Table 2

Kappa results. Kappa results for inter-judge agreement in relevant judgments for ad hoc retrieval task.

Judge 2

Definitely relevant

Possibly relevant

Not relevant

Total


Judge 1

Definitely relevant

62

35

8

105

Possibly relevant

11

11

5

27

Not relevant

14

57

456

527

Total

87

103

469

659


Hersh et al. Journal of Biomedical Discovery and Collaboration 2006 1:3   doi:10.1186/1747-5333-1-3

Open Data