|
Kappa results. Kappa results for inter-judge agreement in relevant judgments for ad hoc retrieval task. |
||||
| Judge 2 |
Definitely relevant |
Possibly relevant |
Not relevant |
Total |
|
|
||||
| Judge 1 |
||||
| Definitely relevant |
62 |
35 |
8 |
105 |
| Possibly relevant |
11 |
11 |
5 |
27 |
| Not relevant |
14 |
57 |
456 |
527 |
| Total |
87 |
103 |
469 |
659 |
Hersh et al. Journal of Biomedical Discovery and Collaboration 2006 1:3 doi:10.1186/1747-5333-1-3 |
||||