Table 3

Ad hoc retrieval results. All runs, sorted by mean average precision.

Run
Group (reference)
Manual/Automatic
Mean Average Precision
Relevant at 10 documents
Relevant at 100 documents

pllsgen4a2
patolis.fujita [20]
A
0.4075
6.04
41.96
uwmtDg04tn
u.waterloo.clarke [21]
A
0.3867
6.24
42.1
pllsgen4a1
patolis.fujita [20]
A
0.3689
5.7
39.36
THUIRgen01
tsinghua.ma [22]
M
0.3435
5.82
39.24
THUIRgen02
tsinghua.ma [22]
A
0.3434
5.94
39.44
utaauto
u.tampere [24]
A
0.3324
5.02
32.26
uwmtDg04n
u.waterloo.clarke [21]
A
0.3318
5.68
36.84
PSE
german.u.cairo [35]
A
0.3308
5.86
36.66
tnog3
tno.kraaij [36]
A
0.3247
5.6
36.56
tnog2
tno.kraaij [36]
A
0.3196
5.62
36.04
utamanu
u.tampere [24]
M
0.3128
6.52
38.88
aliasiBase
alias-i [23]
A
0.3094
5.38
34.58
ConversManu
converspeech [37]
M
0.2931
5.82
37.18
RMITa
rmit.scholer [38]
A
0.2796
5.12
31.4
aliasiTerms
alias-i [23]
A
0.2656
4.8
30.3
akoike
u.tokyo (none)
M
0.2427
4.48
31.3
OHSUNeeds
ohsu.hersh [25]
A
0.2343
3.84
26.46
tgnSplit
tarragon [39]
A
0.2319
4.86
29.26
UIowaGN1
u.iowa [40]
A
0.2316
4.76
28.5
tq0
nlm.umd.ul [28]
A
0.2277
5.12
30.1
OHSUAll
ohsu.hersh [25]
A
0.2272
4.32
27.76
LHCUMDSE
nlm.umd.ul [28]
A
0.2191
3.9
24.18
akoyama
u.tokyo (none)
M
0.2155
4.52
25.62
PDTNsmp4
u.padova [41]
A
0.2074
4.56
23.18
PD50501
u.padova [41]
A
0.2059
4.42
25.18
RMITb
rmit.scholer [38]
A
0.2059
4.56
27.26
UBgtNormJM1
suny.buffalo [42]
A
0.2043
4.34
25.38
ConversAuto
converspeech [37]
A
0.2013
3.88
22.8
york04g2
york.u [43]
M
0.2011
5.5
25.8
tgnNecaux
tarragon [39]
A
0.1951
4.08
23.58
lga1
indiana.u.seki [26]
A
0.1833
3.08
22.86
york04g1
york.u [43]
A
0.1794
4.14
26.96
lga2
indiana.u.seki [26]
A
0.1754
3.1
20.22
rutgersGAH1
rutgers.dayanik [44]
A
0.1702
4.66
26.76
wdvqlxa1
indiana.u.yang [45]
A
0.1582
4.2
24.78
wdvqlx1
indiana.u.yang [45]
A
0.1569
4.26
24.26
DCUmatn1
dubblincity.u [46]
M
0.1388
3.28
17.84
BioTextAdHoc
u.cberkeley.hearst [27]
A
0.1384
3.76
23.76
shefauto2
u.sheffield.gaizauskas [47]
A
0.1304
3.66
18.5
rutgersGAH2
rutgers.dayanik [44]
A
0.1303
3.42
19.48
shefauto1
u.sheffield.gaizauskas [47]
A
0.1294
3.54
18.92
run1
utwente (none)
M
0.1176
1.5
10.5
MeijiHilG
meiji.u [48]
A
0.0924
2.1
15.24
DCUma
dubblincity.u [46]
M
0.0895
2.4
15.46
csusm
u.sanmarcos [49]
M
0.0123
0.44
1.6
edinauto2
u.edinburgh.sinclair [50]
A
0.0017
0.46
1.6
edinauto5
u.edinburgh.sinclair [50]
A
0.0012
0.36
1.3
Mean


0.2074
4.48
26.46

Hersh et al. Journal of Biomedical Discovery and Collaboration 2006 1:3   doi:10.1186/1747-5333-1-3