Task 3 Results
| Rank | Team | Run | Accuracy | Correct | Sufficiently retrieved | Accurracy for Sufficiently retrieved | F2 | Precision | Recall |
|---|---|---|---|---|---|---|---|---|---|
| 1 | NOWJ | NOWJ_run1 | 0.9512 | 78 | 82 | 0.9512 | 0.2224 | 0.0549 | 1.0000 |
| 2 | JNLP | JNLP1 | 0.9024 | 74 | 82 | 0.9024 | 0.7796 | 0.5151 | 1.0000 |
| 3 | NOWJ | NOWJ_run2 | 0.8902 | 73 | 82 | 0.8902 | 0.2224 | 0.0549 | 1.0000 |
| 3 | NOWJ | NOWJ_run3 | 0.8902 | 73 | 82 | 0.8902 | 0.2224 | 0.0549 | 1.0000 |
| 5 | cody | codyrag | 0.8537 | 70 | 82 | 0.8537 | 0.1848 | 0.0439 | 1.0000 |
| 6 | Bengo | BengoR2E2 | 0.8293 | 68 | 79 | 0.8608 | 0.9242 | 0.8364 | 0.9797 |
| 7 | HUKB | HUKBmix | 0.8171 | 67 | 76 | 0.8816 | 0.9446 | 0.9431 | 0.9553 |
| 8 | Bengo | BengoR2E1 | 0.8171 | 67 | 79 | 0.8481 | 0.9242 | 0.8364 | 0.9797 |
| 9 | HUKB | HUKBsoft | 0.8171 | 67 | 76 | 0.8816 | 0.9076 | 0.8465 | 0.9492 |
| 19 | HUKB | HUKBbase | 0.8049 | 66 | 75 | 0.8800 | 0.9304 | 0.9248 | 0.9431 |
| 11 | Bengo | BengoR1E1 | 0.8049 | 66 | 78 | 0.8462 | 0.9187 | 0.8364 | 0.9695 |
| 12 | SCIlab | SCIlab1 | 0.8049 | 66 | 76 | 0.8684 | 0.0612 | 0.0132 | 0.9268 |
| 13 | JNLP | JNLP2 | 0.7927 | 65 | 82 | 0.7927 | 0.7796 | 0.5151 | 1.0000 |
| 14 | DU | DU2 | 0.7927 | 65 | 78 | 0.8333 | 0.3168 | 0.0874 | 0.9654 |
| 15 | cody | codygrag2 | 0.7927 | 65 | 81 | 0.8025 | 0.2197 | 0.0554 | 0.9939 |
| 16 | JNLP | JNLP3 | 0.7805 | 64 | 82 | 0.7805 | 0.7796 | 0.5151 | 1.0000 |
| 17 | cody | codygrag1 | 0.7683 | 63 | 73 | 0.8630 | 0.7446 | 0.5764 | 0.9024 |
| 18 | DU | DU | 0.7683 | 63 | 76 | 0.8289 | 0.5383 | 0.2024 | 0.9431 |
| 19 | DU1 | DU1 | 0.7561 | 62 | 79 | 0.7848 | 0.2712 | 0.0707 | 0.9776 |
| 20 | AIIR | AIIRjpgen | 0.5854 | 48 | 63 | 0.7619 | 0.4481 | 0.1707 | 0.7785 |
| 21 | AIIR | AIIRjpllm | 0.5732 | 47 | 64 | 0.7344 | 0.4606 | 0.1770 | 0.7947 |
| 22 | AIIR | AIIRjpsw | 0.5000 | 41 | 46 | 0.8913 | 0.5474 | 0.5183 | 0.5915 |