Task 1 Results
| Team | File | F1 | Precision | Recall |
|---|---|---|---|---|
| TQM | task1_test_answer_2024_run1.txt | 0.4432 | 0.5057 | 0.3944 |
| TQM | task1_test_answer_2024_run3.txt | 0.4342 | 0.5082 | 0.3790 |
| UMNLP | task1_umnlp_run1.txt | 0.4134 | 0.4000 | 0.4277 |
| UMNLP | task1_umnlp_run2.txt | 0.4097 | 0.3755 | 0.4507 |
| UMNLP | task1_umnlp_runs_combined.txt | 0.4046 | 0.3597 | 0.4622 |
| YR | task1_yr_run1.json | 0.3605 | 0.3210 | 0.4110 |
| TQM | task1_test_answer_2024_run2.txt | 0.3548 | 0.4196 | 0.3073 |
| YR | task1_yr_run2.json | 0.3483 | 0.3245 | 0.3758 |
| YR | task1_yr_run3.json | 0.3417 | 0.3184 | 0.3688 |
| JNLP | 64b7b-07f39.txt | 0.3246 | 0.3110 | 0.3393 |
| JNLP | 07f39.txt | 0.3222 | 0.3347 | 0.3105 |
| JNLP | 64b7b-48fe5.txt | 0.3103 | 0.3017 | 0.3195 |
| WJY | submit_1.txt | 0.3032 | 0.2700 | 0.3457 |
| BM24 | task1_test_result.txt | 0.1878 | 0.1495 | 0.2522 |
| CAPTAIN | captain_mstr.txt | 0.1688 | 0.1793 | 0.1594 |
| CAPTAIN | captain_ft5.txt | 0.1574 | 0.1586 | 0.1562 |
| NOWJ | nowjtask1run2.txt | 0.1313 | 0.0895 | 0.2465 |
| NOWJ | nowjtask1run3.txt | 0.1306 | 0.0957 | 0.2055 |
| NOWJ | nowjtask1run1.txt | 0.1224 | 0.0813 | 0.2478 |
| WJY | submit_3.txt | 0.1179 | 0.0870 | 0.1831 |
| WJY | submit_2.txt | 0.1174 | 0.0824 | 0.2042 |
| MIG | test1_ans.json | 0.0508 | 0.0516 | 0.0499 |
| UBCS | run3.txt | 0.0276 | 0.0140 | 0.7196 |
| UBCS | run2.txt | 0.0275 | 0.0140 | 0.7177 |
| UBCS | run1.txt | 0.0272 | 0.0139 | 0.7100 |
| CAPTAIN | captain_bm25.txt | 0.0019 | 0.0019 | 0.0019 |
| Total Teams: | 10 | |||
| Total submissions: | 26 |