Pilot Task Results
These are the official results of pilot tasks. There are 12 official submissions from 4 teams.
In Pilot Task, note that to make official submissions, every team should choose at most three runs from their visible runs on the leaderboard system, and submit their system descriptions to coliee comittee via e-mail by 15 Mar 2026.
To secure the final ranking results, a team has to submit its paper to COLIEE local proceedings.
Tort Prediction
| Rank | Run | Team | Affiliation | Accuracy |
|---|---|---|---|---|
| 1 | JAIST-LJPJT25-TP | JNLP | Japan Advanced Institute of Science and Technology | 72.7% |
| 2 | TortNLP4 | UIT | University of Information Technology, Vietnam National University, Ho Chi Minh City | 72.6% |
| 3 | Qwen25 | JNLP | Japan Advanced Institute of Science and Technology | 68.0% |
| 4 | NOWJ1 | NOWJ | VNU-UET and NII | 67.6% |
| 5 | NOWJ2 | NOWJ | VNU-UET and NII | 67.6% |
| 6 | NOWJ3 | NOWJ | VNU-UET and NII | 67.1% |
| 7 | KIS1 | KIS | Shizuoka University | 66.6% |
| 8 | KIS2 | KIS | Shizuoka University | 64.4% |
| 9 | KIS3 | KIS | Shizuoka University | 64.3% |
| 9 | TortNLP2 | UIT | University of Information Technology, Vietnam National University, Ho Chi Minh City | 64.3% |
| 11 | TortNLP | UIT | University of Information Technology, Vietnam National University, Ho Chi Minh City | 64.0% |
| 12 | Qwen3 | JNLP | Japan Advanced Institute of Science and Technology | 62.3% |
Rationale Extraction
| Rank | Run | Team | Affiliation | F1 (All) |
|---|---|---|---|---|
| 1 | TortNLP4 | UIT | University of Information Technology, Vietnam National University, Ho Chi Minh City | 68.2% |
| 2 | Qwen3 | JNLP | Japan Advanced Institute of Science and Technology | 67.4% |
| 3 | Qwen25 | JNLP | Japan Advanced Institute of Science and Technology | 65.6% |
| 4 | NOWJ2 | NOWJ | VNU-UET and NII | 64.8% |
| 5 | JAIST-LJPJT25-TP | JNLP | Japan Advanced Institute of Science and Technology | 64.5% |
| 6 | NOWJ3 | NOWJ | VNU-UET and NII | 63.4% |
| 6 | NOWJ1 | NOWJ | VNU-UET and NII | 63.4% |
| 8 | KIS2 | KIS | Shizuoka University | 62.6% |
| 9 | TortNLP | UIT | University of Information Technology, Vietnam National University, Ho Chi Minh City | 60.4% |
| 10 | KIS1 | KIS | Shizuoka University | 57.3% |
| 11 | KIS3 | KIS | Shizuoka University | 57.3% |
| 12 | TortNLP2 | UIT | University of Information Technology, Vietnam National University, Ho Chi Minh City | 53.0% |
Online Leaderboards : https://ljpjt26.coliee.org/ (opens in a new tab)
Unofficial Submissions
Any unofficial submissions will not be considered as part of the official rankings. Unofficial submissions are shown just for reference.