COLIEE 2025
Welcome to the 12th Competition on Legal Information Extraction and Entailment (COLIEE-2025).
This competition is run in association with the International Conference on Artificial Intelligence and Law (ICAIL) 2025 (opens in a new tab). June 20, 2025, Northwestern University, Chicago + Online (Hybrid)
Latest Updates
- 26th January 2025: COLIEE-2025 is run with ICAIL2025, Schedule is updated.
- 28th January 2025: Paper submission format is updated.
- 15th February 2025: Test data for Task 3 and pilot tasks are released. Result submission format updated. Schedule is updated.
- 24th February 2025: Task 4 Submission (opens in a new tab) is updated.
- 3rd June 2025: ICAIL Conference Schedule posted with complete paper titles and author information.
Registration and Contact
Please register here by submitting necessary forms. If you have any questions, please contact coliee_participation@nii.ac.jp.
Competition Tasks
COLIEE-2025 includes four tasks:
Task 1: Legal Case Retrieval
Task 2: Legal Case Entailment
Task 3: Statute Law Retrieval
Task 4: Legal Textual Entailment
Pilot Task: A pilot task featuring a Japanese Legal Judgment Prediction.
Accepted Papers
The following papers have been accepted for presentation at COLIEE 2025:
KIS: COLIEE 2025 Task 4 Solver Using Japanese LLM
Takaaki Onaga, Yoshinobu Kano
SIL@COLIEE 2025: A Cascading Framework for Finding Relevant Case Laws
Bhavya Jain, Pooja Harde, Taha Sadikot, Eric Namit Kujur, Sarika Jain
IRNLPUI at COLIEE 2025: Utilization of LLMs for Statute Law Retrieval and Legal Entailment Task
Bryan Tjandra, Made Swastika Nata Negara, Alfan Farizki Wicaksono
LLMs, Knowledge Graphs, and Hybrid Search: Task-Specific Approaches to Legal AI in COLIEE
Sabine Wehnert, Bhavya Baburaj Chovatta Valappil, Ernesto William De Luca
Investigating Expert-Based Prompt Engineering for Legal Entailment Tasks
Cor Steging, Ludi van Leeuwen, Tadeusz Zbiegień, Dries Wedda, Junjun Liu
Leveraging Rhetorical Role-Based Summarization for Legal Case Retrieval
Tebo K. Leburu-Dingalo, Edwin Thuma, Gontlafetse Mosweunyane, Nkwebi P. Motlogelwa, Monkgogi N. Mudongo
A ModernBERT-Based System by Team KIS for the COLIEE 2025 Pilot Task: Toward Robust Evaluation in Legal Judgment Prediction
Kazuma Kadowaki, Yoshinobu Kano
AIIR Lab at COLIEE 2025: Exploring Applications of Large Language Models for Legal Text Retrieval and Entailment
Deiby Wu, Sarah Lawrence, Behrooz Mansouri
From TF-IDF to Instruction-Tuned LLMs: Hybrid Legal Reasoning Systems for COLIEE 2025
Euijin Baek, Jiayi Dai, H M Quamran Hasan, Yeji Kim, Housam Khalifa Bashier Babiker, Mi-Young Kim, Randy Goebel
NOWJ@COLIEE 2025: A Multi-stage Framework Integrating Embedding Models and Large Language Models for Legal Retrieval and Entailment
Hoang-Trung Nguyen, Tan-Minh Nguyen, Xuan-Bach Le, Tuan-Kiet Le, Khanh-Huyen Nguyen, Ha-Thanh Nguyen, Thi-Hai-Yen Vuong, Le-Minh Nguyen
UQLegalAI@COLIEE2025: Advancing Legal Case Retrieval with Large Language Models and Graph Neural Networks
Yanran Tang, Ruihong Qiu, Zi Huang
JNLP at COLIEE 2025: Hybrid Large Language Model-based Framework for Legal Information Retrieval and Entailment
Hai Nguyen, Hiep Nguyen, Trang Pham, Minh Nguyen, An Trieu, Dinh-Truong Do, Nguyen-Khang Le, Le-Minh Nguyen
CAPTAIN at COLIEE 2025: Enhancing Legal Text Processing and Structural Analysis with Large Language Models
Dat Nguyen, Minh-Phuong Nguyen, Quang-Huy Chu, Son T. Luu, Nguyen-Hoang Chu, Trung Vo, Le-Minh Nguyen
Hierarchical and Referential Structure-Aware Retrieval for Statutory Articles using Graph Neural Networks
Takao Mizuno, Yoshinobu Kano
Note: Highlighted names in yellow indicate the presenters for each paper.
Sponsors
Citations
For the overview and fundamental ideas of the COLIEE, please cite the paper below:
- Rabelo, J., Kim, M. Y., Goebel, R., Yoshioka, M., Kano, Y., & Satoh, K. (2022). Overview and Discussion of the Competition on Legal Information Extraction/Entailment (COLIEE) 2021. Pages 111-133. DOI: 10.1007/s12626-022-00105-z
Recommended citation for COLIEE 2025 (overview paper of COLIEE 2025) will be informed before the submission of the final paper.
Committee
Organizers
- Ken Satoh (Center for Juris-informatics, ROIS-DS , Japan)
- Randy Goebel (University of Alberta, Canada)
- Mi-Young Kim (University of Alberta, Canada)
- Yoshinobu Kano (Shizuoka University, Japan)
- Masaharu Yoshioka (Hokkaido University, Japan)
- Juliano Rabelo (Jurisage and University of Alberta, Canada)
- Calum Kwan (University of Alberta, Canada)
- Hiroaki Yamada (Institute of Science Tokyo, Japan)
Program Committee
- Randy Goebel (University of Alberta, Canada)
- Yoshinobu Kano (Shizuoka University, Japan)
- Mi-Young Kim (University of Alberta, Canada)
- Maria Navas Loro (Technical University of Madrid, Spain)
- Nguyen Le Minh (JAIST, Japan)
- Juliano Rabelo (Jurisage and University of Alberta, Canada)
- Julien Rossi (University of Amsterdam, Netherlands)
- Ken Satoh (Center for Juris-informatics, ROIS-DS , Japan)
- Jaromir Savelka (University of Pittsburgh, USA)
- Yunqiu Shao (Tsinghua University, China)
- Akira Shimazu (JAIST, Japan)
- Satoshi Tojo (JAIST, Japan)
- Vu Tran (JAIST, Japan)
- Josef Valvoda (Københavns Universitet, Denmark)
- Hannes Westermann (University of Montreal, Canada)
- Hiroaki Yamada (Tokyo Institute of Technology, Japan)
- Masaharu Yoshioka (Hokkaido University, Japan)
- Sabine Wehnert (Otto-von-Guericke-Universität Magdeburg, Germany)