Overview

COLIEE 2025

Welcome to the 12th Competition on Legal Information Extraction and Entailment (COLIEE-2025).

This competition is run in association with the International Conference on Artificial Intelligence and Law (ICAIL) 2025 (opens in a new tab). June 20, 2025, Northwestern University, Chicago + Online (Hybrid)

The aim of COLIEE is to formulate a challenging legal informatics competition that would engage researchers around the world, and build a community of practice regarding legal information extraction and textual entailment, so that the adoption and adaptation of general methods from a variety of fields is considered, and that participants share their approaches, problems, and results.

Latest Updates

Registration and Contact

Please register here by submitting necessary forms. If you have any questions, please contact coliee_participation@nii.ac.jp.

Competition Tasks

COLIEE-2025 includes four tasks:

Task 1: Legal Case Retrieval

Task 2: Legal Case Entailment

Task 3: Statute Law Retrieval

Task 4: Legal Textual Entailment

Pilot Task: A pilot task featuring a Japanese Legal Judgment Prediction.

Accepted Papers

The following papers have been accepted for presentation at COLIEE 2025:

  • KIS: COLIEE 2025 Task 4 Solver Using Japanese LLM
    Takaaki Onaga, Yoshinobu Kano

  • SIL@COLIEE 2025: A Cascading Framework for Finding Relevant Case Laws
    Bhavya Jain, Pooja Harde, Taha Sadikot, Eric Namit Kujur, Sarika Jain

  • IRNLPUI at COLIEE 2025: Utilization of LLMs for Statute Law Retrieval and Legal Entailment Task
    Bryan Tjandra, Made Swastika Nata Negara, Alfan Farizki Wicaksono

  • LLMs, Knowledge Graphs, and Hybrid Search: Task-Specific Approaches to Legal AI in COLIEE
    Sabine Wehnert, Bhavya Baburaj Chovatta Valappil, Ernesto William De Luca

  • Investigating Expert-Based Prompt Engineering for Legal Entailment Tasks
    Cor Steging, Ludi van Leeuwen, Tadeusz Zbiegień, Dries Wedda, Junjun Liu

  • Leveraging Rhetorical Role-Based Summarization for Legal Case Retrieval
    Tebo K. Leburu-Dingalo, Edwin Thuma, Gontlafetse Mosweunyane, Nkwebi P. Motlogelwa, Monkgogi N. Mudongo

  • A ModernBERT-Based System by Team KIS for the COLIEE 2025 Pilot Task: Toward Robust Evaluation in Legal Judgment Prediction
    Kazuma Kadowaki, Yoshinobu Kano

  • AIIR Lab at COLIEE 2025: Exploring Applications of Large Language Models for Legal Text Retrieval and Entailment
    Deiby Wu, Sarah Lawrence, Behrooz Mansouri

  • From TF-IDF to Instruction-Tuned LLMs: Hybrid Legal Reasoning Systems for COLIEE 2025
    Euijin Baek, Jiayi Dai, H M Quamran Hasan, Yeji Kim, Housam Khalifa Bashier Babiker, Mi-Young Kim, Randy Goebel

  • NOWJ@COLIEE 2025: A Multi-stage Framework Integrating Embedding Models and Large Language Models for Legal Retrieval and Entailment
    Hoang-Trung Nguyen, Tan-Minh Nguyen, Xuan-Bach Le, Tuan-Kiet Le, Khanh-Huyen Nguyen, Ha-Thanh Nguyen, Thi-Hai-Yen Vuong, Le-Minh Nguyen

  • UQLegalAI@COLIEE2025: Advancing Legal Case Retrieval with Large Language Models and Graph Neural Networks
    Yanran Tang, Ruihong Qiu, Zi Huang

  • JNLP at COLIEE 2025: Hybrid Large Language Model-based Framework for Legal Information Retrieval and Entailment
    Hai Nguyen, Hiep Nguyen, Trang Pham, Minh Nguyen, An Trieu, Dinh-Truong Do, Nguyen-Khang Le, Le-Minh Nguyen

  • CAPTAIN at COLIEE 2025: Enhancing Legal Text Processing and Structural Analysis with Large Language Models
    Dat Nguyen, Minh-Phuong Nguyen, Quang-Huy Chu, Son T. Luu, Nguyen-Hoang Chu, Trung Vo, Le-Minh Nguyen

  • Hierarchical and Referential Structure-Aware Retrieval for Statutory Articles using Graph Neural Networks
    Takao Mizuno, Yoshinobu Kano

Note: Highlighted names in yellow indicate the presenters for each paper.

Citations

For the overview and fundamental ideas of the COLIEE, please cite the paper below:

  • Rabelo, J., Kim, M. Y., Goebel, R., Yoshioka, M., Kano, Y., & Satoh, K. (2022). Overview and Discussion of the Competition on Legal Information Extraction/Entailment (COLIEE) 2021. Pages 111-133. DOI: 10.1007/s12626-022-00105-z

Recommended citation for COLIEE 2025 (overview paper of COLIEE 2025) will be informed before the submission of the final paper.

Committee

Organizers

  • Ken Satoh (Center for Juris-informatics, ROIS-DS , Japan)
  • Randy Goebel (University of Alberta, Canada)
  • Mi-Young Kim (University of Alberta, Canada)
  • Yoshinobu Kano (Shizuoka University, Japan)
  • Masaharu Yoshioka (Hokkaido University, Japan)
  • Juliano Rabelo (Jurisage and University of Alberta, Canada)
  • Calum Kwan (University of Alberta, Canada)
  • Hiroaki Yamada (Institute of Science Tokyo, Japan)

Program Committee

  • Akira Shimazu (Japan Advanced Institute of Science and Technology, Japan)
  • Hannes Westermann (University of Montreal, Canada)
  • Hiroaki Yamada (Institute of Science Tokyo, Japan)
  • Jaromir Savelka (University of Pittsburgh, USA)
  • Josef Valvoda (Københavns Universitet, Denmark)
  • Juliano Rabelo (Jurisage and University of Alberta, Canada)
  • Julien Rossi (University of Amsterdam, Netherlands)
  • Ken Satoh (Center for Juris-informatics, ROIS-DS , Japan)
  • Makoto Nakamura (Niigata Institute of Technology, Japan)
  • Maria Navas Loro (Technical University of Madrid, Spain)
  • Masaharu Yoshioka (Hokkaido University, Japan)
  • Mi-Young Kim (University of Alberta, Canada)
  • Nguyen Le Minh (Japan Advanced Institute of Science and Technology, Japan)
  • Randy Goebel (University of Alberta, Canada)
  • Sabine Wehnert (Otto-von-Guericke-Universität Magdeburg, Germany)
  • Satoshi Tojo (Asia University, Japan)
  • Vu Tran (Japan Advanced Institute of Science and Technology, Japan)
  • Yoshinobu Kano (Shizuoka University, Japan)
  • Yunqiu Shao (Tsinghua University, China)
Last updated on
Schedule