Legal Information & Search Technologies

Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems

Jakub Harašta
Jakub Harašta
Category:

Articles

Region:

Czech Republic

Field of law:

Rechtsinformation & Juristische Suchtechnologien

Collection:

Conference proceedings IRIS 2019

Citation: Jakub Harašta, Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems, in: Jusletter IT 21. Februar 2019

This paper is concerned with a critical evaluation of three widely used Czech legal information retrieval systems: ASPI, Beck-online and Codexis. The legal information retrieved from these systems shape the existing Czech legal practice. Thus, the issue of how reliable their results are when compared to each other is of utmost importance. The paper reports results of an experiment aiming to frame the discussion on information retrieval from the Czech systems. The experiment uses relation-based searches to create three sets of court decisions. The union of these sets establishes ideal databases for individual research tasks that allow for a comparison of the Recall and the Precision of the individual systems. To assess relevance of documents in a system-independent way, three lawyers (two experts and a non-expert) provided for a binary coding of the relevance of the individual court decisions.


Table of contents

  • 1. Introduction
  • 2. Related Work
    • 2.1. Information Retrieval
    • 2.2. Relevance in Information Retrieval
  • 3. Experiment Design
    • 3.1. General Framework and Research Questions
    • 3.2. Retrieval of Case Law
    • 3.3. Manual Selection of Relevant Pairs
  • 4. Results
    • 4.1. General Results
    • 4.2. System-specific Results
  • 5. Discussion
  • 6. Conclusion
  • 7. Acknowledgment and conflict of interest
  • 8. References
Please log in to read the full text.
Register for Campus? More
Login Poster