A comprehensive review of existing corpora and methods for creating annotated corpora for event extraction tasks
, , , , and | Nov 19, 2024
Article Category: Review Papers
Published Online: Nov 19, 2024
Page range: 196 - 238
Received: Apr 27, 2024
Accepted: Sep 03, 2024
Keywords
© 2024 Mohd Hafizul Afifi Abdullah et al., published by Sciendo
This work is licensed under the Creative Commons Attribution 4.0 International License.
Purpose
The purpose of this study is to serve as a comprehensive review of the existing annotated corpora. This review study aims to provide information on the existing annotated corpora for event extraction, which are limited but essential for training and improving the existing event extraction algorithms. In addition to the primary goal of this study, it provides guidelines for preparing an annotated corpus and suggests suitable tools for the annotation task.
Design/methodology/approach
This study employs an analytical approach to examine available corpus that is suitable for event extraction tasks. It offers an in-depth analysis of existing event extraction corpora and provides systematic guidelines for researchers to develop accurate, high-quality corpora. This ensures the reliability of the created corpus and its suitability for training machine learning algorithms.
Findings
Our exploration reveals a scarcity of annotated corpora for event extraction tasks. In particular, the English corpora are mainly focused on the biomedical and general domains. Despite the issue of annotated corpora scarcity, there are several high-quality corpora available and widely used as benchmark datasets. However, access to some of these corpora might be limited owing to closed-access policies or discontinued maintenance after being initially released, rendering them inaccessible owing to broken links. Therefore, this study documents the available corpora for event extraction tasks.
Research limitations
Our study focuses only on well-known corpora available in English and Chinese. Nevertheless, this study places a strong emphasis on the English corpora due to its status as a global lingua franca, making it widely understood compared to other languages.
Practical implications
We genuinely believe that this study provides valuable knowledge that can serve as a guiding framework for preparing and accurately annotating events from text corpora. It provides comprehensive guidelines for researchers to improve the quality of corpus annotations, especially for event extraction tasks across various domains.
Originality/value
This study comprehensively compiled information on the existing annotated corpora for event extraction tasks and provided preparation guidelines.