Effective Event Extraction Method via Enhanced Graph Convolutional Network Indication with Hierarchical Argument Selection Strategy
Abstract
:1. Introduction
- (1)
- We establish a more complete argument extraction template for the Baidu event extraction dataset based on the ACE2005.
- (2)
- We propose an effective event extraction method using trigger events and event classifications detected by EE-GCN as indicators. Moreover, we employ a hierarchical argument selection strategy, which helps in determining the final argument multi-tuple more accurately.
- (3)
- A series of experiments are conducted on the Baidu event extraction dataset to compare the proposed method with other methods, demonstrating that it improves both accuracy and completeness of event extraction compared to existing methods.
2. Related Works
3. Methods
3.1. Argument Role Table Construction for Baidu Dataset
3.2. Event Multi-Argument Extraction
3.2.1. Generation of Argument Indicators Based on EE-GCN
3.2.2. Extraction of Alternative Arguments
Algorithm 1 ERAR based on NER |
Input: Event type E, Event Argument Dataset S, the initial empty argument dictionary D, Input text T. Output: the final argument dictionary D. |
|
|
3.3. Hierarchical Argument Selection Strategy
3.3.1. The Selection of Arguments Based on the Degree of Local Correlation
3.3.2. Argument Selection Based on the Global Correlation Degree
3.3.3. Event Multi-Tuple Generation
4. Experiment
4.1. Experimental Environment
4.2. Extracting the Event Multi-Tuple
4.2.1. Extraction of Alternative Arguments
4.2.2. Selecting of Alternative Arguments
4.3. Case Study of the Comparison Experiment
4.4. Statistical Analysis of the Comparison Experiment
5. Concluding Remarks
Author Contributions
Funding
Institutional Review Board Statement
Data Availability Statement
Conflicts of Interest
References
- Zhan, L.; Jiang, X. Survey on event extraction technology in information extraction research area. In Proceedings of the IEEE 3rd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chengdu, China, 15–17 March 2019; pp. 2121–2126. [Google Scholar]
- Xiang, W.; Wang, B.; Bang, W. A survey of event extraction from text. IEEE Access 2019, 7, 173111–173137. [Google Scholar] [CrossRef]
- Conlon, S.J.; Abrahams, A.S.; Simmons, L.L. Terrorism information extraction from online reports. J. Comput. Inf. Syst. 2015, 55, 20–28. [Google Scholar] [CrossRef]
- Tanev, H.; Piskorski, J.; Atkinson, M. Real-time news event extraction for global crisis monitoring. In Proceedings of the 13th International Conference on Applications of Natural Language to Information Systems (NLDB 2008), London, UK, 24–27 June 2008; pp. 207–218. [Google Scholar]
- Atkinson, M.; Du, M.; Piskorski, J.; Tanev, H.; Yangarber, R.; Zavarella, V. Techniques for multilingual security-related event extraction from online news. In Computational Linguistics; Springer: Berlin, Germany, 2013; pp. 163–186. [Google Scholar]
- Nuij, W.; Hogenboom, F.; Frasincar, F.; Kaymak, U. An automated framework for incorporating news into stock trading strategies. IEEE Trans. Knowl. Data Eng. 2014, 26, 823–835. [Google Scholar] [CrossRef]
- Capet, P.; Delavallade, T.; Nakamura, T.; Sandor, A.; Tarsitano, C.; Voyatzi, S. A risk assessment system with automatic extraction of event types. In Proceedings of the Intelligent Information Processing IV: 5th IFIP International Conference on Intelligent Information Processing, Beijing, China, 19–22 October 2008; pp. 220–229. [Google Scholar]
- Vanegas, J.A.; Matos, S.; González, F.; Oliveira, J.L. An overview of biomolecular event extraction from scientic documents. Comput. Math. Methods Med. 2015, 2015, 571381. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Zhang, J.; Li, X.; Tian, J.; Jiang, Y.; Luo, H.; Yin, S. A variational local weighted deep sub-domain adaptation network for remaining useful life prediction facing cross-domain condition. Reliab. Eng. Syst. Saf. 2023, 231, 108986. [Google Scholar] [CrossRef]
- Zhang, J.; Li, X.; Tian, J.; Luo, H.; Yin, S. An integrated multi-head dual sparse self-attention network for remaining useful life prediction. Reliab. Eng. Syst. Saf. 2023, 233, 109096. [Google Scholar] [CrossRef]
- Cui, S.; Yu, B.; Liu, T.; Zhang, Z.; Wang, X.; Shi, J. Edge-enhanced graph convolution networks for event detection with syntactic relation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2020), Online, 16–20 November 2020; p. 10757. [Google Scholar]
- Grishman, R. Information extraction: Techniques and challenges. In Lecture Notes in Computer Science; Springer: Cham, Switzerland, 1997; pp. 10–27. [Google Scholar]
- Kipf, T.N.; Welling, M. Semi-supervised classification with graph convolutional networks. arXiv 2016, arXiv:1609.02907. [Google Scholar]
- Orr, J.W.; Tadepalli, P.; Fern, X. Event detection with neural networks:A rigorous empirical evaluation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, 31 October–4 November 2018; pp. 999–1004. [Google Scholar]
- Nguyen, T.H.; Grishman, R. Graph convolutional networks with argumant-aware pooling for event detection. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence, New Orleans, LO, USA, 2–7 February 2018; pp. 5900–5907. [Google Scholar]
- Ahn, D. The stages of event extraction. In Proceedings of the Workshop on Annotating and Rcasoning about Time and Events, Sydney, Australia, 23 July 2006; pp. 1–8. [Google Scholar]
- Ji, H.; Grishman, R. Refining event extraction through cross-document inference. In Proceedings of the Meeting of the Association for Computational Linguistics, Columbus, OH, USA, 15–20 June 2008; pp. 254–262. [Google Scholar]
- Liao, S.; Grishman, R. Using document level cross-event inference to improve eventextraction. In Proceedings of the Meeting of the Association for Computational Linguistics, Uppsala, Sweden, 11–16 July 2010; pp. 789–797. [Google Scholar]
- Liu, S.; Liu, K.; He, S.Z.; Zhao, J. A Probabilistic Soft Logic based approach to exploiting latent and global information in event classification. In Proceedings of the 30th AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA, 12–17 February 2016; pp. 2993–2999. [Google Scholar]
- Nguyen, T.H.; Cho, K.; Grishman, R. Joint event extraction via recurent neural networks. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics, San Diego, CA, USA, 12–17 June 2016; pp. 300–309. [Google Scholar]
- Li, Q.; Wan, H.; Huang, L. Joint event extraction via structured prediction with global features. In Proceedings of the Meeting of the Association for Computational Linguistics, Sofia, Bulgaria, 4–9 August 2013; pp. 73–82. [Google Scholar]
- Walker, C.; Strassel, S.; Medero, J.; Maeda, K. ACE 2005 Multilingual Training Corpus LDC2006T06; Web Download; Linguistic Data Consortium: Philadelphia, PA, USA, 2006. [Google Scholar]
- Qi, P.; Zhang, Y.; Zhang, Y.; Bolton, J.; Manning, C.D. Stanza: A Python natural language processing toolkit for many human languages. In Proceedings of the Association for Computational Linguistics (ACL) System Demonstrations, Online, 5–10 July 2020. [Google Scholar]
- Zhang, J.; Tian, J.; Li, M.; Leon, J.I.; Franquelo, L.G.; Luo, H.; Yin, S. A parallel hybrid neural network with integration of spatial and temporal features for remaining useful life prediction in prognostics. IEEE Trans. Instrum. Meas. 2022, 72, 1–12. [Google Scholar] [CrossRef]
- Zhang, J.; Huang, C.; Chow, M.Y.; Li, X.; Tian, J.; Luo, H.; Yin, S. A Data-model Interactive Remaining Useful Life Prediction Approach of Lithium-ion Batteries Based on PF-BiGRU-TSAM. IEEE Trans. Ind. Inform. 2023. [Google Scholar] [CrossRef]
- Akbik, A.; Blythe, D.; Vollgraf, R. Contextual String Embeddings for Sequence Labeling. In Proceedings of the 27th International Conference on Computational Linguistics, Santa Fe, NM, USA, 20–26 August 2018; pp. 1638–1649. [Google Scholar]
- Li, X.; Li, F.; Pan, L.; Chen, Y.; Peng, W.; Wang, Q.; Lyu, Y.; Zhu, Y. DuEE: A Large-scale dataset for chinese event extraction in real-world scenarios. In Proceedings of the Natural Language Processing and Chinese Computing: 9th CCF International Conference (NLPCC 2020), Zhengzhou, China, 14–18 October 2020; pp. 534–545. [Google Scholar]
Event Type | Event Argument Role [Entity Type] |
---|---|
finance/trading—listing | location [GPE LOC FAC] |
listed enterprises [ORG] | |
amount of financing [MONEY] | |
product behavior—publish | time [DATE TIME] |
publish products [PRODUCT WORK_OF_ART] | |
publisher [PERSON ORG GPE NORP] | |
product behavior—release | time [DATE TIME] |
release party [ORG] | |
release film and television [WORK_OF_AR] | |
competitive behavior—winning | time [DATE TIME] |
winner [PERSON ORG] | |
championship event [EVENT] | |
life—marriage | time [DATE TIME] |
married parties [PERSON] | |
… | … |
Sentence ID | 1 |
---|---|
Sentence | Tsingtao Brewery shares (00168) employee representative supervisor Xing Jun resigned. |
Indicator | trigger: resign Event Type: organizational relationship—resignation |
Alternative arguments | time: [] resigned person: [‘Xing Jun’] original organization: [‘Tsingtao Brewery Shares’] |
Sentence ID | 2 |
---|---|
Sentence | A man named Ma has been suspended and is being investigated by the county’s discipline inspection commission, according to a person in charge of the county management over-speed station on June 4. |
Indicator | trigger: suspension Event Type: organizational relations—suspension |
Alternative arguments | time: [‘June 4’] organization: [‘the county management over-speed station’, ‘county’s discipline inspection commission’] suspended person: [‘Ma’] |
Sentence ID | 3 |
---|---|
Sentence | At the 2019 Chongqing International Auto Show, Changan officially published Yidong and CS35 PLUS with a 1.4 T engine. |
Indicator | trigger: publish Event Type : product behavior—publish |
Alternative arguments | time: [‘2019’] publish products: [‘Yidong’, ‘CS35PLUS’, ‘1.4 T engine’] publisher: [‘Chang’ an’] |
Sentence ID | 4 |
---|---|
Sentence | On July 18, the reporter learned from the provincial flood control and disaster reduction work dispatch meeting that since July 16, Dazhou City has experienced heavy rainfall. Affected by rainfall, Dazhou City’s main rivers have suffered varying degrees of flooding. |
Indicator | trigger: flood Event Type: disaster/accident—flood |
Alternative arguments | time: [‘16 July’, ‘18 July’] location: [‘Dazhou City’] |
Sentence ID | Alternative Arguments | Results of the Selection Based on Local Association | Results of the Selection Based on Global Association |
---|---|---|---|
2 | time: [‘June 4’] organization: [‘the county management over-speed station’, ‘county’s discipline inspection commission’] suspended person: [‘Ma’] | organization:{confirmed argument 1: [‘the county management over-speed station’] to-be-confirmed argument: [‘county’s discipline inspection commission’]}) | organization: {confirmed argument 2: []} |
3 | time: [‘2019’] publish products: [‘Yidong’, ‘CS35PLUS’, ‘1.4 T engine’] publisher: [‘Chang’ an’] | publish products: {confirmed argument 1: [‘Yidong’] to-be-confirmed arguments: [‘CS35PLUS’,’1.4 T engine’]} | publish product: {confirmed argument 2: [‘CS35PLUS’]} |
4 | time: [‘16 July’, ‘18 July’] location: [‘Dazhou City’] | time:{confirmed argument 1: [‘16 July’] to-be-confirmed arguments: [‘18 July’]} | time: {confirmed argument 2: []} |
Sentence | Event Multi-Tuple | |
---|---|---|
2 | A man named Ma, has been suspended and is being investigated by the county’s discipline inspection commission, according to a person in charge of the county management over-speed station on June 4. | organizational relations-suspension Trigger: suspension time: [‘June 4’] Argument: organization: [‘the county management over-speed station’] Argument: suspended person: [‘Ma ‘] |
3 | At the 2019 Chongqing International Auto Show, Changan officially published Yidong and CS35 PLUS with a 1.4 T engine. | Event Type: product behavior—publish Trigger: publish Argument: time: [‘2019’] Argument: publish product: [‘Yidong’, ’CS35PLUS’] Argument: publisher: [‘Chang’ an ‘] |
4 | On July 18, the reporter learned from the provincial flood control and disaster reduction work dispatch meeting that since July 16, Dazhou City has experienced heavy rainfall. Affected by rainfall, Dazhou City’s main rivers have suffered varying degrees of flooding. | Event Type: disaster/accident—flood Trigger: flood Argument: time: [‘July 16th’] Argument: location: [‘Dazhou City’] |
Sentence ID | Sentence | Our | LTP |
---|---|---|---|
1 | Tsingtao Brewery shares (00168) employee representative supervisor Xing Jun resigned. | Event Type: organizational relationship-resignation Trigger: resignation Argument: resigned person: Xing Jun Argument: original organization: Tsingtao Brewery shares | [] |
2 | A man named Ma has been suspended and is being investigated by the county’s discipline inspection commission, according to a person in charge of the county management over-speed station on June 4. | Event Type: organizational relations-suspension Trigger: suspension Argument: time: [‘June 4th’] Argument: organization: [‘the county management over-speed station’] Argument: suspended person: [‘Ma’] | Trigger: intervene Argument: entity: county’s discipline inspection commission Argument: time:for now, June 4th |
3 | At the 2019 Chongqing International Auto Show, Changan officially published Yidong and CS35 PLUS with a 1.4 T engine. | Event Type: product behavior-publish Trigger: publish Argument: time: [‘2019’] Argument: publish product: [‘Yidong’, ‘CS35PLUS’] Argument: publisher: [‘Chang’ an ‘] | Trigger: publish Argument: publisher: Chang’ an Argument: publish product: equipped with a 1.4 T engine) Argument: time: 2019 |
Sentence ID | Sentence | Our | ERINE |
---|---|---|---|
1 | Tsingtao Brewery shares (00168) employee representative supervisor Xing Jun resigned. | Event Type: organizational relationship-resignation Trigger: resignation Argument: resigned person: Xing Jun Argument: original organization: Tsingtao Brewery shares | Event Type: organizational relationship-resignation Trigger: resignation Argument: resigned person: employee representative supervisor Xing Jun Argument: original organization: Tsingtao Brewery shares |
2 | A man named Ma has been suspended and is being investigated by the county’s discipline inspection commission, according to a person in charge of the county management over-speed station on June 4. | Event Type: organizational relations-suspension Trigger: suspension Argument: time: [‘June 4th’] Argument: organization: [‘the county management over-speed station’] Argument: suspended person: [‘Ma’] | Event Type: organizational relations-suspension Trigger: suspension Argument: suspension person:negative) Argument: suspended person: [‘The involved man, Ma’] |
4 | On July 18, the reporter learned from the provincial flood control and disaster reduction work dispatch meeting that since July 16, Dazhou City has experienced heavy rainfall. Affected by rainfall, Dazhou City’s main rivers have suffered varying degrees of flooding. | Event Type: disaster/accident—flood Trigger: flood Argument: time: [‘July 16th’] Argument: location: [‘Dazhou City’] | Event Type: disaster/accident—flood Trigger: flood Argument: time: [‘July 16th’] Argument: location: Dazhou City Argument: location: the main rivers of Dazhou city |
Systems | Coverage | Precision | Recall | F1 |
---|---|---|---|---|
LTP | 69.8 | 79.7 | 76.5 | 75.1 |
ERINE | 94.8 | 83.9 | 86.8 | 88.3 |
OUR | 97.5 | 87.4 | 85.6 | 89.9 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Liu, Z.; Li, Y.; Zhang, Y.; Weng, Y.; Yang, K.; Chaomurilige. Effective Event Extraction Method via Enhanced Graph Convolutional Network Indication with Hierarchical Argument Selection Strategy. Electronics 2023, 12, 2981. https://doi.org/10.3390/electronics12132981
Liu Z, Li Y, Zhang Y, Weng Y, Yang K, Chaomurilige. Effective Event Extraction Method via Enhanced Graph Convolutional Network Indication with Hierarchical Argument Selection Strategy. Electronics. 2023; 12(13):2981. https://doi.org/10.3390/electronics12132981
Chicago/Turabian StyleLiu, Zheng, Yimeng Li, Yu Zhang, Yu Weng, Kunyu Yang, and Chaomurilige. 2023. "Effective Event Extraction Method via Enhanced Graph Convolutional Network Indication with Hierarchical Argument Selection Strategy" Electronics 12, no. 13: 2981. https://doi.org/10.3390/electronics12132981