Social commonsense reasoning with multi-head knowledge attention

Social Commonsense Reasoning requires understanding of text, knowledge about social events and their pragmatic implications, as well as commonsense reasoning skills. In this work we propose a novel multi-head knowledge attention model that encodes semi-structured commonsense inference rules and lear...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Paul, Debjit (VerfasserIn) , Frank, Anette (VerfasserIn)
Dokumenttyp: Kapitel/Artikel Konferenzschrift
Sprache:Englisch
Veröffentlicht: November 2020
In: Findings of the Association for Computational Linguistics - Findings of ACL: EMNLP 2020
Year: 2020, Pages: 2969-2980
DOI:10.18653/v1/2020.findings-emnlp.267
Online-Zugang:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.18653/v1/2020.findings-emnlp.267
Verlag, lizenzpflichtig, Volltext: https://aclanthology.org/2020.findings-emnlp.267
Volltext
Verfasserangaben:Debjit Paul, Anette Frank

MARC

LEADER 00000caa a2200000 c 4500
001 1852304472
003 DE-627
005 20240307094825.0
007 cr uuu---uuuuu
008 230710s2020 xx |||||o 00| ||eng c
024 7 |a 10.18653/v1/2020.findings-emnlp.267  |2 doi 
035 |a (DE-627)1852304472 
035 |a (DE-599)KXP1852304472 
035 |a (OCoLC)1425226801 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 28  |2 sdnb 
100 1 |a Paul, Debjit  |d 1992-  |e VerfasserIn  |0 (DE-588)1238813046  |0 (DE-627)1766534368  |4 aut 
245 1 0 |a Social commonsense reasoning with multi-head knowledge attention  |c Debjit Paul, Anette Frank 
264 1 |c November 2020 
300 |a 12 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 10.07.2023 
520 |a Social Commonsense Reasoning requires understanding of text, knowledge about social events and their pragmatic implications, as well as commonsense reasoning skills. In this work we propose a novel multi-head knowledge attention model that encodes semi-structured commonsense inference rules and learns to incorporate them in a transformer-based reasoning cell.We assess the model's performance on two tasks that require different reasoning skills: Abductive Natural Language Inference and Counterfactual Invariance Prediction as a new task. We show that our proposed model improves performance over strong state-of-the-art models (i.e., RoBERTa) across both reasoning tasks. Notably we are, to the best of our knowledge, the first to demonstrate that a model that learns to perform counterfactual reasoning helps predicting the best explanation in an abductive reasoning task. We validate the robustness of the model's reasoning capabilities by perturbing the knowledge and provide qualitative analysis on the model's knowledge incorporation capabilities. 
700 1 |a Frank, Anette  |e VerfasserIn  |0 (DE-588)1020288108  |0 (DE-627)691172161  |0 (DE-576)36005689X  |4 aut 
773 0 8 |i Enthalten in  |a Conference on Empirical Methods in Natural Language Processing (2020 : Online)  |t Findings of the Association for Computational Linguistics - Findings of ACL: EMNLP 2020  |d Stroudsburg, PA : Association for Computational Linguistics (ACL), 2020  |g (2020) vom: Nov., Seite 2969-2980  |h 1 Online-Ressource  |w (DE-627)1745087737  |z 9781952148903  |7 nnam 
773 1 8 |g year:2020  |g month:11  |g pages:2969-2980  |g extent:12  |a Social commonsense reasoning with multi-head knowledge attention 
787 0 8 |i Forschungsdaten  |a Paul, Debjit, 1992 -   |t Source code, data and additional material for the thesis: "Social commonsense reasoning with structured knowledge in text"  |d Heidelberg : Universität, 2023  |h 1 Online-Ressource (403 Files)  |w (DE-627)1852302798 
856 4 0 |u https://doi.org/10.18653/v1/2020.findings-emnlp.267  |x Verlag  |x Resolving-System  |z lizenzpflichtig  |3 Volltext 
856 4 0 |u https://aclanthology.org/2020.findings-emnlp.267  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20230710 
993 |a ConferencePaper 
994 |a 2020 
998 |g 1020288108  |a Frank, Anette  |m 1020288108:Frank, Anette  |d 90000  |d 90500  |e 90000PF1020288108  |e 90500PF1020288108  |k 0/90000/  |k 1/90000/90500/  |p 2  |y j 
998 |g 1238813046  |a Paul, Debjit  |m 1238813046:Paul, Debjit  |d 90000  |d 90500  |e 90000PP1238813046  |e 90500PP1238813046  |k 0/90000/  |k 1/90000/90500/  |p 1  |x j 
999 |a KXP-PPN1852304472  |e 4351853840 
BIB |a Y 
JSO |a {"language":["eng"],"person":[{"role":"aut","given":"Debjit","display":"Paul, Debjit","family":"Paul"},{"display":"Frank, Anette","family":"Frank","role":"aut","given":"Anette"}],"name":{"displayForm":["Debjit Paul, Anette Frank"]},"physDesc":[{"extent":"12 S."}],"recId":"1852304472","relHost":[{"id":{"eki":["1745087737"],"isbn":["9781952148903"]},"recId":"1745087737","physDesc":[{"extent":"1 Online-Ressource","noteIll":"Illustrationen"}],"type":{"bibl":"book","media":"Online-Ressource"},"disp":"Conference on Empirical Methods in Natural Language Processing (2020 : Online)Findings of the Association for Computational Linguistics - Findings of ACL: EMNLP 2020","origin":[{"publisherPlace":"Stroudsburg, PA","dateIssuedDisp":"[2020]","dateIssuedKey":"2020","publisher":"Association for Computational Linguistics (ACL)"}],"note":["\"Welcome to the very first volume of 'Findings of ACL', a new publication designed to operate as a \"companion\" to conferences in the ACL stable. This first volume, 'Findings of ACL: EMNLP 2020' comprises papers selected from those submitted to EMNLP 2020 which were not selected to appear at the main conference. Despite this, the Programme Committee recognised the value of these submissions, and deemed them to be strong work, worthy of publication ... We hope that Findings will continue to serve as a companion to future conferences, and become an important venue for excellent, widely-read, and highly cited work in NLP.\" - Vorwort","\"Trevor Cohn, Yulan He, Yang Liu (editors)\" - Startseite der Ressource","Literaturangaben"],"title":[{"title":"Findings of the Association for Computational Linguistics - Findings of ACL: EMNLP 2020","subtitle":"16-20 November, 2020 : Findings","title_sort":"Findings of the Association for Computational Linguistics - Findings of ACL: EMNLP 2020"}],"part":{"text":"(2020) vom: Nov., Seite 2969-2980","extent":"12","year":"2020","pages":"2969-2980"},"titleAlt":[{"title":"Findings of the Association for Computational Linguistics: EMNLP 2020"}],"language":["eng"],"corporate":[{"display":"Conference on Empirical Methods in Natural Language Processing (2020, Online)","role":"aut"},{"role":"isb","display":"Association for Computational Linguistics"}],"person":[{"role":"edt","given":"Trevor","family":"Cohn","display":"Cohn, Trevor"}]}],"id":{"eki":["1852304472"],"doi":["10.18653/v1/2020.findings-emnlp.267"]},"origin":[{"dateIssuedDisp":"November 2020","dateIssuedKey":"2020"}],"note":["Gesehen am 10.07.2023"],"title":[{"title_sort":"Social commonsense reasoning with multi-head knowledge attention","title":"Social commonsense reasoning with multi-head knowledge attention"}],"type":{"bibl":"chapter","media":"Online-Ressource"}} 
SRT |a PAULDEBJITSOCIALCOMM2020