Weisfeiler-Leman in the bamboo [bamboo]: novel AMR graph metrics and a benchmark for AMR graph similarity
Several metrics have been proposed for assessing the similarity of (abstract) meaning representations (AMRs), but little is known about how they relate to human similarity ratings. Moreover, the current metrics have complementary strengths and weaknesses: Some emphasize speed, while others make the...
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
12/2021
|
| In: |
Transactions of the Association for Computational Linguistics
Year: 2021, Jahrgang: 9, Pages: 1425-1441 |
| ISSN: | 2307-387X |
| DOI: | 10.1162/tacl_a_00435 |
| Online-Zugang: | Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1162/tacl_a_00435
|
| Verfasserangaben: | Juri Opitz, Angel Daza, Anette Frank |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1795730196 | ||
| 003 | DE-627 | ||
| 005 | 20220820145034.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 220316s2021 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1162/tacl_a_00435 |2 doi | |
| 035 | |a (DE-627)1795730196 | ||
| 035 | |a (DE-599)KXP1795730196 | ||
| 035 | |a (OCoLC)1341446063 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 28 |2 sdnb | ||
| 100 | 1 | |a Opitz, Juri |d 1988- |e VerfasserIn |0 (DE-588)117985876X |0 (DE-627)1067540032 |0 (DE-576)518394263 |4 aut | |
| 245 | 1 | 0 | |a Weisfeiler-Leman in the bamboo [bamboo] |b novel AMR graph metrics and a benchmark for AMR graph similarity |c Juri Opitz, Angel Daza, Anette Frank |
| 246 | 3 | 0 | |a Bambus |
| 264 | 1 | |c 12/2021 | |
| 300 | |a 17 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Im Titel steht [bamboo] als bildliche Darstellung | ||
| 500 | |a Gesehen am 16.03.2022 | ||
| 520 | |a Several metrics have been proposed for assessing the similarity of (abstract) meaning representations (AMRs), but little is known about how they relate to human similarity ratings. Moreover, the current metrics have complementary strengths and weaknesses: Some emphasize speed, while others make the alignment of graph structures explicit, at the price of a costly alignment step.In this work we propose new Weisfeiler-Leman AMR similarity metrics that unify the strengths of previous metrics, while mitigating their weaknesses. Specifically, our new metrics are able to match contextualized substructures and induce n:m alignments between their nodes. Furthermore, we introduce a Benchmark for AMR Metrics based on Overt Objectives (Bamboo), the first benchmark to support empirical assessment of graph-based MR similarity metrics. Bamboo maximizes the interpretability of results by defining multiple overt objectives that range from sentence similarity objectives to stress tests that probe a metric’s robustness against meaning-altering and meaning- preserving graph transformations. We show the benefits of Bamboo by profiling previous metrics and our own metrics. Results indicate that our novel metrics may serve as a strong baseline for future work. | ||
| 700 | 1 | |a Daza, Angel |d 1989- |e VerfasserIn |0 (DE-588)1203323360 |0 (DE-627)1688152938 |4 aut | |
| 700 | 1 | |a Frank, Anette |e VerfasserIn |0 (DE-588)1020288108 |0 (DE-627)691172161 |0 (DE-576)36005689X |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Transactions of the Association for Computational Linguistics |d [Erscheinungsort nicht ermittelbar] : Association for Computational Linguistics, 2013 |g 9(2021), Seite 1425-1441 |h Online-Ressource |w (DE-627)1028630034 |w (DE-600)2938521-0 |w (DE-576)508403200 |x 2307-387X |7 nnas |a Weisfeiler-Leman in the bamboo [bamboo] novel AMR graph metrics and a benchmark for AMR graph similarity |
| 773 | 1 | 8 | |g volume:9 |g year:2021 |g pages:1425-1441 |g extent:17 |a Weisfeiler-Leman in the bamboo [bamboo] novel AMR graph metrics and a benchmark for AMR graph similarity |
| 856 | 4 | 0 | |u https://doi.org/10.1162/tacl_a_00435 |x Verlag |x Resolving-System |z lizenzpflichtig |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20220316 | ||
| 993 | |a Article | ||
| 994 | |a 2021 | ||
| 998 | |g 1020288108 |a Frank, Anette |m 1020288108:Frank, Anette |d 90000 |d 90500 |e 90000PF1020288108 |e 90500PF1020288108 |k 0/90000/ |k 1/90000/90500/ |p 3 |y j | ||
| 998 | |g 1203323360 |a Daza, Angel |m 1203323360:Daza, Angel |d 90000 |e 90000PD1203323360 |k 0/90000/ |p 2 | ||
| 998 | |g 117985876X |a Opitz, Juri |m 117985876X:Opitz, Juri |d 90000 |d 90500 |e 90000PO117985876X |e 90500PO117985876X |k 0/90000/ |k 1/90000/90500/ |p 1 |x j | ||
| 999 | |a KXP-PPN1795730196 |e 409095567X | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"title":[{"title":"Weisfeiler-Leman in the bamboo [bamboo]","title_sort":"Weisfeiler-Leman in the bamboo [bamboo]","subtitle":"novel AMR graph metrics and a benchmark for AMR graph similarity"}],"origin":[{"dateIssuedKey":"2021","dateIssuedDisp":"12/2021"}],"note":["Im Titel steht [bamboo] als bildliche Darstellung","Gesehen am 16.03.2022"],"type":{"media":"Online-Ressource","bibl":"article-journal"},"recId":"1795730196","relHost":[{"language":["eng"],"titleAlt":[{"title":"TACL"}],"part":{"text":"9(2021), Seite 1425-1441","extent":"17","volume":"9","pages":"1425-1441","year":"2021"},"corporate":[{"display":"Association for Computational Linguistics","role":"isb"}],"physDesc":[{"extent":"Online-Ressource"}],"recId":"1028630034","id":{"zdb":["2938521-0"],"issn":["2307-387X"],"eki":["1028630034"]},"note":["Gesehen am 12.03.20"],"origin":[{"dateIssuedDisp":"[2013]-","publisher":"Association for Computational Linguistics","publisherPlace":"[Erscheinungsort nicht ermittelbar]"}],"pubHistory":["Vol 1 (2013)-"],"title":[{"title":"Transactions of the Association for Computational Linguistics","title_sort":"Transactions of the Association for Computational Linguistics"}],"disp":"Weisfeiler-Leman in the bamboo [bamboo] novel AMR graph metrics and a benchmark for AMR graph similarityTransactions of the Association for Computational Linguistics","type":{"media":"Online-Ressource","bibl":"periodical"}}],"physDesc":[{"extent":"17 S."}],"name":{"displayForm":["Juri Opitz, Angel Daza, Anette Frank"]},"id":{"eki":["1795730196"],"doi":["10.1162/tacl_a_00435"]},"person":[{"given":"Juri","role":"aut","family":"Opitz","display":"Opitz, Juri"},{"display":"Daza, Angel","family":"Daza","role":"aut","given":"Angel"},{"display":"Frank, Anette","family":"Frank","role":"aut","given":"Anette"}],"language":["eng"]} | ||
| SRT | |a OPITZJURIDWEISFEILER1220 | ||