What do we need to know about an unknown word when parsing German
We propose a new type of subword embedding designed to provide more information about unknown compounds, a major source for OOV words in German. We present an extrinsic evaluation where we use the compound embeddings as input to a neural dependency parser and compare the results to the ones obtained...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Chapter/Article Conference Paper |
| Language: | English |
| Published: |
September 2017
|
| In: |
First Workshop on Subword and Character Level Models in NLP - proceedings of the workshop
Year: 2017, Pages: 117-123 |
| DOI: | 10.18653/v1/W17-4117 |
| Online Access: | Verlag, lizenzpflichtig, Volltext: https://doi.org/10.18653/v1/W17-4117 Verlag, lizenzpflichtig, Volltext: https://aclanthology.org/W17-4117 
|
| Author Notes: | Bich-Ngoc Do, Ines Rehbein, Anette Frank |
| Summary: | We propose a new type of subword embedding designed to provide more information about unknown compounds, a major source for OOV words in German. We present an extrinsic evaluation where we use the compound embeddings as input to a neural dependency parser and compare the results to the ones obtained with other types of embeddings. Our evaluation shows that adding compound embeddings yields a significant improvement of 2% LAS over using word embeddings when no POS information is available. When adding POS embeddings to the input, however, the effect levels out. This suggests that it is not the missing information about the semantics of the unknown words that causes problems for parsing German, but the lack of morphological information for unknown words. To augment our evaluation, we also test the new embeddings in a language modelling task that requires both syntactic and semantic information. |
|---|---|
| Item Description: | Gesehen am 22.11.2023 |
| Physical Description: | Online Resource |
| ISBN: | 9781945626913 |
| DOI: | 10.18653/v1/W17-4117 |