Deep learning of cuneiform sign detection with weak supervision using transliteration alignment
The cuneiform script provides a glimpse into our ancient history. However, reading age-old clay tablets is time-consuming and requires years of training. To simplify this process, we propose a deep-learning based sign detector that locates and classifies cuneiform signs in images of clay tablets. De...
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
December 16, 2020
|
| In: |
PLOS ONE
Year: 2020, Jahrgang: 15, Heft: 12, Pages: 1-21 |
| ISSN: | 1932-6203 |
| DOI: | 10.1371/journal.pone.0243039 |
| Online-Zugang: | Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1371/journal.pone.0243039 Verlag, lizenzpflichtig, Volltext: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0243039 
|
| Verfasserangaben: | Tobias Dencker, Pablo Klinkisch, Stefan M. Maul, Björn Ommer |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1745628398 | ||
| 003 | DE-627 | ||
| 005 | 20210820124031.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 210126s2020 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1371/journal.pone.0243039 |2 doi | |
| 035 | |a (DE-627)1745628398 | ||
| 035 | |a (DE-599)KXP1745628398 | ||
| 035 | |a (OCoLC)1264405714 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 28 |2 sdnb | ||
| 100 | 1 | |a Dencker, Tobias |d 1986- |e VerfasserIn |0 (DE-588)1152236512 |0 (DE-627)1013718631 |0 (DE-576)499755340 |4 aut | |
| 245 | 1 | 0 | |a Deep learning of cuneiform sign detection with weak supervision using transliteration alignment |c Tobias Dencker, Pablo Klinkisch, Stefan M. Maul, Björn Ommer |
| 264 | 1 | |c December 16, 2020 | |
| 300 | |a 21 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 26.01.2021 | ||
| 520 | |a The cuneiform script provides a glimpse into our ancient history. However, reading age-old clay tablets is time-consuming and requires years of training. To simplify this process, we propose a deep-learning based sign detector that locates and classifies cuneiform signs in images of clay tablets. Deep learning requires large amounts of training data in the form of bounding boxes around cuneiform signs, which are not readily available and costly to obtain in the case of cuneiform script. To tackle this problem, we make use of existing transliterations, a sign-by-sign representation of the tablet content in Latin script. Since these do not provide sign localization, we propose a weakly supervised approach: We align tablet images with their corresponding transliterations to localize the transliterated signs in the tablet image, before using these localized signs in place of annotations to re-train the sign detector. A better sign detector in turn boosts the quality of the alignments. We combine these steps in an iterative process that enables training a cuneiform sign detector from transliterations only. While our method works weakly supervised, a small number of annotations further boost the performance of the cuneiform sign detector which we evaluate on a large collection of clay tablets from the Neo-Assyrian period. To enable experts to directly apply the sign detector in their study of cuneiform texts, we additionally provide a web application for the analysis of clay tablets with a trained cuneiform sign detector. | ||
| 650 | 4 | |a Computer vision | |
| 650 | 4 | |a Decision making | |
| 650 | 4 | |a Deep learning | |
| 650 | 4 | |a Digital imaging | |
| 650 | 4 | |a Language | |
| 650 | 4 | |a Libraries | |
| 650 | 4 | |a Machine learning | |
| 650 | 4 | |a Sequence alignment | |
| 700 | 1 | |a Klinkisch, Pablo |e VerfasserIn |0 (DE-588)1172431493 |0 (DE-627)1041200609 |0 (DE-576)514617721 |4 aut | |
| 700 | 1 | |a Maul, Stefan M. |d 1958- |e VerfasserIn |0 (DE-588)111895707 |0 (DE-627)480697124 |0 (DE-576)289715431 |4 aut | |
| 700 | 1 | |a Ommer, Björn |d 1981- |e VerfasserIn |0 (DE-588)1034893106 |0 (DE-627)746457510 |0 (DE-576)382507916 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t PLOS ONE |d San Francisco, California, US : PLOS, 2006 |g 15(2020,12) Artikel-Nummer e0243039, 21 Seiten |h Online-Ressource |w (DE-627)523574592 |w (DE-600)2267670-3 |w (DE-576)281331979 |x 1932-6203 |7 nnas |a Deep learning of cuneiform sign detection with weak supervision using transliteration alignment |
| 773 | 1 | 8 | |g volume:15 |g year:2020 |g number:12 |g pages:1-21 |g extent:21 |a Deep learning of cuneiform sign detection with weak supervision using transliteration alignment |
| 856 | 4 | 0 | |u https://doi.org/10.1371/journal.pone.0243039 |x Verlag |x Resolving-System |z lizenzpflichtig |3 Volltext |
| 856 | 4 | 0 | |u https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0243039 |x Verlag |z lizenzpflichtig |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20210126 | ||
| 993 | |a Article | ||
| 994 | |a 2020 | ||
| 998 | |g 1034893106 |a Ommer, Björn |m 1034893106:Ommer, Björn |d 700000 |d 708070 |e 700000PO1034893106 |e 708070PO1034893106 |k 0/700000/ |k 1/700000/708070/ |p 4 |y j | ||
| 998 | |g 111895707 |a Maul, Stefan M. |m 111895707:Maul, Stefan M. |d 70000 |d 70800 |e 70000PM111895707 |e 70800PM111895707 |k 0/70000/ |k 1/70000/70800/ |p 3 | ||
| 998 | |g 1152236512 |a Dencker, Tobias |m 1152236512:Dencker, Tobias |d 700000 |d 708000 |e 700000PD1152236512 |e 708000PD1152236512 |k 0/700000/ |k 1/700000/708000/ |p 1 |x j | ||
| 999 | |a KXP-PPN1745628398 |e 3842386397 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"physDesc":[{"extent":"21 S."}],"id":{"doi":["10.1371/journal.pone.0243039"],"eki":["1745628398"]},"type":{"bibl":"article-journal","media":"Online-Ressource"},"title":[{"title":"Deep learning of cuneiform sign detection with weak supervision using transliteration alignment","title_sort":"Deep learning of cuneiform sign detection with weak supervision using transliteration alignment"}],"relHost":[{"recId":"523574592","origin":[{"dateIssuedKey":"2006","publisherPlace":"San Francisco, California, US ; Lawrence, Kan.","dateIssuedDisp":"2006-","publisher":"PLOS ; PLoS"}],"part":{"extent":"21","year":"2020","volume":"15","text":"15(2020,12) Artikel-Nummer e0243039, 21 Seiten","pages":"1-21","issue":"12"},"pubHistory":["1.2006 -"],"type":{"bibl":"periodical","media":"Online-Ressource"},"id":{"issn":["1932-6203"],"zdb":["2267670-3"],"eki":["523574592"]},"note":["Schreibweise des Titels bis 2012: PLoS ONE","Gesehen am 20.03.19"],"disp":"Deep learning of cuneiform sign detection with weak supervision using transliteration alignmentPLOS ONE","name":{"displayForm":["Public Library of Science"]},"corporate":[{"display":"Public Library of Science","role":"isb"}],"language":["eng"],"title":[{"title_sort":"PLOS ONE","title":"PLOS ONE"}],"physDesc":[{"extent":"Online-Ressource"}]}],"language":["eng"],"person":[{"given":"Tobias","family":"Dencker","role":"aut","display":"Dencker, Tobias"},{"given":"Pablo","family":"Klinkisch","role":"aut","display":"Klinkisch, Pablo"},{"given":"Stefan M.","family":"Maul","role":"aut","display":"Maul, Stefan M."},{"given":"Björn","family":"Ommer","role":"aut","display":"Ommer, Björn"}],"origin":[{"dateIssuedDisp":"December 16, 2020","dateIssuedKey":"2020"}],"recId":"1745628398","name":{"displayForm":["Tobias Dencker, Pablo Klinkisch, Stefan M. Maul, Björn Ommer"]},"note":["Gesehen am 26.01.2021"]} | ||
| SRT | |a DENCKERTOBDEEPLEARNI1620 | ||