Data collection in multimodal language and communication research: a flexible decision framework

Contemporary research on language and communication has expanded beyond its traditional focus on spoken and written forms to encompass signing, gestures, facial expressions, and other bodily actions. This shift has been accompanied by methodological advancements that extend beyond classical tools, s...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Bauer, Anastasia (Autor) , Trettenbrein, Patrick C. (Autor) , Amici, Federica (Autor) , Ćwiek, Aleksandra (Autor) , Krause, Lisa-Marie (Autor) , Kuder, Anna (Autor) , Ladewig, Silva (Autor) , Schulder, Marc (Autor) , Schumacher, Petra B. (Autor) , Spruijt, Door (Autor) , Zulberti, Chiara (Autor) , Fuchs, Susanne (Autor) , Schulte-Rüther, Martin (Autor)
Formato: Article (Journal)
Lenguaje:inglés
Publicado: April-June 2026
In: Advances in methods and practices in psychological science
Year: 2026, Volumen: 9, Número: 2, Pages: 1-22
ISSN:2515-2467
DOI:10.1177/25152459261442338
Acceso en línea:Verlag, kostenfrei, Volltext: https://doi.org/10.1177/25152459261442338
Enlace del recurso
Notas de Autor:Anastasia Bauer, Patrick C. Trettenbrein, Federica Amici, Aleksandra Ćwiek, Lisa-Marie Krause, Anna Kuder, Silva Ladewig, Marc Schulder, Petra B. Schumacher, Door Spruijt, Chiara Zulberti, Susanne Fuchs, and Martin Schulte-Rüther
Descripción
Sumario:Contemporary research on language and communication has expanded beyond its traditional focus on spoken and written forms to encompass signing, gestures, facial expressions, and other bodily actions. This shift has been accompanied by methodological advancements that extend beyond classical tools, such as tape recorders or video cameras, and include motion-tracking systems, depth cameras, and multimodal data-fusion techniques. Although these tools enable richer empirical insights, they also introduce significant conceptual and practical challenges, particularly for researchers new to multimodal data collection. In this article, we present a structured, decision-oriented workflow for multimodal data collection in language and communication research. We introduce a flexible framework that guides researchers through key methodological choices, including the alignment of research questions with data streams; study-design and acquisition strategies; synchronization and technical requirements; ethical governance; and data management, dissemination, and reuse. The framework is illustrated with case studies spanning controlled laboratory experiments, large-scale annotated sign-language corpora, and field-based research, including nonhuman primates. Rather than advocating a one-size-fits-all approach, in our discussion, we emphasize key decision points, trade-offs, and real-world examples to help researchers navigate the complexities of multimodal data collection. By integrating perspectives from different disciplines, our flexible decision-making framework is intended as a practical tool for researchers seeking to design, implement, and address common conceptual and methodological challenges in the rapidly developing area of multimodal data collection.
Notas:Online veröffentlicht: 6. Mai 2026
Gesehen am 17.08.2026
Descripción Física:Online Resource
ISSN:2515-2467
DOI:10.1177/25152459261442338