Data collection in multimodal language and communication research: a flexible decision framework
Contemporary research on language and communication has expanded beyond its traditional focus on spoken and written forms to encompass signing, gestures, facial expressions, and other bodily actions. This shift has been accompanied by methodological advancements that extend beyond classical tools, s...
Saved in:
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Article (Journal) |
| Language: | English |
| Published: |
April-June 2026
|
| In: |
Advances in methods and practices in psychological science
Year: 2026, Volume: 9, Issue: 2, Pages: 1-22 |
| ISSN: | 2515-2467 |
| DOI: | 10.1177/25152459261442338 |
| Online Access: | Verlag, kostenfrei, Volltext: https://doi.org/10.1177/25152459261442338
|
| Author Notes: | Anastasia Bauer, Patrick C. Trettenbrein, Federica Amici, Aleksandra Ćwiek, Lisa-Marie Krause, Anna Kuder, Silva Ladewig, Marc Schulder, Petra B. Schumacher, Door Spruijt, Chiara Zulberti, Susanne Fuchs, and Martin Schulte-Rüther |
| Summary: | Contemporary research on language and communication has expanded beyond its traditional focus on spoken and written forms to encompass signing, gestures, facial expressions, and other bodily actions. This shift has been accompanied by methodological advancements that extend beyond classical tools, such as tape recorders or video cameras, and include motion-tracking systems, depth cameras, and multimodal data-fusion techniques. Although these tools enable richer empirical insights, they also introduce significant conceptual and practical challenges, particularly for researchers new to multimodal data collection. In this article, we present a structured, decision-oriented workflow for multimodal data collection in language and communication research. We introduce a flexible framework that guides researchers through key methodological choices, including the alignment of research questions with data streams; study-design and acquisition strategies; synchronization and technical requirements; ethical governance; and data management, dissemination, and reuse. The framework is illustrated with case studies spanning controlled laboratory experiments, large-scale annotated sign-language corpora, and field-based research, including nonhuman primates. Rather than advocating a one-size-fits-all approach, in our discussion, we emphasize key decision points, trade-offs, and real-world examples to help researchers navigate the complexities of multimodal data collection. By integrating perspectives from different disciplines, our flexible decision-making framework is intended as a practical tool for researchers seeking to design, implement, and address common conceptual and methodological challenges in the rapidly developing area of multimodal data collection. |
|---|---|
| Item Description: | Online veröffentlicht: 6. Mai 2026 Gesehen am 17.08.2026 |
| Physical Description: | Online Resource |
| ISSN: | 2515-2467 |
| DOI: | 10.1177/25152459261442338 |