Project SENSE: Multimodal Simulation with Full-Body Real-Time Verbal & Nonverbal Interactions

Hossein Miri, J. Kolkmeier*, R. Poppe, P.J. Taylor, D. Heylen

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review

Abstract

This paper presents a multimodal simulation system, project-SENSE, that combines virtual reality and full-body motion capture technologies with real-time verbal and nonverbal communication. We introduce the technical setup and employed hardware and software of a first prototype. We discuss the capabilities of the system for the investigation of cooperation paradoxes and the effects of direct nonverbal mimicry. We argue that this prototype lays the technological basis for further research in interpersonal and social skills, as well as the social and emotional consequences of nonverbal mimicry in sustained interactions.
Original languageEnglish
Title of host publicationIntelligent Technologies for Interactive Entertainments
Subtitle of host publicationINTETAIN 2016
PublisherSpringer
Pages279-284
ISBN (Electronic)978-3-319-49616-0
ISBN (Print)978-3-319-49615-3
DOIs
Publication statusPublished - 2017
Externally publishedYes
EventINTETAIN 2016: 8th International Conference on Intelligent Technologies for Interactive Entertainment - Utrecht, Netherlands
Duration: 28 Jun 201630 Jun 2016

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
Volume178

Conference

ConferenceINTETAIN 2016
Country/TerritoryNetherlands
CityUtrecht
Period28/06/1630/06/16

Fingerprint

Dive into the research topics of 'Project SENSE: Multimodal Simulation with Full-Body Real-Time Verbal & Nonverbal Interactions'. Together they form a unique fingerprint.

Cite this