How to reach us

Thuringian State Development Corporation (LEG Thüringen)

Mainzerhofstrasse 12 | 99084 Erfurt
Telephone: 0361 5603-0
Write an email

Multimodal interactions and embodiment in hybrid environments

Published: November 2025

Multimodal interactions and embodiment in hybrid environments describe the merging of virtual and real worlds through advanced technologies such as full-body representations and digital twins. The goal is to enhance immersion and the user experience by enabling these systems to adapt to human actions in real time and optimize interaction in social and collaborative contexts. This leads to improved human-machine collaboration and adaptability. The development of hybrid environments and multimodal interaction systems has made significant progress in recent years.

Guiding questions

  • How can immersion in hybrid environments be further improved to enable even more realistic experiences?
  • What role do AI and machine learning play in adapting hybrid environments to individual users?
  • How can social and collaborative aspects be optimally considered in multimodal interaction systems?
  • What ethical guidelines should apply to the use of digital twins and virtual representations of real people?
  • How can the transferability of skills learned in hybrid environments to real-world situations be ensured?
Image description: People are standing in front of a large screen.

challenges

The development of realistic simulations that accurately replicate tissues and surgical procedures, as well as the integration of haptic feedback into VR training environments, presents technical challenges. Seamlessly combining real and virtual data in real time requires powerful systems and algorithms. Intuitive user interfaces are crucial for the acceptance of hybrid environments. Furthermore, the use of digital twins and virtual patient models raises questions regarding data protection and liability that urgently need to be addressed.

Concrete examples

  • Meetings in virtual conference rooms that use avatars with realistic body language
  • Training and simulation for the education of specialists, e.g., virtual surgical procedures, flight simulation, machine maintenance
  • Creative collaboration, e.g., design and architectural tools
Image description: Foresight – Thuringia, Blue Eye in focus

Foresight Report

Download

Reference

Your contact persons

Reference

Michel Reichardt

Michel Reichardt Project Manager Strategic Foresight

Christoph Grollman

Christoph Grollman Project Manager Strategic Foresight

Dr. Sophia Gänßle

Dr. Sophia Gänßle Project Manager Data Science Strategic Foresight

[linguise]
service
Top Menu
Legal