Sona Research

Platforms and Interfaces for Embodied Social Interactive Narrative 

This project’s goal is to develop and disseminate the computational frameworks and human-computer interface techniques for creating interactive narrative interfaces that respond to users’ and performers’ bodies. These interactive interfaces utilize technologies of computer vision, motion capture, digital video projection, artificial intelligence, and computer graphics to create real-time responses to people’s full-body actions. We seek to develop the interaction techniques and software technologies to take these interfaces to the next level, and communicate complex narrative concepts for multiple simultaneous users in social situations. We seek to make breakthroughs in interactive narrative interfaces analogous to the development of cross-cutting in cinema, which transformed cinema from a diversion to a powerful communication medium. 

Social Immersive Media

Social Immersive Media is a distinct form of augmented reality focused on social interaction using camera/projector systems. Social Immersive Media builds on the language of cinema, casting users as actors within simulated temporal models to create strong emotional responses and social engagement through visceral interaction. Our research documents approaches to clearly communicate cultural and scientific ideas, and demonstrates how practitioners can design interactions that promote specific social behaviors in users.

supported by National Science Foundation SGER CreativeIT grant #0742297

Generous Media

Generous Media contends that play and open-endedness are essential to human happiness and can be added to every aspect of our experience. Generous media are personalized, social, open-ended, and infinitely variable. Generous Media can be found in all forms of interactive media, from the web to mechanical devices.