M3diate (VR/AR)

Mediate is a joint NYU Abu Dhabi and NYU Shanghai research program focused on integrating Virtual Reality and Augmented Reality (VR and AR, respectively) into content delivery tools for faculty, students and researchers. The use cases for VR and AR cross all academic disciplines and the program has created applications and curriculum spanning diverse fields such as spatialized voice and audio synthesis, 3D videography, scanning and reconstruction and live motion capture in just the past 4 months since its inception in February 2016.

We have 3 separate m3diate demos to show to the participants.

Bongos: (participants can enter the mocap stage, where we will be turning orinary items into musical instruments for them to play together. This is one of the first times this has been done in the world.

Wavefront: This is a VR music creation platform with spatial sound. The first of its kind in the world.

Social VR: We will be demonstrating our 3d sound and interaction system that allows multiple people to enter a VR world together and socialize.

Demonstration of Wavefront sound tech (use headphones):[video]

Demonstration of social platform: [video]

Here's a cool video of what's possible with the Optitrack system - it is being used to control drones: [video]