in ITP Projects

3D Worlds Final: Audio Reactive Projection Mapping

Overcoming some hurdles with VDMX5 and Maya on my second project proved to be quite challenging. I hope to continue learning these tools and pick up Quartz Composer, 123d Catch, Syphon, AfterEffects, and OpenNI/NITE. For my final project, I wanted to create an audio responsive projection mapping in my livingroom (the only place I could conceivably take over for a week) with generative geometry and some AfterEffects animations inspired by the unusual works of Paul Loffely.

I hope to finish up weaving together layered AfterEffects animations in scenes with VDMX5, dealing with multiple Syphon servers, adding the additional surfaces I’ve modeled (and making them transparent), adding the dreamer on the couch with the Kinect, incorporating the spatial shifts in Unity3D to make the projection interesting….

Below are some low res videos (taken on my iphone) and pictures:


Setup for the 123D Catch modeling:

Projection preparation:

Quartz Composer patch “Syphoned” into Unity3D

The 123D Catch couch model, misaligned with strange lighting to help me align the texture properly (I need to clean all of my models a bit more in Maya and change their pivot points. The couch is white and large, making it quite difficult to capture in 123D.):

One of the crude scenes I managed to snag on my camera:

Write a Comment