Augmented Reality: Tactum

TACTUM – Tactile Augmented Reality (Teaser) from Madeline Gannon on Vimeo.

TACTUM – Tactile Augmented Reality (Teaser)
from Madeline Gannon 4 weeks ago

All too often, augmented reality exists as a digital overlay in our physical environment. But what if you could actually touch and manipulate this digital information? And what would you create ...
Tactum explores this space between our analog and virtual realities. It uses your body as the physical canvas for digital design. We track arm, hand, and touch gestures to capture tactile interactions with a person's skin. We can then use this information to generate and manipulate 3D form that's projected directly on to the body.

Technical Details:
In its current iteration, Tactum uses computer vision and projection mapping to detect interactions with the body. Tracking and gesture recognition is done with a Leap Motion Controller, and visual feedback is projected onto the forearm using a Casio XJA251 projector. We extract a user's natural gestures – gestures that don't require specific training – to drive a body-based 3D modeling environment. A person can touch, poke, rub, pinch, grab, and twist the digital geometry projected onto their body.
Fabrication & Ergonomic Fit:
Since this base geometry is generated from 3D data of the arm, any design created through Tactum is inherently built to fit each individual user's body. Additionally, technical 3D printing constraints are also embedded within the geometry; this means that no matter how much you manipulate the digital geometry, every design generated through Tactum is guaranteed to be 3D printable.
To find out more, please visit: madlab.cc/tactum
Tactum was developed in collaboration with Autodesk Research (autodeskresearch.com/)
Music by Broke For Free (soundcloud.com/broke-for-free/bonobo-recurring-remix)