Present at conference from Prof. Carlos Thomaz at INESC Porto.
Title: A simple and efficient supervised method for spatially weighted PCA in Face Image Analysis.
I thought it could be interesting for my project to use in a new lip-sync method, or to give some expression to the puppets. But the conference was very focus in the image reconstruction with PCA components witch wasn’t very useful for me.
Working with Teatro de Marionetas do Porto gave me the privilege of working with someone who is a guide to my work.
I presented the project to the Art Director of Teatro de Marionetas do Porto, João Paulo Seara Cardoso that helped me in the Animatic Project and he will help me again. He his a great reference in the real world Marionettes a living book. I hope to learn many things with him, specially the art of puppets.
International Marionette Festival in Porto
MAKE LOVE NOT WAR, Teatro de Marionetas do Porto
25 September 2010
A very human marionette
The actor is the mask witch is the marionette
Microsoft Kinect
Kinect is based on software technology developed internally by Rare, a subsidiary of Microsoft Game Studios owned by Microsoft and range camera technology by Israeli developer PrimeSense, which interprets 3D scene information from a continuously-projected infrared structured light.This 3D scanner system is called Light Coding, employing a variant of image-based 3D reconstruction.
The Kinect sensor is a horizontal bar connected to a small base with a motorized pivot and is designed to be positioned lengthwise above or below the video display. The device features an “RGB camera, depth sensor and multi-array microphone running proprietary software”, which provide full-body 3D motion capture, facial recognition and voice recognition capabilities.
Arduino duemilenove
Arduino is an open-source electronics prototyping platform, designed to make the process of using electronics in multidisciplinary projects more accessible.
A physical computing interface that helps becoming real our imagination
Playstation Move
PlayStation Move is a motion-sensing controller interface for the Playstation 3.
A handheld motion controller wand that uses the Playstation Eye camera to track the wand´s position, and the inertial sensors in the wand to detect its motion.
Nintendo Wiimote
Nintendo WIImote and WIImote plus
The Wiimote is a low-cost interface that contains a 3 axis accelerometer, a high resolution IR camera, a bluetooth connection and vibration surface.
This was already tested in the Animatic Project, with very good results
I´ll try the IR camera as a tracking system and the accelerometers for a direct manipulation
I´ve been invited to work with Teatro de Marionetas do Porto in a new show.
I´m very please to work with them again specially because of the coincidence of timing with the beginning with my project.
In the Animatic Project the main interaction interfaces were the keyboard, mouse, gamepad, microphone and in the last version the wiimote.
The WIImote was one of the best interfaces to control the virtual marionette because it was very near to a real marionette controller.
After this last prototype i was working with Myron Xtra for Director to motion capture globs with camera. The idea was to control the marionette with our own hands. But the result was not great.
Now, the next step is to try new approaches with the WIImote and WIImote Plus, multitouch surfaces, simple body motion capture, Brain Computer Interface, the new Sony Move and the newest Microsoft Kinetic. This last one, as great capabilities for controlling a puppet in realtime.
