Performance Animation LAB. at Cinanima 2013 (Espinho/Portugal) – Animation Film Festival

The main objective of this Lab is to disseminate Digital Puppetry as a methodology to create performance animation.
We present our methodology based on simple steps: Create->Rig->Map->Animate

November 2013

Reel with CINANIMA 2013 labs

(more…)

Result animation from the performance animation Lab at CINANIMA 2013 (Animation Film Festival in Espinho/Portugal).
Real-time storytelling and live directing with virtual marionettes using digital interfaces to create performance animation.
This play was performed with three digital puppeteers / actors and one director.

Framework:
Hardware used: 2 Wiimotes and 2 Nunchucks; 1 Microsoft Kinect; 1 Ipad, 1 Macbook DualCore 2005; VideoProjector
Software used: Animata, Pure Data, Osceleton, Osculator, TouchOSC.

November 2013
www.virtualmarionette.grifu.com

[vimeo 78027358 w=580&h=326]

INVERSUS – artistic installation that explores interaction by using every-day objects

Why should a lamp be used only to illuminate ? … a speaker to play a sound ? ….or a fan to produce wind ?

This every-day objects are used commonly as transmission devices (light, sound and wind).
I knew, before starting this project, that a speaker could be used as a microphone.

My proposal was to find out if a transmission device could be used as a reception device for interaction purposes.

The Lamps (in this case: Leds) where used as light sensors, the speakers (in this case: piezzos) where used as pressure sensors and the fan was used as a blowing sensor.

The main concept of inversus was to invert the meaning of transmission devices into reception devices. A sensitive machine that capture human interaction to produce sound and visual kinetics. A performing instrument that gives life to a mechanic flower that spins when someone blows into the machine producing an animated shadow like in shadow puppetry. There is also a virtual marionette inside the machine that reacts to the pressure of the pads, this marionette is rigged with bones that are mapped to the pads that make them squash and stretch producing animation.
This instrument was made from a washing machine changing the meaning absorbing the spinning metaphor as a mixing machine. To extend the mixing metaphor i used a spinning wheel that creates a hypnotic effect.

Oct.2013
+ info at http://www.grifu.com/vm/?p=883#more-883
or http://www.virtualmarionette.grifu.com/

Virtual Marionette project was mentioned in the monthly news of Instituto Telecomunicações (IT)

news

“(…)

Instituto de Telecomunicações has participated in the science show that was held at the Pavilhão do Conhecimento – Ciência Viva in Lisbon. A team from Porto Interactive Center presented three demos: the project LIFEisGAME, which explores the possibility of teaching people with Autism Spectrum Disorder to recognize facial emotions, using real time synthesis and automatic facial expression analysis; Virtual Marionette, a research on digital puppetry via an interdisciplinary approach that brings the art of puppetry into the world of digital animation, and 3D Scanner, a system to create a high-quality human like 3D facial avatar by drastically improving the quality of 3D avatars and reducing the time spent in the process. From IT at Lisbon came BITalino, described in page 1, and a couple of demos of the Internet of the Future concept based on RFID. The stand from IT attracted more than 500 very interested visitors.”

link to the paper

SIC National Television broadcasted a news report from Porto Interactive Center showing our projects.

Although the focus was Life Is Game project, many other projects were shown, and Virtual Marionette also appear in this report.

Circus on the Strings is a very interesting puppetry play showing the great manipulation skills from Viktor Antonov.

Although FIMP (Porto International Marionette Festival) doesn”t focus too much in traditional marionettes, Circus on the Strings was that kind of show that fulfill the expectation of a more traditional audience.

Viktor-Antonov-Circus-On-The-Strings-02-482x756

Each time that i a see great puppeteer manipulating with great precision string puppets, i just wonder how they achieve this level of manipulation. It´s very difficult to handle so many strings with such precision giving life to puppets in a expressive way.

circus

Viktor brought to FIMP this amazing work, a classic puppetry play with superb details.

The puppet mechanics were simply amazing; puppets that move their heads, mouths, eyes, even the color of their heads. To control all this parts, the manipulation controllers were very sophisticated.

 

Ellen Fullman started to develop the Long String Instrument in 1981.
An instrument with dozens of metallic strings with more then 15 meters.

Ellen plays with the fingers covered with rosin-coated producing a chorus of organ-like partials.

I had the privilege to participate in Ellen´s workshop at FIMP (Porto International Marionette Festival)

 

Ellenplaying

Beyond the magnificent experience i realized the connection between manipulating a marionette and a instrument like this.

 

Ellen Fullman 2

Ellen must have full concentration to manipulate dozen of strings with great precision.

Her body needs to be in a perfect balance moving from one place to another producing the different tones.

 

IMG_1071

 

In this picture it is possible to view the resonance wooden boxes and Konrad Sprenger with his guitar.

Konrad uses a guitar as an interaction interface for making music without playing it directly.

He uses solenoids in each string to produce sound in an electric guitar. With servo motors attached to the tuners of the guitar he can control and manipulate the tone of the strings. All the manipulation is made inside the computer in a MaxMSP patch.

VIDEO: Konrad guitar

 

 

Multitouch surface testing (FTIR)
The purpose of this tests is to build a puppetBox, a multitouch surface to manipulate puppets using fingers.
I´ve made silicone layers with synthetic and cellular diluent.
Avoid dissolving the silicone with cellular diluent because it will take too much time to try. Using synthetic diluent
Of-course you can use expensive materials to avoid this issues.

 

Material used:
– Optoma projector PK320 80 Ansi Lumen
– EyeCam Default lens with 850 nm filter (i changed the lens to the default because i used a very small surface)
– InfraRed Ledstrip 850 nm
– Baking paper with 2 layers of silicon + synthetic diluent
– CCV 1.2 on MAC and CCV 1.3 on Windows
Conclusions:
Systems:
– Eyecam gives a better performance in Windows (60 fps) against Mac OSX (30 fps)
– Flash CCV demos work 2 times faster on windows compared to Mac OSX
Screens:
– Rosco screen gives high resolution picture and it gives you a great feeling to touch
– Baking paper gives brighter picture with low resolution but it is very low-cost
– Rosco screen needs more layers of Sillicon to track blobs

Experiment made in September 2013

Virtual Marionette demonstration at Noite Europeia dos Investigadores 2013 Lisboa (Parque das Nações)

The participants were able to explore bePuppit system. An experiment to explore different ways to interact with puppets using our body. The players can choose the digital puppet setup with just their hands.nei2013_4

nei2013_12-select

Body motion to control a Dragon figure

nei2013_13-select

Trying several body expressions with the puppets, in this case, a hug.

nei2013_14-select

Two players interacting with the puppets using their hands as puppetry controllers.

(more…)

I´ve participated in a very important workshop supervised by Marcelo Lafontanta from Lafontana Puppetry Company.

In this workshop we made and explore different puppetry styles, namely:

– Shadow puppetry;

– Toy theatre;

– Punch & Judy;

 

teatro formas animadas

In each style we had the opportunity to build/craft the puppets, props and backgrounds and also to performance with each particular style.

And so, we were able to understand the differences in each style: constrains, performance issues, manipulation controllers, materials, and so on…

 

shadow

Building the shadow puppetry project