architectural multi-touch application at cebit 2008

at cebit 2008 we are introducing instantware. it is a sub brand of instantreality for our custom interaction devices and services like the multi-touch table and heyewall, movablescreen and our mobile augmented reality applications.

the multi-touch table will be presented at BMBF booth (hall 9, b40). johannes and yvonne build a ubercool architectural application. it features several scalable plans of messe frankfurt’s new hall 11. multiple users can move and zoom these plans like you know it from other multi-touch applications.

but the key feature is the tile with a high quality 3d view of the building. they implemented the multi-touch 3d camera gestures jens and i introduced last year: you are grabbing a plan with the left hand. one finger of right hand moves the camera through the 3d model. the second finger defines the orientation of the camera. this enables incredible cinematic camera movements in 3d. when the second finger points on a certain object on the plan and the first fingermoves around it the 3d camera moves around that object while keeping it on focus.

more images from cebit 2008 at:

give one – get one

i just ordered my XO laptop and donated one to a student in the third world. unfortunately they do not deliver it to germany. a friend in the usa will send it to me after it arrives. let’s see when i will reveice it and what it will cost me in the end. the dollar is low but shipping and customs are expensive..


multitouch for immersive environments

this week my student jens finished his diploma at h-da and igd. he developed a multitouch table and software for navigation through immersive vr environments. as multitouch technology has become a standard technology and everyone is able to build a table it’s the applications that matter now.

together we created a very straight interaction concept for navigating and evaluating virtual architecture visualizations. the movement in the virtual space becomes cinematic when using two fingers for movement, orientation and lookat at the same time.

the setup consits of a table installation in front of igd‘s 18 megapixel heyewall. content is a 3d architecture visualization of messe frankfurt’s new building. on the table there is a bird view of the area. tracking is done by harald’s visionlib blobdetection. it communicates with instant player (X3D) via TUIO protocol.

pointing with a finger on a spot let’s the camera fly to the point in the 3d scene. moving with the finger moves the camera. with a second finger the orientation of the camera is set. by pointing on a certain building the camera will look at it. by pointing with the second finger on a building and moving the first finger around it the camera moves around it while looking at it.


Project summary

MovableScreen presented at Hannover Messe

during the last months i realized my idea of a movable screen as interaction device at the IGD. it is again a minimalistic approach integrating / hiding complex technlogy in famliar hardware. i simply put an 24″ iMac at a rotating pillar and tracked the rotation with a rotation encoder. in order to create the effect of a “window into virtual reality” i am tracking the user’s head and map the position on the virtual camera. primarily it is running instantreality framework for visualization. there are also working prototypes of Second Life, Google Earth and hopefully soon Nasa Worldwind Java.


last week we presented the MovableScreen at the Hannover Messe trade fair at the booth of BMBF. the software shows the simulation of a Coperion bulk materials plant i created together with my colleages at design&systems institute using instantreality framework. we already have sold two MovableScreens until now!


using DarwiinRemote in processing

several people are working on drivers for nintendos Wiimote. i wrote a speedhack to use hiro’s DarwiinRemote with Processing.

i simply modified DarwiinRemote to write out a textfile with the values of the accelerometer and the orientation of the Wiimote.

there is an pde in the archive and the modified version of DarwiinRemote in the data folder. start DarwiinRemote, connect the Wiimote and then run the pde.

that’s only to start working with the Wiimote. i hope someone will write real drivers for the device soon.

JarwiinRemote for Processing on OS X (binary)
JarwiinRemote for Processing on OS X (source)


i managed to get a nintendo wii on european launch day. it was incredible. more than 40 running people in the shop. me too.

now i have my wii, the great wiimote, zelda, rayman raving rabbits and nintendo sports.

there are already drivers and example applications for reading the wiimote on linux, windows and os x.

how the wiimte works: