Archive for July, 2008

updates..

Tuesday, July 29th, 2008

1. Die Welt and thingsmagazine are covering SurveillanceSaver. maybe we should finally start the follow-up project..

2. the Thom Yorke Hologramm video was seen over 18.000 times on youtube and is the second highest ranked in Radiohead’s youtube group after their own video

3. our multi-touch papers have been accepted by WEB3D2008, VRST2008 and INTUITION2008

4. instantplayer beta5 will be released soon with one of my favorite features: BrowserTexture – display interactive webpages on a texture

5. my students finished their projects: minimal interfaces

rendering thom yorke on the “In Rainbows” LP in augmented reality

Friday, July 18th, 2008

when radiohead released their “In Rainbows” album i bought the limited edition deluxe discbox. it’s good for markerless tracking! now thom yorke’s virtual head is rendered on it in augmented reality.

in our itacitus project at IGD alain and yulian developed a “poster tracker” for markerless tracking. it takes a photo of a flat object (poster, LP, iPhone screen) and extracts visual features. in instantreality it calculates the right camera position relative to the tracked object. thus it is very easy to write augmented reality applications without deep knowledge in computer vision.

thom_ar_01.jpg

ok. i trained the poster tracker for the “In Rainbows” cover and added the 3D data of “House of Cards” to it via peter’s script. now thom is singing on top of the album. thanks mario for the mac version!

thom_ar_02.jpgthom_ar_03.jpg
thom_ar_04.jpgthom_ar_05.jpg

update:

the tracking works on the iphone, too. ok. only when displaying the image on the iphone. but we are really porting instantreality to the iphone.

thom_iphone_01.jpgthom_iphone_02.jpg

radiohead’s ‘house of cards’ data in real-time 3d

Tuesday, July 15th, 2008

yesterday radiohead released the 3d data of their video ‘house of cards’ under the creative commons license. brilliant!

we downloaded the data this morning and started to render it in real-time 3d. imagine a music video that you can walk through! we finished the first visualizations this evening.

peter eschler and i wrote a python script that converts radiohead’s csv coordinate data into an x3d / instantreality particleset. he already started interpreting the intensity values as z-depth, color and dot-size. you can download the python script (bsd license) at his website: http://www.pyjax.net/blog/1/2008/07/15/converting…

the real-time 3d data looks impressive on our new heyewall 2.0 – a multi-touch projection wall with 8160 x 4000 pixel resolution. the next days we will add a wiimote / balance board interaction for controlling time and distortion.

radiohead_hw_01.jpgradiohead_hw_02.jpg
radiohead_hw_03.jpgradiohead_hw_04.jpg

flickr album

youtube videos


update:
peter created an atomizer of thom’s virtual copy.

heyewall 2.0

Tuesday, July 15th, 2008

last week we finished the basic hardware setup of the new heyewall 2.0 at fraunhofer igd. it’s a multi-touch projection wall with 8160 x 4000 pixels resolution. all hardware accelerated by a 48 pc cluster running our instantcluster software on ubuntu linux.

hw_20_01.jpghw_20_02.jpg
hw_20_03.jpghw_20_04.jpg
hw_20_05.jpghw_20_06.jpg

remote debugging

Thursday, July 10th, 2008

remote debugging an application on the multi-touch table via vnc & skype..

remote_debugging.jpglexx.jpg

image: Lexx (Sci-Fi Channel)