institut

AR Design Challenges

Wednesday, June 15th, 2011

Just a short part of a presentation (German) about design challenges in Augmented Reality.

AR_Design_Challenges (PDF)

X3DOM: X3D via WebGL

Wednesday, October 28th, 2009

Johannes and his team are working hard on making X3DOM reality. X3DOM is a solution for a seamless and HTML5 conform integration of 3D content in web pages. Based on WebGL and Javascript it does not need a plug-in anymore. Sounds like the best chance of a 3D internet for years.

Let’s hope Apple enables WebGL on the iPhone soon in order to render augmented reality apps. TwittARound would be happy.

x3dom

iTACITUS Final Review in Turin

Tuesday, July 7th, 2009

iTACITUS is finished. After 32 month the EU funded project came to an end. The final review took place at Reggia Venaria Reale in Italy.

venaria_june_01venaria_june_02

Fraunhofer IGD presented the final version of our augmented reality application on UMPCs (live markerless tracking) and iPhone (Snapshot AR). The application shows context aware overlays of the architecture and interior of the palace. We only used available historic media linke drawings and paintings. This enables affordable augented reality for cultural heritage compared to expensive 3D reconstructions. For a seamless integration of the overlays we invented Reality Filtering (VAST 2008) which renders the environment in the style of the overlay (black and white drawing, painting).

venaria_june_03venaria_june_04

venaria_june_05venaria_june_06

My paper “Cultural Heritage Layers” about iTACITUS was accepted at VSMM 2009 in Vienna.

deutsche gamestage 2009

Sunday, April 26th, 2009

berlin again! michael liebe asked me to give a talk at science forum of deutsche gamestage in berlin. it was an introduction about augmented reality starting with a description of how “assassin’s creed” uses augmented reality features, followed by a technical demystification.

gamestage_01gamestage_02

gamestage_06gamestage_05

gamestage_03gamestage_04

image credits: wikimedia

slides pdf (1.5 mb)

allard pierson museum in amsterdam

Saturday, April 11th, 2009

last week i finished a project for the “a future for the past” exhibition at allard pierson museum in amsterdam. we set up two augmented reality cultural heritage applications about satricum and forum romanum. two large photographs in the exhibition are superimposed with 3d reconstructions and context sensitive information. presented on a new version of the movablescreen and umpcs.
project documentation at IGD

amsterdam_08amsterdam_07

amsterdam_05amsterdam_06

i did not even have time for a fast forward sightseeing in amsterdam..

amsterdam_01amsterdam_02

amsterdam_04amsterdam_03

InstantReality beta 6

Monday, March 16th, 2009

beta 6 is out with a lot of important features:

– the javascript functions have been optimized for live scene manipulation
53 tutorials including augmented reality, marker tracking, poster tracking, …
InstantIO plugin API

instantreality_beta_6

augmented reality sightseeing at CeBIT 2009

Friday, March 6th, 2009

as fraunhofer igd we are presenting the project “augmented reality sightseeing” at BMBF booth (hall 9, booth 40) during CeBIT 2009 in hannover. it deals about “20 years fall of the berlin wall” and is split in three components on two devices: iPhone and UMPC.

like in iTACITUS we are displaying historic photos over today’s view of Brandenburg Gate and Reichstag. in addition the urban development of berlin and the wall are presented on a satellite image of berlin on a table. via augmented reality video-seethrough urban grain plans from 1940 – 2008 in are augmented on the table in 3D.

it works live on an UMPC and via Snapshot Augmented Reality on the iPhone. therefore we set up a tracking server that receives an image, augments it and sends it back to the iPhone.

the german tv was also there:
video from 11:40

winchester iTACITUS review

Tuesday, December 30th, 2008

in november we had our second review of the iTACITUS project. therefore i finished an augmented reality applications for winchester castle’s great hall. it shows overlay information about three points of interest: arthur’s round table, the court and an outside scene with the sheriff of hampshire.

itacitus_winchester_01itacitus_winchester_02

the main task was to present these scenes on the sony ux ultramobile pc. additionaly i showed the outside scene on the iphone with my snapshot augmented reality application.

winchester_iphone_01winchester_iphone_02

the project finishes in may 2009.

reality filtering at reggia venaria reale

Sunday, November 2nd, 2008

i was in turin for a week to test my reality filtering approach at reggia venaria reale. at three places of the hunting palace i am adding historic drawings of lost architecture and paintings to the reality. the reality is rendered like the historic drawing in order to integrate it seamless and to create a living drawing.

diana palace’s architecture was revisioned three times. i am overlaying the two former versions on the current architecture. the reality filter integrates them seamless. even passengers are integrated into the living drawing.

in diana hall there are two grey areas where once were frescos. via augmented reality i am adding black and white drawings of the paintings at their real position. all the overlays are containing spatial audio comments that are starting as soon as the visitor looks at them.

iPhone snapshot augmented reality

Tuesday, October 21st, 2008

“snapshot augmented reality” on iPhone let’s you take a photo and augmented it with virtual objects or geolocated information. therefore the application sends the image to InstantVision server via Wifi or UMTS. the overlayed image is sent back to the iPhone and displayed some seconds later.

this lightweight solution eliminates the major problems of augmented reality on mobile devices: hardware availability, computing power and battery life. and it is compatible with Apple’s iPhone SDK, where live video streaming is still forbidden. the client is a very slim application that takes a photo and sends it to an InstantVision server. this server extracts the geolocation of the image and runs a database-driven postertracking on it to calculate the iPhone’s camera pose. therefore a reference image and a prepared 3d scene of each point of interest (POI) is needed. a flickr image and a small X3D scene is enough.
due to the distributed architecture the slim client can be ported to android, symbian, etc.

ar_venaria_palazzo_01.jpgar_venaria_palazzo_02.jpg

more about the project:
http://a4www.igd.fraunhofer.de/projects/49

see also: instantmini X3D browser on the iPhone