[Mp4-tech] Interactive navigation in video according to semantic relation

[Julian Masuhr]

Hi all !
I have used XMTBatch ("IBM Toolkit for MPEG-4") to create a clickable video. 
That was pretty easy with help of the high-level XMT-O language.
In this mp4-file one can click a moving character (extracted with chromakey) 
in front of a video-background. The result is that a different media-object 
is being played (a mp3 in this case).
Now i want to add Meta-Informations to my Video for the purpose of - let me 
call it - "Interactive Navigation in Video". I know that XMT-O is for 
content-creation, but is it sufficient for adding Meta-Infos to a scene? I 
doubt it. My goal is to provide Meta-Infos to different Objects (e.g. 
persons, buildings, backgrounds), so that you can find (and navigate to) 
similar Objects in parallel Videostreams.
The scenario would be:
1 Parallel running Videostreams
2 Clickable Objects in these Videostreams (prepared via 
Bluebox/Chromakey-Extraction)
3 Data Description Files - about the above mentioned Objects - that can be 
linked together
4 Meta-Infos about these Objects is being displayed when Hoovering an Object
5 Jumping from subscene A in Video_001 to subscene B in Video_002 according 
to the semantic link in the Data Description Files.
Are there existing workarounds?
What technology is for steps 3 to 5 appropriate? MPEG-J, JavaSwing, BIFS, 
XMT-O/XMT-A, VRML, X-Link, MPEG-7-features? I have lost track of all those 
existing technologies!
Thanks for any help.
julian
My preparation: I read many www-sources regarding MPEG-4 and the first 6 
chapters from the fantastic "MPEG-4 Book".
I also tried unsuccessfully to make the ISO-Reference Software work. To be 
honest i am overwhelmed by the many different technologies provided by 
MPEG-4, but i am also fascinated by it.
To my person: i am a student in media-informatics and am currently working 
on my bachelor-thesis. 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: /pipermail/mp4-tech/attachments/20050413/131842cd/attachment.html