[Mp4-tech] Video - Tiling multiple video streams

Tue Aug 3 12:52:15 EDT 2004

Taken from another email on this list:
Kyungpook National University (MPEG-4 Studio, 2D)
Fraunhofer HHI (2D)
Institute for Research and Technology Hellas (MPEG-4 Toolbox, 3D)
Digimax  (Maxpeg Author, 3D)
National Taiwan University (seems to be the same as Digimax Maxpeg Author)
Envivio (4Mation, 2D)
iVAST (Studio Author, 2D)
ETRI (2D)
GPAC (V4Studio, 2D)
Mindego (2D, 3D)
University of Port Elizabeth (2D)
IBM (XMTEdit, 2D)
ENST (MPEG-Pro, 2D, no longer maintained)
Some of these tools are not publicly available
I know our authoring tool (4Mation) can create a window with live video
tiles.
To be clear: these authoring tools do not do any video transcoding. They
create a presentation referring to live streams.
The presentation itself can be done offline, while the video streams are
live.
Regards,
Boris
> -----Original Message-----
> From: Raghuram V Pidaparthi [mailto:raghuram unm.edu] 
> Sent: Tuesday, August 03, 2023 11:34 AM
> To: bfelts envivio.com
> Cc: mp4-tech lists.mpegif.org
> Subject: Re: [Mp4-tech] Video - Tiling multiple video streams
> 
> 
> Boris, Can you suggest me some authoring tools with which this can be 
> accomplished. Also, the number of connections the server 
> could handle is 
> really limited because of the number of streaming connections 
> that the 
> server has to handle and the incoming/outgoing bandwidth. So, can the 
> tools really operate in real-time while handling multiple streams?
> 
> Thanks
> Raghu 
> 
> On Sun, 1 Aug 2023 bfelts envivio.com wrote:
> 
> > There are some other -and maybe easier- ways to do this and use the 
> > object
> > approach of MPEG-4, using MPEG-4 System .
> > You can easily create a scene, or MPEG-4 system 
> presentation, with multiple 
> > video placeholders referring to the live incoming streams.
> > I don't think you have to change the nature of the incoming 
> streams or use 
> > sophisticated transcoding algorithm for the application you 
> describe (and I 
> > don't believe there is any commercial implementation of 
> MPEG-4 part II video 
> > core profile using the video object, but there are quite a 
> few MPEG-4 system 
> > authoring tools and players) With the appropriate tools, it 
> takes maybe few 
> > minutes to accomplish that.
> > 
> > Hope that helps,
> > 
> > Boris Felts
> > Envivio
> > 
> > > Dear Raghuram,
> > > 
> > > It seems to be possible in two ways,
> > > 1. transcoding of various incoming stream into one stream. This is
> > > applicable for most standards which are block-based (like. MPEG2,
> > > H.263,H.264 etc.)  Here streams are essentially decoded 
> (partially or
> > > compeletely depending on need of the input and output 
> formats). Also
> > > it implies computation at some central node. Most ideas 
> on transcoding
> > > are derived from the seminal work described here which 
> can serve for
> > > you as a good starting point.
> > > 
> > > * Shih-Fu Chang; Messerschmitt, D.G. "Manipulation and 
> compositing 
> > > of MC-DCT compressed video" Selected Areas in 
> Communications, IEEE 
> > > Journal on  ,Volume: 13 , Issue: 1 , Jan. 1995 Pages:1 - 11
> > > 
> > > 2. use of object based encoding as supported by MPEG 4 (core 
> > > profiles). MPEG-4 object based encoding facilitates coding of 
> > > various object (they can be rectagular or artbitrary 
> shaped) to be 
> > > combined in a single bitstream. This would mean that at 
> the mixing 
> > > junction, different streams need to be approriately 
> interleaved and 
> > > at the player should be equipped with decoding the video of more 
> > > than one video object. In MPEG-4, there are also profiles of 
> > > synthetic and natural videos and whole lot of combination can be 
> > > packed togather in a single MPEG-4 stream.
> > > 
> > > You may refer to :
> > > * Touradj Ebrahimi, Caspar Horne "MPEG-4 natural video 
> coding - An 
> > > overview", Signal Processing: Image Communication 15 
> (2000) 365-385.
> > > 
> > > * MPEG-4 - Multimedia for our time IEEE Spectrum, Nov 99.
> > >    available at 
> > > http://www.m4if.org/resources/IEEESpectrum/mp4ieee.htm
> > > 
> > > * Overview of the MPEG-4 Standard
> > >   available at : 
> > > http://www.chiariglione.org/mpeg/standards/mpeg-4/mpeg-4.htm
> > > 
> > > * http://www.m4if.org/tutorials.php
> > > 
> > > Hope this helps.
> > > 
> > > Dipan Mehta
> > > 
> > > On Mon, 26 Jul 2023 12:58:17 -0600 (MDT), Raghuram V Pidaparthi 
> > > <raghuram unm.edu> wrote:
> > > > Hi,
> > > > I am new to multimedia streaming applications. I want 
> to implement 
> > > > a project : I want to tile multiple streams in a server 
> received 
> > > > from different systems on a  network into a single 
> composite frame 
> > > > in real-time and stream
> > > the
> > > > resulting composite stream for a video-conferencing 
> application. 
> > > > Is there anyway I can do this using MPEG-4. Can someone give me 
> > > > some leads. Thank you Raghu
> > > > 
> > > > _______________________________________________
> > > > NOTE: Please use clear subject lines for your posts. Include 
> > > > [audio,
> > > [video], [systems], [general] or another apppropriate 
> identifier to 
> > > indicate the type of question you have.
> > > > 
> > > > Note: Conduct on the mailing list is subject to the Antitrust 
> > > > guidelines
> > > found at 
> > > 
> http://www.mpegif.org/public/documents/vault/mp-out-30042-Antitrust.
> > > php
> > > >
> > > _______________________________________________
> > > NOTE: Please use clear subject lines for your posts. 
> Include [audio, 
> > > [video], [systems], [general] or another apppropriate 
> identifier to 
> > > indicate the type of question you have.
> > > 
> > > Note: Conduct on the mailing list is subject to the Antitrust 
> > > guidelines found at 
> > > 
> http://www.mpegif.org/public/documents/vault/mp-out-30042-Antitrust.
> > > php
> > > 
> > 
> > 
> > 
> > 
> > -------------------------------------------------
> > This mail sent through IMP: http://horde.org/imp/ 
> > _______________________________________________
> > NOTE: Please use clear subject lines for your posts. 
> Include [audio, 
> > [video], [systems], [general] or another apppropriate identifier to 
> > indicate the type of question you have.
> > 
> > Note: Conduct on the mailing list is subject to the Antitrust 
> > guidelines found at 
> > 
> http://www.mpegif.org/public/documents/vault/mp-out-30042-Antitrust.ph
> > p
> > 
>