WO2008059511A2 - Dispositif multimédia éloigné pour réseautique - Google Patents

Dispositif multimédia éloigné pour réseautique Download PDF

Info

Publication number
WO2008059511A2
WO2008059511A2 PCT/IN2006/000449 IN2006000449W WO2008059511A2 WO 2008059511 A2 WO2008059511 A2 WO 2008059511A2 IN 2006000449 W IN2006000449 W IN 2006000449W WO 2008059511 A2 WO2008059511 A2 WO 2008059511A2
Authority
WO
WIPO (PCT)
Prior art keywords
data
network computer
server
multimedia
display
Prior art date
Application number
PCT/IN2006/000449
Other languages
English (en)
Other versions
WO2008059511A3 (fr
Inventor
Alok Singh
Nisheeth Mishra
Yuvaraj Galada
Vinodkumar Gopinathan
Mukul Chitrao
Padmalakshmi Shankar
Shuveb Hussain
Siva Rama Krishna Obul Reddy
Saugata Chakrabarti
Rajaraman Krishnan
Sivasubramanium Vidya Kanigiluppai
Barunkumar Parichha
Original Assignee
Alok Singh
Nisheeth Mishra
Yuvaraj Galada
Vinodkumar Gopinathan
Mukul Chitrao
Padmalakshmi Shankar
Shuveb Hussain
Siva Rama Krishna Obul Reddy
Saugata Chakrabarti
Rajaraman Krishnan
Kanigiluppai Sivasubramanium V
Barunkumar Parichha
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alok Singh, Nisheeth Mishra, Yuvaraj Galada, Vinodkumar Gopinathan, Mukul Chitrao, Padmalakshmi Shankar, Shuveb Hussain, Siva Rama Krishna Obul Reddy, Saugata Chakrabarti, Rajaraman Krishnan, Kanigiluppai Sivasubramanium V, Barunkumar Parichha filed Critical Alok Singh
Priority to PCT/IN2006/000449 priority Critical patent/WO2008059511A2/fr
Publication of WO2008059511A2 publication Critical patent/WO2008059511A2/fr
Publication of WO2008059511A3 publication Critical patent/WO2008059511A3/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/756—Media network packet handling adapting media to device capabilities

Definitions

  • This invention relates to remote multimedia in a network computer based environment and, in 0 particular, to a network computer - server based computing system adapted to separate, carry and merge the multimedia and computing data between a server and a network computer.
  • the computing system of the invention adapted to separate the audio / video encoded components of computing and other display components is directed to avoid problems of overloading of servers and choking of networks, thereby facilitating the network 15 computer-server based computing and also favouring satisfactory multimedia content based visual experience for end users.
  • the system is further adapted for better synchronization of audio and video as the output from the network computer providing quality and value addition to end user satisfaction and utilities.
  • the network computer is known to be zero maintenance devices that provide access to data and applications. Such network computers get user inputs, pass it onto the servers and get the output from the server for display / output to the user. Additionally, the network computers are also required to decode multimedia codes such as MPEG and MP3.
  • multimedia content usually include rapidly changing screens / frames.
  • Such rapid change of frames implies that the changes between one frame to the next result in a huge amount of data.
  • This data has to be sent over the network to the client.
  • the complete screen occupies nearly 1 MB of memory space. So even if half the screen changes between adjacent frames 0.5 MB of data has to be passed from the server to the network computer.
  • From the multimedia content atleast 30 frames have to be sent through the network, i.e. 15 MB of data per second.
  • the band width required would be 90 Mbps.
  • the network gets chocked.
  • many a times, such band widths are not consistently available between a network computer and a server.
  • screen shot compression and decompression is not as efficient as multimedia encoding.
  • the effect to the user when the multimedia content is not sent in the appropriate encoded format is very unsatisfactory and is usually jumpy and patchy.
  • the audio and video content are sent in separate channels from the server to the network computer. In such case there is no synchronization of audio arid video when the network computer outputs the contents, which leads- to highly unsatisfactory experience for the end user.
  • a further object of the present invention is directed to remote multimedia in network computer based system which would ease the load on server and would not require the server to decode the multimedia content and favour the server which would be required to carry out fewer activities with possible reduction of the CPU and memory requirements of the server.
  • Yet another object of the present invention is directed to remote multimedia in a network computer-server based system which would be adapted to ease the load on the network and reduce the band width requirement for network computer for better and cost effective wide scale use of computing networks.
  • a further object of the present invention is directed to advantageous utilization of the audio- video encoding systems which are presently adapted for the internet and vary from few Kbps to a few Mbps and make effective use of such efficient encoding using such format to send data from server to network computers.
  • Yet another object of the present invention is directed to remote multimedia in a network computer based system which would facilitate better viewing and hearing experience for the user by providing for the decoding closest to the user at the network computer whereby viewing and hearing experience for the user can be close to that of viewing it on a PC.
  • a further object of the present invention is directed to avoid the complexities of inefficient screen shot compression and decompression vis-a-vis multimedia encoding thereby provide for user liking multimedia content and avoiding problems of jumpy and patchy multimedia content viewing.
  • Yet further object of the present invention is to provide a remote multimedia system in a server based network system, which would avoid the afore discussed problems of decoding of the multimedia data on the server and the audio and video contents being sent in separate channel from the server to the network computer with no synchronization of the audio and video and the network computer outputting the highly unsatisfactory content for the user.
  • a network computer-server based computing system comprising atleast one server ;
  • Atleast one network computer operatively networked to said server ;
  • said network computer adapted to decode both said audio-video encoded components and display components and display to the user.
  • the decoding of the multimedia content is carried out at the network computer closer to the user and the server is free of any required decoding of the multimedia content thereby favouring reduced CPU and memory requirement of the server.
  • the above network computer-server based computing system is adapted for reduced requirement of bandwidth for network computers. 5
  • the server comprises
  • said dummy multimedia decoder adapted to pass blank data without decoding multimedia content to the calling application ; 10 said dummy multimedia decoder operatively connected to a display system to interact and check the content of application exposed to the user and based thereon determine the content of the decoded data to be exposed by the network computer .
  • the said dummy decoder send the encoded data and the location, shape and size of the output 15 window of this data that the network computer should display subsequent to decoding; and a displayed data compression system adapted for compressed display data.
  • the network computer comprises
  • a display-multimedia data scheduler adapted to check at the incoming data and 25. forward selectively to a multimedia decoder unit or a display data compression unit;
  • said multimedia decoder unit is adapted to output the video data to a frame buffer and the audio data ,if any, to the audio system
  • said display data decompression system adapted for decompressing the compressed display data from the server and outputting to the frame buffer;
  • said Frame Buffer adapted to display picked up data to be displayed to the user.
  • the said display-multimedia scheduler is adapted to give priority to the multimedia data.
  • the display data decompression system is adapted to carry out additional functions other than decompression preferably drawing functionality.
  • the said multimedia encoding system comprises standard encoders including
  • a network computer-server based computing system comprising a server ;
  • said server comprising (i) dummy multimedia decoder adapted to pass blank data without decoding multimedia content; (ii) said dummy multimedia decoder operatively connected to a display system to interact and check the content of application exposed to the user and based thereon determine the content of the decoded data to be exposed by the network computer and send the two aforementioned information to the network computer; and (iii) a displayed data compression system adapted for compressed display data; and
  • each said network computer comprising (i) a display-multimedia data scheduler adapted to check at the incoming data and forward selectively to a multimedia decoder unit or a display data compression unit; (ii) said multimedia decoder unit is adapted to output the video data to a frame buffer and the audio data ,if any, to the audio system,(iii)said display data decompression system adapted for decompressing the compressed display data from the server and outputting to the frame buffer ;and (iv)said Frame Buffer adapted to display picked up data to be displayed to the user. 5
  • the system of the invention avoids the problems of overloading of servers and related loss of server performance and unsatisfactory visual experience for the end user.
  • the system further takes care of the problem of choking of network and is directed to ease the load on the network.
  • most of the audio and video encoding system presently available are adapted for internet which vary from few Kbps to a few Mbps and the 10 invention makes advantageous use of such very efficient encoding to send data from server to network computer reducing the bandwidth requirement for the network computers.
  • the system of the invention further provides for better viewing and hearing experience for 15 the end user. This is possible in the present system since as disclosed hereinbefore in the remote multimedia in network computer based system of the invention the decoding happens closest to the user at the network computer and the viewing and hearing experience for the user is thus close to that which can be achieved on a PC.
  • Figure 1 is a block diagram illustrating the conventional remote multimedia in a network computer based environment presently in use.
  • FIG. 2 is a block diagram of the network computer - server based computing system in 30 accordance with the present invention.
  • figure 1 illustrates by way of a block 35 diagram the server side and the network computer side features in case of the usual presently available network computer / server based remote multimedia applications.
  • the multimedia data is decoded on the server and the resulting screen shots are compressed and sent to the network computers.
  • the present available network computers are not capable of differentiating between multimedia content and computing content and simply decompress the data received from the server for display to the user.
  • the server gets overloaded in case most of its users are decoding the above mentioned content simultaneously. This brings down the performance of the server and also brings down the refresh rate of the network computer apart from leading to an unsatisfactory visual experience for the end user. Moreover, since screen shot compression and decompression is not as efficient as multimedia encoding the effect to the user when the multimedia content is not sent in the appropriate encoded format is very unsatisfactory leading to jumpy and patchy contents.
  • the audio and video contents are sent in separate channels from the server to the network computers and there is no synchronization of the audio and video when the network computer outputs the contents. This further leads to unsatisfactory experience to the end user.
  • the conventional networking system leads to chocking of network since multimedia content usually result in rapidly changing screen and frames.
  • multimedia content usually result in rapidly changing screen and frames.
  • atleast 30 frames are sent to the network i.e. 15 MB data per second and if there is no compression the band width require would be 90 Mbps which leads to chocking of the network.
  • band width are not consistently available between the network computer and the server leading to further complexities.
  • FIG. 2 illustrates by way of block diagram an embodiment of network computer - server based computing system in accordance with the present invention.
  • the server side basically includes a Dummy Multimedia Decoder, Display System and Display Data Compression System.
  • the server side instead of conventional multimedia decoder the server side includes dummy decoders. Unlike the current decoders, such Dummy decoders in the
  • 10 system of the invention do not decode the multimedia contents. It passes blank data to the applications.
  • the application passes the entire computing screen to the display system.
  • the decoder interacts with the display system on the server to check what part of the application is exposed to the user. This information is then used to calculate what part of the decoded data should be exposed. All these information and the encoded multimedia data are then sent
  • the display system and the data compression system in the server side can be maintained as usual.
  • the display system renders the drawings as the application demands and the 20 compression system compress the drawing data and passes to the network computer.
  • the system of the invention includes the Display - Multimedia Data Scheduler, Display Data Compression System, Multimedia Decoder and Frame Buffer and finally the Display and Speaker outputs for the multimedia 25 contents.
  • the display multimedia data scheduler is adapted to look at the incoming data and send it to the multimedia decoder or display data decompression unit respectively.
  • the scheduler is 30 preferably adapted to give priority to the multimedia data but the priority mechanism is dynamic to ensure that display data is not starved.
  • the display data decompression system is adapted for decompressing the compressed display data from the server and outputting it to the frame buffer.
  • this system can perform more than just decompression such as the system can be adapted to be further capable of few drawing functionalities.
  • the multimedia decoder is selected depending on the multimedia encoding system used such as selected from standard encoder like MPEG or MP3.
  • the system is adapted to output the video data to the frame buffer and the audio data, if any, to the audio system.
  • the decoder also uses the attributes sent from the server to determine the display geometry of the decoded data.
  • the decoder shares the frame buffer with the decompression system already discussed above.
  • the frame buffer is adapted such that the display picks up the data to be displayed to the user from the frame buffer.
  • the above system of the invention would further favour reducing the server load and the server can thus carry out fewer activities with possible reduction of the CPU and memory requirements of the server. Also the system is adapted to ease the load on the network and reduce the band width requirement for network computer for better and cost effective wide scale use of computing networks.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un dispositif multimédia éloigné dans un environnement réseautique et, en particulier, un ordinateur de réseau. Le système informatique de l'invention qui est conçu pour séparer les composants codés audio/vidéo informatiques de l'informatique et d'autres composants d'affichage permet d'éviter les problèmes de surcharge de serveurs et d'étranglement de réseaux, en simplifiant la réseautique informatique par serveur et en fournissant une expérience visuelle satisfaisante basée sur le contenu multimédia aux utilisateurs finaux. Le système permet également une meilleure synchronisation des composants audio et vidéo comme sortie du réseau informatique, ce qui permet de satisfaire l'utilisateur final en améliorant la qualité et en ajoutant de la valeur aux installations.
PCT/IN2006/000449 2006-11-13 2006-11-13 Dispositif multimédia éloigné pour réseautique WO2008059511A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/IN2006/000449 WO2008059511A2 (fr) 2006-11-13 2006-11-13 Dispositif multimédia éloigné pour réseautique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IN2006/000449 WO2008059511A2 (fr) 2006-11-13 2006-11-13 Dispositif multimédia éloigné pour réseautique

Publications (2)

Publication Number Publication Date
WO2008059511A2 true WO2008059511A2 (fr) 2008-05-22
WO2008059511A3 WO2008059511A3 (fr) 2009-04-09

Family

ID=39402094

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IN2006/000449 WO2008059511A2 (fr) 2006-11-13 2006-11-13 Dispositif multimédia éloigné pour réseautique

Country Status (1)

Country Link
WO (1) WO2008059511A2 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8185581B2 (en) 2009-05-19 2012-05-22 Nholdings Sa Providing a local device with computing services from a remote host
US8756293B2 (en) 2007-04-23 2014-06-17 Nholdings Sa Providing a user with virtual computing services
US8868785B1 (en) 2010-02-11 2014-10-21 Adobe Systems Incorporated Method and apparatus for displaying multimedia content

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020019984A1 (en) * 2000-01-14 2002-02-14 Rakib Selim Shlomo Headend cherrypicker with digital video recording capability
US20020069414A1 (en) * 2000-12-04 2002-06-06 Alticast, Corp. Method for re-utilizing contents data for digital broadcasting and system therefor
US20020087992A1 (en) * 2000-08-16 2002-07-04 Bengeult Greg A. Method and apparatus for bi-directional data services and live television programming to mobile platforms
US20020142689A1 (en) * 2001-01-23 2002-10-03 Levit Mikhail R. Non-woven sheet of aramid floc

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020019984A1 (en) * 2000-01-14 2002-02-14 Rakib Selim Shlomo Headend cherrypicker with digital video recording capability
US20020087992A1 (en) * 2000-08-16 2002-07-04 Bengeult Greg A. Method and apparatus for bi-directional data services and live television programming to mobile platforms
US20020069414A1 (en) * 2000-12-04 2002-06-06 Alticast, Corp. Method for re-utilizing contents data for digital broadcasting and system therefor
US20020142689A1 (en) * 2001-01-23 2002-10-03 Levit Mikhail R. Non-woven sheet of aramid floc

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8756293B2 (en) 2007-04-23 2014-06-17 Nholdings Sa Providing a user with virtual computing services
US9277000B2 (en) 2007-04-23 2016-03-01 Nholdings Sa Providing a user with virtual computing services
US8185581B2 (en) 2009-05-19 2012-05-22 Nholdings Sa Providing a local device with computing services from a remote host
US8478817B2 (en) 2009-05-19 2013-07-02 Nholdings Sa Providing a local device with computing services from a remote host
US8868785B1 (en) 2010-02-11 2014-10-21 Adobe Systems Incorporated Method and apparatus for displaying multimedia content

Also Published As

Publication number Publication date
WO2008059511A3 (fr) 2009-04-09

Similar Documents

Publication Publication Date Title
US11750863B2 (en) Systems and methods for bandwidth-limited video transport
US11120677B2 (en) Transcoding mixing and distribution system and method for a video security system
US20090322784A1 (en) System and method for virtual 3d graphics acceleration and streaming multiple different video streams
JP5122644B2 (ja) レーザコンテンツを使用して場面を構成するための方法及び装置
JP2006501758A (ja) ビデオ圧縮システム
WO2008027724A1 (fr) Techniques pour la gestion de compositions visuelles pour un appel de conférence multimédia
EP2899990A1 (fr) Distribution intelligente de données
CN105577819A (zh) 一种虚拟化桌面的分享系统、分享方法以及分享装置
CN102158693A (zh) 自适应解码嵌入式视频比特流的方法及接收系统
US9226003B2 (en) Method for transmitting video signals from an application on a server over an IP network to a client device
US20130039429A1 (en) Computer display content coding method and system
WO2008059511A2 (fr) Dispositif multimédia éloigné pour réseautique
KR20190003729A (ko) 컨텐트 분산 네트워크들에서 엠펙 미디어 전송 통합을 위한 방법 및 장치
US20130290514A1 (en) Dynamic interstitial transitions
KR101877034B1 (ko) 멀티비전 가상화 시스템 및 가상화 서비스 제공 방법
KR102312668B1 (ko) 비디오 트랜스코딩 시스템
CN115486058A (zh) 发信号通知用于远程终端的电话会议和远程呈现的多个音频混合增益的技术
EP2464115A1 (fr) Procédé et dispositif d'entrées/sorties pour rendre au moins un contenu audio, vidéo et de graphiques informatiques et dispositif d'entretien pour la fourniture d'au moins un contenu audio pré-rendu, vidéo pré-rendu et de graphiques informatiques pré-rendus
US10218992B2 (en) Encoding, transmission and decoding of combined high motion and high fidelity content
US20140055471A1 (en) Method for providing scalable remote screen image and apparatus thereof
Botteck et al. Personal networks and Multimedia rendering
Ahmad Mobile Video Transcoding Approaches and Challenges
GB2451270A (en) Video Data Communication System and Method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 06832298

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 1687/CHENP/2009

Country of ref document: IN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06832298

Country of ref document: EP

Kind code of ref document: A2