CN1277774A - 在广播应用中仿真互联网上的流式传输 - Google Patents

在广播应用中仿真互联网上的流式传输 Download PDF

Info

Publication number
CN1277774A
CN1277774A CN99801418A CN99801418A CN1277774A CN 1277774 A CN1277774 A CN 1277774A CN 99801418 A CN99801418 A CN 99801418A CN 99801418 A CN99801418 A CN 99801418A CN 1277774 A CN1277774 A CN 1277774A
Authority
CN
China
Prior art keywords
state information
file
client
network
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN99801418A
Other languages
English (en)
Other versions
CN1134958C (zh
Inventor
R·马拉特
A·辛哈
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Publication of CN1277774A publication Critical patent/CN1277774A/zh
Application granted granted Critical
Publication of CN1134958C publication Critical patent/CN1134958C/zh
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/65—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
    • A63F13/12—
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/33—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
    • A63F13/335—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35—Details of game servers
    • A63F13/358—Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80—Special adaptations for executing a specific game genre or game mode
    • A63F13/803—Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/27—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding involving both synthetic and natural picture components, e.g. synthetic natural hybrid coding [SNHC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/24—Systems for the transmission of television signals using pulse code modulation
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/40—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
    • A63F2300/402—Communication between platforms, i.e. physical link to protocol
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/40—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
    • A63F2300/407—Data transfer via internet
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/40—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
    • A63F2300/409—Data transfer via television network
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/69—Involving elements of the real world in the game world, e.g. measurement in live races, real video
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8017—Driving on land or water; Flying
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082—Virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)
  • Computer And Data Communications (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

在客户－服务器网络上的广播应用中,仿真在互联网上流式传输动画数据给多个客户。动画被认为是一系列状态。状态信息被发送到客户,而不是图形数据本身。客户在状态信息的控制下产生动画数据本身。服务器和客户使用共享对象协议进行通信。因此,流式传输以及广播一起被完成,而不会遇到严重的网络带宽问题。

Description

在广播应用中仿真互联网上的流式传输
                   发明领域
本发明涉及通过网络对多媒体文件进行流式传输(streaming)。本发明具体地涉及使得仿真在广播范围内通过互联网进行流式传输图象或视频动画成为可能。
                  背景技术
术语“streaming(流式传输)”是指将数据从服务器传输到客户，以使得在接收端可以把它作为稳定的和连续的数据流来处理。随着互联网的成长，流式传输技术变得越来越重要，因为大多数用户不能足够快地接入以下载大的多媒体文件，例如，包括图形动画、音频、视频、或它们的组合。然而，流式传输使得客户的浏览器或插入能够在接收到整个文件以前开始处理数据。为了流式传输行得通，接收文件的客户端必须能够收集数据和把它作为稳定的数据流发送到正在处理数据的应用项。这意味着，如果客户在比所需要的更快地接收数据，则超量的数据需要被缓存。另一方面，如果数据没有及时到达，数据的呈现将不是平滑的。
术语“file(文件)”在这里被用来表示可供数据处理的相关数据项实体，它能够作为整体被处理。在本发明的范围内，术语“file”可以指实时产生的数据以及从存储器恢复的数据。
VRML 97和MPEG-4是当前可提供的或正处在开发的用于通过互联网进行图形数据通信的技术。VRML 97代表“Virtual RealityModeling Language(虚拟真实模型语言)”，它是用于描述交互3D(三维)多媒体内容的国际标准(ISO/IEC 14772)文件格式。MPEG-4是由MPEG(活动画面专家组)开发的ISO/IEC标准。在这两种标准中，图形内容被构建成所谓的场景图形。场景图形是坐标系统和形状的族树，它们集合地描述图形世界。场景族树中最顶端的项目是世界坐标系统。世界坐标系统起到对于一个或多个子坐标系统和形状的父代节点的作用。这些子坐标系统又是另一些子坐标系统和形状的父代节点，等等。
VRML是用于描述对象的文件格式。VRML规定一组用于实施3D图形、多媒体、和交互对象/世界构件的对象。这些对象被称为节点，它们包含被存储在字段和事件中的基本的数据。典型地，场景图形包括结构节点、叶节点、内插节点、和传感节点。结构节点规定场景内对象的空间关系。叶节点规定对象的物理外貌。内插节点规定动画。传感节点规定对于特定的用户输入模态的用户交互作用。VRML并不直接支持从服务器到客户的数据流式传输。对于流式传输来说是重要的那些手段(例如数据流之间的同步和时间印记)在VRML中并不存在。然而，VRML具有一种机制，它允许外部的程序与VRML客户交互作用。这已经在体育应用项中被用来装载动画数据给客户。例如，从<http：//www.virtualive.com>上参阅Orad Hi-Tec System，Ltd公司的“VirtuaLive Soccer”。这个网页文件讨论用于产生现实的、活动的、三维图形剪接的处理过程，它模拟真实的足球比赛精华部分，以便通过互联网发送。该系统以接近实时地用完全多媒体的网页产生用来补充电视体育覆盖的内容。在这个例子中，处理过程以两个步骤来进行。首先，体育馆的图形模型和足球运动员的图形模型连同外部程序(在本例中是Java Applet)一起被下载。然后，用户可以与外部程序交互作用，以请求特定的动画。用于这种动画的数据然后被下载到客户，它们与用户交互作用。按照节点类型来说，这个处理过程首先下载结构节点和叶节点，然后是内插节点。通过改变内插节点组，有可能运行不同的动画序列。在这个例子中所使用的处理过程有点等价于这样的一种单个步骤的处理过程，其中用户可以选择包含全部模型(结构节点)和全部动画数据(内插节点)的完整的VRML文件。这个方法导致在客户处可以播放任何内容之前的长的下载时间。这是作为失败的经验被感受的，特别是如果与电视广播(其中内容是立即可供使用的)相比较的话。
上述的另一种技术，MPEG-4，规定了用于场景的二进制描述格式(BIFS)，它与VRML 97有很大的重叠。另一方面，MPEG-4已经被设计来支持图形的流式传输以及用于视频。MPEG-4规定了用于更新场景和使场景活动的两个服务器/客户协议：BIFS-Update和BIFS-Anim。MPEG-4比起VRML的某些优点是场景描述和动画数据的编码以及内建的流式传输能力。用户不必等待全部下载动画数据。例如，在上述的足球比赛广播应用中，只要运动员和体育馆的模型一旦被下载，动画就可开始。MPEG-4还有这样的优点，由于它的使用压缩的二进制格式的BIFS传送协议，它是更有效的。
在流式传输方面，上述的已知技术在带宽使用、分组-丢失隐蔽或恢复、和多用户交互性方面，特别是在给大量客户的广播中，具有若干限制。
关于带宽，在服务器处产生完整的动画。这导致需要在将客户到服务器的网络(例如互联网)上传送大量的数据。例如，在上述的足球广播应用中，需要22个足球运动员是活动的。每个单独的运动员的每个动画的数据点包括在三维空间中的位置和一组(比如说)15个旋转关节(joint rotations)来模仿运动员的姿势。这代表63个浮点数值。如果假定动画的更新速率是每秒15个数据点，则需要665kbps的比特速率。这个比特速率可通过压缩而被减小。典型地，使用BIFS可减小比特速率20倍，给出约33kbps的比特速率。然而，这个数目没有考虑对于互联网协议(RTP、UDP、和IP)和对于附加数据类型(例如音频)所需要的附加开销。无论如何，当前在消费者市场上可以买到的典型的调制解调器具有28.8kbps或33.6kbps的容量。很明显，由于带宽限制，流式传输动画在最终用户处会造成问题。在给大量客户(比如说，100,000个客户)的广播的情况下，将需要在几个路由器处复制数据流。互联网的路由器确定：在到达分组的最后目的地的路程上，该分组应当被转发到的下一个网络点。路由器根据它对于它所连接的网络的状态的当前的了解，决定用哪条路程发送每个信息分组。路由器位于网络的任何接合点或网关，包括每个互联网存在点。很显然，广播会导致互联网上的难以控制的数据爆发。为了避免这种情况的发生，需要把实际带宽限制为比28.8kbps低得多。
关于分组丢失隐蔽，基于VRML的系统利用可靠的协议(TCP)。分组丢失不是这里的问题。在MPEG-4的情况下，BIFS使用RTP/UDP/IP。所以，需要有分组丢失恢复机制。在点对点的应用中，可以考虑重新发送丢失的分组。然而，在广播的情形中，这要复杂得多。然而，在两种情况下，MPEG可靠度需要更大的带宽使用量(冗余性)或者更长的执行时间(重新发送)。
关于多用户交互性，VRML和MPEG-4主要是基于服务器-客户的通信。不存能够使得多个客户之间进行通信的措施。
为了得到关于VRML的更多的信息，可参阅，例如，在<http：//sgi.felk.cvut.cz/～holecek/VRML/concepts.html>上的“KeyConcepts(关键概念)”，March 5，1996，或在<http：//www.stl.nps.navy.mil/～brutzman/vrml/vrml 95.html>上公开提供的，D.P.Brutzman等人的，“InternetworkInfrastructure Requirements for Virtual Enviroments(对于虚拟环境的网间连接底层结构要求)”，Jan.23，1996.
为了得到关于MPEG-4的更多的信息，可参阅，例如，在<http：//drogo.cselt.stet.it/mpeg/standards/mpeg-4/mpeg-4.htm>上公开提供的，“Overview of the MPEG-4 Standard(MPEG-4标准概要)”，ISO/IEC JTC1/SC29/WG11 N23232 ed.Rob Koenen July 1998.
                     发明目的
所以，本发明的目的是提供一种技术，它使得客户能够把多媒体像稳定和连续的数据流那样来进行处理。另一个目的是使得大量客户能够在互联网上的广播中进行连续的处理。应当指出，上述的问题在广播应用中变成为相当尖锐。
                     发明概要
为此，本发明提供了对通过网络将多媒体文件流式传输到一个被连接到网络的接收站进行仿真的方法。提供了描述文件的各个状态的各个状态信息。使得接收站能够通过网络接收各个状态信息，以及使得接收站能够在各个状态信息的控制下在本地产生多媒体文件。在用于动画的广播中，本发明涉及通过网络提供数据从而能显示图形动画的方法。在网络上提供描述各个接连的动画状态的各个状态信息。各个状态信息是通过网络接收的。使接收站能够在进行接收后在各个状态信息的控制下产生动画。
在本发明中，多媒体文件(动画、视频、或音频文件)以一系列的状态被描述。正是将这个状态信息而不是将动画数据本身发送到客户。所以，术语“emulating(仿真)”强调：被传送到客户的信息不需要进行流式传输。客户在本地根据所接收的状态信息产生用于演播的数据。因此，用户可以在演播期间觉察到连续和稳定的数据流，如同该数据是在网络上(在最佳条件下)进行流式传输一样。
在优选实施例中，将一个共享的对象协议用来完成仿真。服务器和客户具有一批对象的复制品。对象是一种保持状态信息的数据结构。在模拟足球比赛方面，对象例如是一个足球运动员的图形表示。服务器接收流式传输的视频文件，以及监视该对象。应当指出，MPEG-4使得能够创建作为整体被处理的视频对象。如果服务器改变这个对象的状态，则共享的对象协议使得客户处的复制品随之改变。这一点可参照附图更详细地被描述。
这个状态信息比起动画数据本身具有更高的抽象级别。例如，在上述的足球比赛广播应用中，状态信息包括22个运动员在场地上的当前位置和规定他们当前行动(例如，“跑动”、“跳跃”等等)的参量。使用较高级别信息具有几个优点，特别是在其中动画在互联网上被流式传输给大量观众的广播应用中。在互联网上传送时，状态信息的内容是非常紧凑的，这样比起流式传输动画本身的情况下需要较低的带宽。动画可根据几个参量在本地被产生。另外，动画数据点的更新速率是较低的，因为动画的状态以慢于动画数据本身的速率改变。这有助于进一步降低带宽要求。而且，本发明对于分组丢失恢复或隐蔽以及对于网络执行时间起伏遮蔽提供了改进的可能性。在状态之间很容易进行内插和外推，以及实施推测算法原理。由于这个较高的抽象级别，用户与动画的交互是更容易编程的。另一个优点是，如果使得客户能够共享状态信息，则多用户交互是行得通的。再一个优点是，使得客户能够根据他们各自的处理能力(该能力可能随客户而不同)把状态信息变换成动画。在客户处的可提供资源可能随每个客户或客户组而不同。
在本发明的范围内，可参考同一个受让人的美国专利申请序列号No.09/053,448(PHA 23，383)，其题目为“Group-wise videoconferencing uses 3D-graphics model of broadcast event(分组视频会议使用广播事件的3D图象模型)”，该专利申请在此引用，以供参考。这个文件描述了提供给多个在地域上分布的最终用户的电视广播业务。广播业务与会议模式结合在一起。在广播中的某个事件后，特定的最终用户组在软件控制下被切换到广播模式，从而使得该组用户能够讨论该事件。会议模式通过被下载到该组的事件的视频表示的3D图形模型而被增强。最终用户能够与模型交互作用，以便讨论事件的可选方案。
                         附图简述
现在参照附图和通过实例来说明本发明，其中：
图1是VRML客户-服务器系统的图；
图2是MPEG-4客户-服务器系统的图；以及
图3-6是本发明的系统的图。
在所有图中，相同的参考数字表示类似的或相应的特性。
                      优选实施例描述
图1是基于VRML的客户-服务器系统100的方框图。系统100包括服务器102，它通过通信信道106(这里是互联网)与客户104相耦合。该系统100可以包括更多的客户，但为了免得使该图受到混淆，在图上未示出。服务器102包括源编码器108和信道编码器110。客户104包括信道译码器112和源译码器114。源编码器108被看作为内容生成工具。例如，它可以是通过工作在视频上的活动获取装置(未示出)来产生VRML动画数据的工具。信道编码器110是这样一个子系统，它把在源编码器108处生成的VRML动画当作为输入，并把它变换成可以在互联网上输送的形式。VRML动画数据被存储在文件中。这个文件的输送使用标准文件输送协议。在客户104处，信道译码器被包含在外部程序116中，它从下载的文件得到动画数据，并把它发送到执行源译码器功能的VPML播放器118。源译码器的功能基本上是管理景象图形。这种服务器-客户通信程序不是流式传输解决方案。VRML的技术条件没有把流式传输考虑为一种需要。诸如数据流之间的同步和时间印记(对于流式传输来说都是重要的)的手段，在VRML中并不存在。
图2是基于MPEG-4的客户-服务器系统200的方框图。系统200包括服务器202，它通过通信信道206被耦合到客户204。服务器202包括源编码器208和信道编码器210。客户204包括信道译码器212和源译码器214。如上所述，MPEG-4已被设计成支持流式传输。尤其是，MPEG-4已经规定了一种与VRML 97有很大重叠的、对于景象的二进制描述格式(BIFS)。而且，MPEG-4规定了用于更新场景和使场景活动的两种服务器/客户协议，即BIFS-Update和BIFS-Anim。MPEG-4比起VRML在流式传输方面的优点是场景描述的编码和动画数据的编码以及内建的流式传输能力。源编码器208类似于编码器108，也是内容生成工具。信道编码器210不同于信道编码器110。它生成以BIFS和BIFS-Anim格式的比特流。该比特流包含运动员和体育馆的图形模型(在足球比赛动画中)以及动画数据。
然而，系统100和200在用于广播给大量客户(比如说，100-100,000客户)的动画环境中被使用时，具有几个严重的缺点。该限制涉及如上面所提到的网络带宽使用、分组丢失隐蔽、和多用户交互作用。
本发明的优选实施例通过仿真采用能支持对象拥有者和对象观众(或听众)对对象进行共享的通信协议的流式传输而提供了对于这些问题的解决办法。共享的对象是一种保持状态信息的数据结构。规定整个状态的共享的对象集被称为世界模型。客户和服务器具有他们自己的世界模型复制品。例如，在足球比赛表示方面，一个对象是足球运动员的表示。然后，对象的状态信息例如是足球运动员在3D空间中的位置，或活动状态，诸如“跑动”或“跳跃”或“滑动”或“躺在地上，看来像受伤，但具有喜剧的行动记录”。每个共享的对象被特定的一方(例如服务器)所拥有。拥有者可改变对象中所包含的状态信息。当这种情况发生时，协议自动地同步网络中的状态信息。这样的协议在以下被称为共享对象支持协议。该协议确保所有的世界模型复制品保持与所涉及的世界模型的状态一致。可被使用于这种用途的协议的例子是DIS(分布交互模拟)和ISTP(交互共享传送协议)。本发明的根本概念是把动画描述为一系列的状态。例如，在足球软件应用中，动画被描述为在场地上的一系列运动员位置和运动员的动作状态。在给定的时刻的状态由世界模型来代表。随着时间的过去，状态在演变，以及该协议可以同步网络中的世界模型的状态。这也可根据共享的对象来解释。这些对象保持描述给定时刻的比赛的状态信息。对于每个对象的状态信息的更新导致一些消息的产生，这些消息通过网络被发送到客户。
图3是本发明的系统300的方框图。系统300包括服务器302，它通过网络306被耦合到客户304。服务器302包括源编码器308和信道编码器310。客户304包括信道译码器312和源译码器314。服务器302具有世界模型的复制品316，以及客户304具有世界模型的复制品318。数据在输入端320被流式传输到源编码器308。源编码器308根据所接收的输入产生所需要的状态信息，并且当流式传输过程继续进行时，更新在世界模型复制品中的对象的状态。这种类型的技术例如由上述的VirtuaLive足球系统所使用。信道编码器310监视世界模型复制品316，以及编码共享的对象的状态改变。编码状态的改变通过网络304被发送到客户304。信道译码器接收状态改变，以及更新本地的世界模型复制品318。源译码器314完成两个任务。第一，它根据所接收的状态信息产生动画。第二，源译码器314按照动画来管理场景图形。源译码器314现在是智能部件：它执行动画计算，另外，它能够执行一些其它任务，例如状态内插或外推，以便隐蔽分组丢失或网络执行时间起伏。
关于这方面，可以参考同一受让人的美国专利申请序列号No.08/722,414(PHA 23，155)，其题目为“Multi-player video gamewith local updates mitigates latency effects(带有本地更新缓和执行时间效果的多用户视频游戏)”，它在此引用，以供参考。这篇参考文献讨论了这样一个系统，其中多个用户通过交互软件应用共享一个虚拟环境。取决于在该特定用户与每个各个其它用户之间在虚拟环境中的各个相对距离，将特定的用户的状态改变发送到一个或多个其它用户。这个条件性发送减小了消息业务量，以及允许虚拟环境实际上任意地伸缩。
另外，可以参考同一受让人的美国专利申请序列号No.08/722,413(PHA 23，156)，其题目为“Latency effect inmulti-player video game reduced by surrogate agent(通过代理代理人减小的多用户视频游戏中的执行时间效果)”，它在此引用，以供参考。这篇文件涉及处理用于两个或多个用户之间的竞争的交互软件应用的数据处理系统。该系统包括用于由各个用户起动的用户接口机。该接口机通过网络进行互联。为了有效地消除等待时间，一个用户在其它的用户的接口机中被表示为代理人，他对于其它用户的行动的反应由系统中所存储的规则基准来控制。
还可以参考同一受让人的美国专利申请序列号No.08/994,827(PHA 23，319)，题目为“Diversion agent uses cinematographictechniques to mask latency(娱乐代理使用电影院图形技术来遮蔽等待时间)”，它在此引用，以供参考。这篇文件涉及作为运行在数据处理系统中的用户交互软件应用项的功能性部分的软件代理。该代理产生用户可觉察的效果，以便遮蔽在数据传递到用户时存在的等待时间。该代理产生了利用电影院图形技术的效果。
应当指出，世界模型的复制品316和318例如当被给出时在表面上看起来并不需要是相同的，只要世界模型的一个复制品中的对象和世界模型的另一个复制品中的对象在它们共享着状态改变的意义上被看做是共享的。可行性和不同一性的程度是与应用项有关的。例如，如果一个客户的用户喜欢把足球运动员表示为例如企鹅，以及另一个客户的用户喜欢芭蕾舞演员的表演，则在两个客户处的表示可以通过共享的状态改变而在全部系统中保持一致。作为另一个例子，客户304可以使得用户能够输入附加的状态信息，以便在演播时控制世界模型的给出。例如，当观看VirtuaLive足球比赛时，用户可以选择特定的观看点。在服务器302中不存在、以及不需要存在这个状态信息。应当指出，基于状态信息和世界模型给出观看点，比起如果将图象作为带有深度信息的位图实际地流式传输到客户来说，则简单得多，并且需要更少的资源。因此，除了上述的本发明的优点以外，本发明使得易于进行用户交互性。
系统300的配置假定：客户304能够运行软件应用项，以及具有足够有力的CPU和足够大的存储量。某些客户在机器上可能没有这些能力。所以，希望考虑较低层次的终端，也被称为“瘦客户(thinclients)”。这样的终端例如可以是低层次的MPEG-4终端，它们把BIFS作为输入来接受，但可能没有足够的能力。这可以参照图4来解释，该图4是按照本发明的系统400的方框图。系统400包括服务器302，它通过转译站406与客户204通信。服务器302和客户304的结构已在上面讨论过。转译站406保持世界模型的本地复制品。这个世界模型用来自服务器302的消息进行更新，以使得该模型代表当前的状态。根据这个状态信息，转译站406计算动画。动画数据以BIFS-Anim格式被编码，并被发送到MPEG-4的客户204。服务器302类似于系统300中的服务器。转译站406是是一个模块，它执行在根据一方面的更新对象支持协议发送的消息与另一方面的BIFS-Anim比特流之间的变换。该转译站406具有上述的信道译码器312、源代码转换器410和信道编码器412。译码器312翻译从服务器302接收的消息，以及更新世界模型的本地复制品318。源代码转换器410包括一个根据状态信息计算动画的程序。这个模块优选地执行诸如分组丢失恢复(根据内插和外推)、推测算法、本地动画等那样的任务，类似于上述的源译码器314。信道编码器412根据源代码转换器410的输出产生BIFS和BIFS-Anim格式的比特流。
图5是本发明的系统500的方框图。系统500组合了系统300和400的配置结构。系统500包括服务器302、网络502、以及客户504、506、508和510，它们通过网络502被连接到服务器302。系统500还包括转译站406以及客户512、514和516。客户512-516通过网络502和转译站406被耦合到服务器302。客户512-516由转译站406以BIFS比特流向其提供服务，而客户504-510接收在支持共享对象的协议下的状态信息，以及产生动画本身。
图6是本发明使得客户之间能进行交互的系统600的方框图。系统600包括服务器302，它通过网络606被耦合到客户602和604。服务器302的结构配置已在上面讨论过。服务器302具有关于对象608、610、612、和614的世界模型的复制品。客户具有关于同样的对象608-614的世界模型的复制品。世界模型的复制品通过由服务器302发送的状态信息在整个系统600中被保持一致。这构成了如上所述的用于仿真流式传输图形动画、视频动画、或音频文件的基础。客户602和604现在也互相共享对象616和618，但不与服务器302共享。例如，客户602是对象“viewpoint(观看点)”的拥有者，该对象代表了由客户602所选择的足球比赛的图形表示的视图。根据从服务器302接收的状态信息，客户602给出比赛的图象，好像是从体育馆的特定的位置看到的一样。图象是根据从服务器302接收的当前的状态信息、本地的世界模型复制品、和通过用户输入装置620(例如，控制杆或鼠标)的能够选择观看点的用户输入的组合来给出的。客户604共享一个观看点对象，该观看点对象在客户602的控制下以及通过使用共享对象支持协议而与客户602处的视点对象保持一致。对象616-618不与系统中的其它客户共享。应当指出，根据状态信息和世界模型给出观看点，比起如果将图象作为带有深度信息的位图实际地被流式传输到客户602和604来说，是要简单得多，以及需要更少的资源。系统600甚至可以是完全的分布系统，而无需带有主要所有权的服务器。多个客户中的每个各个客户拥有从所有的客户可觉察到的世界模型中的各个对象。对象的拥有者触发一个状态改变，使它在网络中传播，以便保持与共享的世界模型的一致性。在多用户应用中，由于仿真流式传输动画，其结果是得到在每个客户处的连续演播，而没有严格的带宽限制。

Claims (11)

1.对通过网络将多媒体文件流式传输到一个被连接到网络的接收站进行仿真的方法，该方法包括：
-提供描述文件的各个状态的各个状态信息；
-使得接收站能够通过网络接收各个状态信息；以及
-使得接收站能够在各个状态信息的控制下产生文件。
2.权利要求1的方法，其特征在于，包括：
-接收通过流式传输的文件；以及
-根据所接收的文件，产生各个状态信息。
3.权利要求2的方法，其特征在于，包括使用共享的对象协议来把状态信息传送到接收站。
4.权利要求1的方法，其特征在于，其中各个状态信息在网络上被广播到多个接收站。
5.权利要求1的方法，其特征在于，其中文件包括图形动画。
6.权利要求1的方法，其特征在于，其中文件包括音频。
7.权利要求1的方法，其特征在于，其中文件包括视频。
8.通过网络提供数据以使得能够演播文件的方法，该方法包括：
-在网络上提供描述文件的各个接连的状态的各个状态信息；
-使得能够通过网络接收各个状态信息；以及
-使得能够在接收后在各个状态信息的控制下产生文件。
9.权利要求8的方法，其特征在于，包括提供使用共享对象协议的数据。
10.权利要求9的方法，其特征在于，包括提供广播中的数据。
11.一种在服务器-客户系统中所使用的站，其中：
-服务器被耦合到至少一个客户；
-系统能够仿真通过网络流式传输多媒体文件到接收站；
-服务器提供描述文件的各个状态的各个状态信息；
-接收站能够通过网络接收各个状态信息；
-接收站能够在各个状态信息的控制下产生文件；以及
-接收站流式传输所产生的文件到至少一个客户。
CNB998014184A 1998-08-24 1999-08-06 在广播应用中仿真互联网上的流式传输 Expired - Fee Related CN1134958C (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US09/138,782 US6697869B1 (en) 1998-08-24 1998-08-24 Emulation of streaming over the internet in a broadcast application
US09/138782 1998-08-24
US09/138,782 1998-08-24

Publications (2)

Publication Number Publication Date
CN1277774A true CN1277774A (zh) 2000-12-20
CN1134958C CN1134958C (zh) 2004-01-14

Family

ID=22483621

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB998014184A Expired - Fee Related CN1134958C (zh) 1998-08-24 1999-08-06 在广播应用中仿真互联网上的流式传输

Country Status (12)

Country Link
US (2) US6697869B1 (zh)
EP (1) EP1048159B1 (zh)
JP (2) JP2002523980A (zh)
KR (2) KR100791795B1 (zh)
CN (1) CN1134958C (zh)
AR (1) AR056899A1 (zh)
BR (1) BR9906766A (zh)
CA (1) CA2306785C (zh)
DE (1) DE69928642T2 (zh)
TR (1) TR200001074T1 (zh)
TW (1) TW480857B (zh)
WO (1) WO2000011847A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105263040A (zh) * 2015-10-08 2016-01-20 安徽理工大学 一种节省手机流量观看球赛直播的方法

Families Citing this family (168)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6453334B1 (en) 1997-06-16 2002-09-17 Streamtheory, Inc. Method and apparatus to allow remotely located computer programs and/or data to be accessed on a local computer in a secure, time-limited manner, with persistent caching
US6654931B1 (en) 1998-01-27 2003-11-25 At&T Corp. Systems and methods for playing, browsing and interacting with MPEG-4 coded audio-visual objects
US7565905B2 (en) * 1998-06-03 2009-07-28 Scott Laboratories, Inc. Apparatuses and methods for automatically assessing and monitoring a patient's responsiveness
GB2347332B (en) * 1998-10-28 2003-07-09 Canon Kk Computer games apparatus
AUPQ108799A0 (en) * 1999-06-21 1999-07-15 Unisearch Limited Progressive multi-frame animation software for web objects
US6934906B1 (en) 1999-07-08 2005-08-23 At&T Corp. Methods and apparatus for integrating external applications into an MPEG-4 scene
JP2001243043A (ja) * 2000-02-29 2001-09-07 Sony Corp ユーザインタフェースシステム、シーン記述生成装置及び方法、シーン記述変換装置及び方法、記録媒体並びに伝送媒体
JP4389323B2 (ja) * 2000-02-29 2009-12-24 ソニー株式会社 シーン記述変換装置及び方法
US7328239B1 (en) 2000-03-01 2008-02-05 Intercall, Inc. Method and apparatus for automatically data streaming a multiparty conference session
US6948131B1 (en) * 2000-03-08 2005-09-20 Vidiator Enterprises Inc. Communication system and method including rich media tools
JP2002051334A (ja) * 2000-08-01 2002-02-15 Sanyo Electric Co Ltd データ送信装置、データ受信装置及びデータ送受信システム
KR100429838B1 (ko) * 2000-03-14 2004-05-03 삼성전자주식회사 인터랙티브 멀티미디어 콘텐츠 서비스에서 업스트림채널을 이용한 사용자 요구 처리방법 및 그 장치
FR2807268A1 (fr) * 2000-04-04 2001-10-05 Koninkl Philips Electronics Nv Reseau, terminal d'emission et methode de constitution d'un point d'acces dans un flux de donnees
US8296805B2 (en) * 2000-05-30 2012-10-23 Sony Corporation Command description scheme providing for dynamic update of instance documents and their associated schema
AU7693201A (en) * 2000-07-27 2002-02-13 Bea Systems Inc System and method for concentration and load-balancing of requests
GR20000100267A (el) * 2000-08-01 2002-05-24 Θεοδωρου Χρηστος Μαγκος Αμφιδρομη επικοινωνια εικονικου χαρακτηρα με τους θεατες
FI112307B (fi) * 2000-08-02 2003-11-14 Nokia Corp Viestintäpalvelu
US6788300B2 (en) * 2000-08-09 2004-09-07 The Board Of Trustees Of The Leland Stanford Junior University Virtual interactive solids with dynamic multimedia
US6934334B2 (en) * 2000-10-02 2005-08-23 Kabushiki Kaisha Toshiba Method of transcoding encoded video data and apparatus which transcodes encoded video data
US20020083183A1 (en) * 2000-11-06 2002-06-27 Sanjay Pujare Conventionally coded application conversion system for streamed delivery and execution
US20020087883A1 (en) * 2000-11-06 2002-07-04 Curt Wohlgemuth Anti-piracy system for remotely served computer applications
US7062567B2 (en) 2000-11-06 2006-06-13 Endeavors Technology, Inc. Intelligent network streaming and execution system for conventionally coded applications
US8831995B2 (en) * 2000-11-06 2014-09-09 Numecent Holdings, Inc. Optimized server for streamed applications
GB0031157D0 (en) * 2000-12-20 2001-01-31 Ncr Int Inc Streaming of data
FR2823343B1 (fr) * 2001-04-05 2003-07-04 Cit Alcatel Dispositif de generation d'un fichier multimedia a destination d'un terminal de telecommunications et fichier multimedia associe
EP1258837A1 (en) * 2001-05-14 2002-11-20 Thomson Licensing S.A. Method to generate mutual photometric effects
US7216288B2 (en) * 2001-06-27 2007-05-08 International Business Machines Corporation Dynamic scene description emulation for playback of audio/visual streams on a scene description based playback system
KR20030035138A (ko) * 2001-10-30 2003-05-09 한국전자통신연구원 클라이언트-서버 기반 네트워크 가상환경에서 상태정보의전송 방법
KR100497497B1 (ko) * 2001-12-27 2005-07-01 삼성전자주식회사 엠펙 데이터의 송수신시스템 및 송수신방법
US9122808B2 (en) * 2002-02-25 2015-09-01 Csr Technology Inc. Network interface to a video device
US20040024580A1 (en) * 2002-02-25 2004-02-05 Oak Technology, Inc. Server in a media system
US7269543B2 (en) * 2002-02-25 2007-09-11 Zoran Corporation System and method for providing network connectivity to a common embedded interface by stimulating the embedded interface
KR100930340B1 (ko) * 2002-06-07 2009-12-08 엘지전자 주식회사 대화형 광디스크 장치에서의 채팅 데이터 재생방법과,콘텐츠 제공서버에서의 채팅 데이터 제공방법
ATE375187T1 (de) 2002-08-12 2007-10-15 Alcatel Lucent Verfahren und vorrichtungen zur implementerung von hochinteraktiven unterhaltungsdiensten unter verwendung der medienströmungstechnologie, das die bereitstellung auf abstand von virtuelle realitätdiensten ermöglicht
US8458028B2 (en) 2002-10-16 2013-06-04 Barbaro Technologies System and method for integrating business-related content into an electronic game
US9108107B2 (en) 2002-12-10 2015-08-18 Sony Computer Entertainment America Llc Hosting and broadcasting virtual events using streaming interactive video
US9077991B2 (en) * 2002-12-10 2015-07-07 Sony Computer Entertainment America Llc System and method for utilizing forward error correction with video compression
US8711923B2 (en) 2002-12-10 2014-04-29 Ol2, Inc. System and method for selecting a video encoding format based on feedback data
US9003461B2 (en) 2002-12-10 2015-04-07 Ol2, Inc. Streaming interactive video integrated with recorded video segments
US8832772B2 (en) 2002-12-10 2014-09-09 Ol2, Inc. System for combining recorded application state with application streaming interactive video output
US20090118019A1 (en) 2002-12-10 2009-05-07 Onlive, Inc. System for streaming databases serving real-time applications used through streaming interactive video
US9061207B2 (en) 2002-12-10 2015-06-23 Sony Computer Entertainment America Llc Temporary decoder apparatus and method
US9192859B2 (en) 2002-12-10 2015-11-24 Sony Computer Entertainment America Llc System and method for compressing video based on latency measurements and other feedback
US8526490B2 (en) * 2002-12-10 2013-09-03 Ol2, Inc. System and method for video compression using feedback including data related to the successful receipt of video content
US8840475B2 (en) * 2002-12-10 2014-09-23 Ol2, Inc. Method for user session transitioning among streaming interactive video servers
US8949922B2 (en) * 2002-12-10 2015-02-03 Ol2, Inc. System for collaborative conferencing using streaming interactive video
US9032465B2 (en) * 2002-12-10 2015-05-12 Ol2, Inc. Method for multicasting views of real-time streaming interactive video
US8495678B2 (en) 2002-12-10 2013-07-23 Ol2, Inc. System for reporting recorded video preceding system failures
US8366552B2 (en) * 2002-12-10 2013-02-05 Ol2, Inc. System and method for multi-stream video compression
US10201760B2 (en) * 2002-12-10 2019-02-12 Sony Interactive Entertainment America Llc System and method for compressing video based on detected intraframe motion
US8549574B2 (en) * 2002-12-10 2013-10-01 Ol2, Inc. Method of combining linear content and interactive content compressed together as streaming interactive video
US9446305B2 (en) 2002-12-10 2016-09-20 Sony Interactive Entertainment America Llc System and method for improving the graphics performance of hosted applications
US8661496B2 (en) 2002-12-10 2014-02-25 Ol2, Inc. System for combining a plurality of views of real-time streaming interactive video
US20110126255A1 (en) * 2002-12-10 2011-05-26 Onlive, Inc. System and method for remote-hosted video effects
US9138644B2 (en) * 2002-12-10 2015-09-22 Sony Computer Entertainment America Llc System and method for accelerated machine switching
US8893207B2 (en) 2002-12-10 2014-11-18 Ol2, Inc. System and method for compressing streaming interactive video
US8964830B2 (en) 2002-12-10 2015-02-24 Ol2, Inc. System and method for multi-stream video compression using multiple encoding formats
US8468575B2 (en) 2002-12-10 2013-06-18 Ol2, Inc. System for recursive recombination of streaming interactive video
US20110122063A1 (en) * 2002-12-10 2011-05-26 Onlive, Inc. System and method for remote-hosted video effects
US8387099B2 (en) 2002-12-10 2013-02-26 Ol2, Inc. System for acceleration of web page delivery
US9314691B2 (en) * 2002-12-10 2016-04-19 Sony Computer Entertainment America Llc System and method for compressing video frames or portions thereof based on feedback information from a client device
US7426539B2 (en) 2003-01-09 2008-09-16 Sony Computer Entertainment America Inc. Dynamic bandwidth control
TW589892B (en) * 2003-03-12 2004-06-01 Asustek Comp Inc Instant video conferencing method, system and storage medium implemented in web game using A/V synchronization technology
US8264489B2 (en) * 2003-07-11 2012-09-11 Intel Corporation Interface remoting
US20050148388A1 (en) * 2003-07-17 2005-07-07 Fabricio Vayra Method and system for interaction with real-time events from a remote location, through use of a computer, game console or other module
KR100695126B1 (ko) * 2003-12-02 2007-03-14 삼성전자주식회사 그래픽 데이터 압축에 관한 메타표현을 이용한 입력파일생성 방법 및 시스템과, ａｆｘ부호화 방법 및 장치
US20050130725A1 (en) * 2003-12-15 2005-06-16 International Business Machines Corporation Combined virtual and video game
US8965460B1 (en) * 2004-01-30 2015-02-24 Ip Holdings, Inc. Image and augmented reality based networks using mobile devices and intelligent electronic glasses
US10140514B1 (en) 2004-01-30 2018-11-27 Ip Holdings, Inc. Capturing and sharing images with mobile device users including for a limited duration of time
US11455799B2 (en) 2004-01-30 2022-09-27 Airspace Reality Image networks for mobile communication
US20050273804A1 (en) * 2004-05-12 2005-12-08 Showtime Networks Inc. Animated interactive polling system, method, and computer program product
US8870639B2 (en) 2004-06-28 2014-10-28 Winview, Inc. Methods and apparatus for distributed gaming over a mobile device
US8376855B2 (en) 2004-06-28 2013-02-19 Winview, Inc. Methods and apparatus for distributed gaming over a mobile device
US10226698B1 (en) 2004-07-14 2019-03-12 Winview, Inc. Game of skill played by remote participants utilizing wireless devices in connection with a common game event
US20060048136A1 (en) * 2004-08-25 2006-03-02 Vries Jeff D Interception-based resource detection system
US20060077817A1 (en) * 2004-09-13 2006-04-13 Seo Kang S Method and apparatus for reproducing data from recording medium using local storage
EP1789958A4 (en) * 2004-09-13 2009-12-09 Lg Electronics Inc METHOD AND DEVICE FOR REPRODUCING DATA RECORDED IN A RECORDING MEDIUM USING A LOCAL STORAGE
US7433760B2 (en) * 2004-10-28 2008-10-07 Accelerated Pictures, Inc. Camera and animation controller, systems and methods
US8359591B2 (en) * 2004-11-13 2013-01-22 Streamtheory, Inc. Streaming from a media device
US7695369B2 (en) * 2004-11-22 2010-04-13 Planetwide Games, Inc. Systems and methods for accessing online content during online gaming
WO2006057185A1 (ja) * 2004-11-26 2006-06-01 Kabushiki Kaisha Sega Doing Business As Sega Corporation 情報処理装置、データ処理方法、プログラム及び記録媒体
KR20060081323A (ko) * 2005-01-07 2006-07-12 엘지전자 주식회사 로컬 스토리지를 이용한 기록매체 재생방법 및 재생장치
US9716609B2 (en) * 2005-03-23 2017-07-25 Numecent Holdings, Inc. System and method for tracking changes to files in streaming applications
US8024523B2 (en) 2007-11-07 2011-09-20 Endeavors Technologies, Inc. Opportunistic block transmission with time constraints
US20060218165A1 (en) * 2005-03-23 2006-09-28 Vries Jeffrey De Explicit overlay integration rules
US20060230428A1 (en) * 2005-04-11 2006-10-12 Rob Craig Multi-player video game system
US10721543B2 (en) 2005-06-20 2020-07-21 Winview, Inc. Method of and system for managing client resources and assets for activities on computing devices
US8270439B2 (en) * 2005-07-08 2012-09-18 Activevideo Networks, Inc. Video game system using pre-encoded digital audio mixing
US9061206B2 (en) * 2005-07-08 2015-06-23 Activevideo Networks, Inc. Video game system using pre-generated motion vectors
US8284842B2 (en) 2005-07-08 2012-10-09 Activevideo Networks, Inc. Video game system using pre-encoded macro-blocks and a reference grid
US8118676B2 (en) * 2005-07-08 2012-02-21 Activevideo Networks, Inc. Video game system using pre-encoded macro-blocks
US8074248B2 (en) 2005-07-26 2011-12-06 Activevideo Networks, Inc. System and method for providing video content associated with a source image to a television in a communication network
US8149530B1 (en) 2006-04-12 2012-04-03 Winview, Inc. Methodology for equalizing systemic latencies in television reception in connection with games of skill played in connection with live television programming
US9919210B2 (en) 2005-10-03 2018-03-20 Winview, Inc. Synchronized gaming and programming
US9511287B2 (en) 2005-10-03 2016-12-06 Winview, Inc. Cellular phone games based upon television archives
US8577953B2 (en) * 2005-12-09 2013-11-05 At&T Intellectual Property I, Lp System and method for providing multimedia services
US10556183B2 (en) 2006-01-10 2020-02-11 Winview, Inc. Method of and system for conducting multiple contest of skill with a single performance
US8002618B1 (en) 2006-01-10 2011-08-23 Winview, Inc. Method of and system for conducting multiple contests of skill with a single performance
US9056251B2 (en) 2006-01-10 2015-06-16 Winview, Inc. Method of and system for conducting multiple contests of skill with a single performance
US20070238526A1 (en) * 2006-03-31 2007-10-11 Chandranmenon Girish P Methods and devices for exchanging messages in an always-on network
US11082746B2 (en) * 2006-04-12 2021-08-03 Winview, Inc. Synchronized gaming and programming
US20070265094A1 (en) * 2006-05-10 2007-11-15 Norio Tone System and Method for Streaming Games and Services to Gaming Devices
US7841946B2 (en) 2006-06-29 2010-11-30 Spawn Labs, Inc. System for remote game access
JP4064429B2 (ja) * 2006-07-26 2008-03-19 株式会社コナミデジタルエンタテインメント ゲームシステム、ゲーム端末およびサーバ装置
JP4064430B2 (ja) * 2006-07-26 2008-03-19 株式会社コナミデジタルエンタテインメント ゲームシステム、ゲーム端末およびサーバ装置
US7880770B2 (en) * 2006-07-28 2011-02-01 Accelerated Pictures, Inc. Camera control
WO2008014487A2 (en) * 2006-07-28 2008-01-31 Accelerated Pictures, Inc. Scene organization in computer-assisted filmmaking
US8888592B1 (en) 2009-06-01 2014-11-18 Sony Computer Entertainment America Llc Voice overlay
US8261345B2 (en) * 2006-10-23 2012-09-04 Endeavors Technologies, Inc. Rule-based application access management
US7925485B2 (en) * 2006-10-25 2011-04-12 International Business Machines Corporation System and apparatus for managing latency-sensitive interaction in virtual environments
US9826197B2 (en) 2007-01-12 2017-11-21 Activevideo Networks, Inc. Providing television broadcasts over a managed network and interactive content over an unmanaged network to a client device
EP2116051A2 (en) 2007-01-12 2009-11-11 ActiveVideo Networks, Inc. Mpeg objects and systems and methods for using mpeg objects
WO2009026354A1 (en) * 2007-08-20 2009-02-26 Garagegames, Inc. System and method for linking a player computer system directly to a predetermined shared game environment
AU2008243102B2 (en) * 2007-11-05 2012-01-19 Videobet Interactive Sweden AB A gaming system and a method of managing bandwidth usage in a gaming system
US8892738B2 (en) 2007-11-07 2014-11-18 Numecent Holdings, Inc. Deriving component statistics for a stream enabled application
US9168457B2 (en) 2010-09-14 2015-10-27 Sony Computer Entertainment America Llc System and method for retaining system state
US9498714B2 (en) * 2007-12-15 2016-11-22 Sony Interactive Entertainment America Llc Program mode switching
US8968087B1 (en) 2009-06-01 2015-03-03 Sony Computer Entertainment America Llc Video game overlay
US8147339B1 (en) 2007-12-15 2012-04-03 Gaikai Inc. Systems and methods of serving game video
US8613673B2 (en) 2008-12-15 2013-12-24 Sony Computer Entertainment America Llc Intelligent game loading
US8253728B1 (en) 2008-02-25 2012-08-28 Lucasfilm Entertainment Company Ltd. Reconstituting 3D scenes for retakes
US9716918B1 (en) 2008-11-10 2017-07-25 Winview, Inc. Interactive advertising system
KR101029425B1 (ko) * 2008-11-20 2011-04-14 엔에이치엔(주) 멀티 유저 네트워크 게임의 제작 시스템 및 방법
US8926435B2 (en) 2008-12-15 2015-01-06 Sony Computer Entertainment America Llc Dual-mode program execution
US8700072B2 (en) 2008-12-23 2014-04-15 At&T Mobility Ii Llc Scalable message fidelity
AU2010202024A1 (en) * 2009-05-22 2010-12-09 Aristocrat Technologies Australia Pty Limited A gaming system
US9723319B1 (en) 2009-06-01 2017-08-01 Sony Interactive Entertainment America Llc Differentiation for achieving buffered decoding and bufferless decoding
US8194862B2 (en) * 2009-07-31 2012-06-05 Activevideo Networks, Inc. Video game system with mixing of independent pre-encoded digital audio bitstreams
US20110256931A1 (en) * 2010-04-14 2011-10-20 Yazici Emre Player contributed dynamic network games
US8676591B1 (en) 2010-08-02 2014-03-18 Sony Computer Entertainment America Llc Audio deceleration
WO2012028198A1 (en) * 2010-09-03 2012-03-08 Nokia Siemens Networks Oy Media server and method for streaming media
KR20170129297A (ko) 2010-09-13 2017-11-24 소니 인터랙티브 엔터테인먼트 아메리카 엘엘씨 게임 서버
CN110336850B (zh) 2010-09-13 2022-08-09 索尼互动娱乐美国有限责任公司 附加组件管理
US20230201714A1 (en) * 2010-09-13 2023-06-29 Sony Interactive Entertainment LLC Web-Based Game Controller
AU2011315950B2 (en) 2010-10-14 2015-09-03 Activevideo Networks, Inc. Streaming digital video between video devices using a cable television system
US10046241B1 (en) * 2010-11-01 2018-08-14 Ronald Charles Krosky Output production
US20120213404A1 (en) 2011-02-18 2012-08-23 Google Inc. Automatic event recognition and cross-user photo clustering
US9204203B2 (en) 2011-04-07 2015-12-01 Activevideo Networks, Inc. Reduction of latency in video distribution networks using adaptive bit rates
US8810598B2 (en) 2011-04-08 2014-08-19 Nant Holdings Ip, Llc Interference based augmented reality hosting platforms
US8715087B2 (en) * 2011-04-12 2014-05-06 David W. Rouille Video game including user determined location information
US8376860B1 (en) 2011-07-25 2013-02-19 Jari Boutin Game flicz systems
KR20130062463A (ko) 2011-11-25 2013-06-13 한국전자통신연구원 다중 사용자 및 멀티 플랫폼 지원을 위한 게임 스트리밍 시스템 및 방법
EP2800365B1 (en) * 2011-12-29 2019-02-27 Sony Interactive Entertainment Inc. Video playback system
US10409445B2 (en) 2012-01-09 2019-09-10 Activevideo Networks, Inc. Rendering of an interactive lean-backward user interface on a television
US9800945B2 (en) 2012-04-03 2017-10-24 Activevideo Networks, Inc. Class-based intelligent multiplexing over unmanaged networks
US9123084B2 (en) 2012-04-12 2015-09-01 Activevideo Networks, Inc. Graphical application integration with MPEG objects
US9391792B2 (en) 2012-06-27 2016-07-12 Google Inc. System and method for event content stream
HUE028841T2 (en) * 2012-07-04 2017-01-30 Virtually Live (Switzerland) Gmbh Process and system for 3D rendering of real-time live scenes and a computer-readable device
US9418370B2 (en) 2012-10-23 2016-08-16 Google Inc. Obtaining event reviews
US8998719B1 (en) 2012-12-14 2015-04-07 Elbo, Inc. Network-enabled game controller
US10142496B1 (en) 2013-01-26 2018-11-27 Ip Holdings, Inc. Mobile device image capture and image modification including filters, superimposing and geofenced comments in augmented reality
WO2014145921A1 (en) 2013-03-15 2014-09-18 Activevideo Networks, Inc. A multiple-mode system and method for providing user selectable video content
US9219922B2 (en) 2013-06-06 2015-12-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
EP3005712A1 (en) 2013-06-06 2016-04-13 ActiveVideo Networks, Inc. Overlay rendering of user interface onto source video
US9294785B2 (en) 2013-06-06 2016-03-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
US9582516B2 (en) 2013-10-17 2017-02-28 Nant Holdings Ip, Llc Wide area augmented reality location-based services
US9788029B2 (en) 2014-04-25 2017-10-10 Activevideo Networks, Inc. Intelligent multiplexing using class-based, multi-dimensioned decision logic for managed networks
CN104283698A (zh) * 2014-10-28 2015-01-14 用友优普信息技术有限公司 发送广播消息的装置和方法
US10395413B2 (en) * 2015-03-03 2019-08-27 Jeremy Flores Dynamic user interfaces
WO2017016568A1 (de) * 2015-07-24 2017-02-02 Gorillabox Gmbh I. G. Verfahren und telekommunikationsnetz zum streamen und zur wiedergabe von anwendungen
US10565160B1 (en) * 2015-09-21 2020-02-18 Amazon Technologies, Inc. Managing state changes of modeled objects in a three dimensional virtual environment
EP3274878A1 (en) 2015-09-28 2018-01-31 Google LLC Sharing images and image albums over a communication network
US11551529B2 (en) 2016-07-20 2023-01-10 Winview, Inc. Method of generating separate contests of skill or chance from two independent events
CN110770717B (zh) 2017-05-17 2024-04-16 谷歌有限责任公司 通过通信网络与指定用户的自动图像共享
US10357715B2 (en) * 2017-07-07 2019-07-23 Buxton Global Enterprises, Inc. Racing simulation
WO2019193610A2 (en) * 2018-04-06 2019-10-10 Novi Digital Entertainment Private Limited Synchronization of online gaming environment with video streaming of a live event
US11308765B2 (en) 2018-10-08 2022-04-19 Winview, Inc. Method and systems for reducing risk in setting odds for single fixed in-play propositions utilizing real time input
CN113034651B (zh) * 2021-03-18 2023-05-23 腾讯科技（深圳）有限公司 互动动画的播放方法、装置、设备及存储介质

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5701582A (en) * 1989-08-23 1997-12-23 Delta Beta Pty. Ltd. Method and apparatus for efficient transmissions of programs
WO1992000654A1 (en) * 1990-06-25 1992-01-09 Barstow David R A method for encoding and broadcasting information about live events using computer simulation and pattern matching techniques
US5659691A (en) 1993-09-23 1997-08-19 Virtual Universe Corporation Virtual reality network with selective distribution and updating of data to reduce bandwidth requirements
US5594856A (en) * 1994-08-25 1997-01-14 Girard; Michael Computer user interface for step-driven character animation
JP3632705B2 (ja) * 1994-08-31 2005-03-23 ソニー株式会社 対話型画像提供方法、サーバ装置、提供方法、ユーザ端末、受信方法、画像提供システム、および画像提供方法
US5668948A (en) * 1994-09-08 1997-09-16 International Business Machines Corporation Media streamer with control node enabling same isochronous streams to appear simultaneously at output ports or different streams to appear simultaneously at output ports
CA2153445C (en) * 1994-09-08 2002-05-21 Ashok Raj Saxena Video optimized media streamer user interface
JP3193263B2 (ja) * 1995-06-05 2001-07-30 日本電信電話株式会社 ３次元映像表示システム
US5754190A (en) * 1995-06-07 1998-05-19 Advanced Micro Devices System for reproducing images utilizing image libraries
JP3658797B2 (ja) * 1995-06-16 2005-06-08 ソニー株式会社 情報通信装置及び情報提供装置
JPH0981495A (ja) * 1995-07-11 1997-03-28 Sony Corp ３次元仮想現実空間共有方法、３次元仮想現実空間共有システム、情報記録媒体、情報記録方法、情報伝送媒体、情報伝送方法、情報処理方法、並びに共有サーバ端末
US6020885A (en) * 1995-07-11 2000-02-01 Sony Corporation Three-dimensional virtual reality space sharing method and system using local and global object identification codes
US5956028A (en) * 1995-09-14 1999-09-21 Fujitsu Ltd. Virtual space communication system, three-dimensional image display method, and apparatus therefor
US6219045B1 (en) * 1995-11-13 2001-04-17 Worlds, Inc. Scalable virtual world chat client-server system
GB9525047D0 (en) * 1995-12-07 1996-02-07 Philips Electronics Nv Virtual body control device
IL126142A0 (en) * 1996-03-15 1999-05-09 Zapa Digital Art Ltd Programmable computer graphic objects
US5842216A (en) 1996-05-03 1998-11-24 Mitsubishi Electric Information Technology Center America, Inc. System for sending small positive data notification messages over a network to indicate that a recipient node should obtain a particular version of a particular data item
US5864678A (en) * 1996-05-08 1999-01-26 Apple Computer, Inc. System for detecting and reporting data flow imbalance between computers using grab rate outflow rate arrival rate and play rate
US5953506A (en) * 1996-12-17 1999-09-14 Adaptive Media Technologies Method and apparatus that provides a scalable media delivery system
US6055563A (en) * 1997-02-03 2000-04-25 Fujitsu Limited Transfer and display of virtual-world data
JP3472065B2 (ja) * 1997-03-17 2003-12-02 株式会社東芝 アニメーション生成装置およびアニメーション生成方法
US6331851B1 (en) * 1997-05-19 2001-12-18 Matsushita Electric Industrial Co., Ltd. Graphic display apparatus, synchronous reproduction method, and AV synchronous reproduction apparatus
US6006254A (en) 1997-08-29 1999-12-21 Mitsubishi Electric Information Technology Center America, Inc. System for the reliable, fast, low-latency communication of object state updates over a computer network by combining lossy and lossless communications
US5996015A (en) * 1997-10-31 1999-11-30 International Business Machines Corporation Method of delivering seamless and continuous presentation of multimedia data files to a target device by assembling and concatenating multimedia segments in memory
US6157933A (en) * 1997-11-26 2000-12-05 International Business Machines Corporation Method and apparatus for loading multiple animated images on a web-page with limited network throughput
US5999944A (en) * 1998-02-27 1999-12-07 Oracle Corporation Method and apparatus for implementing dynamic VRML
US6208357B1 (en) * 1998-04-14 2001-03-27 Avid Technology, Inc. Method and apparatus for creating and animating characters having associated behavior
US6185602B1 (en) * 1998-06-29 2001-02-06 Sony Corporation Multi-user interaction of multimedia communication
US6215498B1 (en) * 1998-09-10 2001-04-10 Lionhearth Technologies, Inc. Virtual command post
US6351267B1 (en) * 1998-12-10 2002-02-26 Gizmoz Ltd Fast transmission of graphic objects

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105263040A (zh) * 2015-10-08 2016-01-20 安徽理工大学 一种节省手机流量观看球赛直播的方法

Also Published As

Publication number Publication date
KR100791795B1 (ko) 2008-01-04
JP2012147481A (ja) 2012-08-02
US6697869B1 (en) 2004-02-24
WO2000011847A1 (en) 2000-03-02
US20030037156A1 (en) 2003-02-20
KR20010031390A (ko) 2001-04-16
CN1134958C (zh) 2004-01-14
US6557041B2 (en) 2003-04-29
CA2306785A1 (en) 2000-03-02
KR100830852B1 (ko) 2008-05-21
EP1048159A1 (en) 2000-11-02
EP1048159B1 (en) 2005-11-30
JP2002523980A (ja) 2002-07-30
DE69928642T2 (de) 2006-08-10
TW480857B (en) 2002-03-21
DE69928642D1 (de) 2006-01-05
CA2306785C (en) 2010-03-30
TR200001074T1 (tr) 2000-11-21
AR056899A1 (es) 2007-11-07
KR20010031391A (ko) 2001-04-16
BR9906766A (pt) 2000-10-03

Similar Documents

Publication Publication Date Title
CN1134958C (zh) 在广播应用中仿真互联网上的流式传输
EP1391226B1 (en) Method and devices for implementing highly interactive entertainment services using interactive media-streaming technology, enabling remote provisioning of virtual reality services
TWI399982B (zh) 用以壓縮串流互動視訊之系統
TWI459215B (zh) 用於將程式碼及資料儲存於應用程式主機代管中心內之系統及方法
CN107846633A (zh) 一种直播方法及系统
TW201119402A (en) System and method for utilizing forward error correction with video compression
TW201119400A (en) System and method for selecting a video encoding format based on feedback data
TW200949567A (en) Apparatus for combining recorded application state with application streaming interactive video output
CN102713883A (zh) 用编解码器强制的帧大小进行音频分割
TW201119405A (en) System and method for multi-stream video compression using multiple encoding formats
TW200939793A (en) System and method for protecting certain types of multimedia data transmitted over a communication channel
JP5160704B2 (ja) 放送においてインターネットを介してストリーミングをエミュレーションするリアルタイム・ビデオゲーム
Battista et al. MPEG-4: A multimedia standard for the third millennium. 2
US7149770B1 (en) Method and system for client-server interaction in interactive communications using server routes
Hijiri et al. A spatial hierarchical compression method for 3D streaming animation
WO1999039272A1 (en) Method and system for client-server interaction in interactive communications
JP2005502284A (ja) 複数のターミナルへのマルチメディア信号のブロードキャスト方法
Signes Binary Format for Scene (BIFS): Combining MPEG-4 media to build rich multimedia services
JP3723412B2 (ja) ストリーム送受信システム，意味情報サーバおよびストリーム送受信システムにおける課金方法
MXPA00003828A (en) Emulation of streaming over the internet in a broadcast application
JP2001243197A (ja) データ保護機能付き電子配信システムおよび電子配信サービス方法
CN117544808A (zh) 设备控制方法、存储介质和电子设备
Laier et al. Content-based multimedia data access in Internet video communication
Katto et al. System architecture for synthetic/natural hybrid coding and some experiments
CN115624744A (zh) 游戏直播数据处理方法及系统

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20040114

Termination date: 20130806