CN100383764C - Method and system for client-server interaction in interactive communications - Google Patents

Method and system for client-server interaction in interactive communications Download PDF

Info

Publication number
CN100383764C
CN100383764C CNB998045829A CN99804582A CN100383764C CN 100383764 C CN100383764 C CN 100383764C CN B998045829 A CNB998045829 A CN B998045829A CN 99804582 A CN99804582 A CN 99804582A CN 100383764 C CN100383764 C CN 100383764C
Authority
CN
China
Prior art keywords
command
server
mpeg
node
scene
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
CNB998045829A
Other languages
Chinese (zh)
Other versions
CN1295689A (en
Inventor
H·卡尔圭
A·埃莱夫塞里阿迪斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Columbia University of New York
Original Assignee
Columbia University of New York
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Columbia University of New York filed Critical Columbia University of New York
Publication of CN1295689A publication Critical patent/CN1295689A/en
Application granted granted Critical
Publication of CN100383764C publication Critical patent/CN100383764C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/14—Handling requests for interconnection or transfer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally

Abstract

In an interactive communication system based on MPEG-4, Command descriptors along with Command Route nodes or Server Routes in the scene description can be used to support application-specific interactivity. Content selection can be supported by specifying the presentation in command parameters, with the command ID indicating that the command is a content selection command. An initial scene can be created with several images and with text that describes a presentation associated with an image. Associated with each image and the corresponding text is a content selection descriptor. When a user clicks on an image, the client transmits the command containing the selected presentation and the server starts a new presentation. The technique can be used in any application context, as generally as HTTP and CGI can be used to implement any server-based application functionality.

Description

Client-server exchange method and system in the interactive communication
Invention field
The present invention relates in communication system to realize the mutual technology of client-server, particularly based on the communication system of MPEG-4 standard.
Background technology
Interactivity is that (October 31,1997 for ISO/IEC 14496Parts 1-6, Committee Draft, Fribourg, Switzerland) the outstanding problem of paying close attention in the development for the MPEG-4 international standard.Backward channel is specifically designed to the interaction message support.But the syntax and semantics of the message by the channel carrier band does not still add definition, is like this for triggering the mechanism that this message sends yet.Existing standard such as DSM-CC (ISO/IEC international standard 13818-6) and RTSP (RFC 2326) supports that traditional VCR type is mutual, during playback, reconfigure MEDIA FLOW, but require more complicated MPEG-4 to use for mutual control, this is inappropriate.
Interaction message can be generated by certain user action or system event.It is sent to server subsequently, can be by server by increasing and removing object or switch to complete new scene and revise the stream that it is transmitting.User action can comprise clicks an object, input text stream etc.System event comprises timer, condition test etc.
Interactivity is at using, and can't define interbehavior fully by customer incident.In order to support to adopt the mode of similar CGI at the interactivity of using.Specific customer incident makes sends server back at the order data of using.Server can generally respond by sending the scene description update command subsequently.This makes can fully freely support to use required full interactivity.
MPEG-4 adopts two kinds of interactivity patterns basically: local and far-end.Local interaction can utilize the MPEG-4BIFS (binary format of scene, it designs (referring to www.veml.org and " The VRML Handbook " based on VRML 2.0ROUTEs, J.Hartman and J.Wernecke, Addison-Wesley, 1996) and in MPEG-4 instructions (system) part 1 describe) distinctive incident framework realizes local interaction fully.If in Another Application,, then need can be translated as the BIFS update command of MPEG-4 part 1 definition by the incident that application is sent to MPEG-4 take over party based on MPEG-4 take over party.
The far-end interactivity is made up of URLs at present.Defined as MPEG-4 systems committee draft, these can only be used for obtaining the visit to content.Therefore they can't be used for trigger command.
The MPEG-4 system has comprised by event source/converter route (they are scene description (BIFS) parts) and supports the fact of local interaction to require server interaction processing and local interaction model together fully-integrated.
Summary of the invention
Target of the present invention provides a kind of technology, is used between two entities such as " client computer " and " server ", utilizes the MPEG-4 international standard to transmit message.
Second target of the present invention provides a kind of technology, is used to make system or user can generate MPEG-4 player or client and intends this class message under the implication.
The 3rd target provides a kind of technology, is used for generating this class message of the local interaction model compatibility that defines with MPEG-4, and it is stipulated based on VRML2.0.
Further target provides a kind of technology, be used in encoded MPEG-4 bit stream this class message and with the message linkage of coding to scene description.
Further target provides a kind of technology, is used for making server send to client computer for this class message of coding of making amendment easily before using on certain program with a kind of.This is important for interactive application.An example is " cooky " management, the content of the rapid update command of code word of the status information of the enough storage particular station User Activities of the necessary energy of server.
To further significantly these and other targets in order to satisfy by following announcement, the present invention broadly provides a kind of technology, is used for incorporating server command into the MPEG-4 client computer.Technology relates to the use of command description symbol, promptly sends and be included in the concrete form that dependent event triggers the descriptor of the order of returning server afterwards with scene description information.Event source required in the scene description is relevant with these command description symbols.
In one embodiment, utilize the server route to finish relationship.These are operated traditional MPEG-4BIFS route equally, still link with converter command description symbol with the territory, source to have replaced territory, source and converter territory are linked.The server route needs the expansion of MPEG-4BIFS ROUTE grammer.
In another embodiment, utilize command node to realize relationship.This node comprises the converter territory, and related with the command description symbol.This technology relates to an above node type and adds MPEG-4 BIFS groups of nodes.
In both cases, the common interaction models that can adopt MPEG-4 to define for local interaction (incident that promptly generates and on local client computer, handle) and server interactivity (client computer of promptly sending server back to generates the incident that order generates).After the Event triggered relevant with the command description symbol, route to command node through server route or routine, client computer is obtained the command information that is stored in the command description symbol, it is divided into groups into command messages, reasonable is that the grammer that provides in the preferred embodiment is provided, and utilizes suitable Return Channel to send it back to server.
The data in server of returning that generates the order carrier band is included in the command description symbol.Because the command description symbol is the part of the whole descriptor framework of MPEG-4,, they dynamically update so can utilizing the time stamp Object Descriptor to upgrade.This provides suitable dirigibility in customized command is for example managed with realization " cooky ".
In order further to generate secondary server in the order in processing, in client information, also comprised additional information, for example time-event generates source node etc.
The accompanying drawing summary
Fig. 1 is the synoptic diagram that shows MPEG-4 client computer or terminal general structure.
Fig. 2 shows MPEG-4 system decoder model.
Fig. 3 shows method used among the MPEG-4, is used for making the auditory visual object related with the coded data of other stream by Object Descriptor with basic flow descriptors.
Fig. 4 shows the general configuration based on the communication system of MPEG-4 of client/server.
Fig. 5 shows utilization (a) server route and makes scene descriptor node (particularly sensor node) and the relevant method of command description symbol with (b) order routing node.
Fig. 6 shows the scale-of-two grammer of the command description symbol of describing in the preferred embodiment.
Fig. 7 shows the command description symbol of describing in the preferred embodiment and removes the scale-of-two grammer of order.
Fig. 8 shows the scale-of-two grammer of server routing infrastructure and how to add and becomes owner of MPEG-4BIFS scene grammer.
Fig. 9 shows the node syntax and semantics of order routing infrastructure.
Figure 10 shows the indication tabulation of predefine order IDs and relevant explanation.
Figure 11 shows the scale-of-two grammer that is included in the order in the preferred embodiment command description symbol.
Figure 12 triggers the process flow diagram of the process of server command in the MPEG-4 client computer when adopting the server route for expression.
Figure 13 is placed on the process flow diagram of the process of data in the order of returning server for expression combination when adopting the server route.
Figure 14 triggers the process flow diagram of the process of server command in the MPEG-4 client computer when adopting the order routing node for expression.
Figure 15 is placed on the process flow diagram of the process of data in the order of returning server for expression combination when adopting the order routing node.
The preferred mode that carries out an invention
Below by accompanying drawing in detail preferred embodiment of the present invention is described in detail.
MPEG-4 is the international standard that proposes under International Organization for Standardization is supported.Its formal name is called ISO/IEC 14496.The basic difference of itself and former ISO or ITU standard (for example MPEG-1, MPEG-2, H.261 or H.263) is the form of expression of its addressing audiovisual object.Therefore at first utilize the technology that defines in established part 2 (vision) and 3 (audio frequency) respectively encoded packets contain the different units that audio frequency applies scene.These objects are sent to the take over party or read from high-capacity storage together with scene description information, the scene description information description how these objects are placed on the room and time to offer the user.
The coded data of each audiovisual object and scene description information sends with oneself " channel " or basic stream.As described below, for the audiovisual object that the take over party can correctly be made mention in the scene is associated with basic stream in being included in coded data, also sent additional control information.
For the structure of complete description MPEG-4, referring to Fig. 1.Below figure, show various possible transmitting systems, include but is not limited on communication link or through ATM, IP, mpeg 2 transport stream (TS), the DVB of high-capacity storage.Opposite with MPEG-2, in order can under various communication environments, to send, undefined oneself the transport layer functionality of MPEG-4.For lacking suitable multiplexed ability (for example gsm wireless data channel) or requiring few transmitting system that postpones, defined the simple multiplexed instrument that is called FlexMux.
This fabric is used for sending one group to client computer and flows substantially.Stream has comprised any in scene description information, audiovisual object data (for example encoded video such as MPEG-2 or MPEG-4 video flowing) or the control information (being Object Descriptor).Each substantially stream can only comprise one type data.
The data that comprise basic stream are divided into groups according to MPEG-4 Sync Leyer (SL), the addressed location (for example video or audio frame or scene description order) of Sync Layer grouping layer dielectric and adding time sequence information (clock reference and time stamp), sequence number etc.The center section of Fig. 1 shows SL.
The coding of independent audiovisual object data carries out according to the part 2 and 3 of MPEG-4 regulation.Further also allow to utilize other coding, for example MPEG-1 or MPEG-2.Scene description and control information (Object Descriptor) are according to the definition coding of MPEG-4 part 1.
The take over party handle the audiovisual object data of scene description information and decoding and finish synthetic (be about to group of objects be incorporated into) the unit in and show (promptly display result on the User Monitor or under the audio case in user's loudspeaker the process of playback).This is shown in Fig. 1 top.
According to the information that comprises in the scene description, the user can have an opportunity mutual with scene.In addition, scene description can comprise the effective information of dynamic behaviour that makes.In other words, scene itself need not user intervention and can generate incident.
With MPEG-2 with or other system compare, the object-based structure of MPEG-4 need define more general-purpose system code translator model.Particularly as shown in Figure 2, be thought of as the take over party and be equipped with one group of code translator, each object is with one.Each code translator has decoding impact damper and synthetic impact damper.The decoding impact damper promptly utilizes the clock reference and the decoding time stamp (decoding following closely in theory) that is used for removing from the decoding impact damper data of clock recovery by transmit leg utilization and the management of MPEG-2 similar techniques.The data that are placed in the synthetic impact damper can be synthesized the data that device uses and covering had before been placed.The decoding impact damper is filled by the multiplexer that is encapsulated in DMIF (digital media integrated framework, the MPEG-4 part 6) application interface.This is conceptual interface, need not further description.
The MPEG-4 scene description
Scene description information is the expansion of VRML 2.0 (pseudo-entity modeling language) instructions among the MPEG-4.VRML adopts tree structure method definition scene.Each node in the scene is finished synthetic and/or division operation, and the tree construction leaf comprises actual vision or audio-frequency information.And node comprises the territory of the behavior of influence.For example transform node comprise the rotation territory define the anglec of rotation.
Because VRML is pure 3-D scene description language, so MPEG-4 has defined some additional nodes of addressing 2-D composition.The low-cost system demands of applications has been satisfied in this addressing.Opposite with VRML, MPEG-4 does not adopt the text based scene description but has defined the high efficient band width compression form of expression that is called BIFS (binary format of scene).
The BIFS coding follows the text definition of VRML scene closely.Particularly, similar with the text based vrml file, nodes encoding is that first mode is finished with the degree of depth.As in VRML, the territory of every kind of node type is assumed that default value.Therefore have only the territory of non-default value just need define at each intranodal.The territory coding of intranodal utilizes simply to be finished based on the method for index, is thereafter the coding thresholding.The node type coding is more complicated.In order further to improve bandwidth efficiency, considered the context of father field (if any).Each accepts the territory of child node and specific node data type association.In a known way subsequently, utilization is at the index coding nodes of this node data type.
Each coding nodes also can be distributed a node identifier (being generally integer).This can make this node reuse in other positions of scene.The USE/DEF mechanism of this and VRML is similar.But this makes what is more important and can participate in reciprocal process.
Consistent among the used interaction models of MPEG-4 and the VRML.Particularly, nodes domains can be taken on event source, incident converter or the effect of the two simultaneously.Event source is related with specific user action or system event.The example of customer incident is the sensor node that can detect click.The example of system event is the timer (case sensor node) that triggers according to system time.
Dynamic scene behavior and interactivity are by linking realization with event source territory and incident converter territory.Utilize the mechanism of ROUTEs to finish actual link.After describing, scenario node provided MPEG-4 route definition (if any) immediately.Their coding is based on the node identifier of source and converter node and the domain identifier in source and converter territory.
Important difference between VRML and the MPEG-4 is in the latter, can utilize the time stamp order to dynamically update scene description.On the contrary, VRML goes up operation in static " world ".After loading fully, there is not the mechanism of revising.In MPEG-4, object can increase or delete, and part scene (or whole scene) can substitute.
Object Descriptor
In order to have structure (being convenient to editor etc.) very flexibly, the actual content of audiovisual object is not included within the scene description itself.In other words, BIFS only provides scene structure information and pure synthetic object, for example utilizes the red rectangle of BIFS/VRML joint structure.Need the audiovisual object of coded message in scene, to represent with the leaf node that points to URL or Object Descriptor.
Object Descriptor is a hierarchy information, has described the basic stream of the coding form of expression that comprises single audiovisual object.More than stream be may need, stereo or multilingual audio frequency or hierarchical coding video for example are used for.Uppermost descriptor is called as Object Descriptor, and is shell, is used for making Object Descriptor identifier (OD-ID) related with one group of basic flow descriptors.The information of the data type in the latter comprises ES-ID and is included in the basic stream relevant with specific ES-ID.This information notification take over party for example flows and comprised the MPEG-2 video data after the MailProfile of main stor(e)y face.
Utilize the stream mapping table to finish the mapping of ES-ID to actual basic stream.For example it can make ES-ID 10 and support that numbers 1025 related.To can be the take over party used for this table during setting up session.The operation of MPEG-4 content is convenient in indirect multi-level use.For example, multiplexed again general only needs not homogeneous turbulence mapping table.In the MPEG-4 content, need not other information corrections.
Object Descriptor sends in the basic stream of oneself, and divides into groups into order according to Sync Layer grammer.This makes Object Descriptor can be updated, increase or remove.
Fig. 3 show Object Descriptor and basic stream be used for making in the scene description audiovisual object with its substantially stream be associated process.At first utilize specific initial object descriptor, start MPEG-4 take over party with the scene descriptor stream relevant with chosen content by the point at objects descriptor-stream.This descriptor is delivered to the take over party setting up session.
Scene description in this example comprises audiosource node, and it points to one of them Object Descriptor.Descriptor comprises the basic flow descriptors that not relevant stream provides ES-ID.Utilize the stream mapping table that ES-ID is decomposed unactual transmission channel.Scene also has video display texture node, and this node adopts two and flows down telescopic video in this case.Therefore comprised two basic flow descriptors, each points to suitable stream (fundamental sum enhancement layer).
The MPEG-4 client/server is mutual
Visible and consideration MPEG-4/VRML scene description framework it is evident that though abundant local interaction framework is provided, do not have the instrument of realization based on server interaction from foregoing description.Particularly, there is not to describe the mechanism of returning server or triggering this message generation.
Fig. 4 shows exemplary client/server environment.In the left side of figure is the MPEG-4 server, comprises the suction of the timed sending of finishing the data that read as the SL stream of packets and DMIF ISP's example, has utilized the multiplexed instrument of MPEG-4 FlexMux in this case.
The use of FlexMux is optional.As known in the art, can adopt other server architectures.For example data source can be that the MPEG-4 file replaces the SL stream of packets.
The information that the server place generates is delivered to the take over party through network (for example IP or ATM).Accepting side, we have similar DMIF service provider's example, and it sends to player and removes multiplexed basic stream.It is a kind of method that realizes that session is set up that DMIF-to-DMIF delivers a letter, and describes to some extent in the part 6 of MPEG-4.Just as known in the art, additive method also is feasible, comprises based on Internet protocols, for example SIP, SDP, RTSP etc.
A main target of the present invention is a kind of process, at first describes server command and is sent to client computer from server, sentences suitable Time Triggered in client computer subsequently, sends server at last back to start further action.
The command description symbol
Command description symbol framework provides the means that make order related with the event source of scene graph intranodal.When user and scene are mutual, trigger relevant incident and processing command and send it back server subsequently.
Reality itself is defined by creator of content alternately and can be that click or mouse are crossed or other forms of mutual (for example system event).
Command description symbol framework is made up of three unit, command description, server route or order routing node and order.
The command description symbol comprises ID (integer identifier) and finally sends it back the actual command of server (and if when triggering dependent event).
ID is used to represent the command description symbol from scene description information.By isolate command description symbol and order from scene itself, we can make a more than incident use same order.This also allows to revise order under the situation that changes scene description never in any form.
Command description accords with the association of event source domain node and can finish by different way.
At first the server route can add in the conventional route tool of BIFS.With the difference of traditional route be that route target is not another territory, but command description symbol.Fig. 5 (a) shows this structure.In this example, we have two nodes field of eventsization to two command descriptions are accorded with in scene tree.Event triggered to another node, the incident of event source gone out sensor node or incident unit/converter, MPEG-4 term in expose territory (it routes to command description symbol 1 through server).For command description symbol 2, direct server route is arranged from node to descriptor.
Second method comprises the node listing that new order routing node type is added the MPEG-4 support.This node has " execution " incident converter territory and comprises the territory of command description symbol ID.No matter when utilize conventional MPEG-4/VRML route " execution " territory to receive incident, the command description symbol relevant with this ID is used to the server echo command.This structure is shown among Fig. 5 (b).Compare with Fig. 5 (a), the server route substitutes with the order routing node.Operation under two kinds of situations is identical basically.
Fig. 6 shows the grammer of command description symbol.We adopt Flavor medium performance formal language to describe bitstream syntax, and it also is used for the part 1 (referring to the part 1 of www.ee.columbia.edu/flavor or MPEG-4) of MPEG-4 regulation.The command description symbol starts from special mark, and it is identified as the descriptor of this particular type.We have descriptor ID subsequently, are thereafter order ID.The latter be used for delivering a letter predefined server command, for example " beginning ", " time-out " or " stopping ".Then, we comprise the Length Indication in the remainder data of byte in descriptor.Provide the counting of ES-IDs number to be used for subsequently to the server return messages.Realize at needs that (being that individual command is sent to a plurality of servers) provides under the situation of one-to-many communication more than one.Be a series of required ES-IDs thereafter.At last, comprised one group at the parameter of using.These will be sent back to server when trigger command.According to the numerical value of order ID, semanteme that can these parameters of predefine.
The structure of command description symbol byte-oriented makes server can easily generate descriptor.This is important feature for the application that relates to " cooky " management, and command parameter needs server to be upgraded continuously by server after handling each customer incident there.
For the update command descriptor, server or creator of content only need send the identical new descriptor of ID.
In order to remove the command description symbol, provide specific order.Fig. 7 shows grammer.Order begins with the mark of this descriptor being discerned not command description symbol removal order.Be the ID of removed command description symbol subsequently.
Command description symbol and command description symbol are removed structure and can be carried out in Object Descriptor stream.Because the structure of Object Descriptor framework is utilized the mark of discerning descriptor, these descriptors can be dispersed in other descriptors.
As mentioned above, there is dual mode that the command description symbol is linked to scene.First kind depends on the server route.As shown in Figure 8, these require the bitstream syntax of expansion MPEG-4 scene description.Particularly, main BIFS scene structure has comprised the server routing infrastructure through expansion.Only difference is to replace destination node/territory between conventional route and the server route, has defined the ID of command object descriptor.It will be apparent to one skilled in the art that how revising other routing commands (insertion, deletion etc.) is known to hold the server route.In all cases, need to change destination node/territory to according with the indicating target command description.
Utilize order routing node method, need the new node type of definition.In Fig. 9, utilize MPEG-4 instructions part 1 used standard nodes definition list that node definition is provided.Node only comprises two territories, promptly as " executions " territory of incident converter with comprise " command description symbol " territory of pointing to the ID that URL that command description accords with or the command description relevant with this order routing node accord with.Under all SFUrl territories, utilize the sign of a bit to finish selection (the SFUrl territory is coded in definition in the MPEG-4 part 1) between ID and the URL.
Utilize order routing node method, the change incident can utilize standard MPEG-4BIFS order to realize to change node and territory wherein with the related of command description symbol.
Can utilize command description to accord with the update command descriptor of more newly arriving, make that node can be according to the distinct interaction behavior on the order support different time in the command description symbol.The DAI user command unit that utilizes DMIF to support is sent to server with order.
Also can the explosion command descriptor to comprise the agreement that is used for sending order.The transmission that for example can adopt different marks to indicate to utilize HTTP POST/GET rather than the MPEG-4 instrument of standard.
Even command description symbol framework is general and supports at the user interactions of using, in order to support compatible application behavior also to need the order of several standards on the application and service device.Like this especially for the shared order such as current control.Therefore we have defined one group of shared control command.In order to handle, server is to be appreciated that any at the order of using.The standard commands group can cooperate with any server.Figure 10 shows the order ID of Management Information Base together with this embodiment.It is evident that for those skilled in that art other appointments also are feasible.
Figure 11 shows the grammer of ordering when client computer is sent to server.It is the copy that the command description symbol deducts descriptor ID basically.Particularly it has comprised the parameter group that ES-ID organizes and the command description symbol defines that order ID, this order are sent to.These orders send in the SL stream of packets, and therefore server can utilize complete time and sequence information.
Send server process of commands incident
We go through now according to user or system event and generate the process of ordering, and it begins to utilize the server route.
Referring to Figure 12, after generating user or system event, the take over party transmits the network of incident through route and service device route.For the transmission of incident, route-type is inessential, thereby can adopt identical algorithm.If incident is through the server route propagation, the condition whether then systems inspection incident is corresponding relevant with logic true value.If not, then termination is handled in the server name; If then carry out process of transmitting.
Figure 13 shows this process under the server route.Process has comprised the command description symbol ID from the server route.It makes the information on the interior available command descriptor of itself and scene relevant subsequently.If the coupling of not finding then is wrong and do not take further action.If the coupling of finding, then whether systems inspection order ID check corresponding known semanteme (predefine order ID).If corresponding known semanteme, then system can be according to required semantic processes command parameter.If not corresponding known semanteme, then this state is skipped by system, and the order of directly grouping indication and be sent to server.
For the order routing node, referring to Figure 14, after generating user or system event, the take over party transmits incident through the route network.If incident arrives " executions " territory of order routing node, whether then systems inspection incident the correspondence condition related with logic true value.If not, then kill server is handled; If then carry out process of transmitting.
Figure 15 shows this process under the order routing node situation.Step is identical with Figure 13 basically, and difference is that the benchmark of command description symbol ID is now in the order routing node rather than in the server route.

Claims (14)

  1. One kind in interactive communication system server and client computer between transmit the method for command information, it is characterized in that may further comprise the steps:
    Generation comprises the command messages of one of the server route of order, command description symbol and direct correlation node and described command description symbol and command node of indirect association node and described command description symbol; And
    When taking place, trigger event sends command messages.
  2. 2. the method for claim 1 is characterized in that, interactive communication system is based on MPEG-4.
  3. 3. method as claimed in claim 2 is characterized in that, generates the local interaction model compatibility that defines among command messages and the MPEG-4.
  4. 4. the method for claim 1 is characterized in that, trigger event is click.
  5. 5. the method for claim 1 is characterized in that, trigger event is a timer signal.
  6. 6. the method for claim 1 is characterized in that, command information sends to client computer from server.
  7. 7. the method for claim 1 is characterized in that, command information sends to server from client computer.
  8. 8. an interactive communication system is included in the device that transmits command information between server and the client computer, it is characterized in that, the device that transmits command information comprises:
    Generation comprises the device of the command messages of one of the server route of order, command description symbol and direct correlation node and described command description symbol and command node of indirect association node and described command description symbol; And
    When taking place, trigger event sends the device of command messages.
  9. 9. system as claimed in claim 8 is characterized in that based on MPEG-4.
  10. 10. system as claimed in claim 9 is characterized in that generating the local interaction model compatibility that defines among command messages and the MPEG-4.
  11. 11. system as claimed in claim 8 is characterized in that trigger event is click.
  12. 12. system as claimed in claim 8 is characterized in that trigger event is a timer signal.
  13. 13. system as claimed in claim 8 is characterized in that command information sends to client computer from server.
  14. 14. system as claimed in claim 8 is characterized in that command information sends to server from client computer.
CNB998045829A 1998-01-30 1999-01-29 Method and system for client-server interaction in interactive communications Expired - Lifetime CN100383764C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US7320398P 1998-01-30 1998-01-30
US60/073,203 1998-01-30

Publications (2)

Publication Number Publication Date
CN1295689A CN1295689A (en) 2001-05-16
CN100383764C true CN100383764C (en) 2008-04-23

Family

ID=22112365

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB998045829A Expired - Lifetime CN100383764C (en) 1998-01-30 1999-01-29 Method and system for client-server interaction in interactive communications

Country Status (7)

Country Link
EP (1) EP1049984A4 (en)
JP (1) JP4194240B2 (en)
KR (1) KR100580437B1 (en)
CN (1) CN100383764C (en)
AU (1) AU2487799A (en)
CA (1) CA2319820A1 (en)
WO (1) WO1999039272A1 (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100636110B1 (en) * 1999-10-29 2006-10-18 삼성전자주식회사 Terminal supporting signaling for MPEG-4 tranceiving
KR100429838B1 (en) 2000-03-14 2004-05-03 삼성전자주식회사 User request processing method and apparatus using upstream channel in interactive multimedia contents service
FR2819669B1 (en) * 2001-01-15 2003-04-04 Get Int METHOD AND EQUIPMENT FOR MANAGING INTERACTIONS BETWEEN A CONTROL DEVICE AND A MULTIMEDIA APPLICATION USING THE MPEG-4 STANDARD
FR2819604B3 (en) * 2001-01-15 2003-03-14 Get Int METHOD AND EQUIPMENT FOR MANAGING SINGLE OR MULTI-USER MULTIMEDIA INTERACTIONS BETWEEN CONTROL DEVICES AND MULTIMEDIA APPLICATIONS USING THE MPEG-4 STANDARD
CN100366077C (en) * 2002-04-26 2008-01-30 纽约市哥伦比亚大学托管会 Method and system for optimal video transcoding based on utility function descriptors
KR100925198B1 (en) * 2003-03-17 2009-11-06 엘지전자 주식회사 Method of exchanging user messages among interactive disk players
US7958535B2 (en) 2003-09-25 2011-06-07 Sharp Laboratories Of America, Inc. URI pointer system and method for the carriage of MPEG-4 data in an MPEG-2 transport stream
US9219941B2 (en) 2006-10-25 2015-12-22 Telefonaktiebolaget L M Ericsson (Publ) Rich media stream management
KR100950082B1 (en) * 2007-06-22 2010-03-26 주식회사 넷앤티비 Method for Transmitting Compressed Image Using MPEG-4 BIFS Stream
KR20080114496A (en) * 2007-06-26 2008-12-31 삼성전자주식회사 Method and apparatus for composing scene using laser contents
FR2930662B1 (en) * 2008-04-23 2010-05-21 Streamezzo METHOD OF SECURING AN EVOLVING SCENE, DEVICE, SIGNAL AND CORRESPONDING COMPUTER PROGRAM, METHOD OF UPDATING AN EVOLUTIVE SCENE, CORRESPONDING DEVICE AND COMPUTER PROGRAM
CN102271144A (en) * 2010-06-01 2011-12-07 中兴通讯股份有限公司 P2P (point to point) overlay network, data resource operating method and new node adding method
CN103905988B (en) * 2014-04-04 2017-12-01 北京国交信通科技发展有限公司 Boat-carrying base station, mobile terminal, the overboard warning system and method for being opened and closed ring mode

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5621892A (en) * 1995-10-10 1997-04-15 Intel Corporation Method and apparatus for managing alerts and events in a networked computer system
US5671225A (en) * 1995-09-01 1997-09-23 Digital Equipment Corporation Distributed interactive multimedia service system

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5706290A (en) * 1994-12-15 1998-01-06 Shaw; Venson Method and apparatus including system architecture for multimedia communication
CA2118278C (en) * 1993-12-21 1999-09-07 J. David Garland Multimedia system
WO1996017306A2 (en) * 1994-11-21 1996-06-06 Oracle Corporation Media server
CA2181781C (en) * 1995-07-26 2000-02-29 Seiji Iwafune Television system for providing interactive television programs and server system for constructing the television system
US5864843A (en) * 1995-10-20 1999-01-26 Ncr Corporation Method and apparatus for extending a database management system to operate with diverse object servers
US5794250A (en) * 1995-10-20 1998-08-11 Ncr Corporation Method and apparatus for extending existing database management system for new data types
US5790124A (en) * 1995-11-20 1998-08-04 Silicon Graphics, Inc. System and method for allowing a performer to control and interact with an on-stage display device
US5784567A (en) * 1995-12-13 1998-07-21 Silicon Graphics, Inc. System and method for coordinating communication between layers of a layered communication system
US5850218A (en) * 1997-02-19 1998-12-15 Time Warner Entertainment Company L.P. Inter-active program guide with default selection control
US5818935A (en) * 1997-03-10 1998-10-06 Maa; Chia-Yiu Internet enhanced video system
US5892915A (en) * 1997-04-25 1999-04-06 Emc Corporation System having client sending edit commands to server during transmission of continuous media from one clip in play list for editing the play list

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5671225A (en) * 1995-09-01 1997-09-23 Digital Equipment Corporation Distributed interactive multimedia service system
US5621892A (en) * 1995-10-10 1997-04-15 Intel Corporation Method and apparatus for managing alerts and events in a networked computer system

Also Published As

Publication number Publication date
JP2002502169A (en) 2002-01-22
JP4194240B2 (en) 2008-12-10
CA2319820A1 (en) 1999-08-05
EP1049984A4 (en) 2003-09-17
CN1295689A (en) 2001-05-16
AU2487799A (en) 1999-08-16
KR20010040503A (en) 2001-05-15
EP1049984A1 (en) 2000-11-08
WO1999039272A1 (en) 1999-08-05
KR100580437B1 (en) 2006-05-15

Similar Documents

Publication Publication Date Title
KR100937045B1 (en) SAF Synchronization Layer Packet Structure
US20010000962A1 (en) Terminal for composing and presenting MPEG-4 video programs
CN110832872B (en) Processing media data using generic descriptors for file format boxes
CN100399824C (en) Generic adaptation layer for JVT video
TW201742461A (en) Advanced signaling of a most-interested region in an image
CN100383764C (en) Method and system for client-server interaction in interactive communications
TW202127899A (en) Using gltf2 extensions to support video and audio data
US7149770B1 (en) Method and system for client-server interaction in interactive communications using server routes
CN106134146A (en) Process continuous print multicycle content
CN104584574A (en) Apparatus and method for processing an interactive service
CN104662925A (en) Apparatus and method for processing an interactive service
KR20010021755A (en) Data signal for modifying a graphic scene, corresponding method and device
JP4391231B2 (en) Broadcasting multimedia signals to multiple terminals
KR100497497B1 (en) MPEG-data transmitting/receiving system and method thereof
CN100448292C (en) Method and equipment for managing interactions in the MPEG-4 standard
US20100257188A1 (en) Method and apparatus for providing/receiving stereoscopic image data download service in digital broadcasting system
KR100991803B1 (en) System For Providing SAF Synchronization Layer Packet Structure and User Terminal
Eleftheriadis MPEG-4 systems: architecting object-based audio-visual content
KR20030056103A (en) Apparatus for activating specific region in mpeg-2 video using mpeg-4 scene description and method thereof
KR102659380B1 (en) Processing of media data using generic descriptors for file format boxes
Hai et al. Research and application on dynamical media encapsulation technology based on extended mpeg-ts
KR20110117568A (en) Method and apparatus for transmitting/receiving service discovery information in a multimedia transmission system
Eleftheriadis et al. Text for ISO/IEC FCD 14496-1 Systems
KR100940603B1 (en) SAF Synchronization Layer Packet Structure, Method For Providing the Same
JP2000287141A (en) Electronic program table distribution system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1034588

Country of ref document: HK

C14 Grant of patent or utility model
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20010516

Assignee: Dongguan de video technology Co. Ltd. Kit

Assignor: Blue light United Co., Ltd.

Contract record no.: 2018990000216

Denomination of invention: Method and system for client-server interaction in interactive communications

Granted publication date: 20080423

License type: Common License

Record date: 20180815

CX01 Expiry of patent term
CX01 Expiry of patent term

Granted publication date: 20080423