WO2007107115A1

WO2007107115A1 - A method and a terminal and a system for implementing the interaction with the streaming media

Info

Publication number: WO2007107115A1
Application number: PCT/CN2007/000906
Authority: WO
Inventors: Jian Chen; Yongzhong Zhang; Jun Zhang; Wenshuan Dang; Sien Han; Qiang Li; Shile Wang; Weiyu Liu; Xiaoliang Gao; Chunrong Yue
Original assignee: Huawei Technologies Co., Ltd.
Priority date: 2006-03-20
Filing date: 2007-03-20
Publication date: 2007-09-27

Abstract

The invention relates to a method and a terminal and a system for implementing the interaction with the streaming media. The method includes the following steps: terminal connects with the streaming media server to receive the streaming media; the said server sends the interactive information corresponding to the streaming media to the terminal; the terminal interacts with the streaming media according to the interactive mode designated by the interactive information. The method implementing the interaction with the streaming media in the terminal comprises the following steps: terminal receives the streaming media and the interactive information and presents the streaming media and interactive information to the user; the terminal receives interactive manipulation information inputted by user and sends the manipulation information to the network in a interactive mode designated by interactive information to complete the interaction with the streaming media. The invention can carry out the interaction between the terminal and the streaming media.

Description

Method, terminal and system for implementing streaming media interaction

The present invention relates to a technique for transmitting streaming media in a wireless network, and more particularly to a method, terminal and system for implementing interaction of a mobile device. Background technique

With the development of wireless communication technologies, new wireless access network technologies can provide a wide enough data wireless transmission bandwidth, which makes it possible to develop more business applications. Currently, a variety of video-related mobile multimedia services have been developed, such as implementing multimedia short message services, video streaming services, video telephony services, multimedia broadcast multicast services, and terminal television services on mobile terminals.

The application of the mobile terminal has become more and more popular, and in order to meet the needs of implementing various services provided by the wireless network side on the mobile terminal, the integration degree of the mobile terminal is getting higher and higher, and the information processing capability is getting stronger and stronger. Currently, color screens and cameras can be configured on mobile terminals. Therefore, based on various wireless solutions, such as General Packet Radio Service (GPRS), GSM Evolution Enhanced Data Rate (EDGE), Wideband Code Division Multiple Access (WCDMA), Code Division Multiple Access 2000 (CDMA2000), time division synchronization code points Terminal television services (TD-SCDMA), digital television networks (DVB-H), digital multimedia broadcasting (DMB), and integrated services digital broadcasting-terrestrial (ISDB-T) are also becoming more popular with users. By using the terminal TV service, the user can watch the TV program anytime and anywhere on the terminal, which provides great convenience for the user.

In the process of implementing the present invention, the inventors have found that at least the following problems exist in the prior art: The terminal can only provide a television picture to the user, and cannot realize the interaction between the user and the television program.

With the further development of the terminal TV service, the terminal TV service can not only provide TV programs to users, but also provide various interactive services based on TV services, such as implementing TV shopping, on-site voting, real-time investigation and stock trading on the terminal. Wait. When the TV interactive service is provided on the terminal, the user needs to participate in the interaction to achieve. However, in the prior art, since the terminal can only provide the user with a television picture, and the user cannot interact with the television program, the terminal cannot obtain the terminal. , ,

Various business information representing the wishes of the user, such as the name and quantity of the goods to be purchased by the corpse, is used, and the user's various business information cannot be provided to the network side. For terminal TV interactive services that require users to participate in, such as TV shopping, on-site voting, real-time surveys, and stock trading, etc., it is still impossible to implement, which greatly limits the application of terminal TV services and brings inconvenience to users. Summary of the invention

Embodiments of the present invention provide a method for implementing streaming media interaction, which implements interaction between a terminal and a streaming media, and the method includes the following steps:

The terminal is connected to the streaming media server to receive the streaming media; the streaming media server sends the interaction information corresponding to the streaming media to the terminal, and the interaction information includes interaction mode information; the terminal according to the received interaction The interaction method specified by the information interacts with the streaming media.

Another embodiment of the present invention provides a method for implementing streaming media interaction on a terminal, the method comprising the following steps:

Receiving, by the terminal, the streaming media and the interaction information corresponding to the streaming media, and providing the streaming media and the interaction information to the user; the terminal receiving the interaction operation information input by the user, and using the interaction specified by the interaction information The method sends the interactive operation information to the network side to implement interaction with the streaming media.

Another embodiment of the present invention provides a terminal, where the terminal includes: a display unit, a user side interface unit, a network side interface unit, and an interactive control unit, where

a network side interface unit, configured to receive the streaming media information and the interaction information sent by the network side, and send the information to the interaction control unit; and receive the interaction operation information sent by the interaction control unit, and send the information to the network side;

An interaction control unit, configured to: when receiving the streaming media and interaction information sent by the network side interface unit, instruct the display unit to provide the streaming media and the interaction information to the user; and receive an interaction operation sent by the user side interface unit Information and sent to the network side interface unit;

The user side interface unit is configured to receive interaction operation information input by the user, and send the information to the interaction control unit. Another embodiment of the present invention provides a network side system for implementing streaming media interaction, which implements streaming media interaction between the terminal and the network side, and the system includes:

a streaming media server, configured to send the streaming media and the interaction information corresponding to the streaming media to the terminal;

The interaction operation processing unit is configured to receive the interaction operation information sent by the terminal, and perform corresponding interaction operation processing according to the interaction operation information; the interaction operation information is after the terminal receives the interaction information sent by the streaming media server And the interaction operation information sent to the interaction operation processing unit according to the interaction manner specified by the interaction information.

The above embodiment of the present invention overcomes the technical problem of poor interaction of streaming media because the streaming media interactive information is sent to the user terminal, so that the user terminal can interact with the streaming media according to the received interactive information. Furthermore, the user interacts with the streaming media through the terminal, and the technical effect of the terminal streaming media service application is expanded. DRAWINGS

1 is a schematic flowchart of a method for implementing streaming media interaction according to an embodiment of the present invention;

2A is a schematic flowchart of a streaming media server transmitting interactive information of an on-demand program to a terminal according to an embodiment of the present invention;

2B is a schematic flowchart of a streaming media server transmitting interactive information of a live program to a terminal according to an embodiment of the present invention;

3 is a schematic structural diagram of an RTP message carrying interactive information of a TextOnly mode according to an embodiment of the present invention;

4 is a schematic structural diagram of an RTP message carrying an interactive information of a short message interaction mode according to an embodiment of the present invention;

5 is a second schematic structural diagram of an RTP message carrying interactive information of a short message interaction mode according to an embodiment of the present invention;

6 is a schematic structural diagram of an RTP message carrying a universal interactive mode interaction information according to an embodiment of the present invention; FIG. 7 is a schematic structural diagram of a terminal according to an embodiment of the present disclosure;

FIG. 8 is a schematic flowchart of setting an interaction interface between a terminal and a user according to an embodiment of the present invention; FIG. 8A is a schematic diagram of a first broadcast control interface according to an embodiment of the present invention;

FIG. 8B is a schematic diagram of a second broadcast control interface according to an embodiment of the present invention;

FIG. 8C is a schematic diagram of a text interaction interface according to an embodiment of the present invention;

FIG. 8D is a schematic diagram of a short message interaction interface according to an embodiment of the present invention;

FIG. 8E is a schematic diagram of a universal interactive interface according to an embodiment of the present invention;

FIG. 8F is a schematic diagram of a short message editing interface according to an embodiment of the present invention;

FIG. 8G is a schematic diagram of an interactive confirmation interface according to an embodiment of the present invention;

FIG. 9 is a schematic flowchart of a process for a terminal to implement a terminal television service interaction process according to an embodiment of the present invention; FIG. 10A is a schematic flowchart of a method for implementing terminal television service interaction through a customized short message interaction manner according to an embodiment of the present invention;

FIG. 10B is a schematic flowchart of implementing interaction of a terminal television service by using a preset short message interaction manner according to an embodiment of the present invention; FIG.

FIG. 10C is a schematic diagram of a USSD interaction, a WAP interaction method, and a voice call according to an embodiment of the present invention;

Schematic diagram

FIG. 11 is a schematic diagram of a process for realizing interaction of a terminal television service by means of a short message interaction method according to an embodiment of the present invention; FIG.

FIG. 12 is a schematic diagram of a terminal switching between various interactive interfaces according to an embodiment of the present invention; FIG.

FIG. 13 is a schematic diagram of switching between interfaces of various interaction modes in the embodiment of the present invention; FIG.

FIG. 14 is a schematic diagram of an interaction confirmation process provided on a terminal in the embodiment of the present invention; FIG. 15 is a schematic structural diagram of a network side system implemented by streaming media interaction according to an embodiment of the present invention. detailed description

The embodiments of the present invention are described in detail below with reference to the accompanying drawings. In the embodiment of the present invention, the streaming media server presets interactive information carrying an interactive manner on the streaming media server, and establishes a correspondence relationship with the streaming media. When the streaming media server plays the streaming media for the terminal, the interactive information can be synthesized and sent to the terminal in the RTP (Real-time Transport Protocol) file of the streaming media, and the terminal adopts corresponding information according to the received interactive information. Interactively interact with streaming media.

1 is a schematic flowchart of a method for implementing streaming media interaction according to an embodiment of the present invention. The specific steps include:

Step 101: Set interactive information corresponding to the streaming media and carrying the interactive mode and the interactive content on the streaming media server.

Step 102: When the terminal receives the streaming media through the streaming media server, the streaming media server sends the interaction information corresponding to the streaming media to the terminal. In the embodiment of the present invention, the sending method is to synthesize the interactive information into the RTP information stream of the streaming media, and send the information to the terminal.

Step 103: The terminal interacts with the streaming media according to the interaction method specified in the received interactive information. In the embodiment of the present invention, when interacting with the streaming media, the interactive content carried in the interactive information may also be used for interaction.

The network side can not only provide streaming media to the terminal through on-demand mode, but also provide streaming media to the terminal through live broadcast. In both cases, streaming interaction can be achieved. FIG. 2A and FIG. 2B respectively show a process in which the streaming media server sends the interactive information carrying the interactive mode and the interactive content to the terminal when the streaming media server provides the streaming media to the terminal through the on-demand mode and the live broadcast mode, that is, the step 120 in the process of FIG. 1 130 implementation process.

Referring to FIG. 2A, when the streaming media is on-demand (or simulated live streaming), the streaming media server sends a flow diagram of the interactive information to the user terminal, and the streaming media server pre-stores the streaming media file. The steps of the process include:

Step 210: Set interaction information corresponding to the streaming media file carrying the interactive mode and the interactive content, and encapsulate the information into a configuration file.

Step 215: Upload the configuration file to the streaming server.

In the above two steps, after setting the interactive information, the interactive information can also be directly sent to the streaming media. The body server encapsulates the interactive information into the corresponding streaming media file by the streaming media server. The above two steps can be completed by the interactive information setting unit set by the network side, and after the interactive information setting unit sets the interactive information, upload the information to Streaming media ^ server.

Step 220: When the terminal broadcasts (or simulates live broadcast) streaming media, if the interactive information corresponding to the streaming media exists in the configuration file, the streaming media server reads the configuration file corresponding to the streaming media. And the read interactive information is encapsulated and sent to the terminal by the streaming media data; if the interactive information corresponding to the streaming media on the streaming media server is encapsulated into the streaming media file, the streaming media server is sending the streaming media. When the data is received, the corresponding interactive information is sent to the terminal.

Referring to FIG. 2B, when the streaming media is real-time live streaming media, the streaming media server sends a schematic diagram of the interaction information. The live television signal is introduced in advance, and is encoded by the encoder to form a live data stream, which is sent to the streaming media server. The steps of the process include:

Step 210 ′, according to the progress of the live streaming program, real-time setting interactive information carrying the interactive mode and the interactive content. This step can be done through the interactive information setting unit set on the network side.

Step 215 ′: upload the set interaction information to the streaming media server, and the streaming media server encapsulates the interactive information into the corresponding live program stream data.

Step 220 ′, when the terminal requests the live broadcast program from the streaming media server, the streaming media server sends the data stream of the direct broadcast program together with the corresponding interactive information to the terminal.

In the embodiment of the present invention, the interaction information may be sent to the terminal through the RTP message, and the interaction may be carried by the Real-Time Streaming Protocol (RTSP) or the RTCP (Real Time Transport Control Protocol) message. information. Interactive information can be carried only interactively, with interactive and interactive content. In the embodiment of the present invention, the data format of the RTP message is taken as an example to describe how to extend the data format to carry the interactive mode and the interactive content.

Currently, based on the 3GPP Synchronized Text (Timed Text) related protocol description, a total of five Timed Text type (TYPE1 to TYPE5) definitions are used, and the protocol specifies that TYPE0, TYPE6 and TYPE7 are reserved types, which are used for future expansion. The embodiment of the present invention can be in TYPE1 to The interactive information definition is added to any type of TYPE5, but in order to reduce the conflict with the defined protocol, this embodiment is extended by the Timed Text type TYPE 6 reserved in the protocol.

There are three ways to interact, namely, the text-to-text interaction (TextOnly) mode, the SMS interaction mode, and the streaming interaction of the universal interactive mode. For the above three interaction modes, the RTP message structure is shown in Figure 3, Figure 4, Figure 5 and Figure 6.

FIG. 3 is a schematic structural diagram of an RTP message carrying interactive information of a TextOnly mode according to an embodiment of the present invention.

In this interactive mode, the terminal simply displays the interactive information without any interaction with the wireless communication network side. For example, the display of lyrics, the prompt of emergencies, the display of weather forecasts, and the prompts of matching information in the SMS interaction mode and the general interactive mode.

As shown in FIG. 3, the U, R, LEN, and SDUR fields in the RTP message are all set according to the prior art. For details, refer to RFC4396. In the embodiment of the present invention, type 6 is defined, that is, TYPE=6 indicates an extension. Type, here means to display interactive information for the user using SMS mode; SIDX is defined as 0, indicating that it is TextOnly mode; uSIDX defines which area of the terminal is to display interactive information. Currently, the terminal has two areas IndexO area and Indexl area; SendSequence The serial number of the data packet for transmitting the interactive information is defined. If the adjacent data packet serial number is the same, the terminal does not need to process the subsequently received data packet; TLEN, in the TextOnly mode, the terminal will receive the interactive information in the uSIDX Displayed in the defined area. The prompt text information in the interactive information can be described by the existing TYPE1 to TYPE5.

Referring to FIG. 4, it is a schematic structural diagram of an RTP message carrying interactive information of a short message interaction mode according to an embodiment of the present invention.

The U, R, LEN, and SDUR in the RTP message are all set according to the prior art. For details, refer to RFC4396. In the embodiment of the present invention, type 6 is defined, that is, TYPE = 6 to expand the type, and the convection using the short message interaction mode is indicated here. The streaming media played by the media server operates; SIDX is defined as 1 to indicate the recording interaction mode; uSIDX defines the serial number of the data packet for transmitting the interactive information, and if the adjacent serial number of the data packet is the same, the terminal does not need to process the subsequent Received data packet; ConfirmFlag defines whether the terminal performs SMS confirmation to perform streaming media interaction, and the value is 0 or 1; CALLED LE defines the length of each called number; CALLED PARTY NUMBER defines the length of the total called number, up to 16 bytes; SLEN defines the length of the short message; SCONTENT preset SMS content (can be obtained from the configuration file) ), the length depends on the definition of SLEN; CLEN, SMS confirmation length, depends on the definition of ConfiraiFlag; CCONTENT, SMS confirmation, terminal prompt information, length depends on CLEN; SELECTION COUNT defines the number of preset users to send SMS, maximum The value is 10; LENGTH1 defines the length of the short message sent by the terminal; SELECTION1 defines the short message 1 selected by the preset terminal, and the terminal fills the received interactive information into the terminal. The prompt text information in the interactive information can be described by the existing TYPE1 to TYPE5.

In the format definition of the above RTP message, there may be no SCONTENT. In this case, the terminal itself sets the short message content.

The embodiment of the invention further provides a method for carrying the interactive information of the short message interaction mode by using the RTP message.

Referring to FIG. 5, it is a schematic structural diagram of an RTP message carrying interactive information of a short message interaction mode according to an embodiment of the present invention.

The interactive information in the short message interaction mode defined by the embodiment of the present invention includes at least the interactive operation prompt information and the called number, and may also include a service identifier (for identifying the streaming program), an interactive operation option provided to the user for selection, Send information such as cycle or time, display time, font, color, and character set description. The content of the interactive information can be further expanded according to different streaming programs and business needs, such as adding synchronized lyrics and the like. The interactive information can exist in the form of a separate configuration file, such as a text file, a binary file, or an extensible markup language (XML) file, or it can be incorporated into a streaming media file as part of a streaming media file. The following takes an XML file as an example to describe the content of the interactive information.

<smil>

<head>

<body>

< ref delay = 15">

< reflndexO ="Welcome to interactive TV, playing the latest MTV "/>

< ref Indexl = "Send CL set ringtone ($0.5), LY download ring tone ($1), XZ download MTV ($5), DB download on-demand address (free) "/>

< ref sendNumber="221811 "/>

< ref serviceldentifier ="100"/>

< ref sendContentsList ="CL","LY","XZ","DB"/>

</seq>

</body>

</smil>

The description of each information field in the above XML file is as follows:

Filename indicates that the streaming file corresponding to the configuration file is named test.3gp;

Repeat means repeat transmission, its value represents the number of repeated transmissions, if it is 0, it means repeated transmission;

Delay represents the transmission interval, and its value represents the number of seconds in the interval;

IndexO and Indexl respectively represent two prompt information;

sendNumber indicates the short message called number;

The serviceldentifier represents a service identifier, which is used to identify a streaming program.

sendContentsList indicates the user-selectable options for sending short messages. Different options correspond to different interactive operation identifiers, such as "CL" to set the streaming media as a ringback.

The interaction information of the embodiment of the present invention may be carried by the RTP message shown in FIG.

The U, R, LEN, and SDU in the RTP message shown in FIG. 5 are all set according to the prior art. In the embodiment of the present invention, type 6 is defined, that is, TYPE = 6 to expand the type. INDEX represents a special description information type, and the present invention uses INDEX=0, which means that this is an RTP message carrying interactive short message information. LEN1 indicates the length of the called number; SEND NUMBER indicates the called number; LEN2 identifies the length of the service identification code; SERVICE IDENTIFIER indicates the service identification code; COUNT indicates the number of information that the user can select to transmit interactively; CLEN1 to CLENn indicate the length of the first to nth selectable information, respectively; CONTENTS 1 to CONTENTSn represents the first to the nth selectable text messages. The prompt text description in the interactive short message interactive information can be described by the existing TYPE1 to TYPE5.

FIG. 6 is a schematic structural diagram of an RTP message carrying interactive information of a universal interaction mode according to an embodiment of the present invention.

The universal interaction mode can be applied in a variety of scenarios, including:

Preset SMS interaction: In this scenario, the preset SMS content and the preset called number can be configured in the interactive information and sent to the terminal through the RTP message on the streaming media, and the terminal can send the received short message content. To different called numbers (in the interactive information, there is also the setting of the function key of the preset short message interaction, and the terminal can send the short message content to different called numbers by clicking the function key).

Custom SMS interaction: In this scenario, the preset called number can be configured in the interactive information and sent to the terminal through the RTP message on the streaming media. The terminal itself inputs the SMS content, and sends the SMS content to different users. In the calling number (in the interactive information, the function key of the custom short message interaction is also set, and the terminal can send the short message content to different called number by clicking the function key).

Voice call and USSD (Unstructured Supplementary Service Data) interaction. In this scenario, the preset called number can be configured in the interactive information and sent to the terminal through the RTP message on the streaming media. After the terminal confirms, the streaming media (usually voice) played by the streaming media server can be transferred to the terminal corresponding to the called number (in the interactive information, the voice call and the function key of the USSD interaction are also set, and the terminal clicks through The function key can send streaming media to different called numbers).

Video call interaction. In this scenario, the preset called number can be configured in the interactive information and sent to the terminal through the RTP message on the streaming media. After the terminal confirms, the streaming media can be played by the streaming media server. Transfer to the terminal corresponding to the called number (in the video) The function key of the video call interaction is also set, and the terminal can send the streaming media to different called numbers by clicking the function key.

The WAP function is interactive. In this scenario, the preset Uniform Resource Locator (UL) can be configured in the interactive information and sent to the terminal through the RTP message on the streaming media. After the terminal confirms, it will forward through the WAP mode. Go to the preset URL address and perform related wireless network operations.

The JAVA function interacts. In this scenario, the terminal triggers the JAVA program, which communicates with the streaming server to complete the interaction.

In the universal interaction mode, when the user is allowed to select among a plurality of interaction modes, the correspondence between the buttons on the terminal and each interaction mode in the above-mentioned universal interaction mode can be defined, so that the user can adopt the corresponding button by selecting different buttons. Interactively interact with streaming media.

As shown in FIG. 6, U, R, LEN, and SDUR in the message are all set according to the prior art. See RFC4396. In the present invention, type 6 is defined, that is, TYPE = 6 to indicate an extension type. Here, the universal interactive mode is used to display interactive information for the user; SIDX is defined as 2, indicating that it is a universal interactive mode; uSIDX defines the serial number of the data packet for transmitting interactive information, and if the adjacent serial number of the data packet is the same, the terminal does not Need to process subsequent received packets; Count defines the number of interactive operations; iTYPE defines the type of interoperability (such as the preset SMS interaction, custom SMS interaction, voice call and USSD interaction, video call interaction, WAP function interaction Interactive operation types such as JAVA function interaction; KeyPress defines function keys, each function key corresponds to an interoperation type defined by iTYPE; ConfirmFlag defines whether the terminal needs to confirm SMS; paraments length defines the number of interactive operation parameters; Lengthl defines the length of the interactive operation parameter 1; aramentl defines the interactive operation Parameter 1; length2 interactive operating parameter defines the length of 2; parament2 2 defines the operating parameters of interaction; length 3 defines the length of the operating parameters of the interactive 3; parament2 3 defines the parameters of interaction operations. The prompt text information in the interactive information can be described by the existing TYPE1 to TYPE5.

The Parament field is defined according to the type of common interactive operation, for example: When the universal interactive operation type is preset SMS interaction, the SendNumber in Paramentl carries the called number of the short message, and the SendContents in Pamment2 carries the preset short message content. The ConfirmContents in Parament3 carries the prompt information when the operation is confirmed;

When the universal interactive operation type is custom SMS interaction, SendNumber in Paramentl carries the called number of the short message, and ConfirmContents in Paramenia carries the prompt information when the operation confirms;

When the universal interactive operation type is voice call and USSD interactive or video call interaction, the CalledNumber in Paramentl carries the called number, and the ConfirmContents in Parament2 carries the prompt information when the operation confirms;

When the universal interaction operation type is WAP function interaction, the URL in Paramentl carries the URL of the WAP function, such as the URL (Uniform Resource Locator) address; when the universal interaction operation type is JAVA function interaction, JAVA in Paramentl Carry the relevant parameters in the interactive mode using the JAVA program.

The interactive information in this embodiment can be defined by an Extensible Markup Language (XML), and the format of the configuration file is as shown in Table 1.

Table 1

Element Sub-element Attribute Description

TextStream TextSample StartTime The start time of the Textsample packet sent, which is

Absolute time on SLS

Description: This field is optional

The duration of an interactive package. The length of time that the Textsample package is sent, in seconds. A configuration file SendSequence sends the sequence number.

There can only be one mutual description in the box: If the two consecutive Textsample keywords are moving blocks. If the sequence number is the same, it means that the two SMS interaction operations are exactly the same. The terminal does not need to refresh the characters and functions on the current interface, even if there is a difference in the middle score of the keyword.

RepeatCount The number of times the Textsample package is repeatedly sent

This field is optional

Interval The interval at which each Textsample packet is sent, in seconds. This field is optional.

TextTitle The content displayed in the IndexO area. The length of the character does not exceed 256 bytes. If the value is null, it represents the terminal. You need to turn off the display of the IndexO area.

TextContent The content displayed in the Indexl area. The character length is no more than 256 bytes. If the value is null, it means the terminal needs to close the content displayed in the IndexO area.

Commonlnteractive Operation- the number of interactive operations in the universal interaction mode, if

The value of Count Count is 0, which means the terminal needs to disable this function.

Currently the value is less than 9

Whether SMSInteractive ConfinnFlag requires the user to confirm the entered flag. If the value is blank, the terminal needs to turn off the SMS interaction function.

CalledNumber The address sent by the SMS, the length of the number is normal.

The length defined by MSISDN is no more than 16 digits.

The text message sent by Serviceldentfier is less than 32 bytes in length.

ConfrimContents When the SMS is confirmed, the terminal pops up the content confirmed by the SMS.

The length is less than 32 bytes.

The number of content that the SelectCount SP provides to the user.

Description:

In SMS mode, the characters provided by the SP for the user are supported by up to 10 choices, each separated by ",". Namely DefaultContents DefaultContentslOo

Commonlnteractive KeyMap type The type of interaction. Enumeration value:

"SSMS" stands for: Preset SMS interaction.

"ESMS" stands for: Custom SMS interaction, which is currently not implemented.

"VoiceCall" stands for: Voice call, USSD

"Vedio Call" stands for: Video call

"ffitp" stands for: WAP function, according to the address of parameterl, can access Http, Https website, DRM and non-DRM download. The specific implementation is implemented by the terminal.

JAVA represents the use of Java features

KeyNum phone keys, 1~9

The ConfirmFlag terminal needs an operation confirmation mechanism, which is similar to the mechanism for short message confirmation.

Paraml attribute Enumeration value: "SendNumber", the value of this element for the function SMS This value represents the called number. "CalledNumber", the value of this element is for functions such as voice call, VP, USSD, etc. This value represents the called number. "URL" , the value of this element represents the relevant URL for the function that uses WAP. This value is less than 256 in length. "JAVA", the value of this element represents the relevant parameters in the interactive mode using the Java program. The format of the value is: "MIDlet-Name, Class Name, MIDlet-Vendor" represents JAVA related parameters in JAVA interactive mode.

When the interaction mode is the SMS interaction mode, when the streaming media server sends the interactive short message to the terminal, if the terminal does not support the short message interaction configuration by default, it may shield the received interactive short message information, so the terminal needs to be notified to display The interactive short message information it receives.

According to the streaming media RTSP protocol, before sending the streaming media to the terminal, the streaming media server first sends a corresponding Session Descriptor Protocol (SDP) file, and the SDP file identifies the format information of the streaming media, such as a video encoding mode, an audio encoding file, Information such as resolution. The streaming media server may notify the terminal to display the received interactive short message by sending the received STP file to the terminal to notify the terminal that the streaming media data includes the interactive short message information, and add a short-and-interactive identifier to the SDP file, such as sms= l, The identifier contains short message interaction information in the synchronous text transmission.

After the streaming media server sends the streaming media data and the interactive information to the terminal, the terminal displays the interactive interface in the terminal according to the interactive manner and the interactive content defined in the received interactive information, and according to the interactive operation of the terminal, according to the interactive information definition The way of interaction, using interactive content to interact with the body.

For example: When the interactive information carries an interactive method using an audio call, the terminal passes the audio.

]4 The 000906 mode communicates with the preset number of the wireless network to complete the interaction and communication with the streaming media. When the interactive information carries the interactive mode using the video call, the terminal is called by the video and the preset video of the wireless network. The number is communicated. The interaction methods used can also be USSD and WAP.

The terminal that implements the above interaction with the streaming media is shown in FIG. 7.

FIG. 7 is a schematic structural diagram of a terminal according to an embodiment of the present invention. The terminal includes: a display unit, a user side interface unit, a network side interface unit, and an interactive control unit, where

a network side interface unit, configured to receive streaming media data and interaction information sent by the network side, and send the streaming media data and the interaction information to the interaction control unit; receive the interaction operation information sent by the interaction control unit, and the interaction The operation information is sent to the network side;

The interaction control unit is configured to: when the streaming media data and the interaction information are received, provide the streaming media data and the interaction information to the user; receive the interaction operation information sent by the user side interface unit, and send the information to the network side interface unit;

The user side interface unit is configured to send the interactive operation information to the interactive control unit after receiving the interactive operation information input by the user.

In order to better provide the user with interactive information on the network side and realize the interactive function, various interactive interfaces can be set in advance on the terminal, and the terminal provides streaming media data and interactive information to the user through various interactive interfaces.

FIG. 8 is a schematic flowchart of setting an interaction interface between a terminal and a user in an embodiment of the present invention, where the implementation process includes the following steps:

Step 801: Set a first broadcast control interface indicating that the information cannot be interacted on the terminal in advance. The first broadcast control interface may include: a streaming media play window and an icon identifying that the information is not interactive. For example, an icon that cannot interact with information can be a gray icon "■".

The first broadcast control interface can be specifically shown as shown in FIG. 8A.

Step 802: Set a second broadcast control interface indicating that information interaction is possible on the terminal in advance. The second broadcast control interface may include: a streaming media play window and an icon identifying the information interaction. For example, an icon that can interact with information can be a red icon "■". The second broadcast control interface can be specifically shown as shown in FIG. 8B.

Step 803: Set a text interaction interface on the terminal in advance.

The text interactive interface can include: a streaming media play window, a text information display window, an interactive operation window, a full screen prompt, an operation prompt icon, and a return prompt. Among them, the text information display window can display the synchronous text description IndexO and the interactive prompt information Indexl. Synchronized text description IndexO displays the text content related to the currently playing streaming media, such as the name of the currently playing song and the singer, etc., and can also display text content that is not related to the currently playing streaming media, such as advertisements; The information Indexl displays information related to the interaction, such as the operation and charging conditions that the user can select. If the screen of the terminal is large, IndexO and Indexl can be displayed in two lines. Otherwise, IndexO and Indexl are displayed on one line.

In the text interaction interface, the interactive operation window and the operation prompt icon are displayed as the currently unavailable state, for example, the interactive operation window is black, and the operation prompt icon is gray. The return icon indicates that you can return to the previous interface, that is, the second broadcast control interface.

The text interactive interface can be specifically displayed as shown in FIG. 8C.

Step 804: Set a short message interactive interface on the terminal in advance.

The SMS interactive interface can include: a streaming media play window, a text information display window, an interactive operation window, a full rhinoceros prompt, an operation prompt icon, and a return prompt. The text information display window has the same function as the text information display window described in step 803, and the interactive prompt information Index1 displays a short message operation and a function description that the user can select, for example, "send CL setting color Ling, Send LY download ringtone." The interactive action window is used to display to the user various options that can be operated as a text message.

In the SMS interactive interface, the operation prompt icon is illuminated, indicating that the user can select an option in the interactive operation window to perform an interactive operation. The return prompt indicates that you can return to the previous interface, that is, the second broadcast control interface.

The SMS interactive interface can be displayed as shown in Figure 8D.

Step 805: Set a universal interactive interface on the terminal in advance.

The universal interactive interface can include: streaming media playback window, text information display window, interactive operation ^_ ,

As a mouthwash, a full screen prompt, an action prompt icon, and a return prompt. The text information display window has the same function as the text information display window described in step 803, and the interactive prompt information Index1 displays the correspondence between each button on the terminal and the interaction mode. In the universal interactive interface, the operation prompt icon lights up, indicating that the user can select the interaction mode by pressing the corresponding button of the Indexl prompt. The return icon indicates that it can return to the upper level interface, that is, the second broadcast control interface.

The general interactive interface can be specifically shown as shown in Figure 8E.

Step 806: Set a short message editing interface on the terminal in advance.

The SMS editing interface can include: a streaming media playback window, a text information display window, an interactive operation window, a full screen prompt, an operation prompt icon, and a return prompt. The text information display window has exactly the same function as the text information display window described in step 803, and the interactive prompt information Indexl displays the same content as in the universal interactive interface. The interactive action window is used to display the text content of the user's actual edit input, or to display the default value. In the SMS editing interface, the operation prompt icon lights up, indicating that the user can edit the input SMS content or confirm the input default value. The return icon indicates that you can return to the previous interface, that is, the second broadcast control interface.

The SMS editing interface can be displayed as shown in Figure 8F. .

Step 807: Set an interactive confirmation interface on the terminal in advance.

The interactive confirmation interface can include: a streaming media play window, a text information display window, an interactive operation window, a cancel operation prompt, and a confirmation operation prompt. The text information display window has exactly the same function as the text information display window described in step 803, and the displayed contents of IndexO and Indexl can inherit the display content of the interface before entering the interactive confirmation interface. The interactive action window is used to prompt the user to confirm the entered business information. The cancel operation prompt is used to prompt the user to cancel the interactive operation information entered. The confirmation operation prompt is used to prompt the user to confirm the interactive operation information entered.

The interactive confirmation interface can be displayed as shown in Figure 8G.

It should be noted that there is no order limitation between the steps of setting each interface in FIG. 8 above. The information of each interface set in the above FIG. 8 is saved in the interactive control unit of the terminal.

The interaction process between the user and the terminal television service through the terminal is as shown in FIG. 9 . _ , . , . „ , Referring to FIG. 9 , the terminal needs to purchase the terminal terminal electrical service business according to the embodiment of the present invention, and the specific steps include:

Step 901: In the terminal, the user side interface unit sends the button information of the function of starting the TV service input by the user to the interactive control unit, and the interactive control unit requests the network side to perform the terminal television service through the network side interface unit.

Step 902: In the terminal, the interaction control unit receives the streaming media data sent by the network side through the network side interface unit, and monitors whether the interaction information sent by the network side is received. If yes, step 903 is performed; if not received To the interactive information, the interactive control unit instructs the display unit to display the preset first broadcast control interface, and returns to step 902.

When the terminal does not receive the interactive information, referring to FIG. 8A, the interactive control unit instructs the display unit to play the received streaming media in the streaming media playing window of the first broadcast control interface, and displays the icon for performing the information interaction as unavailable. At this time, the user can know that the current interaction between the terminal and the network side cannot be performed through the terminal.

Step 903: In the terminal, the interactive control unit obtains the interaction mode specified by the interaction information from the interaction information received by the network side interface unit. In this embodiment, the interactive modes supported by the terminal include a TextOnly mode, a short message interaction mode, and a universal interactive mode. When the interaction mode is TextOnly mode, step 904 is performed; when the interaction mode is the SMS interaction mode, step 905 is performed; when the interaction mode is the universal interaction mode, step 911 is performed.

In this step, the terminal can determine the interaction mode by the value of SIDX in the interactive information. For example, when SIDX = 0, it means TextOnly mode; when SIDX = 1, it means SMS interaction mode; When SIDX = 2, it means universal interaction mode.

Step 904: When the interaction mode is TextOnly mode, in the terminal, the interactive control unit indicates that the display unit displays a preset text interaction interface, and provides the received streaming media and text interaction information to the user through the text interaction interface.

When the terminal acquires the interaction mode as the TextOnly mode, referring to FIG. 8C, the text information received by the network side interface unit in the terminal includes a synchronous text description IndexO and an interactive prompt information Index1, and the interactive control unit instructs the display unit to display through the text information display window. IndexO and ^ _t

Indexlo is up, if the terminal screen is large enough, it will display IndexO and Indexl in two lines. If the terminal screen is not large enough, IndexO and Indexl will be displayed in one line.

At the same time, through the streaming media played by the streaming media play window in the text interactive interface, the user can watch the television program, and the user can understand the currently playing streaming media through the text information displayed in the text interface of the text interactive interface. Related information or other advertising information, through the text information displayed in the text interactive interface, the Indexl content displayed in the window, the user can understand the interactive operation and cost information that the user can perform for the currently playing television program. For example, the current TV show is TV shopping, and the Indexl content prompts the user to purchase the current item and its price. The user displays the icon that is currently not interactive through the interactive operation window and the operation prompt icon, and knows that the relevant interactive operation information cannot be input at present.

Step 905: When the interaction mode is the short message interaction mode, the interactive control unit instructs the display unit to provide the set SMS interaction interface to the user.

Here, the interactive control unit instructs the display unit to display the currently received streaming media through the streaming media playing window in the short message interactive interface, for example, playing a song for the user; the interactive control unit instructs the display unit to display the window through the text information in the short message interactive interface. The text information sent from the network side is provided to the user. For example, the terminal sends the interactive prompt information Indexl "send CL set color ling, send LY download ringtone" to the user; the interactive control unit instructs the display unit to send the network side through the interactive operation window The various interactive options are provided to the user, for example, the interactive option "CL, LY" is displayed in the interactive operation window; the interactive control unit instructs the display unit to display the operation prompt icon as an icon that is currently interactive, such as brightening.

When the user sees that the operation prompt icon is lighted, it can be known that the interactive operation can be currently performed, and the user can complete the streaming interaction operation by selecting the interactive option. For example, the user can select the currently playing song as Cai Ling by selecting the "CL" option in the interactive operation window by the user side interface unit.

Step 906: In the terminal, the user side interface unit sends the option selected by the user to the interactive control unit, and the interactive control unit sends the option selected by the user to the network side through the network side interface unit.

Step 907: In the terminal, the interaction control unit monitors whether the network side interface unit receives the confirmation indication sent by the network side, and if yes, performs step 908; otherwise, directly performs step 910. Step 908: The interactive control unit instructs the display unit to provide the user with the set interactive confirmation interface.

Here, the interactive control unit instructs the display unit to play the streaming media in the streaming media play window of the interactive confirmation interface; continuously scrolling and displaying the text interactive information in the text information display window; if receiving the confirmation information sent by the network side, such as "you confirm Perform this setting? ,,, The interactive control unit instructs the display unit to display the received confirmation information in the interactive operation window. If the confirmation information sent from the network side is not received, the interactive control unit instructs the display unit to be in the interactive operation window. The default confirmation message is displayed, such as "Confirm operation? And, the interactive control unit instructs the display unit to display the cancel operation prompt and the confirmation operation prompt in the interactive confirmation interface.

At this time, the user can confirm whether to continue the interactive operation through the interactive confirmation interface. For example, after the user selects the "CL" option in step 905, if the user confirms that the currently played song is set to Cai Ling, the user can pass through the terminal. The user side interface unit inputs the "OK" key information. If the setting is canceled, the cancel key information can be input through the user side interface unit in the terminal, and the user side interface unit sends the corresponding key information to the interactive control unit.

Step 909: In the terminal, the interactive control unit determines whether the user inputs the confirmation button information or the cancel button information through the interactive confirmation interface. If the button information is confirmed, the confirmation button information is sent to the network side through the network side interface unit, and the execution is performed. Step 910, otherwise, return directly to step 905.

Step 910: The network side performs corresponding interactive operation processing according to the received option, and ends the current process.

For example, the option input by the user through the user side interface unit is "CL,,", then the interactive operation performed by the network side is to set the currently playing streaming media as the color of the terminal.

In this step, after performing the corresponding interactive operation processing on the network side, the network side may also return the result of the interactive operation processing to the user through the text short message, such as downloading the link information; or, the network side may also return the interaction to the user through the multimedia message. The result of the operation processing, such as downloading link information or downloading content.

Step 911: When the interaction mode is the universal interaction mode, the interactive control unit instructs the display unit to The user provides a universal interactive interface that is set.

Here, the interactive control unit instructs the display unit to provide the currently received streaming media to the user through the streaming media play window in the universal interactive interface; and the textual information of the prompt interaction mode sent by the network side through the text information display window in the universal interactive interface Provided to the user, for example, the interactive prompt information Indexl "order by 1 text message, press 2 to make an HTTP order, press 3 to dial #111 order, etc." to the user; the interactive control unit instructs the display unit to control the operation prompt icon to light up.

In this embodiment, the universal interaction mode supported by the terminal may include: a preset SMS interaction mode, which does not require the user to edit or select the SMS content, but directly sends the short message to a specific called number; The method requires the user to edit the content of the short message, such as the number of the number of the ticket; the USSD interactive mode, which provides the user to perform an interactive operation by dialing a specific called number; the WAP interactive mode, including the HTTP mode and the HTTPS mode, provides the user Interactive operation by logging in to a specific URL; voice mode (Voice) mode; video call (Video Call) mode; JAVA mode.

Through the Indexl content in the universal interactive interface, the user can learn different interaction modes corresponding to different buttons on the terminal, and input corresponding button information on the terminal through the user-side interface unit, for example, when the user needs to interact through the USSD interaction mode. ^4Build 3, when the user needs to interact through HTTP mode button 2; the user side interface unit sends the corresponding button information input by the user to the interactive control unit.

Step 912: In the terminal, the interaction control unit instructs the display unit to display an interface of the corresponding interaction mode according to the button information input by the user, and receives the interaction operation information input by the user on the corresponding interface through the user side interface unit.

For example, when the user presses the button 2, the terminal provides an HTTP interface. After logging in to a specific web address through the HTTP interface, the user can input corresponding ordering information, such as the quantity and name of the purchased product.

Step 913: The interactive control unit sends the interaction operation information input by the user to the network side through the network side interface unit, and determines whether the network side interface unit receives the confirmation indication sent by the network side. If yes, step 914 is performed. Otherwise, Go directly to step 916.

Step 914: The interactive control unit instructs the display unit to provide the user with the set interactive confirmation boundary Face.

Here, the interactive control unit instructs the display unit to provide the streaming media sent by the current network side in the streaming media play window of the interactive confirmation interface; continuously scrolling and displaying the interactive information in the text information display window; if receiving the confirmation information sent by the network side The interactive control unit instructs the display unit to display the received confirmation information in the interactive operation window; if the confirmation information sent by the network side is not received, the interactive control unit instructs the display unit to display the default confirmation information in the interactive operation window. And, the interactive control unit instructs the display unit to display a cancel operation prompt and a confirmation operation prompt in the interactive confirmation interface.

The user can confirm whether to continue the interactive operation according to the interactive confirmation interface. For example, after the user inputs the quantity of the purchased item in step 912, if the user confirms to purchase the quantity of the item, the user side interface unit can press "OK". If the setting is canceled, the cancel button can be pressed through the user interface unit, and the user side interface unit sends the corresponding button information input by the user to the interactive control unit.

Step 915: In the terminal, the interactive control unit determines whether the user inputs the confirmation button information or the cancel button information according to the interaction confirmation interface. If the button information is confirmed, the confirmation button information is sent to the network side through the network side interface unit, and the execution is performed. In step 916, if the button information is cancelled, the process returns directly to step 911.

Step 916: The network side performs corresponding interaction operation processing according to the received interaction operation information. In the process shown in FIG. 9 above, in steps 912-916, if the user selects a custom SMS interaction mode in the universal interaction mode, the process of steps 912-916 may be as shown in FIG. 10A; if the user selects The preset SMS interaction mode in the universal interaction mode, the process of steps 912-916 can be as shown in FIG. 10B; if the user selects the WAP interaction mode, the USSD interaction mode, the voice call interaction mode or the video interaction in the universal interaction mode In the manner, the process according to 912-916 can be as shown in FIG. 10C; if the user selects the JAVA interaction mode in the universal interaction mode, the process of steps 912-916 can be as shown in FIG. 10D.

In the process shown in Figure 9 above, the flow of steps 905-910 can be as shown in FIG.

In the above steps 905 and 911, the network side may only provide text interaction information IndexO and Indexl with the change of the streaming media provided by the network side, when the terminal detects that only the network is received. ^

The side body and text interactive information IndexO and Indexl, without other interactive information, provide the received streaming media and text interactive information to the user through the text interactive interface.

It should be noted that, in the embodiment of the present invention, the interactive interface provided by the terminal to the user is switched in real time following the streaming media sent by the network side and the indication on the network side, and the switching manner may be as shown in FIG. 12 . In FIG. 12, the interactive mode interface includes all interfaces except the first broadcast control interface and the second broadcast control interface, and the interactive mode interface is identified according to the interactive manner in the interactive information sent by the network side, such as the value of the SIDX. , as shown in Figure 13.

According to the foregoing implementation process of the embodiment of the present invention, the interaction confirmation process provided by the terminal may be as shown in FIG. 14.

In the embodiment of the present invention, the terminal type may be a mobile terminal, a personal digital assistant (PDA), or the like. The embodiment of the invention also provides a system for implementing streaming media interaction.

FIG. 15 is a schematic structural diagram of a network side system for implementing streaming media interaction according to an embodiment of the present invention. The system includes: a streaming media server, an interactive information configuration unit, and an interactive operation processing unit, wherein

An interactive information configuration unit for configuring interactive information and transmitting the configured interactive information to the streaming server;

And a streaming media server, configured to encapsulate the interactive information configured by the interactive information configuration unit into the corresponding streaming media file, and send the streaming media and the interaction information corresponding to the streaming media to the terminal. The terminal receives the streaming media and interactive information sent by the streaming media server, and provides the streaming media and the interactive information to the user, and sends the interactive operation information to the interactive operation processing unit according to the interaction manner specified by the interactive information. The terminal and the interactive operation processing unit can be connected wirelessly.

The interaction operation processing unit is configured to receive the interaction operation information sent by the terminal, and perform corresponding interaction operation processing according to the interaction operation information. The interactive operation processing unit may be one or more, and each of the interactive operation processing units respectively receives the interactive operation information sent in different interaction manners. For example, the SMS interaction processing unit receives the interaction operation processing information sent by the SMS interaction mode, and performs corresponding operations; the video interaction processing unit receives the interaction operation processing information sent by the video interaction mode in the universal interaction mode, and performs corresponding operations. The network side can perform interactive operation information according to the terminal. , ,. ,

The information such as the called number or address information carried in the information is sent to the corresponding interactive operation processing unit.

The above embodiments of the present invention can be used not only for a wireless network system that provides mobile video through streaming media technology, such as Wideband Code Division Multiple Access (WCDMA), CDMA2000, Time Division Synchronous CDMA System TD-SCDMA. And the Global System for Mobile Communications (GSM), etc., can also be used in other mobile digital TV technologies (such as DVH-H/DMB).

In summary, the foregoing embodiment of the present invention, by setting the interaction information, and transmitting the interaction information to the user terminal by the streaming media server when the user accesses the streaming media program, so that the user terminal can pass the interaction information according to the interaction information. Interactive methods, such as short message interaction, voice interaction, video interaction, WAP interaction, etc., interact with streaming media to achieve streaming media interaction, enriching the application of terminal multimedia services. The embodiment of the present invention adds an interactive information configuration unit and an interactive operation processing unit to the existing streaming media implementation system, and combines with the existing service platform, but the functions are independent. Therefore, the system coupling degree is low and easy to maintain.

It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of the inventions

Claims

Rights request

A method for implementing streaming media interaction, characterized in that it comprises the following steps:

The terminal is connected to the streaming media server to receive the streaming media;

And the streaming media server sends the interaction information corresponding to the streaming media to the terminal, where the interaction information includes interaction mode information;

The terminal interacts with the streaming media according to the interaction manner specified by the received interaction information.

2. The method according to claim 1, wherein the interaction information further comprises interactive content information; the process of interacting the terminal with the streaming media further comprises the following steps:

The terminal displays the interactive content to a user;

The terminal sends the interaction operation information of the user to the network side according to the interaction manner, and interacts with the streaming media corresponding to the interaction information.

The method according to claim 1 or 2, wherein the interaction mode is a normal text interactive TextOnly mode, a short message interaction mode or a universal interactive mode, or a combination of a TextOnly mode and a short message interaction mode, or a TextOnly mode and A combination of universal interaction modes.

The method according to claim 1 or 2, wherein the streaming server sends the interactive information to a real-time transport protocol RTP message, a real-time streaming protocol RTSP message, or a real-time transport control protocol RTCP message. The terminal.

5. The method of claim 4, wherein the interactive information is carried by extending the RTP message, RTSP message or RTCP message format.

6. The method according to claim 5, wherein when the interaction mode is the TextOnly mode, the process of carrying the interactive information by extending the RTP message is:

Determining the synchronous text type retained in the RTP message as an extension type;

Setting a TextOnly mode identifier in the extension type;

The text information that needs to be displayed on the terminal is set in the synchronized text type that has been defined in the RTP message. WO 2007/107115, ^ _L , , , , , , , , , , , J»CT/CN2007/000906 ,

7. The method described in claim 5, wherein when the interactive mode is the short message interaction mode, the process of carrying the interactive information through the RTP message is:

Setting a short message interaction mode identifier in the extension type;

The short message prompt information that needs to be displayed on the terminal is set in the synchronized text type defined in the RTP message.

8. The method of claim 7, further comprising:

The short message content is set in the extension type, and the set short message content is one or more.

9. The method according to claim 5, wherein when the interaction mode is a universal interaction mode, the process of carrying the interaction information through the RTP message is:

Setting a universal interaction mode identifier in the extension type;

Setting an interaction operation type identifier in a universal interaction mode in the extension type;

An interaction operation parameter corresponding to the interaction operation type is set in the extension type, and the parameter is one or more.

10. The method according to claim 9, wherein the interaction operation type comprises a preset SMS interaction, a customized SMS interaction, a voice call, a USSD interaction, a video call interaction, a WAP function interaction, or a JAVA function interaction;

When the interaction operation type is preset SMS interaction, the interaction operation parameter includes a called number and a short message content;

When the interaction operation type is a custom SMS interaction, the interaction operation parameter includes a called number;

When the interaction operation type is a voice call and a USSD interaction, or a video call interaction, the interaction operation parameter includes a called number;

When the interaction operation type is a WAP function interaction, the interaction operation parameter includes a URL of the WAP function;

When the interaction operation type is JAVA function interaction, the interaction operation parameter includes using JAVA program related parameters in interactive mode.

The method according to claim 9, wherein the interaction operation type identifier is one or more, and when the interaction operation type identifier is multiple, the method further includes:

A function key identifier is set in the extension type, and each function key corresponds to an interactive operation type identifier.

12. The method according to claim 5, wherein when the interaction mode is a short message interaction mode, the process of carrying the interaction information by using an RTP message is:

Defining a defined or retained synchronization text type in the RTP message as an extension type; setting a short message interaction mode identifier in the extension type;

Setting a called number in the extension type;

Setting a streaming media identifier corresponding to the interaction information in the extension type;

The SMS interactive content is set in the synchronized text type defined in the RTP message, and the short message interactive content is one or more.

The method according to claim 10, wherein, when the interaction mode is a short message interaction mode, before the streaming media server sends the interaction information to the terminal, the method further includes the step of: notifying the terminal to receive the interaction information .

The method of claim 13, wherein the streaming media server sends a short message interaction identifier to the terminal to receive the interactive information by sending a session description protocol SDP file corresponding to the streaming media.

The method of claim 1, wherein the streaming media server sends the interaction information to the user terminal, including the steps of:

The configuration file containing the interactive information is stored in advance on the streaming media server. When the streaming media server sends the streaming media to the user terminal, the configuration file corresponding to the streaming media is read, and the read interactive information is encapsulated into Transmitting to the user terminal in a streaming media file;

Or, the interaction information is encapsulated into the streaming media file in advance, and when the streaming media server sends the streaming media to the user terminal, the interaction information is sent to the user terminal;

Or, set interactive information in real time according to the progress of the live streaming media, and the streaming media server will , , , WO 2007/107115, i _T , „„ . , , . . , , , , PCT/CN2007/000906 Dali is loaded into the live media and sent to the terminal with the live media.

The method according to claim 15, wherein the configuration file is a text file, a binary file, or an extensible markup language XML file.

A method for implementing streaming media interaction on a terminal, comprising: the following steps: the terminal receives the streaming media and the interaction information corresponding to the streaming media, and provides the streaming media and the interaction information to the user ;

The terminal receives the interaction operation information input by the user, and sends the interaction operation information to the network side by using an interaction manner specified by the interaction information to implement interaction with the streaming media.

The method of claim 17, further comprising: presetting a text interaction interface on the terminal, the text interaction interface comprising a streaming media play window and a text information display window;

When the interaction mode specified by the interaction information is a normal text interaction TextOnly mode, the interaction information includes only text information, and the step of providing the streaming media and the interaction information to the user includes: the terminal providing the text to the user The interactive interface plays the streaming media through the streaming media playing window in the interface, and displays the text interactive information through the text information display window in the interface.

The method of claim 18, wherein the text interaction interface further comprises an interactive operation window and an operation prompt icon;

The step of providing the streaming media and the interactive information to the user further includes: the terminal displaying the interactive operation window and the operation prompt icon as current unavailable states.

The method of claim 17, further comprising: setting a short message interaction interface on the terminal in advance, wherein the short message interaction interface includes a streaming media play window, a text information display window, and an interactive operation window;

When the interaction mode specified by the interaction information is a short message interaction mode, the interaction information includes text interaction information and a short message interaction content option, and the steps of providing the streaming media and the interaction information to the user include:

The terminal provides a short message interaction interface to the user, and the streaming media is played through the streaming media playing window in the interface, and the text interactive information is displayed through the text information display window in the interface. WO 2007/107115 , _{ι β} „ , , , , ^ _L _ PCT/CN2007/000906 The interactive operation port in the interface displays the interactive content option.

The method of claim 17, further comprising: setting a universal interactive interface on the terminal, wherein the universal interactive interface includes a streaming media play window, a text information display window, and an interactive operation window;

When the interaction mode specified by the interaction information is a universal interaction mode, the interaction information includes text interaction information and key information corresponding to various universal interaction modes; and the steps of providing the streaming media and the interaction information to the user include:

The terminal provides a universal interactive interface to the user, and provides the streaming media information to the user through the streaming media playing window in the universal interactive interface, and provides the text interactive information to the user through the text information display window in the universal interactive interface.

The method according to claim 21, after the streaming media and the interactive information are provided to the user, and before receiving the interactive operation information input by the user, the method further includes the following steps: the terminal receives the key information input by the user, And providing a universal interaction mode interface corresponding to the button; the step of receiving the interaction operation information input by the user includes: the terminal receiving the interaction operation information input by the user on the corresponding universal interaction mode interface.

The method according to claim 22, wherein the universal interactive mode interface is a short message editing interface, and the interface comprises a streaming media playing window, a text information display window, and an interactive operation window;

The step of providing a universal interactive mode interface corresponding to the button includes: the terminal providing a short message editing interface to the user, and playing the streaming media through the streaming media playing window in the interface, and displaying the window through the text information in the interface Display textual interaction information;

The terminal receiving the user inputting the interactive operation information on the short message editing interface includes: the terminal receiving the interactive operation information input by the user in the interactive operation window of the short message editing interface.

The method according to claim 22, wherein the universal interaction mode interface is an existing voice call interaction interface, a video interaction interface or a WAP interaction interface.

The method according to any one of claims 20 to 24, wherein the interface further comprises: an operation prompt icon; WO 2007/107115 ,, ^ , , ! ^ _ff , , 丄 x. , PCT/CN2007/000906 ^ , the step of providing the media and interactive information to the corpse further includes: the operation prompt icon in the interface displayed by the terminal to the user is displayed as An icon that is currently interactive.

The method according to claim 17, wherein after the interactive operation information is sent to the network side, the method further includes the steps of: the terminal determining whether the confirmation indication sent by the network side is received, and if yes, prompting the user to input After confirming the information, and after receiving the confirmation information input by the user, the confirmation information is sent to the network side.

27. The method of claim 26, further comprising the step of: setting an interactive confirmation interface comprising a streaming media play window, a text information display window, an interactive operation window, a cancel operation prompt, and a confirmation operation prompt ;

The step of prompting the user to input the confirmation information comprises: the terminal providing an interactive confirmation interface to the user, and playing the streaming media through the streaming media playing window in the interface, and displaying the text interactive information through the text information display window in the interface; The interactive action window in the display shows a confirmation message.

The method according to claim 17, wherein after the terminal receives the interaction information, and before providing the streaming media and the interaction information to the user, the method further includes the following steps: the terminal will receive the The streaming media is provided to the user, and prompts the user whether an interactive operation is required. If the terminal receives the confirmation button information input by the user, the step of providing the streaming media and the interactive information to the user is continued.

The method of claim 28, further comprising the steps of: setting a second broadcast control interface on the terminal, the second broadcast control interface comprising a streaming media play window and an icon for identifying information interaction;

The terminal provides the second broadcast control interface to the user, and plays the streaming media through the streaming media play window in the interface.

The method according to claim 17, further comprising the step of: after receiving the interactive operation information, the network side performs a corresponding interactive operation process according to the interactive operation information.

The method according to claim 17, wherein if the terminal does not receive the interaction information sent by the network side, the received streaming media is provided to the user, and the user is prompted to perform an interactive operation. WO 2007/107115 ^ . , , , , 丄,, , , >_ PCT/CN2007/000906 ,

32. The method as claimed in claim 31, further comprising the steps of: setting a first broadcast control interface on the terminal in advance, the first broadcast control interface comprising a streaming media play window and the identifier not interacting with the information. Icon

The step of the terminal providing the streaming media to the user and prompting the user that the interactive operation is not currently performed includes: the terminal providing the first broadcast control interface to the user, and playing the streaming media through the streaming media play window in the interface.

33. A network side system implemented by streaming media interaction, characterized in that:

The interaction operation processing unit is configured to receive the interaction operation information sent by the terminal, and perform corresponding interaction operation processing according to the interaction operation information; the interaction operation information is the interaction that the terminal sends when receiving the streaming media server After the information, the interactive operation information sent to the interactive operation processing unit according to the interaction mode specified by the interaction information.

34. The system of claim 33, further comprising:

An interactive information configuration unit, configured to configure the interaction information, and send the information to the streaming media server;

The streaming media server encapsulates the interaction information sent by the interaction information configuration unit into a corresponding streaming media file, and sends the information to the terminal.

35. The system of claim 33, wherein the interactive operation processing unit is wirelessly connected to the terminal.

The system according to claim 33 or 35, wherein the interactive operation processing unit is one or more, and each of the interactive operation processing units respectively receives the interactive operation information transmitted in different interaction manners.

37. A terminal, comprising: a display unit, a user side interface unit, a network side interface unit, and an interactive control unit, where

a network side interface unit, configured to receive streaming media information and interaction information sent by the network side, and send the information to the interaction control unit; receive the interaction operation information sent by the interaction control unit, and concurrently send Sent to W, J;

The user side interface unit is configured to receive interactive operation information input by the user, and send the information to the interaction control unit.

38. The terminal according to claim 37, wherein the interactive control unit further stores text interactive interface information;

The interaction control unit is configured to: when the interaction mode specified by the interaction information is a normal text interaction TextOnly mode, instruct the display unit to provide streaming media and text interaction information to the user through a text interaction interface.

The terminal according to claim 37, wherein the interactive control unit further stores the short message interactive interface information;

The interaction control unit is configured to: when the interaction mode specified by the interaction information is a short message interaction mode, instruct the display unit to provide streaming media and text interaction information to the user through the short message interaction interface.

40. The terminal according to claim 37, wherein the interactive control unit further stores general interactive interface information;

The interaction control unit is configured to: when the interaction mode specified by the interaction information is a universal interaction mode, instruct the display unit to provide streaming media and text interaction information to the user through a universal interactive interface.

The terminal according to any one of claims 37 to 40, wherein the interaction control unit further stores interactive confirmation interface information;

The network side interface unit is further configured to receive an acknowledgement sent by the network side, send the confirmation to the interaction control unit, and send the confirmation button information to the network after receiving the confirmation button information sent by the interaction control unit. side;

The interaction control unit is further configured to: when the confirmation indication is received, indicate the display list The device ^ ^ ^ H interactive confirmation interface information, and after receiving the confirmation button information sent by the user side interface unit, the confirmation button information is sent to the network side interface unit;

The user side interface unit is further configured to receive confirmation button information input by the user, and send the confirmation button information to the interaction control unit.