WO2016050080A1

WO2016050080A1 - Multi-user video-watching real-time interaction method and system

Info

Publication number: WO2016050080A1
Application number: PCT/CN2015/079403
Authority: WO
Inventors: 崔志伟
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-09-29
Filing date: 2015-05-20
Publication date: 2016-04-07
Also published as: CN105530535A

Abstract

A multi-user video-watching real-time interaction method and system, the method comprising: acquiring communication address information of an interactive terminal; transmitting parameter information of a currently played video to the interactive terminal according to the communication address information of the interactive terminal, to enable the interactive terminal to synchronously play the currently played video according to the parameter information; in the process of synchronously playing the currently played video with the interactive terminal, initiating a real-time audio and/or video contact request to the interactive terminal, or receiving an audio and/or video contact request transmitted by the interactive terminal, and transmitting audio and/or video data to the interactive terminal, thus enabling real-time communication and interaction via video and audio when two or more people are watching the same video.

Description

Method and system for multi-person watching video real-time interaction

Technical field

This paper relates to the field of multimedia technology, and in particular to a method and system for real-time interaction of multiple people watching video.

Background technique

With the development of network technology, multimedia video services represented by network television IPTV and open Internet-based video service OTT have been widely used, and multi-screen client devices such as IPTV set-top boxes, OTT set-top boxes, smart phones and Pads have also emerged.

At the same time, social interaction and interaction between web users is one of the most intense needs of users. Users have not only been satisfied with watching video programs as a single user, but more emphasis on sharing and communication. However, the use of text communication in the process of watching video not only affects the viewing effect, but also does not express the viewing experience in time. However, if the synthesized multi-channel video is broadcasted, not only the investment is large, but also the implementation is complicated. The main control server of the core node has complex business requirements, high performance requirements, and user service friendliness and video images. There is a big discount on real-time performance.

Summary of the invention

Embodiments of the present invention provide a method and system for real-time interaction of multiple people watching video, which can realize real-time communication and interaction between two or more people through video and audio when watching the same video.

In order to solve the above problem, an embodiment of the present invention provides a method for real-time interaction of a multi-person viewing video, which is applied to a terminal, and the method includes:

Obtaining the communication address information of the interactive terminal;

Sending parameter information of the currently played video to the interactive terminal according to the communication address information of the interactive terminal, so that the interactive terminal can synchronously play the currently played video according to the parameter information;

In the process of playing the currently playing video synchronously with the interactive terminal, initiating a real-time audio and/or video contact request to the interactive terminal, or receiving an audio and/or video contact request sent by the interactive terminal, and performing audio and/or interaction with the interactive terminal. Video data transmission.

The step of obtaining the communication address information of the interactive terminal includes:

Scanning the two-dimensional code including the communication address information of the interactive terminal and the verification information, and saving the two-dimensional code to the buddy list of the user name including the interactive terminal, so that the two-dimensional code is associated with the user name of the interactive terminal;

The communication address information of the interactive terminal is obtained according to the user name of the interactive terminal selected by the user from the buddy list.

The method further includes: after the step of obtaining the communication address information of the interactive terminal, the method further includes:

According to the communication address information of the interactive terminal, a request for establishing a communication link is sent to the interactive terminal, so that the interactive terminal obtains the communication address information of the terminal.

The step of sending a request for establishing a communication link to the interactive terminal according to the communication address information of the interactive terminal includes:

Generating a character string including address information and verification information of the terminal;

The character string is sent to the interactive terminal through an instant messaging tool or a mailbox according to the communication address information of the interactive terminal.

After the step of obtaining the communication address information of the interactive terminal, the method further includes: detecting a state of a “share” touch button, and when detecting that the “share” touch button is pressed, according to the communication address information of the interactive terminal Send the parameter information of the currently playing video to the interactive terminal.

The step of initiating a real-time audio and/or video contact request to the interactive terminal includes:

A status of a "chat" touch button is detected, and when it is detected that the "chat" touch button is pressed, a real-time audio and/or video contact request is initiated to the interactive terminal.

After the step of transmitting the parameter information of the currently played video to the interactive terminal according to the communication address information of the interactive terminal, the method further includes:

The progress information of the currently played video is sent to the interactive terminal every preset time, so that the interactive terminal plays the current video synchronously.

The parameter information of the currently played video includes: an address of a media server that currently plays the video, an ID of the currently played video, and a playback progress of the currently played video.

Wherein, in the step of performing video data transmission with the interactive terminal, on the current screen, The first window plays the currently playing video, and the second window plays the video data transmitted by the interactive terminal.

The embodiment of the present invention further provides a system for real-time interaction of a multi-person viewing video, which is applied to a terminal, and the system includes:

Obtaining a module, configured to obtain communication address information of the interactive terminal;

The first sending module is configured to send the parameter information of the currently played video to the interactive terminal according to the communication address information of the interactive terminal, so that the interactive terminal can synchronously play the currently played video according to the parameter information;

The interaction module is configured to initiate a real-time audio and/or video contact request to the interactive terminal or to receive an audio and/or video contact request sent by the interactive terminal during the process of playing the currently playing video synchronously with the interactive terminal, and between the interactive terminal and the interactive terminal Perform audio and / or video data transmission.

The acquisition module includes:

The first unit is configured to scan the two-dimensional code including the communication address information and the verification information of the interactive terminal, save the two-dimensional code to the buddy list of the user name including the interactive terminal, and make the two-dimensional code and the user name of the interactive terminal Establish an association;

The second unit is configured to obtain the communication address information of the interactive terminal according to the user name of the interactive terminal selected by the user from the buddy list.

Among them, the system also includes:

The second sending module is configured to send a request for establishing a communication link to the interactive terminal according to the communication address information of the interactive terminal, so that the interactive terminal obtains the communication address information of the terminal.

The second sending module includes:

a third unit, configured to generate a character string including address information and verification information of the terminal;

The fourth unit is configured to send the string to the interactive terminal through an instant messaging tool or a mailbox according to the communication address information of the interactive terminal.

Among them, the system also includes:

The detecting module is configured to detect a state of a “share” touch button. When detecting that the “share” touch button is pressed, the parameter information of the currently played video is sent to the interactive terminal according to the communication address information of the interactive terminal.

Among them, the interactive module includes:

The fifth unit is configured to detect a state of a "chat" touch button, and when detecting that the "chat" touch button is pressed, initiate a real-time audio and/or video contact request to the interactive terminal.

Among them, the system also includes:

The third sending module is configured to send the progress information of the currently played video to the interactive terminal every preset time, so that the interactive terminal synchronously plays the current video.

Wherein, when the interactive module performs video data transmission with the interactive terminal, on the current screen, the current playing video is played in the first window, and the video data transmitted by the interactive terminal is played in the second window.

The embodiment of the present invention further provides a computer readable storage medium, where the storage medium stores a computer program, the computer program includes program instructions, when the program instruction is executed by the video terminal device, enabling the device to execute the above-mentioned multiplayer Watch how videos interact in real time.

The above technical solutions of the embodiments of the present invention have at least the following beneficial effects:

In the method for multi-person watching video real-time interaction in the embodiment of the present invention, multiple terminals can simultaneously and simultaneously watch the same video program and perform real-time audio and video exchange without the need for the main control server to manage and forward the service. .

BRIEF abstract

1 is a flow chart of steps of a method for real-time interaction of multiple people watching video according to an embodiment of the present invention;

2 is a sequence diagram of a method for real-time interaction of multiple people watching video according to an embodiment of the present invention;

3 is a flowchart of step 11 in FIG. 1 according to an embodiment of the present invention;

4 is a flow chart showing the steps of sending a request for establishing a communication link to the interactive terminal according to the communication address information of the interactive terminal according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a system for real-time interaction of multiple people watching video according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic diagram of a system application environment for multi-person watching video real-time interaction according to an embodiment of the present invention; Figure.

Preferred embodiment of the invention

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other. Additionally, although logical sequences are shown in the flowcharts, in some cases the steps shown or described may be performed in a different order than the ones described herein.

The embodiments of the present invention are directed to the problem that a plurality of people cannot share and communicate in real time while watching a video in the prior art, and provide a method and system for real-time interaction of multiple people watching video, which can enable multiple people to pass the video while watching the same video. Communicate in real time with audio.

As shown in FIG. 1 , an embodiment of the present invention provides a method for real-time interaction of a multi-person viewing video, which is applied to a terminal, and the method includes:

Step 11: Obtain communication address information of the interactive terminal;

Step 12: Send the parameter information of the currently played video to the interactive terminal according to the communication address information of the interactive terminal, so that the interactive terminal can synchronously play the currently played video according to the parameter information;

Optionally, the parameter information of the currently played video includes: an address of a media server that currently plays the video, an ID of the currently played video, and a playback progress of the currently played video.

Step 13: In the process of playing the currently playing video synchronously with the interactive terminal, initiating a real-time audio and/or video contact request to the interactive terminal, or receiving an audio and/or video contact request sent by the interactive terminal, and performing audio communication with the interactive terminal. And / or video data transmission.

In the specific embodiment of the present invention, the terminal and the interactive terminal are interchangeable, that is, the terminal may serve as an interactive terminal, and the interactive terminal may serve as a terminal, wherein the terminal and the interactive terminal may be a set top box, a mobile phone, or Tablets, laptops, etc. If the terminal is a set-top box, the terminal must first be equipped with a video input module, ie a camera, an audio input module, ie a microphone pickup, and a real-time encoding module, ie audio and video decoding software and hardware.

In a specific embodiment of the present invention, after acquiring the communication address information of the interactive terminal, the terminal sends the parameter information of the video currently being played to the interactive terminal, so that the interactive terminal can obtain the code stream of the video from the media server, and synchronize with the terminal. Watch this video and watch the terminal and interactive terminal While watching the video, the terminal may initiate a real-time audio and/or video request to the interactive terminal, or the interactive terminal may initiate a real-time audio and/or video request to the terminal, so that the user of the terminal and the user of the interactive terminal can watch the same video. Real-time sharing and communication, of course, the real-time audio and/or video request of the terminal can be retransmitted multiple times (according to the predetermined policy), avoiding the network packet loss and causing the interactive terminal not to receive the corresponding request, and mistakenly thinking that the interactive terminal is not online, the two terminals Regular keep-alive pins can be sent to refresh their respective online states. The timing diagram of the above method is shown in Figure 2, and the establishment of a separate media link between the two terminals can be performed by using the RTSP protocol. Use other public media protocols or even private media protocols.

Optionally, in the foregoing embodiment of the present invention, after performing step 11, the method further includes:

In a specific embodiment of the present invention, after obtaining the communication address of the interactive terminal, the terminal sends a request for establishing a communication connection (for example, “add as a friend”) to the interactive terminal, and the interactive terminal obtains the terminal after receiving the request. The mailing address enables the user of the interactive terminal to actively send an audio and/or video invitation to the user of the terminal.

The status of a “share” touch button is detected. When the “share” touch button is detected to be pressed, the parameter information of the currently played video is sent to the interactive terminal according to the communication address information of the interactive terminal.

In a specific embodiment of the present invention, when the user of the terminal wants to recommend a video program to the user of the interactive terminal, the terminal establishes a service link with the interactive terminal, and the user of the terminal clicks the “Share” button, and when the terminal detects “ When the touch button is pressed, the parameter information of the currently played video is sent to the interactive terminal according to the communication address information of the interactive terminal, so that the user of the interactive terminal can watch the video synchronously with the user of the terminal.

Optionally, in the foregoing embodiment of the present invention, after performing step 12, the method further includes:

In a specific embodiment of the present invention, the terminal sends a progress letter to the interactive terminal every preset time. The interactive terminal keeps playing synchronously with the terminal. Of course, if the terminal user temporarily leaves (for example, gets up and drinks water) to pause playing, the interactive terminal is also paused. After the terminal resumes playing, the interactive terminal also resumes synchronously. Play.

As shown in FIG. 3, in the above embodiment of the present invention, step 11 includes:

Step 111: Scan a two-dimensional code including the communication address information and the verification information of the interactive terminal, save the two-dimensional code to the buddy list of the user name including the interactive terminal, and associate the two-dimensional code with the user name of the interactive terminal;

Step 112: Obtain the communication address information of the interactive terminal according to the user name of the interactive terminal selected by the user from the buddy list.

In a specific embodiment of the present invention, the interactive terminal generates a two-dimensional code including its own address information and verification information, and the terminal can obtain the communication address of the interactive terminal by scanning the two-dimensional code through the camera, and the terminal can move to the interactive terminal. Sending a request to "add as a friend", after receiving the request, the interactive terminal can obtain the communication address of the terminal, so that if the terminal needs to send a message to the interactive terminal, it is only necessary to select the interactive terminal in the list of friends. The username is fine. Of course, the communication address of the interactive terminal can also be obtained by the following method: The first method: the interactive terminal sends an encrypted character string including its own communication address and verification information to the terminal through a conventional manner such as WeChat or the like, or the like. The string can be imported into the corresponding module to obtain the communication address of the interactive terminal; the second method: the terminal and the interactive terminal can obtain the communication address of the other party by means of a unified login server. Of course, it can be understood that the specific manner of obtaining the communication address of the interactive terminal is not limited in the embodiment of the present invention.

As shown in FIG. 4, according to the communication address information of the interactive terminal, the step of sending a request for establishing a communication link to the interactive terminal includes:

Step 41: Generate a character string including address information and verification information of the terminal;

Step 42: Send the character string to the interactive terminal through an instant messaging tool or a mailbox according to the communication address information of the interactive terminal.

In a specific embodiment of the present invention, the terminal sends the encrypted character string including the own address information and the verification information to the interactive terminal through a conventional manner such as an instant messaging tool such as WeChat or a mailbox, and the interactive terminal imports the character string into the corresponding module. The communication address of the terminal is available.

In the above embodiment of the present invention, step 13 includes:

In a specific embodiment of the present invention, when the terminal user wants to communicate with the interactive terminal user, the terminal user may click the “chat” button, and when the terminal detects that the “chat” touch button is pressed, the terminal initiates to the interactive terminal. Real-time audio and/or video contact requests allow end users to communicate with interactive end users.

In the above embodiment of the present invention, in step 13, in the current screen, the current play video is played in the first window, and the video data transmitted by the interactive terminal is played in the second window.

In a specific embodiment of the present invention, the second window may be a small window superimposed on the first window. Of course, the user may choose to close the second window and only retain the audio communication interaction.

In a specific embodiment of the present invention, as shown in FIG. 2, the steps when the terminal, the interactive terminal, and the media server apply the foregoing method are as follows: when the terminal user wants to recommend the currently playing video to the interactive terminal user, the local save can be opened. The buddy list, after selecting the interactive terminal user, sends the parameter information of the currently played video to the interactive terminal, and the interactive terminal acquires the play video from the media server through the parameter information. At this time, if the terminal user wants to communicate with the interactive terminal user, the interactive terminal may send a chat request, and after receiving the request, the interactive terminal sends an RTSP link request to the terminal, and randomly establishes a separate RTSP media link. The end user can then transmit real-time audio and video data to the interactive terminal client. Similarly, the terminal sends an RTSP request to the interactive terminal to establish a reverse RTSP link, so that the interactive terminal transmits the real-time audio and video data of the interactive terminal user to the terminal, so that the terminal client communicates with the interactive terminal client. Subsequently, the terminal may send a request to terminate the RTSP link to the interactive terminal, and after receiving the request, the interactive terminal closes the program sharing and the video interaction.

In order to achieve the above objective, as shown in FIG. 5, an embodiment of the present invention further provides a system 50 for real-time interaction of multiple people watching video, the system comprising a processor and a program storage device, the program storage device storing a computer A readable program, the computer readable program comprising:

The obtaining module 51 is adapted to obtain the communication address information of the interactive terminal;

The first sending module 52 is adapted to play the currently playing video according to the communication address information of the interactive terminal. The parameter information is sent to the interactive terminal, so that the interactive terminal can synchronously play the currently played video according to the parameter information;

The interaction module 53 is adapted to initiate a real-time audio and/or video contact request to the interactive terminal or receive an audio and/or video contact request sent by the interactive terminal during the process of playing the currently played video synchronously with the interactive terminal, and the interactive terminal Audio and/or video data transmission between.

In the specific embodiment of the present invention, the application environment deployment diagram of the above system 50 is as shown in FIG. 6.

The obtaining module 51 includes:

The first unit is adapted to scan the two-dimensional code including the communication address information and the verification information of the interactive terminal, save the two-dimensional code to the buddy list of the user name including the interactive terminal, and make the two-dimensional code and the user name of the interactive terminal Establish an association;

The second unit is adapted to obtain the communication address information of the interactive terminal according to the user name of the interactive terminal selected by the user from the buddy list.

Among them, the system also includes:

The second sending module is adapted to send a request for establishing a communication link to the interactive terminal according to the communication address information of the interactive terminal, so that the interactive terminal obtains the communication address information of the terminal.

The second sending module includes:

The third unit is adapted to generate a character string including address information and verification information of the terminal;

The fourth unit is adapted to send the character string to the interactive terminal through an instant messaging tool or a mailbox according to the communication address information of the interactive terminal.

Among them, the system also includes:

The detecting module is adapted to detect a state of a “share” touch button. When detecting that the “share” touch button is pressed, the parameter information of the currently played video is sent to the interactive terminal according to the communication address information of the interactive terminal.

The interaction module 53 includes:

The fifth unit is adapted to detect a state of a "chat" touch button, and when detecting that the "chat" touch button is pressed, initiate a real-time audio and/or video contact request to the interactive terminal.

Among them, the system also includes:

The third sending module is configured to send the progress information of the currently played video to the interactive terminal every preset time, so that the interactive terminal simultaneously plays the current video.

The interaction module 53 plays the current play video in the first window and the video data transmitted by the interactive terminal in the second window when the video data is transmitted between the interactive terminal and the interactive terminal.

One of ordinary skill in the art will appreciate that all or a portion of the steps described above can be accomplished by a program that instructs the associated hardware, such as a read-only memory, a magnetic or optical disk, and the like. Alternatively, all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the foregoing embodiment may be implemented in the form of hardware or in the form of a software function module. The invention is not limited to any specific form of combination of hardware and software.

The invention may, of course, be embodied in a variety of other embodiments without departing from the spirit and scope of the invention. Changes and modifications are intended to fall within the scope of the appended claims.

Industrial applicability

The method for real-time interaction of multi-person watching video provided by the embodiment of the present invention can realize simultaneous real-time audio and video communication while simultaneously watching the same video program in two or two situations without the main control server managing and forwarding the service. .

Claims

A method for multi-person viewing video real-time interaction is applied to a terminal, and the method includes:

Obtaining the communication address information of the interactive terminal;

Sending parameter information of the currently played video to the interactive terminal according to the communication address information of the interactive terminal, so that the interactive terminal can synchronously play the currently played video according to the parameter information;

In a process of synchronously playing the currently played video with the interactive terminal, initiating a real-time audio and/or video contact request to the interactive terminal, or receiving an audio and/or video contact request sent by the interactive terminal, and Audio and/or video data transmission between interactive terminals.
The method of claim 1, wherein the step of obtaining the communication address information of the interactive terminal comprises:

Scanting a two-dimensional code including the communication address information and the verification information of the interactive terminal, saving the two-dimensional code to a buddy list including a user name of the interactive terminal, and interacting the two-dimensional code with the The user name of the terminal is associated;

Obtaining the communication address information of the interactive terminal according to the user name of the interactive terminal selected by the user from the buddy list.
The method of claim 1 or 2, after the step of obtaining the communication address information of the interactive terminal, further comprising:

And sending, according to the communication address information of the interactive terminal, a request for establishing a communication link to the interactive terminal, so that the interactive terminal obtains the communication address information of the terminal.
The method of claim 3, wherein the step of transmitting a request to establish a communication link to the interactive terminal according to the communication address information of the interactive terminal comprises:

Generating a character string including address information and verification information of the terminal;

And sending the character string to the interactive terminal by using an instant messaging tool or a mailbox according to the communication address information of the interactive terminal.
The method of claim 1, after the step of obtaining the communication address information of the interactive terminal, further comprising: detecting a status of a "share" touch button, when detecting the "sharing" When the touch button is pressed, the parameter information of the currently played video is sent to the interactive terminal according to the communication address information of the interactive terminal.
The method of claim 1 wherein said step of initiating a real-time audio and/or video contact request to said interactive terminal comprises:

A status of a "chat" touch button is detected, and when it is detected that the "chat" touch button is pressed, a real-time audio and/or video contact request is initiated to the interactive terminal.
The method of claim 1, after the step of transmitting the parameter information of the currently played video to the interactive terminal according to the communication address information of the interactive terminal, the method further includes:

Sending progress information of the currently played video to the interactive terminal every predetermined time, so that the interactive terminal synchronously plays the current video.
The method of claim 1, wherein the parameter information of the currently played video comprises: an address of a media server that currently plays the video, an ID of the currently played video, and a playback progress of the currently played video.
The method of claim 1, wherein in the step of performing video data transmission with the interactive terminal, on the current screen, the current play video is played in the first window, and the second window is played in the second window. Video data transmitted by the interactive terminal.
A system for multi-person watching video real-time interaction is applied to a terminal, the system comprising:

Obtaining a module, configured to obtain communication address information of the interactive terminal;

The first sending module is configured to send the parameter information of the currently played video to the interactive terminal according to the communication address information of the interactive terminal, so that the interactive terminal can synchronously play the currently played video according to the parameter information;

An interaction module, configured to initiate a real-time audio and/or video contact request to the interactive terminal or receive audio and/or video sent by the interactive terminal in a process of playing the currently played video synchronously with the interactive terminal A contact request to perform audio and/or video data transmission with the interactive terminal.
The system of claim 10 wherein said obtaining module comprises:

a first unit, configured to scan a two-dimensional code including the communication address information and the verification information of the interactive terminal, and save the two-dimensional code to a buddy list including a user name of the interactive terminal, so that The two-dimensional code is associated with a username of the interactive terminal;

The second unit is configured to obtain the communication address information of the interactive terminal according to the user name of the interactive terminal selected by the user from the buddy list.
A system according to claim 10 or 11, further comprising:

The second sending module is configured to send a request for establishing a communication link to the interactive terminal according to the communication address information of the interactive terminal, so that the interactive terminal obtains the communication address information of the terminal.
The system of claim 12 wherein said second transmitting module comprises:

a third unit, configured to generate a character string including address information and verification information of the terminal;

The fourth unit is configured to send the character string to the interactive terminal by using an instant messaging tool or a mailbox according to the communication address information of the interactive terminal.
The system of claim 10 further comprising:

The detecting module is configured to detect a state of a “share” touch button, and when detecting that the “share” touch button is pressed, send the parameter information of the currently played video to the location according to the communication address information of the interactive terminal. The interactive terminal.
The system of claim 10 wherein said interaction module comprises:

The fifth unit is configured to detect a state of a "chat" touch button, and when detecting that the "chat" touch button is pressed, initiate a real-time audio and/or video contact request to the interactive terminal.
The system of claim 10 further comprising:

The third sending module is configured to send progress information of the currently played video to the interactive terminal every predetermined time, so that the interactive terminal plays the current video synchronously.
The system of claim 10, wherein the parameter information of the currently played video comprises: an address of a media server that currently plays the video, an ID of the currently played video, and a playback progress of the currently played video.
The system according to claim 10, wherein when the interactive module performs video data transmission with the interactive terminal, the current play video is played in the first window and the interaction is played in the second window on the current screen. Video data transmitted by the terminal.
A computer readable storage medium storing a computer program, the computer program comprising program instructions, when the program instructions are executed by a video terminal device, causing the device to perform the method of any one of claims 1-9 .