CN108668152B - Audio and video interaction method and device, management equipment and storage medium - Google Patents

Audio and video interaction method and device, management equipment and storage medium Download PDF

Info

Publication number
CN108668152B
CN108668152B CN201710210887.0A CN201710210887A CN108668152B CN 108668152 B CN108668152 B CN 108668152B CN 201710210887 A CN201710210887 A CN 201710210887A CN 108668152 B CN108668152 B CN 108668152B
Authority
CN
China
Prior art keywords
audio
terminal
video interaction
video
path information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710210887.0A
Other languages
Chinese (zh)
Other versions
CN108668152A (en
Inventor
薛笛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201710210887.0A priority Critical patent/CN108668152B/en
Publication of CN108668152A publication Critical patent/CN108668152A/en
Application granted granted Critical
Publication of CN108668152B publication Critical patent/CN108668152B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H04N21/25816—Management of client data involving client authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses an audio and video interaction method and device, and belongs to the technical field of networks. The method comprises the following steps: when an audio and video interaction quitting request of a first terminal is received, determining second management equipment according to first path information, wherein the first path information is used for indicating that audio and video data of the first terminal are forwarded to the second terminal through the second management equipment; clearing the first path information; and sending an audio and video interaction quit request to the second management equipment, and forwarding the audio and video interaction quit request to the second terminal by the second management equipment. And sending the audio-video interaction quitting request to the second management equipment through the first path information, so that the second management equipment can inform the second terminal that the first terminal quits the current audio-video interaction. Moreover, the first management device can timely clear the first path information of the second terminal, so that the first management device cannot subsequently forward the audio and video data of the first terminal to the second terminal, and an audio and video interaction exit process is realized.

Description

Audio and video interaction method and device, management equipment and storage medium
Technical Field
The invention relates to the technical field of networks, in particular to an audio and video interaction method and device.
Background
With the development of network technology, live video has become a popular network audio-video interaction mode, for example, a live broadcast system will allocate an audio-video identifier, i.e. a room number, to a live broadcast user needing live broadcast, and other users can join in the "room" as audience users to interact with the live broadcast user.
Currently, when a live broadcast user in a "live broadcast room" performs live broadcast, a terminal where the live broadcast user is located may cause live broadcast interruption due to network interruption and the like, and at this time, a device for managing the "live broadcast room" where the live broadcast user is located may notify audience users in the "live broadcast room" of a current state of the live broadcast user, such as a current non-live broadcast state, so that the terminal where the audience users are located can synchronize the state of the live broadcast user. When the audio-video interaction is carried out among the anchor broadcasts of a plurality of rooms, different live broadcast rooms are managed by different devices, when the anchor broadcast of one live broadcast room quits the audio-video interaction, the live broadcast room management device only informs a user in the live broadcast room of corresponding quit information, and users of other live broadcast rooms carrying out the audio-video interaction cannot know the quit information, so that the quit process is wrong, therefore, how to quit the audio-video interaction in one live broadcast room ensures that each live broadcast room can know the corresponding quit information, and the problem to be solved is to smoothly finish the corresponding quit process.
Disclosure of Invention
In order to solve the problems in the prior art, embodiments of the present invention provide an audio and video interaction method and apparatus. The technical scheme is as follows:
in a first aspect, an audio and video interaction method is provided, and is applied to a first management device, where the method includes:
when an audio and video interaction quit request of a first terminal is received, determining second management equipment according to first path information, wherein the first path information is used for indicating that audio and video data of the first terminal are forwarded to a second terminal through the second management equipment, and the second terminal is a terminal for audio and video interaction with the first terminal;
clearing the first path information to enable the first management equipment to subsequently stop forwarding the audio and video data of the first terminal to the second management equipment;
and sending the audio and video interaction quitting request to the second management device, and forwarding the audio and video interaction quitting request to the second terminal by the second management device so as to prompt the first terminal to quit the current audio and video interaction.
In a second aspect, an audio and video interaction method is provided, which is applied to a second management device, and the method includes:
when an audio and video interaction quit request of a first terminal is received from a first management device, a second terminal performing audio and video interaction with the first terminal is determined;
clearing stored second path information, wherein the second path information is used for indicating that audio and video data of the second terminal are forwarded to the first terminal through the first management device;
and sending an audio and video interaction update message to a terminal where a user associated with the second terminal is located, wherein the audio and video interaction update message is used for prompting that the first terminal exits from the current audio and video interaction.
In a third aspect, an audio-video interaction method is provided, where the method includes:
when a first management device receives an audio and video interaction quit request of a first terminal, determining a second management device according to first path information, wherein the first path information is used for indicating that audio and video data of the first terminal are forwarded to a second terminal through the second management device, and the second terminal is a terminal performing audio and video interaction with the first terminal;
the first management equipment clears the first path information so that the first management equipment subsequently stops forwarding the audio and video data of the first terminal to the second management equipment;
the first management device sends the audio and video interaction quit request to the second management device;
the second management equipment determines the second terminal when receiving the audio and video interaction quitting request;
the second management equipment clears the stored second path information, and the second path information is used for indicating that the audio and video data of the second terminal are forwarded to the first terminal through the first management equipment;
and the second management equipment sends an audio-video interaction updating message to a terminal where a user associated with the second terminal is located, wherein the audio-video interaction updating message is used for prompting that the first terminal exits from the current audio-video interaction.
In a fourth aspect, an audio/video interaction apparatus is provided, which is applied to a first management device, and the apparatus includes:
the first determining module is used for determining second management equipment according to first path information when receiving an audio and video interaction quit request of a first terminal, wherein the first path information is used for indicating that audio and video data of the first terminal are forwarded to the second terminal through the second management equipment, and the second terminal is a terminal performing audio and video interaction with the first terminal;
the clearing module is used for clearing the first path information so as to enable the first management equipment to subsequently stop forwarding the audio and video data of the first terminal to the second management equipment;
the first sending module is used for sending the audio and video interaction quitting request to the second management device, and the second management device forwards the audio and video interaction quitting request to the second terminal so as to prompt that the first terminal quits the current audio and video interaction.
In a fifth aspect, an audio/video interaction apparatus is provided, which is applied to a second management device, and the apparatus includes:
the device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining a second terminal which carries out audio and video interaction with a first terminal when receiving an audio and video interaction quit request of the first terminal from a first management device;
the clearing module is used for clearing stored second path information, and the second path information is used for indicating that audio and video data of the second terminal are forwarded to the first terminal through the first management device;
and the first sending module is used for sending an audio and video interaction updating message to a terminal where a user associated with the second terminal is located, wherein the audio and video interaction updating message is used for prompting that the first terminal exits from the current audio and video interaction.
In a sixth aspect, a live video broadcast system is provided, which comprises a first management device, a second management device,
the first management device is configured to perform the method of the first aspect;
the second management device is configured to perform the method of the second aspect.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
when receiving an audio and video interaction quitting request of a first terminal, the first management device can determine a second management device associated with a second terminal according to the stored path information and send the audio and video interaction quitting request to the second management device, so that the second management device can inform the second terminal that the first terminal quits the current audio and video interaction. Moreover, the first management device can timely clear the first path information of the second terminal, so that the first management device cannot subsequently forward the audio and video data of the first terminal to the second terminal, and cannot forward the audio and video data of the second terminal to the first terminal, and therefore, each live broadcast room participating in audio and video interaction can smoothly complete a corresponding exit process.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is an architecture diagram for an audio/video interactive system according to an embodiment of the present invention;
fig. 2 is a flowchart of an audio/video interaction method according to an embodiment of the present invention;
fig. 3 is a signaling interaction diagram of an audio/video interaction exit flow according to an embodiment of the present invention;
fig. 4 is a block diagram of an audio/video interaction apparatus according to an embodiment of the present invention;
fig. 5 is a block diagram of an audio/video interaction apparatus according to an embodiment of the present invention;
fig. 6 is a block diagram of an audio-video interaction apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Fig. 1 is an architecture diagram for an audio/video interactive system according to an embodiment of the present invention, and referring to fig. 1, the audio/video interactive system includes a policy server, a plurality of management devices, and a plurality of terminals.
The policy server is used for allocating an audio/video identifier to a terminal where the anchor user is when the anchor user requests to perform video live broadcasting, wherein the audio/video identifier can be used for uniquely identifying a live broadcasting Room or a live broadcasting Channel, the audio/video identifier can be a Room number (Room ID) or a Channel number (Channel ID), and the policy server allocates management equipment to the live broadcasting Room according to the load conditions of the management equipment.
Each management device is configured to manage live video broadcast in one or more rooms, for example, taking a live broadcast room as an example, when a live broadcast room is created, if the policy server allocates the management device to the live broadcast room, the management device may record an audio/video identifier of the live broadcast room, and in a live broadcast process, send audio/video data uploaded by a terminal where a host user in the live broadcast room is located to a terminal where an audience user in the live broadcast room is located according to the audio/video identifier.
In practical applications, different functional units may be used to implement different functions of the management device, for example, one management device may include a flow control unit (Center) and one or more relay units (accesses). Of course, all functions of the management device may be implemented by one unit, which is not limited in this embodiment.
Each management device can also provide path information of the managed live broadcast room, and the path information is used for indicating that audio and video data of other live broadcast room anchor users can be forwarded to the local live broadcast room through the management device so as to realize audio and video interaction of different live broadcast rooms. When the management device includes a flow control unit and a relay unit, the path information corresponding to one live broadcast room may include address information of the flow control unit and address information of the relay unit corresponding to the live broadcast room. The address information of the flow control unit may be an IP address of the flow control unit, and the address information of the relay unit may be an IP address of the relay unit.
The stream control unit is used for managing live broadcast information of one or more live broadcast rooms, and the live broadcast information of one live broadcast room can include audio and video identifiers of the live broadcast room, a transfer unit list corresponding to the live broadcast room and the like. The transfer unit list of one live broadcast room is used for recording the user identifications of the anchor user and the audience users in the live broadcast room and the address information of the transfer units accessed by the terminal where the anchor user is located and the terminal where the audience users are located. The user identifier of the user may be a user name, a registered mobile phone number, and the like of the user. The flow control unit may also be configured to perform signaling and message interaction with the policy server, for example, perform interaction of an audio/video interaction quit request and an audio/video interaction quit confirmation message. In addition, the flow control unit can be used for regulating and controlling the network quality of the user.
One flow control unit may correspond to one or more relay units, and one relay unit may be connected to one or more terminals. The terminal can be a mobile terminal (such as a mobile phone, a tablet computer, etc.) or a desktop computer, etc. When a certain user needs to participate in the video live broadcasting of a certain live broadcasting room, the policy server allocates a transfer unit to the terminal where the user is located, and registers the identifier of the transfer unit in a transfer unit list corresponding to the flow control unit and the corresponding audio/video identifier. The policy server may assign a nearby transfer unit to the terminal according to the geographic location. Each transit unit can serve as a bridge between the terminal and the flow control unit, and is used for forwarding signaling or messages between the terminal and the flow control unit. For live broadcasting in a live broadcasting room, the transfer unit corresponding to the anchor user can send the audio and video data of the anchor user to the transfer unit corresponding to the audience user, and the transfer unit corresponding to the audience user transfers the audio and video data of the anchor user to the terminal where the audience user is located. For cross-room live broadcasting, interaction of audio and video data of anchor users can be performed among transit units corresponding to anchor users in different live broadcasting rooms. That is, in this embodiment, audio and video interaction may be performed between the relay units corresponding to the same live broadcast room, and audio and video interaction may also be performed between the relay units corresponding to different live broadcast rooms. For example, when the anchor a in one live broadcast room a performs audio-video interaction with the anchor B in another live broadcast room B, the relay unit corresponding to the anchor a in the live broadcast room a is used to send the audio-video data of the terminal in which the anchor a is located to the relay unit corresponding to the live broadcast room B, and then the relay unit corresponding to the live broadcast room B sends the audio-video data of the anchor a to the anchor B and the terminal in which the audience user in the live broadcast room B is located.
In addition, the live video broadcast system also comprises a live broadcast information database, the live broadcast information database provides a live broadcast information query service, the live broadcast information database is used for storing basic information of all online live broadcast rooms in the live video broadcast system, and the basic information comprises creation time of the live broadcast rooms, audio and video identification, address information of a flow control unit for managing the live broadcast rooms and a transfer unit list of the live broadcast rooms. For example, the policy server may query the live broadcast information database for a flow control unit and a transfer unit corresponding to the audio/video identifier according to the audio/video identifier, and return a query result from the live broadcast information database.
In addition, the video live broadcasting system can also comprise a message unit and a signaling access unit, wherein the message unit is used for managing and forwarding interactive instant messages between terminals, such as characters, pictures and the like. The terminal can interact with the message unit and the policy server through the signaling access unit.
Fig. 1 illustrates an architecture of only one management device, and one management device may be installed in one or more servers, or a plurality of management devices may be installed in one server. The flow control unit and the relay unit of one management device may be assumed to be on one server, or may be erected on multiple servers, and the management device may be an entity device having a corresponding function, or an application program implementing a corresponding function, which is not limited in this embodiment.
Fig. 2 is a flowchart of an audio-video interaction method provided by an embodiment of the present invention, and referring to fig. 2, a method flow provided by the embodiment of the present invention includes:
201. and when the first flow control unit receives an audio and video interaction quitting request of the first terminal, determining a second flow control unit according to the first path information.
And the second terminal is a terminal for audio-video interaction with the first terminal. The number of the second terminals may be one or more, and accordingly, the number of the live broadcast rooms for performing audio/video interaction may be two or more, which is not limited in the embodiment of the present invention.
The first path information is used for indicating that the audio and video data of the first terminal are forwarded to the second terminal through the second management device. For example, the audio/video data of the first terminal is forwarded to the second terminal through the second forwarding unit. The first path information may include address information of a second traffic control unit and address information of a second transit unit associated with the second terminal. The second transfer unit is a transfer unit corresponding to both the second flow control unit and the second terminal.
In the embodiment of the present invention, the process of the first flow control unit receiving the audio/video interaction quitting request of the first terminal may be: when the first terminal detects the quitting operation of the user, the first terminal sends an audio and video interaction quitting request to the first transfer unit, and the first transfer unit forwards the audio and video interaction quitting request to the first flow control unit, so that the first flow control unit receives the audio and video interaction quitting request of the first terminal.
In the embodiment of the invention, users in different live broadcast rooms can interact audio and video data, that is, the audio and video data of users with control authority in different live broadcast rooms can be interacted, for example, the users with control authority can be anchor users in the live broadcast rooms. Compared with live broadcasting in live broadcasting rooms, the process of audio and video interaction can be regarded as cross-room live broadcasting among different live broadcasting rooms. Taking two live broadcast rooms, namely a first live broadcast room and a second live broadcast room, as an example, the two live broadcast rooms perform audio and video interaction, namely, audio and video data of a first anchor user in the first live broadcast room are sent to a terminal where a user associated with the second live broadcast room is located; and sending the audio and video data of the second anchor user in the second live broadcast room to the terminal of the user associated with the first live broadcast room. From the perspective of the user associated with the first live broadcast room and the user associated with the second live broadcast room, the audio and video data of the first anchor user and the audio and video data of the second anchor user are displayed in the same picture. Wherein the users associated with the live room include the anchor user and the audience users in the live room.
It should be noted that, in the audio-video interaction described in the embodiment of the present invention, in addition to performing interaction on audio-video data of a director user between different live broadcast rooms, the interactive audio-video data may also include audio-video data of audience users in the live broadcast rooms. For example, the interactive audio-video data includes audio-video data of a first anchor user and a first audience user of a first live room, and audio-video data of a second anchor user. For another example, the interactive audio/video data includes audio/video data of a first anchor user and audio/video data of a second anchor user and a second viewer user in a second live broadcast room. For another example, the interactive audio/video data includes audio/video data of a first anchor user and a first audience user, and audio/video data of a second anchor user and the first audience user. In the embodiment of the present invention, a first terminal is taken as a terminal where a first live broadcast user in a first live broadcast room is located, and a second terminal is taken as a terminal where a second live broadcast user in a second live broadcast room is located.
It should be noted that, in the process of establishing audio/video interaction between the first terminal and the second terminal, the first flow control unit may store a corresponding relationship between the audio/video identifier of the first terminal, the audio/video identifier of the second terminal, the user identifier of the second terminal user, and the path information of the second terminal. The first flow control unit can determine a second terminal which carries out audio-video interaction with the first terminal currently through the corresponding relation. In addition, since the first flow control unit and the first relay unit both store the path information of the second terminal, and the second flow control unit and the second relay unit both store the path information of the first terminal, data forwarding, such as forwarding of audio and video data of audio and video interaction or forwarding of audio and video interaction signaling, such as signaling for exiting audio and video interaction (such as an audio and video interaction exit request), can be performed in the live broadcast room where the first terminal is located and the live broadcast room where the second terminal is located through the first flow control unit, the first relay unit, the second flow control unit and the second relay unit.
In this embodiment of the present invention, the determining, by the first flow control unit according to the first path information, the second flow control unit may include the following two ways:
in the first mode, the first flow control unit determines first path information corresponding to the audio/video interaction identifier from the stored path information according to the audio/video interaction identifier carried by the audio/video interaction exit request; address information of the second management apparatus is extracted from the first path information.
In the second mode, the first flow control unit determines the audio and video identification of the second terminal associated with the audio and video interaction identification according to the audio and video interaction identification carried by the audio and video interaction quit request; according to the audio and video identification of the second terminal, first path information corresponding to the audio and video identification of the second terminal is determined from the locally stored path information, and address information of the second management device is extracted from the first path information. The audio and video identification of the second terminal refers to the audio and video identification of a live broadcast room to which the second terminal belongs.
It should be noted that, for the two modes, in the embodiment of the present invention, the audio/video interaction exit request carries an audio/video interaction identifier, where the audio/video interaction identifier is used to uniquely determine an audio/video interaction, and the audio/video interaction identifier may be allocated by the policy server in the process of establishing the audio/video interaction, and the first streaming control unit and the second streaming control unit store the relevant path information corresponding to the audio/video interaction identifier. For example, the audio-video interaction in the live broadcast rooms of the anchor user a and the anchor user B is denoted by "1001" and the audio-video interaction in the live broadcast rooms of the anchor user a and the anchor user C is denoted by "1002". That is, in this embodiment, a live broadcast room can establish a plurality of audio-video interactions at the same time, and allocate different audio-video interaction identifiers to different audio-video interactions. Certainly, an audio-video interaction can be established in the live broadcast rooms where the anchor user a, the anchor user B and the anchor user C are located, for example, the allocated audio-video interaction identifier is "1003", and at this time, the user terminals participating in the audio-video interaction can see the video pictures of the anchor user a, the anchor user B and the anchor user C at the same time. The first flow control unit can manage a plurality of live broadcast rooms, and each live broadcast room can establish audio-video interaction with other live broadcast rooms, so that the first flow control unit can store a plurality of path information.
For the first mode, the first flow control unit stores the first path information corresponding to the audio/video interaction identifier, for example, when the audio/video interaction is performed in a live broadcast room where the first terminal and the second terminal are located, the audio/video interaction identifier is "1000", and the first flow control unit stores the first path information of the second terminal corresponding to the audio/video interaction identifier "1000", for example, manages the address information of the second flow control unit and the address information of the second relay unit in the live broadcast room where the second terminal is located.
For the second mode, the first flow control unit stores the audio/video identifier of the second terminal corresponding to the audio/video interaction identifier, and stores path information corresponding to the audio/video identifier of the second terminal, where the path information corresponding to the audio/video identifier of the second terminal includes path information of a terminal performing audio/video interaction with the second terminal.
In the embodiment of the present invention, to avoid a malicious exit behavior and ensure the security of audio/video interaction, the first flow control unit may send the audio/video interaction exit request of the first terminal to the policy server, and the policy server performs identity verification on the first terminal, where the process may be as follows: the audio/video interaction quitting request of the first terminal also carries the signature information of the first terminal. The policy server performs identity verification on the first terminal according to the signature information, for example, the signature information may be obtained by encrypting the user identifier of the first terminal by the first terminal according to a preset algorithm, the policy server decrypts the signature information according to an algorithm corresponding to or the same as the preset algorithm, if the decryption is successful, it is determined that the identity verification is successful, and the following step 202 and subsequent steps are performed; otherwise, it is determined that the identity verification fails, the first terminal is rejected from exiting the current audio-video interaction, and the processing flow of this embodiment is ended.
In the following, the process of establishing audio and video interaction between two live broadcast rooms corresponding to the first terminal and the second terminal is introduced by taking an example that the first terminal initiates audio and video interaction, and the process may include the following steps a to j:
step a: the first terminal sends an initial audio and video interaction request message to the first transfer unit, and the first transfer unit sends the received initial audio and video interaction request message to the first flow control unit.
And the initial audio/video interaction request message carries the audio/video identification of the second terminal and the user identification of the second terminal user. When the second terminal user is the anchor user, the initial association request may not carry the user identifier of the second terminal user, but for each live broadcast room, a management device (such as a flow control unit or a relay unit) that manages the live broadcast room may record a correspondence between the audio/video identifier indicated in the live broadcast room and the user identifier of the anchor user, and the management device determines the user identifier of the corresponding anchor user according to the audio/video identifier.
Step b: the first flow control unit adds the path information of the first terminal, the audio and video identification of the first terminal and the user identification of the first terminal user in the initial audio and video interaction request message to obtain the audio and video interaction request message of the first terminal.
The path information of the first terminal may include address information of the first relay unit and address information of the first flow control unit, and the path information of the first terminal is used to indicate that data forwarding may be performed to the first terminal through the first relay unit and the first flow control unit.
Step c: and the first flow control unit sends the audio and video interaction request message to a policy server.
Step d: and the policy server determines a second flow control unit associated with the second terminal according to the audio and video identification of the second terminal carried in the audio and video interaction request message, and sends the audio and video interaction request message to the second flow control unit.
Step e: the second flow control unit stores the audio and video identification of the second terminal, the user identification of the second terminal user, the audio and video identification of the first terminal, the user identification of the first terminal user and the corresponding relation between the path information of the first terminal, and returns an audio and video interaction confirmation message to the strategy server, wherein the audio and video interaction confirmation message carries the path information of the second terminal, the audio and video identification of the second terminal and the user identification of the second terminal user.
Step f: and the second flow control unit synchronizes the information carried by the audio/video interaction request message to the second transfer unit and sends an audio/video interaction update message to the second transfer unit.
Step g: the second transfer unit sends the audio and video interaction update message to a terminal where a user associated with the second terminal is located, so that the user in the live broadcast room where the second terminal is located is informed of the audio and video interaction request message of the first terminal, and the terminal where the user in the live broadcast room where the second terminal is located can add the audio and video identification of the first terminal to a local audio and video interaction list, so that the audio and video interaction establishment process at the side of the second terminal is completed.
Step h: after the step e, the strategy server sends the audio and video interaction confirmation message to the first flow control unit.
Step i: the first flow control unit stores the corresponding relation among the audio and video identification of the first terminal, the user identification of the first terminal user, the audio and video identification of the second terminal, the user identification of the second terminal user and the path information of the second terminal, synchronizes the information carried by the audio and video interaction confirmation message to the first transfer unit, and sends an audio and video interaction updating message to the first transfer unit.
Step j: the first transfer unit sends the audio and video interaction updating message to a terminal where a user associated with the first terminal is located, so that the terminal where the user in a live broadcast room where the first terminal is located can add the audio and video identification of the second terminal to a local audio and video interaction list, and the audio and video interaction establishing process at the first terminal side is completed.
202. The first flow control unit clears the first path information.
And after receiving the audio and video interaction quitting request of the first terminal, the first flow control unit clears the first path information of the second terminal to indicate that the first terminal quits the audio and video interaction with the second terminal.
In addition, in order to notify the first terminal user that the logout is successful in time, the first flow control unit may further send a logout success message to the first terminal through the first relay unit, so that the first terminal prompts the logout to be successful after receiving the logout success message.
203. And the first flow control unit informs the first transfer unit of clearing the stored first path information.
In this embodiment, the first traffic control unit may further notify the first transit unit to clear the stored first path information, for example, the first traffic control unit may send a path information clearing instruction to the first transit unit, where the path information clearing instruction carries an audio-video interaction identifier, so that the first transit unit determines the path information that needs to be cleared.
204. And the first transfer unit clears the stored first path information, sends an audio and video interaction updating message to the terminal where the user associated with the first terminal is located, and deletes the audio and video identification of the second terminal in the local live broadcast list by the terminal where the user associated with the first terminal is located.
And the first transfer unit removes the first path information corresponding to the audio-video interaction identifier from the stored path information. After the first relay unit clears the first path information, the audio and video data of the first terminal will not be forwarded to the second relay unit any more subsequently, that is, the audio and video data of the first terminal will not be forwarded to the terminal where the user associated with the second terminal is located through the second relay unit. For example, after the first terminal initiates an audio/video interaction quit request, the first relay unit may also receive audio/video data of the second terminal forwarded by the second relay unit, at this time, the first relay unit may detect whether path information of the second terminal is locally stored, and if the first path information is not locally stored, the audio/video data of the second terminal is discarded, so as to ensure that a user in a live broadcast room where the first terminal is located does not receive the audio/video data of the second terminal any more, and ensure the correctness of the quit process.
The audio and video interaction updating message is used for indicating that the first terminal quits audio and video interaction with the second terminal, the audio and video interaction updating message can carry an audio and video interaction identifier and an audio and video identifier of the second terminal, and the audio and video identifier of the second terminal is deleted from the local live broadcast list by the terminal where the user associated with the first terminal is located according to the audio and video interaction identifier and the audio and video identifier of the second terminal. The user associated with the first terminal refers to a user associated with the audio and video identification of the live broadcast room to which the first terminal belongs, that is, all users in the live broadcast room to which the first terminal belongs.
It should be noted that, in this embodiment, for any live broadcast room participating in audio/video interaction, a terminal where a user associated with the live broadcast room is located may all agree to participate in the audio/video interaction, and certainly, may also refuse to participate in the audio/video interaction. Therefore, the process of sending the audio/video interaction update message to the terminal where the user associated with the first terminal is located by the first transit unit may include the following two cases:
in the first case, the terminals where the users in the default live broadcast room are located agree to participate in the audio-video interaction.
In this case, the first relay unit determines a first user associated with the first terminal; and sending an audio and video interaction updating message to the terminal where the first user is located.
And in the second case, a terminal where the user who refuses to participate in the audio-video interaction exists.
In this case, the first relay unit determines a first user associated with the first terminal; determining users without the specified label in the first users as second users; and sending an audio and video interaction updating message to the terminal where the second user is located, wherein the designated tag is used for indicating the user to refuse to participate in the audio and video interaction of the second terminal.
It should be noted that, in the process of establishing the audio-video interaction, when the first terminal initiates an audio-video interaction request to the second terminal, if the first terminal user is a main broadcasting user, the audience user in the live broadcasting room where the first terminal is located may choose to participate in the audio-video interaction, or may refuse to participate in the audio-video interaction. For example, when a first terminal initiates an audio/video interaction request, an audio/video interaction access request may be sent to audience users through a first relay unit, and if any one of the first users refuses to participate in the audio/video interaction, an access refusal message may be sent to the first relay unit through a local terminal. If the first transfer unit receives the access rejection message of the terminal where the user is located, an appointed label is added to the user, so that in the process of audio-video interaction with the second terminal, the first transfer unit only sends the audio-video data of the first terminal to the terminal where the user is located, and does not send the audio-video data of the second terminal to the terminal where the user is located. In this case, the terminal where the user is located only displays the audio and video data of the first terminal, that is, only displays the video picture of the anchor user of the first terminal. The designated tag may be configured in advance to the second transit unit or the second traffic control unit by the policy server, which is not limited in this embodiment.
It should be noted that, in the audio/video interaction process, the local live broadcast list of the user terminal may store the user identifier of the anchor user in addition to the audio/video identifier of the room where the anchor user is currently live broadcast, and when the audio/video identifier of one live broadcast room is deleted, the user identifier of the corresponding anchor user may also be deleted.
205. And the first flow control unit sends the audio and video interactive quitting request to the second flow control unit.
And the first flow control unit sends the audio/video interactive quit request to the second flow control unit according to the address information of the second flow control unit.
The foregoing steps 201 to 205 are processes of determining, by the first management device, the second management device according to the first path information when receiving the audio/video interaction quitting request of the first terminal, clearing the first path information, and sending the audio/video interaction quitting request to the second management device. It should be noted that, the step 203 and the step 205 are executed asynchronously, and the execution order of the two is not limited in the embodiment of the present invention.
206. And when the second flow control unit receives the audio and video interaction quit request of the first terminal, determining a second terminal which performs audio and video interaction with the first terminal.
The process that the second flow control unit determines the second terminal performing audio and video interaction with the first terminal may be: determining a plurality of audio-video identifiers corresponding to the audio-video interaction identifiers according to the audio-video interaction identifiers carried by the audio-video interaction quitting request; and determining the terminal corresponding to the audio and video identifier managed by the second flow control unit as a second terminal in the plurality of audio and video identifiers.
In this embodiment, the audio/video identifiers of one or more live broadcast rooms managed by the second streaming control unit are referred to as audio/video identifiers belonging to the second streaming control unit. In the implementation process, the second streaming control unit may compare the determined multiple audio/video identifiers with locally managed audio/video identifiers, and determine an audio/video identifier, which is consistent with the locally managed audio/video identifier, of the multiple audio/video identifiers as an audio/video identifier corresponding to the second terminal.
For example, when audio and video interaction is performed among three live broadcast rooms corresponding to the anchor user a, the anchor user B and the anchor user C, the audio and video interaction is marked as "1003", the first streaming control unit is used for managing the live broadcast room where the anchor user a is located, and the streaming control units for managing the live broadcast rooms where the anchor user B and the anchor user C are located are both called as second streaming control units. For the second streaming control unit which manages the live broadcast room in which the anchor user B is located, the audio and video identifiers of the live broadcast rooms in which the anchor user a, the anchor user B and the anchor user C are located are stored corresponding to the audio and video interaction identifier "1003". For example, the second streaming control unit manages live broadcast rooms in which the anchor user B and the anchor user D are located, and then it can be known through comparison that the audio/video identifier of the live broadcast room in which the anchor user B is located is the audio/video identifier corresponding to the second terminal, and a user associated with the second terminal can be determined according to the audio/video identifier corresponding to the second terminal.
207. The second flow control unit clears the stored second path information.
The second path information is used for indicating that the audio and video data of the second terminal are forwarded to the first terminal through the first management device, that is, the audio and video data of the second terminal are forwarded to the user terminal corresponding to the live broadcast room where the first terminal is located through the first forwarding unit. The second path information may include address information of a first traffic control unit and address information of a first relay unit associated with the first terminal. The first transfer unit is a transfer unit corresponding to both the first flow control unit and the first terminal.
In this embodiment of the present invention, the second flow control unit may determine the second path information by using the following two ways:
in the first mode, the second flow control unit determines the second path information from the stored path information according to the audio/video interaction identifier carried by the audio/video interaction exit request.
For the first mode, the second traffic control unit stores second path information corresponding to the audio/video interaction identifier, for example, when the audio/video interaction is performed in a live broadcast room where the first terminal and the second terminal are located, the audio/video interaction identifier is "1000", the second traffic control unit stores one or more path information corresponding to the audio/video interaction identifier "1000", where the path information corresponding to the first terminal is the second path information, for example, the second path information may be address information of a first traffic control unit and address information of a first relay unit that manages the live broadcast room where the first terminal is located.
In the second mode, the second flow control unit determines second path information from the locally stored path information according to the audio/video interaction identifier carried by the audio/video interaction quit request and the audio/video identifier of the first terminal.
For the second mode, the second flow control unit stores one or more audio/video identifiers corresponding to the audio/video interaction identifier, and stores path information corresponding to the audio/video identifier, wherein the path information corresponding to the audio/video identifier of the first terminal is the second path information.
It should be noted that, in step 201, the av interaction logout request of the first terminal may further have a logout type, where the logout type includes a one-way logout and a decentralized logout. The unidirectional quitting is used for indicating that only the first terminal quits the current audio-video interaction, and the scattered quitting is used for indicating the end of the current audio-video interaction. For example, currently, three anchor users (anchor user a, anchor user B, and anchor user C) are performing audio-video interaction, and the anchor user a initiates a unidirectional exit from the audio-video interaction, so the anchor user B and the anchor user C still maintain the audio-video interaction. From a user terminal of a live broadcast room where a main broadcast user A is located, originally displayed video pictures of three main broadcast users on the user terminal are changed into video pictures of the main broadcast user A which are independently live broadcast; or the originally displayed video pictures of the three main broadcasts are directly changed into the live broadcast ending pictures. And when viewed from the user terminals of the live broadcast room in which the anchor user B is located and the live broadcast room in which the anchor user C is located, the three anchor video pictures displayed by the round faces on the user terminals are changed into the video pictures with only two anchor user audio-video interaction.
Correspondingly, when the audio/video interactive quitting request has a quitting type, in step 204, the second streaming control unit needs to determine the quitting type of the audio/video interactive quitting request when receiving the audio/video interactive quitting request of the first terminal. The audio/video interactive quitting request may use a designated field to indicate the quitting type, where the designated field may be a reserved resource in the communication protocol or an extension field of the communication protocol, and the like, and this is not limited in the embodiment of the present invention.
The process of clearing the second path information by the second traffic control unit for different exit types can be divided into the following two cases:
in the first case, the exit type of the audio/video interactive exit request is unidirectional exit.
If the second flow control unit determines that the exit type of the audio/video interaction exit request is unidirectional exit, determining a path information group corresponding to the audio/video interaction identifier from the stored path information according to the audio/video interaction identifier carried by the audio/video interaction exit request; determining path information corresponding to the first terminal in the path information group as the second path information; and clearing the second path information, and continuing to perform audio-video interaction based on the path information in the path information group except the second path information.
For example, audio-video interaction is performed in three live broadcast rooms corresponding to the anchor user a, the anchor user B, and the anchor user C, and the audio-video interaction is marked as "1003". The flow control unit for managing the live broadcast room in which the anchor user B is located can store the path information associated with the anchor user A and the path information associated with the anchor user C corresponding to the audio-video interaction identifier '1003', and if the anchor user A initiates a one-way exit, the flow control unit corresponding to the anchor user B only clears the path information associated with the anchor user A corresponding to the audio-video interaction identifier '1003', and retains the path information associated with the anchor user C. Correspondingly, the flow control unit corresponding to the anchor user C also clears the path information associated with the anchor user a corresponding to the audio/video interaction identifier "1003", and retains the path information associated with the anchor user B. That is, the live rooms in which anchor user B and anchor user C are located still continue to perform audio-video interaction.
And in the second case, the exit type of the audio/video interactive exit request is a scattered exit.
If the second flow control unit determines that the exit type of the audio/video interaction exit request is a scattered exit, all path information in a path information group corresponding to the audio/video interaction identifier in the stored path information is determined as second path information according to the audio/video interaction identifier carried by the audio/video interaction exit request; and clearing the second path information, thereby finishing the audio-video interaction indicated by the audio-video interaction identifier.
Still taking the audio-video interaction scenario in the first case as an example, if the anchor user a initiates a dismissal audio-video interaction quitting request, the flow control unit corresponding to the anchor user B will completely remove all path information (path information associated with the anchor user a and path new information associated with the anchor user C) corresponding to the audio-video interaction identifier "1003". Accordingly, the flow control unit corresponding to the anchor user C will completely remove all path information (path information associated with the anchor user a and path new information associated with the anchor user B) corresponding to the audio-video interaction identifier "1003". That is, the live rooms in which anchor user a, anchor user B, and anchor user C are located all quit the current audio-video interaction. After exiting, the live broadcast in one live broadcast room can be continued in each live broadcast room, and the live broadcast in the live broadcast room can also be ended, which is not limited in this embodiment. Wherein, the current audio-video interaction refers to the audio-video interaction indicated by the audio-video identification.
It should be noted that, when only two live broadcast rooms perform audio-video interaction, one live broadcast room needs to quit the current audio-video interaction regardless of whether the live broadcast room quits in a unidirectional manner or in a decentralized manner. Therefore, in an embodiment, when only two live broadcast rooms perform audio-video interaction, only one exit function may be provided to the anchor user terminal in each live broadcast room, for example, only one exit option is provided in the audio-video interaction interface, so that any party can only initiate one exit request, and the one exit request is used to indicate that the current audio-video interaction is ended. In another embodiment, when only two live broadcast rooms perform audio-video interaction, a one-way quit and a decentralized quit, two quit functions, can be provided for the anchor user terminal of each live broadcast room as if the audio-video interaction is performed in more than two live broadcast rooms. And when the flow control unit receiving the audio/video interaction quit request detects that the number of the audio/video identifications corresponding to the audio/video interaction identification is 2, namely when only two live broadcast rooms are determined to carry out audio/video interaction, determining that the audio/video interaction quit request indicates to end the audio/video interaction corresponding to the audio/video interaction identification.
In addition, after the second flow control unit clears the second path information, an exit success message can be fed back to the first flow control unit, and the first flow control unit sends the exit success message to the terminal where the user is located and is associated with the first terminal through the first relay unit so as to prompt that the live broadcast room where the second terminal is located and is located of the user terminal associated with the first terminal knows that the first terminal exits the current audio-video interaction.
208. And the second flow control unit informs the second transfer unit of clearing the stored second path information.
In this embodiment, the second traffic control unit may further notify the second transit unit to clear the stored second path information, for example, the second traffic control unit may send a path information clearing instruction to the second transit unit, where the path information clearing instruction carries the audio-video interactive identifier and the audio-video identifier of the second terminal, so that the second transit unit determines the path information that needs to be cleared.
209. And the second transfer unit clears the stored second path information, sends an audio and video interaction updating message to the terminal where the user associated with the second terminal is located, and deletes the audio and video identification of the first terminal in the local live broadcast list by the terminal where the user associated with the second terminal is located.
And the second transfer unit determines the path information corresponding to the audio-video interactive identifier and the audio-video identifier of the second terminal from the stored path information as second path information and removes the second path information. After the second relay unit clears the second path information, the audio and video data of the second terminal will not be forwarded to the first relay unit any more subsequently, that is, the audio and video data of the second terminal will not be forwarded to the terminal where the user is located and associated with the first terminal through the first relay unit, for example, when the audio and video data of the second terminal is received by the second relay unit, whether the second path information of the first terminal is stored locally is detected, and if the second path information of the first terminal is not stored locally, the audio and video data of the second terminal is refused to be forwarded to the first relay unit.
The audio-video interaction updating message is used for prompting that the first terminal exits from the current audio-video interaction. The audio/video interactive update message can carry an audio/video interactive identifier and an audio/video identifier of the first terminal. The audio and video identification of the first terminal refers to the audio and video identification of a live broadcast room to which the first terminal belongs. And deleting the audio and video identification of the first terminal from the local live list by the terminal where the user associated with the second terminal is located according to the audio and video interaction identification and the audio and video identification of the first terminal. In order to distinguish the audiovisual interaction update message of step 204 from that of step 209, the audiovisual interaction update message of step 204 may be referred to as a first audiovisual interaction update message, and the audiovisual interaction update message of step 209 may be referred to as a second audiovisual interaction update message.
It should be noted that, in this embodiment, for any live broadcast room participating in audio/video interaction, a terminal where a user associated with the live broadcast room is located may all agree to participate in the audio/video interaction, and certainly, may also refuse to participate in the audio/video interaction. Therefore, the process of sending the audio/video interaction update message to the terminal where the user associated with the second terminal is located by the second transit unit may include the following two cases:
in the first case, the terminals where the users in the default live broadcast room are located agree to participate in the audio-video interaction.
In this case, the second relay unit determines a first user associated with the second terminal; and sending an audio and video interaction updating message to the terminal where the first user is located.
And in the second case, a terminal where the user who refuses to participate in the audio-video interaction exists.
In this case, the second relay unit determines a first user associated with the second terminal; determining users without the specified label in the first users as second users; and sending an audio and video interaction updating message to the terminal where the second user is located, wherein the designated tag is used for indicating the user to refuse to participate in the audio and video interaction of the second terminal.
It should be noted that, in the process of establishing the audio-video interaction, when the first terminal initiates an audio-video interaction request to the second terminal, if the second terminal user is a main broadcasting user, the audience user in the live broadcasting room where the second terminal is located may choose to participate in the audio-video interaction, or may refuse to participate in the audio-video interaction. For example, after step g, if any one of the first users refuses to participate in the audio-video interaction, the refusal update message may be sent to the second transit unit through the local terminal. If the second transfer unit receives the update rejection message of the terminal where the user is located, adding a designated tag for the user, so that the second transfer unit only sends the audio and video data of the second terminal to the terminal where the user is located and does not send the audio and video data of the first terminal to the terminal where the user is located in the process of audio and video interaction with the first terminal. In this case, the terminal where the user is located only displays the audio and video data of the second terminal, that is, only displays the video picture of the anchor user of the second terminal. The designated tag may be configured in advance to the second transit unit or the second traffic control unit by the policy server, which is not limited in this embodiment.
The foregoing steps 206 to 209 are processes of determining, by the second management device, the second terminal performing audio/video interaction with the first terminal when receiving the audio/video interaction exit request of the first terminal, clearing the second path information of the first terminal, and sending an audio/video interaction update message to the terminal where the user associated with the second terminal is located. In order to better perform the audio-video interactive exit process shown in the above steps 201 to 209, fig. 3 shows a signaling interaction diagram of an audio-video interactive exit flow.
It should be emphasized that, in the embodiment provided in fig. 2, the number of the second terminals may be one or more, and when the number of the second terminals is multiple, the first management device corresponding to the first terminal sends an audio/video interactive logout request to the second management device corresponding to each second terminal, that is, step 205 is executed for each second management device, and step 206 to step 209 are executed for each second management device to complete a corresponding logout procedure. When the audio-video interaction quitting request is unidirectional quitting, the corresponding second terminals still keep audio-video interaction among the plurality of second management devices after the plurality of second management devices finish corresponding quitting processes; when the quitting request is a scattered quitting, after the plurality of second management devices finish corresponding quitting processes, the plurality of second terminals do not perform audio and video interaction any more.
According to the method provided by the embodiment of the invention, when receiving the audio/video interaction quitting request of the first terminal, the first management device can determine the second management device associated with the second terminal according to the stored path information and send the audio/video interaction quitting request to the second management device, so that the second management device can inform the second terminal that the first terminal quits the current audio/video interaction. Moreover, the first management device can timely clear the first path information of the second terminal, so that the first management device cannot subsequently forward the audio and video data of the first terminal to the second terminal, and cannot forward the audio and video data of the second terminal to the first terminal, and therefore, each live broadcast room participating in audio and video interaction can smoothly complete a corresponding exit process.
Fig. 4 is a block diagram of an audio-video interaction apparatus according to an embodiment of the present invention. Referring to fig. 4, the apparatus includes a first determining module 401, a clearing module 402, and a first transmitting module 403.
The first determining module 401 is configured to determine, according to first path information when receiving an audio/video interaction exit request of a first terminal, a second management device, where the first path information is used to instruct that audio/video data of the first terminal is forwarded to a second terminal through the second management device, and the second terminal is a terminal performing audio/video interaction with the first terminal; a clearing module 402, configured to clear the first path information, so that the first management device subsequently stops forwarding the audio and video data of the first terminal to the second management device; the first sending module 403 is configured to send the audio/video interaction quit request to the second management device, and the second management device forwards the audio/video interaction quit request to the second terminal to prompt that the first terminal has quit the current audio/video interaction.
In one possible implementation manner, the first determining module is configured to:
determining the first path information corresponding to the audio-video interaction identifier from the stored path information according to the audio-video interaction identifier carried by the audio-video interaction exit request;
from the first path information, address information of the second management apparatus is extracted.
In one possible implementation manner, the first determining module is configured to:
determining the second terminal associated with the audio-video interaction identifier according to the audio-video interaction identifier carried by the audio-video interaction quit request;
determining first path information corresponding to the second terminal from the stored path information;
from the first path information, address information of the second management apparatus is extracted.
In a possible implementation manner, the exit type of the audio/video interaction exit request includes a one-way exit and a decentralized exit, the one-way exit is used for indicating that only the first terminal exits from the current audio/video interaction, and the decentralized exit is used for indicating that the current audio/video interaction is ended.
In one possible implementation, the apparatus further includes:
a second determining module for determining a first user associated with the first terminal; sending an audio and video interaction update message to the terminal where the first user is located, wherein the audio and video interaction update message is used for prompting that the first terminal exits from the current audio and video interaction; or the like, or, alternatively,
a third determining module, configured to determine a first user associated with the first terminal; determining users without the specified label in the first users as second users; and sending the audio-video interaction updating message to the terminal where the second user is located, wherein the appointed tag is used for indicating the user to refuse to participate in the audio-video interaction of the second terminal.
In one possible implementation, the apparatus further includes:
the detection module is used for detecting whether the first path information of the second terminal is stored locally or not if the audio and video data of the second terminal are received from the second management device;
and the second sending module is used for discarding the audio and video data of the second terminal if the first path information is not stored locally.
In one possible implementation, the apparatus further includes:
a third sending module, configured to send an audio/video interaction request message of the first terminal to a policy server, where the policy server determines the second management device, sends the audio/video interaction request message to the second management device, and the second management device returns the first path information;
the audio/video interaction request message carries second path information, and the second path information is used for indicating that audio/video data are forwarded to the first terminal through the first management device.
According to the device provided by the embodiment of the invention, when the first management device receives the audio/video interaction quitting request of the first terminal, the first management device can determine the second management device associated with the second terminal according to the stored path information and send the audio/video interaction quitting request to the second management device, so that the second management device can inform the second terminal that the first terminal quits the current audio/video interaction. Moreover, the first management device can timely clear the first path information of the second terminal, so that the first management device cannot subsequently forward the audio and video data of the first terminal to the second terminal, and cannot forward the audio and video data of the second terminal to the first terminal, and therefore, each live broadcast room participating in audio and video interaction can smoothly complete a corresponding exit process.
Fig. 5 is a block diagram of an audio-video interaction apparatus according to an embodiment of the present invention. Referring to fig. 5, the apparatus includes a determination module 501, a clearing module 502, and a first transmission module 503.
The device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining a second terminal which carries out audio and video interaction with a first terminal when receiving an audio and video interaction quit request of the first terminal from a first management device;
the clearing module is used for clearing stored second path information, and the second path information is used for indicating that audio and video data of the second terminal are forwarded to the first terminal through the first management device;
and the first sending module is used for sending an audio and video interaction updating message to the terminal where the user associated with the second terminal is located, wherein the audio and video interaction updating message is used for prompting that the first terminal exits from the current audio and video interaction.
In a possible implementation manner, the determining module 501 is configured to:
determining a plurality of audio-video identifiers corresponding to the audio-video interaction identifiers according to the audio-video interaction identifiers carried by the audio-video interaction quitting request;
and determining the terminal corresponding to the audio and video identifier managed by the second management device as the second terminal in the plurality of audio and video identifiers.
In one possible implementation, the clearing module 502 is configured to:
determining the exit type of the audio/video interactive exit request, wherein the exit type comprises one-way exit and decentralized exit;
if the exit type of the audio-video interaction exit request is unidirectional exit, determining a path information group corresponding to the audio-video interaction identifier from stored path information according to the audio-video interaction identifier carried by the audio-video interaction exit request;
determining path information corresponding to the first terminal in the path information group as the second path information;
and clearing the second path information, and continuing to perform audio-video interaction based on the path information in the path information group except the second path information.
In one possible implementation, the clearing module 502 is configured to:
if the exit type of the audio-video interactive exit request is a scattered exit, determining all path information in a path information group corresponding to the audio-video interactive identification in the stored path information as second path information according to the audio-video interactive identification carried by the audio-video interactive exit request;
and clearing the second path information to finish the audio-video interaction indicated by the audio-video interaction identifier.
In one possible implementation, the apparatus further includes:
the detection module is used for detecting whether the second path information is stored locally or not when the audio and video data of the second terminal are received;
and the second sending module is used for refusing to forward the audio and video data of the second terminal to the first management device if the second path information is not stored.
In one possible implementation, the apparatus further includes:
a third sending module, configured to send, when receiving an audio/video interaction request message from the policy server, an audio/video interaction update message to a terminal where a first user associated with the second terminal is located, where the audio/video interaction update message is used to indicate that the second terminal performs audio/video interaction with the first terminal;
the adding module is used for adding an appointed label for any one of the first users if the update rejection message of the user is received, wherein the appointed label is used for indicating the user to reject participating in the audio-video interaction of the first terminal;
and the fourth sending module is used for sending the audio and video data of the second terminal to the terminal where the user with the specified tag is located in the process of audio and video interaction with the first terminal.
According to the device provided by the embodiment of the invention, when the first management device receives the audio/video interaction quitting request of the first terminal, the first management device can determine the second management device associated with the second terminal according to the stored path information and send the audio/video interaction quitting request to the second management device, so that the second management device can inform the second terminal that the first terminal quits the current audio/video interaction. Moreover, the first management device can timely clear the first path information of the second terminal, so that the first management device cannot subsequently forward the audio and video data of the first terminal to the second terminal, and cannot forward the audio and video data of the second terminal to the first terminal, and therefore, each live broadcast room participating in audio and video interaction can smoothly complete a corresponding exit process.
It should be noted that: in the audio/video interaction device provided in the above embodiment, when a video is live, only the division of the above functional modules is used for illustration, and in practical application, the function distribution may be completed by different functional modules as needed, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the above described functions. In addition, the audio/video interaction device and the audio/video interaction method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.
The embodiment also provides a video live broadcast system, which comprises a first management device and a second management device,
the first management equipment is used for determining second management equipment according to first path information when receiving an audio and video interaction quit request of a first terminal, wherein the first path information is used for indicating that audio and video data of the first terminal are forwarded to a second terminal through the second management equipment, and the second terminal is a terminal performing audio and video interaction with the first terminal;
the first management device is further configured to clear the first path information, so that the first management device subsequently stops forwarding the audio and video data of the first terminal to the second management device;
the first management device is also used for sending the audio and video interaction quitting request to the second management device;
the second management device is used for determining a second terminal when receiving the audio/video interaction quitting request;
the second management device is further configured to clear stored second path information, where the second path information is used to instruct the first management device to forward the audio and video data of the second terminal to the first terminal;
the second management device is further configured to send an audio/video interaction update message to a terminal where a user associated with the second terminal is located, where the audio/video interaction update message is used to prompt that the first terminal has quitted the current audio/video interaction.
Fig. 6 is a block diagram of an audio-video interaction apparatus according to an embodiment of the present invention. For example, the apparatus 600 may be provided as a server. Referring to fig. 6, the apparatus 600 includes a processing component 622 that further includes one or more processors and memory resources, represented by memory 632, for storing instructions, such as applications, that are executable by the processing component 622. The application programs stored in memory 632 may include one or more modules that each correspond to a set of instructions. Further, the processing component 622 is configured to execute the instructions to perform the methods performed by the policy server, the first management device and the second management device in the above-described audio-video interaction method embodiments.
The apparatus 600 may also include a power component 626 configured to perform power management of the apparatus 600, a wired or wireless network interface 650 configured to connect the apparatus 600 to a network, and an input/output (I/O) interface 658. The apparatus 600 may operate based on an operating system, such as Windows Server, stored in the memory 632TM，Mac OS XTM，UnixTM,LinuxTM，FreeBSDTMOr the like.
In an exemplary embodiment, there is also provided a non-transitory computer readable storage medium, such as a memory, comprising instructions executable by a processor in a server to perform the audio-video interaction method in the above embodiments. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (18)

1. An audio-video interaction method is applied to a first management device, and comprises the following steps:
when an audio and video interaction quit request of a first terminal is received, extracting address information of second management equipment from first path information, wherein the first path information is used for indicating that audio and video data of the first terminal are forwarded to a second terminal through the second management equipment, and the second terminal is a terminal performing audio and video interaction with the first terminal;
clearing the first path information to enable the first management equipment to subsequently stop forwarding the audio and video data of the first terminal to the second management equipment;
and sending the audio and video interaction quitting request to the second management equipment according to the extracted address information of the second management equipment, and forwarding the audio and video interaction quitting request to the second terminal by the second management equipment so as to prompt the first terminal to quit the current audio and video interaction.
2. The method according to claim 1, wherein when receiving an audio-video interaction quitting request of a first terminal, determining a second management device according to the first path information comprises:
according to the audio and video interaction identification carried by the audio and video interaction quitting request, determining the first path information corresponding to the audio and video interaction identification from the stored path information; extracting address information of the second management device from the first path information; or the like, or, alternatively,
determining the audio/video identification of the second terminal associated with the audio/video interaction identification according to the audio/video interaction identification carried by the audio/video interaction quit request; according to the audio and video identification of the second terminal, determining first path information corresponding to the audio and video identification of the second terminal from the stored path information; extracting address information of the second management device from the first path information.
3. The method according to claim 1, wherein the exit types of the audio-video interaction exit request include a one-way exit and a dismissal exit, the one-way exit is used for indicating that only the first terminal exits the current audio-video interaction, and the dismissal exit is used for indicating that the current audio-video interaction is ended.
4. The method of claim 1, further comprising:
determining a first user associated with the first terminal; sending an audio and video interaction update message to the terminal where the first user is located, wherein the audio and video interaction update message is used for prompting that the first terminal exits from the current audio and video interaction; or the like, or, alternatively,
determining a first user associated with the first terminal; determining users without the specified label in the first users as second users; and sending the audio and video interaction updating message to the terminal where the second user is located, wherein the designated tag is used for indicating the user to refuse to participate in the audio and video interaction of the second terminal.
5. The method according to claim 1, wherein after the sending of the audio/video interaction quit request of the first terminal to the second management device, the method further comprises:
if the audio and video data of the second terminal are received from the second management device, detecting whether the first path information of the second terminal is stored locally;
and if the first path information is not stored locally, discarding the audio and video data of the second terminal.
6. The method of claim 1, further comprising:
sending an audio and video interaction request message of the first terminal to a policy server, determining the second management device by the policy server, sending the audio and video interaction request message to the second management device, and returning the first path information by the second management device;
the audio/video interaction request message carries second path information of the first terminal, and the second path information of the first terminal is used for indicating that audio/video data are forwarded to the first terminal through the first management device.
7. An audio-video interaction method is applied to a second management device, and comprises the following steps:
when an audio and video interaction quit request of a first terminal is received from a first management device, a second terminal performing audio and video interaction with the first terminal is determined;
clearing stored second path information, wherein the second path information is used for indicating that audio and video data of the second terminal are forwarded to the first terminal through the first management device;
and sending an audio and video interaction update message to a terminal where a user associated with the second terminal is located, wherein the audio and video interaction update message is used for prompting that the first terminal exits from the current audio and video interaction.
8. The method according to claim 7, wherein when receiving an audio/video interaction quit request of a first terminal from a first management device, determining a second terminal performing audio/video interaction with the first terminal comprises:
determining a plurality of audio-video identifiers corresponding to the audio-video interaction identifiers according to the audio-video interaction identifiers carried by the audio-video interaction quitting request;
and in the plurality of audio/video identifiers, determining a terminal corresponding to the audio/video identifier managed by the second management device as the second terminal.
9. The method of claim 7, wherein clearing the stored second path information comprises:
determining the exit type of the audio/video interactive exit request, wherein the exit type comprises one-way exit and decentralized exit;
if the exit type of the audio/video interaction exit request is unidirectional exit, determining a path information group corresponding to the audio/video interaction identifier from stored path information according to the audio/video interaction identifier carried by the audio/video interaction exit request; determining path information corresponding to the first terminal in the path information group as the second path information; clearing the second path information, and continuing to perform audio-video interaction based on the path information in the path information group except the second path information;
if the exit type of the audio/video interaction exit request is a scattered exit, determining all path information in a path information group corresponding to the audio/video interaction identifier in the stored path information as the second path information according to the audio/video interaction identifier carried by the audio/video interaction exit request; and clearing the second path information to finish the audio-video interaction indicated by the audio-video interaction identifier.
10. The method of claim 7, further comprising:
when receiving an audio and video interaction request message of the first terminal from a policy server, sending an audio and video interaction update message to a terminal where a first user associated with the second terminal is located, wherein the audio and video interaction update message is used for indicating the second terminal to perform audio and video interaction with the first terminal;
for any one of the first users, if a rejection update message of the user is received, adding a specified tag for the user, wherein the specified tag is used for indicating the user to reject participating in audio-video interaction of the first terminal;
and in the process of audio-video interaction with the first terminal, transmitting the audio-video data of the second terminal to the terminal where the user with the specified tag is located.
11. An audio-video interaction method, characterized in that the method comprises:
when a first management device receives an audio and video interaction quit request of a first terminal, extracting address information of a second management device from first path information, wherein the first path information is used for indicating that audio and video data of the first terminal are forwarded to a second terminal through the second management device, and the second terminal is a terminal performing audio and video interaction with the first terminal;
the first management equipment clears the first path information so that the first management equipment subsequently stops forwarding the audio and video data of the first terminal to the second management equipment;
the first management device sends the audio and video interaction quit request to the second management device according to the extracted address information of the second management device;
the second management equipment determines the second terminal when receiving the audio and video interaction quitting request;
the second management equipment clears the stored second path information, and the second path information is used for indicating that the audio and video data of the second terminal are forwarded to the first terminal through the first management equipment;
and the second management equipment sends an audio-video interaction updating message to a terminal where a user associated with the second terminal is located, wherein the audio-video interaction updating message is used for prompting that the first terminal exits from the current audio-video interaction.
12. An audio-video interaction device, applied to a first management device, the device comprising:
the device comprises a first determining module, a second determining module and a first management module, wherein the first determining module is used for extracting address information of second management equipment from first path information when receiving an audio and video interaction quit request of a first terminal, the first path information is used for indicating that audio and video data of the first terminal are forwarded to the second terminal through the second management equipment, and the second terminal is a terminal performing audio and video interaction with the first terminal;
the clearing module is used for clearing the first path information so as to enable the first management equipment to subsequently stop forwarding the audio and video data of the first terminal to the second management equipment;
and the first sending module is used for sending the audio and video interaction quitting request to the second management equipment according to the extracted address information of the second management equipment, and the second management equipment forwards the audio and video interaction quitting request to the second terminal so as to prompt the first terminal to quit the current audio and video interaction.
13. The apparatus according to claim 12, wherein the exit types of the av interaction exit request include a one-way exit and a de-centralized exit, the one-way exit is used to indicate that only the first terminal exits the current av interaction, and the de-centralized exit is used to indicate that the current av interaction is ended.
14. An audio-video interaction device, applied to a second management device, the device comprising:
the device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining a second terminal which carries out audio and video interaction with a first terminal when receiving an audio and video interaction quit request of the first terminal from a first management device;
the clearing module is used for clearing stored second path information, and the second path information is used for indicating that audio and video data of the second terminal are forwarded to the first terminal through the first management device;
and the first sending module is used for sending an audio and video interaction updating message to a terminal where a user associated with the second terminal is located, wherein the audio and video interaction updating message is used for prompting that the first terminal exits from the current audio and video interaction.
15. The apparatus of claim 14, wherein the purge module is configured to:
determining the exit type of the audio/video interactive exit request, wherein the exit type comprises one-way exit and decentralized exit;
if the exit type of the audio/video interaction exit request is unidirectional exit, determining a path information group corresponding to the audio/video interaction identifier from stored path information according to the audio/video interaction identifier carried by the audio/video interaction exit request; determining path information corresponding to the first terminal in the path information group as the second path information; clearing the second path information, and continuing to perform audio-video interaction based on the path information in the path information group except the second path information;
if the exit type of the audio/video interaction exit request is a scattered exit, determining all path information in a path information group corresponding to the audio/video interaction identifier in the stored path information as second path information according to the audio/video interaction identifier carried by the audio/video interaction exit request; and clearing the second path information, and finishing the audio-video interaction indicated by the audio-video interaction identifier.
16. A first management device, characterized in that it comprises a processor and a memory, in which at least one instruction is stored, which is loaded and executed by the processor to implement the audio-video interaction method according to any one of claims 1 to 6.
17. A second management device, characterized in that it comprises a processor and a memory, in which at least one instruction is stored, which is loaded and executed by the processor to implement the audio-video interaction method according to any one of claims 7 to 10.
18. A computer-readable storage medium having stored therein at least one instruction, which is loaded and executed by a processor, to implement the method of audio-video interaction according to any one of claims 1-11.
CN201710210887.0A 2017-03-31 2017-03-31 Audio and video interaction method and device, management equipment and storage medium Active CN108668152B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710210887.0A CN108668152B (en) 2017-03-31 2017-03-31 Audio and video interaction method and device, management equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710210887.0A CN108668152B (en) 2017-03-31 2017-03-31 Audio and video interaction method and device, management equipment and storage medium

Publications (2)

Publication Number Publication Date
CN108668152A CN108668152A (en) 2018-10-16
CN108668152B true CN108668152B (en) 2020-08-11

Family

ID=63784583

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710210887.0A Active CN108668152B (en) 2017-03-31 2017-03-31 Audio and video interaction method and device, management equipment and storage medium

Country Status (1)

Country Link
CN (1) CN108668152B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102307294A (en) * 2011-08-25 2012-01-04 中兴通讯股份有限公司 Method for participation of intelligent mobile terminal in video conference, terminal and system
CN102625078A (en) * 2012-03-08 2012-08-01 华为技术有限公司 Teleconference control method, terminal device, MCU (Multipoint Control Unit) and video system
CN103841353A (en) * 2014-02-24 2014-06-04 广州华多网络科技有限公司 Video interaction method, terminal, server and system
CN106027679A (en) * 2016-07-15 2016-10-12 中兴通讯股份有限公司 Implementing method, apparatus and system for video conference and cloud desktop terminal
CN106254899A (en) * 2016-08-16 2016-12-21 网宿科技股份有限公司 The control method of a kind of live even wheat and system
CN106454537A (en) * 2016-10-14 2017-02-22 广州华多网络科技有限公司 Live video streaming method and relevant equipment
CN106488169A (en) * 2015-08-28 2017-03-08 腾讯科技（深圳）有限公司 A kind of method of data transfer, system and relevant device
CN106488335A (en) * 2016-09-20 2017-03-08 北京小米移动软件有限公司 Live-broadcast control method and device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102105641B1 (en) * 2014-04-04 2020-04-29 한국전자통신연구원 Method and system for supporting videoconfernce in the distributed telepresence platform
US9560410B2 (en) * 2014-12-31 2017-01-31 Echostar Technologies L.L.C. Systems and methods for automatic resumption of video stream following transient WiFi disconnect

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102307294A (en) * 2011-08-25 2012-01-04 中兴通讯股份有限公司 Method for participation of intelligent mobile terminal in video conference, terminal and system
CN102625078A (en) * 2012-03-08 2012-08-01 华为技术有限公司 Teleconference control method, terminal device, MCU (Multipoint Control Unit) and video system
CN103841353A (en) * 2014-02-24 2014-06-04 广州华多网络科技有限公司 Video interaction method, terminal, server and system
CN106488169A (en) * 2015-08-28 2017-03-08 腾讯科技（深圳）有限公司 A kind of method of data transfer, system and relevant device
CN106027679A (en) * 2016-07-15 2016-10-12 中兴通讯股份有限公司 Implementing method, apparatus and system for video conference and cloud desktop terminal
CN106254899A (en) * 2016-08-16 2016-12-21 网宿科技股份有限公司 The control method of a kind of live even wheat and system
CN106488335A (en) * 2016-09-20 2017-03-08 北京小米移动软件有限公司 Live-broadcast control method and device
CN106454537A (en) * 2016-10-14 2017-02-22 广州华多网络科技有限公司 Live video streaming method and relevant equipment

Also Published As

Publication number Publication date
CN108668152A (en) 2018-10-16

Similar Documents

Publication Publication Date Title
CN108989264B (en) Live broadcast method, system and related equipment
CN108235042B (en) Multi-user network live broadcast method, device, joining device, system, server and computer readable storage medium
CN110213522B (en) Video data processing method and device and related equipment
EP3926917A1 (en) Data transmission method, device and computer storage medium
JP5902820B2 (en) Checking the integrity of content received by peers in a peer-to-peer content distribution system
US8037170B2 (en) Integrated application management system, apparatus and program, and integrated session management server, system, program and server chassis, and communication system, session management server and integration application server
US8203989B2 (en) Distributing content in a communication network
CN115664989A (en) Monitoring system and method of cloud desktop
CN111277544B (en) Communication method, system and related equipment
EP4096328A1 (en) Network function registration method and apparatus, network function discovery method and apparatus, and device and medium
CN112243224B (en) Edge computing network implementation method and device
CN108668151B (en) Audio and video interaction method and device
CN112217910B (en) Video service access method, device, network equipment and storage medium
CN113014672A (en) Message pushing method and device, electronic equipment and storage medium
CN108668140B (en) Audio and video interaction state synchronization method and device
CN108668152B (en) Audio and video interaction method and device, management equipment and storage medium
CN108259408B (en) Information transmission method, server and system
CN112511884B (en) Mixed flow control method, system and storage medium for audio and video flow
CN113115065B (en) Live broadcast-based data processing method and device
CN104780591A (en) Service interoperation implementation method between terminal equipment, device, system and related equipment
KR20210044566A (en) System and method for controlling multi-party video call using WebRTC
CN110730172A (en) Video conference realization method and device
CN115499712B (en) Multicast stream display method, device, medium and electronic equipment
WO2022267692A1 (en) Data processing method, file service system, terminal device, and storage medium
US8627505B2 (en) Technique for controlling access by a client entity to a service

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant