WO2022111401A1 - 一种连麦系统、方法、装置、设备及存储介质 - Google Patents
一种连麦系统、方法、装置、设备及存储介质 Download PDFInfo
- Publication number
- WO2022111401A1 WO2022111401A1 PCT/CN2021/131995 CN2021131995W WO2022111401A1 WO 2022111401 A1 WO2022111401 A1 WO 2022111401A1 CN 2021131995 W CN2021131995 W CN 2021131995W WO 2022111401 A1 WO2022111401 A1 WO 2022111401A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- lianmai
- terminal
- virtual room
- microphone
- invited
- Prior art date
Links
- 238000003860 storage Methods 0.000 title claims abstract description 13
- 230000004044 response Effects 0.000 claims abstract description 72
- 238000000034 method Methods 0.000 claims abstract description 56
- 241000209140 Triticum Species 0.000 claims description 49
- 235000021307 Triticum Nutrition 0.000 claims description 49
- 238000004891 communication Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 8
- 230000003993 interaction Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000001960 triggered effect Effects 0.000 description 3
- 240000000233 Melia azedarach Species 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000011437 continuous method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/043—Real-time or near real-time messaging, e.g. instant messaging [IM] using or handling presence information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1822—Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1083—In-session procedures
- H04L65/1093—In-session procedures by adding participants; by removing participants
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/185—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast with management of multicast group membership
Definitions
- the present disclosure relates to the field of data processing, and in particular, to a system, method, device, device and storage medium for connecting wheat.
- Lianmai has become a common form of live broadcast. Usually, Lianmai refers to the real-time communication and interaction between anchors or between anchors and viewers in a way similar to a video call.
- the efficiency of Lianmai is one of the important factors affecting the user experience of participating in Lianmai. Especially for the users who are invited to Lianmai, after actively clicking to accept the invitation of Lianmai, they look forward to entering the communication interface of Lianmai of both parties as soon as possible. Therefore, minimizing the waiting time of Lianmai invited users after accepting Lianmai invitation is one of the ways to improve the user's Lianmai experience.
- the user of the Lianmai invitee clicks to accept the Lianmai invitation they need to wait for the peer to enter the virtual room, and then push the audio and video stream from the peer to the real-time collaboration server before pulling the audio from the real-time collaboration server.
- the first frame of the video stream realizes the connection between the two parties.
- the present disclosure provides a system, method, device, device, and storage medium for connecting a microphone, which can improve the efficiency of connecting a microphone and reduce the number of users who are invited to accept a microphone.
- the waiting time after the invitation improves the user's experience of connecting to the microphone.
- the present disclosure provides a Lianmai system, the system includes a Lianmai business server, a Lianmai invitation terminal, and a Lianmai invited terminal;
- the connected microphone business server is used to return a response message carrying the virtual room identity to the connected microphone invitation terminal when receiving the connected microphone request from the connected microphone invitation terminal; wherein, the response message is used for Indicates that the reception of the Lianmai request is successful;
- the connecting microphone invitation terminal is configured to obtain the virtual room ID from the response message when receiving the response message, and enter the virtual room corresponding to the virtual room ID;
- the Lianmai invited terminal accepts the message for the Lianmai requested by the Lianmai, push audio and video streams to it;
- the Lianmai invited terminal is configured to pull the audio and video stream from the real-time collaboration server in response to the Lianmai accepting operation.
- the connected microphone service terminal is further configured to send a connected microphone invitation carrying the virtual room identity to the connected microphone invited terminal after receiving the connected microphone request. message; the Lianmai invitation message is used to request the Lianmai invited end to accept the Lianmai invitation;
- the Lianmai invited terminal is also used to obtain the virtual room ID from the Lianmai invitation message after receiving the Lianmai invitation message, and enter the virtual room corresponding to the virtual room ID .
- the Lianmai business server is further configured to, after receiving the Lianmai request, determine whether the Lianmai inviting end and the Lianmai invited end corresponding to the Lianmai request are in conformity with each other.
- the default version standard and when it is determined that both the Lianmai inviting terminal and the Lianmai invited terminal corresponding to the Lianmai request meet the preset version standard, execute the described return to the Lianmai inviting end to carry the virtual room ID Response message steps.
- the Lianmai business server is also used to send the Lianmai invited terminal to the Lianmai invited terminal when receiving a Lianmai acceptance message requested by the Lianmai invited terminal.
- the microphone connection state of the terminal and the microphone connection invite terminal is updated to the connected state, and the timing is started. Then, the connected microphone state of the connected microphone invited terminal or the connected microphone invited terminal is updated to an unconnected state.
- the Lianmai invite terminal is in a live broadcast state
- the Lianmai inviting terminal is specifically configured to, when receiving the Lianmai acceptance message requested by the Lianmai invited terminal for the Lianmai request, stop pushing the webcast traffic to the webcast server, and start to send the real-time collaboration service
- the terminal pushes audio and video streams.
- the present disclosure provides a method for connecting wheat, the method comprising:
- the Lianmai business server When the Lianmai business server receives the Lianmai request from the Lianmai inviter, it returns a response message carrying the virtual room identity to the Lianmai inviter; wherein, the response message is used to indicate that the Lianmai request is directed to the Lianmai request. If the reception is successful, the virtual room ID is used to make the Lianmai invite terminal enter the virtual room;
- the server terminal of the microphone-linking service When the server terminal of the microphone-linking service receives a microphone-linking acceptance message from the terminal that is invited to the microphone-linking terminal, it forwards the microphone-linking accepting message to the terminal that invites the microphone-linking terminal.
- the service terminal of the connected microphone service when the service terminal of the connected microphone service receives the connected microphone acceptance message requested by the connected microphone from the connected microphone terminal, it forwards the connected microphone acceptance message to the connected microphone.
- the Mai invitation before the Mai invitation, it also includes:
- the connected microphone service server After receiving the connected microphone request, the connected microphone service server sends a connected microphone invitation message carrying the virtual room ID to the connected microphone invited terminal; the connected microphone invitation message is used to request the connected microphone
- the invited terminal accepts the invitation of Lianmai, and the virtual room ID is used to make the invited terminal of Lianmai enter the virtual room.
- the method before returning the response message carrying the virtual room identity to the Lianmai inviting terminal, the method further includes:
- the Lianmai business server determines whether the Lianmai inviting terminal and the Lianmai invited terminal corresponding to the Lianmai request conform to the preset version standard;
- returning a response message carrying the virtual room ID to the Lianmai invite terminal includes:
- the method further includes:
- the connected microphone service server When the connected microphone service server receives the connected microphone acceptance message of the connected microphone requested by the connected microphone, it updates the connected microphone status of the connected microphone invited terminal and the connected microphone to the following: Connected and start timing;
- the Lianmai status of the Lianmai invited terminal and the Lianmai inviting terminal is updated to Not connected state.
- the present disclosure provides a method for connecting wheat, the method comprising:
- the Lianmai invite terminal After the Lianmai invite terminal sends the Lianmai request to the Lianmai service server, when receiving a response message for the Lianmai request, it obtains the virtual room ID from the response message, and enters the virtual room ID the corresponding virtual room;
- the Lianmai invitation terminal is in a live network state; before the audio and video streams are pushed to the real-time collaboration server, the method further includes:
- the present disclosure provides a method for connecting wheat, the method comprising:
- the Lianmai invited terminal After receiving the Lianmai invitation message, the Lianmai invited terminal obtains the virtual room ID from the Lianmai invitation message, and enters the virtual room corresponding to the virtual room ID; the Lianmai invitation message is used to request The Lianmai was invited to accept the invitation of Lianmai;
- the Lianmai invited terminal pulls audio and video streams from the real-time collaboration server after receiving the Lianmai invitation corresponding to the Lianmai invitation message.
- the present disclosure provides a wheat connecting device, the device comprising:
- the returning module is used to return a response message carrying the virtual room identity to the Lianmai inviting terminal when receiving the Lianmai request from the Lianmai inviter; wherein, the response message is used to indicate that the request for the Lianmai is directed to the Lianmai request If the reception is successful, the virtual room ID is used to make the Lianmai invite terminal enter the virtual room;
- the forwarding module is configured to forward the connected microphone acceptance message to the connected microphone invitation terminal when receiving the connected microphone acceptance message from the connected microphone invited terminal for the connected microphone request.
- the present disclosure provides a wheat connecting device, the device comprising:
- the first obtaining module is configured to obtain a virtual room identity from the response message after receiving a response message for the microphone connection request after sending the microphone connection request to the microphone connection service server;
- a first entry module used to enter the virtual room corresponding to the virtual room identification
- the push module is configured to push audio and video streams to the real-time collaboration server when receiving the Lianmai acceptance message requested by the Lianmai invited terminal for the Lianmai request.
- the present disclosure provides a wheat connecting device, the device comprising:
- the second obtaining module is used to obtain the virtual room identity from the Lianmai invitation message after receiving the Lianmai invitation message; the Lianmai invitation message is used to request the Lianmai invited terminal to accept the Lianmai invitation;
- the second entry module is used to enter the virtual room corresponding to the virtual room identification
- the pulling module is configured to pull the audio and video streams from the real-time collaboration server after receiving the Lianmai invitation corresponding to the Lianmai invitation message.
- the present disclosure provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer device, the computer device enables the computer device to implement the above method.
- the present disclosure provides a device comprising: a memory, a processor, and a computer program stored on the memory, and the processor implements the above method when executing the computer program.
- the embodiment of the present disclosure provides a connected microphone system.
- the connected microphone service server When receiving a connected microphone request, the connected microphone service server returns a response message carrying a virtual room ID to the connected microphone invitation terminal, so that the connected microphone invited terminal can enter the virtual room in advance.
- the Lianmai inviting end receives the Lianmai acceptance message from the Lianmai invited end, it pushes the audio and video streams to the real-time collaboration server, while the Lianmai invited end directly pulls the link from the real-time collaboration server when it receives the Lianmai acceptance operation. Take the audio and video stream to realize the connection between the two parties.
- the Lianmai invited terminal Since the Lianmai inviter has already entered the virtual room in advance when the Lianmai invited terminal receives the Lianmai acceptance operation, the Lianmai invited terminal does not need to wait for the peer to enter the virtual room, but pulls it directly after entering the virtual room.
- the first frame of the audio and video stream of the peer end is sufficient, which improves the efficiency of connecting to the microphone and improves the user's experience of connecting to the microphone.
- FIG. 1 is a schematic diagram of data interaction in the current webcasting mode of connecting microphones
- FIG. 2 is a signaling interaction diagram in which anchor A invites anchor B to connect to a microphone according to an embodiment of the present disclosure
- FIG. 3 is a schematic structural diagram of a wheat connection system provided by an embodiment of the present disclosure.
- FIG. 5 is a flowchart of another wheat-connecting method provided by an embodiment of the present disclosure.
- FIG. 6 is a flowchart of another wheat-connecting method provided by an embodiment of the present disclosure.
- FIG. 7 is a schematic structural diagram of a wheat connecting device according to an embodiment of the present disclosure.
- FIG. 8 is a schematic structural diagram of another wheat connecting device according to an embodiment of the present disclosure.
- FIG. 9 is a schematic structural diagram of another wheat connecting device according to an embodiment of the present disclosure.
- FIG. 10 is a schematic structural diagram of a wheat connecting device according to an embodiment of the present disclosure.
- FIG. 1 it is a schematic diagram of data interaction in the current network broadcast connection method.
- host A sends an invitation to host B to connect to the microphone.
- the server of the linked-to-mic service sends a notification message of linked-to-host A to host A, and carries the function The virtual room ID for entering the virtual room of Lianmai this time. That is to say, the host A can only enter the corresponding virtual room based on the virtual room ID at this time.
- anchor B can enter the virtual room when receiving a response message after clicking to accept the Lianmai invitation, and push audio and video streams and pull audio to the Real-Time Communications (RTC) server. video stream.
- RTC Real-Time Communications
- host B enters the virtual room earlier than host A. Therefore, host B needs to wait for host A to enter the virtual room before pulling the audio and video stream of host A, so as to realize the connection between the two parties.
- anchor B From the perspective of anchor B's experience, after anchor B takes the initiative to click to accept the invitation to connect to the microphone, he needs to wait for anchor A to enter the virtual room before he can pull the first frame of the audio and video of anchor A to realize the connection between the two parties, and the waiting time is obviously Affects anchor B's experience. Therefore, the inventor proposed an optimization scheme for Lianmai based on this.
- FIG. 2 a signaling interaction diagram in which an anchor A invites an anchor B to connect to a microphone according to an embodiment of the present disclosure.
- the server side of the link-mai service when receiving the request for connecting to the microphone from the host A, the server side of the link-mai service returns a response message carrying the virtual room ID to the host A, so that the host A can enter the virtual room in advance.
- anchor B accepts the invitation from anchor A, since anchor A has already entered the virtual room in advance, anchor B can pull the audio and video stream of anchor A without waiting for anchor A to enter the virtual room, which improves the efficiency of connecting microphones. , and also improved anchor B's microphone connection experience.
- an embodiment of the present disclosure provides a connected wheat system.
- a schematic structural diagram of a connected wheat system provided by an embodiment of the present disclosure is provided, wherein the connected wheat system includes a connected wheat service server 301, a connected wheat service Inviting terminal 302 and Lianmai invited terminal 303.
- the connected microphone service server 301 is configured to return a response message carrying the virtual room identity to the connected microphone invitation terminal when receiving the connected microphone request from the connected microphone invitation terminal; wherein, the response message uses Yu indicates that the reception of the request for connecting to the microphone is successful.
- the Lianmai request is used to request the Lianmai invited terminal to accept the Lianmai invitation from the Lianmai inviting terminal.
- the Lianmai inviting end sends a Lianmai request to the Lianmai business server to request the Lianmai invited end to accept the Lianmai invitation, and the Lianmai business server returns to the Lianmai inviter after receiving the Lianmai request.
- the response message is used to notify the Lianmai inviter that the request for the Lianmai has been successfully received.
- the Lianmai service server returns a request for Lianmai to the Lianmai inviting end.
- the virtual room ID used to enter the virtual room is carried in the response message.
- the virtual room identification may include a virtual room ID, virtual room verification information, etc., and a corresponding virtual room may be entered based on the virtual room identification.
- the connecting microphone invitation terminal 302 is configured to obtain the virtual room ID from the response message when receiving the response message, and enter the virtual room corresponding to the virtual room ID;
- the Lianmai invited terminal accepts the message for the Lianmai requested by the Lianmai, the audio and video streams are pushed to the real-time collaboration server.
- the microphone connection service server sends a response message to the microphone connection request to notify that the microphone connection request has been successfully received.
- the Lianmai invite terminal obtains the virtual room ID carried in the response message, and then enters the virtual room corresponding to the virtual room ID based on the virtual room ID.
- the inviting terminal of the connecting to the microphone can enter the virtual room corresponding to the current connection to the microphone in advance, so as to save the time of entering the room and improve the efficiency of the connection to the microphone.
- the Lianmai invite terminal may be in a live broadcast state, or may be in a non-live broadcast state, such as an online non-live broadcast state, and the like.
- the Lianmai inviting terminal when receiving the Lianmai acceptance message requested by the Lianmai invited terminal for the Lianmai request, it stops pushing the network live broadcast traffic to the network live broadcast server, And start to push audio and video streams to the real-time collaboration server. That is to say, when the Lianmai inviting end receives the Lianmai acceptance message of the Lianmai invited end, it starts to switch from the live broadcast state to the Lianmai state.
- both the Lianmai business server 301 and the web live broadcast server can be deployed on the live broadcast server, that is, the live broadcast server is used to realize the functions of the Lianmai business server 301 and the network live broadcast server; the Lianmai business server 301 and the network live broadcast server.
- the servers may also be deployed on independent servers, that is, using different servers to implement the functions of the Lianmai service server 301 and the web live broadcast server respectively.
- the embodiments of the present disclosure do not limit the deployment mode of the connected microphone service server 301 and the web live broadcast server.
- the server terminal of the microphone connection service after receiving the microphone connection request, forwards the request to the invited terminal of the microphone connection corresponding to the microphone connection request, and the invited terminal of the microphone connection service receives the microphone connection request. After the request, you can choose whether to accept the invitation to connect to the microphone this time.
- the Lianmai invited terminal accepts this Lianmai invitation, it will send a Lianmai acceptance message for the Lianmai request to the Lianmai service server, so as to notify the Lianmai business server to accept this Lianmai invitation.
- the Lianmai business server after receiving the Lianmai acceptance message from the Lianmai invited end, forwards the Lianmai acceptance message to the Lianmai inviter to inform it that the Lianmai invited end has accepted the Lianmai invitation.
- the Lianmai inviter is in the state of live webcasting, it is determined that the Lianmai invited end accepts the Lianmai invitation, disconnects the current webcast traffic, and starts to push audio and video streams to the real-time collaborative RTC server.
- the Lianmai invite terminal since the Lianmai inviter entered the virtual room of Lianmai in advance, after receiving the Lianmai acceptance message from the opposite end, it directly started to push audio and video streams to the RTC server, and pull Get the audio and video streams of the opposite end, and realize the microphone connection between the two parties. Therefore, if the Lianmai invite terminal enters the virtual room in advance, it can also reduce the time-consuming of the Lianmai invite terminal from receiving the Lianmai acceptance message from the peer end to pulling the first frame of the audio and video stream to the peer end, improving the Lianmai efficiency.
- the Lianmai invited terminal 303 is configured to pull the audio and video stream from the real-time collaboration server in response to the Lianmai accepting operation.
- the invited terminal of the connection after receiving the connection request forwarded by the connection service server, the invited terminal of the connection can enter the virtual room of this connection and push the request to the RTC server if the connection acceptance operation is triggered. Audio and video streams, as well as pull the audio and video streams of the opposite end from the RTC server, to achieve connected microphones. If the Lianmai rejection operation is triggered, a Lianmai rejection message will be returned to the Lianmai service server to notify it not to accept this Lianmai invitation.
- the Lianmai invited terminal 303 may be in a state of live webcasting, or may be in a state of non-webcasting, such as an online state of not livestreaming, and the like.
- the Lianmai invited terminal triggers the Lianmai accept operation
- the Lianmai inviter enters the virtual room in advance
- there is no need to wait for the Lianmai inviter to enter the virtual room which saves the Lianmai invited terminal from triggering the virtual room.
- the Lianmai invited end pushes the audio and video streams to the RTC server, and pulls the audio and video streams of the peer end, while the Lianmai inviting end pulls the audio and video streams of the Lianmai invited end after confirming that the peer end pushes the audio and video streams.
- the Lianmai inviting end pulls the audio and video streams of the Lianmai invited end after confirming that the peer end pushes the audio and video streams.
- video streams when both parties pull the audio and video streams of the opposite end, the connection between the two parties is realized.
- the Lianmai invited terminal if the Lianmai invited terminal is in a live webcast state, after the Lianmai invited terminal triggers the Lianmai accept operation, it first stops pushing the webcast traffic to the webcast server, and starts to send live webcast to the real-time server.
- the collaboration server pushes audio and video streams. That is to say, after the Lianmai invited terminal triggers Lianmai to accept the operation, it starts to switch from the live broadcast state to the Lianmai state.
- the Lianmai service server when receiving the Lianmai request, the Lianmai service server returns a response message carrying the virtual room ID to the Lianmai inviter, so that the Lianmai inviter can enter the virtual room in advance.
- the Lianmai inviting end receives the Lianmai acceptance message from the Lianmai invited end, it pushes the audio and video streams to the real-time collaboration server, while the Lianmai invited end directly pulls the link from the real-time collaboration server when it receives the Lianmai acceptance operation. Take the audio and video stream to realize the connection between the two parties.
- the Lianmai invited terminal Since the Lianmai inviter has already entered the virtual room in advance when the Lianmai invited terminal receives the Lianmai acceptance operation, the Lianmai invited terminal does not need to wait for the peer to enter the virtual room, but pulls it directly after entering the virtual room.
- the first frame of the audio and video stream of the peer end is sufficient, which improves the efficiency of connecting to the microphone and improves the user's experience of connecting to the microphone.
- the host B ie, the Lianmai invited terminal
- the Lianmai service server receives the Lianmai acceptance message
- return a response message to the live broadcast B for the received message, which is used to notify it that the message is successfully received.
- the response message carries the virtual room identification, and only when the anchor B receives the response message can enter the virtual room based on the virtual room identification in the response message. Obviously, it takes time for the anchor B to enter the virtual room after accepting the invitation of Lianmai. Based on this, the inventor proposes a further optimization scheme for Lianmai.
- the embodiment of the present disclosure can also make the invited terminal of Lianmai enter the virtual room in advance, so as to save the waiting time of the invited terminal of Lianmai after triggering Lianmai to accept the invitation, and improve the efficiency of Lianmai. For this reason, in the embodiment of the present disclosure, when the Lianmai service server receives the Lianmai request and sends a Lianmai invitation message to the Lianmai invitee, the ID of the virtual room is carried in the Lianmai invitation message, so that the Lianmai is invited.
- the inviting end When the inviting end receives the Lianmai invitation message, it can enter the virtual room in advance based on the virtual room ID it carries, which saves the Lianmai invited end's waiting time after triggering Lianmai to accept the invitation, and improves Lianmai's experience.
- invitational Lianmai experience When the inviting end receives the Lianmai invitation message, it can enter the virtual room in advance based on the virtual room ID it carries, which saves the Lianmai invited end's waiting time after triggering Lianmai to accept the invitation, and improves Lianmai's experience.
- Invitational Lianmai experience When the inviting end receives the Lianmai invitation message, it can enter the virtual room in advance based on the virtual room ID it carries, which saves the Lianmai invited end's waiting time after triggering Lianmai to accept the invitation, and improves Lianmai's experience.
- the connected microphone service server 301 is further configured to, after receiving the connected microphone request, send a connected microphone invitation message carrying the virtual room ID to the connected microphone invited terminal;
- the Mai invite message is used to request the Lian Mai invitee to accept the Lian Mai invitation.
- the Lianmai invitation message is obtained by the Lianmai service server adding the virtual room ID to the Lianmai request after receiving the Lianmai request from the Lianmai invitation terminal, and is used to indicate that the Lianmai invitation terminal is requested Accept Lianmai's invitation.
- the Lianmai invited terminal 303 is further configured to obtain the virtual room ID from the Lianmai invitation message after receiving the Lianmai invitation message, and enter the virtual room ID corresponding to the virtual room ID. Room.
- the Lianmai service server sends a Lianmai invitation message to anchor B
- the Lianmai invitation message carries a virtual room ID.
- anchor B can enter this session in advance based on the virtual room ID. In the virtual room, there is no need to wait for a long time to enter the room after anchor B triggers the connection to accept the operation, which improves the experience of anchor B.
- the Lianmai service server after receiving the Lianmai request from the Lianmai inviting terminal, the Lianmai service server first determines the Lianmai inviting end and the client of the Lianmai invited end corresponding to the Lianmai request. Whether the terminal version conforms to the preset version standard.
- the Lianmai service server 301 is further configured to, after receiving the Lianmai request, determine whether the Lianmai inviting terminal and the Lianmai invited terminal corresponding to the Lianmai request conform to the preset version standard, And when it is determined that the Lianmai inviting end and the Lianmai invited end corresponding to the Lianmai request meet the preset version standard, the step of returning a response message carrying the virtual room identity to the Lianmai inviting end is performed. .
- the Lianmai service server may obtain the client versions of the Lianmai inviting end and the Lianmai invited end respectively after receiving the Lianmai request. Set the version standard. If the default version standard is the highest version, a response message carrying the virtual room ID will be returned to the Lianmai invite terminal, so as to improve the success rate of Lianmai.
- the Lianmai business server saves the Lianmai state of the Lianmai inviting end and the Lianmai invited end, which may be used for various other services.
- the StartBattle service end needs to be called after the PK party pulls the audio and video streams of the other party. Before starting the PK, the StartBattle service end needs to check the microphone connection status of both parties. PK is only started when it is in the connected state.
- the Lianmai business server needs to obtain the Lianmai status of the Lianmai inviting terminal and the Lianmai invited terminal.
- the Lianmai inviter and the Lianmai invited end need to send a Lianmai notification message (join channel request) to the Lianmai business server to inform the Lianmai business server Ready to enter the virtual room to start connecting to the microphone.
- the connected microphone service server updates the connected microphone state of the client corresponding to the connected microphone notification message to the connected state, so as to ensure the successful execution of the above-mentioned PK service.
- the sending end of connecting wheat and the invited end of connecting wheat are sent to the business server of connecting wheat, and the connecting end and the invited end of connecting wheat will enter the connecting end of connecting wheat with the inviting end of connecting wheat and the invited end of connecting wheat.
- Virtual rooms are processed in parallel. That is, in the embodiment of the present disclosure, the Lianmai inviting terminal and the Lianmai invited terminal can enter the virtual room without sending a Lianmai notification message to the Lianmai service server before entering the virtual room.
- the Lianmai service server when the Lianmai service server receives the Lianmai acceptance message from the Lianmai invited end for the Lianmai request, it updates the Lianmai status of the Lianmai invited end and the Lianmai inviting end to the connected state, indicating that at this time. The two have been connected to the microphone, which does not affect the verification and other functions of other services in the connected microphone service server.
- the connected microphone service server starts timing. If it does not receive a connected microphone notification message from the invited terminal or the connected microphone invitation terminal within the preset time period, it will update the corresponding client's connected microphone status to the disconnected state. If the connected microphone notification message is sent, the connected microphone status of the client that sent the connected microphone notification message will be kept in the connected state.
- the Lianmai invited terminal and the Lianmai invite terminal only need to send the Lianmai notification message to the Lianmai service server within the preset time period from the start of the timer.
- the timing of sending the Lianmai notification message does not affect the Lianmai invited terminal and Lianmai invites the terminal to enter the virtual room, which improves the efficiency of Lianmai.
- the Lianmai service server 301 is further configured to send the Lianmai invited terminal to the Lianmai invited terminal when receiving the Lianmai accepting message for the Lianmai request.
- the microphone connection state of the terminal and the microphone connection invite terminal is updated to the connected state, and starts timing. Then, the connected microphone states of the connected microphone invited terminal and the connected microphone invited terminal are updated to the disconnected state.
- the present disclosure also provides a method for connecting wheat.
- FIG. 4 it is a flowchart of a method for connecting wheat according to an embodiment of the present disclosure. The method includes:
- the response message is used to indicate that the request for connecting to the microphone is successfully received, and the virtual room ID is used to make the inviting terminal of the connected microphone enter the virtual room.
- the Lianmai service server carries the virtual room ID in the response message of the Lianmai request, so that the Lianmai inviter can enter the virtual room in advance based on the virtual room ID, which saves the Lianmai invitation from receiving
- the time-consuming of the peer-to-peer link receiving the message to pulling the first frame of the audio and video on the opposite end improves the link-mic efficiency.
- the server of the connected to microphone service After receiving the request to connect to the microphone, the server of the connected to microphone service sends the connected to the microphone to the invited terminal of the connected to the microphone to send a connected to the microphone to invite the terminal that carries the virtual room identifier.
- the Lianmai invitation message is used to request the Lianmai invited terminal to accept the Lianmai invitation
- the virtual room ID is used to enable the Lianmai invited terminal to enter the virtual room.
- the Lianmai service server after receiving the Lianmai request, sends a Lianmai invitation message to the Lianmai invited terminal, so as to request the Lianmai invited terminal to accept the Lianmai invitation.
- the embodiment of the present disclosure carries a virtual room ID in the Lianmai invitation message, so that the Lianmai invited terminal can advance Entering the virtual room saves the time spent by the invited end of Lianmai from accepting Lianmai's invitation to pulling to the first frame of audio and video on the opposite end, and improves the efficiency of Lianmai.
- the invited terminal after receiving the request to connect to the microphone, in response to the user-triggered operation of accepting the connection to the microphone, the invited terminal sends a connection to the microphone to the microphone-connected service server. After accepting the message, it forwards the Lianmai acceptance message to the Lianmai inviter to inform the Lianmai inviter that the end-to-end Lianmai invitation has been accepted.
- the Lianmai inviting terminal since the Lianmai inviting terminal enters the virtual room in advance, the Lianmai invited terminal does not need to wait for the Lianmai inviting terminal to enter the virtual room after accepting the Lianmai invitation, but directly pulls the audio and video headers of the peer end.
- Frame the realization of two-way connection to the microphone, obviously improves the efficiency of the connection to the microphone, and also improves the user experience of the invited end of the connection to the microphone.
- the Lianmai service server After receiving the Lianmai request from the Lianmai inviting terminal, the Lianmai service server first determines the Lianmai inviting end and the client of the Lianmai invited end corresponding to the Lianmai request. Whether the terminal version conforms to the preset version standard.
- the Lianmai service server before the Lianmai service server returns a response message carrying the virtual room ID to the Lianmai inviting end, it can also determine whether the Lianmai inviting end and the Lianmai invited end corresponding to the Lianmai request meet the preset version standards. When it is determined that both the Lianmai inviting end and the Lianmai invited end corresponding to the Lianmai request meet the preset version standard, a response message carrying a virtual room identity is returned to the Lianmai inviting end. If one of the two does not meet the preset version standard, terminate the current connection to the microphone, and send a response message rejecting the connection to the microphone invitation terminal.
- the Lianmai inviting terminal and the Lianmai invited terminal send a Lianmai notification message to the Lianmai service server, and the Lianmai inviting terminal and the Lianmai invited terminal enter the Lianmai's Virtual rooms are processed in parallel.
- the Lianmai invited terminal and the Lianmai when receiving the Lianmai acceptance message requested by the Lianmai invited terminal for the Lianmai request, the Lianmai invited terminal and the Lianmai The microphone connection status of the inviting end is updated to the connected status, and the timing starts. If no communication notification message is received from the Lianmai invited terminal and the Lianmai inviting terminal within a preset time period, the Lianmai status of the Lianmai invited terminal and the Lianmai inviting terminal is updated to Not connected state.
- a flowchart of another wheat continuous method provided by the embodiment of the present disclosure includes:
- S502 When receiving the Lianmai acceptance message requested by the Lianmai invited terminal for the Lianmai request, push an audio and video stream to the real-time collaboration server, where the audio and video stream is pulled by the Lianmai invited terminal.
- the Lianmai inviting terminal when receiving the response message for the Lianmai request, can enter the corresponding virtual room in advance according to the virtual room ID in the response message.
- the Lianmai inviting terminal when receiving a Lianmai acceptance message requested by the Lianmai invited terminal for the Lianmai request, it first stops pushing the webcast traffic to the webcast server. Then start to push audio and video traffic to the RTC server to switch from the live broadcast state to the connected microphone state.
- the microphone connection method provided by the embodiment of the present disclosure can reduce the time-consuming of the connection microphone invitation terminal from receiving the connection microphone acceptance message to pulling the first frame of the audio and video stream of the peer end, improve the connection microphone efficiency, and improve the user connection microphone experience.
- the Lianmai invited terminal does not need to wait for the peer to enter the virtual room after triggering to accept the Lianmai invitation, which reduces the number of times that the Lianmai invited terminal triggers to accept the Lianmai invitation to pull
- the time-consuming to obtain the first frame of the audio and video stream of the peer end improves the efficiency of connecting to the microphone, and also improves the connected-mic experience of the invited end.
- a flowchart of another method for connecting wheat provided by the embodiment of the present disclosure includes:
- the Lianmai invited terminal After receiving the Lianmai invitation message, the Lianmai invited terminal obtains a virtual room ID from the Lianmai invitation message, and enters the virtual room corresponding to the virtual room ID; the Lianmai invitation message uses Accept the invitation of Lianmai at the invited end of the request.
- the Lianmai invited terminal since the Lianmai invited terminal has already entered the virtual room in advance when accepting this Lianmai's Lianmai invitation, the Lianmai invited terminal can directly push audio and video streams to the RTC server, and Pull the audio and video stream from the RTC server to realize the connection to the microphone.
- the Lianmai invitation message received by the Lianmai invited terminal carries the virtual room ID, so that the Lianmai invited terminal can enter the virtual room in advance based on the virtual room ID, and does not need to enter the virtual room at this time.
- the virtual room reduces the time spent by the invited end of Lianmai from triggering to accept the invitation of Lianmai to pulling the first frame of the audio and video stream to the peer end, improving the efficiency of Lianmai and the experience of being invited to Lianmai.
- a schematic structural diagram of a wheat connecting device provided in an embodiment of the present disclosure includes:
- Returning module 701 is configured to return a response message carrying a virtual room identity to the microphone-connecting terminal when receiving a request for connecting the microphones from the microphone-linking terminal; wherein, the response message is used to indicate that the request for the microphone-linking invites the terminal.
- the request is received successfully, and the virtual room ID is used to make the Lianmai invite terminal enter the virtual room;
- the forwarding module 702 is configured to forward the connected microphone acceptance message to the connected microphone invitation terminal when receiving the connected microphone acceptance message from the connected microphone invited terminal for the connected microphone request.
- the device further includes:
- the sending module is used to send a link-mai invitation message carrying the virtual room identity to the link-mai invited terminal after receiving the link-mai request;
- the terminal accepts the invitation from Lianmai, and the virtual room ID is used to enable the invited terminal of Lianmai to enter the virtual room.
- the device further includes:
- a determination module used to determine whether the Lianmai inviting terminal and the Lianmai invited terminal corresponding to the Lianmai request meet the preset version standard
- the return module is specifically used for:
- the device further includes:
- the first state update module is used to update the connected microphone states of the connected microphone invited terminal and the connected microphone invited terminal when receiving the connected microphone acceptance message requested by the connected microphone terminal for the connected microphone request. is connected and starts timing;
- the second state update module is configured to update the connected microphone invited terminal and the connected microphone when the connected microphone notification message from the connected microphone invited terminal and the connected microphone invited terminal is not received within a preset period of time.
- the microphone connection status of the inviting end is updated to the disconnected state.
- FIG. 8 a schematic structural diagram of another wheat-connecting device provided in an embodiment of the present disclosure includes:
- the first obtaining module 801 is configured to obtain a virtual room identity from the response message when receiving a response message for the microphone connection request after sending the microphone connection request to the microphone connection service server;
- the first entry module 802 is used to enter the virtual room corresponding to the virtual room ID;
- the push module 803 is configured to push audio and video streams to the real-time collaboration server when receiving the Lianmai acceptance message from the Lianmai invited terminal for the Lianmai request.
- the device further includes:
- the stop pushing module is configured to stop pushing the live web traffic to the web live broadcast server when receiving the link microphone acceptance message requested by the linked microphone terminal for the link microphone request.
- FIG. 9 a schematic structural diagram of another wheat-connecting device provided in an embodiment of the present disclosure includes:
- the second obtaining module 901 is configured to obtain the virtual room identity from the Lianmai invitation message after receiving the Lianmai invitation message; the Lianmai invitation message is used to request the Lianmai invited terminal to accept the Lianmai invitation;
- a second entry module 902 configured to enter the virtual room corresponding to the virtual room ID
- the pulling module 903 is configured to pull the audio and video streams from the real-time collaboration server after receiving the Lianmai invitation corresponding to the Lianmai invitation message.
- the Lianmai invited end since the Lianmai inviter has already entered the virtual room in advance when the Lianmai invited end receives the Lianmai acceptance operation, the Lianmai invited end does not need to wait for the opposite end to enter the virtual room, and After entering the virtual room, you can directly pull the first frame of the audio and video stream of the opposite end, which improves the efficiency of connecting to the microphone and improves the user's experience of connecting to the microphone.
- embodiments of the present disclosure also provide a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a terminal device, the terminal device is made to implement the present invention.
- the continuous wheat method described in the disclosed embodiments is disclosed.
- an embodiment of the present disclosure also provides a wheat connecting device, as shown in FIG. 10 , which may include:
- the number of processors 1001 in the connected microphone device may be one or more, and one processor is taken as an example in FIG. 10 .
- the processor 1001 , the memory 1002 , the input device 1003 and the output device 1004 may be connected by a bus or in other ways, wherein the connection by a bus is taken as an example in FIG. 10 .
- the memory 1002 can be used to store software programs and modules, and the processor 1001 executes various functional applications and data processing of the connected microphone device by running the software programs and modules stored in the memory 1002 .
- the memory 1002 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function, and the like. Additionally, memory 1002 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
- the input device 1003 can be used to receive input digital or character information, and generate signal input related to user setting and function control of the connecting microphone device.
- the processor 1001 loads the executable files corresponding to the processes of one or more application programs into the memory 1002 according to the following instructions, and the processor 1001 executes the executable files stored in the memory 1002 application, so as to realize various functions of the Lianmai device in the above-mentioned webcast.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Information Transfer Between Computers (AREA)
Abstract
本公开提供了一种连麦系统、方法、装置、设备及存储介质，连麦业务服务端在接收到连麦请求时，向连麦邀请端返回携带虚拟房间身份标识的响应消息，以便连麦邀请端能够提前进入虚拟房间。当连麦邀请端接收到连麦被邀端的连麦接受消息时推送音视频流至实时协作服务端，而连麦被邀端在接收到连麦接受操作时，直接从实时协作服务端拉取该音视频流，实现双方的连麦。由于连麦被邀端在接收到连麦接受操作时，连麦邀请方已经提前进入虚拟房间，因此，连麦被邀端无需等待对端进入虚拟房间，而是在进入虚拟房间后直接拉取对端的音视频流的首帧即可，提高了连麦的效率，也提升了用户的连麦体验。
Description
本公开要求于2020年11月25日提交中国国家知识产权局、申请号为202011335239.6、发明名称为“一种连麦系统、方法、装置、设备及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
本公开涉及数据处理领域，尤其涉及一种连麦系统、方法、装置、设备及存储介质。
在网络直播功能中，连麦已经成为一种常见的直播形式。通常，连麦是指主播之间或者主播和观众之间以类似视频电话的方式，实现实时通信互动。
连麦效率是影响参与连麦用户体验的重要因素之一，尤其是对连麦被邀端的用户，在主动点击接受连麦邀请之后，期待能够尽快进入双方连麦的通信交互界面。因此，尽量减少连麦被邀端的用户在接受连麦邀请后的等待时间，是提升用户连麦体验的途径之一。
目前，连麦被邀方的用户在点击接受连麦邀请后，需要等待对端进入虚拟房间，然后由对端向实时协作服务端推送音视频流之后，才能从实时协作服务端拉取到音视频流的首帧，实现双方的连麦。
显然，上述连麦方式连麦效率较低，导致连麦被邀方的用户在接受连麦邀请之后的等待时间较长，影响了用户的连麦体验。
发明内容
为了解决上述技术问题或者至少部分地解决上述技术问题，本公开提供了一种连麦系统、方法、装置、设备及存储介质，能够提高连麦效率，减少连麦被邀端的用户在接受连麦邀请后的等待时间，提升用户的连麦体验。
第一方面，本公开提供了一种连麦系统，所述系统包括连麦业务服务端、连麦邀请端和连麦被邀端；
所述连麦业务服务端，用于在接收到来自所述连麦邀请端的连麦请求时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息；其中，所述响应消息用于表示针对所述连麦请求接收成功；
所述连麦邀请端，用于在接收到所述响应消息时，从所述响应消息中获取所述虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间；以及，在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，向推送音视频流；
所述连麦被邀端，用于响应于连麦接受操作，从所述实时协作服务端拉取所述音视频流。
一种可选的实施方式中，所述连麦业务服务端，还用于在接收到所述连麦请求后，向所述连麦被邀端发送携带所述虚拟房间身份标识的连麦邀请消息；所述连麦邀请消息用于请求所述连麦被邀端接受连麦邀请；
所述连麦被邀端，还用于在接收到所述连麦邀请消息后，从所述连麦邀请消息中获取所述虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间。
一种可选的实施方式中，所述连麦业务服务端，还用于在接收到所述连麦请求后，确定所述连麦请求对应的连麦邀请端和连麦被邀端是否符合预设版本标准，并在确定所述连麦请求对应的连麦邀请端和连麦被邀端均符合所述预设版本标准时，执行所述向所述连麦邀请端返回携带虚拟房间身份标识的响应消息的步骤。
一种可选的实施方式中，所述连麦业务服务端，还用于在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦被邀端和所述连麦邀请端的连麦状态更新为已连接状态，并开始计时，如果在预设时长内未接收到来自所述连麦被邀端或所述连麦邀请端的连麦通知消息，则将所述连麦被邀端或所述连麦邀请端的连麦状态更新为未连接状态。
一种可选的实施方式中，所述连麦邀请端处于网络直播状态；
所述连麦邀请端，具体用于在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，停止向网络直播服务端推送网络直播流量，并开始向实时协作服务端推送音视频流。
第二方面，本公开提供了一种连麦方法，所述方法包括：
连麦业务服务端在接收到来自连麦邀请端的连麦请求时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息；其中，所述响应消息用于表示针对所述连麦请求接收成功，所述虚拟房间身份标识用于使所述连麦邀请端进入虚拟房间；
所述连麦业务服务端在接收到来自连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦接受消息转发至所述连麦邀请端。
一种可选的实施方式中，所述连麦业务服务端在接收到来自连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦接受消息转发至所述连麦邀请端之前，还包括：
所述连麦业务服务端在接收到所述连麦请求后，向连麦被邀端发送携带所述虚拟房间身份标识的连麦邀请消息；所述连麦邀请消息用于请求所述连麦被邀端接受连麦邀请，所述虚拟房间身份标识用于使所述连麦被邀端进入所述虚拟房间。
一种可选的实施方式中，所述向所述连麦邀请端返回携带虚拟房间身份标识的响应消息之前，还包括：
所述连麦业务服务端确定所述连麦请求对应的连麦邀请端和连麦被邀端是否符合预设版本标准；
相应的，所述向所述连麦邀请端返回携带虚拟房间身份标识的响应消息，包括：
在确定所述连麦请求对应的连麦邀请端和连麦被邀端均符合所述预设版本标准时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息。
一种可选的实施方式中，所述方法还包括：
所述连麦业务服务端在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦被邀端和所述连麦邀请端的连麦状态更新为已连接状态，并开始计时；
如果在预设时长内未接收到来自所述连麦被邀端和所述连麦邀请端的连麦通知消息，则将所述连麦被邀端和所述连麦邀请端的连麦状态更新为未连接状态。
第三方面，本公开提供了一种连麦方法，所述方法包括：
连麦邀请端向连麦业务服务端发送连麦请求后，在接收到针对所述连麦请求的响应消息时，从所述响应消息中获取虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间；
在接收到连麦被邀端针对所述连麦请求的连麦接受消息时，向实时协作服务端推送音视频流，所述音视频流供所述连麦被邀端拉取。
一种可选的实施方式中，所述连麦邀请端处于网络直播状态；所述向实时协作服务端推送音视频流之前，还包括：
在接收到连麦被邀端针对所述连麦请求的连麦接受消息时，停止向网络直播服务端推送网络直播流量。
第四方面，本公开提供了一种连麦方法，所述方法包括：
连麦被邀端在接收到连麦邀请消息后，从所述连麦邀请消息中获取虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间；所述连麦邀请消息用于请求所述连麦被邀端接受连麦邀请；
所述连麦被邀端在接收所述连麦邀请消息对应的连麦邀请后，从实时协作服务端拉取音视频流。
第五方面，本公开提供了一种连麦装置，所述装置包括：
返回模块，用于在接收到来自连麦邀请端的连麦请求时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息；其中，所述响应消息用于表示针对所述连麦请求接收成功，所述虚拟房间身份标识用于使所述连麦邀请端进入虚拟房间；
转发模块，用于在接收到来自连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦接受消息转发至所述连麦邀请端。
第六方面，本公开提供了一种连麦装置，所述装置包括：
第一获取模块，用于向连麦业务服务端发送连麦请求后，在接收到针对所述连麦请求的响应消息时，从所述响应消息中获取虚拟房间身份标识；
第一进入模块，用于进入所述虚拟房间身份标识对应的虚拟房间；
推送模块，用于在接收到连麦被邀端针对所述连麦请求的连麦接受消息时，向实时协作服务端推送音视频流。
第七方面，本公开提供了一种连麦装置，所述装置包括：
第二获取模块，用于在接收到连麦邀请消息后，从所述连麦邀请消息中获取虚拟房间身份标识；所述连麦邀请消息用于请求连麦被邀端接受连麦邀请；
第二进入模块，用于进入所述虚拟房间身份标识对应的虚拟房间；
拉取模块，用于在接收所述连麦邀请消息对应的连麦邀请后，从实时协作服务器拉取音视频流。
第八方面，本公开提供了一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，当所述指令在计算机设备上运行时，使得所述计算机设备实现上述的方法。
第九方面，本公开提供了一种设备，包括：存储器，处理器，及存储在所述存储器上的计算机程序，所述处理器执行所述计算机程序时，实现上述的方法。
本公开实施例提供的技术方案与现有技术相比具有如下优点：
本公开实施例提供了一种连麦系统，连麦业务服务端在接收到连麦请求时，向连麦邀请端返回携带虚拟房间身份标识的响应消息，以便连麦邀请端能够提前进入虚拟房间。当连麦邀请端接收到连麦被邀端的连麦接受消息时，推送音视频流至实时协作服务端，而连麦被邀端在接收到连麦接受操作时，直接从实时协作服务端拉取该音视频流，实现双方的连麦。
由于连麦被邀端在接收到连麦接受操作时，连麦邀请方已经提前进入虚拟房间，因此，连麦被邀端无需等待对端进入虚拟房间，而是在进入虚拟房间后直接拉取对端的音视频流的首帧即可，提高了连麦的效率，也提升了用户的连麦体验。
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本公开的实施例，并与说明书一起用于解释本公开的原理。
为了更清楚地说明本公开实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，对于本领 域普通技术人员而言，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为目前的网络直播中的连麦方式的数据交互示意图；
图2为本公开实施例提供的一种主播A邀请主播B连麦的信令交互图；
图3为本公开实施例提供的一种连麦系统的结构示意图；
图4为本公开实施例提供的一种连麦方法流程图；
图5为本公开实施例提供的另一种连麦方法流程图；
图6为本公开实施例提供的另一种连麦方法流程图；
图7为本公开实施例提供的一种连麦装置的结构示意图；
图8为本公开实施例提供的另一种连麦装置的结构示意图；
图9为本公开实施例提供的另一种连麦装置的结构示意图；
图10为本公开实施例提供的一种连麦设备的结构示意图。
为了能够更清楚地理解本公开的上述目的、特征和优点，下面将对本公开的方案进行进一步描述。需要说明的是，在不冲突的情况下，本公开的实施例及实施例中的特征可以相互组合。
在下面的描述中阐述了很多具体细节以便于充分理解本公开，但本公开还可以采用其他不同于在此描述的方式来实施；显然，说明书中的实施例只是本公开的一部分实施例，而不是全部的实施例。
在网络直播过程中，主播之间或者主播和观众之间经常以类似视频电话的方式，实现实时通信互动，也被称作连麦。
目前，网络直播的连麦方式中，连麦被邀端的用户在主动点击接受连麦邀请之后，需要等待的时间较长，影响用户的连麦体验。以主播之间的连麦为例，如图1所示，为目前的网络直播的连麦方式中的数据交互示意图。
其中，主播A向主播B发送连麦邀请，连麦业务服务端在接收到来自主播B的连麦接受消息后，向主播A发送连麦接受通知消息，并在连麦接受通知消息中携带用于进入本次连麦的虚拟房间的虚拟房间身份标识。也 就是说，主播A此时才能基于该虚拟房间身份标识进入对应的虚拟房间。但是，对于主播B而言，主播B在点击接受连麦邀请后接收到响应消息时即可进入虚拟房间，并向实时协作(Real-Time Communications；RTC)服务端推送音视频流以及拉取音视频流。显然，主播B相比于主播A更提前进入虚拟房间，因此，主播B需要等待主播A进入虚拟房间，才能拉取主播A的音视频流，从而实现双方的连麦。
从主播B的体验角度看，主播B在主动点击接受连麦邀请后，需要等待主播A进入虚拟房间，才能拉取到主播A的音视频首帧，实现双方的连麦，而等待的时间显然影响了主播B的体验。因此，发明人基于此提出了对连麦的优化方案。
如图2所示，为本公开实施例提供的一种主播A邀请主播B连麦的信令交互图。其中，连麦业务服务端在接收到主播A的连麦请求时，向主播A返回携带虚拟房间身份标识的响应消息，以便主播A能够提前进入虚拟房间。当主播B接受主播A的连麦邀请时，由于主播A已经提前进入了虚拟房间，所以主播B不需要等待主播A进入虚拟房间，即可拉取主播A的音视频流，提高了连麦效率，也提升了主播B的连麦体验。
基于此，本公开实施例提供了一种连麦系统，参考图3，为本公开实施例提供的一种连麦系统的结构示意图，其中，连麦系统包括连麦业务服务端301、连麦邀请端302和连麦被邀端303。
所述连麦业务服务端301，用于在接收到来自所述连麦邀请端的连麦请求时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息；其中，所述响应消息用于表示针对所述连麦请求接收成功。
本公开实施例中，连麦请求用于请求连麦被邀端接受连麦邀请端的连麦邀请。
实际应用中，连麦邀请端向连麦业务服务端发送连麦请求，以请求连麦被邀端接受连麦邀请，连麦业务服务端在接收到连麦请求后，向连麦邀请端返回响应消息，用于通知连麦邀请端针对该连麦请求已接收成功。
为了使得连麦邀请端能够提前进入虚拟房间，而不需要等待连麦被邀端接受邀请之后再进入虚拟房间，本公开实施例在连麦业务服务端向连麦 邀请端返回针对连麦请求的响应消息时，在该响应消息中携带用于进入虚拟房间的虚拟房间身份标识。
一种可选的实施方式中，虚拟房间身份标识可以包括虚拟房间ID和虚拟房间验证信息等，基于虚拟房间身份标识可以进入对应的虚拟房间。
所述连麦邀请端302，用于在接收到所述响应消息时，从所述响应消息中获取所述虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间；以及，在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，向实时协作服务端推送音视频流。
本公开实施例中，连麦邀请端在向连麦业务服务端发送连麦请求后，连麦业务服务端针对该连麦请求发送响应消息，以通知连麦请求被成功接收。而连麦邀请端在接收到该响应消息时，从该响应消息中获取携带的虚拟房间身份标识，然后基于该虚拟房间身份标识，进入该虚拟房间身份标识对应的虚拟房间。
为了提高连麦效率，连麦邀请端在从响应消息中获取到虚拟房间身份标识后，能够提前进入本次连麦对应的虚拟房间，以节省后续进入房间的耗时，提高连麦效率。
本公开实施例中的连麦邀请端可以处于网络直播状态，也可以处于非网络直播状态，如在线未直播状态等。
一种可选的实施方式中，如果连麦邀请端处于网络直播状态，则在接收到连麦被邀端针对连麦请求的连麦接受消息时，停止向网络直播服务端推送网络直播流量，并开始向实时协作服务端推送音视频流。也就是说，连麦邀请端在接收到连麦被邀端的连麦接受消息时，开始从网络直播状态切换为连麦状态。
实际应用中，连麦业务服务端301和网络直播服务端可以均部署于直播服务器上，即利用直播服务器实现连麦业务服务端301和网络直播服务端的功能；连麦业务服务端301和网络直播服务端也可以分别部署于独立的服务器上，即利用不同的服务器分别实现连麦业务服务端301和网络直播服务端的功能。本公开实施例不限定连麦业务服务端301和网络直播服务端的部署方式。
本公开实施例中，连麦业务服务端在接收到连麦请求后，将该连麦请求转发至该连麦请求对应的连麦被邀端，而连麦被邀端在接收到该连麦请求后，能够选择是否接收本次连麦邀请。
如果连麦被邀端接受本次连麦邀请，则向连麦业务服务端发送针对该连麦请求的连麦接受消息，以便通知连麦业务服务端接受本次连麦邀请。而连麦业务服务端在接收到来自连麦被邀端的连麦接受消息后，将该连麦接受消息转发至连麦邀请端，以通知其连麦被邀端已经接受本次连麦邀请。
此时，如果连麦邀请端处于网络直播状态，则在确定连麦被邀端接受本次连麦邀请，将当前的网络直播流量断开，并开始向实时协作RTC服务端推送音视频流。
另外，对于连麦邀请端而言，由于连麦邀请端提前进入了本次连麦的虚拟房间，在接收到对端的连麦接受消息后，直接开始推送音视频流至RTC服务端，以及拉取对端的音视频流，实现双方连麦即可。因此，连麦邀请端提前进入虚拟房间，也能够减少连麦邀请端从接收到对端的连麦接受消息到拉取到对端的音视频流首帧的耗时，提高了连麦效率。
所述连麦被邀端303，用于响应于连麦接受操作，从所述实时协作服务端拉取所述音视频流。
本公开实施例中，连麦被邀端在接收到连麦业务服务端转发的连麦请求之后，如果触发连麦接受操作，则可以进入本次连麦的虚拟房间，并向RTC服务端推送音视频流，以及从RTC服务端拉取对端的音视频流，实现连麦。如果触发连麦拒绝操作，则向连麦业务服务端返回连麦拒绝消息，以通知其不接受本次连麦邀请。
其中，连麦被邀端303可以处于网络直播状态，也可以处于非网络直播状态，如在线未直播状态等。
本公开实施例中，连麦被邀端在触发连麦接受操作后，由于连麦邀请端提前进入了虚拟房间，而无需等待连麦邀请端进入虚拟房间，节省了连麦被邀端从触发连麦接受操作到拉取到对端的音视频首帧的耗时，提高了连麦效率，也提升了连麦被邀端用户的体验。
实际应用中，连麦被邀端推送音视频流至RTC服务端，并拉取对端的 音视频流，而连麦邀请端在确定对端推送音视频流后，拉取连麦被邀端的音视频流，当双方均拉取到对端的音视频流时，即实现了双方的连麦。
一种可选的实施方式中，如果连麦被邀端处于网络直播状态，则在连麦被邀端触发连麦接受操作后，首先停止向网络直播服务端推送网络直播流量，并开始向实时协作服务端推送音视频流。也就是说，连麦被邀端在触发连麦接受操作后，开始从网络直播状态切换为连麦状态。
本公开实施例提供的连麦系统中，连麦业务服务端在接收到连麦请求时，向连麦邀请端返回携带虚拟房间身份标识的响应消息，以便连麦邀请端能够提前进入虚拟房间。当连麦邀请端接收到连麦被邀端的连麦接受消息时，推送音视频流至实时协作服务端，而连麦被邀端在接收到连麦接受操作时，直接从实时协作服务端拉取该音视频流，实现双方的连麦。
由于连麦被邀端在接收到连麦接受操作时，连麦邀请方已经提前进入虚拟房间，因此，连麦被邀端无需等待对端进入虚拟房间，而是在进入虚拟房间后直接拉取对端的音视频流的首帧即可，提高了连麦的效率，也提升了用户的连麦体验。
如图1所示，主播B(即连麦被邀端)在触发接受连麦邀请后，向连麦业务服务端发送连麦接受消息，连麦业务服务端在接收到该连麦接受消息后，向直播B返回针对该连麦接受消息的响应消息，用于通知其消息接收成功。其中，该响应消息中携带虚拟房间身份标识，在主播B接收到该响应消息时，才能够基于该响应消息中的虚拟房间身份标识进入虚拟房间。显然，主播B在接受本次连麦邀请后，自身进入虚拟房间也需要耗时，发明人基于此提出了对连麦的进一步优化方案。
具体的，本公开实施例还可以使得连麦被邀端提前进入虚拟房间，以节省连麦被邀端在触发连麦接受邀请后的等待耗时，提高连麦效率。为此，本公开实施例在连麦业务服务端接收到连麦请求后，向连麦被邀端发送连麦邀请消息时，在该连麦邀请消息中携带虚拟房间身份标识，以便连麦被邀端在接收到连麦邀请消息时，即可基于其携带的虚拟房间身份标识提前进入虚拟房间，节省了连麦被邀端在触发连麦接受邀请后的等待耗时，提升了连麦被邀端的连麦体验。
具体的，所述连麦业务服务端301，还用于在接收到所述连麦请求后，向所述连麦被邀端发送携带所述虚拟房间身份标识的连麦邀请消息；所述连麦邀请消息用于请求所述连麦被邀端接受连麦邀请。
本公开实施例中，连麦邀请消息是连麦业务服务端在接收到连麦邀请端的连麦请求后，将虚拟房间身份标识添加至连麦请求中得到的，用于表示请求连麦邀请端接受连麦邀请。
所述连麦被邀端303，还用于在接收到所述连麦邀请消息后，从所述连麦邀请消息中获取所述虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间。
如图2所示，连麦业务服务端在向主播B发送连麦邀请消息时，连麦邀请消息携带有虚拟房间身份标识，主播B此时可以基于该虚拟房间身份标识提前进入本次连麦的虚拟房间，无需在主播B触发连麦接受操作后耗时等待进入房间，提升了主播B的连麦体验。
另外，由于客户端的版本影响了连麦的成功率，通常较低版本的客户端可能导致连麦失败。因此，本公开实施例为了提高连麦的成功率，连麦业务服务端在接收到来自连麦邀请端的连麦请求后，首先确定连麦邀请端以及连麦请求对应的连麦被邀端的客户端版本是否符合预设版本标准。
具体的，所述连麦业务服务端301，还用于在接收到所述连麦请求后，确定所述连麦请求对应的连麦邀请端和连麦被邀端是否符合预设版本标准，并在确定所述连麦请求对应的连麦邀请端和连麦被邀端均符合所述预设版本标准时，执行所述向所述连麦邀请端返回携带虚拟房间身份标识的响应消息的步骤。
一种可选的实施方式中，连麦业务服务端可以在接收到连麦请求后，分别获取连麦邀请端和连麦被邀端的客户端版本，如果确定二者的客户端版本均符合预设版本标准，如预设版本标准为最高版本，则向连麦邀请端返回携带虚拟房间身份标识的响应消息，以提高连麦成功率。
另外，连麦业务服务端中保存有连麦邀请端和连麦被邀端的连麦状态，可能用于其他各种业务。例如，在PK场景下，需要PK一方拉取到另一方的音视频流后，调用StartBattle业务端，而StartBattle业务端在开始PK之 前，需要校验PK双方的连麦状态，只有在确定双方均为已连接状态时，才开始PK。
为此，连麦业务服务端需要获取到连麦邀请端和连麦被邀端的连麦状态。而图1的连麦方案中，在进入虚拟房间之前，连麦邀请端和连麦被邀端需要向连麦业务服务端发送连麦通知消息(join channel请求)，以告知连麦业务服务端已准备进入虚拟房间开始连麦。而连麦业务服务端在接收到连麦通知消息后，将该连麦通知消息对应的客户端的连麦状态更新为已连接状态，以保证如上述PK业务的成功执行。
本公开实施例中，为了提高连麦效率，将连麦邀请端和连麦被邀端向连麦业务服务端发送连麦通知消息，与连麦邀请端和连麦被邀端进入连麦的虚拟房间并行处理。即本公开实施例中连麦邀请端和连麦被邀端无需在进入虚拟房间之前，向连麦业务服务端发送连麦通知消息，即可进入虚拟房间。
相应的，连麦业务服务端在接收到连麦被邀端针对连麦请求的连麦接受消息时，将连麦被邀端和连麦邀请端的连麦状态更新为已连接状态，表示此时二者已连麦，不影响连麦业务服务端中其他业务的校验等功能。同时，连麦业务服务端开始计时，如果预设时长内未接收到来自被邀请端或连麦邀请端的连麦通知消息，则将对应的客户端的连麦状态更新为未连接状态，如果收到连麦通知消息，则将发送该连麦通知消息的客户端的连麦状态保持已连接状态。
可见，连麦被邀端和连麦邀请端只需要在计时开始的预设时长内向连麦业务服务端发送连麦通知消息即可，连麦通知消息的发送时机不影响连麦被邀端和连麦邀请端进入虚拟房间，提高了连麦的效率。
具体的，在上述连麦系统中，连麦业务服务端301，还用于在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦被邀端和所述连麦邀请端的连麦状态更新为已连接状态，并开始计时，如果在预设时长内未接收到来自所述连麦被邀端和所述连麦邀请端的连麦通知消息，则将所述连麦被邀端和所述连麦邀请端的连麦状态更新为未连接状态。
基于上述系统实施例，本公开还提供了一种连麦方法，参考图4，为 本公开实施例提供的一种连麦方法流程图，所述方法包括：
S401：连麦业务服务端在接收到来自连麦邀请端的连麦请求时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息。
其中，所述响应消息用于表示针对所述连麦请求接收成功，所述虚拟房间身份标识用于使所述连麦邀请端进入虚拟房间。
本公开实施例中，连麦业务服务端在连麦请求的响应消息中携带虚拟房间身份标识，以便连麦邀请端能够基于虚拟房间身份标识提前进入虚拟房间，节省了连麦邀请端从接收到对端的连麦接受消息到拉取到对端音视频首帧的耗时，提高了连麦效率。
S402：连麦业务服务端在接收到所述连麦请求后，向连麦被邀端发送携带所述虚拟房间身份标识的连麦邀请消息。
所述连麦邀请消息用于请求所述连麦被邀端接受连麦邀请，所述虚拟房间身份标识用于使所述连麦被邀端进入所述虚拟房间。
本公开实施例中，连麦业务服务端在接收到连麦请求后，向连麦被邀端发送连麦邀请消息，以请求连麦被邀端接受连麦邀请。
为了使得连麦被邀端也能够提前进入本次连麦的虚拟房间，本公开实施例在连麦邀请消息中携带有虚拟房间身份标识，以便连麦被邀端基于该虚拟房间身份标识，提前进入虚拟房间，节省了连麦被邀端从接受连麦邀请到拉取到对端音视频首帧的耗时，提高了连麦效率。
S403：连麦业务服务端在接收到来自连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦接受消息转发至所述连麦邀请端。
本公开实施例中，连麦被邀端在接收到连麦请求后，响应于用户触发的连麦接受操作，向连麦业务服务端发送连麦接受消息，当连麦业务服务端接收到连麦接受消息后，向连麦邀请端转发该连麦接受消息，以通知连麦邀请端对端已接受本次连麦邀请。
本公开实施例中，由于连麦邀请端提前进入虚拟房间，使得连麦被邀端在接受连麦邀请后，不需要等待连麦邀请端进入虚拟房间，而是直接拉取对端音视频首帧，实现双方连麦，显然提高了连麦效率，也提升了连麦被邀端的用户体验。
由于客户端的版本影响了连麦的成功率，通常较低版本的客户端可能导致连麦失败。因此，本公开实施例为了提高连麦的成功率，连麦业务服务端在接收到来自连麦邀请端的连麦请求后，首先确定连麦邀请端以及连麦请求对应的连麦被邀端的客户端版本是否符合预设版本标准。
具体的，连麦业务服务端向连麦邀请端返回携带虚拟房间身份标识的响应消息之前，还可以确定连麦请求对应的连麦邀请端和连麦被邀端是否符合预设版本标准。在确定所述连麦请求对应的连麦邀请端和连麦被邀端均符合所述预设版本标准时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息。如果二者之一不符合预设版本标准，则终止本次连麦，向连麦邀请端发送拒绝连麦的响应消息。
另外，为了提高连麦效率，本公开实施例将连麦邀请端和连麦被邀端向连麦业务服务端发送连麦通知消息，与连麦邀请端和连麦被邀端进入连麦的虚拟房间并行处理。
为此，本公开实施例中，连麦业务服务端在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦被邀端和所述连麦邀请端的连麦状态更新为已连接状态，并开始计时。如果在预设时长内未接收到来自所述连麦被邀端和所述连麦邀请端的连麦通知消息，则将所述连麦被邀端和所述连麦邀请端的连麦状态更新为未连接状态。
在上述实施例的基础上，本公开还提供了一种连麦方法，参考图5，为本公开实施例提供的另一种连麦方法流程图，所述方法包括：
S501：连麦邀请端向连麦业务服务端发送连麦请求后，在接收到针对所述连麦请求的响应消息时，从所述响应消息中获取虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间。
S502：在接收到连麦被邀端针对所述连麦请求的连麦接受消息时，向实时协作服务端推送音视频流，所述音视频流供所述连麦被邀端拉取。
本公开实施例中，连麦邀请端在接收到针对连麦请求的响应消息时，即可根据响应消息中的虚拟房间身份标识，提前进入对应的虚拟房间。
在接收到连麦被邀端针对连麦请求的连麦接受消息时，不需要此时再耗时进入虚拟房间，而是直接推送音视频流量至RTC服务端即可。
一种可选的实施方式中，连麦邀请端处于网络直播状态时，在接收到连麦被邀端针对连麦请求的连麦接受消息时，首先停止向网络直播服务端推送网络直播流量，然后开始向RTC服务端推送音视频流量，实现由网络直播状态切换为连麦状态。
本公开实施例提供的连麦方法能够减少连麦邀请端从接收到连麦接受消息到拉取对端音视频流首帧的耗时，提高连麦效率，提升用户连麦体验。
另外，由于连麦邀请端提前进入虚拟房间，所以，连麦被邀端在触发接受连麦邀请后，无需等待对端进入虚拟房间，减少了连麦被邀端在触发接受连麦邀请到拉取到对端音视频流首帧的耗时，提高了连麦效率，也提升了连麦被邀端的连麦体验。
在上述实施例的基础上，本公开还提供了一种连麦方法，参考图6，为本公开实施例提供的另一种连麦方法流程图，所述方法包括：
S601：连麦被邀端在接收到连麦邀请消息后，从所述连麦邀请消息中获取虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间；所述连麦邀请消息用于请求所述连麦被邀端接受连麦邀请。
S602：连麦被邀端在接收所述连麦邀请消息对应的连麦邀请后，从实时协作服务端拉取音视频流。
本公开实施例中，由于连麦被邀端在接受本次连麦的连麦邀请时，已经提前进入了虚拟房间，因此，连麦被邀端可以直接向RTC服务端推送音视频流，以及从RTC服务端拉取音视频流，实现连麦。
本公开实施例中，连麦被邀端接收到的连麦邀请消息中携带有虚拟房间身份标识，使得连麦被邀端可以基于虚拟房间身份标识，提前进入虚拟房间，无需此时耗时进入虚拟房间，减少了连麦被邀端在触发接受连麦邀请到拉取到对端音视频流首帧的耗时，提高了连麦效率，也提升了连麦被邀端的连麦体验。
与上述方法实施例基于同一个发明构思，本公开还提供了一种连麦装置，参考图7，为本公开实施例提供的一种连麦装置的结构示意图，所述装置包括：
返回模块701，用于在接收到来自连麦邀请端的连麦请求时，向所述 连麦邀请端返回携带虚拟房间身份标识的响应消息；其中，所述响应消息用于表示针对所述连麦请求接收成功，所述虚拟房间身份标识用于使所述连麦邀请端进入虚拟房间；
转发模块702，用于在接收到来自连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦接受消息转发至所述连麦邀请端。
一种可选的实施方式中，所述装置还包括：
发送模块，用于在接收到所述连麦请求后，向连麦被邀端发送携带所述虚拟房间身份标识的连麦邀请消息；所述连麦邀请消息用于请求所述连麦被邀端接受连麦邀请，所述虚拟房间身份标识用于使所述连麦被邀端进入所述虚拟房间。
一种可选的实施方式中，所述装置还包括：
确定模块，用于确定所述连麦请求对应的连麦邀请端和连麦被邀端是否符合预设版本标准；
相应的，所述返回模块，具体用于：
在确定所述连麦请求对应的连麦邀请端和连麦被邀端均符合所述预设版本标准时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息。
一种可选的实施方式中，所述装置还包括：
第一状态更新模块，用于在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦被邀端和所述连麦邀请端的连麦状态更新为已连接状态，并开始计时；
第二状态更新模块，用于在预设时长内未接收到来自所述连麦被邀端和所述连麦邀请端的连麦通知消息时，将所述连麦被邀端和所述连麦邀请端的连麦状态更新为未连接状态。
与上述方法实施例基于同一个发明构思，本公开还提供了一种连麦装置，参考图8，为本公开实施例提供的另一种连麦装置的结构示意图，所述装置包括：
第一获取模块801，用于向连麦业务服务端发送连麦请求后，在接收到针对所述连麦请求的响应消息时，从所述响应消息中获取虚拟房间身份标识；
第一进入模块802，用于进入所述虚拟房间身份标识对应的虚拟房间；
推送模块803，用于在接收到连麦被邀端针对所述连麦请求的连麦接受消息时，向实时协作服务端推送音视频流。
一种可选的实施方式中，所述装置还包括：
停止推送模块，用于在接收到连麦被邀端针对所述连麦请求的连麦接受消息时，停止向网络直播服务端推送网络直播流量。
与上述方法实施例基于同一个发明构思，本公开还提供了一种连麦装置，参考图9，为本公开实施例提供的另一种连麦装置的结构示意图，所述装置包括：
第二获取模块901，用于在接收到连麦邀请消息后，从所述连麦邀请消息中获取虚拟房间身份标识；所述连麦邀请消息用于请求连麦被邀端接受连麦邀请；
第二进入模块902，用于进入所述虚拟房间身份标识对应的虚拟房间；
拉取模块903，用于在接收所述连麦邀请消息对应的连麦邀请后，从实时协作服务端拉取音视频流。
本公开提供的连麦装置中，由于连麦被邀端在接收到连麦接受操作时，连麦邀请方已经提前进入虚拟房间，因此，连麦被邀端无需等待对端进入虚拟房间，而是在进入虚拟房间后直接拉取对端的音视频流的首帧即可，提高了连麦的效率，也提升了用户的连麦体验。
除了上述方法和装置以外，本公开实施例还提供了一种计算机可读存储介质，计算机可读存储介质中存储有指令，当所述指令在终端设备上运行时，使得所述终端设备实现本公开实施例所述连麦方法。
另外，本公开实施例还提供了一种连麦设备，参见图10所示，可以包括：
处理器1001、存储器1002、输入装置1003和输出装置1004。连麦设备中的处理器1001的数量可以一个或多个，图10中以一个处理器为例。在本公开的一些实施例中，处理器1001、存储器1002、输入装置1003和输出装置1004可通过总线或其它方式连接，其中，图10中以通过总线连接为例。
存储器1002可用于存储软件程序以及模块，处理器1001通过运行存储在存储器1002的软件程序以及模块，从而执行连麦设备的各种功能应用以及数据处理。存储器1002可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序等。此外，存储器1002可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。输入装置1003可用于接收输入的数字或字符信息，以及产生与连麦设备的用户设置以及功能控制有关的信号输入。
具体在本实施例中，处理器1001会按照如下的指令，将一个或一个以上的应用程序的进程对应的可执行文件加载到存储器1002中，并由处理器1001来运行存储在存储器1002中的应用程序，从而实现上述网络直播中的连麦设备的各种功能。
需要说明的是，在本文中，诸如“第一”和“第二”等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
以上所述仅是本公开的具体实施方式，使本领域技术人员能够理解或实现本公开。对这些实施例的多种修改对本领域的技术人员来说将是显而易见的，本文中所定义的一般原理可以在不脱离本公开的精神或范围的情况下，在其它实施例中实现。因此，本公开将不会被限制于本文所述的这些实施例，而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。
Claims (17)
- 一种连麦系统，其特征在于，所述系统包括连麦业务服务端、连麦邀请端和连麦被邀端；所述连麦业务服务端，用于在接收到来自所述连麦邀请端的连麦请求时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息；其中，所述响应消息用于表示针对所述连麦请求接收成功；所述连麦邀请端，用于在接收到所述响应消息时，从所述响应消息中获取所述虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间；以及，在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，向实时协作服务端推送音视频流；所述连麦被邀端，用于响应于连麦接受操作，从所述实时协作服务端拉取所述音视频流。
- 根据权利要求1所述的系统，其特征在于，所述连麦业务服务端，还用于在接收到所述连麦请求后，向所述连麦被邀端发送携带所述虚拟房间身份标识的连麦邀请消息；所述连麦邀请消息用于请求所述连麦被邀端接受连麦邀请；所述连麦被邀端，还用于在接收到所述连麦邀请消息后，从所述连麦邀请消息中获取所述虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间。
- 根据权利要求1所述的系统，其特征在于，所述连麦业务服务端，还用于在接收到所述连麦请求后，确定所述连麦请求对应的连麦邀请端和连麦被邀端是否符合预设版本标准，并在确定所述连麦请求对应的连麦邀请端和连麦被邀端均符合所述预设版本标准时，执行所述向所述连麦邀请端返回携带虚拟房间身份标识的响应消息的步骤。
- 根据权利要求1所述的系统，其特征在于，所述连麦业务服务端，还用于在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦被邀端和所述连麦邀请端的连麦状态更新为已连接状态，并开始计时，如果在预设时长内未接收到来自所述连 麦被邀端或所述连麦邀请端的连麦通知消息，则将所述连麦被邀端或所述连麦邀请端的连麦状态更新为未连接状态。
- 根据权利要求1所述的系统，其特征在于，所述连麦邀请端处于网络直播状态；所述连麦邀请端，具体用于在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，停止向网络直播服务端推送网络直播流量，并开始向实时协作服务端推送音视频流。
- 一种连麦方法，其特征在于，所述方法包括：连麦业务服务端在接收到来自连麦邀请端的连麦请求时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息；其中，所述响应消息用于表示针对所述连麦请求接收成功，所述虚拟房间身份标识用于使所述连麦邀请端进入虚拟房间；所述连麦业务服务端在接收到来自连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦接受消息转发至所述连麦邀请端。
- 根据权利要求6所述的方法，其特征在于，所述连麦业务服务端在接收到来自连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦接受消息转发至所述连麦邀请端之前，还包括：所述连麦业务服务端在接收到所述连麦请求后，向连麦被邀端发送携带所述虚拟房间身份标识的连麦邀请消息；所述连麦邀请消息用于请求所述连麦被邀端接受连麦邀请，所述虚拟房间身份标识用于使所述连麦被邀端进入所述虚拟房间。
- 根据权利要求6所述的方法，其特征在于，所述向所述连麦邀请端返回携带虚拟房间身份标识的响应消息之前，还包括：所述连麦业务服务端确定所述连麦请求对应的连麦邀请端和连麦被邀端是否符合预设版本标准；相应的，所述向所述连麦邀请端返回携带虚拟房间身份标识的响应消息，包括：在确定所述连麦请求对应的连麦邀请端和连麦被邀端均符合所述预设版本标准时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息。
- 根据权利要求6所述的方法，其特征在于，所述方法还包括：所述连麦业务服务端在接收到所述连麦被邀端针对所述连麦请求的连麦接受消息时，将所述连麦被邀端和所述连麦邀请端的连麦状态更新为已连接状态，并开始计时；如果在预设时长内未接收到来自所述连麦被邀端和所述连麦邀请端的连麦通知消息，则将所述连麦被邀端和所述连麦邀请端的连麦状态更新为未连接状态。
- 一种连麦方法，其特征在于，所述方法包括：连麦邀请端向连麦业务服务端发送连麦请求后，在接收到针对所述连麦请求的响应消息时，从所述响应消息中获取虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间；在接收到连麦被邀端针对所述连麦请求的连麦接受消息时，向实时协作服务端推送音视频流，所述音视频流供所述连麦被邀端拉取。
- 根据权利要求10所述的方法，其特征在于，所述连麦邀请端处于网络直播状态；所述向实时协作服务端推送音视频流之前，还包括：在接收到连麦被邀端针对所述连麦请求的连麦接受消息时，停止向网络直播服务端推送网络直播流量。
- 一种连麦方法，其特征在于，所述方法包括：连麦被邀端在接收到连麦邀请消息后，从所述连麦邀请消息中获取虚拟房间身份标识，并进入所述虚拟房间身份标识对应的虚拟房间；所述连麦邀请消息用于请求所述连麦被邀端接受连麦邀请；所述连麦被邀端在接收所述连麦邀请消息对应的连麦邀请后，从实时协作服务端拉取音视频流。
- 一种连麦装置，其特征在于，所述装置包括：返回模块，用于在接收到来自连麦邀请端的连麦请求时，向所述连麦邀请端返回携带虚拟房间身份标识的响应消息；其中，所述响应消息用于表示针对所述连麦请求接收成功，所述虚拟房间身份标识用于使所述连麦邀请端进入虚拟房间；转发模块，用于在接收到来自连麦被邀端针对所述连麦请求的连麦接 受消息时，将所述连麦接受消息转发至所述连麦邀请端。
- 一种连麦装置，其特征在于，所述装置包括：第一获取模块，用于向连麦业务服务端发送连麦请求后，在接收到针对所述连麦请求的响应消息时，从所述响应消息中获取虚拟房间身份标识；第一进入模块，用于进入所述虚拟房间身份标识对应的虚拟房间；推送模块，用于在接收到连麦被邀端针对所述连麦请求的连麦接受消息时，向实时协作服务端推送音视频流。
- 一种连麦装置，其特征在于，所述装置包括：第二获取模块，用于在接收到连麦邀请消息后，从所述连麦邀请消息中获取虚拟房间身份标识；所述连麦邀请消息用于请求连麦被邀端接受连麦邀请；第二进入模块，用于进入所述虚拟房间身份标识对应的虚拟房间；拉取模块，用于在接收所述连麦邀请消息对应的连麦邀请后，从实时协作服务端拉取音视频流。
- 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质中存储有指令，当所述指令在计算机设备上运行时，使得所述计算机设备实现如权利要求6-12任一项所述的方法。
- 一种设备，其特征在于，包括：存储器，处理器，及存储在所述存储器上的计算机程序，所述处理器执行所述计算机程序时，实现如权利要求6-12任一项所述的方法。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US18/254,426 US20240106772A1 (en) | 2020-11-25 | 2021-11-22 | Real time chat system and apparatus, device, and storage medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011335239.6 | 2020-11-25 | ||
| CN202011335239.6A CN114554129B (zh) | 2020-11-25 | 2020-11-25 | 一种连麦系统、方法、装置、设备及存储介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2022111401A1 true WO2022111401A1 (zh) | 2022-06-02 |
Family
ID=81660296
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2021/131995 WO2022111401A1 (zh) | 2020-11-25 | 2021-11-22 | 一种连麦系统、方法、装置、设备及存储介质 |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20240106772A1 (zh) |
| CN (1) | CN114554129B (zh) |
| WO (1) | WO2022111401A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023241575A1 (zh) * | 2022-06-16 | 2023-12-21 | 抖音视界(北京)有限公司 | 连麦建立方法、装置、设备、存储介质及程序产品 |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117294864A (zh) * | 2022-06-16 | 2023-12-26 | 抖音视界(北京)有限公司 | 消息处理方法、装置、通信设备、存储介质及程序产品 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108235042A (zh) * | 2016-12-14 | 2018-06-29 | 腾讯科技（深圳）有限公司 | 一种多人网络直播方法、装置、加入装置和系统 |
| CN108965932A (zh) * | 2017-05-17 | 2018-12-07 | 武汉斗鱼网络科技有限公司 | 一种连麦窗口展示方法及装置 |
| CN110267053A (zh) * | 2019-06-27 | 2019-09-20 | 广州酷狗计算机科技有限公司 | 直播方法、装置及系统 |
| CN111107441A (zh) * | 2018-10-25 | 2020-05-05 | 武汉斗鱼网络科技有限公司 | 一种连麦通信建立方法、存储介质、电子设备及系统 |
| CN111294622A (zh) * | 2020-02-13 | 2020-06-16 | 腾讯科技（深圳）有限公司 | 一种互动方法和相关装置 |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102118324B (zh) * | 2010-01-06 | 2015-11-25 | 腾讯科技（深圳）有限公司 | 邀请好友进入关联产品的方法及系统 |
| CN107846379B (zh) * | 2016-09-18 | 2021-09-07 | 中兴通讯股份有限公司 | 一种视频会议系统中端口复用方法和服务器 |
| CN106470343B (zh) * | 2016-09-29 | 2019-09-17 | 广州华多网络科技有限公司 | 直播视频流远程控制方法及装置 |
| US20180338119A1 (en) * | 2017-05-18 | 2018-11-22 | Visual Mobility Inc. | System and method for remote secure live video streaming |
| CN109640191A (zh) * | 2017-10-09 | 2019-04-16 | 武汉斗鱼网络科技有限公司 | 一种连麦直播的方法和装置 |
| US10462293B2 (en) * | 2017-10-16 | 2019-10-29 | Mobiline, Inc. | Personalized audio/video invitations for phone calls |
| CN107911707B (zh) * | 2017-11-08 | 2019-09-17 | 北京密境和风科技有限公司 | 一种基于直播的处理方法、装置及服务器 |
| CN110213609B (zh) * | 2019-06-12 | 2020-12-29 | 珠海读书郎网络教育有限公司 | 在网络教育直播中进行连麦直播的方法、装置及存储介质 |
| CN110708237A (zh) * | 2019-10-30 | 2020-01-17 | 北京字节跳动网络技术有限公司 | 消息交互方法、装置、可读介质及电子设备 |
| CN111372092B (zh) * | 2020-03-04 | 2022-03-04 | 北京字节跳动网络技术有限公司 | 通信链路建立方法、装置、设备及存储介质 |
| CN111836074B (zh) * | 2020-07-23 | 2022-09-09 | 北京达佳互联信息技术有限公司 | 一种连麦直播方法、装置、电子设备及存储介质 |
-
2020
- 2020-11-25 CN CN202011335239.6A patent/CN114554129B/zh active Active
-
2021
- 2021-11-22 US US18/254,426 patent/US20240106772A1/en active Pending
- 2021-11-22 WO PCT/CN2021/131995 patent/WO2022111401A1/zh active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108235042A (zh) * | 2016-12-14 | 2018-06-29 | 腾讯科技（深圳）有限公司 | 一种多人网络直播方法、装置、加入装置和系统 |
| CN108965932A (zh) * | 2017-05-17 | 2018-12-07 | 武汉斗鱼网络科技有限公司 | 一种连麦窗口展示方法及装置 |
| CN111107441A (zh) * | 2018-10-25 | 2020-05-05 | 武汉斗鱼网络科技有限公司 | 一种连麦通信建立方法、存储介质、电子设备及系统 |
| CN110267053A (zh) * | 2019-06-27 | 2019-09-20 | 广州酷狗计算机科技有限公司 | 直播方法、装置及系统 |
| CN111294622A (zh) * | 2020-02-13 | 2020-06-16 | 腾讯科技（深圳）有限公司 | 一种互动方法和相关装置 |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023241575A1 (zh) * | 2022-06-16 | 2023-12-21 | 抖音视界(北京)有限公司 | 连麦建立方法、装置、设备、存储介质及程序产品 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114554129B (zh) | 2023-10-31 |
| US20240106772A1 (en) | 2024-03-28 |
| CN114554129A (zh) | 2022-05-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022111401A1 (zh) | 一种连麦系统、方法、装置、设备及存储介质 | |
| US5854898A (en) | System for automatically adding additional data stream to existing media connection between two end points upon exchange of notifying and confirmation messages therebetween | |
| EP2342883B1 (en) | File transfer in conference services | |
| KR100752038B1 (ko) | 멀티미디어 회의를 위한 동적 멀티캐스트 트리의 알티피요소 선정 방법 | |
| US8249068B2 (en) | Method and apparatus for establishing multicast groups | |
| US5572582A (en) | Method and apparatus for establishing communication between two teleconferencing endpoints | |
| US20040088309A1 (en) | Method of constructing and managing overlay multicast tree on Internet | |
| TW201006289A (en) | Method, user equipment and software product for media stream transfer between devices | |
| WO2010108404A1 (zh) | 终端选择入会或控制终端选择入会的方法、设备及系统 | |
| WO2016119300A1 (zh) | 基于ims多方通话的信息同步方法、信息同步装置和终端 | |
| WO2011015020A1 (zh) | 文件传输方法、系统及客户端 | |
| WO2010102588A1 (zh) | 一种多媒体会议控制方法和系统 | |
| KR102324919B1 (ko) | 데이터 분배 방법 및 분배 서버 | |
| WO2020098712A1 (zh) | 数据传输通道的建立方法及设备、存储介质、系统 | |
| CN103188134A (zh) | 逻辑中转通信方法、逻辑中转服务器和逻辑中转通信系统 | |
| JP2020537454A5 (zh) | ||
| JPH10336176A (ja) | グループ通信方法及びシステム及びグループ通信プログラムを格納した記憶媒体 | |
| WO2022262670A1 (zh) | 一种连麦系统、方法、装置、设备及存储介质 | |
| CN114845124A (zh) | 基于WebSocket同步控制的机顶盒直播方法 | |
| JP2008153766A (ja) | データ中継装置 | |
| KR101180993B1 (ko) | ＰｏＣ 세션 대체를 위한 서버 및 클라이언트와 그 방법 | |
| WO2022262676A1 (zh) | 一种连麦系统、方法、装置、设备及存储介质 | |
| WO2019161721A1 (zh) | 一种基于互通rcs系统的对应关系处理方法及装置 | |
| WO2017045536A1 (zh) | 多方会话的处理方法及装置 | |
| CN113381990B (zh) | 一种点播终端之间互相通信的方法及系统 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21896902 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18254426 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 13.09.2023) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 21896902 Country of ref document: EP Kind code of ref document: A1 |