CN117278815A - Live broadcast connection method, device, equipment and medium - Google Patents

Live broadcast connection method, device, equipment and medium Download PDF

Info

Publication number
CN117278815A
CN117278815A CN202210667600.8A CN202210667600A CN117278815A CN 117278815 A CN117278815 A CN 117278815A CN 202210667600 A CN202210667600 A CN 202210667600A CN 117278815 A CN117278815 A CN 117278815A
Authority
CN
China
Prior art keywords
client
connection
invited
inviting
live
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210667600.8A
Other languages
Chinese (zh)
Inventor
刘桂东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Priority to CN202210667600.8A priority Critical patent/CN117278815A/en
Publication of CN117278815A publication Critical patent/CN117278815A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27Server based end-user applications
    • H04N21/274Storing end-user multimedia data in response to end-user request, e.g. network recorder
    • H04N21/2743Video hosting of uploaded data from client
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the disclosure relates to a live broadcast connection method, a device, equipment and a medium, wherein the method comprises the following steps: receiving a live connection request sent by an inviting client, sending live connection information to the invited client according to the live connection request, and sending a connection return information to the inviting client; receiving a converging request sent by an invited client and/or an inviting client after determining that the first connection establishment is successful and determining that the connection is agreed, converging two live broadcast data uploaded after the first connection establishment, and respectively returning the converging data after converging to the invited client and/or the inviting client for rendering and displaying; wherein the first establishment is for establishing a data connection between the inviting client and the invited client. The method and the device greatly reduce the time consumption of the first frame in the live broadcast connection process, and further improve the live broadcast connection experience effect of the user.

Description

Live broadcast connection method, device, equipment and medium
Technical Field
The disclosure relates to the technical field of live broadcasting, and in particular relates to a live broadcasting connection method, a live broadcasting connection device, live broadcasting connection equipment and a live broadcasting connection medium.
Background
With the continuous development of internet and live broadcast technologies, watching live broadcast has become an important entertainment mode. The live connection may be an interactive way between different anchor sites through real-time audio or real-time video calls.
In the related art, the live connection is usually realized by performing confluence display after the connection of the business process and the connection of the data dimension are established by the client where the two anchor are located, and the method causes that the initial frame of the live connection consumes longer time and has limited optimization space, so that the actual requirement cannot be met.
Disclosure of Invention
In order to solve the technical problems, the present disclosure provides a live connection method, a device, equipment and a medium.
The embodiment of the disclosure provides a live broadcast connection method, which is applied to a server and comprises the following steps:
receiving a live connection request sent by an inviting client, sending a live connection message to an invited client according to the live connection request, and sending a connection return message to the inviting client;
receiving a converging request sent by the invited client and/or the inviting client after determining that the first connection establishment is successful and determining that the connection is agreed, converging the two live broadcast data uploaded after the first connection establishment, and respectively returning the converging data after converging to the invited client and/or the inviting client for rendering and displaying;
wherein the first establishment is for establishing a data connection between the inviting client and the invited client.
The embodiment of the disclosure also provides a live connection method, which is applied to the invitation client and comprises the following steps:
the method comprises the steps of sending a live connection request to a server, enabling the server to send live connection information to an invited client according to the live connection request, and sending a connection return information to the inviting client;
receiving the connection return message, and initiating a first establishment connection with the invited client, wherein the first establishment connection is used for establishing a data connection between the inviting client and the invited client;
uploading live broadcast data of the invitation client after the first establishment success is determined, and sending a confluence request to the server after the connection agreement is determined, so that the server can confluence the two live broadcast data uploaded after the first establishment, and the confluence data after confluence is returned to the invitation client;
and receiving the confluence data and rendering and displaying.
The embodiment of the disclosure also provides a live connection method, which is applied to the invited client and comprises the following steps:
acquiring a live connection message sent by a server, and initiating a first establishment with an inviting client, wherein the first establishment is used for establishing a data connection between the inviting client and the invited client;
Uploading live broadcast data of the invited client after the first link establishment is determined to be successful, and sending a converging request to the server after the link agreement is determined, so that the server can converge the two live broadcast data uploaded after the first link establishment, and returning the converged converging data to the invited client;
and receiving the confluence data and rendering and displaying.
The embodiment of the disclosure also provides a live broadcast connection device, which is arranged at a server and comprises:
the request module is used for receiving a live connection request sent by the inviting client, sending a live connection message to the invited client according to the live connection request, and sending a connection return message to the inviting client;
the merging module is used for receiving a merging request sent by the invited client and/or the inviting client after the success of the first establishment and the consent to the connection are determined, merging the two live broadcast data uploaded after the first establishment, and respectively returning the merged merging data to the invited client and/or the inviting client for rendering and displaying;
wherein the first establishment is for establishing a data connection between the inviting client and the invited client.
The embodiment of the disclosure also provides a live connection device, which is arranged at the inviting client and comprises:
the sending module is used for sending the live connection request to the server side, so that the server side sends live connection information to the invited client side according to the live connection request and sends connection return information to the inviting client side;
the first initiating module is used for receiving the connection return message and initiating a first establishment connection with the invited client, wherein the first establishment connection is used for establishing a data connection between the inviting client and the invited client;
the first merging request module is used for uploading live broadcast data of the invitation client after the first establishment success is determined, sending a merging request to the server after the connection agreement is determined, enabling the server to merge the two live broadcast data uploaded after the first establishment, and returning the merged merging data to the invitation client;
and the first display module is used for receiving the confluence data and performing rendering display.
The embodiment of the disclosure also provides a live connection device, which is arranged at the invited client and comprises:
The second initiation module is used for acquiring a live connection message sent by the server and initiating a first establishment with the inviting client, wherein the first establishment is used for establishing a data connection between the inviting client and the invited client;
the second merging request module is used for uploading live broadcast data of the invited client after the first establishment success is determined, sending a merging request to the server after the connection agreement is determined, enabling the server to merge the two live broadcast data uploaded after the first establishment, and returning the merged merging data to the invited client;
and the second display module is used for receiving the confluence data and performing rendering display.
The embodiment of the disclosure also provides an electronic device, which comprises: a processor; a memory for storing the processor-executable instructions; the processor is configured to read the executable instructions from the memory and execute the instructions to implement a live connection method as provided in an embodiment of the disclosure.
The present disclosure also provides a computer-readable storage medium storing a computer program for executing the live wire method as provided by the embodiments of the present disclosure.
Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: according to the live connection scheme provided by the embodiment of the disclosure, a server receives a live connection request sent by an invitation client, sends live connection information to an invited client according to the live connection request, and sends a connection return information to the invitation client; receiving a converging request sent by an invited client and/or an inviting client after determining that the first connection establishment is successful and determining that the connection is agreed, converging two live broadcast data uploaded after the first connection establishment, and respectively returning the converging data after converging to the invited client and/or the inviting client for rendering and displaying; wherein the first establishment is for establishing a data connection between the inviting client and the invited client. By adopting the technical scheme, in the live broadcast connection process, the data can be converged after the data connection is successful and the two clients confirm to agree with the connection by advancing the time of the data convergence, the result of service connection is not required to be waited, the live broadcast data can be uploaded after the data connection is successful, the time of data uploading is also advanced, the optimization limit on the time consumption of the first frame in the converged data in the related technology is broken through, the time consumption of the first frame is greatly reduced, and the live broadcast connection experience effect of a user is further improved.
Drawings
The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.
Fig. 1 is a schematic flow chart of a live connection method according to an embodiment of the disclosure;
fig. 2 is a schematic diagram of live connection invitation provided in an embodiment of the disclosure;
fig. 3 is a schematic diagram of a live connection being invited according to an embodiment of the disclosure;
FIG. 4 is a schematic diagram of a live link in the related art;
fig. 5 is a schematic diagram of a live wire according to an embodiment of the present disclosure;
fig. 6 is a flowchart of another live connection method according to an embodiment of the disclosure;
fig. 7 is a flowchart of still another live connection method according to an embodiment of the disclosure;
fig. 8 is a schematic structural diagram of a live connection device according to an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of another live connection device according to an embodiment of the disclosure;
fig. 10 is a schematic structural diagram of still another live connection device according to an embodiment of the disclosure;
Fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.
It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.
It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.
The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
In order to solve the problem of time-consuming optimization of the first frame in the live connection scene in the related art, the embodiment of the disclosure provides a live connection method, and the method is described below with reference to specific embodiments.
Fig. 1 is a schematic flow chart of a live connection method provided in an embodiment of the present disclosure, where the method may be performed by a live connection device, and the device may be implemented by using software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 1, the method is applied to a server, and includes:
Step 101, receiving a live connection request sent by an inviting client, sending a live connection message to an invited client according to the live connection request, and sending a connection return message to the inviting client.
The live connection, also called live connection, can be an interactive mode realized by real-time audio or real-time video communication between different anchor or between anchor and audience, so as to form an interactive scene of multi-user participation. The live connection is realized by inviting, the inviting client can be the client where the user actively initiates live connection inviting in the live process, and can generate a live connection request and send the live connection request to the server. The invited client may be the client where the user is invited to live wire in the live process. For example, when the anchor a initiates a live connection invitation to the anchor B, the client where the anchor a is located is an inviting client, and the client where the anchor B is located is an invited client.
In the embodiment of the disclosure, an invitation client can send a live connection request to a server in response to a triggering operation of an invitation user in a live broadcast process, wherein the live connection request can comprise a live broadcast room identifier of the invitation client and a live broadcast room identifier of an invited client; the server side can receive the live connection request, send live connection information to the invited client side corresponding to the live broadcasting room identification of the invited client side according to the live connection request, and send connection return information to the inviting client side. The live link message may be used to notify the invited client of the invitation information of the live link, and the link return message may be used to notify the invited client of the invitation of the live link.
Fig. 2 is a schematic diagram of live connection invitation provided in an embodiment of the present disclosure, as shown in fig. 2, in which a live page 200 of an inviting client is shown, the live page 200 includes an invitation pop-up window 201 for live connection invitation, in which other users related to a current inviting user and an inviting component are shown in the invitation pop-up window 201, and an arrow on the inviting component of the user B indicates that the user B is invited to perform live connection. Optionally, a random connection component and a search component may be further displayed in the invitation popup window 201, where the random connection component is used to randomly select a user to perform live connection, and the search component is used to search for a user desiring to perform connection with live connection. Fig. 3 is an exemplary live wire invited schematic diagram provided in the embodiment of the present disclosure, as shown in fig. 3, which illustrates a live page 300 of an invited client, where an invitation popup window 301 of the invited live wire may be included in the live page 300, and relevant information, a rejecting component and an accepting component of the inviting user a may be shown in the invitation popup window 301, and when the invited user B triggers the rejecting component, the live wire invitation of the user a may be rejected; when the invited user B triggers the accepting component, a live wire invitation of user a may be accepted. The above-described fig. 2 and 3 are merely examples and are not limiting.
And 102, receiving a converging request sent by the invited client and/or the inviting client after determining that the first connection establishment is successful and determining that the connection is agreed, converging the two live broadcast data uploaded after the first connection establishment, and respectively returning the converging data after converging to the invited client and/or the inviting client for rendering and displaying.
The first establishment is used for establishing a data connection between the inviting client and the invited client, and the data connection can be understood as that two clients of the live connection push live data to the same data channel of the server, so that the two clients can pull live data of the other party to be merged for playing. The first link is used for realizing the transmission of live broadcast data, namely the transmission of live broadcast audio and video streaming data respectively corresponding to the inviting client and the invited client.
The determination of the success of the first establishment by the inviting client or the invited client may indicate that the inviting client or the invited client receives a first establishment success message sent by the server. The inviting client determines that the agreeing connection indicates that the inviting client knows that the invited client agrees to connect, namely the inviting client determines that the agreeing connection indicates that the inviting client receives a connection agreeing message of the invited client forwarded by the server; the determination of the consent connection by the invited client means that the invited client determines that the invited user accepts the live connection invitation, i.e. the determination of the consent connection by the invited client means that the invited client detects the connection consent triggering operation of the invited user.
The merge request may be a request for merging two live data of the inviting client and the invited client. The merging data may merge the two live data into a data stream, where the merging data may include a first frame, and the first frame may be a first frame of the invited client for the inviting client, and may be a first frame of the inviting client for the invited client.
Specifically, after receiving a converging request sent by the invited client after determining that the first connection establishment is successful and determining that the connection is agreed, the server does not need to wait for whether a second connection establishment of a service connection between the invited client and the invited client is successful, converging corresponding live data of the invited client and corresponding live data of the invited client uploaded after the first connection establishment, and returning the converging data to the invited client for rendering and displaying; similarly, the server side can send the merged merging data to the invitation client side for rendering and displaying aiming at the invitation client side, and the merging data can comprise a first frame. It can be appreciated that, since the inviting client and the invited client have different roles in each other, the merging data of the server for the inviting client and the merging data for the invited client may be different, so that live frames when rendering the presentation are different.
Because the live connection scene is inviting, the total duration from the live connection to the viewing of the first frame picture of the other party can be defined as the first frame duration based on the service requirement, and the first frame duration can be the duration from the receiving of the connection agreement message of the invited client to the first frame rendering display of the invited client; for the invited client, the first frame duration may be a duration of detecting that the connection agreement of the invited user triggers the first frame rendering presentation of the operation to the inviting client. In the scheme, the data confluence is executed in advance, the server can carry out the data confluence without waiting for the success of the service connection, and the inviting client and the invited client can carry out live broadcast data uploading and first frame display without waiting for the success of the service connection or the result of the success of the service connection, so that the first frame duration of the inviting client and the invited client can be greatly reduced.
It should be noted that, because the data push and the data merge are performed in advance, the inviting client and the invited client receive the first frame of the other party before the state is ready, and rendering is not performed at this time, that is, the inviting client may not perform rendering when receiving the first frame of the inviting client before receiving the connection agreement message, and does not perform rendering until receiving the connection agreement message; the invited client does not render until the invited user performs the connection consent trigger operation, and does not render until the invited user detects the connection consent trigger operation. The inviting client and the invited client render the locally existing live data when the state is ready, and the time consumption of the whole first frame is approximately equal to the time consumption of rendering the live data, for example, the time consumption of rendering the live data can be controlled to be about 300 milliseconds.
According to the live connection scheme provided by the embodiment of the disclosure, a server receives a live connection request sent by an invitation client, sends live connection information to an invited client according to the live connection request, and sends a connection return information to the invitation client; receiving a converging request sent by an invited client and/or an inviting client after determining that the first connection establishment is successful and determining that the connection is agreed, converging two live broadcast data uploaded after the first connection establishment, and respectively returning the converging data after converging to the invited client and/or the inviting client for rendering and displaying; wherein the first establishment is for establishing a data connection between the inviting client and the invited client. By adopting the technical scheme, in the live broadcast connection process, the data can be converged after the data connection is successful and the two clients confirm to agree with the connection by advancing the time of the data convergence, the result of service connection is not required to be waited, the live broadcast data can be uploaded after the data connection is successful, the time of data uploading is also advanced, the optimization limit on the time consumption of the first frame in the converged data in the related technology is broken through, the time consumption of the first frame is greatly reduced, and the live broadcast connection experience effect of a user is further improved.
In some embodiments, before the step 102, the live wire method may further include: and executing a first establishment between the inviting client and the invited client, and executing a second establishment between the inviting client and the invited client in parallel, wherein the second establishment is used for establishing a service connection line between the inviting client and the invited client.
The service connection established by the second connection establishment can be understood as that two clients of the live connection are added with the same service channel in the connection process, so that a service party can realize corresponding service data display or additional operation and the like according to service requirements. The second build-up is used for other data than live data, for example advertising data of the business party etc. can be added.
Specifically, after receiving the live connection request sent by the inviting client and sending the live connection message and the connection return message to the invited client and the inviting client, the server may execute the first connection establishment and the second connection establishment between the inviting client and the invited client in parallel. In the embodiment of the present disclosure, the first establishment and the second establishment may be performed by one server; the service end may also include two service ends, a data service end and a service end, the data service end executes the first connection establishment, the data service end is an instant connection (Real Time Connection, RTC) service end, and the service end executes the second connection establishment. According to the scheme, the time of the data connection is advanced, the data connection and the service connection are executed in parallel, and the service end can merge the data without waiting for the success of the service connection, so that the time consumption of the first frame in merged data is greatly reduced.
In an embodiment of the present disclosure, performing a first association between an inviting client and an invited client may include: receiving a first joining request sent by the inviting client according to the online return message and a second joining request sent by the invited client according to the live online message; joining the inviting client and the invited client to the same data channel, and returning a first successful message of establishing connection to the inviting client and the invited client. The first joining request is a request for the inviting client to initiate a first association, and the second joining request is a request for the invited client to initiate a first association.
Specifically, after obtaining the connection return message, the inviting client may send a first joining request to the server; the invited client can send a second joining request to the server after receiving the live connection message; the server side can receive the first joining request and the second joining request, create a data channel, join the inviting client side and the invited client side into the data channel, and the joining is successful to realize the first establishment, and then return a first establishment success message to the inviting client side and the invited client side so that the inviting client side and the invited client side can acquire that the first establishment is successful.
In some embodiments, the first join request and the second join request each include authentication information, the authentication information of the invited client being sent by adding to the live wire message, the authentication information of the inviting client being sent by adding to the wire return message. The authentication information may represent a Token (Token), which may be information used in the data connection process to authenticate and verify between the inviting client and the invited client. When the server side performs the first connection between the inviting client side and the invited client side, two pieces of verification information in the first joining request and the second joining request can be extracted, mutual verification is performed, and if the verification is passed, the inviting client side and the invited client side can be joined into the same data channel. According to the scheme, the verification of the verification information is carried out during the first establishment, so that the safety and reliability of the data establishment are improved.
In some embodiments, after performing the first association between the inviting client and the invited client, the live wire method may further include: and acquiring two live broadcast data sent after the invitation client and the invited client receive the first establishment success message, wherein the two live broadcast data comprise live broadcast data corresponding to the invitation client and live broadcast data corresponding to the invited client. After receiving the first successful establishment message, the inviting client and the invited client determine that the first establishment with the opposite party is successful, and can send own live broadcast data to the server and store the live broadcast data under the data channel for subsequent use, wherein the live broadcast data can be multimedia data in the live broadcast process, other related data and the like.
In the scheme, the inviting client and the invited client can push the stream in advance after the successful data connection without waiting for the successful service connection, and the time for uploading the data is advanced, so that the time consumption of the first frame of the live connection can be reduced subsequently.
In an embodiment of the present disclosure, performing the second association between the inviting client and the invited client may include: receiving a connection agreement message sent by the invited client and forwarding the connection agreement message to the inviting client; receiving a third joining request sent by the invited client and a fourth joining request sent by the inviting client after receiving the connection agreement message; the inviting client and the invited client are joined to the same traffic channel. The third joining request is a request for the invited client to initiate the second association, and the fourth joining request is a request for the inviting client to initiate the second association.
Specifically, after detecting the connection agreement triggering operation of the invited user, the invited client may send a connection agreement message to the server, and the server may send the connection agreement message to the inviting client after receiving the connection agreement message, and send a reply notification to the invited client; after receiving the reply notification sent by the server, the invited client can send a third joining request to the server; after receiving the connection agreement message, the inviting client can send a fourth joining request to the server; the server may receive the third joining request and the fourth joining request, then create a service channel, join the inviting client and the invited client to the service channel, and establish the second establishment after successful joining.
According to the scheme, the data connection and the service connection are executed in parallel, and the service end can merge the data without waiting for the success of the service connection, so that the time consumption of the first frame in merged data is greatly reduced.
In some embodiments, the live wire method may further include: when it is determined that the second establishment fails, the first establishment is interrupted.
Specifically, the server may also interrupt the first association when determining that the second association between the inviting client and the invited client fails, i.e. when the inviting client and the invited client fail to join the same traffic channel. The interrupting the first connection may include stopping the merging operation of the two live data of the inviting client and the invited client, sending a push stopping notification to the inviting client and the invited client, so that the inviting client and the invited client stop sending live data, and exiting the inviting client and the invited client from the same data channel, so that neither the inviting client nor the invited client can pull live data of the other party.
Alternatively, when a connection cancellation request sent by the inviting client is received, the first connection establishment may be interrupted when a connection rejection message sent by the invited client is received.
The online cancellation request may be a request that the inviting client actively performs live online invitation cancellation based on online cancellation operation of the inviting user after sending the live online request, that is, the inviting user actively cancels live online invitation. The connection rejection message may be a message that the invited client performs live connection rejection based on the connection rejection operation of the invited user after receiving the live connection message, that is, the invited user actively rejects live connection invitation.
When receiving a connection money cancellation request actively sent by an invitation client, the server can confirm that an inviting user wants to cancel the connection invitation, and can interrupt the first connection establishment at the moment; or when the server receives the connection rejection message sent by the invited client, the server can determine that the invited user does not wish to conduct live connection, and at the moment, the server can interrupt the first connection establishment and notify the invited client.
In the above scheme, since the second establishment and the first establishment are executed in parallel in the live connection process, the first frame rendering display does not need to wait for the result of the second establishment, so when the inviting user or the invited user does not want to perform live connection or the second establishment fails, the first establishment can be interrupted, the live connection is stopped, partial service functions caused by unsuccessful second establishment can be avoided, and only when the second establishment is successful and both the inviting user and the invited user have willingness to perform live connection, the live connection can be normally performed.
Fig. 4 is a schematic diagram of a live connection in the related art, as shown in fig. 4, in which a live connection process in the related art is shown, a service end includes a data service end and a service end, and a specific serial procedure of first establishing a second connection is performed first, where the second connection establishment process is indicated by a thinner arrow in the figure, and the first connection establishment process is indicated by a thicker arrow in the figure. The second association process may include: the invitation anchor A (namely the client where the invitation anchor A is located) sends an invitation (invite) to the service server; the service server forwards the invitation to the invited anchor B (namely the client where the invited anchor B is located), and returns the invite to the client where the invited anchor A is sent; the service server can accept the agreeing (reply) request sent after the invited anchor B clicks to accept the invitation, and returns the reply; the invited anchor B sends a service channel joining request (join_channel request) to a service server; the service server sends the consent information (reply_message) to the inviting anchor a so that the inviting anchor a also returns a service channel joining request (join_channel request), and the service server joins the inviting anchor a and the invited anchor B to the same service channel and sends a service channel joining result (join_channel return) to the inviting anchor a and the invited anchor B.
The first association establishment procedure may include: after the invited anchor B receives the successful service channel joining result sent by the service server, a data channel joining request (rtc_join_channel) can be sent to the data server; after the invitation anchor A receives the successful joining result of the service channel sent by the service server, a data channel joining request (rtc_join_channel) can be sent to the data server; the data server may join the inviting host a and the invited host B to the same data channel, send a successful result of the joining of the data channel (rtc_join_channel_success) to the inviting host a and the invited host B, and join live data, where the data server may return the joined data to the inviting host a and the invited host B to render and display the joined data, where the joined data includes a first frame (rtc_first_remote_video).
As shown in fig. 4, the inviting side first frame duration may include a service join_channel request time consuming, rtc room entering time consuming, and a waiting for the opposite first frame time consuming of the inviting host a, and the invitee side first frame duration may include a reply request time consuming, a service join_channel request time consuming, rtc room entering time consuming, and a waiting for the opposite first frame time consuming of the invited host B. The first frame duration of the invitee and the first frame duration of the invitee are long, and optimization is limited due to the relation of business processes.
Fig. 5 is a schematic diagram of a live connection provided by an embodiment of the present disclosure, and as shown in fig. 5, a live connection process provided by the embodiment of the present disclosure is shown in the figure, and a service end includes a data service end and a service end as an example, specifically, a first link establishment and a second link establishment may be executed in parallel, where the second link establishment process is indicated by a thinner arrow in the figure, and the first link establishment process is indicated by a thicker arrow in the figure. In the figure, the inviting anchor A is the client where the inviting anchor A is located, and the invited anchor B is the client where the invited anchor B is located.
As shown in fig. 5, the live wire process may include: the invitation anchor A sends an invitation (invite) to a business server; the service server sends an invite message to the invited anchor B, and returns the invite to the client of the invited anchor A; the invitation anchor A sends a data channel joining request (rtc_join_channel) to the data service end after the invitation interface returns, and sends audio and video data (rtc_push_date) to the data service end after receiving a successful result (rtc_join_channel_success) of the data channel joining; after receiving the invite message sent by the service server, the invited anchor B may send a data channel joining request (rtc_join_channel) to the data server, and after receiving a successful result of the data channel joining (rtc_join_channel_success), send audio/video data (rtc_push_date) to the data server; the service server can accept the agreeing (reply) request sent after the invited anchor B clicks to accept the invitation, and returns the reply; the invited anchor B sends a service channel joining request (join_channel request) to a service server; the service server sends the consent information (reply_message) to the inviting anchor A so that the inviting anchor A also returns a service channel joining request (join_channel request), and the service server executes the inviting anchor A and the invited anchor B to join the same service channel; after receiving the consent information (reply_message) sent by the service server, the inviting anchor A can send a request for updating the layout to start converging to the data server; the invited anchor B clicks to accept the request of sending consent and simultaneously sends a request for updating the layout starting confluence to the data server; the data server can carry out live data confluence of the inviting anchor A and the invited anchor B, the data server can respectively return the confluence data to the inviting anchor A and the invited anchor B for confluence data rendering and displaying, and the confluence data comprises a first frame (rtc_first_remote_video).
It will be appreciated that since the time at which the invited anchor B clicks to accept the invitation may vary, the invited anchor B may also send an approval request to the service server during the joining of the data channel.
As shown in fig. 5, the time length of the first frame of the inviter only includes time consumption for waiting for the first frame of the opposite side from the time of receiving the consent information, and the time length of the first frame of the invitee only includes time consumption for waiting for the first frame of the opposite side from the time of clicking to accept the consent request. Compared to fig. 4, both the invitee first frame duration and the invitee first frame duration are greatly reduced.
In the scheme, the process optimization of the live broadcast connection is realized by advancing the time of data merging and data connection in the live broadcast connection process and advancing the time of live broadcast data uploading, namely by data merging without waiting for a service connection result, parallel execution of the data connection and the service connection and advanced push of data dimension, the theoretical limit of optimizing the first frame duration in the streaming data in the related technology is broken, the first frame duration perceived by a user is basically the same as the first frame duration waiting for the opposite party, and further the live broadcast connection experience effect of the user is improved.
Fig. 6 is a flowchart of another live connection method provided in an embodiment of the present disclosure, where the method may be performed by a live connection device, and the device may be implemented in software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 6, the method is applied to an inviting client, and includes:
Step 601, a live connection request is sent to a server, so that the server sends live connection information to an invited client according to the live connection request, and sends a connection return information to the inviting client.
The invitation client can respond to the triggering operation of the invitation user in the live broadcast process to send a live broadcast connection request to the server, the server can receive the live broadcast connection request, send a live broadcast connection message to the invited client corresponding to the live broadcast room identification of the invited client according to the live broadcast connection request, and send a connection return message to the invitation client.
Step 602, receiving a connection return message, and initiating a first connection establishment with the invited client, wherein the first connection establishment is used for establishing a data connection between the inviting client and the invited client.
After the invitation client acquires the connection return message, the invitation client can send a first joining request to the server, the first joining request initiates a first connection establishment request for the invitation client, and after receiving the connection agreement message of the invited client forwarded by the server, the invitation client can send a fourth joining request to the server, wherein the fourth joining request initiates a second connection establishment request for the invitation client. The server side can receive a first joining request and a second joining request of the invited client side, create a data channel, join the invited client side and the invited client side into the data channel, and realize a first establishment after successful joining, and then return a first establishment success message to the invited client side and the invited client side so that the invited client side and the invited client side can acquire that the first establishment is successful; the server receives the third joining request and the fourth joining request of the invited client, creates a service channel, joins the invited client and the invited client into the service channel, and can establish the second establishment after successful joining.
And 603, uploading live broadcast data of the inviting client after the success of the first establishment, and sending a converging request to the server after the confirmation of the connection, so that the server merges the two live broadcast data uploaded after the first establishment, and returns the converging data after the converging to the inviting client.
After receiving the first successful establishment message of the server, the invitation client determines that the first successful establishment is successful, can upload live broadcast data of the invitation client itself, and sends a converging request to the server after receiving a connection agreement message of the invited client forwarded by the server, and after receiving the converging request, the server can merge the live broadcast data corresponding to the invited client and the live broadcast data corresponding to the invitation client, which are uploaded after the first successful establishment, and returns the merged converging data to the invitation client.
And step 604, receiving the converging data and rendering and displaying.
The invitation client may perform rendering display after receiving the confluence data, where the confluence data may include a first frame.
For an inviting client, the first frame duration may be a duration from receiving a connection consent message of the invited client to a first frame rendering presentation of the invited client. According to the scheme, the second establishment and the first establishment are executed in parallel, the server can carry out data confluence without waiting for success of the second establishment, and the invitation client can upload live data and display the first frame without waiting for a result of whether the second establishment is successful or not, so that the first frame duration of the invitation client can be greatly reduced.
According to the live connection scheme provided by the embodiment of the disclosure, the invitation client can send a live connection request to the server, so that the server sends live connection information to the invited client according to the live connection request and sends a connection return information to the invitation client; receiving a connection return message, and initiating a first establishment connection with the invited client, wherein the first establishment connection is used for establishing a data connection between the invited client and the invited client; uploading live broadcast data of the inviting client after the success of the first establishment is determined, and sending a converging request to the server after the connection agreement is determined, so that the server merges the two live broadcast data uploaded after the first establishment, and returns the converging data after the converging to the inviting client; and receiving the converging data and rendering and displaying. By adopting the technical scheme, in the live broadcast connection process, the data can be converged after the data connection is successful and the two clients confirm to agree with the connection by advancing the time of the data convergence, the result of service connection is not required to be waited, the live broadcast data can be uploaded after the data connection is successful, the time of data uploading is also advanced, the optimization limit on the time consumption of the first frame in the converged data in the related technology is broken through, the time consumption of the first frame is greatly reduced, and the live broadcast connection experience effect of a user is further improved.
Fig. 7 is a flowchart of still another live connection method provided in an embodiment of the present disclosure, where the method may be performed by a live connection device, where the device may be implemented in software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 7, the method is applied to the invited client, and includes:
step 701, acquiring a live connection message sent by a server, and initiating a first establishment with an inviting client, wherein the first establishment is used for establishing a data connection between the inviting client and an invited client.
The invited client can acquire a live connection message sent by the server side based on a live connection request of the inviting client, can send a second joining request to the server side, the second joining request initiates a first connection establishment request for the invited client, the invited client can send a connection consent message to the server side after detecting a connection consent triggering operation of the invited user, and the server side can send the connection consent message to the inviting client and send a reply notification to the invited client after receiving the connection consent message; after receiving the reply notification sent by the server, the invited client may send a third join request to the server, where the third join request is a request for the invited client to initiate a second association establishment. The server side can receive the first joining request of the inviting client side and the second joining request, create a data channel, join the inviting client side and the invited client side into the data channel, and realize the first establishment after successful joining, and then return a first establishment success message to the inviting client side and the invited client side so that the inviting client side and the invited client side can acquire that the first establishment is successful; and the server receives the third joining request and the fourth joining request of the inviting client, creates a service channel, joins the inviting client and the invited client into the service channel, and can establish the second establishment after successful joining.
Step 702, uploading live broadcast data of the invited client after the success of the first establishment, and sending a merging request to the server after the confirmation of the connection, so that the server merges the two live broadcast data uploaded after the first establishment, and returns the merged merging data to the invited client.
After receiving the first successful establishment message of the server, the invited client determines that the first successful establishment is successful, can upload live broadcast data of the invited client, and sends a converging request to the server after detecting the connection agreement triggering operation of the invited user, and after receiving the converging request, the server can merge the live broadcast data corresponding to the invited client and the live broadcast data corresponding to the inviting client, which are uploaded after the first successful establishment, and returns the merged converging data to the invited client.
And 703, receiving the confluence data and rendering and displaying.
The invited client can render and display after receiving the converging data, and the converging data can comprise a first frame.
For the invited client, the first frame duration may be a duration of detecting that the connection agreement of the invited user triggers the first frame rendering presentation of the operation to the inviting client. According to the scheme, the second establishment and the first establishment are executed in parallel, the server can carry out data confluence without waiting for success of the second establishment, and the invited client can upload live data and display the first frame without waiting for a result of whether the second establishment is successful or not, so that the first frame duration of the invited client can be greatly reduced.
Furthermore, various steps, features of embodiments of the disclosure may be combined with other embodiments of the disclosure (including, but not limited to, the embodiment shown in fig. 1, the embodiment shown in fig. 6, the embodiment shown in fig. 7, and implementations of these embodiments, etc.) without conflict.
According to the live connection scheme provided by the embodiment of the disclosure, the invited client can acquire live connection information sent by the server and initiate a first establishment with the inviting client, wherein the first establishment is used for establishing a data connection between the inviting client and the invited client; uploading live broadcast data of the invited client after the success of the first establishment is determined, and sending a converging request to the server after the confirmation of the connection, so that the server merges the two live broadcast data uploaded after the first establishment, and returns the converging data after the converging to the inviting client; and receiving the converging data and rendering and displaying. By adopting the technical scheme, in the live broadcast connection process, the data can be converged after the data connection is successful and the two clients confirm to agree with the connection by advancing the time of the data convergence, the result of service connection is not required to be waited, the live broadcast data can be uploaded after the data connection is successful, the time of data uploading is also advanced, the optimization limit on the time consumption of the first frame in the converged data in the related technology is broken through, the time consumption of the first frame is greatly reduced, and the live broadcast connection experience effect of a user is further improved.
Fig. 8 is a schematic structural diagram of a live connection device according to an embodiment of the present disclosure, where the device may be implemented by software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 8, the device is disposed in a server, and includes:
a request module 801, configured to receive a live connection request sent by an inviting client, send a live connection message to an invited client according to the live connection request, and send a connection return message to the inviting client;
a converging module 802, configured to receive a converging request sent by the invited client and/or the inviting client after determining that the first connection establishment is successful and determining that the connection is agreed, and to merge the two live broadcast data uploaded after the first connection establishment, and to return the merged converging data to the invited client and/or the inviting client for rendering and displaying, respectively;
wherein the first establishment is for establishing a data connection between the inviting client and the invited client.
Optionally, the device further comprises a linking module for: receiving the invited client and/or the invitation client before determining that the first connection establishment is successful and determining that the joining request sent after the connection is agreed,
And executing the first establishment connection between the inviting client and the invited client, and executing a second establishment connection between the inviting client and the invited client in parallel, wherein the second establishment connection is used for establishing a service connection line between the inviting client and the invited client.
Optionally, the linking module includes a first linking unit, configured to:
receiving a first joining request sent by the inviting client according to the online return message and a second joining request sent by the invited client according to the live online message;
joining the inviting client and the invited client to the same data channel, and returning a first successful message of establishing connection to the inviting client and the invited client.
Optionally, the first joining request and the second joining request each include authentication information, the authentication information of the invited client is sent by adding to the live wire message, and the authentication information of the inviting client is sent by adding to the wire return message.
Optionally, the device further includes a data pushing module, configured to: after performing a first association between the inviting client and the invited client,
And acquiring the two live broadcast data sent after the invitation client and the invited client receive the first join-in success message, wherein the two live broadcast data comprise live broadcast data corresponding to the invitation client and live broadcast data corresponding to the invited client.
Optionally, the linking module includes a second linking unit, configured to:
receiving a connection agreement message sent by the invited client and forwarding the connection agreement message to the inviting client;
receiving a third joining request sent by the invited client and a fourth joining request sent by the inviting client after receiving the connection agreement message;
joining the inviting client and the invited client to the same traffic channel.
Optionally, the invitation client determines that the consent connection indicates that the invitation client receives the connection consent message of the invited client forwarded by the server, and the invited client determines that the consent connection indicates that the invited client detects the connection consent triggering operation of the invited user.
Optionally, the apparatus further includes a data interrupt module configured to:
And when the second establishment fails, interrupting the first establishment.
The live broadcast connection device provided by the embodiment of the disclosure can execute the live broadcast connection method applied to the server provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
Fig. 9 is a schematic structural diagram of another live connection device according to an embodiment of the present disclosure, where the device may be implemented by software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 9, the apparatus is disposed at an inviting client, and includes:
the sending module 901 is configured to send a live connection request to a server, so that the server sends a live connection message to an invited client according to the live connection request, and sends a connection return message to the inviting client;
a first initiation module 902, configured to receive the connection return message, and initiate a first establishment with the invited client, where the first establishment is used to establish a data connection between the inviting client and the invited client;
the first merging request module 903 is configured to upload live broadcast data of the inviting client after determining that the first connection establishment is successful, and send a merging request to the server after determining that the connection is agreed, so that the server merges the two live broadcast data uploaded after the first connection establishment, and returns the merged merging data to the inviting client;
And the first display module 904 is used for receiving the merging data and performing rendering display.
The live connection device provided by the embodiment of the disclosure can execute the live connection method applied to the inviting client provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
Fig. 10 is a schematic structural diagram of still another live connection device according to an embodiment of the present disclosure, where the device may be implemented by software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 10, the apparatus is disposed at an invited client, and includes:
a second initiation module 1001, configured to obtain a live connection message sent by a server, and initiate a first establishment with an inviting client, where the first establishment is used to establish a data connection between the inviting client and the invited client;
a second merge request module 1002, configured to upload live broadcast data of the invited client after determining that the first association is successful, and send a merge request to the server after determining that the connection is agreed, so that the server merges the two live broadcast data uploaded after the first association, and returns the merged merge data to the invited client;
And the second display module 1003 is used for receiving the merging data and performing rendering display.
The live connection device provided by the embodiment of the disclosure can execute the live connection method applied to the invited client provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
The disclosed embodiments also provide a computer program product comprising a computer program/instructions which, when executed by a processor, implement the live wire method provided by any of the embodiments of the present disclosure.
Fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. Referring now in particular to fig. 11, a schematic diagram of an electronic device 1100 suitable for use in implementing embodiments of the present disclosure is shown. The electronic device 1100 in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, as well as stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 11 is merely an example, and should not impose any limitations on the functionality and scope of use of embodiments of the present disclosure.
As shown in fig. 11, the electronic device 1100 may include a processing means (e.g., a central processor, a graphics processor, etc.) 1101 that may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 1102 or a program loaded from a storage means 1108 into a Random Access Memory (RAM) 1103. In the RAM 1103, various programs and data necessary for the operation of the electronic device 1100 are also stored. The processing device 1101, ROM 1102, and RAM 1103 are connected to each other by a bus 1104. An input/output (I/O) interface 1105 is also connected to bus 1104.
In general, the following devices may be connected to the I/O interface 1105: input devices 1106 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, and the like; an output device 1107 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 1108, including for example, magnetic tape, hard disk, etc.; and a communication device 1109. The communication means 1109 may allow the electronic device 1100 to communicate wirelessly or by wire with other devices to exchange data. While fig. 11 illustrates an electronic device 1100 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a non-transitory computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via communications device 1109, or from storage device 1108, or from ROM 1102. The above-described functions defined in the live wire method of the embodiment of the present disclosure are performed when the computer program is executed by the processing apparatus 1101.
It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: receiving a live connection request sent by an inviting client, sending a live connection message to an invited client according to the live connection request, and sending a connection return message to the inviting client; receiving a converging request sent by the invited client and/or the inviting client after determining that the first connection establishment is successful and determining that the connection is agreed, converging the two live broadcast data uploaded after the first connection establishment, and respectively returning the converging data after converging to the invited client and/or the inviting client for rendering and displaying; wherein the first establishment is for establishing a data connection between the inviting client and the invited client.
Alternatively, the computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: the method comprises the steps of sending a live connection request to a server, enabling the server to send live connection information to an invited client according to the live connection request, and sending a connection return information to the inviting client; receiving the connection return message, and initiating a first establishment connection with the invited client, wherein the first establishment connection is used for establishing a data connection between the inviting client and the invited client; uploading live broadcast data of the invitation client after the first establishment success is determined, and sending a confluence request to the server after the connection agreement is determined, so that the server can confluence the two live broadcast data uploaded after the first establishment, and the confluence data after confluence is returned to the invitation client; and receiving the confluence data and rendering and displaying.
Alternatively, the computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: acquiring a live connection message sent by a server, and initiating a first establishment with an inviting client, wherein the first establishment is used for establishing a data connection between the inviting client and the invited client; uploading live broadcast data of the invited client after the first link establishment is determined to be successful, and sending a converging request to the server after the link agreement is determined, so that the server can converge the two live broadcast data uploaded after the first link establishment, and returning the converged converging data to the invited client; and receiving the confluence data and rendering and displaying.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).
Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims (15)

1. The live broadcast connection method is characterized by being applied to a server and comprising the following steps:
receiving a live connection request sent by an inviting client, sending a live connection message to an invited client according to the live connection request, and sending a connection return message to the inviting client;
receiving a converging request sent by the invited client and/or the inviting client after determining that the first connection establishment is successful and determining that the connection is agreed, converging the two live broadcast data uploaded after the first connection establishment, and respectively returning the converging data after converging to the invited client and/or the inviting client for rendering and displaying;
wherein the first establishment is for establishing a data connection between the inviting client and the invited client.
2. The method of claim 1, wherein receiving the invited client and/or the inviting client before determining that the first association was successful and determining that the join request sent after the connection was granted, the method further comprises:
And executing the first establishment connection between the inviting client and the invited client, and executing a second establishment connection between the inviting client and the invited client in parallel, wherein the second establishment connection is used for establishing a service connection line between the inviting client and the invited client.
3. The method of claim 2, wherein performing the first association between the inviting client and the invited client comprises:
receiving a first joining request sent by the inviting client according to the online return message and a second joining request sent by the invited client according to the live online message;
joining the inviting client and the invited client to the same data channel, and returning a first successful message of establishing connection to the inviting client and the invited client.
4. The method of claim 3, wherein the first join request and the second join request each include authentication information, the authentication information of the invited client is sent by adding to the live wire message, and the authentication information of the inviting client is sent by adding to the wire return message.
5. The method of claim 3, wherein after performing the first association between the inviting client and the invited client, the method further comprises:
and acquiring the two live broadcast data sent after the invitation client and the invited client receive the first join-in success message, wherein the two live broadcast data comprise live broadcast data corresponding to the invitation client and live broadcast data corresponding to the invited client.
6. The method of claim 2, wherein performing a second association between the inviting client and the invited client comprises:
receiving a connection agreement message sent by the invited client and forwarding the connection agreement message to the inviting client;
receiving a third joining request sent by the invited client and a fourth joining request sent by the inviting client after receiving the connection agreement message;
joining the inviting client and the invited client to the same traffic channel.
7. The method of claim 1, wherein the inviting client determining agreeing to connect indicates that the inviting client receives a connection agreeing message from the invited client forwarded by the server, the invited client determining agreeing to connect indicating that the invited client detects a connection agreeing trigger operation of the invited user.
8. The method according to claim 2, wherein the method further comprises:
and when the second establishment fails, interrupting the first establishment.
9. A live connection method, applied to an inviting client, comprising:
the method comprises the steps of sending a live connection request to a server, enabling the server to send live connection information to an invited client according to the live connection request, and sending a connection return information to the inviting client;
receiving the connection return message, and initiating a first establishment connection with the invited client, wherein the first establishment connection is used for establishing a data connection between the inviting client and the invited client;
uploading live broadcast data of the invitation client after the first establishment success is determined, and sending a confluence request to the server after the connection agreement is determined, so that the server can confluence the two live broadcast data uploaded after the first establishment, and the confluence data after confluence is returned to the invitation client;
and receiving the confluence data and rendering and displaying.
10. A live connection method, applied to an invited client, comprising:
Acquiring a live connection message sent by a server, and initiating a first establishment with an inviting client, wherein the first establishment is used for establishing a data connection between the inviting client and the invited client;
uploading live broadcast data of the invited client after the first link establishment is determined to be successful, and sending a converging request to the server after the link agreement is determined, so that the server can converge the two live broadcast data uploaded after the first link establishment, and returning the converged converging data to the invited client;
and receiving the confluence data and rendering and displaying.
11. The utility model provides a live broadcast connecting device which characterized in that sets up in the server, includes:
the request module is used for receiving a live connection request sent by the inviting client, sending a live connection message to the invited client according to the live connection request, and sending a connection return message to the inviting client;
the merging module is used for receiving a merging request sent by the invited client and/or the inviting client after the success of the first establishment and the consent to the connection are determined, merging the two live broadcast data uploaded after the first establishment, and respectively returning the merged merging data to the invited client and/or the inviting client for rendering and displaying;
Wherein the first establishment is for establishing a data connection between the inviting client and the invited client.
12. A live wire device, characterized in that it is disposed at an inviting client, comprising:
the sending module is used for sending the live connection request to the server side, so that the server side sends live connection information to the invited client side according to the live connection request and sends connection return information to the inviting client side;
the first initiating module is used for receiving the connection return message and initiating a first establishment connection with the invited client, wherein the first establishment connection is used for establishing a data connection between the inviting client and the invited client;
the first merging request module is used for uploading live broadcast data of the invitation client after the first establishment success is determined, sending a merging request to the server after the connection agreement is determined, enabling the server to merge the two live broadcast data uploaded after the first establishment, and returning the merged merging data to the invitation client;
and the first display module is used for receiving the confluence data and performing rendering display.
13. A live wire device, configured to an invited client, comprising:
the second initiation module is used for acquiring a live connection message sent by the server and initiating a first establishment with the inviting client, wherein the first establishment is used for establishing a data connection between the inviting client and the invited client;
the second merging request module is used for uploading live broadcast data of the invited client after the first establishment success is determined, sending a merging request to the server after the connection agreement is determined, enabling the server to merge the two live broadcast data uploaded after the first establishment, and returning the merged merging data to the invited client;
and the second display module is used for receiving the confluence data and performing rendering display.
14. An electronic device, the electronic device comprising:
a processor;
a memory for storing the processor-executable instructions;
the processor is configured to read the executable instructions from the memory and execute the instructions to implement the live wire method of any of the preceding claims 1-10.
15. A computer readable storage medium, characterized in that the storage medium stores a computer program for performing the live wire method of any of the preceding claims 1-10.
CN202210667600.8A 2022-06-13 2022-06-13 Live broadcast connection method, device, equipment and medium Pending CN117278815A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210667600.8A CN117278815A (en) 2022-06-13 2022-06-13 Live broadcast connection method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210667600.8A CN117278815A (en) 2022-06-13 2022-06-13 Live broadcast connection method, device, equipment and medium

Publications (1)

Publication Number Publication Date
CN117278815A true CN117278815A (en) 2023-12-22

Family

ID=89214686

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210667600.8A Pending CN117278815A (en) 2022-06-13 2022-06-13 Live broadcast connection method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN117278815A (en)

Similar Documents

Publication Publication Date Title
US20220300243A1 (en) Screen sharing method and device and electronic equipment
CN112291629B (en) Interaction method, interaction device, electronic equipment and readable medium
CN112291502B (en) Information interaction method, device and system and electronic equipment
US20230199873A1 (en) Information interaction method and apparatus, and electronic device
US11757948B2 (en) Communication method and apparatus, and electronic device
US11758087B2 (en) Multimedia conference data processing method and apparatus, and electronic device
JP7490124B2 (en) INTERACTION METHOD, DEVICE AND ELECTRONIC DEVICE
US20240104513A1 (en) Schedule sharing method, apparatus, and device
CN111818291B (en) Method and device for establishing multimedia call and electronic equipment
CN113326013A (en) Information interaction method and device and electronic equipment
CN112015506B (en) Content display method and device
CN112311750B (en) Interaction method and device and electronic equipment
CN112306595A (en) Interaction method and device and electronic equipment
CN117278815A (en) Live broadcast connection method, device, equipment and medium
CN111818293B (en) Communication method and device and electronic equipment
CN112291216A (en) Communication method and device and electronic equipment
CN116962803A (en) Method, device, equipment and medium for processing direct broadcast audio and video stream
CN112311749B (en) Method and device for adding participating members and electronic equipment
CN117278706A (en) Connection processing method, device, equipment and medium
WO2023185499A1 (en) Multi-user multimedia control method, apparatus and system, and device and medium
CN117294681A (en) Method, device, equipment, storage medium and program product for setting up link wheat
CN117294863A (en) Live broadcasting room wheat connecting method, device, electronic equipment, storage medium and program product
CN117115480A (en) User matching interaction method, device, equipment and medium
CN115776599A (en) Game live broadcast interaction method, device, equipment and medium
CN117806497A (en) Interaction method and device of session interface, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination