CN117319693A - Method, device, system and equipment for transmitting online live wheat-linked interactive data - Google Patents

Method, device, system and equipment for transmitting online live wheat-linked interactive data Download PDF

Info

Publication number
CN117319693A
CN117319693A CN202210726169.XA CN202210726169A CN117319693A CN 117319693 A CN117319693 A CN 117319693A CN 202210726169 A CN202210726169 A CN 202210726169A CN 117319693 A CN117319693 A CN 117319693A
Authority
CN
China
Prior art keywords
link
interaction
point
wheat
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210726169.XA
Other languages
Chinese (zh)
Inventor
戴满佐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Cubesili Information Technology Co Ltd
Original Assignee
Guangzhou Cubesili Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Cubesili Information Technology Co Ltd filed Critical Guangzhou Cubesili Information Technology Co Ltd
Priority to CN202210726169.XA priority Critical patent/CN117319693A/en
Publication of CN117319693A publication Critical patent/CN117319693A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/361Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Abstract

The application relates to the field of network live broadcast, and provides a method, a device, a system, equipment and a medium for transmitting communication interaction data of network live broadcast. According to the method and the device, the communication interaction data transmission time delay in the Lian Mai interaction scene can be reduced as much as possible, so that the requirement of communication interaction data transmission time delay between communication terminals in online KTV and other scenes can be met. The method comprises the following steps: based on the original links, point-to-point links are established based on the link interaction scene identification and other link ends in the interaction scene, and low-delay links established based on the multi-line servers corresponding to the address and the scene identification are accessed, then link interaction data interaction is carried out between the links and the other link ends respectively, first link interaction data provided by links with optimal transmission delay on link interaction data of the other link ends in the links are obtained, and then the first link interaction data is presented in the scene so that a local link user can provide second link interaction data matched with the first link interaction data.

Description

Method, device, system and equipment for transmitting online live wheat-linked interactive data
Technical Field
The present disclosure relates to the field of network live broadcasting technologies, and in particular, to a method, an apparatus, a system, an electronic device, and a computer readable storage medium for transmitting data in a live broadcasting link.
Background
With the development of network live broadcasting technology, the live broadcasting application can be used for each user to communicate with other users in a network live broadcasting mode by means of personal terminal equipment so as to display own skills and promote information transmission. The online live broadcasting and wheat linking interaction is an interaction mode for enabling each user to display own skills and promote information transmission in the online live broadcasting, for example, online KTV is an online wheat linking interaction scene which realizes a KTV function through live broadcasting and wheat linking of the user and accompaniment and displays own singing skills of the user.
In the prior art, the link ends of the link interaction are added to carry out the link interaction data transmission through the link provided by the network live broadcast server, but various link interaction scenes such as online KTV and the like have higher interaction coordination requirements on link users, the link connection modes of the link ends are different, and the link interaction data transmission mode provided in the prior art is difficult to meet the requirements of the link ends on the link interaction data transmission time delay.
Disclosure of Invention
Based on the foregoing, it is necessary to provide a method, an apparatus, a system, an electronic device and a computer readable storage medium for transmitting online live communication data.
In a first aspect, the present application provides a live-webcast link-wheat interactive data transmission method. The method comprises the following steps:
when entering a wheat-linking interaction scene of network live broadcast, establishing a point-to-point link based on a wheat-linking interaction scene identifier and other wheat-linking ends in the wheat-linking interaction scene on the basis of an original link, and accessing a low-delay link corresponding to the wheat-linking interaction scene identifier; the low-delay link is established based on a server address and a multi-line server corresponding to the wheat-connected interaction scene identifier;
respectively carrying out wheat connecting interaction data interaction with the other wheat connecting ends through the original link, the point-to-point link and the low-delay link;
acquiring first link interaction data provided by links with optimal transmission delay for link interaction data of other link ends in the original links, point-to-point links and low-delay links;
and in the communication interaction scene, presenting the first communication interaction data provided by the link with the optimal transmission time delay so as to provide the second communication interaction data matched with the first communication interaction data for the local communication user.
In one embodiment, the establishing a point-to-point link with other link ends in the link interaction scene based on the link interaction scene identification includes:
acquiring a wheat connecting interaction scene identifier of the wheat connecting interaction scene, and acquiring network information of a local wheat connecting terminal; based on the wheat connecting interaction scene identification, the network information of the local wheat connecting end is sent to the other wheat connecting ends through the broadcasting channel of the original link, and the network information of the other wheat connecting ends is received through the broadcasting channel of the original link; and establishing point-to-point links with the other wheat connecting ends according to the network information of the other wheat connecting ends.
In one embodiment, the establishing a point-to-point link with the other headset according to the network information of the other headset includes:
sending a hole punching confirmation request to the other wheat connecting end according to the network information of the other wheat connecting end; and receiving a hole confirmation response corresponding to the hole confirmation request from the other headset terminal, and determining that a point-to-point link is established with the other headset terminal.
In one embodiment, after the peer-to-peer link is established between the link-based interaction scene identifier and other links in the link-based interaction scene, the method further includes:
And if the link state information from one other headset terminal does not carry the headset interaction scene identification of the headset interaction scene, removing the point-to-point link with the other headset terminal, or removing the point-to-point link with the other headset terminal and informing the other headset terminal in the headset interaction scene to remove the point-to-point link with the other headset terminal.
In one embodiment, the method further comprises:
in the interaction of the headset interaction data with the other headset ends through the point-to-point links, the headset interaction data is retransmitted to the other headset ends when the data receiving confirmation response fed back by the other headset ends is not received, and the headset interaction data is retransmitted to the other headset ends when the data retransmission request sent by the other headset ends is received.
In one embodiment, the accessing the low-latency link corresponding to the link-to-microphone interaction scene identifier includes:
acquiring a wheat connecting interaction scene identifier of the wheat connecting interaction scene, and acquiring network information of a local wheat connecting terminal; the communication interaction scene identification and the network information are sent to a distribution server, so that the distribution server distributes corresponding multi-line servers according to the communication interaction scene identification and the network information; receiving a server address sent by the distribution server; sending a login command carrying the wheat-connected interaction scene identifier to a multi-line server corresponding to the server address; and when receiving the login reply fed back by the multi-line server, determining that the low-delay link is accessed.
In one embodiment, the obtaining the first link interaction data provided by the link having the optimal transmission delay for the link interaction data of the other link end in the original link, the point-to-point link and the low-delay link includes:
sending each path of wheat connecting interaction data which are sent in from the original link, the point-to-point link and the low-delay link into a data queue according to the sending time sequence; determining a data sequence number of the wheat-linked interaction data to be presented currently; and acquiring the wheat connecting interaction data which corresponds to the data sequence number and is firstly sent into the data queue from each path of the wheat connecting interaction data of the data queue, and obtaining the first wheat connecting interaction data.
In a second aspect, the application provides a live-webcast link-microphone interactive data transmission device. The device comprises:
the link establishment module is used for establishing point-to-point links with other link ends in the link interaction scene based on the link interaction scene identification on the basis of the original links when entering the link interaction scene of the network live broadcast, and accessing the low-delay links corresponding to the link interaction scene identification; the low-delay link is established based on a server address and a multi-line server corresponding to the wheat-connected interaction scene identifier;
The data interaction module is used for carrying out wheat connecting interaction data interaction with the other wheat connecting ends through the original link, the point-to-point link and the low-delay link respectively;
the data acquisition module is used for acquiring first link interaction data provided by links with optimal transmission delay for the link interaction data of other link ends in the original links, the point-to-point links and the low-delay links;
and the data presentation module is used for presenting the first link interaction data provided by the link with the optimal transmission time delay in the link interaction scene so as to provide the second link interaction data matched with the first link interaction data for the local link user.
In a third aspect, the present application provides a live-webcast link-wheat interactive data transmission system. The system comprises: each wheat connecting end, access equipment and an original link server of each wheat connecting end for forming an original link, and a multi-line server; the access equipment of each wheat connecting end is used for forming a point-to-point link, and the access equipment of each wheat connecting end and the multi-line server are used for forming a low-delay link; and each wheat connecting end is used for transmitting wheat connecting interaction data according to the method.
In a fourth aspect, the present application provides an electronic device. The electronic device comprises a memory storing a computer program and a processor implementing the steps of the method as described above when the processor executes the computer program.
In a fifth aspect, the present application provides a computer-readable storage medium. The computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the method as described above.
According to the method, the device, the system, the equipment and the medium for transmitting the link wheat interaction data of the network live broadcast, when the network live broadcast enters the link wheat interaction scene, on the basis of an original link, a point-to-point link is established based on the link wheat interaction scene identification and other link wheat ends in the scene, and a low-delay link established based on a multi-line server corresponding to the address and the scene identification is accessed, then the link wheat interaction data interaction is carried out with the other link wheat ends through the links respectively, first link wheat interaction data provided by links with optimal transmission delay on the link wheat interaction data of the other link wheat ends in the links is obtained, and then the first link wheat interaction data is presented in the scene so that a local link wheat user can provide second link wheat interaction data matched with the first link wheat interaction data. According to the scheme, a point-to-point link and a low-delay link are newly added for each link entering the link interaction scene on the basis of the original link, the three links respectively and independently transmit complete link interaction data, when the local link presents link interaction data from other link users for the local link, the first link interaction data provided by the link with optimal transmission delay is selected for presentation so that the users can timely cooperate and feed back second link interaction data, the effect that the access of various link ends in the link interaction scene is covered by the original link, the point-to-point link and the low-delay link under the condition that the original link is not influenced is achieved, the link interaction data transmission delay in the scene can be reduced as much as possible, the requirement of on the link interaction data transmission delay between the link ends in the online KTV and other link interaction scene is met, and the link users at all ends can interact with other link users with high cooperation degree in the corresponding link interaction scene.
Drawings
Fig. 1 is an application scenario diagram of a live-webcast link interaction data transmission method in an embodiment of the present application;
fig. 2 is a flow chart of a live communication interaction data transmission method in the embodiment of the application;
FIG. 3 (a) is a schematic diagram of an original link in an embodiment of the present application;
FIG. 3 (b) is a schematic diagram of a point-to-point link in an embodiment of the present application;
FIG. 3 (c) is a schematic diagram of a low latency link in an embodiment of the present application;
FIG. 4 is a flow chart illustrating the steps for establishing a point-to-point link in an embodiment of the present application;
fig. 5 is a flowchart illustrating steps for accessing a low latency link according to an embodiment of the present application;
FIG. 6 is a flowchart illustrating steps for obtaining first link interaction data according to an embodiment of the present disclosure;
fig. 7 is a schematic diagram of a live-webcast link interaction data transmission system in an embodiment of the present application;
fig. 8 is a block diagram of a live communication interaction data transmission device in an embodiment of the present application;
fig. 9 is an internal structural diagram of an electronic device in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
The method for transmitting the link-wheat interactive data of the live webcast provided by the embodiment of the application can be applied to an application scene shown in fig. 1, wherein the application scene can comprise a plurality of link-wheat ends, and for convenience of description and understanding of a scheme, the first link-wheat end, the second link-wheat end and the third link-wheat end are shown in fig. 1 and are respectively used by a first link-wheat user 11, a second link-wheat user 12 and a third link-wheat user 13, and each link-wheat user can use the link provided by the respective link-wheat end network live webcast service to transmit the link-wheat interactive data. The first, second and third connecting terminals can be, but are not limited to, electronic devices such as personal computers, smart phones, tablet computers and the like. In the application, for each link end added in the link interaction scene, the network live broadcast service adds a point-to-point link (P2P link) and a low-delay link on the basis of the original link to allow any link end to interact with other link ends for link interaction data. Specifically, for the first, second and third link ends added into the link interaction scene, the first link end can interact with the second and third link ends through the original link, the point-to-point link and the low-delay link, the second link end can interact with the first and third link ends through the original link, the point-to-point link and the low-delay link, the third link end can interact with the first and second link ends through the original link, the point-to-point link and the low-delay link, the access of various link ends in the link interaction scene can be covered through the original link, the point-to-point link and the low-delay link under the condition that the original link is not affected, so that the link interaction data transmission time delay in the scene is reduced as much as possible, the requirements of each link end in the link interaction scene such as on-line KTV on the link interaction data transmission time delay can be met, and the link users at each end can interact with other link users at high coordination degree in the corresponding link interaction scene.
The following describes a live webcast link-to-wheat interactive data transmission method provided by the application with reference to various embodiments and corresponding drawings on the basis of fig. 1.
In one embodiment, as shown in fig. 2, a method for transmitting live-connection interaction data is provided, which can be performed by any connection terminal shown in fig. 1, and in this embodiment, the connection terminal performing the method is called a local connection terminal, and a user using the local connection terminal is called a local connection user. The method comprises the following steps:
step S201, when entering a live-webcast link interaction scene, a point-to-point link is established based on the link interaction scene identification and other link ends in the link interaction scene on the basis of the original link, and a low-delay link corresponding to the link interaction scene identification is accessed.
In this step, when the local link end enters the link interaction scene of the network live broadcast, on the basis of the original link of the network live broadcast, the local link end establishes a point-to-point link based on the link interaction scene identifier and other link ends in the link interaction scene, and the local link end accesses a low-delay link corresponding to the link interaction scene identifier.
Specifically, the continuous-microphone interaction scene may be online KTV in live continuous-microphone interaction, the online KTV realizes the offline KTV function through multi-user continuous microphone and local accompaniment, the online KTV has a primary singing user and an accompaniment user, the primary singing user is an initiator of the online KTV, the primary singing user generally determines which track or tracks to chorus, only one primary singing user exists in the whole chorus process, the accompaniment user is a user who accepts the primary singing user to chorus together, and at least one accompaniment user exists in the whole chorus process, but the method is not limited to one accompaniment user. The company-microphone interaction scene identifier refers to an identifier with a unique marking or identifying function on the company-microphone interaction scene, and for online KTV, the company-microphone interaction scene identifier can be the UID (User Identification, user account number) of the host singing user. Therefore, when the local link end enters the online KTV scene, the local link end can establish a point-to-point link based on the UID of the primary singing user and other link ends which also enter the online KTV scene on the basis of the original link, and the local link end is connected to a low-delay link corresponding to the UID of the primary singing user. The local microphone connecting terminal can be a microphone connecting terminal used by a main singer or a microphone connecting terminal used by an accompaniment user.
The original link, the point-to-point link, and the low-delay link are described in order with reference to fig. 3 (a) to 3 (c), respectively.
Fig. 3 (a) illustrates the original link by taking the first and second links as examples. The first link is accessed to the original link through a first access device (such as a gateway), the second link is accessed to the original link through a second access device (such as a gateway), and the original link can be established based on the first front-end server, the second front-end server and the inter-network server. The first front-end server and the second front-end server can be specifically AVP servers (audio and video front-end servers) and can be used for receiving and distributing uplink audio and video data of users, the inter-network servers can be used for cross-machine room and cross-region connection, and the first front-end server can be directly connected with the second front-end server or can be connected with the second front-end server through the inter-network servers. In the original link, the first and second wheat connecting ends are accessed to the corresponding front end servers (i.e. the first and second front end servers) nearby, i.e. the front end server closest to the user, so that for the common wheat connecting, the original link basically can meet the requirement of the original link on time delay, but for the wheat connecting interaction scene such as online KTV and the like with higher interaction coordination degree requirement of the wheat connecting users, the original link is difficult to ensure to meet the requirement of the original link on time delay due to different access modes of the wheat connecting ends. For example, in an online KTV scene, chorus sound can be really heard by a headset user from acquisition, the delay cannot be too high, and once a certain delay threshold value is exceeded, the interaction coordination of the headset user can be greatly influenced, so that the user experience of the headset user is influenced.
Taking a main singing user and an accompaniment user in an online KTV scene as examples, the delay influence of the original link on the wheat connecting end with different access modes comprises the following steps:
1. when the primary and accompaniment users are in relatively close areas, but due to the close access, plus balanced scheduling of resources, the primary and accompaniment users are not necessarily assigned to front-end servers that are relatively close together, it is easy for delays to occur that exceed acceptable delay thresholds.
2. When the host and accompaniment users are in relatively far away areas, if accessed nearby, the front-end server may be caused to be accessed further, and the delay through the inter-network server may exceed an acceptable delay threshold.
3. When the master singing user and the accompaniment user are in different operators, as each front-end server in the original link is usually a single-line machine room arranged at an edge node, the master singing user and the accompaniment user need to communicate with each other, and need to walk across the servers of the operators, namely, pass through multi-level inter-network servers, and the time delay of the master singing user and the accompaniment user far exceeds an acceptable time delay threshold.
According to the method, the point-to-point link and the low-delay link are newly added on the basis of the original link, namely, the link meeting extremely low delay can be dynamically selected according to the wheat-linking interaction scene such as online KTV and the like under the condition that the original link is not modified.
Fig. 3 (b) illustrates the point-to-point links of the first, second and third links with respect to each other. The first, second and third wheat connecting ends respectively establish point-to-point links through the first, second and third access devices, wherein the point-to-point links are virtual links, and UDP (user datagram protocol) connection of the original links can be multiplexed.
Fig. 3 (c) illustrates a low-latency link with first and second links as examples. The first connecting end is connected to the low-delay link through the first access equipment, the second connecting end is connected to the low-delay link through the second access equipment, and the low-delay link is established based on the server address and the multi-line server corresponding to the connecting interaction scene identifier. The correspondence between the server address and the company interaction scene identifier means that one company interaction scene identifier corresponds to one server address, that is, each company end added to the same company interaction scene such as online KTV is assigned to a multi-line server (multi-line machine room) with the same server address, and the multi-line server can support user access of different operators, so that a link established by the multi-line server based on the server address and the company interaction scene identifier has lower time delay compared with the original link, and therefore the link is called as a low-delay link.
Step S202, communicating with other communicating ends through original links, point-to-point links and low-delay links respectively.
In this step, the local link performs link interaction data with other link in Lian Mai interaction scene through the original link, the point-to-point link and the low-delay link respectively. The original link, the point-to-point link and the low-delay link respectively and independently transmit the wheat connecting interaction data, namely each link can ensure the integrity of the wheat connecting interaction data. The present headset terminal transmits the headset interaction data a to other headset terminals through the point-to-point link and the low-delay link in addition to the original link, and correspondingly, the present headset terminal can receive the headset interaction data B from other headset terminals through the point-to-point link and the low-delay link in addition to the original link.
Step 203, obtaining first link interaction data provided by links with optimal transmission delay for other link interaction data of the link ends in the original links, the point-to-point links and the low-delay links.
In this step, the local link can receive the link interaction data from other links from the original link, the point-to-point link and the low-delay link, and in order to make the transmission delay as low as possible, the local link acquires the link interaction data provided by the link with the optimal transmission delay for the link interaction data of other links from the three links, and records the link interaction data as the first link interaction data. For example, if the local link receives the link interaction data from the other link from the point-to-point link, the point-to-point link is the link with the optimal transmission delay, and the received link interaction data is the first link interaction data.
In step S204, in the headset interaction scenario, the first headset interaction data provided by the link with the optimal transmission delay is presented for the local headset user to provide the second headset interaction data matched with the first headset interaction data.
In this step, after the local link end obtains the first link interaction data provided by the link with the optimal transmission delay, the first link interaction data is presented for the local link user in the link interaction scene, so that the local link user provides the second link interaction data matched with the first link interaction data. Taking an online KTV scene as an example, the local microphone connecting end is set as the microphone connecting end of the primary singing user, the first microphone connecting interaction data is set as the audio data of the accompaniment user, and the primary singing user plays the audio data of the accompaniment user after the microphone connecting end receives the audio data of the accompaniment user so as to provide the audio data of chorus with the primary singing user.
According to the method and the device, the access of various link ends in the link interaction scene is covered through the original link, the point-to-point link and the low-delay link, so that the link interaction data transmission time delay in the scene is reduced as much as possible, the requirement of the link ends in the online KTV and other link interaction scenes on the link interaction data transmission time delay is met, and the link users at the ends can interact with other link users with high coordination degree in the corresponding link interaction scene. In combination with the original link, the point-to-point link and the low-delay link, the point-to-point link has no intermediate interaction link, all the wheat-connected interaction data are point-to-point, and belong to the shortest link, and are generally limited by the point-to-point communication condition between the wheat-connected ends, so that the link can be effective in most conditions; the low-delay link is constructed based on the multi-line server, so that the lowest delay of the links of each wheat connecting end can be ensured as much as possible, and most wheat connecting ends are met; for the situation that the communication terminals of the minimum part cannot be connected with each other or the time delay of the low-time-delay link is possibly larger than the time delay of the original link, certain time delay can be ensured by the original link, so that the access of various communication terminals in the communication interaction scene is ensured to be covered, and the communication interaction data transmission time delay is reduced as much as possible.
The method of the embodiment can be that each link entering the link interaction scene is newly added with a point-to-point link and a low-delay link on the basis of the original link, and the three links respectively and independently transmit complete link interaction data, when the local link presents the link interaction data from other link ends for the local link user, the first link interaction data provided by the link with the optimal transmission delay is selected for presentation so that the user can timely cooperate and feed back the second link interaction data, and under the condition that the original link is not influenced, the access of various link ends in the link interaction scene is covered by the original link, the point-to-point link and the low-delay link, the link interaction data transmission delay in the scene can be reduced as much as possible, so that the requirement of each link end in the online link interaction scene on the link interaction data transmission delay in the link interaction scene such as KTV is met, and the link user at each end can interact with other link users at high cooperation in the corresponding link interaction scene.
For the establishment of the point-to-point link, in some embodiments, as shown in fig. 4, the establishing of the point-to-point link with other link ends in the link interaction scene based on the link interaction scene identifier in step S201 may include:
Step S401, a wheat linking interaction scene identifier of a wheat linking interaction scene is obtained, and network information of a local wheat linking end is obtained.
Step S402, based on the communication scene identification, the network information of the local communication terminal is sent to other communication terminals through the broadcasting channel of the original link, and the network information of other communication terminals is received through the broadcasting channel of the original link.
Step S403, establishing point-to-point links with other wheat connecting ends according to the network information of the other wheat connecting ends.
In step S401 of the present embodiment, when entering a live-webcast communication scene, the local communication terminal obtains a communication interaction scene identifier of the communication interaction scene, and obtains network information of the local communication terminal, where the network information may include information such as an external network IP, an external network port, a local network IP, and a local network port of the local communication terminal, and the communication interaction scene identifier may be a UID of a host singing user in an online KTV scene. In the step S402, the local microphone terminal may use the UID of the host microphone user as a key, and use the external network IP, external network port, local network IP and local network port of the local microphone terminal as network information, and synchronize the local microphone terminal (i.e. other microphone terminals) of all the accompaniment users through the broadcasting channel of the original link. Then in step S403, the local link end can establish a point-to-point link with other links according to the network information of other links. In this embodiment, each link end can accurately establish a point-to-point link with other link ends entering the same link interaction scene based on the link interaction scene identifier.
Further, as an embodiment, step S403 specifically includes: sending a hole punching confirmation request to other wheat connecting ends according to the network information of the other wheat connecting ends; and receiving the hole confirmation responses corresponding to the hole confirmation requests from the other connecting ends, and determining that the point-to-point links are established with the other connecting ends.
In this embodiment, after the local link receives network information of other links, point-to-point hole punching is attempted through the external network and the internal network. The wheat connecting end sends a hole punching confirmation request to the other wheat connecting end, the hole punching confirmation request can be specifically a hole punching protocol packet, after the other wheat connecting end receives the hole punching protocol packet of the wheat connecting end, when relevant conditions are met, the other wheat connecting end replies a hole punching confirmation response which is successfully received, when the wheat connecting end receives the hole punching confirmation response corresponding to the hole punching confirmation request from the other wheat connecting end, the whole hole punching process is finished, a point-to-point link is established with the wheat connecting end, the state of the corresponding other wheat connecting end can be set to be a through state, the other wheat connecting end can also start the same hole punching process, only one end completes the whole process and the state of the corresponding wheat connecting end is set to be the through state.
Further, in some embodiments, after establishing a point-to-point link with other links in the link interaction scene based on the link interaction scene identifier in step S201, the method further includes the following steps:
if link state information from other link ends does not carry link interaction scene identification of the link interaction scene, removing the point-to-point link with the other link ends, or removing the point-to-point link with the other link ends and informing the other link ends in the link interaction scene to remove the point-to-point link with the other link ends.
In this embodiment, the local link may send ping packets at corresponding point-to-point link timing to other links that have been successfully drilled, and when the corresponding other links receive a ping, keep-alive and calculate rtt (Round-Trip Time) and packet loss rate by replying to ping res when the ping judgment is consistent, where the link state information needs to carry link interaction scene identifiers of the link interaction scene. If the peer-to-peer link Lian Mai receives the link state information from another peer-to-peer link without carrying the peer-to-peer interaction scene identifier of the peer-to-peer interaction scene, the peer-to-peer link with the other peer-to-peer link is removed, and the peer is notified to perform a corresponding removal operation, so as to save data transmission resources and prevent interference caused by data of a non-identical interaction scene. The continuous-wheat interaction scene identification which does not carry the continuous-wheat interaction scene comprises no continuous-wheat interaction scene identification or inconsistent continuous-wheat interaction scene identification of the continuous-wheat interaction scene. In addition to removing the point-to-point links with the other link ends, the link end can inform the other link ends in the link interaction scene to remove the point-to-point links with the other link ends, so that each link end in the link interaction scene can save data transmission resources and prevent interference caused by data of a non-identical interaction scene.
Further, in some embodiments, for a point-to-point link, the method may further include the steps of:
in the interaction of the wheat linking interaction data with other wheat linking ends through the point-to-point links, the wheat linking interaction data is retransmitted to other wheat linking ends when a data receiving confirmation response fed back by the other wheat linking ends is not received, and the wheat linking interaction data is retransmitted to the other wheat linking ends when a data retransmitting request sent by the other wheat linking ends is received.
In the embodiment, uplink and downlink retransmission is mainly implemented in a point-to-point link, the integrity of the data of the link interaction is ensured through double transmission, and redundant data is exchanged for low time delay, so that the requirement of extremely time delay is met.
Specifically, in the process that the local headset terminal performs headset interaction data interaction with other headset terminals through a point-to-point link, the local headset terminal transmits headset interaction data to other headset terminals, the other headset terminals receive the headset interaction data and feed back a data receiving confirmation response, and when the local headset terminal receives the data receiving confirmation response, the local headset terminal can determine that the headset interaction data is received by the other headset terminals. In the scene, aiming at the wheat connecting interaction data sent to other wheat connecting terminals, the local wheat connecting terminal records the wheat connecting interaction data of which the data receiving confirmation response is not received and fed back by the other wheat connecting terminals, and the local wheat connecting terminal retransmits the wheat connecting interaction data, namely, uplink retransmission; accordingly, the other headset terminal can receive the headset interaction data of the local headset terminal, and because the headset interaction data such as the audio data packet usually has a continuous packet sequence number, the other headset terminal can record the received headset interaction data sequence number, search for the non-received data sequence number, when the time of the non-received headset interaction data exceeds RTO (Retransmission TimeOut, retransmission timeout time), the other headset terminal sends a data retransmission request to the local headset terminal, and when the local headset terminal receives a data retransmission request sent by the other headset terminal, the headset interaction data is retransmitted to the other headset terminal, and the flow is downlink retransmission. For example, the audio data packet sent to the accompaniment user by the host singing user is directly consumed by the end where the accompaniment user is located, so that the integrity of the audio data sent to the accompaniment user can be ensured by only uplink retransmission or downlink retransmission, but the embodiment performs the integrity of the uplink and downlink retransmission coverage data on the point-to-point link due to the extremely low time delay requirement.
In the application, for the point-to-point link, as the network of each link end basically belongs to the network which can be opened, the effective point-to-point link can be basically established between each link end, and the live link interaction data transmitted on the point-to-point link is less in forwarding processing of a server, and is direct point-to-point, in a KTV scene, for a main singing and accompaniment user with a physical distance of a medium distance and a short distance, the point-to-point link can provide low time delay for the main singing and accompaniment user with a physical distance of a medium distance and a short distance, thereby meeting the requirement of the KTV scene on the network time delay.
For the establishment of the low-latency link, in some embodiments, as shown in fig. 5, the low-latency link corresponding to the access link interaction scene identifier in step S201 may include:
step S501, a wheat linking interaction scene identification of a wheat linking interaction scene is obtained, and network information of a local wheat linking end is obtained.
Step S502, the communication interaction scene identification and the network information are sent to the distribution server, so that the distribution server distributes corresponding multi-line servers according to the communication interaction scene identification and the network information.
In step S503, a server address sent by the allocation server is received.
Step S504, a login command carrying the communication interaction scene identifier is sent to a multi-line server corresponding to the server address.
Step S505, when receiving the login reply fed back by the multi-line server, determining that the low-delay link is accessed.
In step S501 of the present embodiment, when entering a live-webcast communication scene, the local communication terminal obtains a communication interaction scene identifier of the communication interaction scene and obtains network information of the local communication terminal, which may include information such as an external network IP, an external network port, a local area network IP, and a local area network port of the local communication terminal, where the communication interaction scene identifier may be the UID of the host singing user in the online KTV scene. Referring to fig. 3 (c), in step S502, the local link uses the UID of the host singing user (i.e., the link interaction scene identifier) as a key, and the external network IP, the external network port, the local network IP and the local network port with the local link are used as network information to be sent to the distribution server, and the distribution server distributes corresponding server addresses to the distribution service request, distributes corresponding multi-line servers according to the link interaction scene identifier and the network information, and feeds back the server addresses corresponding to the identifier to the local link. For the distribution server, the distribution server distributes each wheat connecting end to the multi-line server with the same server address according to the received sequence, and the distribution server can perform information interaction with the multi-line server to enable the multi-line server to obtain the network information of each wheat connecting end corresponding to the wheat connecting interaction scene identifier. In step S503 to step S505, the local link receives the server address allocated by the allocation server, establishes a UDP link to connect to the multi-line server corresponding to the server address, and sends a login command carrying the aforementioned link interaction scene identifier to the multi-line server corresponding to the server address, where when the local link receives a login reply fed back by the multi-line server, the local link determines that the low-delay link is available and has been connected to the low-delay link. In this embodiment, by means of the allocation server, each link end of the same link interaction scene may access the low-delay link provided by the multi-line server of the same server address based on the link interaction scene identifier.
For the low-delay link, after the local link end is accessed, the local link end can broadcast and send link wheat interaction data to the multi-line server, and other accessed link wheat ends can execute the same operation. The multi-line server receives the wheat connecting interaction data of the local wheat connecting end, distributes the wheat connecting interaction data to other wheat connecting ends, and distributes the wheat connecting interaction data of other wheat connecting ends to the local wheat connecting end. In the low-delay link, data sent by each microphone connecting end can be provided with a microphone connecting interaction scene identifier, so that each microphone connecting end in the scene can be defaulted in the same circle, a multi-line server can defaults to automatically distribute microphone connecting interaction data in the circle, namely, in an online KTV scene, for example, a main singing user can receive audio data of all accompaniment users, the accompaniment users can receive the audio data of the main singing user and other accompaniment users, further, the main singing user and the accompaniment users can carry out uplink retransmission on the uplink audio data of the main singing user and the accompaniment users, thereby ensuring that the uplink of the link is complete, and the main singing user and the accompaniment users can also respectively establish downlink retransmission on each piece of received downlink audio data, thereby ensuring that all audio data from the multi-line server is complete.
In the application, for each wheat connecting end which is positioned in different operators and has relatively far effective distance, cannot be opened or has too high rtt between nodes, the low-delay link can provide low-delay wheat connecting interaction data transmission for the wheat connecting end, the low-delay link is a link with a high probability better than the original link, all signaling can use UDP, and a relatively aggressive retransmission strategy can be used in uplink and downlink.
In some embodiments, as shown in fig. 6, the step S203 of obtaining the first link interaction data provided by the link having the optimal transmission delay for the link interaction data of the other link end in the original link, the point-to-point link and the low-delay link specifically includes:
step S601, each path of communication interaction data transmitted from the original link, the point-to-point link and the low-delay link is transmitted into the data queue according to the transmission time sequence.
Step S602, determining the data sequence number of the data of the wheat-linked interaction to be presented currently.
Step S603, the data sequence number corresponding to the first link interaction data sent to the data queue is obtained from the link interaction data of each link of the data queue, so as to obtain the first link interaction data.
In step S601 of this embodiment, the local link sends each link interaction data sent from the original link, the point-to-point link and the low-delay link to the data queue according to the incoming time sequence. Wherein each link wheat connecting interaction data comprises the wheat connecting interaction data transmitted by each link, and each link can ensure the integrity of the wheat connecting interaction data; the incoming timing refers to the time sequence of the incoming. The wheat connecting terminal sequentially puts the three paths of incoming wheat connecting interaction data into a data queue according to the time sequence of the three paths of incoming wheat connecting interaction data. Each link interactive data has a corresponding data sequence number, such as a corresponding packet sequence number for an audio data packet from the primary user, and the local link plays the audio data from the primary user for the user according to the packet sequence number. In steps S602 and S603, the local headset terminal determines the data sequence number of the headset interaction data to be presented currently, for example, determines the packet sequence number of the audio data to be played for the local headset user, then obtains the headset interaction data which corresponds to the data sequence number and is first sent to the data queue from the headset interaction data of each path of the data queue, takes the headset interaction data as the first headset interaction data, and obtains the headset interaction data with the data sequence number of 10 from the headset interaction data of each path of the data queue if the data sequence number determined by the local headset terminal is 10, and, because the three paths of incoming headset interaction data all comprise the headset interaction data with the data sequence number of 10, in order to meet the delay requirement, the local headset terminal takes the headset interaction data with the data sequence number of 10 and which is first sent to the data queue as the first headset interaction data, and performs deduplication on the headset interaction data with the remaining data sequence number of 10 in the data queue. In this embodiment, the three links each independently transmit the data of the link interaction, that is, each link can ensure the integrity of the data of the link interaction, and when the delay performance of one link is optimal, the data of the link interaction of the link can be dynamically and adaptively used.
It should be understood that, although the steps in the flowcharts related to the embodiments described above are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.
In one embodiment, a live-webcast link-based interactive data transmission system is provided, the system comprising: each wheat connecting end, access equipment and an original link server of each wheat connecting end for forming an original link, and a multi-line server; the access equipment of each wheat connecting end is used for forming a point-to-point link, and the access equipment of each wheat connecting end and the multi-line server are used for forming a low-delay link; each link end is used for transmitting link interaction data according to the method of any one of the embodiments.
Specifically, referring to fig. 7, the present embodiment will be described by taking an example in which each of the wheat connecting terminals includes a first wheat connecting terminal and a second wheat connecting terminal. The system comprises a first wheat connecting end, a second wheat connecting end, a first access device, a second access device and an original link server, wherein the first access device and the second access device are used for forming an original link. The original link server may include a first front-end server, a second front-end server and an inter-network server. The system may also include a multi-line server and an assignment server. Wherein the first and second access devices may form a point-to-point link; the first and second access devices and the multi-line server may form a low latency link with the assistance of the distribution server.
The online KTV is further taken as a live webcast wheat connecting interaction scene, the first wheat connecting end is taken as a wheat connecting end of a main singing user, and the second wheat connecting end is taken as a wheat connecting end of an accompaniment user for explanation.
For the P2P link, the first connecting end entering the KTV scene takes the UID of the primary singing user as a key, the own external network IP, external network port, local network IP and local network port are synchronized to the second connecting end through the broadcasting channel of the original link, and the second connecting end can also synchronize the own external network IP, external network port, local network IP and local network port to the first connecting end through the broadcasting channel of the original link by taking the UID of the primary singing user as a key. The second microphone connecting end receives the network information of the primary singing user, tries to perform P2P hole punching through the external network and the internal network, sends a hole punching protocol packet to the first microphone connecting end, and returns to successfully receive the hole punching protocol when the first microphone connecting end meets the relevant conditions, and the second microphone connecting end receives the successfully received hole punching protocol returned by the first microphone connecting end to complete the whole hole punching process; the second communication terminal also starts the same flow, and only one of the two ends completes the whole flow to complete the punching, and the state of the corresponding node is set as the opened state. And (3) sending a ping packet at fixed time to the wheat connecting end with successful hole, replying information such as keep-alive, rtt calculation, packet loss rate and the like by the ping Res when the ping judgment is consistent, removing the P2P link of the wheat connecting end when the UID of the primary singing user is not carried in the information, and informing the opposite end to perform corresponding removal actions. When the first link sends audio data packets to the original link, the first link distributes an audio data packet to the second link, and the second link receives the audio data packet and then puts the audio data packet into a play queue. Because the received audio data packet is a user and does not need to be distributed, only uplink retransmission or downlink retransmission is usually needed, but because of the extremely low time delay requirement, uplink and downlink retransmission is carried out on a P2P link, the integrity of the audio data of the link is ensured through double transmission, and redundant data is used for replacing low time delay.
For uplink and downlink retransmission of the P2P link, for example, the first link sends an audio packet to the second link, and the second link replies an ACK (data reception acknowledgement response) to the first link, and when the first link receives the ACK, it indicates that the audio packet has been received by the second link. The first link records the transmitted audio data packet, and retransmits the audio data packet which does not receive the ACK, namely uplink retransmission; the second link receives the audio data packet of the first link, because the audio data packet has continuous packet sequence number, the second link records the received audio data packet, searches out the packet sequence number not received, when the received audio data packet exceeds rto, sends NAK request (data retransmission request) to the first link, requests the first link to retransmit the audio data packet, and the flow is downlink retransmission. Because the audio data packet sent by the first link to the second link is directly consumed by the second link, the data sent by the first link to the second link can be ensured to be complete only by uplink retransmission or downlink retransmission, but the integrity of uplink and downlink retransmission coverage data is realized for the P2P link due to the extremely low time delay requirement.
The P2P link has the function that because the network of the main singing and accompaniment users basically belongs to the network which can be opened, the main singing and accompaniment users basically can establish an effective P2P link, the audio data of the P2P link is less than the forwarding processing of a server, the audio data is directly ordered to the point, and when the physical distance of the main singing and accompaniment users is a medium-short distance, the link can reach the low time delay required by KTV, thereby meeting the requirement of KTV scenes on the network time delay.
For a low-delay link, the first and second wheat connecting ends all use the UID sung as key, the external network IP, the external network port, the local area network IP and the local area network port of the first and second wheat connecting ends are taken to request the allocation server to allocate server addresses, the allocation server allocates the first and second wheat connecting ends to the multi-line server with the same server address according to the receiving sequence, and the multi-line server can support user access of different operators. The first connecting end receives the allocated server address, establishes a multi-line server corresponding to the UDP link connection address, sends a login command carrying the UID of the primary tone to the multi-line server, and judges that the low-delay link is available and accessed when receiving a login reply of the multi-line server. When the low-delay link is successfully accessed, the first link can play audio and send audio data packets to the multi-line server, and the second link can also execute the same operation. The multi-line server receives the audio data of the first connecting end and distributes the audio data to the second connecting end; similarly, the audio data of the second microphone is distributed to the first microphone. Because the wheat connecting end connected to the low-time-delay link is provided with the UID of the master singing, the master singing and the accompaniment are defaulted in the same circle, the multi-line server defaults to automatically distribute the audio data in the circle, namely the master singing receives the audio data of all the accompaniment, and the accompaniment receives the audio data of the master singing and other accompaniment. The main singing and the accompaniment can carry out uplink retransmission on the uplink audio data, so that the uplink of the link is ensured to be complete; the main singing and the accompaniment can respectively establish downlink retransmission for each piece of received downlink audio data, thereby ensuring that all audio data from the multi-line server are complete.
The low-delay link can be suitable for the situations that when the master singing and the accompaniment are in different operators, the effective distance of the master singing is relatively far, the joint is not opened or the rtt between the nodes is too high, and the low-delay link is a link with a high probability better than the original link, all signaling can use UDP, and a relatively aggressive retransmission strategy can be used in the uplink and the downlink.
In this embodiment, three links ensure extremely low delay in KTV scene. The three links respectively and independently transmit the audio data, each link can ensure the integrity of the audio data, and when the transmission delay of one link is optimal, the audio data of the optimal link is used by default. The P2P link has no intermediate interaction link, all data are point-to-point, belong to the shortest link and are limited by the P2P open condition among users, so that the link can take effect in most conditions; the low-delay link belongs to a newly added multi-line server, ensures the lowest delay of the links between the main singing and the accompaniment as much as possible, and is satisfied for most users; for the very small part of users, under the conditions that the master singing and the accompaniment cannot be communicated with each other, the delay of a low-delay link is larger than that of the original link, and the like, a certain delay can be ensured through the original link, so that the full coverage of all the users connected with wheat in a KTV scene is ensured. Under the KTV scene, if the audio code rate is 128kbps, for the conventional KTV scene, the added audio is 2-way uplink and +2-way downlink, namely, for a host singing user and an accompaniment user, the uplink of about 300kbps and the downlink of 300kbps are added under normal conditions, most of the networks of the users can be met, and the network delay of the KTV on-line can be dynamically achieved by adding corresponding equipment under the condition of not affecting the original links, so that the delay of the KTV scene is reduced to the minimum as much as possible and all host broadcasting users are covered.
Based on the same inventive concept, the embodiment of the application also provides a live-connection interaction data transmission device for realizing the live-connection interaction data transmission method of the live-connection. The implementation scheme of the device for solving the problem is similar to the implementation scheme described in the above method, so the specific limitation in the embodiments of the one or more live-network communication interactive data transmission devices provided below can be referred to the limitation of the live-network communication interactive data transmission method hereinabove, and will not be repeated here.
In one embodiment, as shown in fig. 8, a live, communication-with-wheat interactive data transmission device is provided, where the device 800 may include:
the link establishment module 801 is configured to establish a point-to-point link with other link ends in the link interaction scene based on the link interaction scene identifier and access a low-delay link corresponding to the link interaction scene identifier on the basis of an original link when entering the link interaction scene of the network live broadcast; the low-delay link is established based on a server address and a multi-line server corresponding to the wheat-connected interaction scene identifier;
the data interaction module 802 is configured to interact with the other link through the original link, the point-to-point link, and the low-latency link respectively;
A data obtaining module 803, configured to obtain first link interaction data provided by a link having an optimal transmission delay for link interaction data of other links in the original link, the point-to-point link, and the low-delay link;
the data presenting module 804 is configured to present, in the headset interaction scene, the first headset interaction data provided by the link with the optimal transmission delay, so that the local headset user can provide the second headset interaction data matched with the first headset interaction data.
In one embodiment, the link establishment module 801 is configured to obtain a link interaction scene identifier of the link interaction scene, and obtain network information of the local link terminal; based on the wheat connecting interaction scene identification, the network information of the local wheat connecting end is sent to the other wheat connecting ends through the broadcasting channel of the original link, and the network information of the other wheat connecting ends is received through the broadcasting channel of the original link; and establishing point-to-point links with the other wheat connecting ends according to the network information of the other wheat connecting ends.
In one embodiment, the link establishment module 801 is configured to send a hole punching confirmation request to the other headset according to the network information of the other headset; and receiving a hole confirmation response corresponding to the hole confirmation request from the other headset terminal, and determining that a point-to-point link is established with the other headset terminal.
In one embodiment, the link establishment module 801 is further configured to remove the peer-to-peer link with another headset terminal if the headset interaction scene identifier of the headset interaction scene is not carried in the link status information from the other headset terminal is received from the peer-to-peer link, or remove the peer-to-peer link with the other headset terminal and notify the other headset terminal in the headset interaction scene to remove the peer-to-peer link with the other headset terminal.
In one embodiment, the link establishment module 801 is further configured to, in performing the data interaction with the other headset terminal through the point-to-point link, retransmit the headset interaction data to the other headset terminal when the data reception acknowledgement response fed back by the other headset terminal is not received, and retransmit the headset interaction data to the other headset terminal when the data retransmission request sent by the other headset terminal is received.
In one embodiment, the link establishment module 801 is configured to obtain a link interaction scene identifier of the link interaction scene, and obtain network information of the local link terminal; the communication interaction scene identification and the network information are sent to a distribution server, so that the distribution server distributes corresponding multi-line servers according to the communication interaction scene identification and the network information; receiving a server address sent by the distribution server; sending a login command carrying the wheat-connected interaction scene identifier to a multi-line server corresponding to the server address; and when receiving the login reply fed back by the multi-line server, determining that the low-delay link is accessed.
In one embodiment, the data obtaining module 803 is configured to send each path of communication interaction data sent from the original link, the point-to-point link and the low-latency link into the data queue according to an incoming time sequence; determining a data sequence number of the wheat-linked interaction data to be presented currently; and acquiring the wheat connecting interaction data which corresponds to the data sequence number and is firstly sent into the data queue from each path of the wheat connecting interaction data of the data queue, and obtaining the first wheat connecting interaction data.
All or part of each module in the live-network wheat-linked interactive data transmission device can be realized by software, hardware and the combination thereof. The above modules may be embedded in hardware or independent of a processor in the electronic device, or may be stored in software in a memory in the electronic device, so that the processor may call and execute operations corresponding to the above modules.
In one embodiment, an electronic device is provided, which may be a user terminal, and the internal structure thereof may be as shown in fig. 9. The electronic device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the electronic device is configured to provide computing and control capabilities. The memory of the electronic device includes a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The communication interface of the electronic device is used for conducting wired or wireless communication with an external device, and the wireless communication can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by a processor to realize a live communication interaction data transmission method. The display screen of the electronic equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the electronic equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
It will be appreciated by those skilled in the art that the structure shown in fig. 9 is merely a block diagram of a portion of the structure associated with the present application and is not limiting of the electronic device to which the present application is applied, and that a particular electronic device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
In an embodiment, there is also provided an electronic device including a memory and a processor, the memory storing a computer program, the processor implementing the steps of the method embodiments described above when executing the computer program.
In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored which, when executed by a processor, carries out the steps of the method embodiments described above.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, database, or other medium used in the various embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magnetic random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (Phase Change Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like. The databases referred to in the various embodiments provided herein may include at least one of relational databases and non-relational databases. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processors referred to in the embodiments provided herein may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic units, quantum computing-based data processing logic units, etc., without being limited thereto.
It should be noted that, user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, presented data, etc.) referred to in the present application are information and data authorized by the user or sufficiently authorized by each party.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples only represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the present application. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application shall be subject to the appended claims.

Claims (11)

1. The method for transmitting the online live wheat-linked interactive data is characterized by comprising the following steps of:
When entering a wheat-linking interaction scene of network live broadcast, establishing a point-to-point link based on a wheat-linking interaction scene identifier and other wheat-linking ends in the wheat-linking interaction scene on the basis of an original link, and accessing a low-delay link corresponding to the wheat-linking interaction scene identifier; the low-delay link is established based on a server address and a multi-line server corresponding to the wheat-connected interaction scene identifier;
respectively carrying out wheat connecting interaction data interaction with the other wheat connecting ends through the original link, the point-to-point link and the low-delay link;
acquiring first link interaction data provided by links with optimal transmission delay for link interaction data of other link ends in the original links, point-to-point links and low-delay links;
and in the communication interaction scene, presenting the first communication interaction data provided by the link with the optimal transmission time delay so as to provide the second communication interaction data matched with the first communication interaction data for the local communication user.
2. The method of claim 1, wherein the establishing a point-to-point link with other link ends in the link interaction scene based on the link interaction scene identification comprises:
Acquiring a wheat connecting interaction scene identifier of the wheat connecting interaction scene, and acquiring network information of a local wheat connecting terminal;
based on the wheat connecting interaction scene identification, the network information of the local wheat connecting end is sent to the other wheat connecting ends through the broadcasting channel of the original link, and the network information of the other wheat connecting ends is received through the broadcasting channel of the original link;
and establishing point-to-point links with the other wheat connecting ends according to the network information of the other wheat connecting ends.
3. The method according to claim 2, wherein the establishing a point-to-point link with the other headset according to the network information of the other headset comprises:
sending a hole punching confirmation request to the other wheat connecting end according to the network information of the other wheat connecting end;
and receiving a hole confirmation response corresponding to the hole confirmation request from the other headset terminal, and determining that a point-to-point link is established with the other headset terminal.
4. A method according to any one of claims 1 to 3, wherein after the peer-to-peer link is established with other peers in the headset interaction scenario based on the headset interaction scenario identification, the method further comprises:
And if the link state information from one other headset terminal does not carry the headset interaction scene identification of the headset interaction scene, removing the point-to-point link with the other headset terminal, or removing the point-to-point link with the other headset terminal and informing the other headset terminal in the headset interaction scene to remove the point-to-point link with the other headset terminal.
5. A method according to any one of claims 1 to 3, further comprising:
in the interaction of the headset interaction data with the other headset ends through the point-to-point links, the headset interaction data is retransmitted to the other headset ends when the data receiving confirmation response fed back by the other headset ends is not received, and the headset interaction data is retransmitted to the other headset ends when the data retransmission request sent by the other headset ends is received.
6. The method of claim 1, wherein the accessing the low-latency link corresponding to the link-to-microphone interaction scenario identification comprises:
acquiring a wheat connecting interaction scene identifier of the wheat connecting interaction scene, and acquiring network information of a local wheat connecting terminal;
The communication interaction scene identification and the network information are sent to a distribution server, so that the distribution server distributes corresponding multi-line servers according to the communication interaction scene identification and the network information;
receiving a server address sent by the distribution server;
sending a login command carrying the wheat-connected interaction scene identifier to a multi-line server corresponding to the server address;
and when receiving the login reply fed back by the multi-line server, determining that the low-delay link is accessed.
7. The method according to any one of claims 1 to 3 and 6, wherein the obtaining the first link interaction data provided by the link having the optimal transmission delay for the link interaction data of the other links among the original link, the point-to-point link and the low-delay link includes:
sending each path of wheat connecting interaction data which are sent in from the original link, the point-to-point link and the low-delay link into a data queue according to the sending time sequence;
determining a data sequence number of the wheat-linked interaction data to be presented currently;
and acquiring the wheat connecting interaction data which corresponds to the data sequence number and is firstly sent into the data queue from each path of the wheat connecting interaction data of the data queue, and obtaining the first wheat connecting interaction data.
8. A live-webcast's company's wheat interactive data transmission device, characterized in that, said device includes:
the link establishment module is used for establishing point-to-point links with other link ends in the link interaction scene based on the link interaction scene identification on the basis of the original links when entering the link interaction scene of the network live broadcast, and accessing the low-delay links corresponding to the link interaction scene identification; the low-delay link is established based on a server address and a multi-line server corresponding to the wheat-connected interaction scene identifier;
the data interaction module is used for carrying out wheat connecting interaction data interaction with the other wheat connecting ends through the original link, the point-to-point link and the low-delay link respectively;
the data acquisition module is used for acquiring first link interaction data provided by links with optimal transmission delay for the link interaction data of other link ends in the original links, the point-to-point links and the low-delay links;
and the data presentation module is used for presenting the first link interaction data provided by the link with the optimal transmission time delay in the link interaction scene so as to provide the second link interaction data matched with the first link interaction data for the local link user.
9. A live-webcast's company's wheat interactive data transmission system, characterized in that, the system includes: each wheat connecting end, access equipment and an original link server of each wheat connecting end for forming an original link, and a multi-line server; wherein,
the access equipment of each wheat connecting end is used for forming a point-to-point link, and the access equipment of each wheat connecting end and the multi-line server are used for forming a low-delay link; each link end is used for transmitting link interaction data according to the method of any one of claims 1 to 7.
10. An electronic device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any one of claims 1 to 7 when the computer program is executed.
11. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 7.
CN202210726169.XA 2022-06-23 2022-06-23 Method, device, system and equipment for transmitting online live wheat-linked interactive data Pending CN117319693A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210726169.XA CN117319693A (en) 2022-06-23 2022-06-23 Method, device, system and equipment for transmitting online live wheat-linked interactive data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210726169.XA CN117319693A (en) 2022-06-23 2022-06-23 Method, device, system and equipment for transmitting online live wheat-linked interactive data

Publications (1)

Publication Number Publication Date
CN117319693A true CN117319693A (en) 2023-12-29

Family

ID=89261035

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210726169.XA Pending CN117319693A (en) 2022-06-23 2022-06-23 Method, device, system and equipment for transmitting online live wheat-linked interactive data

Country Status (1)

Country Link
CN (1) CN117319693A (en)

Similar Documents

Publication Publication Date Title
CN102868916B (en) A kind ofly share the method for information, terminal and system to digital TV terminal
US9191219B2 (en) Network multicast peer discovery methods
KR20100019420A (en) Peer-to-peer collaboration system with edge routing
CN101277248A (en) Method and system for distributing network data
US10348676B1 (en) Method and apparatus of establishing a connection between devices using cached connection information
JP2023508061A (en) ACCOUNT ACCESS METHOD AND DEVICE, STORAGE MEDIUM, AND ELECTRONIC DEVICE
CN112954406B (en) Data downloading method and device, computer equipment and storage medium
CN108234518A (en) A kind of method, apparatus, terminal and the storage medium of terminal communication
CN106550058A (en) Network address translation penetration method and system using same
CN103716230B (en) Message sending method, device and server
JP2012083891A (en) Failover system, storage processor, and failover control method
US6993348B2 (en) Radio terminal, communication control method and computer program
CN103595546A (en) Method and apparatus for realizing reliable multicast
US8959243B2 (en) System and method to guide active participation in peer-to-peer systems with passive monitoring environment
CN112398754B (en) Data transmission method, device, medium, electronic equipment and network access equipment
CN112398845B (en) Data transmission method, data transmission device, data transmission system and electronic equipment
CN107483628B (en) DPDK-based one-way proxy method and system
CN113452778A (en) Session keeping method, device, equipment, system and storage medium
CN104521211A (en) Session connection establishment method, apparatus and system
US20120331154A1 (en) Method and apparatus of establishing a connection between devices using cached connection information
CN117319693A (en) Method, device, system and equipment for transmitting online live wheat-linked interactive data
WO2016095510A1 (en) Path selection method, device and system
CN104780230A (en) Method of automatically acquiring cloud server IP address, system and cloud system
CN107094175A (en) A kind of server disposition structure and interoperability methods for realizing interworking between network
KR102025375B1 (en) Apparatus and method for data distribution service, data distribution service system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination