CN113691799B

CN113691799B - Live stream interaction control method and corresponding device, equipment and medium thereof

Info

Publication number: CN113691799B
Application number: CN202110916283.4A
Authority: CN
Inventors: 何永德; 林绪虹; 刘科
Original assignee: Guangzhou Huaduo Network Technology Co Ltd
Current assignee: Guangzhou Huaduo Network Technology Co Ltd
Priority date: 2021-08-11
Filing date: 2021-08-11
Publication date: 2023-07-04
Anticipated expiration: 2041-08-11
Also published as: CN113691799A

Abstract

The application relates to the field of network live broadcast and discloses a live broadcast stream interaction control method and corresponding devices, equipment and media thereof, wherein the method comprises the following steps: establishing a data communication link of the push device, which is relayed by the server to the broadcast stream device, wherein the data communication link is used for pushing the live stream generated by the push device into the broadcast stream device; the network transmission performance of the data communication link is controlled in a simulation mode by applying preset link control information so as to control the audio and video quality of the live stream reaching the stream playing equipment; and receiving the live stream generated by the push stream equipment through the data communication link, and forwarding the live stream to the play display in the push stream equipment. The method and the device can simulate and reproduce the real production environment network for the transmission of the live stream, and conveniently track the online audio and video quality problem or limit the audio and video quality according to the requirement.

Description

Live stream interaction control method and corresponding device, equipment and medium thereof

Technical Field

The present disclosure relates to the field of network live broadcast, and in particular, to a live broadcast stream interaction control method and apparatus, and corresponding electronic device and non-volatile storage medium.

Background

In audio/video interaction and network live broadcast scenes, various network environments, including normal network and weak network conditions, are often required to be simulated by using network damage equipment in a laboratory, and the network factors which are mainly required to be simulated are packet loss rate, bandwidth, time delay and the like, and then the audio/video quality under various transmission and coding strategies is evaluated through the simulated network environments. In the whole process, there are two outstanding problems:

1) The network condition needs to be manually modified, and the evaluation result needs to be collected through means of manual screen recording, photographing, subjective audio-visual and the like, so that the result arrangement is time-consuming and labor-consuming, is easy to make mistakes and has strong subjectivity.

2) The simulation of the network in the laboratory is realized by a network injury instrument, and the damage of the existing network injury instrument to the network condition can only be simulated by a few modes (such as fixed, random, burst, sine and the like), so that the method greatly simplifies the complexity and the timeliness of the network, is far from the network condition encountered in the actual production environment, and therefore, the evaluation of the audio/video coding and decoding and transmission algorithm strategy is not comprehensive enough, the laboratory good result is easy to obtain by the trial practice, but the AB test on the actual production environment can not obtain good results.

Taking a network live broadcast system as an example, the traditional scheme is to access a network damage device to an uplink or downlink network, simulate various weak network conditions through the network damage device, and then collect the quality of audio and video received by a watching end at a spectator end through manual means such as screen recording, photographing and the like. In the test process, one use case is tested, and the next use case is tested by manually modifying the weak network condition.

Therefore, the simulation technology of the network environment required by the audio/video interaction in the network live broadcast process in the prior art has the defects, which cause the related test efficiency to be low and the related test efficiency to be improved.

Disclosure of Invention

It is an object of the present application to solve at least one of the above problems and provide a live stream interaction control method, and corresponding apparatus, computer device, non-volatile storage medium, for implementing an automated distribution test for an application.

In order to meet the purposes of the application, the application adopts the following technical scheme:

the live stream interaction control method provided by adapting to one of the purposes of the application comprises the following steps:

establishing a data communication link of the push device, which is relayed by the server to the broadcast stream device, wherein the data communication link is used for pushing the live stream generated by the push device into the broadcast stream device;

The network transmission performance of the data communication link is controlled in a simulation mode by applying preset link control information so as to control the audio and video quality of the live stream reaching the stream playing equipment;

and receiving the live stream generated by the push stream equipment through the data communication link, and forwarding the live stream to the play display in the push stream equipment.

In a specific embodiment, establishing a data communication link that the push device reaches the broadcast streaming device through the relay of the server includes the following steps:

responding to an opening event of the pushing equipment in a live broadcasting room, and establishing a first branch link between the pushing equipment and the server for uploading the live broadcasting stream so as to receive the live broadcasting stream uploaded by the pushing equipment;

responding to an entry event triggered by the broadcast stream equipment in the live broadcast room, and establishing a second branch link between the server and the broadcast stream equipment for pushing the live broadcast stream so as to push the live broadcast stream to the broadcast stream equipment;

and continuously transmitting the live stream through the data communication link formed by the first branch link and the second branch link.

In a specific embodiment, the network transmission performance of the data communication link is controlled by applying preset link control information in a simulation manner, so as to control the audio and video quality of the live stream reaching the streaming device, and the method comprises the following steps:

Detecting whether link control information of the data communication link is in an enabling state, and if so, starting to apply the link control information;

analyzing the enabled link control information to obtain at least one simulation control instance calibrated with the operation time length, wherein each simulation control instance comprises network transmission performance configuration parameters corresponding to a plurality of time slices within the operation time length range;

adapting to each simulation control example, correspondingly adapting to the network transmission performance configuration parameters according to the time sequence of the time slice, and implementing simulation control on the data communication link.

In a further embodiment, detecting whether link control information of the data communication link is in an enabled state, and if so, starting to apply the link control information includes the following steps:

detecting whether the push stream equipment and the broadcast stream equipment are simulation service objects according to the respective user characteristic information of the push stream equipment and the broadcast stream equipment;

aiming at the simulation service object, judging that the link control information of the simulation service object is in an enabling state, and calling the link control information corresponding to the simulation service object;

and starting and applying the adaptive link control information for the simulation service object, so that each link control information is applied to a corresponding branch link in the data communication link, the branch link between the pushing equipment and the server is applicable to the link control information corresponding to the pushing equipment, and the branch link between the server and the streaming equipment is applicable to the link control information corresponding to the streaming equipment.

In a preferred embodiment, adapting to each simulation control instance, correspondingly adapting to the network transmission performance configuration parameters according to the time sequence of the time slice, and implementing simulation control on the data communication link, including the following steps:

adapting to each simulation control instance to obtain network transmission performance configuration parameters of time slice organization;

sequentially calling the network transmission performance configuration parameters corresponding to each time slice according to time sequence, wherein the network transmission performance configuration parameters comprise time stamps, bandwidth values, minimum round trip delay, maximum round trip delay and packet loss rate corresponding to the time slices;

the following simulation control is implemented on the data communication link in the time range lasting until the current time slice before the arrival of the next time stamp: and restraining the data communication link to transmit the live stream by taking the bandwidth value as the highest bandwidth, restraining the round trip delay of the live stream between the minimum round trip delay and the maximum round trip delay, and restraining the live stream to randomly discard the data message according to the packet loss rate.

In an alternative embodiment, in the step of analyzing the enabled link control information, the link control information includes a plurality of simulation control instances, the running time length uniformly calibrated for the plurality of simulation control instances, and an interval time length for controlling the two simulation control instances to sequentially implement the simulation control.

In an extended embodiment, the method further comprises the steps of:

pushing a test configuration page to a management user in response to a configuration request triggered by the management user;

receiving test configuration information submitted by a management user through the test configuration page, wherein the test configuration information comprises link control information and adaptive user characteristic information thereof;

and responding to a checking instruction of a management user, pushing a test report to the management user, wherein the test report comprises summarized information formed by inquiring and acquiring sampling data representing the audio and video quality from a database, and the sampling data is sampled and submitted to the database by the streaming equipment.

The utility model provides a live stream interaction control device who adapts to one of the purpose of this application, includes link establishment module, emulation control module to and transmission live module, wherein: the link establishment module is used for establishing a data communication link of the push stream equipment, which is relayed by the server to the broadcast stream equipment, and the data communication link is used for pushing the live stream generated by the push stream equipment into the broadcast stream equipment; the simulation control module applies preset link control information to simulate and control the network transmission performance of the data communication link so as to control the audio and video quality of the live stream reaching the stream playing equipment; and the live transmission module is used for receiving the live stream generated by the push stream equipment through the data communication link and forwarding the live stream to the broadcast stream equipment for playing and displaying.

In a specific embodiment, the link establishment module includes: an on-stream uploading sub-module, configured to respond to an on-stream event of a push device in a live broadcast room, and establish a first branch link between the push device and a server for uploading the live broadcast stream, so as to receive the live broadcast stream uploaded by the push device; the entering plug flow sub-module is used for responding to an entering event triggered by the broadcast flow equipment in the live broadcast room, and establishing a second branch link between the server and the broadcast flow equipment for pushing the live broadcast flow so as to push the live broadcast flow to the broadcast flow equipment; and the continuous transmission sub-module is used for continuously transmitting the live stream through the data communication link formed by the first branch link and the second branch link.

In a specific embodiment, the simulation control module includes: the starting detection sub-module is used for detecting whether the link control information of the data communication link is in a starting state, and starting to apply the link control information if the link control information is in the starting state; the method comprises the steps of calling an analysis submodule, wherein the analysis submodule is used for analyzing the enabled link control information to obtain at least one simulation control instance calibrated with operation time length, and each simulation control instance comprises network transmission performance configuration parameters corresponding to a plurality of time slices within the operation time length range; and the simulation implementation sub-module is used for adapting to each simulation control instance, correspondingly adapting to the network transmission performance configuration parameters according to the time sequence of the time slice, and implementing simulation control on the data communication link.

In a further embodiment, the enabling detection submodule includes: the object recognition secondary module is used for detecting whether the pushing equipment and the broadcasting equipment are simulation service objects according to the respective user characteristic information of the pushing equipment and the broadcasting equipment; the state recognition secondary module is used for judging that the link control information of the simulation service object is in an enabling state and calling the link control information corresponding to the simulation service object; the differential adaptation second-level module is used for starting and applying the adaptive link control information for the simulation service object, so that each link control information is applied to the corresponding branch link in the data communication link, the branch link between the pushing equipment and the server is applicable to the link control information corresponding to the pushing equipment, and the branch link between the server and the streaming equipment is applicable to the link control information corresponding to the streaming equipment.

In a preferred embodiment, the simulation implementation submodule includes: the parameter acquisition secondary module is used for adapting to each simulation control instance and acquiring network transmission performance configuration parameters of the time slice organization; the slice calling secondary module is used for sequentially calling the network transmission performance configuration parameters corresponding to each time slice according to time sequence, wherein the network transmission performance configuration parameters comprise time stamps, bandwidth values, minimum round trip delay, maximum round trip delay and packet loss rate corresponding to the time slices; and the slice simulation secondary module is used for implementing the following simulation control on the data communication link in the time range of the current time slice lasting until the next time stamp arrives: and restraining the data communication link to transmit the live stream by taking the bandwidth value as the highest bandwidth, restraining the round trip delay of the live stream between the minimum round trip delay and the maximum round trip delay, and restraining the live stream to randomly discard the data message according to the packet loss rate.

In an alternative embodiment, the link control information called by the calling analysis sub-module includes a plurality of simulation control instances, the operation duration uniformly calibrated for the simulation control instances, and an interval duration for controlling the two simulation control instances to sequentially implement the simulation control.

In an extended embodiment, the present apparatus further includes: the configuration response module is used for responding to a configuration request triggered by the management user and pushing a test configuration page to the management user; the configuration implementation module is used for receiving the test configuration information submitted by the management user through the test configuration page, wherein the test configuration information comprises link control information and adaptive user characteristic information thereof; and the report checking module is used for responding to a checking instruction of a management user and pushing a test report to the management user, wherein the test report comprises summarized information formed by inquiring and acquiring sampling data representing the audio and video quality from a database, and the sampling data is sampled and submitted to the database by the streaming equipment.

A computer device provided in accordance with one of the objects of the present application comprises a central processor and a memory, the central processor being adapted to invoke the steps of running a computer program stored in the memory to perform the live stream interactive control method described herein.

A non-volatile storage medium adapted to another object of the present application is provided, in which a computer program implemented according to the live stream interactive control method is stored in the form of computer readable instructions, which computer program, when being called by a computer for running, performs the steps comprised by the method.

Compared with the prior art, the method has the following advantages:

the method and the device can conveniently and automatically simulate and control the network transmission performance of the live stream passing data communication link by means of the pre-provided link control information, realize the simulation and reproduction of the actual production environment network, thereby helping to complete the test of the live stream interaction process and conveniently tracking the online audio and video quality problem.

According to the method and the device, the network simulation use case is automatically covered by means of the link control information, so that the labor cost is greatly saved, the objectivity and the uniformity of the audio and video quality evaluation standard are improved, and the audio and video quality comparison of front and back versions, different network conditions and different algorithm strategies is facilitated.

According to the method and the device, network simulation is carried out by automatically applying network damage operation to the data communication link through the link control information, compared with the situation that weak network conditions are simulated by using network damage equipment or software damage tools in the past, only relevant information of a control process is required to be written in the link control information, the damage conditions are not required to be manually modified and switched, and the whole-course automatic high-efficiency test is convenient to realize.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:

FIG. 1 is a schematic diagram of a typical deployment architecture associated with implementing the teachings of the present application;

fig. 2 is a flow chart of an exemplary embodiment of a live stream interaction control method of the present application;

fig. 3 is a schematic flow chart of establishing a data communication link by the live stream interaction control method of the present application;

fig. 4 is a schematic flow chart of implementing simulation control by the live stream interaction control method of the present application;

fig. 5 is a schematic flow chart of enabling link control information in the live stream interaction control method of the present application;

FIG. 6 is a schematic flow chart of an example of simulation control applicable to the live stream interactive control method of the present application;

fig. 7 is a flow chart illustrating a process of managing user operations in an extended embodiment of the live stream interactive control method of the present application;

FIG. 8 is a functional block diagram of an exemplary embodiment of a live stream interactive control device of the present application;

fig. 9 is a schematic structural diagram of a computer device used in the present application.

Detailed Description

Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of illustrating the present application and are not to be construed as limiting the present application.

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless expressly stated otherwise, as understood by those skilled in the art. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. The term "and/or" as used herein includes all or any element and all combination of one or more of the associated listed items.

It will be understood by those skilled in the art that all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs unless defined otherwise. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

As used herein, "client," "terminal device," and "terminal device" are understood by those skilled in the art to include both devices that include only wireless signal receivers without transmitting capabilities and devices that include receiving and transmitting hardware capable of two-way communication over a two-way communication link. Such a device may include: a cellular or other communication device such as a personal computer, tablet, or the like, having a single-line display or a multi-line display or a cellular or other communication device without a multi-line display; a PCS (Personal Communications Service, personal communication system) that may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant ) that can include a radio frequency receiver, pager, internet/intranet access, web browser, notepad, calendar and/or GPS (Global Positioning System ) receiver; a conventional laptop and/or palmtop computer or other appliance that has and/or includes a radio frequency receiver. As used herein, "client," "terminal device" may be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or adapted and/or configured to operate locally and/or in a distributed fashion, at any other location(s) on earth and/or in space. As used herein, a "client," "terminal device," or "terminal device" may also be a communication terminal, an internet terminal, or a music/video playing terminal, for example, a PDA, a MID (Mobile Internet Device ), and/or a mobile phone with music/video playing function, or may also be a device such as a smart tv, a set top box, or the like.

The hardware referred to by the names "server", "client", "service node" and the like in the present application is essentially an electronic device having the performance of a personal computer, and is a hardware device having necessary components disclosed by von neumann's principle, such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, and an output device, and a computer program is stored in the memory, and the central processing unit calls the program stored in the external memory to run in the memory, executes instructions in the program, and interacts with the input/output device, thereby completing a specific function.

It should be noted that the concept of "server" as referred to in this application is equally applicable to the case of a server farm. The servers should be logically partitioned, physically separate from each other but interface-callable, or integrated into a physical computer or group of computers, according to network deployment principles understood by those skilled in the art. Those skilled in the art will appreciate this variation and should not be construed as limiting the implementation of the network deployment approach of the present application.

Referring to fig. 1, the hardware base required for implementing the related technical solution of the present application may be deployed according to the architecture shown in the figure, and the roles and functions of each part are as follows:

the remote server 80 referred to herein may serve as a front-end service server, and is responsible for further connecting to related data servers to form a logically associated service cluster for providing services to related terminal devices, such as

smartphones

81, 82 and personal computers as shown in the figure. The

smart phones

81, 82 and the personal computer can establish a data communication link with the remote server 80 through a well-known network access mode.

The remote server 80 is suitable for providing audio and video push services such as network live broadcast and instant communication, and provides corresponding internet services for corresponding terminal equipment by running the services, so that different users can exchange communication data between the users by using the services of the remote server 80 through the respective terminal equipment. For example, a host user in a webcast room may upload his live stream from a push device 81 where he is located to the remote server 80 and then push it by the remote server 80 to a streaming device 82 where one or more viewer users are located. Since this application focuses primarily on push services provided by remote server 80, it may also be referred to as a media server.

The push device 81 and the play device 82 belong to a terminal device referred to in the application, the terminal device is provided with related operating systems, such as Android, IOS, homoneyOS and other operating systems providing the same function, under the support of such operating systems, the remote server 80 and the terminal device can perform data communication through mutually agreed data protocols, and application programs adaptively developed for the operating systems can also normally run in the terminal device, so that the terminal device can implement man-machine interaction, remote interaction and various indirect interactions with other terminals through the remote server by virtue of the running of the application programs.

The data server 88, which is referred to herein as a data server, is adapted to store the sampled data collected by the push device 81 and the broadcast device 82 and the summary information formed after statistical analysis thereof, and is equipped with a background management logic that can be accessed by a management user, and functions implemented on the data server 88 are also strongly integrated by a cluster where the remote server 80 is located, which can be flexibly implemented by a person skilled in the art without affecting the implementation of the present application.

The application program refers to an application program running on an electronic device such as a server or a terminal device in a general meaning, the application program adopts a programming mode to implement the related technical scheme of the application, the program code of the application program can be stored in a computer-readable nonvolatile storage medium in the form of computer executable instructions, and the program code can be called by a central processing unit to run in a memory, and the related device of the application is constructed by the running of the application program on the computer.

In the network live broadcasting room, called as a live broadcasting room for short, a cluster where the remote server 80 is located is responsible for maintenance and operation, and a host user, a spectator user or other tourist users can enter a live broadcasting room instance associated with the host user through the operation of an application program on a terminal device, wherein the host user can submit a live broadcasting stream to a media server through a stream pushing device of the host user so as to be pushed to a stream pushing device where the relevant spectator user located in the live broadcasting room instance by the media server.

Those skilled in the art will appreciate that: although the various methods of the present application are described based on the same concepts so as to be common to each other, the methods may be performed independently, unless otherwise indicated. Similarly, for each of the embodiments disclosed herein, the concepts presented are based on the same inventive concept, and thus, the concepts presented for the same description, and concepts that are merely convenient and appropriately altered although they are different, should be equally understood.

The various embodiments to be disclosed herein, unless the plain text indicates a mutually exclusive relationship with each other, the technical features related to the various embodiments may be cross-combined to flexibly construct a new embodiment, so long as such combination does not depart from the inventive spirit of the present application and can satisfy the needs in the art or solve the deficiencies in the prior art. This variant will be known to the person skilled in the art.

Referring to fig. 2, in an exemplary embodiment of the present application, an application program on a media server side is responsible for executing the implementation, and the method includes the following steps:

step S1100, a data communication link of the push device reaching the broadcast stream device through the relay of the server is established, and the data communication link is used for pushing the live stream generated by the push device into the broadcast stream device:

the streaming equipment is terminal equipment with playing control function, wherein the streaming equipment is the terminal equipment with playing control function, the other users in the network living broadcast room are usually registered audience users, and after the host user pushes the live stream to the server, namely the media server, through the streaming equipment, the server pushes the live stream to the streaming equipment, wherein the audience users are located. It follows that there is a data communication link between the push device and the cast device, which is relayed via the server. The data communication link is established in a segmented manner, and the detailed process of the establishment is disclosed in other embodiments, so that the server establishes a first branch link of the data communication link with the host user when the host user logs in the live broadcasting room of the host user and starts the live broadcasting room of the host user, and ensures that the live broadcasting equipment can push the live broadcasting stream of the host user to the server through the first branch link; when the audience user enters the live broadcasting room in the broadcasting equipment, the server establishes a second branch link of the data communication link with the audience user, so that the server can push the live broadcasting stream to the broadcasting equipment through the second branch link to play and display.

The live stream can be locally collected or synthesized through the plug-flow equipment, and necessary synthesis and collection can be carried out after the live stream reaches the server, so that the live stream can be flexibly processed, and the implementation of the application is not affected.

Step S1200, applying preset link control information to simulate and control the network transmission performance of the data communication link, so as to control the audio/video quality of the live stream reaching the streaming device:

under normal conditions, the live stream is transmitted by using the data communication link based on objective and realistic network conditions provided by an operator between the push stream device and the broadcast stream device, and the application provides a technical means for controlling the network transmission performance of the data communication link so as to meet the requirements of current limiting or testing and the like.

For this purpose, link control information may be applied to the data communication link, where the link control information is used to describe configuration parameters related to network transmission performance of one or all branch links in the data communication link, and simulate and control network transmission conditions when the corresponding branch links transmit the live stream according to the configuration parameters, so as to perform a network impairment function on a transmission process of the live stream, thereby implementing simulation of transmission of the live stream in a weak network environment.

The application of the link control information may be initiated by checking device characteristic information of the terminal device or by checking whether user characteristic information of the anchor user, audience user is added to a control list. Specifically, when program testing or network restriction control is required, it can be established whether the user or the device is the object of control, once the user or the device is established, the corresponding user characteristic information or the device unique characteristic information is added into a control list of a background, and the server can query whether the current user characteristic information or the device unique characteristic information is in the control list according to a default trigger mechanism, for example, when a target living broadcast room is started, a host user starts the living broadcast room, a viewer user enters the living broadcast room, or a test user sends a related instruction, thereby the link control information can be applied to the user or the device entering the control list.

Whether the network impairment effect implemented by the link control information acts on the whole data communication link or on one of the branch links, it can be understood that, compared with an objective network environment, the audio/video quality of the live stream reaching the streaming device after implementing the network impairment will be relatively reduced.

In one embodiment, for the requirement of audio and video interaction test of a live stream, service logic related to audio and video quality data acquisition can be preset in an application program of the live stream equipment side, and the audio and video quality data of the live stream can be acquired through embedding points in advance and uploaded to a data server for standby. The data reflecting the audio and video quality, including the code rate, resolution, frame rate, clamping rate, time delay, audio and video synchronization difference, audio and video output speed and the like during the live stream transmission, can be buried point acquisition as required, and can be flexibly determined by a person skilled in the art. After mastering the data, a tester can abandon traditional photographing, screen recording and other modes, and only needs to analyze the audio and video quality under the action of the link control information by using objective data.

Step S1300, receiving the live stream generated by the push stream device through the data communication link, and forwarding the live stream to the play display in the play stream device:

the server still serves the operation of each live broadcasting room according to the logic for maintaining the operation of the network live broadcasting room instance, when one of the data communication links is applied with corresponding link control information and is damaged by the implementation network, the corresponding push stream equipment can still push the live stream to the corresponding broadcast stream equipment through the data communication link through the relay of the server, and after the broadcast stream equipment receives the live stream, the broadcast stream equipment outputs the live stream to the broadcast room player according to default service logic regardless of the audio and video quality.

For the situation that the audio and video quality data acquisition related codes are pre-embedded at the streaming equipment side, the streaming equipment continuously acquires the audio and video quality data of the received live streaming under the action of the instructions generated by the codes of the embedded points and submits the audio and video quality data to the data server so as to achieve the aim of testing in a matching way.

According to the method and the device for simulating and controlling the network transmission performance of the live stream through the data communication link, disclosed by the exemplary embodiment, the network transmission performance of the live stream through the data communication link can be conveniently and automatically simulated and controlled by means of the link control information provided in advance, perfect simulation and reproduction of a real production environment network are achieved, testing of a live stream interaction process is facilitated, and online audio and video quality problems are conveniently tracked.

Furthermore, by automatically covering the network simulation use cases by means of the link control information, the method and the device greatly save labor cost, improve objectivity and uniformity of the audio and video quality evaluation standard, and facilitate audio and video quality comparison of front and back versions, different network conditions and different algorithm strategies.

In addition, the network simulation is carried out by automatically applying network damage operation to the data communication link through the link control information, and compared with the situation that the weak network condition is simulated by using network damage equipment or a software damage tool in the past, the method and the device only need to write the control process related information in the link control information, do not need to manually modify and switch the damage condition, and are convenient for realizing the whole-course automatic high-efficiency test.

Referring to fig. 3, in an embodiment, a data communication link between a push device and a broadcast device via a relay of a server is established, which includes the following steps:

step S1110, in response to an on-air event of the push device in the live broadcast room, a first branch link between the push device and the server for uploading the live broadcast stream is established, so as to receive the live broadcast stream uploaded by the push device:

the service related to network live broadcast generally allows each user to create a live broadcast room instance of the user, wherein the user starting the live broadcast room instance to play to other users is a host user, and the terminal equipment where the host user is located is the push equipment of the application; the user who enters the living broadcast room to receive the living broadcast stream of the host user for playing is the audience user of the living broadcast room instance, and the application program of the network living broadcast can play and display the living broadcast stream after receiving the corresponding living broadcast stream of the living broadcast room instance.

When a main broadcasting user needs to start broadcasting, a broadcasting instruction is triggered in a network live broadcasting application program of the streaming equipment, a live broadcasting room interface can be entered accordingly, a broadcasting event is generated, a live broadcasting stream locally generated by the streaming equipment is pushed to a media server according to a default service logic of the application program, and the live broadcasting stream generally comprises audio and video contents.

The media server responds to an opening event generated by the streaming equipment in a live broadcasting room, automatically establishes a data communication link between the streaming equipment and the server according to service logic of an application program pre-protocol of the streaming equipment, namely a first branch link in the data communication link between the streaming equipment and the streaming equipment, so that the streaming equipment continuously uploads live streams of the streaming equipment to the media server through the first branch link.

Step S1120, in response to an entry event triggered by the streaming device in the live broadcast room, a second branch link between the server and the streaming device for pushing the live broadcast stream is established, so as to push the live broadcast stream to the streaming device:

the media server continuously maintains the operation of the live broadcast room examples related to the main broadcasting user, and sequentially pushes the live broadcast stream pushed by the push device where the main broadcasting user of the live broadcast room is located to the audience user entering the live broadcast room, so as to play a role of relay.

When any audience user in the living broadcast room enters the living broadcast room, a corresponding entry event of the audience user entering the living broadcast room is generated according to business logic preset by an application program, and therefore the server can receive the entry event and acquire user characteristic information of the audience user and further respond to the entry event.

In order to realize the relay push function of the server, the server responds to the entry event, establishes a data communication link between the server and the broadcast stream equipment where the corresponding audience user is located, forms a second branch link in the data communication link between the push equipment and the broadcast stream equipment, and can continuously relay and forward the live broadcast stream uploaded by the push equipment to the broadcast stream equipment through the second branch link.

Step S1130, continuously transmitting the live stream through the data communication link formed by the first branch link and the second branch link:

according to the inherent logic of the live room application, once the first branch link is established, the anchor user is allowed to upload the live stream to the server, once the second branch link is established, the server is allowed to push the corresponding live stream to the corresponding stream device, therefore, the establishment process of the whole data communication link between the anchor user and the audience user is completed once the first branch link and the second branch link between the anchor user and the audience user are established, and the transmission of the live stream between the anchor user and the audience user can be serviced.

It will be appreciated that since the internet is implemented based on the TCP/IP protocol, whereas the audio-video data is typically encapsulated in UDP data packets, the first and second branch links are typically maintained in a long link, as will be appreciated by those skilled in the art.

The embodiment further discloses a process of establishing a data communication link between the push stream device and the broadcast stream device, and it can be seen that the data communication link can be established based on the inherent business logic of the corresponding live broadcast room instance of the network live broadcast without additional independent implementation, so that implementation of the technical scheme of the application at the media server is beneficial to saving implementation cost of the application and realizing the purpose of the application efficiently.

Referring to fig. 4, in the embodiment, in step S1200, the network transmission performance of the data communication link is controlled by applying preset link control information to simulate, so as to control the audio/video quality of the live stream reaching the streaming device, and the method includes the following steps:

step S1210, detecting whether link control information of the data communication link is in an enabled state, and if so, starting to apply the link control information:

For any one data communication link, whether the corresponding link control information needs to be applied to realize network transmission performance control can be registered in the background. In the foregoing embodiment, a control list may be constructed in the server, in which corresponding enabling state information of a user that needs to implement network transmission performance simulation control is registered, and in particular, mapping relationship data between user feature information of the user and enabling state information thereof may be stored for implementation, so that when a host user or a viewer user enables a corresponding data communication link, the server may query the control list to find whether the corresponding user feature information is marked as an enabling state, and if in the enabling state, the corresponding link control information is started for its corresponding branch link, that is, a branch link between the terminal device and the media server.

In an improved embodiment, the enabling state information may be implemented as a state flag in the personal setting information of the user, so if simulation control of the application needs to be applied to some users, only the corresponding state flag of the users needs to be modified to be the enabling state, and then the server determines whether to apply corresponding link control information to the branch link corresponding to the corresponding user by querying the state flag.

The link control information can be integrated in the same file and data table, or can be distributed in a plurality of files and data tables according to the difference of the properties of the first branch link and the second branch link. In this embodiment, it is recommended that the first link control information is independently compiled for the first branch link, the second link control information is independently compiled for the second branch link, then the first link control information is uniformly applied to the first branch links corresponding to the plurality of push devices, and the second link control information is uniformly applied to the second branch links corresponding to the plurality of broadcast devices. Therefore, only two kinds of link control information are needed to be compiled, standardized test or control can be carried out on each data communication link, and the implementation efficiency of the application is improved.

Step S1220, analyzing the enabled link control information to obtain at least one simulation control instance calibrated with the operation duration, where each simulation control instance includes network transmission performance configuration parameters corresponding to a plurality of time slices within the operation duration range:

the link control information is usually compiled according to a certain predetermined format so as to be correspondingly parsed by the server according to the format specification. The following illustrates one format specification:

[ run duration ] [ interval duration ]

[ simulation control example 1 File name ]

[ simulation control example 2 File name ]

……

[ simulation control instance n File name ]

It can be seen that one link control information includes two parameters and at least one simulation control instance (indicated by a storage path/file name), wherein the parameter "run time" is used to calibrate the length of run time for which each simulation control instance is adapted to exert a weak network control effect on the data communication link, and in some variant embodiments, it is also contemplated that the run time is independently calibrated for each simulation control instance; the parameter "interval duration" is an option for indicating the time interval between two simulation control instances that are successively applicable. According to this specification, the following link control information can be formulated:

180 120

100_600k_35loss.txt

45loss_50_300delay.txt

100_500k_50_300rtt.txt

after the analysis of the link control information is performed, three simulation control instances can be obtained, the operation duration of the obtained simulation control instance is 180s, and the interval duration between the two simulation control instances is 120s.

It should be appreciated that, those skilled in the art can flexibly compile link control information with reference to the examples herein, and are not limited by the examples herein, as long as the present server can correspondingly parse and obtain corresponding parameters and simulation control instances according to the compiling specification of the link control information.

For simplicity of description, in the link control information, each simulation control instance is indicated in the form of its storage path or file name, so the server should further obtain the specific content of the simulation control instance according to its file name, and in fact, in some embodiments, the specific content of the simulation control instance may also be directly written into the link control information, without being separately stored in a file, which will be understood by those skilled in the art.

For the orchestration format specification for each simulation control instance, reference may be made to the following examples:

[ timestamp 1] [ Bandwidth value ] [ minimum round-trip delay ] [ maximum round-trip delay ] [ packet loss Rate ]

[ timestamp 2] [ Bandwidth value ] [ minimum round-trip delay ] [ maximum round-trip delay ] [ packet loss Rate ]

Timestamp 3 bandwidth value minimum round trip delay maximum round trip delay packet loss ratio

……

[ timestamp n ] [ Bandwidth value ] [ minimum round-trip delay ] [ maximum round-trip delay ] [ packet loss Rate ]

Wherein each row includes a timestamp and a network transmission performance configuration parameter. The time stamps can be arranged in a time sequence, and a time slice is defined between two time stamps adjacent in time sequence, and each time stamp is the starting time of the time slice to which the time stamp belongs. The network transmission performance configuration parameters mainly comprise parameters such as bandwidth value, minimum round trip time delay, maximum round trip time length, packet loss rate and the like, and the parameters can be flexibly determined by one skilled in the art as required, including one or more of the parameters is preferred, or related parameters are added and removed. The bandwidth value is used for representing the transmission live stream of the applicable data communication link according to the specified highest bandwidth simulation control; the minimum round trip delay and the maximum round trip delay are used for jointly simulating and defining the dynamic change range of the round trip delay between two ends when the data communication link transmits the corresponding live stream, so that the actual round trip delay is between the minimum round trip delay and the maximum round trip delay; the packet loss rate is used for simulating and controlling the direct broadcast stream transmitted in the data communication link to randomly discard the data message according to the calibrated percentage thereof, so that the maximum comprehensive packet loss rate is equal to or close to the percentage. In one specific example implemented according to this specification, as described in the simulation control instance 100_600k_35loss.txt in the previous link control information example, the following is shown:

As can be seen from the examples herein, the respective bandwidth values of the different time slices are varied, so that after parsing out these configuration parameters, the live stream can be subsequently switched at different times for transmission in the data communication link in accordance with the respective bandwidth values. Although other parameters are unchanged, those skilled in the art will appreciate that other parameters may be set as desired.

Therefore, the pre-programmed link control information can be correctly resolved as long as a certain format specification is complied with, and then the intermediate simulation control instance is called to realize simulation control of the network transmission performance in the data communication link.

Step S1230, adapting to each simulation control instance, correspondingly applying the network transmission performance configuration parameters according to the time sequence of the time slice, and implementing simulation control on the data communication link:

after the link control information is analyzed, the time stamp corresponding to each time slice corresponding to each simulation control instance and the network transmission performance configuration parameter corresponding to each time slice are obtained, and accordingly, simulation control can be implemented on the corresponding data communication link, and the purpose of simulating network transmission performance change of the data communication link is achieved.

According to the embodiment, the network transmission performance of the data communication link can be accurate to the time slice level through the programming of the link control information, different network transmission performance configuration parameters are applicable to different time slices, the simulation of complex network conditions is realized, the instant change and jitter condition of the network can be reflected through controlling the granularity of the time slices, the effect of fine simulation of the network transmission performance is realized, and when the method is used for implementing the test of the audio/video interaction of the live stream, the method is simple and easy to use, the network description is accurate, and the test effect can be obtained efficiently and at low cost.

Referring to fig. 5, in a deepened embodiment, in step S1210, detecting whether link control information of the data communication link is in an enabled state, and if so, starting to apply the link control information, including the following steps:

step S1211, detecting whether the push device and the broadcast device are simulation service objects according to the user characteristic information of the push device and the broadcast device respectively:

as described above, when the push device establishes the first branch link in the data communication link with the server, and when the broadcast device establishes the second branch link in the data communication link with the server, the server can determine whether the user characteristic information of the anchor user logged in the push device and the user characteristic information of the audience user logged in the broadcast device are registered in the control list in advance, if yes, the corresponding push device and broadcast device are simulation service objects of the application.

In practical application, only the first branch link of the push device is required to be subjected to simulation control, only the second branch link of the broadcast device is required to be subjected to simulation control, and the whole data communication link is required to be subjected to simulation control, and the choice is specific depending on whether the corresponding user characteristic information of the push device and the corresponding user characteristic information of the broadcast device are registered in the control list in advance.

Step S1212, for the simulation service object, determines that the link control information thereof is in an enabled state, and invokes the link control information corresponding to the simulation service object:

for the emulated service object, it may be further detected whether its link control information is in an enabled state. As described above, the link control information may be adapted to the first branch link and the second branch link to be respectively configured, in this case, if the emulation service object includes a push device, it is detected whether the corresponding link control information is in an enabled state, and if the emulation service object includes a broadcast device, it is also detected whether the corresponding link control information is in an enabled state, and for the link control information in the enabled state, the link control information may be directly invoked for analysis.

For the situation that the whole data communication link needs to be subjected to simulation control, two pieces of link control information can be obtained by detecting the starting state of the simulation service object and the stream pushing equipment and the stream broadcasting equipment. In the case where the first branch link and the second branch link are organized in the same link control information, it is only necessary to detect whether or not the link control information is in an enabled state.

Step S1213, starting the application of the adapted link control information for the simulation service object, so that each link control information is applied to the corresponding branch link in the data communication link, so that the branch link between the push device and the server is applicable to the link control information corresponding to the push device, and the branch link between the server and the broadcast device is applicable to the link control information corresponding to the broadcast device:

the control list may be pre-registered with user characteristic information of users in the plurality of push devices and the plurality of broadcast devices, so that the simulation service object finally determined by the server may relate to a plurality of data communication links, and in this case, the server needs to correspondingly apply the link control information matched with the simulation service object for the plurality of simulation service objects. Because the link control information can be standardized according to the classification of the first branch link and the second branch link, in this embodiment, the service can adapt to the simulation service object belonging to the first branch link, and the link control information corresponding to the first branch link is standardized and matched with the simulation service object belonging to the second branch link, and the link control information corresponding to the second branch link is standardized and matched with the simulation service object belonging to the first branch link.

The embodiment specifically reveals the idea of processing the matching of different types of link control information in the data communication link, enriches the control means of the server for serving a plurality of push stream devices and a plurality of broadcast stream devices, ensures that the simulation control of the network transmission performance of the data communication link can be orderly implemented, and ensures the running efficiency of the server for implementing the simulation control.

Referring to fig. 6, in the preferred embodiment, in the step S1230, each simulation control instance is adapted to apply the network transmission performance configuration parameters correspondingly according to the time sequence of the time slice, and the simulation control is performed on the data communication link, which includes the following steps:

step S1231, adapting to each simulation control example to obtain network transmission performance configuration parameters of time slice organization:

for the same data communication link, the operation of multiple simulation control instances can be controlled according to the operation duration and interval duration in the link control information under the condition that the link control information is analyzed in advance. Each simulation control instance is sequentially called according to the sequence of the simulation control instances in the link control information, the application duration of each simulation control instance is not longer than the operation duration, after one simulation control instance is applied, the simulation control instance is suspended according to the interval duration, and after the interval duration is ended, the subsequent simulation control instance is started for application.

Since each simulation control instance includes a plurality of groups of network transmission performance configuration parameters organized by time slicing, the configuration parameters have been previously resolved, and thus, the corresponding network transmission performance configuration parameters can be obtained according to the time slicing.

Step S1232, calling the network transmission performance configuration parameters corresponding to each time slice in time sequence, where the network transmission performance configuration parameters include a timestamp, a bandwidth value, a minimum round trip delay, a maximum round trip delay, and a packet loss rate corresponding to the time slice:

as described above, in each simulation control instance, the network transmission performance configuration parameters under each time slice are described in the sequence of time stamps, and when the simulation control instance is specifically applied, the corresponding configuration parameters can be applied strictly according to the time sequence indicated by the time stamps and the time duration of the time slices. The embodiment extends to the foregoing example, where the configuration parameters mainly include a timestamp, a bandwidth value, a minimum round trip delay, a maximum round trip delay, and a packet loss rate.

Step S1233, performing the following simulation control on the data communication link within the time range lasting until the current time slice before the arrival of the next time stamp: and restraining the data communication link to transmit the live stream by taking the bandwidth value as the highest bandwidth, restraining the round trip delay of the live stream between the minimum round trip delay and the maximum round trip delay, and restraining the live stream to randomly discard the data message according to the packet loss rate:

The time slice is formed from one time stamp to the next time stamp adjacent in time sequence, so that when the current time stamp arrives, the current time slice is entered and is not finished until the next time stamp arrives, therefore, the simulation control can be implemented on the corresponding data communication link within the time range constrained by the current time slice according to the network transmission performance configuration parameters corresponding to the current time slice, and the simulation control is implemented by taking the branch link as a unit according to the corresponding relation between the link control information and the branch link of the data communication link.

In connection with the previous examples of the constitution of the configuration parameters, when the simulation control is performed on the data communication links according to the network transmission performance configuration parameters, the following constraint control may be performed on the corresponding branch links in the data communication links:

according to the bandwidth value in the configuration parameters, the transmission rate of the live stream which is transmitted or pushed by the current branched-chain road is controlled to be generally transmitted according to the bandwidth value, and certain error is allowed, so that the comprehensive bandwidth of the live stream is not higher than the bandwidth value as much as possible, and the live stream can be flexibly regulated by a person skilled in the art.

According to the minimum round trip delay and the maximum round trip delay in the configuration parameters, the round trip delay of the live broadcast stream for transmitting the data message in the corresponding branch link can be controlled to be between the minimum round trip delay and the maximum round trip delay in a simulation mode.

According to the packet loss rate in the configuration parameters, the direct broadcast stream is correspondingly simulated and controlled to randomly discard the data packet according to a given percentage, such as 35%, of the packet loss rate when transmitting the data packet in the corresponding branch link, and finally the comprehensive packet loss rate of the direct broadcast stream reaches or is approximately equal to the percentage.

Therefore, according to different network transmission performance configuration parameters, the server can correspondingly implement simulation control so as to achieve different weak network conditions, and perform perfect simulation on the network transmission performance of the data communication link.

According to the embodiment, whether the branch link where the push device is or the branch link where the broadcast device is, for the whole data communication link, the simulation control can be implemented at the server without depending on the direct control of the terminal devices such as the push device and the broadcast device, and because the server is a media server, all live broadcast stream resources of the whole network live broadcast platform are converged, the simulation control of the network transmission performance is implemented in the server, and for implementing the current limiting or testing, the simulation control is very efficient and centralized, the implementation efficiency of related items is greatly improved, and the control and testing cost of the platform is saved.

Referring to fig. 7, in an extended embodiment, the method further includes the following steps:

step S2100, pushing a test configuration page to the management user in response to the configuration request triggered by the management user:

in order to facilitate the implementation of audio and video interaction test by the management user, the embodiment further provides a relevant test configuration page for the management user by means of the background management system, when the management user enters the background management system, a configuration request can be triggered in the background management system, and after the background management system receives the configuration request, the corresponding test configuration page is pushed to the management user in response to the configuration request. The background management system can be deployed in a remote server of the application, including a media server of the application or other servers of a cluster where the media server is located, and thus, the background management system can be flexibly implemented by those skilled in the art.

Step S2200, receiving the test configuration information submitted by the management user through the test configuration page, wherein the test configuration information comprises link control information and adaptive user characteristic information thereof:

after the management user obtains the test configuration page, the editing frame provided by the page can be utilized to compile the link control information, user characteristic information and the like corresponding to the user needing to be tested are added into the control list, and then the information is submitted to the background management system.

The background management system acquires the user characteristic information edited by the management user, and then adds the user characteristic information into the control list so as to indicate that corresponding link control information is applicable to the streaming equipment or the push equipment for providing the user characteristic information.

After the background management system acquires the link control information edited by the management user, the link control information is also stored in a corresponding storage address so that the subsequent acquisition of the path line to be called can be realized, the management user can generally configure the starting state information of the link control information provided by the management user, the starting state information is defaulted to be the starting state, and the background management system can correspondingly process and store the link control information.

Step S2300, in response to a management user viewing instruction, pushing a test report to a management user, wherein the test report comprises summarized information formed by inquiring and acquiring sampling data representing the audio and video quality from a database, and the sampling data is sampled and submitted to the database by the streaming equipment:

because the test result is often required to be checked by a test user, the embedded point code can be preset in the live webcast application program operated by the push stream equipment and the broadcast stream equipment, so that the embedded point data can be acquired during operation of the live webcast application program and uploaded to the related data server of the application, and therefore, after the application is implemented and operated, the data server stores the sampled data of the audio and video quality submitted by the broadcast stream equipment which is suitable for the link control information, and the background management system can carry out statistical analysis on the sampled data to obtain corresponding summarized information.

As described above, the sampled data of the audio/video quality acquired by the application program is objective data, and does not need to be generated by recording, photographing or subjective viewing and listening, so that the actual quality of the audio/video after being transmitted is objectively reflected, and these sampled data generally include one or several types of data as follows: code rate, resolution, frame rate, click-through rate, time delay, poor audio and video synchronization, audio and video output speed, and the like.

When a management user sends a user checking instruction to a background management system, the background management system can acquire corresponding summarized information from a database in the data server, push a result page to the management user to present a corresponding test report, and the test report comprises the summarized information.

According to the embodiment, a control means is provided for the management user, so that the management user can implement the test on the audio and video interaction through the background management system by means of the technical scheme of the application, and a corresponding audio and video quality test report is obtained, and because the audio and video quality is presented by objective data, the advantages and disadvantages of the audio and video interaction strategies of different versions and different algorithms to be tested can be compared by means of the objective data, and compared with the quality data calibrated by manual analysis in the industry, the method is more scientific and reasonable, and the optimal audio and video interaction implementation scheme can be more conveniently determined.

Further, by performing the functionalization of each step in the method disclosed in the foregoing embodiments, a live stream interaction control apparatus of the present application may be constructed, and according to this idea, please refer to fig. 8, where in one exemplary embodiment, the apparatus includes a link establishment module 1100, a simulation control module 1200, and a live transmission module 1300, where: the link establishment module 1100 is configured to establish a data communication link that the push device relays to the broadcast stream device through the server, where the data communication link is configured to push a live stream generated by the push device to the broadcast stream device; the simulation control module 1200 applies preset link control information to simulate and control the network transmission performance of the data communication link, so as to control the audio/video quality of the live stream reaching the streaming device; the live transmission module 1300 is configured to receive, through the data communication link, the live stream generated by the push stream device, and forward the live stream to the play display in the play stream device.

In an embodiment, the link establishment module 1100 includes: an on-stream uploading sub-module, configured to respond to an on-stream event of a push device in a live broadcast room, and establish a first branch link between the push device and a server for uploading the live broadcast stream, so as to receive the live broadcast stream uploaded by the push device; the entering plug flow sub-module is used for responding to an entering event triggered by the broadcast flow equipment in the live broadcast room, and establishing a second branch link between the server and the broadcast flow equipment for pushing the live broadcast flow so as to push the live broadcast flow to the broadcast flow equipment; and the continuous transmission sub-module is used for continuously transmitting the live stream through the data communication link formed by the first branch link and the second branch link.

In an embodiment, the simulation control module 1200 includes: the starting detection sub-module is used for detecting whether the link control information of the data communication link is in a starting state, and starting to apply the link control information if the link control information is in the starting state; the method comprises the steps of calling an analysis submodule, wherein the analysis submodule is used for analyzing the enabled link control information to obtain at least one simulation control instance calibrated with operation time length, and each simulation control instance comprises network transmission performance configuration parameters corresponding to a plurality of time slices within the operation time length range; and the simulation implementation sub-module is used for adapting to each simulation control instance, correspondingly adapting to the network transmission performance configuration parameters according to the time sequence of the time slice, and implementing simulation control on the data communication link.

In order to solve the technical problems, the embodiment of the application also provides computer equipment. As shown in fig. 9, the internal structure of the computer device is schematically shown. The computer device includes a processor, a non-volatile storage medium, a memory, and a network interface connected by a system bus. The nonvolatile storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store a control information sequence, and when the computer readable instructions are executed by a processor, the processor can realize a live stream interaction control method. The processor of the computer device is used to provide computing and control capabilities, supporting the operation of the entire computer device. The memory of the computer device may store computer readable instructions that, when executed by the processor, may cause the processor to perform the live stream interactive control method of the present application. The network interface of the computer device is for communicating with a terminal connection. It will be appreciated by those skilled in the art that the structure shown in fig. 9 is merely a block diagram of a portion of the structure associated with the present application and is not limiting of the computer device to which the present application applies, and that a particular computer device may include more or fewer components than shown, or may combine some of the components, or have a different arrangement of components.

The processor in this embodiment is configured to execute specific functions of each module and its sub-module in fig. 8, and the memory stores program codes and various data required for executing the above modules or sub-modules. The network interface is used for data transmission between the user terminal or the server. The memory in this embodiment stores program codes and data required for executing all modules/sub-modules in the live stream interactive control device of the present application, and the server can call the program codes and data of the server to execute the functions of all sub-modules.

The present application also provides a storage medium storing computer readable instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of the live stream interaction control method of any of the embodiments of the present application.

Those skilled in the art will appreciate that implementing all or part of the above-described methods of embodiments of the present application may be accomplished by way of a computer program stored on a computer readable storage medium, which when executed, may comprise the steps of embodiments of the methods described above. The storage medium may be a nonvolatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a random access Memory (Random Access Memory, RAM).

In summary, the method and the device can realize perfect simulation and reproduction of the real production environment network for transmission of the live stream, and conveniently track the online audio and video quality problem or limit the audio and video quality as required.

Those of skill in the art will appreciate that the various operations, methods, steps in the flow, actions, schemes, and alternatives discussed in the present application may be alternated, altered, combined, or eliminated. Further, other steps, means, or steps in a process having various operations, methods, or procedures discussed in this application may be alternated, altered, rearranged, split, combined, or eliminated. Further, steps, measures, schemes in the prior art with various operations, methods, flows disclosed in the present application may also be alternated, altered, rearranged, decomposed, combined, or deleted.

The foregoing is only a partial embodiment of the present application, and it should be noted that, for a person skilled in the art, several improvements and modifications can be made without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims

1. The live stream interaction control method is characterized by comprising the following steps of:

and applying preset link control information to simulate and control the network transmission performance of the data communication link so as to control the audio and video quality of the live stream reaching the stream playing equipment, wherein the method comprises the following steps: detecting whether link control information of the data communication link is in an enabling state, and if so, starting to apply the link control information; analyzing the enabled link control information to obtain at least one simulation control instance calibrated with the operation time length, wherein each simulation control instance comprises network transmission performance configuration parameters corresponding to a plurality of time slices within the operation time length range; adapting to each simulation control instance, correspondingly adapting to the network transmission performance configuration parameters according to the time sequence of the time slice, and implementing simulation control on the data communication link;

2. The method according to claim 1, wherein establishing a data communication link for the push device to reach the streaming device via the present server relay comprises the steps of:

3. The method of claim 1, wherein detecting whether link control information for the data communication link is in an enabled state, and if so, initiating application of the link control information, comprises the steps of:

according to the user characteristic information of each push device and/or broadcast device, detecting whether the push device and/or broadcast device is a simulation service object or not;

4. The method of claim 1, wherein adapting each simulation control instance to adapt the network transmission performance configuration parameters in the time-sliced time sequence, performing simulation control on the data communication link, comprises the steps of:

adapting to each simulation control instance to obtain network transmission performance configuration parameters organized by time stamps corresponding to time slices;

invoking the network transmission performance configuration parameters corresponding to each time slice in sequence according to time sequence, wherein the network transmission performance configuration parameters comprise: bandwidth value, minimum round trip delay, maximum round trip delay, packet loss rate;

5. The method of claim 1, wherein in the step of parsing the enabled link control information, the link control information includes a plurality of simulation control instances, the running durations uniformly calibrated for the plurality of simulation control instances, and an interval duration for controlling two simulation control instances to sequentially implement the simulation control.

6. The method according to any one of claims 1 to 5, further comprising the step of:

7. A live stream interactive control device, characterized in that it comprises:

the link establishment module is used for establishing a data communication link which is relayed by the pushing equipment to the streaming equipment through the server, and the data communication link is used for pushing the live stream generated by the pushing equipment into the streaming equipment;

the simulation control module is used for applying preset link control information to simulate and control the network transmission performance of the data communication link so as to control the audio and video quality of the live stream reaching the stream playing equipment, and comprises the following steps: detecting whether link control information of the data communication link is in an enabling state, and if so, starting to apply the link control information; analyzing the enabled link control information to obtain at least one simulation control instance calibrated with the operation time length, wherein each simulation control instance comprises network transmission performance configuration parameters corresponding to a plurality of time slices within the operation time length range; adapting to each simulation control instance, correspondingly adapting to the network transmission performance configuration parameters according to the time sequence of the time slice, and implementing simulation control on the data communication link;

And the live broadcast transmission module is used for receiving the live broadcast stream generated by the stream pushing equipment through the data communication link and forwarding the live broadcast stream to the stream pushing equipment for playing and displaying.

8. A computer device comprising a central processor and a memory, characterized in that the central processor is arranged to invoke the execution of a computer program stored in the memory for performing the steps of the live stream interactive control method according to any of claims 1 to 6.

9. A non-volatile storage medium, characterized in that it stores in the form of computer readable instructions a computer program implemented in accordance with the method of any one of claims 1 to 6, which computer program, when being called by a computer to run, performs the steps comprised by the method of corresponding live stream interactive control.