CN113691799A

CN113691799A - Live stream interaction control method and corresponding device, equipment and medium

Info

Publication number: CN113691799A
Application number: CN202110916283.4A
Authority: CN
Inventors: 何永德; 林绪虹; 刘科
Original assignee: Guangzhou Huaduo Network Technology Co Ltd
Current assignee: Guangzhou Huaduo Network Technology Co Ltd
Priority date: 2021-08-11
Filing date: 2021-08-11
Publication date: 2021-11-23
Anticipated expiration: 2041-08-11
Also published as: CN113691799B

Abstract

The application relates to the field of network live broadcast, and discloses a live broadcast stream interaction control method and a corresponding device, equipment and medium thereof, wherein the method comprises the following steps: establishing a data communication link from the stream pushing equipment to the streaming equipment through the server relay, wherein the data communication link is used for pushing the live stream generated by the stream pushing equipment to the streaming equipment; the network transmission performance of the data communication link is controlled in a simulation mode by using preset link control information so as to control the audio and video quality of the live stream reaching the streaming equipment; and receiving the live stream generated by the stream pushing equipment through the data communication link, and forwarding the live stream to the stream playing equipment for playing and displaying. The method and the device can realize simulation and reproduction of a real production environment network for transmission of live streaming, and are convenient for tracking online audio and video quality problems or implementing limitation on audio and video quality as required.

Description

Live stream interaction control method and corresponding device, equipment and medium

Technical Field

The present application relates to the field of live webcasting, and in particular, to a live webcasting stream interaction control method and apparatus, and an electronic device and a non-volatile storage medium corresponding to the same.

Background

In audio-video interaction and live network scenes, various network environments including normal network and weak network conditions are often required to be simulated by network damage equipment in a laboratory, and network factors mainly required to be simulated comprise packet loss rate, bandwidth, time delay and the like, and then audio-video quality under various transmission and coding strategies is evaluated through the simulated network environment. In the whole process, the following two outstanding problems exist:

1) network conditions need to be modified manually, evaluation results need to be acquired through means of manual screen recording, photographing, subjective audio-visual and the like, the arrangement of the results is time-consuming and labor-consuming, errors are easy to occur, and the subjectivity is strong.

2) The simulation of a laboratory on a network is realized by a network damage instrument, and the damage of the existing network damage instrument on network conditions can only be simulated by a few modes (such as fixed, random, burst, sine and the like).

Taking a live network system as an example, in the conventional scheme, a network damage device is accessed to an uplink or downlink network, various weak network conditions are simulated through the network damage device, and then the quality of audio and video received by a watching end is collected at the watching end through some manual means such as screen recording and photographing. In the testing process, after one case is tested, the weak network condition needs to be manually modified to test the next case.

Therefore, in the prior art, a simulation technology of a network environment required by audio and video interaction in a live network broadcast process is not enough, so that the related test efficiency is low, and a space should be improved.

Disclosure of Invention

The present application is directed to solve at least one of the above problems and provide a live stream interaction control method and a corresponding apparatus, computer device, and non-volatile storage medium, so as to implement an automated distribution test for an application program.

In order to meet various purposes of the application, the following technical scheme is adopted in the application:

the method for controlling the interaction of the live stream, which is provided by adapting to one of the purposes of the application, comprises the following steps:

establishing a data communication link from the stream pushing equipment to the streaming equipment through the server relay, wherein the data communication link is used for pushing the live stream generated by the stream pushing equipment to the streaming equipment;

the network transmission performance of the data communication link is controlled in a simulation mode by using preset link control information so as to control the audio and video quality of the live stream reaching the streaming equipment;

and receiving the live stream generated by the stream pushing equipment through the data communication link, and forwarding the live stream to the stream playing equipment for playing and displaying.

In an embodiment, the establishing of the data communication link from the stream pushing device to the stream broadcasting device via the server relay includes the following steps:

responding to a broadcast event of the stream pushing equipment in a live broadcast room, and establishing a first branch link for uploading the live broadcast stream between the stream pushing equipment and a server so as to receive the live broadcast stream uploaded by the stream pushing equipment;

responding to an entry event triggered by the streaming device in the live broadcast room, and establishing a second branch link used for pushing the live broadcast stream between the server and the streaming device so as to push the live broadcast stream to the streaming device;

continuously transmitting said live stream over said data communication link comprised of a first branched link and a second branched link.

In an embodiment, the method for controlling the network transmission performance of the data communication link by applying the preset link control information to simulate and control the audio and video quality of the live stream reaching the streaming device includes the following steps:

detecting whether the link control information of the data communication link is in an enabling state, and if the link control information is in the enabling state, starting to apply the link control information;

analyzing the enabled link control information to obtain at least one simulation control instance with the operation duration calibrated, wherein each simulation control instance comprises network transmission performance configuration parameters corresponding to a plurality of time slices within the operation duration range;

and adapting to each simulation control instance, correspondingly adapting to the network transmission performance configuration parameters according to the time sequence of the time slice, and carrying out simulation control on the data communication link.

In a further embodiment, detecting whether the link control information of the data communication link is in an enabled state, and if the link control information is in the enabled state, starting to apply the link control information includes the following steps:

detecting whether the stream pushing equipment and the stream broadcasting equipment are simulation service objects or not according to respective user characteristic information of the stream pushing equipment and the stream broadcasting equipment;

aiming at the simulation service object, judging that the link control information of the simulation service object is in an enabled state, and calling the link control information corresponding to the simulation service object;

and starting the adaptive link control information for the simulation service object, so that each link control information is applied to the corresponding branch link in the data communication link, the branch link between the streaming device and the server is applied to the link control information corresponding to the streaming device, and the branch link between the server and the streaming device is applied to the link control information corresponding to the streaming device.

In a preferred embodiment, adapting to each simulation control instance, correspondingly applying the network transmission performance configuration parameters according to the time sequence of the time slice, and implementing simulation control on the data communication link includes the following steps:

adapting to each simulation control instance to obtain the network transmission performance configuration parameters of the time slice organization;

sequentially calling the network transmission performance configuration parameters corresponding to each time slice according to a time sequence, wherein the network transmission performance configuration parameters comprise timestamps, bandwidth values, minimum round-trip time delay, maximum round-trip time delay and packet loss rates corresponding to the time slices;

in the time range lasting until the current time slice before the next timestamp arrives, the following simulation control is carried out on the data communication link: and constraining the data communication link to transmit the live stream by taking the bandwidth value as the highest bandwidth, constraining the round-trip delay time of the live stream to be between the minimum round-trip delay time and the maximum round-trip delay time, and constraining the data messages of the live stream to be randomly discarded according to the packet loss rate.

In a modified embodiment, in the step of analyzing the enabled link control information, the link control information includes a plurality of simulation control instances, the operation duration uniformly calibrated for the plurality of simulation control instances, and an interval duration for controlling two simulation control instances to successively implement simulation control.

In an extended embodiment, the method further comprises the following steps:

responding to a configuration request triggered by a management user and pushing a test configuration page to the management user;

receiving the test configuration information submitted by a management user through the test configuration page, wherein the test configuration information comprises link control information and adaptive user characteristic information thereof;

and responding to a checking instruction of a management user, pushing a test report to the management user, wherein the test report contains summary information formed by inquiring and acquiring sampling data representing the audio and video quality from a database, and the sampling data is sampled and submitted to the database by the streaming device.

One of the objectives of the present application is adapted to provide a live streaming interaction control apparatus, including a link establishment module, a simulation control module, and a live transmission module, wherein: the link establishing module is used for establishing a data communication link from the stream pushing equipment to the streaming equipment through the server relay, and the data communication link is used for pushing the live stream generated by the stream pushing equipment to the streaming equipment; the simulation control module is used for simulating and controlling the network transmission performance of the data communication link by using preset link control information so as to control the audio and video quality of the live stream reaching the streaming equipment; and the live transmission module is used for receiving the live stream generated by the stream pushing equipment through the data communication link and forwarding the live stream to the stream playing equipment for playing and displaying.

In an embodied embodiment, the link establishment module comprises: the broadcasting and uploading sub-module is used for responding to a broadcasting event of the streaming pushing equipment in the live broadcasting room, establishing a first branch link for uploading the live broadcasting stream between the streaming pushing equipment and the server, and receiving the live broadcasting stream uploaded by the streaming pushing equipment; the stream entering and pushing sub-module is used for responding to an entering event triggered by the streaming equipment in the live broadcast room, and establishing a second branch link used for pushing the live broadcast stream between the server and the streaming equipment so as to push the live broadcast stream to the streaming equipment; and the continuous transmission submodule is used for continuously transmitting the live broadcast stream through the data communication link formed by the first branched link and the second branched link.

In an embodied embodiment, the simulation control module comprises: the starting detection submodule is used for detecting whether the link control information of the data communication link is in a starting state or not, and if the link control information is in the starting state, the link control information is started and applied; calling an analysis submodule for analyzing the enabled link control information to obtain at least one simulation control instance with the operation duration calibrated, wherein each simulation control instance comprises network transmission performance configuration parameters corresponding to a plurality of time slices within the operation duration range; and the simulation implementation sub-module is used for adapting to each simulation control instance, correspondingly applying the network transmission performance configuration parameters according to the time sequence of the time slice, and implementing simulation control on the data communication link.

In a further embodiment, the enabling detection sub-module comprises: the object identification secondary module is used for detecting whether the stream pushing equipment and the stream broadcasting equipment are simulation service objects or not according to respective user characteristic information of the stream pushing equipment and the stream broadcasting equipment; the state identification secondary module is used for judging that the link control information of the simulation service object is in a starting state and calling the link control information corresponding to the simulation service object; and the differential adaptive secondary module is used for starting the application of the adaptive link control information for the simulation service object so that each link control information is applied to the corresponding branch link in the data communication link, the branch link between the streaming device and the server is applied to the link control information corresponding to the streaming device, and the branch link between the server and the streaming device is applied to the link control information corresponding to the streaming device.

In a preferred embodiment, the simulation implementation sub-module includes: the parameter acquisition secondary module is used for adapting to each simulation control instance and acquiring the network transmission performance configuration parameters of the time slice organization; the slice calling secondary module is used for calling the network transmission performance configuration parameters corresponding to each time slice in sequence according to the time sequence, and the network transmission performance configuration parameters comprise timestamps, bandwidth values, minimum round-trip delay, maximum round-trip delay and packet loss rates corresponding to the time slices; the slice simulation secondary module is used for implementing the following simulation control on the data communication link in the time range of the current time slice which lasts until the next time stamp arrives: and constraining the data communication link to transmit the live stream by taking the bandwidth value as the highest bandwidth, constraining the round-trip delay time of the live stream to be between the minimum round-trip delay time and the maximum round-trip delay time, and constraining the data messages of the live stream to be randomly discarded according to the packet loss rate.

In an alternative embodiment, the link control information called by the calling and analyzing sub-module includes a plurality of simulation control instances, the operation duration uniformly calibrated for the plurality of simulation control instances, and an interval duration for controlling two simulation control instances to successively implement simulation control.

In an extended embodiment, the apparatus further comprises: the configuration response module is used for responding to a configuration request triggered by a management user and pushing a test configuration page to the management user; the configuration implementation module is used for receiving the test configuration information submitted by the management user through the test configuration page, wherein the test configuration information comprises link control information and adaptive user characteristic information thereof; and the report viewing module is used for responding to a viewing instruction of a management user and pushing a test report to the management user, wherein the test report contains summary information formed by inquiring and acquiring sampling data representing the audio and video quality from a database, and the sampling data is sampled and submitted to the database by the streaming device.

The computer device comprises a central processing unit and a memory, wherein the central processing unit is used for calling and running a computer program stored in the memory to execute the steps of the live streaming interaction control method.

A non-volatile storage medium, which is provided to adapt to another object of the present application, stores a computer program implemented according to the live stream interaction control method in the form of computer readable instructions, and when the computer program is called by a computer, executes the steps included in the method.

Compared with the prior art, the application has the following advantages:

according to the method and the device, simulation control can be conveniently and automatically carried out on the network transmission performance of the data communication link of the live stream channel by means of the link control information provided in advance, and simulation and reproduction of the real production environment network are realized, so that the test of the live stream interaction process is assisted to be completed, and the online audio and video quality problem is conveniently tracked.

According to the method and the device, the network simulation case is automatically covered by means of the link control information, so that the labor cost is greatly saved, the objectivity and the uniformity of the audio and video quality evaluation standard are improved, and the audio and video quality comparison of front and back versions, different network conditions and different algorithm strategies is conveniently carried out.

According to the method and the device, network simulation is carried out by automatically applying network damage operation to the data communication link through the link control information, compared with the situation that the weak network condition is simulated through network damage equipment or a software damage tool in the prior art, the relevant information of the control process only needs to be written in the link control information, manual modification and damage condition switching are not needed, and the full-process automatic high-efficiency test is convenient to realize.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1 is a schematic diagram of a typical deployment architecture associated with implementing the subject technology;

fig. 2 is a schematic flowchart of an exemplary embodiment of a live stream interaction control method according to the present application;

fig. 3 is a schematic flow chart illustrating establishment of a data communication link by the live stream interaction control method according to the present application;

fig. 4 is a schematic flow chart of simulation control implemented by the live streaming interaction control method of the present application;

fig. 5 is a schematic flowchart of a live stream interaction control method according to the present application, where link control information is enabled;

fig. 6 is a schematic flow chart of an example of simulation control applicable to the live streaming interactive control method according to the present application;

fig. 7 is a schematic flowchart illustrating a process of managing a user operation in an extended embodiment of a live stream interaction control method according to the present application;

fig. 8 is a functional block diagram of an exemplary embodiment of a live stream interaction control apparatus according to the present application;

fig. 9 is a schematic structural diagram of a computer device used in the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.

It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

As will be appreciated by those skilled in the art, "client," "terminal," and "terminal device" as used herein include both devices that are wireless signal receivers, which are devices having only wireless signal receivers without transmit capability, and devices that are receive and transmit hardware, which have receive and transmit hardware capable of two-way communication over a two-way communication link. Such a device may include: cellular or other communication devices such as personal computers, tablets, etc. having single or multi-line displays or cellular or other communication devices without multi-line displays; PCS (Personal Communications Service), which may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant), which may include a radio frequency receiver, a pager, internet/intranet access, a web browser, a notepad, a calendar and/or a GPS (Global Positioning System) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "client," "terminal device" can be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. The "client", "terminal Device" used herein may also be a communication terminal, a web terminal, a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, and may also be a smart tv, a set-top box, and the like.

The hardware referred to by the names "server", "client", "service node", etc. is essentially an electronic device with the performance of a personal computer, and is a hardware device having necessary components disclosed by the von neumann principle such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, an output device, etc., a computer program is stored in the memory, and the central processing unit calls a program stored in an external memory into the internal memory to run, executes instructions in the program, and interacts with the input and output devices, thereby completing a specific function.

It should be noted that the concept of "server" as referred to in this application can be extended to the case of a server cluster. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided, and in physical space, the servers may be independent from each other but can be called through an interface, or may be integrated into one physical computer or a set of computer clusters. Those skilled in the art will appreciate this variation and should not be so limited as to restrict the implementation of the network deployment of the present application.

Referring to fig. 1, the hardware basis required for implementing the related art embodiments of the present application can be deployed according to the architecture shown in the figure, and the functions and functions of the components are disclosed as follows:

the remote server 80 referred to in this application can be used as a front-end service server, and is responsible for further connecting with related data servers, so as to form a logically related server cluster, so as to provide services for related terminal devices, such as the

smart phones

81 and 82 and the personal computer shown in the figure. Both the

smart phones

81, 82 and the personal computer may establish a data communication link with the remote server 80 via a known network access method.

The remote server 80 of the present application is adapted to provide audio and video push streaming services such as live webcasting, instant messaging, and the like, and provide corresponding internet services to corresponding terminal devices by running the services, so that different users can exchange communication data by using the services of the remote server 80 through respective terminal devices. For example, a main user in a webcast room may upload their live stream from a streaming device 81 at which they are located to the remote server 80, and then be pushed by the remote server 80 to a streaming device 82 at which one or more viewer users are located. Since the present application focuses primarily on the push streaming service provided by the remote server 80, it may also be referred to as a media server.

The stream pushing device 81 and the stream playing device 82 both belong to terminal devices referred to in this application, the terminal devices are equipped with related operating systems, such as Android, IOS, homeyos, and other operating systems providing equivalent functions, under the support of such operating systems, the remote server 80 and the terminal devices can perform data communication through mutually agreed data protocols, and application programs adaptively developed for these operating systems can also normally run in the terminal devices, so that the terminal devices can realize human-computer interaction, remote interaction, and various indirect interactions with other terminals through the remote server.

The data server 88 is suitable for storing the sampling data collected by the stream pushing device 81 and the stream playing device 82 and summary information formed after statistical analysis of the sampling data, and is equipped with background management logic for a management user to access, and functions realized on the data server 88 are also strongly integrated by a cluster where the remote server 80 is located, and can be flexibly realized by a person skilled in the art without affecting the implementation of the present application.

The application program referred to in this application is generally referred to as an application program that runs on an electronic device such as a server or a terminal device, and the application program implements the related technical solution of this application in a programming manner, and a program code of the application program may be stored in a nonvolatile storage medium that can be identified by a computer in the form of a computer executable instruction, and called into a memory by a central processing unit to run, and the related apparatus of this application is constructed by running the application program on the computer.

The network live broadcast room, called live broadcast room for short, is maintained and operated by a cluster where a remote server 80 is located, and through operation of an application program on a terminal device, a host user, an audience user or other tourist users can enter a live broadcast room example associated with the host user, wherein the host user can submit live broadcast stream to a media server through a stream pushing device of the host user, so that the live broadcast stream is pushed to a stream playing device where a relevant audience user is located in the live broadcast room example by the media server.

The person skilled in the art will know this: although the various methods of the present application are described based on the same concept so as to be common to each other, they may be independently performed unless otherwise specified. In the same way, for each embodiment disclosed in the present application, it is proposed based on the same inventive concept, and therefore, concepts of the same expression and concepts of which expressions are different but are appropriately changed only for convenience should be equally understood.

The embodiments to be disclosed herein can be flexibly constructed by cross-linking related technical features of the embodiments unless the mutual exclusion relationship between the related technical features is stated in the clear text, as long as the combination does not depart from the inventive spirit of the present application and can meet the needs of the prior art or solve the deficiencies of the prior art. Those skilled in the art will appreciate variations therefrom.

Referring to fig. 2, a live streaming interaction control method according to the present application is executed by an application program on a media server side, and in an exemplary embodiment, the method includes the following steps:

step S1100, establishing a data communication link for the stream pushing equipment to reach the streaming equipment through the server, wherein the data communication link is used for pushing the live stream generated by the stream pushing equipment into the streaming equipment:

the stream pushing device is a terminal device which plays a role in playing and controlling and is located by a main broadcast user of a live webcast room, the stream playing device is another user of the live webcast room, and is usually a terminal device where a registered audience user is located, after the main broadcast user pushes a live stream to the server, namely the media server through the stream pushing device, the server pushes the live stream to the stream playing device where the audience user is located. It can be seen that there is a data communication link between the stream pushing device and the stream playing device, which is relayed by the server. The data communication link is established in a segmented manner, and detailed procedures of the establishment are disclosed subsequently through other embodiments, which are briefly summarized here, that is, when the anchor user logs in the streaming device to start the live room thereof, the server establishes a first branch link of the data communication link with the anchor user, so as to ensure that the streaming device can push the live stream thereof to the server through the first branch link; when the audience user enters the live broadcast room in the broadcast stream equipment, the server establishes a second branch link of the data communication link with the audience user, and the server is ensured to push the live broadcast stream to the broadcast stream equipment through the second branch link for playing and displaying.

The live broadcast stream can be locally collected or synthesized through the stream pushing equipment, necessary synthesis and collection can be carried out after the live broadcast stream reaches the server, the live broadcast stream and the server can be flexibly processed, and implementation of the application is not affected.

Step S1200, using preset link control information to simulate and control the network transmission performance of the data communication link, so as to control the audio and video quality of the live stream reaching the streaming device:

under the normal condition, between pushing stream equipment and broadcasting stream equipment, based on the objective real network condition that the operator provided, use data communication link goes on live broadcast stream's transmission, this application then provides right data communication link's network transmission performance carries out the technological means controlled to satisfy needs such as current-limiting or test, through emulation network condition, control data communication link's network transmission performance reaches the purpose of control live stream equipment's audio frequency and video quality.

Therefore, link control information can be applied to the data communication link, the link control information is used for describing configuration parameters related to the network transmission performance of one or all branch links in the data communication link, and network transmission conditions when the corresponding branch links transmit the live stream are controlled in a simulation mode according to the configuration parameters, so that the effect of implementing network damage to the transmission process of the live stream is achieved, and the simulation of the transmission of the live stream in a weak network environment is achieved.

The application of the link control information may be initiated by checking the device characteristic information of the terminal device or by checking whether the user characteristic information of the anchor user, the viewer user, is added to a control list. Specifically, when a program test or a network current limiting control is required, it may be first determined whether a user or a device is a control object, and once it is determined, corresponding user characteristic information or device uniqueness characteristic information is added to a background control list.

No matter the network damage effect implemented by the link control information is applied to the whole data communication link or one of the branch links, it can be understood that, compared with the objective network environment, the audio and video quality of the live stream reaching the streaming device after the network damage is implemented is relatively reduced.

In one embodiment, due to the requirement of audio and video interaction testing of a live stream, service logic related to audio and video quality data acquisition can be preset in an application program of the application on one side of a streaming device, audio and video quality data of the live stream can be acquired through pre-embedding points and uploaded to a data server for viewing. Data reflecting the audio and video quality, including code rate, resolution, frame rate, pause rate, time delay, audio and video synchronization difference, audio and video output speed and the like during live stream transmission, can be collected in a buried point mode according to needs and can be flexibly determined by a person skilled in the art. After mastering the data, a tester can abandon the traditional modes of photographing, recording a screen and the like, and only needs to utilize objective data to analyze the audio and video quality under the action of link control information.

Step S1300, receiving the live stream generated by the stream pushing device through the data communication link, and forwarding the live stream to the stream playing device for playing and displaying:

the server still serves the operation of each live broadcast room according to the implemented logic for maintaining the operation of the instance of the network live broadcast room, when one of the data communication links is applied with the corresponding link control information and is damaged by the implemented network, the corresponding stream pushing equipment still can push the live broadcast stream to the corresponding stream playing equipment through the data communication link and the server in a relay way, and after the stream playing equipment receives the live broadcast stream, the live broadcast stream is output to a live broadcast room player for playing and displaying according to the default service logic regardless of the audio and video quality.

For the condition that the codes related to audio and video quality data acquisition are pre-embedded at the side of the streaming equipment, the streaming equipment continuously acquires the audio and video quality data of the received live streaming under the action of the instructions generated by the codes of the embedded points and submits the audio and video quality data to the data server so as to achieve the purpose of testing in a matching manner.

According to the disclosure of the exemplary embodiment, the network transmission performance of the data communication link through which the live stream flows can be conveniently and automatically simulated and controlled by means of the link control information provided in advance, and perfect simulation and reproduction of the real production environment network are realized, so that the test of the live stream interaction process is completed in an assisted manner, and the online audio/video quality problem is conveniently tracked.

Further, the network simulation case is automatically covered by means of the link control information, so that the labor cost is greatly saved, the objectivity and the uniformity of the audio and video quality evaluation standard are improved, and the audio and video quality comparison of front and back versions, different network conditions and different algorithm strategies is conveniently carried out.

In addition, the data communication link is automatically subjected to network damage operation through the link control information to perform network simulation, and compared with the situation that the weak network condition is simulated through network damage equipment or a software damage tool in the prior art, the method only needs to write the relevant information of the control process into the link control information, does not need manual modification and damage condition switching, and is convenient for realizing full-process automatic high-efficiency testing.

Referring to fig. 3, in an embodiment, the step of establishing a data communication link between the streaming device and the streaming device via the server relay includes the following steps:

step S1110, responding to a broadcast event of the stream pushing device in the live broadcast room, and establishing a first branch link between the stream pushing device and the server for uploading the live broadcast stream, so as to receive the live broadcast stream uploaded by the stream pushing device:

the network live broadcast related service generally allows each user to create a live broadcast room example, wherein a user starting the live broadcast room example to other users is an anchor user, and a terminal device where the anchor user is located is a stream pushing device of the application; the user entering the live broadcast room to receive the live broadcast stream of the anchor user for playing is the audience user of the live broadcast room example, and the live broadcast application program can play and display the live broadcast stream after receiving the live broadcast stream corresponding to the live broadcast room example.

When a main broadcasting user wants to broadcast, a broadcast command is triggered in a network broadcast application program of the stream pushing equipment, accordingly, a broadcast room interface can be accessed, a broadcast event is generated, a locally generated live stream of the stream pushing equipment is pushed to a media server according to the default service logic of the application program, and the live stream usually contains audio and video contents.

The media server of the application, in response to a broadcast event generated by the stream pushing device in the live broadcast room, automatically establishes a data communication link from the stream pushing device to the media server according to a service logic pre-agreed with an application program of the stream pushing device, that is, a first branch link in a data communication link from the stream pushing device to the stream playing device, so that the stream pushing device continuously uploads the live broadcast stream to the media server through the first branch link.

Step S1120, responding to an entry event triggered by the streaming device in the live broadcast room, and establishing a second branch link between the server and the streaming device for pushing the live broadcast stream, so as to push the live broadcast stream to the streaming device:

the media server continuously maintains the operation of the live broadcast room instance related to the anchor user, and successively pushes the live broadcast stream pushed by the stream pushing equipment where the anchor user of the live broadcast room is located to the audience users entering the live broadcast room, so that the relay function is realized.

When any audience user in the live broadcast room enters the live broadcast room, a corresponding entry event of the audience user entering the live broadcast room is generated according to the service logic preset by the application program, so that the server can receive the entry event and acquire the user characteristic information of the audience user, and further respond to the entry event.

In order to implement the relay streaming function of the server, the server responds to the entry event, establishes a data communication link from the server to the streaming device where the corresponding audience user is located, and forms a second branch link in the data communication link from the streaming device to the streaming device, and through the second branch link, the server can continuously relay the live streaming uploaded by the streaming device to the streaming device.

Step S1130, continuously transmitting the live stream through the data communication link formed by the first branched link and the second branched link:

according to the inherent logic of the live broadcast room application, once the first branched path is established, the anchor user is allowed to upload the live broadcast stream to the server, and once the second branched path is established, the server is allowed to push the corresponding live broadcast stream to the corresponding broadcast stream device, so that the establishment process of the whole data communication link between the anchor user and the audience user is completed once the first branched path and the second branched path between the anchor user and the audience user are both established, and the transmission of the live broadcast stream between the anchor user and the audience user can be served.

It is to be understood that since the internet is implemented based on the TCP/IP protocol, and the audio/video data is usually encapsulated in UDP data packets, the first branch link and the second branch link are usually maintained in a long link manner, which should be known to those skilled in the art.

The embodiment further discloses a process of establishing a data communication link between the streaming pushing device and the streaming playing device, and it can be seen that the data communication link can be established based on the inherent service logic of the live broadcast room instance corresponding to the network live broadcast without additional independent implementation, so that the technical scheme of the application is implemented in the media server, which is beneficial to saving the implementation cost of the application and efficiently achieving the purpose of the application.

Referring to fig. 4, in an embodiment, in the step S1200, the step of controlling the network transmission performance of the data communication link by applying preset link control information to simulate, so as to control the audio and video quality of the live stream reaching the streaming device includes the following steps:

step S1210, detecting whether the link control information of the data communication link is in an enabled state, and if the link control information is in the enabled state, starting to apply the link control information:

for any data communication link, whether the data communication link needs to apply corresponding link control information to carry out network transmission performance control on the data communication link can be registered in the background. In the embodiment disclosed above, a control list may be constructed in the server, in which the corresponding enabling status information of the user needing to implement the network transmission performance simulation control is registered, and specifically, the mapping relationship data between the user characteristic information of the user and the enabling status information thereof may be stored for implementation, so that, when a anchor user or a viewer user enables the corresponding data communication link, the server may query the control list to find out whether the corresponding user characteristic information is marked as enabling status, and if so, start to apply the corresponding link control information to the corresponding branch link, i.e., the branch link between the terminal device and the media server.

In an improved embodiment, the enabling state information may be implemented as a state flag in the personal setting information of the user, so that if it is necessary to apply the simulation control of the present application to some users, only the corresponding state flags of the users need to be modified into the enabling state, and the subsequent server determines whether to apply the corresponding link control information to the corresponding branch link of the corresponding user by querying the state flag.

The link control information may be integrated in the same file and data table, or may be distributed in a plurality of files and data tables according to the difference of the properties of the first branch link and the second branch link. In this embodiment, it is recommended that first link control information is separately compiled for the first branch link, second link control information is separately compiled for the second branch link, and then, for the first branch links corresponding to the plurality of stream pushing devices, the first link control information is uniformly applied, and for the second branch links corresponding to the plurality of stream playing devices, the second link control information is uniformly applied. Accordingly, only two kinds of link control information need to be compiled, standardized testing or control can be carried out on each data communication link, and the implementation efficiency of the application is favorably improved.

Step S1220, analyzing the enabled link control information, and obtaining at least one simulation control instance with the running duration calibrated, where each simulation control instance includes network transmission performance configuration parameters corresponding to multiple time slices within the running duration range:

the link control information is usually compiled according to a certain predetermined format so as to be correspondingly analyzed by the server according to the format specification. The following example is a format specification:

[ operation duration ] [ Interval duration ]

[ simulation control example 1 File name ]

[ simulation control example 2 File name ]

……

[ simulation control example n File name ]

It can be seen that a link control message includes two parameters and at least one simulation control instance (indicated by a storage path/file name), wherein the parameter "run-time length" is used to calibrate the run-time length of each simulation control instance that is adapted to perform the weak network control function on the data communication link, and in some variant embodiments, it is also contemplated to calibrate the run-time length independently for each simulation control instance; the parameter "interval duration" is an optional item to indicate the time interval between two simulation control instances that apply one after the other. According to the specification, the following link control information can be compiled:

180 120

100_600k_35loss.txt

45loss_50_300delay.txt

100_500k_50_300rtt.txt

after performing the analysis of this link control information, three simulation control instances may be obtained, the operation duration of the obtained simulation control instance is 180s, and the interval duration between two obtained simulation control instances is 120 s.

It should be understood that, persons skilled in the art can flexibly formulate link control information by referring to the examples herein, and the server is not limited to the examples herein, as long as the server can obtain corresponding parameters and simulation control examples according to the formulation specification of the link control information.

For the sake of simplicity, in the link control information, each simulation control instance is indicated in the form of its storage path or file name, and therefore, the server should further obtain the specific content of the simulation control instance according to its file name, and actually, in some embodiments, the specific content of the simulation control instance may also be directly written into the link control information without being separately stored in a file, and for this, those skilled in the art should also understand.

For the formulation format specification of each simulation control instance, the following example can be referred to:

[ timestamp 1] [ bandwidth value ] [ minimum round trip delay ] [ maximum round trip delay ] [ packet loss ratio ]

[ time stamp 2] [ bandwidth value ] [ minimum round trip delay ] [ maximum round trip delay ] [ packet loss rate ]

[ time stamp 3] [ bandwidth value ] [ minimum round trip delay ] [ maximum round trip delay ] [ packet loss rate ]

……

[ timestamp n ] [ bandwidth value ] [ minimum round trip delay ] [ maximum round trip delay ] [ packet loss rate ]

Wherein each row includes a timestamp and a network transmission performance configuration parameter. The time stamps can be arranged in a time sequence, and two time stamps adjacent in the time sequence jointly define a time slice, and each time stamp is the starting time of the time slice to which the time stamp belongs. The network transmission performance configuration parameters mainly include parameters such as a bandwidth value, a minimum round-trip delay, a maximum round-trip duration, a packet loss rate, and the like, and these parameters can be flexibly determined by those skilled in the art as required, including preferably selecting one or more of the parameters, or adding or removing related parameters. The bandwidth value is used for representing that the data communication link applicable to the bandwidth value simulates and controls the transmission of the live broadcast stream according to the specified highest bandwidth; the minimum round-trip delay and the maximum round-trip delay are used for jointly simulating and defining the dynamic variation range of the round-trip delay between the two ends when the data communication link transmits the corresponding live broadcast stream, so that the actual round-trip delay is between the minimum round-trip delay and the maximum round-trip delay; the packet loss rate is used for simulating and controlling the live stream transmitted in the data communication link to randomly discard the data messages according to the calibrated percentage, so that the maximum comprehensive packet loss rate is equal to or close to the percentage. In one specific example of implementation of this specification, the contents described in the simulation control instance 100_600k _35loss. txt in the aforementioned link control information example are as follows:

as can be seen from the examples herein, the respective bandwidth values of the different time slices vary, so that after the configuration parameters are analyzed, the live stream can be switched and controlled to be transmitted in the data communication link according to the respective bandwidth values at different times. Other parameters are not changed, but those skilled in the art can understand that other parameters can be set as required.

Therefore, as long as a certain format specification is observed, the link control information compiled in advance can be correctly analyzed, and then the simulation control example is called to be applied to the data communication link to realize the simulation control of the network transmission performance of the data communication link.

Step S1230, adapting to each simulation control instance, correspondingly applying the network transmission performance configuration parameters according to the time sequence of the time slice, and performing simulation control on the data communication link:

after the link control information is analyzed, the time stamps corresponding to the time slices corresponding to each simulation control instance and the network transmission performance configuration parameters corresponding to the time slices are obtained, so that simulation control can be performed on the corresponding data communication link, and the purpose of simulating network transmission performance change for the data communication link is achieved.

According to the method, the network transmission performance of the data communication link can be accurate to the time slice level through establishment of the link control information, different network transmission performance configuration parameters are suitable for different time slices, simulation of complex network conditions is achieved, instantaneous change and jitter conditions of the network can be reflected through control of granularity of the time slices, the effect of fine simulation of the network transmission performance is achieved, and when the method is used for testing audio and video interaction of live streaming, the method is simple and easy to use, accurate in network description and capable of achieving the testing effect efficiently and at low cost.

Referring to fig. 5, in a further embodiment, in the step S1210, detecting whether the link control information of the data communication link is in an enabled state, and if the link control information is in the enabled state, starting to apply the link control information includes the following steps:

step S1211, detecting whether the streaming device and the streaming device are the simulation service objects according to the respective user characteristic information of the streaming device and the streaming device:

as described above, when the streaming device establishes the first branch link in the data communication link with the server, and when the streaming device establishes the second branch link in the data communication link with the server, the server may determine whether the user characteristic information of the anchor user logged in the streaming device and the user characteristic information of the audience user logged in the streaming device are pre-registered in the control list, and if so, the corresponding streaming device and streaming device are the simulation service object of the present application.

In practical applications, sometimes only the first branch circuit of the stream pushing equipment needs to be subjected to simulation control, sometimes only the second branch circuit of the stream playing equipment needs to be subjected to simulation control, and sometimes the whole data communication link needs to be subjected to simulation control.

Step S1212, for the simulation service object, determining that the link control information thereof is in the enabled state, and calling the link control information corresponding to the simulation service object:

for the emulated service object, it may be further detected whether its link control information is in an enabled state. As described above, the link control information may be adapted to the first branch network and the second branch network for being respectively configured, in this case, if the simulation service object includes the stream pushing device, it is detected whether the corresponding link control information is in the enabled state, and if the simulation service object includes the stream playing device, it is also detected whether the corresponding link control information is in the enabled state, and for the link control information in the enabled state, it may be directly called for analysis.

For the situation that the whole data communication link needs to implement simulation control, because the simulation service object simultaneously comprises stream pushing equipment and stream playing equipment, two pieces of link control information can be obtained by detecting the starting states of the stream pushing equipment and the stream playing equipment. For the case that the first branch link and the second branch link are programmed in the same link control information, it is only necessary to correspondingly detect whether the link control information is in the enabled state.

Step S1213, starting the adaptive link control information for the simulation service object, so that each link control information is applied to the corresponding branch link in the data communication link, and the branch link between the streaming device and the server is applied to the link control information corresponding to the streaming device, and the branch link between the server and the streaming device is applied to the link control information corresponding to the streaming device:

the control list may be pre-registered with user feature information of users in a plurality of stream pushing devices and a plurality of stream playing devices, and therefore, the simulation service object finally determined by the server may relate to a plurality of data communication links. Since the link control information can be standardized according to the classification of the first branch link and the second branch link, in this embodiment, the service can adapt to the simulation service object belonging to the first branch link, and standardize the link control information corresponding to the first branch link, adapt to the simulation service object belonging to the second branch link, and standardize the link control information corresponding to the second branch link.

The embodiment specifically discloses a concept of processing matching of different types of link control information in a data communication link, and enriches control means of the server serving a plurality of stream pushing devices and a plurality of stream playing devices, so that simulation control over network transmission performance of the data communication link can be implemented orderly, and the operating efficiency of the server for implementing the simulation control is ensured.

Referring to fig. 6, in a preferred embodiment, the step S1230, adapted to each simulation control instance, correspondingly applies the network transmission performance configuration parameters according to the time sequence of the time slice, and performs simulation control on the data communication link, which includes the following steps:

step S1231, adapting to each simulation control instance, obtaining the network transmission performance configuration parameters organized according to time slices:

for the same data communication link, under the condition that the link control information is analyzed in advance, the operation of a plurality of simulation control instances can be controlled according to the operation duration and the interval duration in the link control information. And calling the simulation control instances in sequence according to the sequence of the simulation control instances in the link control information, wherein the applicable time length of each simulation control instance is based on the condition that the applicable time length of each simulation control instance does not exceed the running time length, pausing according to the interval time length after the application of one simulation control instance is finished, and starting the subsequent simulation control instances for application after the interval time length is finished.

Since each simulation control instance comprises a plurality of sets of network transmission performance configuration parameters organized according to time slices, which have been previously analyzed, the corresponding network transmission performance configuration parameters can be obtained according to the time slices.

Step S1232, sequentially invoking the network transmission performance configuration parameters corresponding to each time slice according to a time sequence, where the network transmission performance configuration parameters include a timestamp, a bandwidth value, a minimum round-trip delay, a maximum round-trip delay, and a packet loss rate corresponding to the time slice:

as described above, in each simulation control instance, the network transmission performance configuration parameters under each time slice are described in the time stamp sequence, and when the simulation control instance is specifically applied, the corresponding configuration parameters may be applied strictly according to the time sequence indicated by the time stamp and the duration of the time slice. In this embodiment, the foregoing examples are used, and the configuration parameters mainly include a timestamp, a bandwidth value, a minimum round-trip delay, a maximum round-trip delay, and a packet loss rate.

Step S1233, in the time range of the current time slice until the next timestamp arrives, performing the following simulation control on the data communication link: the data communication link is constrained to transmit the live stream by taking the bandwidth value as the highest bandwidth, the round-trip delay of the live stream is constrained to be between the minimum round-trip delay and the maximum round-trip delay, and the data messages of the live stream are constrained to be randomly discarded according to the packet loss rate:

the time slice is formed from one time stamp to the next time stamp adjacent to the time sequence of the time stamp, so that when the current time stamp arrives, the current time slice is entered, and the current time slice is not ended until the next time stamp arrives, therefore, within the time range constrained by the current time slice, simulation control can be implemented on the corresponding data communication link according to the network transmission performance configuration parameters corresponding to the current time slice, and of course, the simulation control is generally implemented by taking the branch link as a unit according to the corresponding relationship between the link control information and the branch link of the data communication link.

With reference to the previous example regarding the configuration of the configuration parameters, when simulation control is performed on the data communication link according to the network transmission performance configuration parameters, the following constraint control may be performed on the corresponding branch link in the data communication link:

according to the bandwidth value in the configuration parameters, the transmission rate of the live stream uploaded or pushed through the current branch link is controlled to be generally transmitted according to the bandwidth value, a certain error is allowed, and the comprehensive bandwidth of the live stream should not exceed the bandwidth value as much as possible, and the transmission rate can be flexibly adjusted by a person skilled in the art.

According to the minimum round-trip delay and the maximum round-trip delay in the configuration parameters, the round-trip delay of the live broadcast stream for transmitting the data message in the corresponding branch link can be controlled to be between the minimum round-trip delay and the maximum round-trip delay in a simulation mode.

According to the packet loss rate in the configuration parameters, correspondingly simulating and controlling the live stream to randomly discard the data messages according to the given percentage, for example 35%, of the packet loss rate when the data messages are transmitted in the corresponding branch link, and finally enabling the comprehensive packet loss rate to reach or approximately equal to the percentage.

Therefore, according to different network transmission performance configuration parameters, the server can correspondingly implement simulation control so as to achieve different weak network conditions and perfectly simulate the network transmission performance of the data communication link.

It can be seen from this embodiment that, no matter the branch link where the stream pushing device is located or the branch link where the stream playing device is located, for the whole data communication link, the simulation control can be implemented at the server without depending on direct control over the terminal devices such as the stream pushing device and the stream playing device, and because the server is a media server, it aggregates all the live stream resources of the whole network live platform, so that the simulation control of the network transmission performance is implemented in the server, and for implementing current limiting or testing, the method is very efficient and centralized, greatly improves the implementation efficiency of the related items, and helps to save the control and testing cost of the platform.

Referring to fig. 7, in an expanded embodiment, the method further includes the following steps:

step S2100, responding to a configuration request triggered by a management user, and pushing a test configuration page to the management user:

in order to facilitate the management user to implement the audio/video interaction test, the embodiment further provides a relevant test configuration page for the management user by means of a background management system, when the management user enters the background management system, a configuration request can be triggered therein, and after receiving the configuration request, the background management system of the present application responds to the configuration request to push the corresponding test configuration page to the management user. The background management system may be deployed in a remote server of the present application, including the media server of the present application or other servers of the cluster where the media server is located.

Step S2200, receiving the test configuration information submitted by the management user through the test configuration page, where the test configuration information includes link control information and adaptive user characteristic information:

after the management user obtains the test configuration page, the link control information can be compiled by using an edit box provided by the page, user characteristic information and the like corresponding to the user needing to carry out the test are added into a control list, and then the information is submitted to a background management system.

The background management system acquires the user characteristic information edited by the management user, and then adds the user characteristic information into the control list for indicating that the corresponding link control information is applicable to the streaming equipment or the stream pushing equipment which provides the user characteristic information.

The background management system acquires the link control information edited by the management user, and then stores the link control information in a corresponding storage address so as to acquire the link control information when the link control information needs to be called later, the management user can generally configure the starting state information for the link control information provided by the management user, the default is the starting state, and the background management system can correspondingly process and store the starting state information.

Step S2300, responding to a checking instruction of a management user, pushing a test report to the management user, wherein the test report comprises summary information formed by inquiring and acquiring sampling data representing the audio and video quality from a database, and the sampling data is sampled and submitted to the database by the streaming device:

in the method, a test user often needs to check a test result due to the need of a test, so that a buried point code can be preset in a live network application program operated by stream pushing equipment and stream playing equipment, so that the buried point code can be obtained during operation and is uploaded to a related data server of the application.

As mentioned above, the sampling data of the audio/video quality obtained by the application program is objective data, and is not generated by screen recording, photographing, and subjective audio/video, so that the actual quality of the audio/video after being transmitted is objectively reflected, and the sampling data generally includes one or more types of data as follows: code rate, resolution, frame rate, pause rate, time delay, audio and video synchronization difference, audio and video output speed and the like.

When a management user sends a user checking instruction to the background management system, the background management system can acquire corresponding summary information from a database in the data server, and pushes a result page to the management user to present a corresponding test report, wherein the test report comprises the summary information.

The embodiment provides a control means for the management user, so that the management user can implement the test of audio-video interaction by means of the technical scheme of the application through a background management system and obtain a corresponding audio-video quality test report.

Further, a live streaming interaction control apparatus of the present application can be constructed by functionalizing each step in the method disclosed in the foregoing embodiments, and according to this idea, please refer to fig. 8, wherein in an exemplary embodiment, the apparatus includes a link establishing module 1100, a simulation control module 1200, and a live transmission module 1300, wherein: the link establishing module 1100 is configured to establish a data communication link where the stream pushing device reaches the streaming device through the server, where the data communication link is used to push a live stream generated by the stream pushing device to the streaming device; the simulation control module 1200 applies preset link control information to simulate and control the network transmission performance of the data communication link, so as to control the audio and video quality of the live stream reaching the streaming device; the live broadcast transmission module 1300 is configured to receive the live broadcast stream generated by the stream pushing device through the data communication link, and forward the live broadcast stream to the stream playing device for playing and displaying.

In an embodied embodiment, the link establishment module 1100 includes: the broadcasting and uploading sub-module is used for responding to a broadcasting event of the streaming pushing equipment in the live broadcasting room, establishing a first branch link for uploading the live broadcasting stream between the streaming pushing equipment and the server, and receiving the live broadcasting stream uploaded by the streaming pushing equipment; the stream entering and pushing sub-module is used for responding to an entering event triggered by the streaming equipment in the live broadcast room, and establishing a second branch link used for pushing the live broadcast stream between the server and the streaming equipment so as to push the live broadcast stream to the streaming equipment; and the continuous transmission submodule is used for continuously transmitting the live broadcast stream through the data communication link formed by the first branched link and the second branched link.

In an embodied embodiment, the simulation control module 1200 includes: the starting detection submodule is used for detecting whether the link control information of the data communication link is in a starting state or not, and if the link control information is in the starting state, the link control information is started and applied; calling an analysis submodule for analyzing the enabled link control information to obtain at least one simulation control instance with the operation duration calibrated, wherein each simulation control instance comprises network transmission performance configuration parameters corresponding to a plurality of time slices within the operation duration range; and the simulation implementation sub-module is used for adapting to each simulation control instance, correspondingly applying the network transmission performance configuration parameters according to the time sequence of the time slice, and implementing simulation control on the data communication link.

In order to solve the technical problem, an embodiment of the present application further provides a computer device. As shown in fig. 9, the internal structure of the computer device is schematically illustrated. The computer device includes a processor, a non-volatile storage medium, a memory, and a network interface connected by a system bus. The non-volatile storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store control information sequences, and the computer readable instructions can enable a processor to realize a live stream interaction control method when being executed by the processor. The processor of the computer device is used for providing calculation and control capability and supporting the operation of the whole computer device. The memory of the computer device may store computer readable instructions, and when the computer readable instructions are executed by the processor, the processor may execute the live stream interaction control method of the present application. The network interface of the computer device is used for connecting and communicating with the terminal. Those skilled in the art will appreciate that the architecture shown in fig. 9 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In this embodiment, the processor is configured to execute specific functions of each module and its sub-module in fig. 8, and the memory stores program codes and various data required for executing the modules or sub-modules. The network interface is used for data transmission to and from a user terminal or a server. The memory in this embodiment stores program codes and data required for executing all modules/sub-modules in the live streaming interactive control device of the present application, and the server can call the program codes and data of the server to execute the functions of all sub-modules.

The present application also provides a storage medium storing computer-readable instructions, which, when executed by one or more processors, cause the one or more processors to perform the steps of the live stream interaction control method of any of the embodiments of the present application.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments of the present application can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when the computer program is executed, the processes of the embodiments of the methods can be included. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random Access Memory (RAM).

In conclusion, the method and the device can realize perfect simulation and reproduction of a real production environment network for transmission of live streaming, and conveniently track the online audio and video quality problem or limit the audio and video quality as required.

Those of skill in the art will appreciate that the various operations, methods, steps in the processes, acts, or solutions discussed in this application can be interchanged, modified, combined, or eliminated. Further, other steps, measures, or schemes in various operations, methods, or flows that have been discussed in this application can be alternated, altered, rearranged, broken down, combined, or deleted. Further, steps, measures, schemes in the prior art having various operations, methods, procedures disclosed in the present application may also be alternated, modified, rearranged, decomposed, combined, or deleted.

The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.

Claims

1. A live stream interaction control method is characterized by comprising the following steps:

2. The method of claim 1, wherein establishing a data communication link between the streaming device and the streaming device via the server relay comprises:

3. The method according to claim 1, wherein the network transmission performance of the data communication link is controlled by applying preset link control information simulation to control the audio and video quality of the live stream reaching the streaming device, comprising the following steps:

4. The method of claim 3, wherein detecting whether the link control information of the data communication link is in an enabled state, and if so, starting to apply the link control information comprises:

5. The method of claim 3, wherein the step of applying the network transmission performance configuration parameters in time order of the time slice to perform simulation control on the data communication link for each simulation control instance comprises:

6. The method according to claim 3, wherein in the step of parsing out the enabled link control information, the link control information includes a plurality of the simulation control instances, the operation duration uniformly calibrated for the plurality of simulation control instances, and an interval duration for controlling two simulation control instances to successively implement simulation control.

7. The method according to any one of claims 1 to 6, characterized in that the method further comprises the steps of:

8. A live streaming interaction control apparatus, comprising:

the link establishing module is used for establishing a data communication link from the stream pushing equipment to the streaming equipment through the server relay, and the data communication link is used for pushing the live stream generated by the stream pushing equipment to the streaming equipment;

the simulation control module is used for controlling the network transmission performance of the data communication link in a simulation way by using preset link control information so as to control the audio and video quality of the live stream reaching the streaming equipment;

and the live transmission module is used for receiving the live stream generated by the stream pushing equipment through the data communication link and forwarding the live stream to the stream playing equipment for playing and displaying.

9. A computer device comprising a central processor and a memory, characterized in that the central processor is configured to invoke execution of a computer program stored in the memory to perform the steps of the live stream interaction control method according to any one of claims 1 to 7.

10. A non-volatile storage medium, characterized in that it stores, in the form of computer-readable instructions, a computer program implemented according to the method of any one of claims 1 to 7, which, when invoked by a computer, performs the steps comprised in the method of interaction control of a corresponding live stream.