CN114466210B

CN114466210B - Live broadcast quality detection processing method and device, equipment and medium thereof

Info

Publication number: CN114466210B
Application number: CN202210102482.6A
Authority: CN
Inventors: 钟佩芝; 朱旺南; 钟树林
Original assignee: Guangzhou Cubesili Information Technology Co Ltd
Current assignee: Guangzhou Cubesili Information Technology Co Ltd
Priority date: 2022-01-27
Filing date: 2022-01-27
Publication date: 2024-04-16
Anticipated expiration: 2042-01-27
Also published as: CN114466210A

Abstract

The application discloses a live broadcast quality detection processing method, a device, equipment and a medium thereof, wherein the method comprises the following steps: responding to a live broadcasting room opening event of a main broadcasting end, determining the opening source information of the main broadcasting end, monitoring a live broadcasting interaction event of the main broadcasting end acting on the live broadcasting room, and counting live broadcasting interaction data; identifying a live broadcast characteristic identifier of a live broadcast stream, determining characteristic similarity of a video screenshot of the live broadcast stream and a recorded broadcast video stream of a main broadcasting end, and acquiring a suspected recorded broadcast screenshot with higher characteristic similarity; calling a live broadcast hanging verification strategy, carrying out first verification according to the information of an open broadcast source, the identification of a live broadcast characteristic or live broadcast interaction data, and if the verification result is a live broadcast hanging room, correspondingly modifying the live broadcast authority of a main broadcasting end; and if the verification result is the suspected hanging broadcast live broadcast room, pushing the open broadcast source information, the live broadcast characteristic identification, the live broadcast interaction data and the suspected recording broadcast screenshot to an auditing end for second verification. The method and the device detect the live broadcasting room in a hanging mode in a multi-dimensional mode, and optimize the quality of the live broadcasting room of the platform.

Description

Live broadcast quality detection processing method and device, equipment and medium thereof

Technical Field

The present invention relates to the field of network live broadcast, and in particular, to a live broadcast quality detection processing method, and further, to a device, equipment, a nonvolatile storage medium and a computer program product corresponding to the method.

Background

With the development of the Internet, various live broadcasting platforms exist in the Internet, each platform provides live broadcasting room online service for platform users, so that a live broadcasting room is opened in the platform by a live broadcasting user, audience users are attracted to enter the live broadcasting room to participate in the live broadcasting activities opened by the live broadcasting user, various types of live broadcasting rooms exist in the live broadcasting platform for the platform users to browse, and the use experience of the users in the platform is improved.

However, in the existing live broadcasting platform, a live broadcasting room for broadcasting live broadcasting in a hanging broadcasting mode exists, the live broadcasting room service of the platform is affected, the live broadcasting room for broadcasting live broadcasting in a hanging broadcasting mode refers to a live broadcasting room for broadcasting live broadcasting in a low quality on the live broadcasting platform, for example, by broadcasting a traditional live broadcasting video or broadcasting content which is not related to a live broadcasting partition where the live broadcasting room is located in the live broadcasting room, or only starting the live broadcasting room without carrying out any live broadcasting service, further, related economic benefits are obtained by using a live broadcasting reward rule set by the live broadcasting platform, and the live broadcasting watching experience of a platform user is very affected by the live broadcasting room existing in the platform, so that the user loss of the platform is caused.

In view of the foregoing, the applicant has made a corresponding search for consideration of the problems.

Disclosure of Invention

It is an object of the present application to meet the needs of the prior art or to overcome at least some of the deficiencies of the prior art to provide a live quality detection processing method and corresponding apparatus, electronic device, non-volatile storage medium and computer program product.

In order to achieve the purposes of the application, the following technical scheme is adopted:

the live broadcast quality detection processing method suitable for the purpose of the application comprises the following steps:

responding to a live broadcasting room opening event of a main broadcasting end, acquiring the opening source information of the main broadcasting end acting on a live broadcasting stream, monitoring a live broadcasting interaction event of the main broadcasting end acting on the live broadcasting room, and counting live broadcasting interaction data corresponding to the live broadcasting interaction event;

identifying a live broadcast feature identifier corresponding to the live broadcast stream, determining feature similarity of a video screenshot of the live broadcast stream and a recorded broadcast video stream to which the main broadcasting end belongs, and acquiring a suspected recorded broadcast screenshot with higher feature similarity;

invoking a preset live broadcast hanging verification strategy, performing first verification according to the open broadcast source information, the live broadcast characteristic identification or the live broadcast interactive data, and if the verification result is a live broadcast hanging room, correspondingly modifying the live broadcast authority of the main broadcasting end to control the output of the live broadcast stream;

And if the verification result is the suspected hanging broadcast live broadcast room, pushing the open broadcast source information, the live broadcast characteristic identification, the live broadcast interaction data and the suspected recording broadcast screenshot to an auditing end for second verification, and further determining whether the live broadcast room is the hanging broadcast live broadcast room according to the auditing result pushed by the auditing end.

In a further embodiment, the step of monitoring the live interaction event acted by the main broadcasting end on the live broadcasting room, and counting live interaction data corresponding to the live interaction event includes the following steps executed by the server:

monitoring a public-screen chat interaction event acted on a live broadcasting room by the anchor terminal, and obtaining one or more chat texts output to the public-screen chat area of the live broadcasting room by the anchor terminal;

performing acoustic voice recognition on an audio stream in the live stream of the anchor end to obtain text content corresponding to voice information in the audio stream;

acquiring user nicknames corresponding to a plurality of audience terminals in the live broadcasting room, and checking whether phrases matched with the user nicknames exist in each chat text and text content;

and counting and checking results to obtain the number of results with matched phrases, wherein the live interaction data comprises the number of results.

responding to a virtual gift giving event acted on the living broadcast room, and acquiring a nickname of a gift giving user at a spectator end giving a virtual gift corresponding to the event;

responding to an audience entering event acted on the living broadcast room, and acquiring a new audience user nickname of a new audience terminal entering the living broadcast room;

and checking whether the text content is matched with the nickname of the gift sending user or the nickname of the new audience user, and if so, correspondingly updating the live broadcast interaction data corresponding to the anchor terminal.

In a further embodiment, the step of identifying the live characteristic identifier corresponding to the live stream includes the following steps executed by the server:

invoking a training to converged image feature extraction model to extract a video stream in the live stream, and obtaining an image feature vector corresponding to the video stream;

Calling a voice recognition model trained until convergence to extract an audio stream in the live stream, and acquiring text content corresponding to the audio stream;

invoking a text feature extraction model trained until convergence to extract the text content and obtaining a text feature vector of the text information;

and respectively carrying out classified mapping on the image feature vector and the text feature vector, and determining the corresponding live broadcast feature identification of the live broadcast stream.

In a further embodiment, the step of calling a preset live broadcast hanging verification policy to perform the first verification according to the open broadcast source information, the live broadcast feature identifier or the live broadcast interactive data includes the following steps executed by the server:

when the open source information comprises the open source type of the video playing source, acquiring the supplemental enhancement information of the video stream corresponding to the video playing source;

analyzing the supplementary enhancement information, and checking whether the supplementary enhancement information contains a recorded broadcast feature identifier or not;

and when the supplementary enhancement information contains the recorded broadcast feature identifier, characterizing the video stream as a recorded broadcast video stream, and determining a live broadcast room where the main broadcast section is located as a hanging broadcast live broadcast room.

Determining a preset live broadcast partition of a live broadcast room where the main broadcasting end is located, and acquiring a live broadcast type corresponding to the live broadcast partition;

judging whether the live broadcast type is matched with the live broadcast feature identifier according to the live broadcast feature identifier which is newly identified for the live broadcast stream corresponding to the main broadcasting end;

when the live type does not match the live feature identification, then the live room will be determined to be the on-hook live room.

In a further embodiment, if the verification result is a suspected hanging broadcast live broadcast room, pushing the open broadcast source information, the live broadcast feature identifier, the live broadcast interaction data and the suspected recording broadcast screenshot to an auditing end for performing a second verification, where the method includes the following steps executed by the auditing end:

receiving suspected hanging live broadcasting room information pushed by a server, and outputting live broadcasting room characteristic information, opening source information, live broadcasting characteristic identification and live broadcasting interaction data contained in the suspected hanging live broadcasting room information to a graphical user interface for display;

synchronously outputting suspected recorded video clips and corresponding recorded video contained in the suspected recorded live broadcasting room information to a graphical user interface for display;

and responding to an audit event of the live broadcasting room corresponding to the suspected live broadcasting room information, and pushing an audit result corresponding to the audit event to a server.

A live broadcast quality detection processing apparatus that adapts to the purpose of this application and puts forward, it includes:

the live broadcast starting response module is used for responding to a live broadcast room starting event of a main broadcasting end, acquiring the starting source information of the main broadcasting end acting on a live broadcast stream, monitoring a live broadcast interaction event of the main broadcasting end acting on the live broadcast room, and counting live broadcast interaction data corresponding to the live broadcast interaction event;

the live stream identification module is used for identifying a live broadcast feature identifier corresponding to the live stream, determining the feature similarity of the video screenshot of the live stream and the recorded broadcast video stream to which the main broadcasting end belongs, and acquiring a suspected recorded broadcast screenshot with higher feature similarity;

the live broadcasting room verification module is used for calling a preset live broadcasting verification strategy, carrying out first verification according to the open-broadcasting source information, the live broadcasting feature identification or the live broadcasting interactive data, and correspondingly modifying the live broadcasting authority of the main broadcasting end to control the output of the live broadcasting stream if the verification result is the live broadcasting room;

and the auditing result processing module is used for pushing the open broadcast source information, the live broadcast characteristic identification, the live broadcast interaction data and the suspected recorded broadcast screenshot to an auditing end for second checking if the checking result is a suspected hung broadcast live broadcast room, and further determining whether the live broadcast room is the hung broadcast live broadcast room according to the auditing result pushed by the auditing end.

In a further embodiment, the live start response module includes:

the chat text acquisition sub-module is used for monitoring the public screen chat interaction event acted on the live broadcasting room by the anchor terminal and acquiring one or more chat texts output to the public screen chat area of the live broadcasting room by the anchor terminal;

the text content acquisition sub-module is used for carrying out acoustic voice recognition on the audio stream in the live stream of the anchor terminal to acquire text content corresponding to voice information;

the user nickname matching sub-module is used for acquiring user nicknames corresponding to a plurality of audience terminals in the live broadcasting room and checking whether phrases matched with the user nicknames exist in each chat text and text content;

and the result number counting sub-module is used for counting the number of the results with matched phrases as the verification result, and the live interaction data contains the number of the results.

In a further embodiment, the live stream identification module includes:

the gift giving response sub-module is used for responding to a virtual gift giving event acted on the living broadcast room and obtaining a nickname of a gift giving user at a spectator end giving a virtual gift corresponding to the event;

a viewer entry response sub-module, configured to obtain a new viewer user nickname of a new viewer end entering the live broadcast room in response to a viewer entry event acting on the live broadcast room;

and the user nickname matching sub-module is used for checking whether the text content is matched with the gift sending user nickname or the new audience user nickname, and if yes, the live broadcast interaction data corresponding to the host side is correspondingly updated.

In a preferred embodiment, the live stream identification module further includes:

the live stream feature extraction submodule is used for calling the image feature extraction model trained until convergence to extract a video stream in the live stream and obtaining an image feature vector corresponding to the video stream;

the text content acquisition sub-module is used for calling the voice recognition model trained until convergence to extract the audio stream in the live stream and acquire the text content corresponding to the audio stream;

the text feature acquisition sub-module is used for calling a text feature extraction model trained until convergence to extract the text content and acquiring a text feature vector of the text information;

and the live broadcast feature identification determining submodule is used for respectively carrying out classified mapping on the image feature vector and the text feature vector and determining the corresponding live broadcast feature identification of the live broadcast stream.

In a further embodiment, the on-hook live room verification module includes:

the supplementary enhancement information acquisition sub-module is used for acquiring supplementary enhancement information of a video stream corresponding to a video play source when the open play source information contains the open play source type which is the video play source;

the supplementary enhancement information analysis sub-module is used for analyzing the supplementary enhancement information and checking whether the supplementary enhancement information contains the recorded broadcast feature identification;

and the live broadcasting-hanging room determining submodule is used for characterizing the video stream as a recorded broadcast video stream when the supplementary enhancement information contains the recorded broadcast characteristic identifier, and the live broadcasting room where the main broadcasting section is located is determined to be the live broadcasting-hanging room.

In a preferred embodiment, the on-hook live broadcast room verification module further includes:

the live broadcast type acquisition sub-module is used for determining a preset live broadcast partition of a live broadcast room where the main broadcasting end is located and acquiring a live broadcast type corresponding to the live broadcast partition;

the type characteristic matching sub-module is used for judging whether the live broadcast type is matched with the live broadcast characteristic identifier according to the live broadcast characteristic identifier which is latest identified by the live broadcast stream corresponding to the main broadcasting end;

and the live broadcasting hanging room determining submodule determines the live broadcasting room as the live broadcasting hanging room when the live broadcasting type is not matched with the live broadcasting characteristic identifier.

In a further embodiment, the audit result processing module includes:

the information output and display sub-module is used for receiving the suspected hanging broadcast live broadcast room information pushed by the server and outputting the live broadcast room characteristic information, the open broadcast source information, the live broadcast characteristic identification and the live broadcast interaction data contained in the suspected hanging broadcast live broadcast room information to the graphical user interface for display;

the information synchronous display sub-module is used for synchronously outputting the suspected recorded video screenshot contained in the suspected recorded video broadcasting room information and the recorded video corresponding to the suspected recorded video screenshot to a graphical user interface for display;

and the auditing result pushing sub-module is used for responding to the auditing event of the live broadcasting room corresponding to the suspected hanging broadcasting live broadcasting room information and pushing the auditing result corresponding to the auditing event to the server.

An electronic device, as proposed for the purpose of the present application, comprises a central processor and a memory, the central processor being arranged to invoke the steps of executing a computer program stored in the memory for performing the live quality detection processing method.

A non-volatile storage medium adapted to the object of the present application stores a computer program implemented according to the live broadcast quality detection processing method, which when invoked by a computer, performs the steps comprised by its corresponding method.

In order to solve the above technical problem, an embodiment of the present application further provides a computer program product, which includes a computer program and computer instructions, where the computer program and the computer instructions, when executed by a processor, cause the processor to execute the steps of the live broadcast data hierarchical prediction method or the live broadcast quality detection processing method.

Compared with the prior art, the method has the following advantages:

the live broadcasting platform provides the function of hanging broadcasting live broadcasting room that exists in the testing platform for the live broadcasting platform, and the verification and detection are carried out according to the open broadcasting source, the live broadcasting interactive data and the live broadcasting characteristic identification of the live broadcasting room in the platform, so that whether the live broadcasting room is the hanging broadcasting live broadcasting room or not is judged, hanging broadcasting verification is carried out on the live broadcasting room according to various live broadcasting information multidimensional of the live broadcasting room, compared with the limitation of a traditional single live broadcasting data verification mode, the verification accuracy of the hanging broadcasting live broadcasting room is effectively improved, misjudgment is prevented, the situation of normal live broadcasting in the platform is prevented from being blocked, and the live broadcasting business of a main broadcasting user in the normal live broadcasting room and the live broadcasting watching experience of a spectator user are influenced.

Secondly, the method and the device automatically detect the live broadcasting hanging room in the platform, intercept the video screenshot of the suspected recorded broadcasting in the live broadcasting stream, and push the live broadcasting information of the suspected live broadcasting hanging room and the video screenshot of the suspected recorded broadcasting to the auditing end for manual auditing when the automatic checking hanging broadcasting system can not finish determining whether the suspected live broadcasting hanging room is the live broadcasting hanging room, so that the overall hanging broadcasting checking accuracy of the hanging broadcasting checking system is improved.

Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:

FIG. 1 is a schematic diagram of a typical network deployment architecture relevant to implementing the technical solutions of the present application;

FIG. 2 is a flow chart of an exemplary embodiment of a live quality detection processing method of the present application;

FIG. 3 is a schematic diagram of a graphical user interface of a hanging direct broadcast room audit page in the present application;

FIG. 4 is a schematic diagram of a graphical user interface of a live room page in the present application;

FIG. 5 is a flowchart illustrating an embodiment of responding to a public chat interaction event to count live interaction data;

FIG. 6 is a flow chart of an embodiment of the present application for counting live interaction data in response to a virtual gift-gifting event and a viewer entry event;

fig. 7 is a schematic flowchart of an embodiment of identifying a live characteristic identifier corresponding to a live stream according to the present application;

Fig. 8 is a schematic flow chart of an embodiment of a live verification policy for on-hook broadcasting of open source information;

fig. 9 is a schematic flow chart diagram of an embodiment of a live verification policy on hanging for live feature identification;

fig. 10 is a schematic flow chart of an embodiment of processing a suspected live broadcast room in an auditing end according to the present application;

FIG. 11 is a functional block diagram of an exemplary embodiment of a live quality detection processing apparatus of the present application;

fig. 12 is a basic structural block diagram of a computer device according to an embodiment of the present application.

Detailed Description

Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of illustrating the present application and are not to be construed as limiting the present application.

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless expressly stated otherwise, as understood by those skilled in the art. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. The term "and/or" as used herein includes all or any element and all combination of one or more of the associated listed items.

It will be understood by those skilled in the art that all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs unless defined otherwise. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

As used herein, "client," "terminal device," and "terminal device" are understood by those skilled in the art to include both devices that include only wireless signal receivers without transmitting capabilities and devices that include receiving and transmitting hardware capable of two-way communication over a two-way communication link. Such a device may include: a cellular or other communication device such as a personal computer, tablet, or the like, having a single-line display or a multi-line display or a cellular or other communication device without a multi-line display; a PCS (Personal Communications Service, personal communication system) that may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant ) that can include a radio frequency receiver, pager, internet/intranet access, web browser, notepad, calendar and/or GPS (Global Positioning System ) receiver; a conventional laptop and/or palmtop computer or other appliance that has and/or includes a radio frequency receiver. As used herein, "client," "terminal device" may be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or adapted and/or configured to operate locally and/or in a distributed fashion, at any other location(s) on earth and/or in space. As used herein, a "client," "terminal device," or "terminal device" may also be a communication terminal, an internet terminal, or a music/video playing terminal, for example, a PDA, a MID (Mobile Internet Device ), and/or a mobile phone with music/video playing function, or may also be a device such as a smart tv, a set top box, or the like.

The hardware referred to by the names "server", "client", "service node" and the like in the present application is essentially an electronic device having the performance of a personal computer, and is a hardware device having necessary components disclosed by von neumann's principle, such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, and an output device, and a computer program is stored in the memory, and the central processing unit calls the program stored in the external memory to run in the memory, executes instructions in the program, and interacts with the input/output device, thereby completing a specific function.

It should be noted that the concept of "server" as referred to in this application is equally applicable to the case of a server farm. The servers should be logically partitioned, physically separate from each other but interface-callable, or integrated into a physical computer or group of computers, according to network deployment principles understood by those skilled in the art. Those skilled in the art will appreciate this variation and should not be construed as limiting the implementation of the network deployment approach of the present application.

Referring to fig. 1, the hardware base required for implementing the related technical solution of the present application may be deployed according to the architecture shown in the figure. The server 80 is deployed at the cloud as a service server, and may be responsible for further connecting to related data servers and other servers providing related support, so as to form a logically related service cluster, to provide services for related terminal devices, such as a smart phone 81 and a personal computer 82 shown in the figure, or a third party server (not shown). The smart phone and the personal computer can access the internet through a well-known network access mode, and establish a data communication link with the cloud server 80 so as to run a terminal application program related to the service provided by the server.

For the server, the application program is generally constructed as a service process, and a corresponding program interface is opened for remote call of the application program running on various terminal devices.

The application program refers to an application program running on a server or terminal equipment, the application program adopts a programming mode to realize the related technical scheme of the application, the program codes of the application program can be stored in a nonvolatile storage medium which can be identified by a computer in the form of computer executable instructions, and the program codes are called by a central processing unit to run in a memory, and the related device of the application is constructed by the running of the application program on the computer.

The technical solution suitable for implementation in a terminal device in the present application may also be programmed to be built into an application providing live webcasting as part of which the functionality is extended. The network live broadcast refers to a live broadcast room network service realized based on the network deployment architecture.

The live broadcasting room refers to a video chat room realized by means of an Internet technology, and generally has an audio and video broadcasting control function, wherein the video chat room comprises a host user and a spectator user, and the spectator user can comprise registered users registered in a platform or unregistered guest users; the registered user who pays attention to the anchor user may be a registered user who pays attention to the anchor user or an unregistered user. The interaction between the anchor user and the audience user can be realized through the well-known online interaction modes such as voice, video, text and the like, generally, the anchor user performs programs for the audience user in the form of audio and video streams, and economic transaction behaviors can be generated in the interaction process. Of course, the application form of the live broadcast room is not limited to online entertainment, and can be popularized to other related scenes, such as educational training scenes, video conference scenes, product recommendation sales scenes and any other scenes needing similar interaction.

Those skilled in the art will appreciate that: although the various methods of the present application are described based on the same concepts so as to be common to each other, the methods may be performed independently, unless otherwise indicated. Similarly, for each of the embodiments disclosed herein, the concepts presented are based on the same inventive concept, and thus, the concepts presented for the same description, and concepts that are merely convenient and appropriately altered although they are different, should be equally understood.

The various embodiments to be disclosed herein, unless the plain text indicates a mutually exclusive relationship with each other, the technical features related to the various embodiments may be cross-combined to flexibly construct a new embodiment, so long as such combination does not depart from the inventive spirit of the present application and can satisfy the needs in the art or solve the deficiencies in the prior art. This variant will be known to the person skilled in the art.

Referring to fig. 2, in an exemplary embodiment of the present application, a live broadcast quality detection processing method includes the following steps:

step S11, responding to a live broadcasting room opening event of a main broadcasting end, acquiring the information of an opening source of the main broadcasting end acting on a live broadcasting stream, monitoring a live broadcasting interaction event of the main broadcasting end acting on the live broadcasting room, and counting live broadcasting interaction data corresponding to the live broadcasting interaction event:

The server responds to the live broadcasting room opening event of any main broadcasting end in the platform, acquires the information of the opening source of the main broadcasting end pushing the live broadcasting flow of the main broadcasting end, monitors the live broadcasting interaction event of the main broadcasting end in the opened live broadcasting room after the live broadcasting room of the main broadcasting end is opened, and further counts the live broadcasting interaction data corresponding to the live broadcasting interaction event.

The live broadcasting room opening event refers to an event that a main broadcasting end of a current live broadcasting platform opens a live broadcasting room for carrying out live broadcasting business, and the server responds to the live broadcasting room opening event in the current live broadcasting platform to further acquire the opening source information of the main broadcasting end to which the live broadcasting room opening event belongs for pushing the live broadcasting stream of the server.

The open-cast source information refers to an open-cast tool used for characterizing that the main-cast end generates a live-cast stream of the main-cast end, for example, when the live-cast stream pushed to the server by the main-cast end is a video-capturing video stream, the open-cast source type contained in the open-cast source information corresponding to the live-cast stream is a video-capturing tool, such as a mobile phone camera or a camera, when the live-cast stream pushed to the server by the main-cast end is a video file, the open-cast source type contained in the open-cast source information corresponding to the live-cast stream is a video play source such as a video player, for example, when the live-cast stream is an audio stream, the open-cast source type contained in the live-cast source information corresponding to the live-cast stream can be a microphone or an audio play source such as an audio player, and the open-cast source type contained in the live-cast source information corresponding to the live-cast end can be a live-cast stream generated by a plurality of open-cast tools, for example, when the live-cast stream is a content of a live-cast film, such as a live-cast film, the live-cast user is a live-cast film, the open-cast film is generated by the open-cast source type through the open-cast source type is a video file, the live-cast tool is a live-cast film, and when the live-cast source is recorded by the live-cast by the live-stream, and the live-cast stream is recorded by the live-broadcast by the live-stream.

After responding to the live broadcasting room opening event and acquiring the live broadcasting stream pushed by the main broadcasting end, the server acquires the opening source information contained in the live broadcasting stream characteristic information through the corresponding live broadcasting stream characteristic information.

When the anchor end starts the live broadcasting room to conduct live broadcasting business, the server monitors live broadcasting interaction events of the anchor end acting on the live broadcasting room, wherein the live broadcasting interaction events refer to interaction events based on the live broadcasting business of anchor users at the anchor end and audience users at audience ends of the live broadcasting room, for example, the anchor users and audience users in the live broadcasting room communicate through a public screen chat area, the anchor users and audience users in the live broadcasting room conduct dialogue through live broadcasting flows, or interaction actions such as giving virtual gifts to the audience users in the live broadcasting room are all live broadcasting interaction events.

The server monitors the live broadcast interaction event of the anchor terminal in the live broadcast room to count live broadcast interaction data corresponding to the live broadcast interaction event, wherein the live broadcast interaction data generally refers to statistics data of effective interaction between the anchor terminal and audience terminals in the live broadcast room, for example, the server monitors chat interaction events of the anchor terminal acting on a public screen in the live broadcast room to obtain one or more chat texts output by the anchor terminal to the public screen chat area of the live broadcast room, and simultaneously carries out acoustic voice recognition on audio streams in live broadcast streams of the anchor terminal to obtain text content corresponding to voice information therein, and further checks whether nicknames of users corresponding to the audience terminals in the live broadcast room exist in each chat text and the text content or not to count the number of matched phrases, and the number of results indicates that the chat texts or the audio streams are effective interactions as matched phrases exist.

Another statistical method of the live broadcast interactive data is that a server responds to a virtual gift presentation event acted on the live broadcast room to obtain a gift presentation user nickname of a viewer end presenting the virtual gift corresponding to the event, when the live broadcast room triggers a viewer entering event, the server responds to the event to obtain a new viewer nickname of a new viewer end entering the live broadcast room, so that the server carries out acoustic voice recognition on an audio stream in a live broadcast stream of the host side to obtain text content corresponding to voice information therein, and further checks whether the text content is matched with the gift presentation user nickname or the new viewer nickname, if the text content is matched with the virtual gift presentation event, the virtual gift presentation event is represented as an effective gift event, and if the virtual gift presentation event is not matched with the live broadcast user nickname, the server correspondingly updates the interactive data corresponding to the host side in order to prevent the live broadcast room from being judged as a data fake act by a platform, for example, if the text content is matched with the gift presentation user nickname and the new viewer nickname, the live broadcast interactive data is correspondingly updated.

Step S12, identifying a live broadcast feature identifier corresponding to the live broadcast stream, determining feature similarity of a video screenshot of the live broadcast stream and a recorded broadcast video stream to which the main broadcasting end belongs, and acquiring a suspected recorded broadcast screenshot with higher feature similarity:

after receiving the live stream pushed by the main broadcasting end, the server carries out identification of real-time live broadcast feature identification on the live stream at regular time or in real time so as to conveniently judge whether live broadcast business carried out by the main broadcasting end in a live broadcasting room corresponds to a live broadcast partition preset by the main broadcasting end or not, specifically, the server calls a training-to-convergence image feature extraction model to extract a video stream in the live stream, acquires an image feature vector corresponding to the video stream, calls a training-to-convergence voice identification model to extract an audio stream in the live stream, acquires text content corresponding to the audio stream, calls a training-to-convergence text feature extraction model to extract the text content, acquires a text feature vector of the text information, and further carries out classified mapping on the image feature vector and the text feature vector after acquiring the image feature training, namely the text feature vector, so as to determine the live broadcast feature identification corresponding to the live stream.

The live broadcast feature identifier is used for representing content presented by a viewer user in live broadcast streams such as live broadcast content, live broadcast scenes or anchor property corresponding to the live broadcast streams, for example, when video pictures output in video streams of the live broadcast streams are live broadcast and sold indoors by anchor users and females of the anchor users, the live broadcast feature identifier identified by the server comprises live broadcast carried-cargo identifiers, indoor scenes and female anchor identifiers.

The method comprises the steps that a server performs live broadcast characteristic identification on a live broadcast stream, simultaneously performs recording and broadcasting picture retrieval on the live broadcast stream to obtain video screen shots which are similar to pictures in a recording and broadcasting video stream which a main broadcasting end belongs to in the live broadcast stream, specifically, the server respectively intercepts video screen shots of a plurality of video frames of the live broadcast stream, extracts image characteristics of the video screen shots, obtains a recording and broadcasting video library which the main broadcasting end belongs to, and determines video screen shots with higher similarity as suspicious recording and broadcasting screen shots by calculating characteristic similarity of the video screen shots and one or more recording and broadcasting video streams in the recording and broadcasting video library, so that the suspicious recording and broadcasting video is pushed to an auditing end to be manually audited later, and whether a live broadcasting room is a hanging and broadcasting room is further judged.

The recorded broadcast video stream generally refers to a live broadcast stream in the past of the main broadcasting end, and the server correspondingly stores the recorded broadcast video stream into a recorded broadcast video library to which the main broadcasting end belongs so as to search recorded broadcast pictures of the live broadcast stream currently pushed by the main broadcasting end, and simultaneously, the recorded broadcast video stream can be browsed and watched by a user in a platform.

Step S13, calling a preset live broadcast hanging verification strategy, carrying out first verification according to the information of the open broadcast source, the live broadcast feature identification or the live broadcast interaction data, and if the verification result is a live broadcast hanging room, correspondingly modifying the live broadcast authority of the main broadcasting end to control the output of the live broadcast stream:

and the server calls the preset on-hook live broadcast verification processing to verify the on-hook live broadcast room of the live broadcast room according to the on-hook source information, the live broadcast characteristic identification or the live broadcast interaction data of the live broadcast room and judge whether the live broadcast room is the on-hook live broadcast room.

The live broadcasting room is a live broadcasting room for low-quality live broadcasting on a live broadcasting platform, for example, the live broadcasting room is used for broadcasting the prior live broadcasting video in the live broadcasting room, or broadcasting the live broadcasting content which is not related to the live broadcasting partition where the live broadcasting room is located in the live broadcasting room, or only starting the live broadcasting room without any live broadcasting business, and the like, so that the live broadcasting business of the live broadcasting platform is seriously influenced by the live broadcasting room, and the live broadcasting watching experience of a platform user is influenced.

The first verification means that the server verifies whether a live broadcasting room of the main broadcasting end has a first turbine verification mode of hanging broadcasting according to the hanging broadcasting live broadcasting verification strategy, wherein the hanging broadcasting live broadcasting verification strategy is used for verifying whether the live broadcasting room is the hanging broadcasting live broadcasting room according to the opening broadcasting source information, the live broadcasting characteristic identification or the live broadcasting interaction data of the live broadcasting room, for example, the hanging broadcasting live broadcasting verification strategy has the verification strategy aiming at the opening broadcasting source information of the live broadcasting room, specifically, the server determines the opening broadcasting source information of the live broadcasting room, when the opening broadcasting source information comprises the opening broadcasting source type of a camera, the server judges whether the camera is started, and when the server determines that the closing time of the camera exceeds the preset verification time, the live broadcasting room is primarily judged to be the hanging broadcasting live broadcasting room, and meanwhile, whether the live broadcasting room is the hanging broadcasting room is further verified according to the live broadcasting characteristic identification or the interaction data aiming at the live broadcasting room in the hanging broadcasting live broadcasting verification strategy.

In addition, the server invokes the live hanging verification policy to verify the open source information of the main broadcasting end, when the open source information is a video broadcasting source, the server will acquire a video stream corresponding to the video broadcasting source, specifically, the video broadcasting source is generally a video player, the video stream is a video text played in the video broadcasting source, after the server acquires Supplemental Enhancement Information (SEI) of the video stream, the server will analyze the Supplemental Enhancement Information (SEI), verify whether the Supplemental Enhancement Information (SEI) contains the feature identifier of recording and broadcasting, the video stream with the feature identifier of recording and broadcasting is generally a feature identifier unique to a video stream recorded and broadcasting generated by a live broadcasting recording tool of a live broadcasting platform, if the Supplemental Enhancement Information (SEI) of the video stream contains the feature identifier of recording and broadcasting, it indicates that the video stream is the video stream of recording and broadcasting, that the live broadcasting room accords with the live hanging verification policy corresponding to the open broadcasting source information, and the live broadcasting room will be primarily determined as the live hanging broadcasting room by the server.

Regarding the verification policy of the live feature identifier of the live broadcasting on hook in the live broadcasting verification policy, firstly determining a preset live broadcasting partition of the live broadcasting room, obtaining a live broadcasting type corresponding to the live broadcasting partition, judging whether the live broadcasting type is matched with the live broadcasting feature identifier according to the live broadcasting feature identifier which is latest and is identified by the live broadcasting flow corresponding to the main broadcasting end, and when the live broadcasting type is not matched with the live broadcasting feature identifier, primarily determining the live broadcasting room as the live broadcasting on hook; in addition, the server can also determine whether the voice identifier characterizes the voice in the live stream according to the voice identifier in the live characteristic identifier, if not, the live broadcasting room is preliminarily determined as the live broadcasting room.

In the on-hook live broadcast verification policy, the verification policy for the live broadcast interaction data of the live broadcast room is generally to determine whether the live broadcast interaction data exceeds a preset interaction value, for example, a server analyzes the live broadcast interaction data of the live broadcast room to obtain effective gift sending interaction data, effective new audience interaction data, effective language communication interaction data and the like in the live broadcast interaction data, and when any one or more of the interaction data does not exceed the corresponding interaction value, the live broadcast room is primarily determined as the on-hook live broadcast room.

And the server checks whether the live broadcasting room is the live broadcasting room or not step by step according to the on-hook broadcasting live broadcasting verification policy check on the on-hook broadcasting source information, the live broadcasting characteristic identification and the live broadcasting interaction data of the live broadcasting room, generally when the server judges that the on-hook broadcasting source information, the live broadcasting characteristic identification and the live broadcasting interaction data of the live broadcasting room are judged to be in accordance with the corresponding on-hook broadcasting live broadcasting verification policy, the live broadcasting room is determined to be the on-hook broadcasting live broadcasting room, and then the live broadcasting authority of the main broadcasting end is correspondingly modified so as to control the production of the live broadcasting flow of the live broadcasting room, for example, the live broadcasting room is forbidden to be pushed to a recommended live broadcasting list of a live broadcasting platform, the recommended live broadcasting list comprises the live broadcasting room recommended to a platform user for browsing, and the main broadcasting end of the live broadcasting room is forbidden to authorize to start the live broadcasting room, and the live broadcasting service of the main broadcasting end in the current platform is stopped.

When the server judges that the open source information, the live broadcast characteristic identification and the live broadcast interaction data of the live broadcast room do not completely accord with the related live broadcast hanging verification policy, the server outputs a verification result representing suspected live broadcast problems of the live broadcast room to the auditing end for second verification according to the live broadcast hanging verification policy met by the live broadcast room, for example, the server judges that the live broadcast room except the open source information accords with the live broadcast hanging verification policy for verifying whether the live broadcast is recorded broadcast or not, and the live broadcast characteristic identification and the live broadcast interaction data of the live broadcast room do not accord with the live broadcast hanging verification policy for verifying whether the live broadcast is hung or not, the live broadcast room is determined to be a live broadcast hanging room suspected to be recorded by the server, the server pushes a verification result representing that the live broadcasting room suspected to have a recorded broadcast hanging problem to the auditing end, or the server judges that the live broadcasting feature identification and live broadcasting interaction data of the live broadcasting room accord with hanging broadcast verification processing for verifying whether the live broadcasting room is on hook or not, if the open source information of the live broadcasting room does not accord with hanging broadcast verification processing for verifying whether the live broadcasting room is recorded broadcast or not, the server pushes the verification result representing that the live broadcasting room suspected to have a recorded broadcast hanging machine to the auditing end, and of course, a person skilled in the art can design verification purposes of each hanging broadcast verification strategy and required live broadcasting room data thereof according to actual application scenes, and the description is omitted; in addition, when the server pushes the verification result to the auditing end, the live broadcast source information, the live broadcast feature identification, the live broadcast interaction data and the suspected recorded broadcast screenshot of the live broadcast room are pushed to the auditing end at the same time to carry out second verification.

In addition, different verification weights are preset for the open-cast source information, the live-cast characteristic identification and the live-cast interaction data of the live-cast room in the live-cast live-broadcast verification strategy, for example, when the verification weight of the open-cast source information is highest, if the server judges that the open-cast source information of the live-cast room accords with the relevant live-cast live-broadcast verification strategy, the server does not judge whether the live-cast characteristic identification and the live-cast interaction data of the live-cast room meet the relevant live-cast live-broadcast verification strategy or not any more, and the live-cast room is directly determined as the live-cast room; those skilled in the art can flexibly design the verification weights, which are not repeated.

Step S14, pushing the open broadcast source information, the live broadcast feature identification, the live broadcast interaction data and the suspected recorded broadcast screenshot to an auditing end for second checking if the checking result is a suspected hung broadcast live broadcast room, and further determining whether the live broadcast room is the hung broadcast live broadcast room according to the auditing result pushed by the auditing end:

when the server determines that the live broadcasting room is a suspected live broadcasting room through the live broadcasting verification strategy, the open source information, the live broadcasting feature identification, the live broadcasting interaction data and the suspected recorded broadcasting screenshot of the live broadcasting room are pushed to the auditing end, so that the auditing end can conduct manual auditing on the live broadcasting room.

The second verification means that the auditing end performs a second round of verification according to the open broadcast source information, the live broadcast feature identifier, the live broadcast interaction data and the suspected record screenshot of the main broadcasting end, the verification means generally aims at a live broadcast room in which the suspected record broadcasting exists, which is judged by the first round of verification, wherein the auditing end refers to an executive end performing a manual auditing service, after the auditing end receives the open broadcast source information, the live broadcast feature identifier, the live broadcast interaction data and the suspected record screenshot of the live broadcast room pushed by the server, the auditing end outputs and displays the information to a live broadcast room auditing page so as to enable auditing personnel at the auditing end to perform manual auditing, specifically, the auditing end receives the suspected record room information pushed by the server, outputs the direct broadcast room feature information, the open broadcast source information, the suspected feature identifier and the live broadcast interaction data contained in the suspected record room information to a graphical user interface of the live broadcast room page, and synchronously outputs the suspected record screenshot and the corresponding record screenshot thereof contained in the suspected record room information to the live broadcast room page to the corresponding graphical user interface of the live broadcast room, and further the auditing personnel in response to the live broadcast room is triggered by the live broadcast user interface.

Referring to fig. 3, fig. 3 is a schematic diagram of a graphical user interface of the on-hook live broadcast room audit page, in fig. 3, the open source information, the live broadcast feature identifier and the live broadcast interaction data of the suspected on-hook live broadcast are output to the on-hook live broadcast room audit page to be displayed, and the suspected recorded screenshot is output to a suspected recorded screenshot window 301 in fig. 3 to be displayed, so that the suspected recorded screenshot and the recorded video corresponding to the suspected recorded screenshot are synchronously output to the on-hook live broadcast room audit page to be displayed, and an audit result window 302 in fig. 3 can be used for generating an audit result edited by an auditor not to be pushed to a server, so that the server can determine whether the suspected on-hook live broadcast room is the on-hook live broadcast room according to the audit result.

In addition, the auditing end can also check the suspected live broadcasting hanging room through a suspected live broadcasting hanging checking strategy of the auditing end, so that whether the suspected live broadcasting hanging room is a live broadcasting hanging room is further checked on the basis of the first checking, for example, the auditing end judges similarity data of the recorded video streams corresponding to the suspected recorded screenshot through the judgment, when the similarity data exceeds a preset threshold, the threshold is generally set in a range of 70% -90%, the suspected live broadcasting hanging room is determined to be the live broadcasting hanging room, and the auditing end pushes the auditing result to a server so that the server correspondingly modifies the live broadcasting authority of a host broadcasting end to which the live broadcasting hanging room belongs.

After receiving the auditing result pushed by the auditing end, the server finally determines whether the suspected live-hanging room is a live-hanging room or not according to the auditing result, if the auditing result represents that the suspected live-hanging room is a live-hanging room, the server correspondingly modifies the live-broadcasting authority of a main broadcasting end to which the live-hanging room belongs so as to control the output of the live stream of the live-broadcasting room, for example, the live-broadcasting room is prevented from being pushed to the server, the live-broadcasting room is prevented from being pushed to a recommended live-broadcasting list of a live-broadcasting platform, the recommended live-broadcasting list comprises live-broadcasting rooms recommended to a platform user for browsing, and the main broadcasting end of the live-broadcasting room is prevented from authorizing to start the live-broadcasting room, and the live-broadcasting service of the main broadcasting end in the current platform is stopped.

According to the method, the live broadcasting platform is provided with the function of hanging broadcasting live broadcasting rooms in the detection platform, whether the shown live broadcasting rooms are hanging broadcasting live broadcasting rooms or not is judged according to the open broadcasting source information, the live broadcasting interaction data and the live broadcasting feature identification automatic hanging broadcasting verification detection, and compared with the limitation of a traditional single live broadcasting data verification mode, the method effectively improves the verification accuracy of the hanging broadcasting live broadcasting rooms, prevents misjudgment, causes the situation of erroneously blocking the live broadcasting rooms of normal live broadcasting in the platform, and influences the live broadcasting business of a main broadcasting user in the normal live broadcasting rooms and the live broadcasting watching experience of audience users; secondly, the method not only automatically detects the live broadcasting room of the hanging broadcast existing in the platform, but also intercepts the video screenshot of the suspected recorded broadcast in the live broadcasting stream, so that when the automatic checking hanging broadcast system can not finish determining whether the live broadcasting room of the suspected hanging broadcast is the live broadcasting room of the hanging broadcast, the live broadcasting information of the live broadcasting room of the suspected hanging broadcast and the video screenshot of the suspected recorded broadcast are pushed to an auditing end for manual auditing, and the overall hanging broadcast checking accuracy of the hanging broadcast checking system is improved.

The above exemplary embodiments and variations thereof fully disclose embodiments of the live quality detection processing method of the present application, but various variations of the method can still be deduced by transforming and augmenting some technical means, and the following outline describes other embodiments:

in an embodiment, please refer to fig. 4 and fig. 5, the step of monitoring the live interaction event acted by the main broadcasting end on the live broadcasting room and counting live interaction data corresponding to the live interaction event includes the following steps executed by the server:

step S111, monitoring a public-screen chat interaction event acted by the anchor terminal in the live broadcasting room, and obtaining one or more chat texts output by the anchor terminal to the public-screen chat area in the live broadcasting room:

referring to fig. 4, fig. 4 is a schematic diagram of a graphical user interface of a live room page, and a server responds to the public chat interaction event of the anchor, and obtains the chat text pushed by the anchor to the public chat area 401 shown in fig. 4.

The chat text is generally pushed to the server by the anchor, so that the server obtains the chat text and broadcasts the chat text to a live broadcast room where the anchor is located for display, and meanwhile, the server performs subsequent live broadcast interactive data statistics according to the chat text.

Step S112, performing acoustic voice recognition on the audio stream in the live stream of the anchor side, to obtain text content corresponding to the voice information therein:

the server acquires a live stream pushed by the anchor end, analyzes the live stream to acquire the audio stream contained in the live stream, calls an acoustic voice recognition model trained to be converged, performs voice preprocessing on the audio stream, extracts voice characteristics through the acoustic model, recognizes the voice characteristics through a language model, acquires corresponding text content, and realizes voice-to-text operation.

Step S113, obtaining nicknames of users corresponding to a plurality of audience terminals in the live broadcasting room, and checking whether phrases matched with the nicknames of users exist in each chat text and text content:

the server acquires the user nicknames corresponding to a plurality of audience terminals in the live broadcasting room where the anchor terminal is located, and judges whether the chat text and the text content always have the phrases matched with the user nicknames, for example, when the user nicknames with the names being small, the server checks whether the chat text and the text content have the phrases with the names being small.

Step S114, counting and checking results to obtain the number of results with matched phrases, wherein the live interaction data comprises the number of results:

the server counts the number of verification results of the chat text or the text content, which have the phrases matched with the nicknames of the users, so as to correspondingly update the affiliated live broadcast interaction data of the anchor terminal.

In this embodiment, by checking whether the chat text and the audio stream pushed by the anchor end have nicknames with the audience users in the live broadcast room, whether the anchor users interact with the audience in the current live broadcast room is further determined, so as to count the effective interaction times.

In an embodiment, please refer to fig. 4 and fig. 6, the step of monitoring the live interaction event acted by the main broadcasting end on the live broadcasting room and counting live interaction data corresponding to the live interaction event includes the following steps executed by the server:

step S111', in response to a virtual gift-gifting event acting on the living broadcast room, obtaining a nickname of a gifting user at a viewer end gifting a virtual gift corresponding to the event:

the server responds to the virtual gift-giving event in the living broadcast room to which the anchor terminal belongs, and determines the audience terminal giving the virtual gift in the virtual gift-giving event so as to acquire the nickname of the gift-giving user corresponding to the audience terminal.

The virtual gift-gifting event number refers to an event that a viewer end in a living room gives a corresponding virtual gift to a host end.

Step S112', in response to a viewer entry event acting on the living room, acquiring a new viewer user nickname of a new viewer end entering the living room:

and the server responds to the audience entering event in the live broadcasting room where the anchor terminal is located, and determines a new audience terminal corresponding to the audience entering event so as to acquire a new audience user nickname corresponding to the new audience terminal.

Referring to fig. 4, fig. 4 is a schematic diagram of a graphical user interface of a live room page, and the new viewer entry notification window 402 in fig. 4 is a visual manner of the viewer entry event in the live room.

Step S113', performing acoustic voice recognition on the audio stream in the live stream of the anchor side, to obtain text content corresponding to the voice information therein:

Step S114', checking whether the text content matches with the nickname of the gift sending user or the nickname of the new audience user, if yes, updating the live interaction data corresponding to the anchor terminal accordingly:

the server checks whether the text content is matched with the nickname of the gift sending user or the nickname of the new audience user, specifically, the server judges whether the text content is matched with the nickname of the gift sending user or the nickname of the new audience user by inquiring whether phrases corresponding to the nickname of the gift sending user and the nickname of the new audience user exist in the text content, and if so, the server correspondingly updates the interaction times of the gift sending and the interaction times of the new audience in the live broadcast interaction data.

In this embodiment, by responding to the virtual gift presentation event and the new audience entry event, it is determined whether the current anchor in the living room performs effective interaction with the gift-sending audience or the new audience through the language, so as to count the live broadcast interaction data corresponding to the events.

In one embodiment, referring to fig. 7, the step of identifying the live characteristic identifier corresponding to the live stream includes the following steps executed by the server:

step S121, invoking the image feature extraction model trained to converge to extract the video stream in the live stream, and obtaining the image feature vector corresponding to the video stream:

After receiving the live stream pushed by the anchor, the server analyzes and acquires the video stream contained in the live stream, so as to perform feature extraction on the live stream by adopting an image feature extraction model, such as Resnet, which is pre-trained to a convergence state, to obtain an image feature vector representing deep semantic information of the live stream, and normalize the image feature vector into a high-dimensional vector.

Step S122, calling a voice recognition model trained until convergence to extract an audio stream in the live stream, and acquiring text content corresponding to the audio stream:

the server acquires a live broadcast stream pushed by the anchor end, analyzes the live broadcast stream to acquire the audio stream contained in the live broadcast stream, calls a voice recognition model trained to be converged, performs voice preprocessing on the audio stream, extracts voice characteristics, recognizes the voice characteristics by adopting a language model, acquires corresponding text content, and realizes the operation of converting voice into characters.

Step S123, calling a text feature extraction model trained until convergence to extract the text content, and obtaining a text feature vector of the text information:

and extracting the characteristics of the text content by adopting a text characteristic extraction model which is pre-trained to a convergence state, such as Bert, LSTM and the like, obtaining text characteristic vectors representing deep semantic information of the text content, and normalizing the text characteristic vectors into high-dimensional vectors.

Step S124, respectively performing classification mapping on the image feature vector and the text feature vector, and determining a corresponding live broadcast feature identifier of the live broadcast stream:

after the server acquires the image feature vector and the text feature vector, a classifier is adopted to map the image feature vector and the text feature vector to a classification space after being fully connected, so that classification probabilities corresponding to a plurality of live broadcast feature types are obtained, wherein a classification model with the largest classification probability is the live broadcast feature identifier contained in live broadcast content of the live broadcast stream.

In this embodiment, the live broadcast feature identifier corresponding to the live broadcast stream is determined by respectively extracting feature information of a video stream and an audio stream of the live broadcast stream and classifying the live broadcast stream according to the feature information.

In an embodiment, please refer to fig. 8, the step of calling a preset on-hook live broadcast verification policy to perform a first verification according to the on-air source information, the live broadcast feature identifier, or the live broadcast interactive data includes the following steps executed by the server:

step S131, when the open source information includes an open source type that is a video play source, acquiring supplemental enhancement information of a video stream corresponding to the video play source:

The server invokes the live broadcast verification strategy of hanging broadcast to verify the information of the play source of the main broadcasting end, and when the information of the play source is a video playing source, the server obtains a video stream corresponding to the video playing source, specifically, the video playing source is generally a video player, and the video stream is a video text played in the video playing source.

After the server obtains the video stream played by the video playing source, the supplemental enhancement information of the video stream is obtained, wherein the supplemental enhancement information refers to an identification code used for representing the video stream, and different video streams have different identification codes, such as an ID of the video stream is used for distinguishing different video streams.

Step S132, analyzing the supplementary enhancement information, and checking whether the supplementary enhancement information contains recorded broadcast feature identification:

after the server acquires the supplemental enhancement information of the video stream, the supplemental enhancement information is analyzed, and whether the supplemental enhancement information contains the recorded broadcast feature identification is checked.

The video stream with the recording and broadcasting characteristic identifier is generally a characteristic identifier unique to a recording and broadcasting video stream generated by a live broadcast recording tool of a live broadcast platform, and if the supplementary enhancement information of the video stream contains the recording and broadcasting characteristic identifier, the video stream is indicated to be the recording and broadcasting video stream.

Step S133, when the supplemental enhancement information includes the recording feature identifier, characterizing that the video stream is a recording video stream, and determining that the live broadcast room where the main broadcast segment is located is a hanging live broadcast room:

when the server verifies that the supplemental enhancement information of the video stream contains the recorded broadcast feature identifier, the video stream is characterized as the recorded broadcast video stream, namely, the live broadcast room accords with a hanging broadcast live broadcast verification strategy corresponding to the open broadcast source information, and the live broadcast room is preliminarily determined as the hanging broadcast live broadcast room by the server.

In this embodiment, when the live stream in the live broadcasting room is a video played by a host user through a video player, whether the video stream is a recorded video is determined by determining supplemental enhancement information of the video, so as to determine whether the live broadcasting room is a hanging live broadcasting room.

In an embodiment, referring to fig. 9, the step of calling a preset on-hook live broadcast verification policy to perform a first verification according to the on-air source information, the live broadcast feature identifier, or the live broadcast interactive data includes the following steps executed by the server:

step S131', determining a preset live broadcast partition of a live broadcast room where the main broadcasting end is located, and obtaining a live broadcast type corresponding to the live broadcast partition:

The preset live broadcast partition of the live broadcast room is generally set by the main broadcasting end, and the server determines the preset live broadcast partition of the live broadcast room to obtain the live broadcast type corresponding to the live broadcast room, for example, the live broadcast type corresponding to the live broadcast partition of the live broadcast room which is a singing partition is generally lyrics type.

Step S132', judging whether the live broadcast type is matched with the live broadcast feature identifier according to the live broadcast feature identifier which is newly identified for the live broadcast stream corresponding to the main broadcasting end:

and the server determines the live broadcast type represented by the live broadcast feature identifier according to the live broadcast feature identifier which is newly identified according to the live broadcast stream of the main broadcasting end, and judges whether the live broadcast type represented by the live broadcast feature identifier is the live broadcast type of the live broadcast room.

Step S133', when the live type does not match the live feature identifier, the live room will be determined as the hanging live room:

when the server determines that the live broadcast type of the live broadcast room is not matched with the corresponding live broadcast feature identification, the live broadcast room is initially determined as the on-hook live broadcast room by the server.

In this embodiment, whether the live broadcasting room is a hanging live broadcasting room is determined by determining whether the live broadcasting content of the live broadcasting room accords with the corresponding live broadcasting partition.

In an embodiment, please refer to fig. 3 and fig. 10, if the verification result is a suspected hanging broadcast live broadcast room, pushing the open broadcast source information, the live broadcast feature identifier, the live broadcast interactive data and the suspected recording broadcast screenshot to the auditing end for performing the second verification, including the following steps executed by the auditing end:

step S141, receiving suspected live-broadcast hanging room information pushed by a server, and outputting live-broadcast room characteristic information, opening source information, live-broadcast characteristic identification and live-broadcast interaction data contained in the suspected live-broadcast hanging room information to a graphical user interface for display:

the auditing end receives the suspected live-broadcast-hanging-room information pushed by the server, wherein the suspected live-broadcast-room information comprises the live-broadcast-room characteristic information, the open-broadcast source information, the live-broadcast characteristic identification and live-broadcast interaction data of a suspected live broadcast room, and the live-broadcast-room characteristic information comprises a live-broadcast room ID, a live-broadcast room partition, the number of live-broadcast room audiences, a main broadcasting name, equipment for carrying out live broadcast business and the like of the suspected live broadcast room.

Referring to fig. 3, after analyzing and acquiring the live broadcasting room feature information, the open source information, the live broadcasting feature identifier and the live broadcasting interaction data contained in the suspected live broadcasting room information, the auditing end outputs the information to the live broadcasting room auditing interface shown in fig. 3 for displaying.

Step S142, synchronously outputting the suspected recorded video and the recorded video corresponding to the suspected recorded video screenshot included in the suspected recorded live room information to a graphical user interface for display:

referring to fig. 3, fig. 3 is a schematic diagram of a graphical user interface of the on-hook live broadcasting room audit page, where the audit terminal outputs the suspected recorded screenshot to the suspected recorded screenshot window 301 in fig. 3 for display, so that the suspected recorded screenshot and the recorded video corresponding to the suspected recorded screenshot are synchronously output to the on-hook live broadcasting room audit page for display

Step S143, responding to the auditing event of the living broadcast room corresponding to the suspected hanging broadcasting living broadcast room information, and pushing the auditing result corresponding to the auditing event to a server:

referring to fig. 3, an audit result window 302 shown in fig. 3 may be used to generate an audit result edited by an auditor, when the auditor completes editing of the audit result through the audit result window 302, the audit terminal will respond to the audit event and push the audit result edited by the auditor in the audit result window 302 to the server, so that the server can determine whether the suspected live broadcasting-hanging room is a live broadcasting-hanging room according to the audit result.

In the embodiment, the manual auditing terminal is provided for further auditing whether the suspected live broadcasting hanging room is the live broadcasting hanging room or not, so that the accuracy of the live broadcasting hanging room is improved.

Further, by performing the functionalization of each step in the method disclosed in each of the foregoing embodiments, a live broadcast quality detection processing apparatus of the present application may be constructed, and according to this concept, please refer to fig. 11, in one exemplary embodiment, the apparatus includes: the live broadcast starting response module 11 is used for responding to a live broadcast room starting event of a main broadcasting end, acquiring the starting source information of the main broadcasting end acting on a live broadcast stream, monitoring a live broadcast interaction event of the main broadcasting end acting on the live broadcast room, and counting live broadcast interaction data corresponding to the live broadcast interaction event; the live stream identification module 12 is configured to identify a live broadcast feature identifier corresponding to the live stream, determine feature similarity between a video screenshot of the live stream and a recorded broadcast video stream to which the main broadcasting end belongs, and obtain a suspected recorded broadcast screenshot with higher feature similarity; the live broadcasting-hanging room verification module 13 is configured to invoke a preset live broadcasting-hanging verification policy, perform a first verification according to the open-broadcasting source information, the live broadcasting feature identifier, or the live broadcasting interactive data, and if the verification result is a live broadcasting-hanging room, correspondingly modify the live broadcasting authority of the main broadcasting end to control the output of the live broadcasting stream; and the auditing result processing module 14 is configured to push the open broadcast source information, the live broadcast feature identifier, the live broadcast interaction data and the suspected recorded broadcast screenshot to an auditing end for performing a second check if the checking result is a suspected hung broadcast live broadcast room, and further determine whether the live broadcast room is the hung broadcast live broadcast room according to the auditing result pushed by the auditing end.

In one embodiment, the live start response module 11 includes: the chat text acquisition sub-module is used for monitoring the public screen chat interaction event acted on the live broadcasting room by the anchor terminal and acquiring one or more chat texts output to the public screen chat area of the live broadcasting room by the anchor terminal; the text content acquisition sub-module is used for carrying out acoustic voice recognition on the audio stream in the live stream of the anchor terminal to acquire text content corresponding to voice information; the user nickname matching sub-module is used for acquiring user nicknames corresponding to a plurality of audience terminals in the live broadcasting room and checking whether phrases matched with the user nicknames exist in each chat text and text content; and the result number counting sub-module is used for counting the number of the results with matched phrases as the verification result, and the live interaction data contains the number of the results.

In one embodiment, the live stream identification module 12 includes: the gift giving response sub-module is used for responding to a virtual gift giving event acted on the living broadcast room and obtaining a nickname of a gift giving user at a spectator end giving a virtual gift corresponding to the event; a viewer entry response sub-module, configured to obtain a new viewer user nickname of a new viewer end entering the live broadcast room in response to a viewer entry event acting on the live broadcast room; the text content acquisition sub-module is used for carrying out acoustic voice recognition on the audio stream in the live stream of the anchor terminal to acquire text content corresponding to voice information; and the user nickname matching sub-module is used for checking whether the text content is matched with the gift sending user nickname or the new audience user nickname, and if yes, the live broadcast interaction data corresponding to the host side is correspondingly updated.

In another embodiment, the live stream identification module 12 further includes: the live stream feature extraction submodule is used for calling the image feature extraction model trained until convergence to extract a video stream in the live stream and obtaining an image feature vector corresponding to the video stream; the text content acquisition sub-module is used for calling the voice recognition model trained until convergence to extract the audio stream in the live stream and acquire the text content corresponding to the audio stream; the text feature acquisition sub-module is used for calling a text feature extraction model trained until convergence to extract the text content and acquiring a text feature vector of the text information; and the live broadcast feature identification determining submodule is used for respectively carrying out classified mapping on the image feature vector and the text feature vector and determining the corresponding live broadcast feature identification of the live broadcast stream.

In one embodiment, the on-hook live room verification module 13 includes: the supplementary enhancement information acquisition sub-module is used for acquiring supplementary enhancement information of a video stream corresponding to a video play source when the open play source information contains the open play source type which is the video play source; the supplementary enhancement information analysis sub-module is used for analyzing the supplementary enhancement information and checking whether the supplementary enhancement information contains the recorded broadcast feature identification; and the live broadcasting-hanging room determining submodule is used for characterizing the video stream as a recorded broadcast video stream when the supplementary enhancement information contains the recorded broadcast characteristic identifier, and the live broadcasting room where the main broadcasting section is located is determined to be the live broadcasting-hanging room.

In another embodiment, the on-hook live room verification module 13 further includes: the live broadcast type acquisition sub-module is used for determining a preset live broadcast partition of a live broadcast room where the main broadcasting end is located and acquiring a live broadcast type corresponding to the live broadcast partition; the type characteristic matching sub-module is used for judging whether the live broadcast type is matched with the live broadcast characteristic identifier according to the live broadcast characteristic identifier which is latest identified by the live broadcast stream corresponding to the main broadcasting end; and the live broadcasting hanging room determining submodule determines the live broadcasting room as the live broadcasting hanging room when the live broadcasting type is not matched with the live broadcasting characteristic identifier.

In one embodiment, the audit result processing module 14 includes: the information output and display sub-module is used for receiving the suspected hanging broadcast live broadcast room information pushed by the server and outputting the live broadcast room characteristic information, the open broadcast source information, the live broadcast characteristic identification and the live broadcast interaction data contained in the suspected hanging broadcast live broadcast room information to the graphical user interface for display; the information synchronous display sub-module is used for synchronously outputting the suspected recorded video screenshot contained in the suspected recorded video broadcasting room information and the recorded video corresponding to the suspected recorded video screenshot to a graphical user interface for display; and the auditing result pushing sub-module is used for responding to the auditing event of the live broadcasting room corresponding to the suspected hanging broadcasting live broadcasting room information and pushing the auditing result corresponding to the auditing event to the server.

In order to solve the technical problem, the embodiment of the application also provides a computer device for running a computer program implemented according to the live broadcast quality detection processing method. Referring specifically to fig. 12, fig. 12 is a basic structural block diagram of a computer device according to the present embodiment.

As shown in fig. 12, the internal structure of the computer device is schematically shown. The computer device includes a processor, a non-volatile storage medium, a memory, and a network interface connected by a system bus. The nonvolatile storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store a control information sequence, and when the computer readable instructions are executed by a processor, the processor can realize a live broadcast quality detection processing method. The processor of the computer device is used to provide computing and control capabilities, supporting the operation of the entire computer device. The memory of the computer device may have stored therein computer readable instructions that, when executed by the processor, cause the processor to perform a live quality detection processing method. The network interface of the computer device is for communicating with a terminal connection. It will be appreciated by those skilled in the art that the structure shown in fig. 12 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.

In this embodiment, the processor is configured to execute specific functions of each module/sub-module in the live broadcast quality detection processing apparatus according to the present invention, and the memory stores program codes and various types of data required for executing the modules. The network interface is used for data transmission between the user terminal or the server. The memory in the present embodiment stores program codes and data required for executing all modules/sub-modules in the live broadcast quality detection processing apparatus, and the server can call the program codes and data of the server to execute the functions of all sub-modules.

The present application also provides a non-volatile storage medium, in which the live quality detection processing method is written as a computer program, and the computer program is stored in the storage medium in the form of computer readable instructions, where the computer readable instructions when executed by one or more processors mean that the program runs in a computer, thereby causing the one or more processors to execute the steps of the live quality detection processing method in any of the foregoing embodiments.

Those skilled in the art will appreciate that implementing all or part of the above-described methods in accordance with the embodiments may be accomplished by way of a computer program stored in a computer-readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. The storage medium may be a nonvolatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a random access Memory (Random Access Memory, RAM).

In summary, this application provides the live room of hanging broadcast function that exists among the testing platform for the live platform, carries out hanging broadcast check-up to the live room in a multidimensional, compares the limitation of traditional single live data check-up mode, and this application has promoted the check-up rate of hanging broadcast live room effectively, prevents to appear the condition of misjudgement, causes the live room of normal live broadcast in the error-seal platform, influences the live business of main broadcasting user in the normal live room and spectator user's live broadcast and watches experience.

It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the flowcharts of the figures may include a plurality of sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily being sequential, but may be performed in turn or alternately with other steps or at least a portion of the other steps or stages.

Those of skill in the art will appreciate that the various operations, methods, steps in the flow, actions, schemes, and alternatives discussed in the present application may be alternated, altered, combined, or eliminated. Further, other steps, means, or steps in a process having various operations, methods, or procedures discussed in this application may be alternated, altered, rearranged, split, combined, or eliminated. Further, steps, measures, schemes in the prior art with various operations, methods, flows disclosed in the present application may also be alternated, altered, rearranged, decomposed, combined, or deleted.

The foregoing is only a partial embodiment of the present application, and it should be noted that, for a person skilled in the art, several improvements and modifications can be made without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims

1. The live broadcast quality detection processing method is characterized by comprising the following steps of:

Identifying a live broadcast feature identifier corresponding to a video stream and an audio stream in the live broadcast stream, determining feature similarity of a video screenshot of the live broadcast stream and a recorded broadcast video stream to which the main broadcasting end belongs, and acquiring a suspected recorded broadcast screenshot with higher feature similarity;

invoking a preset on-hook live broadcast verification strategy, carrying out first verification according to the on-hook source information, the live broadcast feature identification or the live broadcast interaction data, and correspondingly modifying the live broadcast authority of the main broadcasting end to control the output of the live broadcast stream if the verification result is an on-hook live broadcast room, wherein when the on-hook source information comprises an on-hook source type which is a video playing source, and when the supplementary enhancement information of the video stream of the video playing source comprises a recorded broadcast feature identification, the verification result is an on-hook live broadcast room, and when the live broadcast feature identification is not matched with a live broadcast type corresponding to a preset live broadcast partition of the live broadcast room, the verification result is an on-hook live broadcast room;

the preset hanging broadcast and live broadcast verification strategy comprises the following steps: when the verification results of the verification according to the open-broadcasting source information, the live broadcast characteristic identification and the live broadcast interaction data are all the live broadcast hanging and broadcasting rooms, the live broadcast room is determined to be the live broadcast hanging and broadcasting room, and when the verification results of the verification according to the open-broadcasting source information, the live broadcast characteristic identification and the live broadcast interaction data are not the live broadcast hanging and broadcasting room, the live broadcast room is determined to be the suspected live broadcast hanging and broadcasting room;

And when the live broadcasting room is determined to be the suspected live broadcasting room, pushing the open broadcasting source information, the live broadcasting feature identification, the live broadcasting interaction data and the suspected recorded broadcasting screenshot to an auditing end to carry out second checking, and further determining whether the live broadcasting room is the live broadcasting room according to an auditing result pushed by the auditing end.

2. The method of claim 1, wherein the step of monitoring live interaction events acted by the main broadcasting end on the live broadcasting room and counting live interaction data corresponding to the live interaction events includes the following steps executed by a server:

3. The method of claim 1, wherein the step of monitoring live interaction events acted by the main broadcasting end on the live broadcasting room and counting live interaction data corresponding to the live interaction events includes the following steps executed by a server:

4. The method according to claim 1, wherein the step of identifying the live characteristic identifier corresponding to the live stream includes the steps performed by the server of:

5. The method of claim 1, wherein the step of invoking a preset on-hook live verification policy to perform the first verification according to the on-air source information, the live feature identifier, or the live interaction data includes the steps performed by the server:

and when the supplementary enhancement information contains the recorded broadcast feature identifier, characterizing the video stream as a recorded broadcast video stream, and determining a live broadcast room where the main broadcasting end is located as a hanging broadcast live broadcast room.

6. The method of claim 1, wherein the step of invoking a preset on-hook live verification policy to perform the first verification according to the on-air source information, the live feature identifier, or the live interaction data includes the steps performed by the server:

7. The method of claim 1, wherein the step of pushing the open source information, the live broadcast feature identifier, the live broadcast interactive data and the suspected recorded broadcast screenshot to the auditing end for the second verification if the verification result is a suspected hanging broadcast live broadcast room comprises the steps executed by the auditing end:

8. A live broadcast quality detection processing apparatus, comprising:

the live stream identification module is used for identifying live broadcast feature identifiers corresponding to video streams and audio streams in the live streams, determining feature similarity of video screenshots of the live streams and recorded broadcast video streams of the main broadcasting end, and acquiring suspected recorded broadcast screenshots with higher feature similarity;

the live broadcasting room verification module is used for calling a preset live broadcasting verification strategy, carrying out first verification according to the open broadcasting source information, the live broadcasting feature identification or the live broadcasting interaction data, and correspondingly modifying the live broadcasting authority of the main broadcasting end to control the output of the live broadcasting stream if the verification result is the live broadcasting room, wherein when the open broadcasting source information comprises the open broadcasting source type which is a video broadcasting source, and when the supplementary enhancement information of the video stream of the video broadcasting source comprises the recorded broadcasting feature identification, the verification result is the live broadcasting room, and when the live broadcasting feature identification is not matched with the live broadcasting type corresponding to the preset live broadcasting partition of the live broadcasting room, the verification result is the live broadcasting room;

and the auditing result processing module is used for pushing the open broadcast source information, the live broadcast characteristic identification, the live broadcast interaction data and the suspected recorded broadcast screenshot to an auditing end for second checking when the live broadcast room is determined to be the suspected hung broadcast live broadcast room, and further determining whether the live broadcast room is the hung broadcast live broadcast room according to the auditing result pushed by the auditing end.

9. An electronic device comprising a central processor and a memory, characterized in that the central processor is adapted to invoke a computer program stored in the memory for performing the steps of the method according to any of claims 1 to 7.

10. A non-volatile storage medium, characterized in that it stores in the form of computer readable instructions a computer program implemented according to the method of any one of claims 1 to 7, which when invoked by a computer, performs the steps comprised by the method.