CN114466210A - Live broadcast quality detection processing method and device, equipment, medium and product thereof - Google Patents
Live broadcast quality detection processing method and device, equipment, medium and product thereof Download PDFInfo
- Publication number
- CN114466210A CN114466210A CN202210102482.6A CN202210102482A CN114466210A CN 114466210 A CN114466210 A CN 114466210A CN 202210102482 A CN202210102482 A CN 202210102482A CN 114466210 A CN114466210 A CN 114466210A
- Authority
- CN
- China
- Prior art keywords
- live broadcast
- live
- broadcast
- room
- stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 25
- 238000003672 processing method Methods 0.000 title claims abstract description 16
- 230000002452 interceptive effect Effects 0.000 claims abstract description 89
- 238000012795 verification Methods 0.000 claims abstract description 74
- 230000003993 interaction Effects 0.000 claims abstract description 60
- 238000000034 method Methods 0.000 claims abstract description 39
- 238000012544 monitoring process Methods 0.000 claims abstract description 17
- 238000012550 audit Methods 0.000 claims description 42
- 101150054987 ChAT gene Proteins 0.000 claims description 37
- 101100203187 Mus musculus Sh2d3c gene Proteins 0.000 claims description 37
- 239000013598 vector Substances 0.000 claims description 37
- 238000012545 processing Methods 0.000 claims description 23
- 238000005192 partition Methods 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 16
- 238000000605 extraction Methods 0.000 claims description 16
- 230000004044 response Effects 0.000 claims description 13
- 238000013507 mapping Methods 0.000 claims description 6
- 230000000153 supplemental effect Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 10
- 238000004891 communication Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 7
- 238000012552 review Methods 0.000 description 7
- 230000008901 benefit Effects 0.000 description 5
- 239000000284 extract Substances 0.000 description 4
- 238000007781 pre-processing Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 238000013524 data verification Methods 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013145 classification model Methods 0.000 description 1
- 238000004132 cross linking Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The application discloses a live broadcast quality detection processing method, a device, equipment and a medium thereof, wherein the method comprises the following steps: responding to a live broadcast room starting event of the anchor end, determining the starting source information of the anchor end, monitoring a live broadcast interaction event acted on the live broadcast room by the anchor end, and counting live broadcast interaction data; identifying a live broadcast characteristic identifier of a live broadcast stream, determining the characteristic similarity of a video screenshot of the live broadcast stream and a recorded and broadcast video stream of a main broadcast end, and acquiring a suspected recorded and broadcast screenshot with higher characteristic similarity; calling a live broadcast verification strategy, performing first verification according to the broadcast source information, the live broadcast characteristic identification or the live broadcast interactive data, and correspondingly modifying the live broadcast authority of the anchor terminal if the verification result is a live broadcast room; and if the verification result is that the live broadcast is suspected to be hung, pushing the broadcast source information, the live broadcast characteristic identification, the live broadcast interactive data and the suspected recorded broadcast screenshot to an auditing end for second verification. The method and the device for detecting the hanging broadcast live broadcast room in the multi-dimensional mode optimize the quality of the live broadcast room of the platform.
Description
Technical Field
The present application relates to the field of network live broadcast, and in particular, to a live broadcast quality detection processing method, and further, to an apparatus, a device, a non-volatile storage medium, and a computer program product corresponding to the method.
Background
With the development of the internet, various live broadcast platforms exist in the internet, and each platform provides live broadcast room online service for platform users, so that anchor users open live broadcast rooms in the platform, audience users are attracted to enter the live broadcast rooms to participate in anchor activities started by the anchor users, various types of live broadcast rooms exist in the live broadcast platforms for the platform users to browse, and the use experience of the users in the platform is improved.
However, in the existing live broadcast platform, there is a live broadcast room in which part of live broadcasts are performed in a live broadcast form, which affects the live broadcast room services of the platform, and the live broadcast room in which low-quality live broadcasts are performed on the live broadcast platform is a live broadcast room, for example, by playing a previous live broadcast video or live broadcast in the live broadcast room without related live broadcast content in a live broadcast partition where the live broadcast room is located, or only starting the live broadcast room without performing any live broadcast service, and then using live broadcast reward rules set by the live broadcast platform, relevant economic benefits are gained from the live broadcast platform, and the live broadcast room in the platform affects the live broadcast viewing experience of the platform user, which causes the loss of the platform user.
In view of the above problems, the applicant has made a corresponding search in view of the problems.
Disclosure of Invention
It is an object of the present application to meet the needs of the prior art or overcome at least some of the deficiencies of the prior art and to provide a live broadcast quality detection processing method and a corresponding apparatus, electronic device, non-volatile storage medium, and computer program product.
In order to realize the purpose of the application, the following technical scheme is adopted:
the method for detecting and processing the live broadcast quality is suitable for the purpose of the application and comprises the following steps:
responding to a live broadcast room opening event of an anchor end, acquiring the opening source information of a live broadcast stream acted by the anchor end, monitoring the live broadcast interaction event acted by the anchor end on the live broadcast room, and counting live broadcast interaction data corresponding to the live broadcast interaction event;
identifying a live broadcast characteristic identifier corresponding to the live broadcast stream, determining the characteristic similarity between a video screenshot of the live broadcast stream and a recorded and broadcast video stream to which the anchor terminal belongs, and acquiring a suspected recorded and broadcast screenshot with higher characteristic similarity;
calling a preset on-hook broadcast live broadcast verification strategy, performing first verification according to the broadcast source information, the live broadcast characteristic identification or the live broadcast interactive data, and if the verification result is an on-hook broadcast live broadcast room, correspondingly modifying the live broadcast authority of the anchor end to control the output of the live broadcast stream;
and if the verification result is that the live broadcast room is suspected to be the on-hook broadcast live broadcast room, pushing the starting source information, the live broadcast characteristic identification, the live broadcast interactive data and the suspected recorded and broadcast screenshot to an auditing end to perform second verification, and further determining whether the live broadcast room is the on-hook broadcast live broadcast room or not according to the auditing result pushed by the auditing end.
In a further embodiment, the step of monitoring a live broadcast interaction event that the anchor terminal acts on the live broadcast room and counting live broadcast interaction data corresponding to the live broadcast interaction event includes the following steps executed by the server:
monitoring a public screen chat interaction event acted by the anchor terminal in a live broadcast room, and acquiring one or more chat texts output by the anchor terminal to a public screen chat area of the live broadcast room;
performing acoustic voice recognition on an audio stream in a live stream of the anchor terminal to obtain text content corresponding to voice information in the audio stream;
obtaining user nicknames corresponding to a plurality of audience terminals in the live broadcast room, and checking whether phrases matched with the user nicknames exist in the chat texts and the text contents or not;
and counting the number of the results of the verification result, wherein the number of the results is the number of the results of the matched phrases, and the live broadcast interactive data comprises the number of the results.
In a further embodiment, the step of monitoring a live broadcast interaction event that the anchor terminal acts on the live broadcast room and counting live broadcast interaction data corresponding to the live broadcast interaction event includes the following steps executed by the server:
responding to a virtual gift presenting event acting on the live broadcast room, and acquiring a nickname of a gift sending user of a spectator end presenting a virtual gift corresponding to the event;
responding to a spectator entrance event acting on the live broadcast room, and acquiring a nickname of a new spectator user entering a new spectator end of the live broadcast room;
performing acoustic voice recognition on an audio stream in a live stream of the anchor terminal to obtain text content corresponding to voice information in the audio stream;
and checking whether the text content is matched with the nickname of the gift sending user or the nickname of the new audience user, and if so, correspondingly updating the live broadcast interactive data corresponding to the main broadcast terminal.
In a further embodiment, the step of identifying the live broadcast feature identifier corresponding to the live broadcast stream includes the following steps executed by the server:
calling an image feature extraction model trained to be convergent to extract a video stream in the live stream, and acquiring an image feature vector corresponding to the video stream;
calling a speech recognition model trained to convergence to extract an audio stream in the live stream, and acquiring text content corresponding to the audio stream;
calling a text feature extraction model trained to be convergent to extract the text content, and acquiring a text feature vector of the text information;
and respectively carrying out classification mapping on the image characteristic vector and the text characteristic vector, and determining the corresponding live broadcast characteristic identification of the live broadcast stream.
In a further embodiment, the step of calling a preset on-air live broadcast verification policy and performing the first verification according to the broadcast source information, the live broadcast feature identifier or the live broadcast interactive data includes the following steps executed by the server:
when the broadcast source information contains a broadcast source type of a video broadcast source, acquiring supplementary enhancement information of a video stream corresponding to the video broadcast source;
analyzing the supplementary enhancement information and checking whether the supplementary enhancement information contains a recorded broadcast characteristic identifier;
and when the supplementary enhancement information contains the recorded broadcast characteristic identification, the video stream is represented as a recorded broadcast video stream, and the live broadcast room where the main broadcast section is located is determined as a hanging broadcast live broadcast room.
In a further embodiment, the step of calling a preset on-air live broadcast verification policy and performing the first verification according to the broadcast source information, the live broadcast feature identifier or the live broadcast interactive data includes the following steps executed by the server:
determining a preset live broadcast partition of a live broadcast room where the anchor terminal is located, and acquiring a live broadcast type corresponding to the live broadcast partition;
judging whether the live broadcast type is matched with the live broadcast characteristic identification or not according to the live broadcast characteristic identification which is identified by the live broadcast stream corresponding to the anchor terminal at the latest time;
when the live type is not matched with the live characteristic identification, the live room is determined as the hanging live room.
In a further embodiment, if the verification result is that the live broadcast room is suspected to be on-air, the step of pushing the broadcast source information, the live broadcast feature identifier, the live broadcast interactive data and the suspected recorded broadcast screenshot to an auditing end for second verification includes the following steps executed by the auditing end:
receiving suspected on-hook live broadcast room information pushed by a server, and outputting live broadcast room characteristic information, broadcast source information, live broadcast characteristic identification and live broadcast interactive data contained in the suspected on-hook live broadcast room information to a graphical user interface for displaying;
synchronously outputting the suspected recorded and broadcast screenshot contained in the suspected on-hook broadcast live room information and the recorded and broadcast video corresponding to the suspected recorded and broadcast screenshot to a graphical user interface for display;
and responding to an audit event acting on the live broadcast room corresponding to the suspected hanging live broadcast room information, and pushing an audit result corresponding to the audit event to a server.
Adapt to the purpose of this application and a live broadcast quality detection processing apparatus that proposes, it includes:
the live broadcast starting response module is used for responding to a live broadcast room starting event of an anchor end, acquiring the starting source information of a live broadcast stream acted by the anchor end, monitoring the live broadcast interaction event acted by the anchor end on the live broadcast room, and counting live broadcast interaction data corresponding to the live broadcast interaction event;
the live stream identification module is used for identifying a live stream characteristic identifier corresponding to the live stream, determining the characteristic similarity between a video screenshot of the live stream and a recorded and broadcast video stream to which the anchor terminal belongs, and acquiring a suspected recorded and broadcast screenshot with higher characteristic similarity;
the hanging broadcast live broadcast room checking module is used for calling a preset hanging broadcast live broadcast checking strategy, carrying out first checking according to the broadcasting source information, the live broadcast characteristic identification or the live broadcast interactive data, and correspondingly modifying the live broadcast authority of the main broadcast end to control the output of the live broadcast stream if the checking result is the hanging broadcast live broadcast room;
and the auditing result processing module is used for pushing the broadcast source information, the live broadcast characteristic identifier, the live broadcast interactive data and the suspected recorded broadcast screenshot to an auditing end for second auditing if the verifying result is that the live broadcast room is a suspected live broadcast room, and further determining whether the live broadcast room is the live broadcast room or not according to the auditing result pushed by the auditing end.
In a further embodiment, the live start response module includes:
the chat text acquisition submodule is used for monitoring a public screen chat interaction event acted by the anchor terminal in a live broadcast room and acquiring one or more chat texts output by the anchor terminal to a public screen chat area of the live broadcast room;
the text content acquisition submodule is used for carrying out acoustic voice recognition on an audio stream in the live stream of the anchor end to obtain text content corresponding to voice information in the audio stream;
the user nickname matching sub-module is used for acquiring the nicknames of the users corresponding to a plurality of audience terminals in the live broadcast room and checking whether phrases matched with the nicknames of the users exist in the chat texts and the text contents;
and the result quantity counting submodule is used for counting the result quantity of the verification result which is the result quantity with the matched phrase, and the live broadcast interactive data comprises the result quantity.
In a further embodiment, the live stream identification module includes:
the gift-giving response sub-module is used for responding to the virtual gift-giving event acting on the live broadcast room and acquiring the nickname of the gift-giving user of the audience end of the virtual gift corresponding to the event;
the audience entering response submodule is used for responding to an audience entering event acting on the live broadcast room and acquiring a new audience user nickname of a new audience end entering the live broadcast room;
the text content acquisition submodule is used for carrying out acoustic voice recognition on an audio stream in the live stream of the anchor end to obtain text content corresponding to voice information in the audio stream;
and the user nickname matching sub-module is used for verifying whether the text content is matched with the nickname of the gift sending user or the nickname of the new audience user, and if so, the live broadcast interactive data corresponding to the anchor terminal is correspondingly updated.
In a preferred embodiment, the live stream identification module further includes:
the live stream feature extraction submodule is used for calling an image feature extraction model trained to be convergent to extract a video stream in the live stream and acquiring an image feature vector corresponding to the video stream;
the text content acquisition sub-module is used for calling a speech recognition model trained to be convergent to extract an audio stream in the live stream and acquiring text content corresponding to the audio stream;
the text feature acquisition submodule is used for calling a text feature extraction model trained to be convergent to extract the text content and acquiring a text feature vector of the text information;
and the live broadcast feature identification determining submodule is used for respectively carrying out classification mapping on the image feature vector and the text feature vector and determining the corresponding live broadcast feature identification of the live broadcast stream.
In a further embodiment, the live webcast room checking module includes:
the supplementary enhancement information acquisition submodule is used for acquiring supplementary enhancement information of a video stream corresponding to a video playing source when the playing source information contains the type of the playing source of the video playing source;
the supplementary enhancement information analysis submodule is used for analyzing the supplementary enhancement information and checking whether the supplementary enhancement information contains a recorded broadcast characteristic identifier;
and the live broadcast hanging room determining submodule is used for representing that the video stream is a recorded broadcast video stream when the supplementary enhancement information contains the recorded broadcast characteristic identification, and determining the live broadcast room where the main broadcast section is positioned as the live broadcast hanging room.
In a preferred embodiment, the live webcast room checking module further includes:
the live broadcast type acquisition submodule is used for determining a preset live broadcast partition of a live broadcast room where the anchor terminal is located and acquiring a live broadcast type corresponding to the live broadcast partition;
the type feature matching submodule is used for judging whether the live broadcast type is matched with the live broadcast feature identification according to the live broadcast feature identification which is identified by the live broadcast stream corresponding to the anchor terminal at the latest time;
and a live hanging room determining submodule, wherein when the live type is not matched with the live characteristic identification, the live broadcasting room is determined as the live hanging room.
In a further embodiment, the audit result processing module includes:
the information output display sub-module is used for receiving suspected on-hook live broadcast room information pushed by the server and outputting live broadcast room characteristic information, broadcast source information, live broadcast characteristic identification and live broadcast interaction data contained in the suspected on-hook live broadcast room information to a graphical user interface for display;
the information synchronous display sub-module is used for synchronously outputting the suspected recorded and broadcast screenshot contained in the suspected on-hook broadcast live broadcasting room information and the recorded and broadcast video corresponding to the suspected recorded and broadcast screenshot to a graphical user interface for display;
and the auditing result pushing submodule is used for responding to an auditing event acting on the live broadcast room corresponding to the suspected on-hook broadcast live broadcast room information and pushing the auditing result corresponding to the auditing event to the server.
The electronic device comprises a central processing unit and a memory, wherein the central processing unit is used for calling and running a computer program stored in the memory to execute the steps of the live broadcast quality detection processing method.
The non-volatile storage medium stores a computer program implemented according to the live broadcast quality detection processing method, and when the computer program is called by a computer, the computer program executes the steps included in the corresponding method.
In order to solve the foregoing technical problem, an embodiment of the present application further provides a computer program product, which includes a computer program and a computer instruction, and when the computer program and the computer instruction are executed by a processor, the processor executes the steps of the live data hierarchical prediction method or the live quality detection processing method.
Compared with the prior art, the application has the following advantages:
this application provides the function of the on-hook broadcast live broadcast room that exists among the testing platform for the live broadcast platform, according to the source of opening of the live broadcast room that is in the platform, live broadcast interactive data, live characteristic identification carries out the check-up and detects, whether to be on-hook broadcast live broadcast room in order to judge the live broadcast room, carry out the on-hook broadcast check-up to the live broadcast room multidimension according to each type live broadcast information of live broadcast room, compare the limitation of single live broadcast data check-up mode traditionally, the check-up accuracy of on-hook broadcast live broadcast room has been promoted effectively in this application, the condition of erroneous judgement prevents to appear, cause the live broadcast room of normal live broadcast in the mistake seal platform, influence in the normal live broadcast room live broadcast user's live broadcast business go on and audience user's live broadcast watch experience.
Secondly, the method and the system can automatically detect the on-hook broadcast live broadcast room in the platform, and can also intercept the suspected recorded and broadcast video screenshot in the live broadcast stream, so that when the automatic verification on-hook broadcast system cannot determine whether the suspected on-hook broadcast live broadcast room is the on-hook broadcast live broadcast room, the live broadcast information of the suspected on-hook broadcast live broadcast room and the suspected recorded and broadcast video screenshot are pushed to a verification end for manual verification, and the accuracy of the on-hook broadcast verification of the whole on-hook broadcast verification system is improved.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic diagram of a typical network deployment architecture related to implementing the technical solution of the present application;
fig. 2 is a schematic flow chart of an exemplary embodiment of a live broadcast quality detection processing method according to the present application;
fig. 3 is a schematic diagram of a graphical user interface of an audit page of a on-hook live broadcast room in the present application;
FIG. 4 is a schematic view of a graphical user interface of a live view page of the present application;
FIG. 5 is a schematic flow chart illustrating the statistical processing of live interactive data in response to a public screen chat interaction event according to an embodiment of the present application;
FIG. 6 is a flow chart illustrating the statistical live interaction data generated by the present application in response to a virtual gift-giving event and an audience-entering event;
fig. 7 is a schematic flowchart illustrating a process performed by the embodiment of the present application for identifying a live broadcast feature identifier corresponding to a live broadcast stream;
fig. 8 is a schematic flowchart illustrating a live-on-air verification policy for broadcast source information according to an embodiment of the present disclosure;
fig. 9 is a schematic flowchart illustrating a live-on-air verification policy for live feature identifiers according to an embodiment of the present application;
FIG. 10 is a schematic flow chart illustrating an embodiment of processing a suspected live room in an audit end according to the present application;
fig. 11 is a functional block diagram of an exemplary embodiment of a live broadcast quality detection processing apparatus according to the present application;
fig. 12 is a block diagram of a basic structure of a computer device according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As used herein, "client," "terminal," and "terminal device" include both wireless signal receiver devices, which are only capable of wireless signal receiver devices without transmit capability, and receiving and transmitting hardware devices, which have receiving and transmitting hardware capable of two-way communication over a two-way communication link, as will be understood by those skilled in the art. Such a device may include: cellular or other communication devices such as personal computers, tablets, etc. having single or multi-line displays or cellular or other communication devices without multi-line displays; PCS (Personal Communications Service), which may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant), which may include a radio frequency receiver, a pager, internet/intranet access, a web browser, a notepad, a calendar and/or a GPS (Global Positioning System) receiver; a conventional laptop and/or palmtop computer or other appliance having and/or including a radio frequency receiver. As used herein, a "client," "terminal device" can be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. The "client", "terminal Device" used herein may also be a communication terminal, a web terminal, a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, and may also be a smart tv, a set-top box, and the like.
The hardware referred to by the names "server", "client", "service node", etc. is essentially an electronic device with the performance of a personal computer, and is a hardware device having necessary components disclosed by the von neumann principle such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, an output device, etc., a computer program is stored in the memory, and the central processing unit calls a program stored in an external memory into the internal memory to run, executes instructions in the program, and interacts with the input and output devices, thereby completing a specific function.
It should be noted that the concept of "server" as referred to in this application can be extended to the case of a server cluster. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided, and in physical space, the servers may be independent from each other but can be called through an interface, or may be integrated into one physical computer or a set of computer clusters. Those skilled in the art will appreciate this variation and should not be so limited as to restrict the implementation of the network deployment of the present application.
Referring to fig. 1, the hardware basis required for implementing the related art embodiments of the present application may be deployed according to the architecture shown in the figure. The server 80 is deployed at the cloud end, and serves as a business server, and is responsible for further connecting to a related data server and other servers providing related support, so as to form a logically associated server cluster to provide services for related terminal devices, such as a smart phone 81 and a personal computer 82 shown in the figure, or a third-party server (not shown in the figure). Both the smart phone and the personal computer can access the internet through a known network access mode, and establish a data communication link with the cloud server 80 so as to run a terminal application program related to the service provided by the server.
For the server, the application program is usually constructed as a service process, and a corresponding program interface is opened for remote call of the application program running on various terminal devices.
The application program refers to an application program running on a server or a terminal device, the application program implements the related technical scheme of the application in a programming mode, a program code of the application program can be saved in a nonvolatile storage medium which can be identified by a computer in a form of a computer executable instruction, and is called into a memory by a central processing unit to run, and the related device of the application is constructed by running the application program on the computer.
For the server, the application program is usually constructed as a service process, and a corresponding program interface is opened for remote call of the application program running on various terminal devices.
The technical scheme suitable for being implemented in the terminal device in the application can also be programmed and built in an application program providing live webcasting, and the technical scheme is used as a part of extended functions. The live webcast refers to a live webcast room network service realized based on the network deployment architecture.
The live broadcast room is a video chat room realized by means of an internet technology, generally has an audio and video broadcast control function and comprises a main broadcast user and audience users, wherein the audience users can comprise registered users registered in a platform or unregistered tourist users; either registered users who are interested in the anchor user or registered or unregistered users who are not interested in the anchor user. The interaction between the anchor user and the audience user can be realized through known online interaction modes such as voice, video, characters and the like, generally, the anchor user performs programs for the audience user in the form of audio and video streams, and economic transaction behaviors can also be generated in the interaction process. Of course, the application form of the live broadcast room is not limited to online entertainment, and can be popularized to other relevant scenes, such as an educational training scene, a video conference scene, a product recommendation and sale scene, and any other scene needing similar interaction.
The person skilled in the art will know this: although the various methods of the present application are described based on the same concept so as to be common to each other, they may be independently performed unless otherwise specified. In the same way, for each embodiment disclosed in the present application, the same inventive concept is proposed, and therefore, concepts expressed in the same manner and concepts expressed in terms of the same are equally understood, and even though the concepts are expressed differently, they are merely convenient and appropriately changed.
The embodiments to be disclosed herein can be flexibly constructed by cross-linking related technical features of the embodiments unless the mutual exclusion relationship between the related technical features is stated in the clear text, as long as the combination does not depart from the inventive spirit of the present application and can meet the needs of the prior art or solve the deficiencies of the prior art. Those skilled in the art will appreciate variations therefrom.
Referring to fig. 2, in an exemplary embodiment of a live broadcast quality detection processing method of the present application, the method includes the following steps:
step S11, responding to a live broadcast room start event of the anchor, acquiring start source information of the anchor acting on a live broadcast stream, monitoring a live broadcast interaction event of the anchor acting on the live broadcast room, and counting live broadcast interaction data corresponding to the live broadcast interaction event:
the server responds to the live broadcast room opening event of any anchor terminal in the platform, acquires the opening source information of the live broadcast stream pushed by the anchor terminal, monitors the live broadcast interaction event of the anchor terminal in the live broadcast room opened by the anchor terminal after the live broadcast room of the anchor terminal is opened, and further counts the live broadcast interaction data of the prison where the live broadcast interaction event is located.
The live broadcast room opening event refers to an event that a live broadcast room for carrying out live broadcast services is opened by a main broadcast end in a current live broadcast platform, and the server responds to the live broadcast room opening event in the current live broadcast platform to further acquire the start source information of the live broadcast stream pushed by the main broadcast end to which the live broadcast room opening event belongs.
The broadcast source information refers to an opening tool used for representing a main broadcast end to generate a live stream of the main broadcast end, for example, when the live stream pushed to the server by the main broadcast end is a video stream for shooting, the type of the opening source included in the broadcast source information corresponding to the live stream is a video tool, such as a camera of a mobile phone or a camera, and a shooting and playing source, such as a video player, when the live stream pushed to the server by the main broadcast end is a video file, the type of the opening source included in the broadcast source information corresponding to the live stream is a video playing source, such as a video player, and for example, when the live stream is an audio stream, the type of the opening source included in the broadcast source information corresponding to the live stream may be an audio playing source, such as a microphone or an audio player, of course, the live stream of the main broadcast end may be a live stream generated by a plurality of opening tools, for example, when the live stream is the content of an open-face commentary movie, the live stream includes a video picture generated by the anchor user through the opening source type as a camera, a movie picture generated by the video player through the opening source type, and an audio stream through a microphone, and when the anchor end closes any opening tool, the opening source type corresponding to the closed opening tool is recorded in the opening source information of the corresponding live stream.
And after responding to the live broadcast room starting event and acquiring the live broadcast stream pushed by the anchor terminal, the server acquires the broadcast source information contained in the live broadcast stream characteristic information through the corresponding live broadcast stream characteristic information.
After the anchor terminal opens the live broadcast room to perform the live broadcast service, the server monitors the live broadcast interaction event acted on the live broadcast room by the anchor terminal, wherein the live broadcast interaction event refers to the interaction event based on the live broadcast service between the anchor terminal and the audience terminal in the live broadcast room, for example, the interaction behaviors that the anchor terminal communicates with the audience terminal in the live broadcast room through a public screen chat area, the anchor terminal talks with the audience terminal in the live broadcast room through a live broadcast stream, or the anchor terminal answers the give virtual gifts of the audience terminal in the live broadcast room are the live broadcast interaction event.
The server monitors the live interactive events of the anchor terminal in the live broadcast room of the anchor terminal to count the live interactive data corresponding to the live interactive events, the live interactive data generally refers to the statistical data of effective interaction between the anchor terminal and the audience terminals in the live broadcast room, for example, the server monitors the public screen chat interactive events acted in the live broadcast room by the anchor terminal to obtain one or more chat texts output by the anchor terminal to the public screen chat area of the live broadcast room, and performs acoustic voice recognition on the audio stream in the live broadcast stream of the anchor terminal to obtain the text content corresponding to the voice information therein, and further checks whether phrases matched with the nicknames of the users exist in the chat texts and the text content by obtaining the nicknames of the users corresponding to the audience terminals in the live broadcast room, and takes the statistical check result as the number of the matched phrases, the result is that there is a matching phrase that characterizes the chat text or audio stream as a valid interaction, i.e. the resulting amount can be used as the live interaction data.
Another statistical method of the live broadcast interactive data is that the server responds to a virtual gift presenting event acting on the live broadcast room, obtains a nickname of a gift-sending user at a viewer end presenting the virtual gift corresponding to the event, and when the live broadcast room triggers a viewer entering event, the server will respond to the event to obtain the nickname of a new viewer user at the new viewer end entering the live broadcast room, so that the server performs acoustic voice recognition on an audio stream in a live broadcast stream of the main broadcast end to obtain text content corresponding to voice information therein, further checks whether the text content is matched with the nickname of the gift-sending user or the nickname of the new viewer user, if the text content is matched with the nickname, the live broadcast interactive data is characterized to be an effective live broadcast event, and if the text content is not swiped, the server updates the live broadcast interactive data corresponding to the main broadcast end so as to prevent the live broadcast interactive data from being judged to be fake by the platform as a hanging broadcast live broadcast room, for example, when the text content matches the nickname of the gift-sending user and the nickname of the new audience user, the interactive data used for representing effective gift-sending or effective new audience interaction in the live interactive data is correspondingly updated.
Step S12, identifying a live broadcast feature identifier corresponding to the live broadcast stream, determining a feature similarity between a video screenshot of the live broadcast stream and a recorded broadcast video stream to which the anchor terminal belongs, and obtaining a suspected recorded broadcast screenshot with a higher feature similarity:
the server receives the live broadcast stream pushed by the anchor terminal, and then identifies the live broadcast characteristic mark in real time or at real time so as to subsequently judge whether the live broadcast service carried out by the anchor terminal in the live broadcast room corresponds to the live broadcast partition preset by the anchor terminal, specifically, the server calls an image characteristic extraction model trained to be convergent to extract the video stream in the live broadcast stream, obtains the image characteristic vector corresponding to the video stream, calls a voice recognition model trained to be convergent to extract the audio stream in the live broadcast stream, obtains the text content corresponding to the audio stream, calls a text characteristic extraction model trained to be convergent to extract the text content, obtains the text characteristic vector of the text information, and then respectively carries out classification mapping on the image characteristic vector and the text characteristic vector after obtaining the image characteristic training, namely the text characteristic vector, and determining the live broadcast characteristic identification corresponding to the live broadcast stream.
The live broadcast feature identifier is used for representing content presented by audience users in live broadcast streams such as live broadcast content, live broadcast scenes or anchor attributes corresponding to the live broadcast streams, for example, when a video picture output in a video stream of the live broadcast stream is live broadcast and sold indoors by an anchor user and women of the anchor user are in the live broadcast feature identifier identified by the server, the live broadcast feature identifier includes a live broadcast cargo-carrying identifier, an indoor scene and a women's anchor identifier.
The server performs live broadcast feature identification on the live broadcast stream, and at the same time, performs recorded broadcast picture retrieval on the live broadcast stream to obtain a video screenshot in the live broadcast stream which is similar to a picture in a recorded broadcast video stream to which the anchor terminal belongs, specifically, the server respectively intercepts video screenshots of a plurality of video frames of the live broadcast stream, extracts image features of the video screenshots, obtains a recorded broadcast video library to which the anchor terminal belongs, determines a video screenshot with a higher similarity as the suspected recorded broadcast screenshot by calculating feature similarities between the image features of the video screenshots and one or more recorded screen video streams in the recorded broadcast video library respectively, so that the suspected recorded broadcast screenshot is pushed to an auditing terminal for manual auditing, and further judges whether the live broadcast room is a hanging broadcast room.
The recorded and broadcast video stream generally refers to the past live broadcast stream of the anchor terminal, and the server correspondingly stores the recorded and broadcast video stream into a recorded and broadcast video library to which the anchor terminal belongs, so that recorded and broadcast picture retrieval is performed on the live broadcast stream currently pushed by the anchor terminal, and meanwhile, the recorded and broadcast picture retrieval can be performed by a user in a platform.
Step S13, calling a preset on-hook broadcast live broadcast verification strategy, performing first verification according to the broadcast source information, the live broadcast feature identifier or the live broadcast interactive data, and if the verification result is an on-hook broadcast room, correspondingly modifying the live broadcast authority of the anchor end to control the output of the live broadcast stream:
and calling the preset hanging broadcast live broadcast verification processing by the server, so as to verify the hanging broadcast live broadcast room of the live broadcast room according to the starting source information, the live broadcast characteristic identification or the live broadcast interactive data of the live broadcast room, and judging whether the live broadcast room is the hanging broadcast live broadcast room or not.
The on-hook live broadcast room is a live broadcast room for performing low-quality live broadcast on a live broadcast platform, for example, the on-hook live broadcast room generally plays previous live broadcast videos in the live broadcast room, or broadcasts live broadcast contents which are irrelevant to a live broadcast partition where the on-hook live broadcast room is located in the live broadcast room, or only opens the live broadcast room without performing any live broadcast service, and the like, and the on-hook live broadcast room seriously affects the live broadcast service of the live broadcast platform and affects the live broadcast viewing experience of a platform user.
The first check refers to a first turbine machine check mode that the server checks whether the live broadcasting room of the anchor terminal has the on-air according to the on-air live broadcasting check strategy, wherein the on-air live broadcasting check strategy refers to a check strategy that is used for checking whether the live broadcasting room is the on-air live broadcasting room according to the on-air source information, the live broadcasting feature identification or the live broadcasting interactive data of the live broadcasting room, for example, the on-air live broadcasting check strategy has a check strategy for the on-air source information of the live broadcasting room, specifically, the server determines the on-air source information of the live broadcasting room, when the on-air source information includes the on-air source type of the camera, the server judges whether the camera is turned on, when the server determines that the off time of the camera exceeds the preset check time, the live broadcasting room is preliminarily judged as the on-air live broadcasting room, and simultaneously, according to the live broadcasting feature identification or the live broadcasting interactive data of the live broadcasting room in the on-air live broadcasting check strategy, and further checking whether the live broadcast room is a hanging live broadcast room.
In addition, the server calls the on-air live broadcast checking strategy to check the information of the on-air source of the main broadcast end, when the information of the on-air source is a video playing source, the server acquires a video stream corresponding to the video playing source, specifically, the video playing source generally refers to a video player, the video stream refers to a video text played in the video playing source, after acquiring the Supplemental Enhancement Information (SEI) of the video stream, the server analyzes the Supplemental Enhancement Information (SEI), checks whether the Supplemental Enhancement Information (SEI) contains the recording and playing characteristic identifier, the video stream with the recording and playing characteristic identifier generally refers to a characteristic identifier unique to the recorded and played video stream generated by a live broadcast recording tool of a live broadcast platform, and if the Supplemental Enhancement Information (SEI) of the video stream contains the recording and playing characteristic identifier, the video stream is indicated as the screen recording video stream, namely, the live broadcast room accords with the on-hook broadcast check strategy corresponding to the broadcast source information, and the live broadcast room is preliminarily determined as the on-hook broadcast room by the server.
Regarding a verification strategy aiming at the live broadcast feature identifier of a live broadcast room in the on-hook live broadcast verification strategy, a server firstly determines a preset live broadcast partition of the live broadcast room, acquires a live broadcast type corresponding to the live broadcast partition, judges whether the live broadcast type is matched with the live broadcast feature identifier according to a live broadcast feature identifier which is identified by a live broadcast stream corresponding to the main broadcast end at the latest, and when the live broadcast type is not matched with the live broadcast feature identifier, the live broadcast room is preliminarily determined as the on-hook live broadcast room; in addition, the server can also determine whether the voice identification represents that voice exists in the live broadcast stream according to the voice identification in the live broadcast characteristic identification, and if the voice identification does not exist, the live broadcast room is preliminarily determined as the on-hook live broadcast room.
Regarding the live broadcast interactive data verification strategy of the live broadcast room in the on-hook live broadcast verification strategy, generally, the live broadcast interactive data is judged whether to exceed a preset interactive numerical value, for example, the server analyzes the live broadcast interactive data of the live broadcast room, obtains effective gift sending interactive data, effective new audience interactive data, effective language communication interactive data and the like in the live broadcast interactive data, and when any one or more of the interactive data do not exceed the corresponding interactive numerical value, the live broadcast room is preliminarily determined to be the on-hook live broadcast room.
The server checks step by step whether the live broadcast room is the on-hook live broadcast room or not according to the on-hook live broadcast source information, the live broadcast characteristic identification and the live broadcast interaction data of the live broadcast room in the on-hook live broadcast check strategy check, and generally, when the server judges that the on-hook live broadcast source information, the live broadcast characteristic identification and the live broadcast interaction data of the live broadcast room all conform to the corresponding on-hook live broadcast check strategy, the live broadcast room is determined to be the on-hook live broadcast room, and further correspondingly modifying the live broadcast authority of the anchor end to control the output of the live broadcast stream of the live broadcast room, for example, the live broadcasting room is prohibited to be pushed to a recommended live broadcasting list of a live broadcasting platform, the recommended live broadcasting list comprises the live broadcasting room recommended by the live broadcasting platform to a platform user for browsing, and forbidding the anchor terminal of the live broadcast room to authorize the opening of the live broadcast room, and stopping the live broadcast service of the anchor terminal in the current platform.
When the server judges that the broadcast source information, the live broadcast characteristic identification and the live broadcast interactive data of the live broadcast room do not completely accord with the related on-hook broadcast live broadcast check strategy, the server outputs a check result for indicating the on-hook broadcast problem suspected to exist in the live broadcast room to the check end for second check according to the on-hook broadcast check strategy met by the live broadcast room, for example, when the server judges that the live broadcast room does not accord with the on-hook broadcast check strategy for checking whether the on-hook broadcast check strategy is an on-hook broadcast or not except that the broadcast source information of the live broadcast room accords with the on-hook broadcast check strategy for checking whether the on-hook broadcast check strategy is a recorded broadcast or not, the live broadcast room is determined as the on-hook broadcast room suspected to be recorded broadcast by the server, the server pushes the check result for indicating the on-hook broadcast problem suspected to exist in the live broadcast room to the check end, or, the server judges that the live broadcast feature identifier and the live broadcast interactive data of the live broadcast room are in accordance with the on-hook live broadcast check processing for checking whether the live broadcast feature identifier and the live broadcast interactive data are on-hook, and when the start broadcast source information of the live broadcast room is not in accordance with the on-hook live broadcast check processing for checking whether the live broadcast source information is recorded broadcast, the server pushes a check result representing the suspected on-hook existence of the live broadcast room into the auditing terminal, of course, technical personnel in the field can design the check purpose of each on-hook live broadcast check strategy and the required live broadcast room data according to the actual application scene, and redundancy is omitted; in addition, when the server pushes the verification result to the verification end, the broadcast source information, the live broadcast feature identifier, the live broadcast interactive data and the suspected recorded and broadcast screenshot which are simultaneously pushed to the live broadcast room are pushed to the verification end for second verification.
In addition, different check weights are preset in the on-hook live broadcast check strategy aiming at the opening source information, the live broadcast feature identifier and the live broadcast interactive data of the live broadcast room, for example, when the check weight of the opening source information is the highest, if the server judges that the opening source information of the live broadcast room conforms to the related on-hook live broadcast check strategy, the server does not judge whether the live broadcast feature identifier and the live broadcast interactive data of the live broadcast room meet the related on-hook live broadcast check strategy or not, and directly determines the live broadcast room as the on-hook live broadcast room; those skilled in the art can design the check weights flexibly, which will not be described in detail.
Step S14, if the verification result is a suspected on-hook live broadcast room, pushing the broadcast source information, the live broadcast feature identifier, the live broadcast interactive data, and the suspected recorded broadcast screenshot to an auditing end for a second verification, and further determining whether the live broadcast room is an on-hook live broadcast room according to the auditing result pushed by the auditing end:
and when the server determines that the live broadcast room is a suspected live broadcast room through the live broadcast verification strategy, pushing the start source information, the live broadcast characteristic identification, the live broadcast interactive data and the suspected recorded broadcast screenshot of the live broadcast room to the auditing terminal so that the auditing terminal can manually audit the live broadcast room.
The second check is a mode that an audit terminal carries out a second round of check according to the broadcast source information, the live feature identification, the live interactive data and the suspected recorded broadcast screenshot of the main broadcast terminal, the check mode generally aims at a live broadcast room judged to be suspected of hanging broadcast by the first round of check, wherein the audit terminal is an execution terminal for carrying out manual audit business, the audit terminal receives the broadcast source information, the live feature identification, the live interactive data and the suspected recorded broadcast screenshot of the live broadcast room pushed by a server, and then outputs and displays the information to an audit page of the hanging broadcast live broadcast room so that auditors at the audit terminal can carry out manual audit, specifically, the audit terminal receives the suspected hanging broadcast live broadcast room information pushed by the server, and sends the live broadcast room feature information, the broadcast source information and the suspected recorded broadcast screenshot contained in the suspected hanging broadcast room information, And outputting the live broadcast characteristic identifier and the live broadcast interactive data to a graphical user interface of a live broadcast room page for display, synchronously outputting a suspected recorded broadcast screenshot contained in the suspected live broadcast room information and a recorded broadcast video corresponding to the suspected recorded broadcast screenshot to the graphical user interface for display, responding to an audit event which is triggered by an auditor at the audit end and acts on a live broadcast room corresponding to the suspected live broadcast room information, and pushing an audit result corresponding to the audit event to a server.
Please refer to fig. 3, fig. 3 is a schematic diagram of a graphical user interface of the review page of the on-hook live broadcast room, in fig. 3, the broadcast source information, the live broadcast feature identifier and the live broadcast interaction data of the suspected on-hook live broadcast are output to the review page of the on-hook live broadcast room for display, and the suspected recorded broadcast screenshot is output to the suspected recorded broadcast screenshot window 301 in fig. 3 for display, so that the suspected recorded broadcast screenshot and the recorded broadcast video corresponding to the suspected recorded broadcast screenshot are synchronously output to the review page of the on-hook live broadcast room for display, and the review result window 302 shown in fig. 3 can be used for generating a review result edited by a reviewer and pushing the review result to a server, so that the server determines whether the suspected live broadcast on-hook live broadcast room is the on-hook broadcast room according to the review result.
In addition, the auditing terminal can also verify the suspected on-hook broadcast live broadcast room through a self suspected on-hook broadcast verification strategy so as to further verify whether the suspected on-hook broadcast live broadcast room is the on-hook broadcast live broadcast room or not on the basis of the verification of the first verification, for example, the auditing terminal judges the similarity data of the suspected recorded and broadcast screenshot and the recorded and broadcast video stream corresponding to the suspected recorded and broadcast screenshot through the verification, when the similarity data exceeds a preset threshold value, the threshold value is generally set within the range of 70% -90%, the suspected on-hook broadcast live broadcast room is determined to be the on-hook broadcast live broadcast room, and the auditing terminal pushes the auditing result to the server so that the server correspondingly modifies the live broadcast authority of the main broadcast end to which the on-hook broadcast room belongs.
After receiving the audit result pushed by the audit end, the server finally determines whether the suspected on-hook live broadcast room is an on-hook live broadcast room according to the audit result, if the audit result indicates that the suspected on-hook live broadcast room is the on-hook live broadcast room, the server correspondingly modifies the live broadcast authority of a main broadcast end to which the on-hook live broadcast room belongs so as to control the output of the live broadcast stream of the live broadcast room, for example, the live broadcast room is prohibited from being pushed into the server, the live broadcast room is prohibited from being pushed into a recommended live broadcast list of a live broadcast platform, the recommended live broadcast list comprises live broadcast rooms recommended by the live broadcast platform to a platform user for browsing, the main broadcast end of the live broadcast room is prohibited from authorizing to start the live broadcast room, and the main broadcast end stops the live broadcast service in the current platform.
According to the typical embodiment, the method provides the live broadcast platform with the function of the on-hook live broadcast room in the detection platform, judges whether the shown live broadcast room is the on-hook broadcast room or not according to the starting source information, the live broadcast interactive data and the live broadcast characteristic identification automatic on-hook broadcast check detection of the live broadcast room, and carries out on-hook broadcast check on the live broadcast room in a multi-dimensional manner; secondly, the method can automatically detect the on-hook broadcasting live broadcasting room in the platform, and also can intercept the suspected recorded and broadcast video screenshot in the live broadcasting stream, so that when the automatic verification on-hook broadcasting system cannot determine whether the suspected on-hook broadcasting live broadcasting room is the on-hook broadcasting live broadcasting room, the live broadcasting information of the suspected on-hook broadcasting live broadcasting room and the suspected recorded and broadcast video screenshot are pushed to a verification end for manual verification, and the accuracy of the overall on-hook broadcasting verification of the on-hook broadcasting verification system is improved.
The above exemplary embodiments and their variations disclose the embodiments of the present method for detecting quality of live broadcast sufficiently, but various variations of the method can be deduced by transforming and amplifying some technical means, and other embodiments are summarized as follows:
in an embodiment, referring to fig. 4 and fig. 5, the step of monitoring a live interactive event of the anchor terminal acting on the live broadcast room and counting live interactive data corresponding to the live interactive event includes the following steps executed by the server:
step S111, monitoring the interaction event of public screen chatting in the live broadcast room acted by the anchor terminal, and acquiring one or more chatting texts output by the anchor terminal to the public screen chatting area of the live broadcast room:
referring to fig. 4, fig. 4 is a schematic diagram of a graphical user interface of a live broadcast room page, where a server responds to the public screen chat interaction event of the anchor terminal to obtain the chat text pushed by the anchor terminal to the public screen chat area 401 in fig. 4.
The chat text is generally pushed to the server by the anchor terminal, so that the server acquires the chat text broadcast to be displayed in a live broadcast room where the anchor terminal is located, and meanwhile, the server also performs subsequent live broadcast interactive data statistics according to the chat text.
Step S112, performing acoustic speech recognition on the audio stream in the live stream of the anchor to obtain text content corresponding to the speech information:
the server obtains a live stream pushed by a main broadcasting end, analyzes the live stream to obtain the audio stream contained in the live stream, calls an acoustic voice recognition model trained to be convergent, performs voice preprocessing on the audio stream, extracts voice features through the acoustic model, and then adopts a language model to recognize the voice features to obtain corresponding text contents, so that the operation of converting voice into characters is realized.
Step S113, obtaining the nicknames of the users corresponding to the multiple audience terminals in the live broadcast room, and checking whether phrases matched with the nicknames of the users exist in the chat texts and the text contents:
the server obtains the user nicknames corresponding to a plurality of audience terminals in the live broadcast room where the anchor terminal is located, and judges whether phrases matched with the user nicknames exist in the chat text and the text content, for example, when the user nicknames exist as small and clear user nicknames, the server checks whether phrases of 'small and clear' exist in the chat text and the text content.
Step S114, counting the number of results with matching phrases as the verification result, where the live broadcast interactive data includes the number of results:
and the server counts the number of the verification results of the phrases matched with the nicknames of the users in the chat texts or the text contents so as to correspondingly update the live broadcast interactive data belonging to the anchor terminal.
In this embodiment, whether the nickname of the audience user in the live broadcast room exists in the chat text and the audio stream pushed by the anchor terminal is checked, and whether the anchor user interacts with the audience in the current live broadcast room is further determined, so as to count the effective interaction times.
In an embodiment, referring to fig. 4 and fig. 6, the step of monitoring a live interactive event of the anchor terminal acting on the live broadcast room and counting live interactive data corresponding to the live interactive event includes the following steps executed by the server:
step S111', in response to the virtual gift-presenting event acting on the live broadcast room, obtaining a nickname of a gift-presenting user at the audience end presenting the virtual gift corresponding to the event:
and the server responds to the virtual gift presenting event in the live broadcast room of the main broadcast end, determines the audience end presenting the virtual gift in the virtual gift presenting event, and acquires the nickname of the gift-presenting user corresponding to the audience end.
The virtual gift giving event number refers to an event that a viewer end in a live broadcast room gives a corresponding virtual gift to a main broadcast end.
Step S112', in response to the viewer entering event acting on the live broadcast room, acquiring a new viewer user nickname of a new viewer end entering the live broadcast room:
and the server responds to the audience entering event in the live broadcast room where the main broadcast end is positioned, and determines a new audience end corresponding to the audience entering event so as to obtain a new audience user nickname corresponding to the new audience end.
Referring to fig. 4, fig. 4 is a schematic diagram of a graphical user interface of a live room page, and a new viewer entry notification window 401 in fig. 4 is a visualization manner of the viewer entry event in the live room.
Step S113', performing acoustic speech recognition on the audio stream in the live stream of the anchor to obtain a text content corresponding to the speech information:
the server obtains a live stream pushed by a main broadcasting end, analyzes the live stream to obtain the audio stream contained in the live stream, calls an acoustic voice recognition model trained to be convergent, performs voice preprocessing on the audio stream, extracts voice features through the acoustic model, and then adopts a language model to recognize the voice features to obtain corresponding text contents, so that the operation of converting voice into characters is realized.
Step S114', checking whether the text content matches the nickname of the gift sending user or the nickname of the new audience user, if yes, updating the live interactive data corresponding to the anchor terminal correspondingly:
the server checks whether the text content is matched with the nickname of the gift sending user or the nickname of the new audience user, specifically, the server judges whether the text content is matched with the nickname of the gift sending user or the nickname of the new audience user by inquiring whether phrases corresponding to the nickname of the gift sending user and the nickname of the new audience user exist in the text content, and if the text content is matched with the nickname of the gift sending user or the nickname of the new audience user, the gift sending interaction times and the new audience interaction times in the live broadcast interaction data are correspondingly updated.
In this embodiment, whether the current anchor in the live broadcast room effectively interacts with the gift-presenting audience or the new audience through the language is determined by responding to the virtual gift-presenting event and the new audience entry event, and then live broadcast interaction data corresponding to the events are counted.
In an embodiment, referring to fig. 7, the step of identifying a live feature identifier corresponding to the live stream includes the following steps performed by the server:
step S121, calling an image feature extraction model trained to convergence to extract a video stream in the live stream, and acquiring an image feature vector corresponding to the video stream:
after receiving the live stream pushed by the anchor end, the server analyzes and obtains the video stream contained in the live stream, so as to extract the features of the live stream by adopting an image feature extraction model, such as Resnet, which is pre-trained to a convergence state, obtain an image feature vector representing deep semantic information of the live stream, and normalize the image feature vector into a high-dimensional vector.
Step S122, calling a speech recognition model trained to be convergent to extract an audio stream in the live stream, and acquiring text content corresponding to the audio stream:
the server obtains a live stream pushed by a main broadcasting end, analyzes the live stream to obtain the audio stream contained in the live stream, calls a speech recognition model trained to be convergent, performs speech preprocessing on the audio stream, extracts speech features, and then adopts a language model to recognize the speech features to obtain corresponding text contents, so that the operation of converting speech into characters is realized.
Step S123, calling a text feature extraction model trained to be convergent to extract the text content, and acquiring a text feature vector of the text information:
and (3) extracting the features of the text content by adopting a text feature extraction model which is pre-trained to a convergence state, such as Bert, LSTM and the like, obtaining a text feature vector representing deep semantic information of the text content, and normalizing the text feature vector into a high-dimensional vector.
Step S124, performing classification mapping on the image feature vectors and the text feature vectors, and determining a corresponding live broadcast feature identifier of the live broadcast stream:
after the server obtains the image feature vector and the text feature vector, a classifier is adopted to respectively map the image feature vector and the text feature vector to a classification space after being fully connected, so that classification probabilities of the image feature vector and the text feature vector corresponding to a plurality of live broadcast feature types are obtained, wherein a classification model with the maximum classification probability is the live broadcast feature identification contained in the live broadcast content of the live broadcast stream.
In this embodiment, the feature information of the video stream and the audio stream of the live stream is extracted respectively, and live feature classification is performed on the live stream according to the feature information, so as to determine a live feature identifier corresponding to the live stream.
In an embodiment, referring to fig. 8, the step of invoking a preset on-air live broadcast verification policy and performing a first verification according to the broadcast source information, the live broadcast feature identifier, or the live broadcast interactive data includes the following steps executed by the server:
step S131, when the broadcast source information includes a broadcast source type of a video broadcast source, acquiring supplemental enhancement information of a video stream corresponding to the video broadcast source:
the server calls the on-hook broadcast verification strategy to verify the broadcast source information of the anchor terminal, and when the broadcast source information is a video broadcast source, the server acquires a video stream corresponding to the video broadcast source, specifically, the video broadcast source generally refers to a video player, and the video stream refers to a video text played in the video broadcast.
After acquiring the video stream played by the video playing source, the server acquires the supplemental enhancement information of the video stream, where the supplemental enhancement information is an identification code used for characterizing the video stream, and different video streams have different identification codes, such as an ID of the video stream used for distinguishing different video streams.
Step S132, analyzing the supplementary enhancement information, and checking whether the supplementary enhancement information contains a recorded broadcast characteristic identifier:
and after acquiring the supplementary enhancement information of the video stream, the server analyzes the supplementary enhancement information and verifies whether the supplementary enhancement information contains the recording and playing characteristic identification.
The video stream with the recorded and broadcast feature identifier is generally a unique feature identifier of the recorded and broadcast video stream generated by a live broadcast recording tool of a live broadcast platform, and if the supplementary enhancement information of the video stream contains the recorded and broadcast feature identifier, the video stream is indicated as the screen recording video stream.
Step S133, when the supplemental enhancement information includes the recorded broadcast feature identifier, the video stream is characterized as a recorded broadcast video stream, and the live broadcast room in which the anchor broadcast segment is located is determined as a live broadcast on-air room:
when the server verifies that the supplementary enhancement information of the video stream contains the recorded broadcast characteristic identification, the video stream is represented as a recorded broadcast video stream, namely the live broadcast room conforms to a hanging broadcast live broadcast verification strategy corresponding to the broadcast source information, and the live broadcast room is preliminarily determined as the hanging broadcast live broadcast room by the server.
In this embodiment, when the live stream in the live broadcast room is a video played by the anchor user through the video player, whether the video stream is a screen recording video is determined by determining the supplemental enhancement information of the video, so as to determine whether the live broadcast room is a live on-hook broadcast room.
In an embodiment, referring to fig. 9, the step of calling a preset on-hook live broadcast verification policy and performing a first verification according to the broadcast source information, the live broadcast feature identifier, or the live broadcast interactive data includes the following steps executed by the server:
step S131', determining a preset live partition of the live broadcasting room where the anchor terminal is located, and acquiring a live type corresponding to the live broadcasting partition:
the server determines a preset live broadcast partition of the live broadcast room to acquire a live broadcast type corresponding to the live broadcast room, for example, a live broadcast type corresponding to a live broadcast room in which the live broadcast partition is a singing partition is generally a lyric type.
Step S132', according to the live broadcast feature identifier identified for the live broadcast stream corresponding to the anchor terminal, determine whether the live broadcast type matches the live broadcast feature identifier:
and the server determines the live broadcast type represented by the live broadcast characteristic identification according to the live broadcast characteristic identification identified by the live broadcast stream of the anchor terminal, and judges whether the live broadcast type represented by the live broadcast characteristic identification is the live broadcast type of the live broadcast room.
Step S133', when the live type does not match the live feature identifier, the live room is determined as the on-hook live room:
and when the server determines that the live broadcast type of the live broadcast room is not matched with the corresponding live broadcast characteristic identification, the live broadcast room is preliminarily determined as the on-hook live broadcast room by the server.
In this embodiment, whether the live broadcast room is a live broadcast room is determined by determining whether the live broadcast content of the live broadcast room conforms to the corresponding live broadcast partition.
In an embodiment, referring to fig. 3 and fig. 10, if the verification result is a suspected on-hook live broadcast room, the step of pushing the broadcast source information, the live broadcast feature identifier, the live broadcast interactive data, and the suspected recorded broadcast screenshot to an auditing end for a second verification includes the following steps executed by the auditing end:
step S141, receiving suspected on-hook live broadcast room information pushed by the server, and outputting live broadcast room characteristic information, broadcast source information, live broadcast characteristic identification and live broadcast interactive data contained in the suspected on-hook live broadcast room information to a graphical user interface for displaying:
and the auditing end receives the suspected on-hook live broadcast room information pushed by the server, wherein the suspected on-hook live broadcast room information comprises the live broadcast room characteristic information, the broadcast source information, the live broadcast characteristic identification and the live broadcast interactive data of a suspected live broadcast room, and the live broadcast room characteristic information comprises a live broadcast room ID of the suspected live broadcast room, a live broadcast room partition, the number of audience of the live broadcast room, the name of an anchor and equipment for the anchor to carry out live broadcast business and the like.
Referring to fig. 3, after the auditing terminal parses and acquires the live broadcast room characteristic information, the broadcast source information, the live broadcast characteristic identifier and the live broadcast interactive data included in the suspected live broadcast room information, the information is output to the live broadcast room auditing interface shown in fig. 3 for display.
Step S142, synchronously outputting the suspected recorded and broadcasted screenshot contained in the suspected on-hook live broadcasting room information and the recorded and broadcasted video corresponding to the suspected recorded and broadcasted screenshot to a graphical user interface for displaying:
referring to fig. 3, fig. 3 is a schematic diagram of a graphical user interface of an audit page of the on-hook live broadcast room, where the audit end outputs the suspected recorded and broadcast screenshot to the suspected recorded and broadcast screenshot window 301 in fig. 3 for display, so that the suspected recorded and broadcast screenshot and the recorded and broadcast video corresponding to the suspected recorded and broadcast screenshot are synchronously output to the audit page of the on-hook live broadcast room for display
Step S143, responding to an audit event acting on the live broadcast room corresponding to the suspected on-hook live broadcast room information, and pushing an audit result corresponding to the audit event to a server:
referring to fig. 3, the audit result window 302 shown in fig. 3 may be used to generate the audit result edited by the auditor, after the auditor finishes editing the audit result through the audit result window 302, the audit end will respond to the audit event and push the audit result edited by the auditor in the audit result window 302 to the server, so that the server determines whether the suspected on-hook live broadcast room is the on-hook live broadcast room according to the audit result.
In the embodiment, the method and the device have the advantages that the manual auditing end is used for further auditing, whether the suspected live hanging broadcast room is the live hanging broadcast room or not is audited, and the accuracy of auditing the live hanging broadcast room is improved.
Further, a live broadcast quality detection processing apparatus of the present application can be constructed by functionalizing the steps in the methods disclosed in the above embodiments, and according to this idea, please refer to fig. 11, wherein in an exemplary embodiment, the apparatus includes: the live broadcast starting response module 11 is configured to respond to a live broadcast room starting event of an anchor end, acquire starting source information of a live broadcast stream acted by the anchor end, monitor a live broadcast interaction event acted by the anchor end on the live broadcast room, and count live broadcast interaction data corresponding to the live broadcast interaction event; a live stream identification module 12, configured to identify a live feature identifier corresponding to the live stream, determine a feature similarity between a video screenshot of the live stream and a recorded and broadcast video stream to which the anchor terminal belongs, and obtain a suspected recorded and broadcast screenshot with a higher feature similarity; a live hanging broadcast room checking module 13, configured to invoke a preset live hanging broadcast checking policy, perform a first check according to the broadcast source information, the live broadcast feature identifier, or the live broadcast interactive data, and if a check result is a live hanging broadcast room, modify the live broadcast permission of the anchor terminal correspondingly to control the output of the live broadcast stream; and the auditing result processing module 14 is configured to, if the verifying result is that the live broadcast room is a suspected on-hook live broadcast room, push the broadcast source information, the live broadcast feature identifier, the live broadcast interactive data, and the suspected recorded and broadcast screenshot to an auditing end for second verification, and further determine whether the live broadcast room is the on-hook live broadcast room according to an auditing result pushed by the auditing end.
In one embodiment, the live start response module 11 includes: the chat text acquisition submodule is used for monitoring a public screen chat interaction event acted by the anchor terminal in a live broadcast room and acquiring one or more chat texts output by the anchor terminal to a public screen chat area of the live broadcast room; the text content acquisition submodule is used for carrying out acoustic voice recognition on an audio stream in the live stream of the anchor end to obtain text content corresponding to voice information in the audio stream; the user nickname matching sub-module is used for acquiring the nicknames of the users corresponding to a plurality of audience terminals in the live broadcast room and checking whether phrases matched with the nicknames of the users exist in the chat texts and the text contents; and the result quantity counting submodule is used for counting the result quantity of the verification result which is the result quantity with the matched phrase, and the live broadcast interactive data comprises the result quantity.
In one embodiment, the live stream identification module 12 includes: the gift-giving response sub-module is used for responding to the virtual gift-giving event acting on the live broadcast room and acquiring the nickname of the gift-giving user of the audience end of the virtual gift corresponding to the event; the audience entering response submodule is used for responding to an audience entering event acting on the live broadcast room and acquiring a new audience user nickname of a new audience end entering the live broadcast room; the text content acquisition submodule is used for carrying out acoustic voice recognition on an audio stream in the live stream of the anchor end to obtain text content corresponding to voice information in the audio stream; and the user nickname matching sub-module is used for verifying whether the text content is matched with the nickname of the gift sending user or the nickname of the new audience user, and if so, the live broadcast interactive data corresponding to the anchor terminal is correspondingly updated.
In another embodiment, the live stream identification module 12 further includes: the live stream feature extraction submodule is used for calling an image feature extraction model trained to be convergent to extract a video stream in the live stream and acquiring an image feature vector corresponding to the video stream; the text content acquisition sub-module is used for calling a speech recognition model trained to be convergent to extract an audio stream in the live stream and acquiring text content corresponding to the audio stream; the text feature acquisition submodule is used for calling a text feature extraction model trained to be convergent to extract the text content and acquiring a text feature vector of the text information; and the live broadcast feature identification determining submodule is used for respectively carrying out classification mapping on the image feature vector and the text feature vector and determining the corresponding live broadcast feature identification of the live broadcast stream.
In one embodiment, the on-hook live room check module 13 includes: the supplemental enhancement information acquisition sub-module is used for acquiring the supplemental enhancement information of the video stream corresponding to the video playing source when the playing source information contains the type of the playing source of the video playing source; the supplementary enhancement information analysis submodule is used for analyzing the supplementary enhancement information and verifying whether the supplementary enhancement information contains a recording and broadcasting characteristic mark or not; and the live broadcast hanging room determining submodule is used for representing that the video stream is a recorded broadcast video stream when the supplementary enhancement information contains the recorded broadcast characteristic identification, and determining the live broadcast room where the main broadcast section is positioned as the live broadcast hanging room.
In another embodiment, the on-hook live broadcast room checking module 13 further includes: the live broadcast type acquisition submodule is used for determining a preset live broadcast partition of a live broadcast room where the anchor terminal is located and acquiring a live broadcast type corresponding to the live broadcast partition; the type feature matching sub-module is used for judging whether the live broadcast type is matched with the live broadcast feature identifier or not according to the live broadcast feature identifier identified by the live broadcast stream corresponding to the anchor terminal; and a live hanging room determining submodule, wherein when the live type is not matched with the live characteristic identification, the live broadcasting room is determined as the live hanging room.
In one embodiment, the audit result processing module 14 includes: the information output display sub-module is used for receiving suspected on-hook live broadcast room information pushed by the server and outputting live broadcast room characteristic information, broadcast source information, live broadcast characteristic identification and live broadcast interaction data contained in the suspected on-hook live broadcast room information to a graphical user interface for display; the information synchronous display sub-module is used for synchronously outputting the suspected recorded and broadcast screenshot contained in the suspected on-hook broadcast live broadcasting room information and the recorded and broadcast video corresponding to the suspected recorded and broadcast screenshot to a graphical user interface for display; and the auditing result pushing submodule is used for responding to an auditing event acting on the live broadcast room corresponding to the suspected on-hook broadcast live broadcast room information and pushing the auditing result corresponding to the auditing event to the server.
In order to solve the above technical problem, an embodiment of the present application further provides a computer device, configured to run a computer program implemented according to the live broadcast quality detection processing method. Referring to fig. 12, fig. 12 is a block diagram of a basic structure of a computer device according to the present embodiment.
As shown in fig. 12, the internal structure of the computer device is schematically illustrated. The computer device includes a processor, a non-volatile storage medium, a memory, and a network interface connected by a system bus. The non-volatile storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store control information sequences, and the computer readable instructions, when executed by the processor, can enable the processor to realize a live broadcast quality detection processing method. The processor of the computer device is used for providing calculation and control capability and supporting the operation of the whole computer device. The memory of the computer device may have stored therein computer readable instructions that, when executed by the processor, may cause the processor to perform a live quality detection processing method. The network interface of the computer device is used for connecting and communicating with the terminal. Those skilled in the art will appreciate that the architecture shown in fig. 12 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In this embodiment, the processor is configured to execute specific functions of each module/sub-module in the live broadcast quality detection processing apparatus of the present invention, and the memory stores program codes and various types of data required for executing the modules. The network interface is used for data transmission to and from a user terminal or a server. The memory in this embodiment stores program codes and data required for executing all modules/submodules in the live broadcast quality detection processing device, and the server can call the program codes and data of the server to execute the functions of all the submodules.
The present application further provides a non-volatile storage medium, where the live broadcast quality detection processing method is written as a computer program and stored in the storage medium in the form of computer readable instructions, where the computer readable instructions, when executed by one or more processors, mean the execution of the program in a computer, thereby causing the one or more processors to execute the steps of the live broadcast quality detection processing method according to any one of the above embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random Access Memory (RAM).
In conclusion, the method and the device for detecting the live broadcast of the live broadcast room provide the live broadcast platform with the function of the live broadcast room of the anchor broadcast existing in the detection platform, conduct live broadcast verification on the live broadcast room in a multidimensional manner, and compared with the limitation of a single live broadcast data verification mode in the traditional manner, the method and the device for detecting the live broadcast data of the live broadcast room effectively improve the verification accuracy of the live broadcast room of the anchor broadcast room, prevent the situation of misjudgment, prevent the live broadcast room of normal live broadcast in the error block platform, and influence the live broadcast service of the anchor user in the normal live broadcast room and the live broadcast watching experience of audience users.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of execution is not necessarily sequential, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
Those of skill in the art will appreciate that the various operations, methods, steps in the processes, acts, or solutions discussed in this application can be interchanged, modified, combined, or eliminated. Further, other steps, measures, or schemes in various operations, methods, or flows that have been discussed in this application can be alternated, altered, rearranged, broken down, combined, or deleted. Further, steps, measures, schemes in the prior art having various operations, methods, procedures disclosed in the present application may also be alternated, modified, rearranged, decomposed, combined, or deleted.
The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.
Claims (10)
1. A live broadcast quality detection processing method is characterized by comprising the following steps:
responding to a live broadcast room opening event of an anchor end, acquiring the opening source information of a live broadcast stream acted by the anchor end, monitoring the live broadcast interaction event acted by the anchor end on the live broadcast room, and counting live broadcast interaction data corresponding to the live broadcast interaction event;
identifying a live broadcast characteristic identifier corresponding to the live broadcast stream, determining the characteristic similarity between a video screenshot of the live broadcast stream and a recorded and broadcast video stream to which the anchor terminal belongs, and acquiring a suspected recorded and broadcast screenshot with higher characteristic similarity;
calling a preset on-hook broadcast live broadcast verification strategy, performing first verification according to the broadcast source information, the live broadcast characteristic identification or the live broadcast interactive data, and if the verification result is an on-hook broadcast live broadcast room, correspondingly modifying the live broadcast authority of the anchor end to control the output of the live broadcast stream;
and if the verification result is that the live broadcasting room is the suspected on-hook live broadcasting room, pushing the broadcast source information, the live broadcasting characteristic identification, the live broadcasting interactive data and the suspected recorded and broadcast screenshot to an auditing end to perform second verification, and further determining whether the live broadcasting room is the on-hook live broadcasting room or not according to the auditing result pushed by the auditing end.
2. The method according to claim 1, wherein the step of monitoring the live interactive event of the anchor terminal acting on the live broadcast room and counting the live interactive data corresponding to the live interactive event includes the following steps executed by the server:
monitoring a public screen chat interaction event acted on a live broadcast room by the anchor terminal, and acquiring one or more chat texts output to a public screen chat area of the live broadcast room by the anchor terminal;
performing acoustic voice recognition on an audio stream in a live stream of the anchor terminal to obtain text content corresponding to voice information in the audio stream;
obtaining user nicknames corresponding to a plurality of audience terminals in the live broadcast room, and checking whether phrases matched with the user nicknames exist in the chat texts and the text contents or not;
and counting the number of the results of the verification result, wherein the number of the results is the number of the results of the matched phrases, and the live broadcast interactive data comprises the number of the results.
3. The method according to claim 1, wherein the step of monitoring the live interactive event of the anchor terminal acting on the live broadcast room and counting the live interactive data corresponding to the live interactive event includes the following steps executed by the server:
responding to a virtual gift presenting event acting on the live broadcast room, and acquiring a nickname of a gift sending user of a spectator end presenting a virtual gift corresponding to the event;
responding to a spectator entrance event acting on the live broadcast room, and acquiring a nickname of a new spectator user entering a new spectator end of the live broadcast room;
performing acoustic voice recognition on an audio stream in a live stream of the anchor terminal to obtain text content corresponding to voice information in the audio stream;
and checking whether the text content is matched with the nickname of the gift sending user or the nickname of the new audience user, and if so, correspondingly updating the live broadcast interactive data corresponding to the main broadcast terminal.
4. The method according to claim 1, wherein the step of identifying the live feature identifier corresponding to the live stream includes the following steps executed by a server:
calling an image feature extraction model trained to be convergent to extract a video stream in the live stream, and acquiring an image feature vector corresponding to the video stream;
calling a speech recognition model trained to be convergent to extract an audio stream in the live stream, and acquiring text content corresponding to the audio stream;
calling a text feature extraction model trained to be convergent to extract the text content, and acquiring a text feature vector of the text information;
and respectively carrying out classification mapping on the image characteristic vector and the text characteristic vector, and determining the corresponding live broadcast characteristic identification of the live broadcast stream.
5. The method according to claim 1, wherein the step of calling a preset on-hook live broadcast verification policy and performing the first verification according to the broadcast source information, the live broadcast feature identifier or the live broadcast interactive data comprises the following steps executed by the server:
when the broadcast source information contains a broadcast source type of a video broadcast source, acquiring supplementary enhancement information of a video stream corresponding to the video broadcast source;
analyzing the supplementary enhancement information and checking whether the supplementary enhancement information contains a recorded broadcast characteristic identifier;
and when the supplementary enhancement information contains the recorded broadcast characteristic identification, the video stream is represented as a recorded broadcast video stream, and the live broadcast room where the main broadcast section is located is determined as a hanging broadcast live broadcast room.
6. The method according to claim 1, wherein the step of calling a preset on-hook live broadcast verification policy and performing the first verification according to the broadcast source information, the live broadcast feature identifier or the live broadcast interactive data comprises the following steps executed by the server:
determining a preset live broadcast partition of a live broadcast room where the anchor terminal is located, and acquiring a live broadcast type corresponding to the live broadcast partition;
judging whether the live broadcast type is matched with the live broadcast characteristic identification or not according to the live broadcast characteristic identification which is identified by the live broadcast stream corresponding to the anchor terminal at the latest time;
when the live type does not match with the live feature identification, the live room is determined as the hanging live room.
7. The method according to claim 1, wherein the step of pushing the broadcast source information, the live feature identifier, the live interactive data, and the suspected recorded broadcast screenshot to an auditing end for a second verification if the verification result is a suspected live on-hook room comprises the following steps executed by the auditing end:
receiving suspected on-hook live broadcasting room information pushed by a server, and outputting live broadcasting room characteristic information, broadcast source information, live broadcasting characteristic identification and live broadcasting interactive data contained in the suspected on-hook live broadcasting room information to a graphical user interface for displaying;
synchronously outputting the suspected recorded and broadcast screenshot contained in the suspected on-hook broadcast live room information and the recorded and broadcast video corresponding to the suspected recorded and broadcast screenshot to a graphical user interface for display;
and responding to an audit event acting on the live broadcast room corresponding to the suspected on-hook live broadcast room information, and pushing an audit result corresponding to the audit event to a server.
8. A live broadcast quality detection processing apparatus, comprising:
the live broadcast starting response module is used for responding to a live broadcast room starting event of an anchor end, acquiring the starting source information of a live broadcast stream acted by the anchor end, monitoring the live broadcast interaction event acted by the anchor end on the live broadcast room, and counting live broadcast interaction data corresponding to the live broadcast interaction event;
the live stream identification module is used for identifying a live stream characteristic identifier corresponding to the live stream, determining the characteristic similarity between a video screenshot of the live stream and a recorded and broadcast video stream to which the anchor terminal belongs, and acquiring a suspected recorded and broadcast screenshot with higher characteristic similarity;
the hanging broadcast live broadcast room checking module is used for calling a preset hanging broadcast live broadcast checking strategy, carrying out first checking according to the broadcasting source information, the live broadcast characteristic identification or the live broadcast interactive data, and correspondingly modifying the live broadcast authority of the main broadcast end to control the output of the live broadcast stream if the checking result is the hanging broadcast live broadcast room;
and the auditing result processing module is used for pushing the broadcast source information, the live broadcast characteristic identifier, the live broadcast interactive data and the suspected recorded broadcast screenshot to an auditing end for second auditing if the verifying result is that the live broadcast room is a suspected live broadcast room, and further determining whether the live broadcast room is the live broadcast room or not according to the auditing result pushed by the auditing end.
9. An electronic device comprising a central processor and a memory, characterized in that the central processor is configured to invoke execution of a computer program stored in the memory to perform the steps of the method according to any one of claims 1 to 7.
10. A non-volatile storage medium, characterized in that it stores, in the form of computer-readable instructions, a computer program implemented according to the method of any one of claims 1 to 7, which, when invoked by a computer, performs the steps comprised by the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210102482.6A CN114466210B (en) | 2022-01-27 | 2022-01-27 | Live broadcast quality detection processing method and device, equipment and medium thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210102482.6A CN114466210B (en) | 2022-01-27 | 2022-01-27 | Live broadcast quality detection processing method and device, equipment and medium thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114466210A true CN114466210A (en) | 2022-05-10 |
| CN114466210B CN114466210B (en) | 2024-04-16 |
Family
ID=81411371
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210102482.6A Active CN114466210B (en) | 2022-01-27 | 2022-01-27 | Live broadcast quality detection processing method and device, equipment and medium thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114466210B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114979700A (en) * | 2022-08-01 | 2022-08-30 | 广州市千钧网络科技有限公司 | Live broadcast wheat connection quality detection method and device |
| CN115134617A (en) * | 2022-06-16 | 2022-09-30 | 招商银行股份有限公司 | Live broadcast quality inspection system, method, Web server and storage medium |
| WO2024045064A1 (en) * | 2022-08-31 | 2024-03-07 | 京东方科技集团股份有限公司 | Playing content monitoring method, main unit, system, apparatus, medium and device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106210757A (en) * | 2016-07-28 | 2016-12-07 | 北京小米移动软件有限公司 | Live broadcasting method, live broadcast device and live broadcast system |
| WO2018113140A1 (en) * | 2016-12-22 | 2018-06-28 | 武汉斗鱼网络科技有限公司 | Method and system for displaying virtual gift during live video broadcast |
| WO2018161933A1 (en) * | 2017-03-09 | 2018-09-13 | 贵州白山云科技有限公司 | Live broadcast stream transmission method, apparatus and system, and computer readable storage medium, and computer device |
| CN110868609A (en) * | 2019-12-02 | 2020-03-06 | 杭州当虹科技股份有限公司 | Method for monitoring and standardizing live video |
| CN111182314A (en) * | 2018-11-12 | 2020-05-19 | 阿里巴巴集团控股有限公司 | Live stream processing method and device and data processing method |
| CN111698529A (en) * | 2020-06-19 | 2020-09-22 | 广州繁星互娱信息科技有限公司 | Live broadcast monitoring method, device, equipment and computer readable storage medium |
| CN111954077A (en) * | 2020-08-24 | 2020-11-17 | 上海连尚网络科技有限公司 | Video stream processing method and device for live broadcast |
| CN113573092A (en) * | 2021-07-30 | 2021-10-29 | 北京达佳互联信息技术有限公司 | Live broadcast data processing method and device, electronic equipment and storage medium |
-
2022
- 2022-01-27 CN CN202210102482.6A patent/CN114466210B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106210757A (en) * | 2016-07-28 | 2016-12-07 | 北京小米移动软件有限公司 | Live broadcasting method, live broadcast device and live broadcast system |
| WO2018113140A1 (en) * | 2016-12-22 | 2018-06-28 | 武汉斗鱼网络科技有限公司 | Method and system for displaying virtual gift during live video broadcast |
| WO2018161933A1 (en) * | 2017-03-09 | 2018-09-13 | 贵州白山云科技有限公司 | Live broadcast stream transmission method, apparatus and system, and computer readable storage medium, and computer device |
| CN111182314A (en) * | 2018-11-12 | 2020-05-19 | 阿里巴巴集团控股有限公司 | Live stream processing method and device and data processing method |
| CN110868609A (en) * | 2019-12-02 | 2020-03-06 | 杭州当虹科技股份有限公司 | Method for monitoring and standardizing live video |
| CN111698529A (en) * | 2020-06-19 | 2020-09-22 | 广州繁星互娱信息科技有限公司 | Live broadcast monitoring method, device, equipment and computer readable storage medium |
| CN111954077A (en) * | 2020-08-24 | 2020-11-17 | 上海连尚网络科技有限公司 | Video stream processing method and device for live broadcast |
| CN113573092A (en) * | 2021-07-30 | 2021-10-29 | 北京达佳互联信息技术有限公司 | Live broadcast data processing method and device, electronic equipment and storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115134617A (en) * | 2022-06-16 | 2022-09-30 | 招商银行股份有限公司 | Live broadcast quality inspection system, method, Web server and storage medium |
| CN115134617B (en) * | 2022-06-16 | 2024-04-26 | 招商银行股份有限公司 | Live broadcast quality inspection system, live broadcast quality inspection method, web server and storage medium |
| CN114979700A (en) * | 2022-08-01 | 2022-08-30 | 广州市千钧网络科技有限公司 | Live broadcast wheat connection quality detection method and device |
| WO2024045064A1 (en) * | 2022-08-31 | 2024-03-07 | 京东方科技集团股份有限公司 | Playing content monitoring method, main unit, system, apparatus, medium and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114466210B (en) | 2024-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114466210B (en) | Live broadcast quality detection processing method and device, equipment and medium thereof | |
| CN110557659B (en) | Video recommendation method and device, server and storage medium | |
| CA2771379C (en) | Estimating and displaying social interest in time-based media | |
| US10652592B2 (en) | Named entity disambiguation for providing TV content enrichment | |
| CN111754267B (en) | Data processing method and system based on block chain | |
| CN109640112B (en) | Video processing method, device, equipment and storage medium | |
| CN114465737B (en) | Data processing method and device, computer equipment and storage medium | |
| CN111372141B (en) | Expression image generation method and device and electronic equipment | |
| CN109933688A (en) | Determine the method, apparatus, equipment and computer storage medium of video labeling information | |
| CN112153397B (en) | Video processing method, device, server and storage medium | |
| CN114245205A (en) | Video data processing method and system based on digital asset management | |
| CN113766299A (en) | Video data playing method, device, equipment and medium | |
| CN113438492B (en) | Method, system, computer device and storage medium for generating title in live broadcast | |
| CN111597361B (en) | Multimedia data processing method, device, storage medium and equipment | |
| CN114302161A (en) | Video stream auditing control method and device, equipment and medium thereof | |
| CN113794624B (en) | Instant message transmission control method and device, computer equipment and storage medium | |
| CN113468373B (en) | Information acquisition method and device, electronic equipment and storage medium | |
| CN112434677B (en) | Contract auditing method, device, equipment and storage medium | |
| US10536729B2 (en) | Methods, systems, and media for transforming fingerprints to detect unauthorized media content items | |
| CN117939258A (en) | Live broadcast on-demand monitoring method and device, equipment and medium thereof | |
| CN117750056A (en) | Recording and playing detection method and device, electronic equipment and storage medium | |
| CN116033202A (en) | Live broadcast popup window control method and device, equipment and medium thereof | |
| CN116229439A (en) | Barrage identification method, device, apparatus, storage medium and program product | |
| CN115914690A (en) | Data processing method, device, server and storage medium | |
| CN116017039A (en) | Live broadcast background dynamic adjustment system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |