CN110784727B - Reporting method and device for live broadcast - Google Patents

Reporting method and device for live broadcast Download PDF

Info

Publication number
CN110784727B
CN110784727B CN201910782515.4A CN201910782515A CN110784727B CN 110784727 B CN110784727 B CN 110784727B CN 201910782515 A CN201910782515 A CN 201910782515A CN 110784727 B CN110784727 B CN 110784727B
Authority
CN
China
Prior art keywords
reporting
video stream
live broadcast
gesture
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910782515.4A
Other languages
Chinese (zh)
Other versions
CN110784727A (en
Inventor
黄灵
曹超利
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201910782515.4A priority Critical patent/CN110784727B/en
Publication of CN110784727A publication Critical patent/CN110784727A/en
Application granted granted Critical
Publication of CN110784727B publication Critical patent/CN110784727B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/26603—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4784—Supplemental services, e.g. displaying phone caller identification, shopping application receiving rewards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Social Psychology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Human Computer Interaction (AREA)
  • Evolutionary Biology (AREA)
  • Medical Informatics (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Marketing (AREA)
  • Business, Economics & Management (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Computer Graphics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Psychiatry (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a reporting method and a reporting device for live broadcasting, wherein the reporting method for live broadcasting comprises the following steps: receiving a gesture track input in a live video playing process to obtain a target gesture; when the target gesture is matched with a preset reporting gesture, acquiring a video stream identifier of the live video; generating a reporting instruction according to the video stream identification; and sending the reporting instruction to a reporting server so that the reporting server responds to the reporting instruction to determine a target live broadcast video stream matched with the video stream identification, records audio data and video image data of the target live broadcast video stream, and performs reporting processing according to the recorded audio data and video image data. The method and the device realize the function of reporting based on the convenient interactive gesture, avoid the problem that the illegal live broadcast video is already deleted or deleted due to searching of an unobvious reporting operation entry, and are favorable for enhancing the supervision of the live broadcast of the video.

Description

Reporting method and device for live broadcast
Technical Field
The invention relates to the technical field of computers, in particular to a reporting method and device for live broadcasting.
Background
With the development of computer technology, live video is receiving more and more attention. In the video live broadcast, a video data stream is provided by a main broadcast client, and is forwarded in real time by a server, so that the video data stream is viewed on a spectator client.
Due to the uncertainty of the content of the video data stream provided by the anchor client, some illegal content often appears in the video live broadcast process. In the related art, when illegal contents appearing in a video live broadcast process are reported, a reporting operation entry is often not obvious, so that when the reporting operation entry is found, related illegal live broadcast videos are already deleted or deleted, and the monitoring on the video live broadcast is not facilitated.
Disclosure of Invention
In order to solve the problems in the prior art, the embodiment of the invention provides a reporting method and device for live broadcasting. The technical scheme is as follows:
in one aspect, a reporting method for live broadcasting is provided, and the method includes:
receiving a gesture track input in a live video playing process to obtain a target gesture;
when the target gesture is matched with a preset reporting gesture, acquiring a video stream identifier of the live video;
generating a reporting instruction according to the video stream identification;
and sending the reporting instruction to a reporting server so that the reporting server responds to the reporting instruction to determine a target live broadcast video stream matched with the video stream identification, records audio data and video image data of the target live broadcast video stream, and reports according to the audio data and the video image data.
In another aspect, a reporting method for live broadcasting is provided, and the method includes:
receiving a reporting instruction, wherein the reporting instruction carries a video stream identifier of a reported live video; the reporting instruction is generated when a target gesture received by the reporting client in the live video playing process is matched with a preset reporting gesture;
responding to the report instruction, and determining a target live broadcast video stream matched with the video stream identification;
recording audio data and video image data of the target live broadcast video stream;
and reporting according to the audio data and the video image data.
In another aspect, a reporting apparatus for live broadcasting is provided, the apparatus including:
the first receiving module is used for receiving a gesture track input in the live video playing process to obtain a target gesture;
the first acquisition module is used for acquiring a video stream identifier of the live video when the target gesture is matched with a preset reporting gesture;
the generating module is used for generating a reporting instruction according to the video stream identification;
and the sending module is used for sending the reporting instruction to a reporting server so that the reporting server responds to the reporting instruction to determine a target live broadcast video stream matched with the video stream identifier, records audio data and video image data of the target live broadcast video stream, and reports according to the recorded audio data and video image data.
Optionally, the generating module includes:
the third acquisition module is used for acquiring the violation level corresponding to the preset reporting gesture matched with the target gesture;
and the generation submodule is used for generating the reporting instruction according to the video stream identification and the violation level.
Optionally, the device further comprises a setting module, wherein the setting module is used for setting a preset reporting gesture; the setting module includes:
the fourth acquisition module is used for responding to a preset reporting gesture setting request and acquiring an input preset reporting gesture;
the display module is used for displaying violation level options;
and the fifth acquisition module is used for responding to the selection signal of the violation level option and determining the violation level corresponding to the preset reporting gesture.
In another aspect, a reporting apparatus for live broadcasting is provided, the apparatus including:
the second receiving module is used for receiving a reporting instruction, and the reporting instruction carries a video stream identifier of a reported live video; the reporting instruction is generated when a target gesture received by the reporting client in the live video playing process is matched with a preset reporting gesture;
the first determining module is used for responding to the reporting instruction and determining a target live broadcast video stream matched with the video stream identification;
the recording module is used for recording audio data and video image data of the target live broadcast video stream;
and the report processing module is used for reporting according to the recorded audio data and video image data.
Optionally, the report processing module includes:
the characteristic extraction module is used for respectively extracting the characteristics of the recorded audio data and video image data to obtain audio characteristics and video image characteristics;
the second determining module is used for determining the label information of the audio data according to the audio characteristics and determining the label information of the video image data according to the video image characteristics;
a third determining module, configured to determine, according to the tag information of the audio data and the tag information of the video image data, tag information of the target live video stream;
the fourth determining module is used for determining a reporting processing strategy according to the label information of the target live broadcast video stream;
and the processing submodule is used for reporting according to the reporting processing strategy.
Optionally, the tag information includes a tag type, where the tag type includes an illegal tag and a non-illegal tag, and when the tag type is an illegal tag, the tag information further includes an illegal level;
the third determining module includes:
a fifth determining module, configured to determine that the tag type of the target live video stream is an illegal tag when the illegal tag exists in the tag type of the audio data and the tag type of the video image data;
a sixth determining module, configured to use the violation level with the highest level in the tag information corresponding to the violation tag as the violation level of the target live broadcast video stream;
and the seventh determining module is used for determining that the label type of the target live broadcast video stream is a non-violation label under the condition that no violation label exists in the label type of the audio data and the label type of the video image data.
Optionally, the reporting instruction includes a violation level of the reported live video stream;
the fourth determining module includes:
an eighth determining module, configured to determine, based on the violation level of the target live broadcast video stream, a penalty level for the anchor client corresponding to the video stream identifier when the tag type of the target live broadcast video stream is an violation tag, and determine, based on the violation level in the report instruction and the violation level of the target live broadcast video stream, an incentive level for the report client;
and the ninth determining module is used for determining the punishment level of the reporting client based on the violation level in the reporting instruction under the condition that the label type of the target live broadcast video stream is a non-violation label.
Optionally, the eighth determining module is specifically configured to: when the violation level in the reporting instruction is matched with the violation level of the target live broadcast video stream, determining an incentive level for the reporting client based on the violation level of the reporting instruction; and when the violation level in the reporting instruction is not matched with the violation level of the target live broadcast video stream, determining the reward level for the reporting client based on the violation level of the target live broadcast video stream.
In another aspect, a reporting system for live broadcasting is provided, the system comprising a reporting client and a reporting server, wherein,
the reporting client is used for receiving a gesture track input in the live video playing process to obtain a target gesture; when the target gesture is matched with a preset reporting gesture, acquiring a video stream identifier of the live video; generating a reporting instruction according to the video stream identification; sending the reporting instruction to a reporting server;
the report server is used for receiving the report instruction; responding to the report instruction, and determining a target live broadcast video stream matched with the video stream identification; recording audio data and video image data of the target live broadcast video stream; and reporting according to the recorded audio data and video image data.
In another aspect, a terminal is provided, which includes a processor and a memory, where the memory stores at least one instruction, at least one program, a code set, or an instruction set, and the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the above-mentioned reporting method for live broadcast on the client side.
In another aspect, a server is provided, which includes a processor and a memory, where at least one instruction, at least one program, a code set, or a set of instructions is stored in the memory, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by the processor to implement the above-mentioned server-side reporting method for live broadcast.
In another aspect, a computer-readable storage medium is provided, in which at least one instruction, at least one program, a code set, or a set of instructions is stored, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by a processor to implement the reporting method for live broadcast on a reporting client side or a reporting server side provided in the foregoing method embodiments.
According to the embodiment of the invention, the target gesture is obtained by receiving the gesture track in the live video playing process, when the target gesture is matched with the preset reporting gesture, the video stream identification of the live video is obtained, the reporting instruction is generated according to the video stream identification, and the reporting instruction is sent to the reporting server, so that the reporting server can immediately record the audio data and the video image data of the live video stream when receiving the reporting instruction, and report processing is carried out according to the recorded audio data and the video image data, the reporting function based on the convenient interaction gesture is realized, the problem that the illegal live video is deleted or deleted due to the fact that an unobvious reporting operation inlet is found is avoided, and the monitoring on the live video is favorably enhanced.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic illustration of an implementation environment provided by an embodiment of the invention;
fig. 2 is a schematic flowchart of a reporting method for live broadcast according to an embodiment of the present invention;
fig. 3a, 3b, and 3c are schematic diagrams illustrating gesture tracks input during a live video playing process received by a reporting client according to an embodiment of the present invention;
fig. 4 is a schematic flowchart of another reporting method for live broadcast according to an embodiment of the present invention;
fig. 5 is a schematic flow chart of a method for reporting according to recorded audio data and video image data according to an embodiment of the present invention;
FIGS. 6a, 6b and 6c are schematic diagrams of a report being rewarded to a reporting client in real time according to an embodiment of the present invention; 6d, 6e, and 6f are schematic diagrams of a report that is not penalized to a reporting client in real time according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a reporting device for live broadcasting according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of another reporting apparatus for live broadcasting according to an embodiment of the present invention;
fig. 9 is a block diagram of a hardware structure of a terminal according to an embodiment of the present invention;
fig. 10 is a block diagram of a hardware structure of a server according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Referring to fig. 1, a schematic diagram of an implementation environment according to an embodiment of the present invention is shown, where the implementation environment may include an anchor terminal 110, a live server 120, a viewer terminal 130, and a report server 140.
Among them, the anchor terminal 110 may have an anchor client running therein, the viewer terminal 130 may have a viewer client running therein, and there may be a plurality of viewer clients corresponding to the anchor client. In this embodiment of the present specification, when the audience client performs the report on the live video of the anchor client, the audience client initiating the report may also be referred to as a report client. Anchor terminal 110 and viewer terminal 130 may include, but are not limited to, smart phones, desktop computers, tablet computers, laptops, digital assistants, smart wearable devices, and the like.
The live server 120 may provide background live services for the anchor client and the viewer client, and may include a server operating independently, or a distributed server, or a server cluster composed of multiple servers. The live server 120 and the anchor terminal 110 may be connected through a wired network or a wireless network, and the live server 120 and the viewer terminal 130 may be connected through a wired gateway or a wireless network.
The reporting server 140 may provide a background reporting service for the audience clients, and may comprise a stand-alone server, or a distributed server, or a server cluster consisting of multiple servers. The report server 140 and the anchor terminal 110 may be connected via a wired network or a wireless network, and the report server 140 and the viewer terminal 130 may be connected via a wired gateway or a wireless network.
Referring to fig. 2, a flow chart of a reporting method for live broadcast according to an embodiment of the present invention is shown, where the method can be applied to the audience terminal in fig. 1, and more specifically, can be applied to a reporting client initiating reporting in the audience terminal. It is noted that the present specification provides the method steps as described in the examples or flowcharts, but may include more or less steps based on routine or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. In actual system or product execution, sequential execution or parallel execution (e.g., parallel processor or multi-threaded environment) may be possible according to the embodiments or methods shown in the figures. Specifically, as shown in fig. 2, the method may include:
s201, receiving a gesture track input in a live video playing process to obtain a target gesture.
Specifically, in the video live broadcast, a user can play a live video provided by a main broadcast client through a viewer client, and in the live video playing process, if the user feels that the live video content has illegal content, a gesture track can be input through sliding of a finger on a live video playing interface. The audience client can monitor the touch signal of the user through the monitor and analyze a gesture track formed by sliding of a finger on a live video playing interface to obtain a target gesture. The violation content may include, but is not limited to, a yellow video image, a forbidden vocabulary, and the like.
S203, when the target gesture is matched with a preset reporting gesture, acquiring a video stream identifier of the live video.
In an embodiment of the present specification, the preset reporting gesture is a preset gesture for reporting, and the preset reporting gesture may be a default gesture or a gesture set by a user according to personal preferences and habits. In order to facilitate quick reporting by a user, the preset reporting gesture is generally a simple figure, a number, a mathematical symbol or a letter.
In a specific embodiment, if the preset reporting gesture is a system default gesture, when the user opens the video live broadcast application each time, the default gesture is skipped and the violation level corresponding to the default gesture is correspondingly prompted, so that the user is prompted to report the corresponding violation level through the default gesture. The preset reporting gestures corresponding to different violation levels are different, so that the user can report quickly, and the preset reporting gestures corresponding to different violation levels can be distinguished by the number of the contained same elements. For example, the violation levels from low to high may include warnings, first level warnings, and no-show, and the corresponding preset-reporting gestures may be "X", "XX", and "XXX", respectively.
In another specific embodiment, the method may further include a preset reporting gesture setting step, so that the user may set the preset reporting gesture according to personal preferences and habits. Specifically, the spectator client may prompt the user to set a preset reporting gesture and display a drawing interface of the preset reporting gesture when the user uses the video live broadcast application for the first time, and when the user inputs a gesture track on the drawing interface and clicks and submits, the spectator client may respond to the preset reporting gesture setting request to obtain the input preset reporting gesture; the audience client displays the violation level options so that the user can select the violation level corresponding to the current preset gesture; the audience client may determine the violation level corresponding to the preset reporting gesture in response to a selection signal of the violation level option. The violation level included in the violation level option may include multiple levels, for example, the violation level from low to high may include warning, first-level warning, and no-broadcast.
Taking three levels of violation level from low to high as warning, first-level warning and no-broadcast, and taking preset reporting gestures corresponding to the violation level from low to high as "X", "XX" and "XXX" as examples, as shown in fig. 3a, a target gesture received by a client is "X", and the target gesture is matched with the preset reporting gesture "X"; as shown in fig. 3b, the target gesture received by the client is "XX", and the target gesture matches with the preset reporting gesture "XX"; as shown in fig. 3c, the target gesture received by the client is "XXX", and the target gesture matches the preset reporting gesture "XXX".
In an embodiment of the present description, when the target gesture matches a preset reporting gesture, the viewer client may obtain a video stream identifier of a live video. The video stream identifier is used for uniquely identifying the video stream of the live video, and is in one-to-one correspondence with the anchor client providing the live video, namely, the anchor client and the live video stream can be uniquely determined through the video stream identifier.
And S205, generating a reporting instruction according to the video stream identification.
In this embodiment of the specification, when the preset reporting gesture corresponds to a corresponding violation level, the violation level corresponding to the preset reporting gesture matched with the target gesture may be obtained, and a corresponding reporting instruction is generated according to the violation level and the video stream identifier.
And S207, sending the reporting instruction to a reporting server so that the reporting server responds to the reporting instruction to determine a target live broadcast video stream matched with the video stream identifier, recording audio data and video image data of the target live broadcast video stream, and reporting according to the recorded audio data and video image data.
According to the technical scheme of the embodiment of the invention, the report of the live video can be realized only by sliding and inputting the corresponding gesture on the playing interface of the live video by the user, so that the report of the live video is quicker and more convenient, and the report operation entry is not required to be searched, thereby avoiding the problem that the illegal live video is passed or deleted due to the fact that the invisible report operation entry is searched, and being beneficial to strengthening the supervision of the live video.
Referring to fig. 4, a flow chart of another reporting method for live broadcast according to an embodiment of the present invention is shown, where the method may be applied to the reporting server in fig. 1, and as shown in fig. 4, the method may include:
s401, receiving a reporting instruction, wherein the reporting instruction carries a video stream identifier of a reported live video.
The reporting instruction is generated when a target gesture received by the reporting client in the live video playing process is matched with a preset reporting gesture. For the preset reporting gesture, reference may be made to the related description in the embodiment of the method shown in fig. 2, and details are not described herein.
And S403, responding to the reporting instruction, and determining a target live broadcast video stream matched with the video stream identification.
Specifically, after receiving the report instruction, the report server may extract the video stream identifier carried in the report instruction, and determine the target live video stream matched with the video stream identifier.
In a specific implementation mode, the reporting instruction can also carry the violation level of the reported live video stream, when the reporting server receives the reporting instructions of a plurality of different reporting terminals for different live videos at the same time, the reporting server can extract the violation level in the reporting instruction and sort the reporting instructions according to the violation level from high to low, so that the target reporting instruction can be determined according to the violation level, and then the reporting instruction with the high violation level can be responded preferentially, and the unhealthy live video can be processed timely.
S405, recording audio data and video image data of the target live broadcast video stream.
In the embodiment of the description, the reporting server records the audio data and the video image data of the target live broadcast video stream immediately after responding to the reporting instruction, so that the content of the reported live broadcast video can be reserved in time.
In a specific implementation, the audio data and the video image data within a preset time period may be recorded, where the preset time period is a preset duration with a receiving timestamp of the reporting instruction as a starting point, and the preset time period may be set according to an actual requirement, and may be set to 20 seconds, 50 seconds, or the like, for example.
And S407, reporting according to the recorded audio data and video image data.
In this embodiment of the present specification, the reporting server may implement reporting processing according to the recorded audio data and video image data by using the method shown in fig. 5, and as shown in fig. 5, the method may include:
s501, respectively extracting the characteristics of the recorded audio data and video image data to obtain audio characteristics and video image characteristics.
In the embodiment of the present specification, the extracting of the feature of the audio data includes performing audio, amplitude, and timbre identification on the audio data, then converting the audio data into corresponding text content, and acquiring a keyword in the text content, where the audio feature is the keyword of the text content corresponding to the audio data.
Feature extraction on the video image data includes determining the number of skin regions in the video image data, and determining the ratio of pixels of the skin regions to all pixels of the image, determining the ratio of the largest skin region to the total skin region. Accordingly, the video image features include the number of skin regions, the ratio of the pixels of the skin regions to all the pixels of the image, and the ratio of the largest skin region to the total skin region.
S503, determining the label information of the audio data according to the audio characteristics, and determining the label information of the video image data according to the video image characteristics.
In practical application, the audio features and the video image features can be respectively input into the audio tag determination model and the video tag determination model, tag information corresponding to the audio features is determined through the audio tag determination model, and tag information corresponding to the video image features is determined through the video tag determination model. The audio tag determination model is a machine learning model trained based on sample audio and corresponding tags, and the video tag determination model is a machine learning model trained based on sample video images and corresponding tags, and the machine learning model may include, but is not limited to, a linear classifier (such as LR), a Support Vector Machine (SVM), Naive Bayes (NB), and the like.
In a specific implementation, the sample audio includes a positive sample audio and a negative sample audio, the positive sample audio is determined audio that does not contain the illegal content, and the negative sample audio is determined audio that contains the illegal content; the labeling label of the positive sample audio is a non-violation label, and the labeling label of the negative sample audio is a violation label. The sample video images comprise positive sample video images and negative sample video images, the positive sample video images are determined video images which do not contain illegal contents, and the negative sample video images are determined video images which contain illegal contents; the labeling label of the positive sample video image is a non-violation label, and the labeling label of the negative sample video image is a violation label.
In a specific implementation manner, during training of the machine learning model, violation levels can be labeled on the negative sample audio, and violation levels can be labeled on the negative sample video image, so that the machine learning model obtained by training the negative sample audio marked with the violation levels can output corresponding violation levels, and the machine learning model obtained by training the negative sample video image marked with the violation levels can output corresponding violation levels. For the violation level, reference may be made to the related description in the embodiment of the method shown in fig. 2, and details are not repeated here.
And S505, determining the tag information of the target live broadcast video stream according to the tag information of the audio data and the tag information of the video image data.
In this embodiment of the present specification, the tag information may include a tag type, where the tag type includes an illegal tag and a non-illegal tag, and when the tag type is an illegal tag, the corresponding tag information may further include an illegal level.
And under the condition that the illegal tag exists in the tag type of the audio data and the tag type of the video image data, determining that the tag type of the target live broadcast video stream is the illegal tag, namely, if only one of the tag type of the audio data and the tag type of the video image data is the illegal tag, the tag type of the target live broadcast video stream can be considered as the illegal tag. When one of the two tags is an illegal tag, acquiring an illegal level in tag information corresponding to the illegal tag, and determining the illegal level as an illegal level of the target live video stream; and when the label type of the audio data is an illegal label and the label type of the video image data is an illegal label, respectively acquiring an illegal grade in the label information of the audio data and an illegal grade in the label information of the video image data, and taking the illegal grade in the label information of the audio data and the illegal grade with the highest illegal grade in the label information of the video image data as the illegal grade of the target live broadcast video stream.
For example, when the tag information of the audio data is: violation label and warning, wherein the label information of the video image data is as follows: when the illegal tag is not violated, determining the tag information of the target live video stream as follows: violation labels, warnings; when the tag information of the audio data is: the non-violation label comprises the following label information of video image data: and when illegal tags and broadcasting prohibition are carried out, determining that the tag information of the target live video stream is as follows: illegal labeling and broadcasting prohibition; when the tag information of the audio data is: violation label and warning, wherein the label information of the video image data is as follows: when illegal tags and broadcast forbidding are carried out, since the illegal level of broadcast forbidding is higher than that of warning, the tag information of the target live broadcast video stream can be determined as follows: illegal tag and broadcast prohibition.
Under the condition that no illegal tag exists in the tag type of the audio data and the tag type of the video image data, determining that the tag type of the target live broadcast video stream is a non-illegal tag, that is, when the tag type of the audio data is a non-illegal tag and the tag type of the video image data is a non-illegal tag, determining that the tag information of the target live broadcast video stream is: a non-violation tag.
And S507, determining a reporting processing strategy according to the label information of the target live broadcast video stream.
In order to encourage the user to report the illegal contents and strengthen the attack on the illegal live broadcasters, in the embodiment of the specification, the report processing strategy comprises a report processing strategy corresponding to the report being in real time and a report processing strategy corresponding to the report not being in real time. The reporting attribute means that the tag information of the target live broadcast video stream determined by the reporting server conforms to the reporting instruction; the fact that the report is not true means that the tag information of the target live broadcast video stream determined by the report service does not conform to the report instruction. The reporting processing strategy belongs to real-time reporting and comprises an incentive strategy for reporting clients and a penalty strategy for anchor clients; the reporting processing strategy which is not practical for reporting comprises a punishment strategy for the reporting client.
In practical application, the reporting instruction includes an illegal level of a reported live video stream, the reporting attribute can be determined under the condition that the label type of the target live video stream is an illegal label, the punishment level of the anchor client corresponding to the video stream identifier can be determined based on the illegal level of the target live video stream, and the rewarding level of the reporting client is determined based on the illegal level in the reporting instruction and the illegal level of the target live video stream.
In a specific implementation, the report server may store a corresponding relationship between the violation level and the penalty level, and the corresponding relationship may include a corresponding relationship between the violation level and the penalty level of the anchor client and a corresponding relationship between the violation level and the penalty level of the report client according to a difference between penalty objects (including the report client and the anchor client).
In a specific embodiment, when the punishment object is an anchor client, the violation level may include, from low to high, a warning, a first-level warning, and a no-broadcast, and the corresponding punishment level may include a warning punishment, a first-level warning punishment, and a no-broadcast punishment, where the warning punishment and the first-level warning punishment may represent different severity of the punishment through different no-broadcast durations, for example, the warning punishment may be set to no-broadcast for 10 minutes, and the first-level warning punishment may be set to no-broadcast for half an hour; the off-air penalty may be a permanent off-air.
In a specific embodiment, when the penalty object is a reporting client, the violation levels may include, from low to high, a warning, a first-level warning, and a no-cast, the corresponding penalty levels may include a first-level penalty, a second-level penalty, and a third-level penalty, the penalty modes of the respective levels may be the same or different, and different degrees of penalty may be represented by different penalty contents between the same penalty modes. For example, the first-level penalty, the second-level penalty and the third-level penalty are all forbidden claims to the reporting client, and the first-level penalty can be set as forbidden claims for 5 minutes, the second-level penalty can be set as forbidden claims for 30 minutes, and the third-level penalty can be set as forbidden claims for 24 hours.
The report server can also store the corresponding relation between the violation level and the reward level. In a specific embodiment, the violation levels may include warning, primary warning, and no-broadcast, the corresponding bonus levels may include primary bonus, secondary bonus, and tertiary bonus, the bonus manners of the respective bonus levels may be the same or different, and different degrees of bonus may be embodied by different bonus contents between the same bonus manners. For example, the primary award, the secondary award and the tertiary award are all awards to the reporting client for virtual resources such as virtual coins, points and the like, and for example, the primary award can be set to be 50 virtual coins, the secondary award to be 250 virtual coins and the tertiary award to be 500 virtual coins.
In this embodiment of the present specification, when determining an incentive level to the reporting client based on an violation level in the reporting instruction and an violation level of the target live broadcast video stream, when the violation level in the reporting instruction matches the violation level of the target live broadcast video stream, determining an incentive level to the reporting client based on the violation level of the reporting instruction; when the violation level in the reporting instruction is not matched with the violation level of the target live broadcast video stream, determining an incentive level for the reporting client based on the violation level of the target live broadcast video stream, determining a violation level with a lower level in the reporting instruction and the violation level of the target live broadcast video stream, and determining the incentive level for the reporting client according to the violation level with the lower level.
In this embodiment of the specification, when the tag type of the target live broadcast video stream is a non-violation tag, it may be determined that reporting is not true, and a penalty level for the reporting client may be determined based on a violation level in the reporting instruction.
And S509, reporting processing is carried out according to the reporting processing strategy.
Specifically, the report server performs corresponding report processing according to the determined report processing policy, for example, when the report is in real time, the report client is rewarded with virtual gold coins of a corresponding reward level, as shown in fig. 6a, 6b, and 6c, and the report client can also be rewarded with a corresponding prompt, for example, reward information is displayed on a display interface of the report client; and performing penalty corresponding to the penalty level on the reported anchor client, converting the live image of the anchor client into a preset picture, and displaying penalty information on a display interface of the anchor client. And when the report is not in real time, performing penalty corresponding to the penalty level on the report client, as shown in fig. 6d, 6e and 6f, and performing corresponding prompt of the penalty on the report client, for example, displaying the penalty information on a display interface of the report client.
According to the technical scheme of the embodiment of the invention, the reporting function of the live broadcast video is realized through the convenient interactive gesture, the reporting server can record the reported live broadcast video stream immediately when receiving the reporting instruction, the audio data and the video image data are quickly reserved for carrying out corresponding reporting processing, the problem that the related illegal live broadcast video is passed or deleted is effectively avoided, and the reporting is facilitated and the efficiency of the reporting processing is also improved.
In addition, the embodiment of the invention can reduce the bearing pressure of the server by recording the audio data and the video image data of the live broadcast video stream in the preset time period, thereby avoiding the problem of large bearing pressure of the server caused by recording the complete live broadcast content and further reducing the monitoring cost of the live broadcast.
The embodiment of the invention also provides another reporting method for live broadcasting, which comprises the following steps:
the reporting client receives a gesture track input in a live video playing process to obtain a target gesture; when the target gesture is matched with a preset reporting gesture, acquiring a video stream identifier of the live video; generating a reporting instruction according to the video stream identification; sending the reporting instruction to a reporting server;
the reporting server receives the reporting instruction; responding to the report instruction, and determining a target live broadcast video stream matched with the video stream identification; recording audio data and video image data of the target live broadcast video stream; and reporting according to the recorded audio data and video image data.
Corresponding to the reporting methods for live broadcast on the reporting client side provided in the foregoing several embodiments, embodiments of the present invention further provide a reporting device for live broadcast, and since the reporting device for live broadcast provided in the embodiments of the present invention corresponds to the reporting methods for live broadcast on the reporting client side provided in the foregoing several embodiments, the foregoing implementation manner of the reporting method for live broadcast on the reporting client side is also applicable to the reporting device for live broadcast provided in this embodiment, and is not described in detail in this embodiment.
Referring to fig. 7, it is a schematic structural diagram of a reporting apparatus for live broadcasting according to an embodiment of the present invention, where the apparatus has a function of implementing a reporting method for live broadcasting on a reporting client side in the foregoing method embodiment, and the function may be implemented by hardware or by hardware executing corresponding software. As shown in fig. 7, the apparatus may include:
the first receiving module 710 is configured to receive a gesture track input in a live video playing process to obtain a target gesture;
a first obtaining module 720, configured to obtain a video stream identifier of the live video when the target gesture matches a preset reporting gesture;
the generating module 730 is configured to generate a reporting instruction according to the video stream identifier;
the sending module 740 is configured to send the report instruction to a report server, so that the report server responds to the report instruction to determine a target live broadcast video stream matched with the video stream identifier, records audio data and video image data of the target live broadcast video stream, and performs report processing according to the recorded audio data and video image data.
In a specific embodiment, the generating module 730 may include:
the third acquisition module is used for acquiring the violation level corresponding to the preset reporting gesture matched with the target gesture;
and the generation submodule is used for generating the reporting instruction according to the video stream identification and the violation level.
In another specific embodiment, the apparatus may further include a setting module, where the setting module is configured to set a preset reporting gesture; the setting module may include:
the fourth acquisition module is used for responding to a preset reporting gesture setting request and acquiring an input preset reporting gesture;
the display module is used for displaying violation level options;
and the fifth acquisition module is used for responding to the selection signal of the violation level option and determining the violation level corresponding to the preset reporting gesture.
Referring to fig. 8, a schematic structural diagram of another reporting apparatus for live broadcasting according to an embodiment of the present invention is shown, where the apparatus has a function of implementing a reporting method for live broadcasting on a reporting server side in the foregoing method embodiment, and the function may be implemented by hardware or by hardware executing corresponding software. As shown in fig. 8, the apparatus may include:
a second receiving module 810, configured to receive a report instruction, where the report instruction carries a video stream identifier of a reported live video; the reporting instruction is generated when a target gesture received by the reporting client in the live video playing process is matched with a preset reporting gesture;
a first determining module 820, configured to determine, in response to the report instruction, a target live video stream that matches the video stream identifier;
a recording module 830, configured to record audio data and video image data of the target live video stream;
and the report processing module 840 is used for performing report processing according to the recorded audio data and video image data.
In a particular embodiment, the report processing module 840 may include:
the characteristic extraction module is used for respectively extracting the characteristics of the recorded audio data and video image data to obtain audio characteristics and video image characteristics;
the second determining module is used for determining the label information of the audio data according to the audio characteristics and determining the label information of the video image data according to the video image characteristics;
a third determining module, configured to determine, according to the tag information of the audio data and the tag information of the video image data, tag information of the target live video stream;
the fourth determining module is used for determining a reporting processing strategy according to the label information of the target live broadcast video stream;
and the processing submodule is used for reporting according to the reporting processing strategy.
Specifically, the tag information includes a tag type, the tag type includes an illegal tag and a non-illegal tag, and when the tag type is the illegal tag, the tag information further includes an illegal level; the third determining module may include:
a fifth determining module, configured to determine that the tag type of the target live video stream is an illegal tag when the illegal tag exists in the tag type of the audio data and the tag type of the video image data;
a sixth determining module, configured to use the violation level with the highest level in the tag information corresponding to the violation tag as the violation level of the target live broadcast video stream;
and the seventh determining module is used for determining that the label type of the target live broadcast video stream is a non-violation label under the condition that no violation label exists in the label type of the audio data and the label type of the video image data.
In a specific embodiment, the reporting instruction comprises a violation level of a reported live video stream; accordingly, the fourth determining module may include:
an eighth determining module, configured to determine, based on the violation level of the target live broadcast video stream, a penalty level for the anchor client corresponding to the video stream identifier when the tag type of the target live broadcast video stream is an violation tag, and determine, based on the violation level in the report instruction and the violation level of the target live broadcast video stream, an incentive level for the report client;
and the ninth determining module is used for determining the punishment level of the reporting client based on the violation level in the reporting instruction under the condition that the label type of the target live broadcast video stream is a non-violation label.
Optionally, the eighth determining module is specifically configured to: when the violation level in the reporting instruction is matched with the violation level of the target live broadcast video stream, determining an incentive level for the reporting client based on the violation level of the reporting instruction; and when the violation level in the reporting instruction is not matched with the violation level of the target live broadcast video stream, determining the reward level for the reporting client based on the violation level of the target live broadcast video stream.
The embodiment of the invention also provides a reporting system for live broadcasting, which can comprise a reporting client and a reporting server, wherein,
the reporting client is used for receiving a gesture track input in the live video playing process to obtain a target gesture; when the target gesture is matched with a preset reporting gesture, acquiring a video stream identifier of the live video; generating a reporting instruction according to the video stream identification; sending the reporting instruction to a reporting server;
the report server is used for receiving the report instruction; responding to the report instruction, and determining a target live broadcast video stream matched with the video stream identification; recording audio data and video image data of the target live broadcast video stream; and reporting according to the recorded audio data and video image data.
It should be noted that, when the apparatus provided in the foregoing embodiment implements the functions thereof, only the division of the functional modules is illustrated, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the apparatus may be divided into different functional modules to implement all or part of the functions described above. In addition, the apparatus and method embodiments provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments for details, which are not described herein again.
The embodiment of the present invention provides a terminal, where the terminal includes a processor and a memory, where the memory stores at least one instruction, at least one program, a code set, or an instruction set, and the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the reporting method for live broadcast on the reporting client side provided by the above method embodiment. Fig. 9 is a block diagram of a hardware structure of a terminal that runs a reporting method for live broadcast according to an embodiment of the present invention, specifically:
the terminal may include RF (Radio Frequency) circuitry 910, memory 920 including one or more computer-readable storage media, an input unit 930, a display unit 940, a sensor 950, audio circuitry 960, a WiFi (wireless fidelity) module 970, a processor 980 including one or more processing cores, and a power supply 990. Those skilled in the art will appreciate that the terminal structure shown in fig. 9 does not constitute a limitation of the terminal, and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:
the RF circuit 910 may be used for receiving and transmitting signals during a message transmission or call, and in particular, for receiving downlink information from a base station and then processing the received downlink information by the one or more processors 980; in addition, data relating to uplink is transmitted to the base station. In general, RF circuit 910 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like. In addition, the RF circuit 910 may also communicate with networks and other terminals through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), and the like.
The memory 920 may be used to store software programs and modules, and the processor 980 performs various functional applications and data processing by operating the software programs and modules stored in the memory 920. The memory 920 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, application programs required for functions, and the like; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 920 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 920 may also include a memory controller to provide the processor 980 and the input unit 930 with access to the memory 920.
The input unit 930 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, the input unit 930 may include a touch-sensitive surface 931 as well as other input devices 932. The touch-sensitive surface 931, also referred to as a touch screen or a touch pad, may collect touch operations by a user on or near the touch-sensitive surface 931 (e.g., operations by a user on or near the touch-sensitive surface 931 using a finger, a stylus, or any other suitable object or attachment) and drive the corresponding connecting device according to a predetermined program. Alternatively, the touch sensitive surface 931 may include both a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 980, and can receive and execute commands sent by the processor 980. In addition, the touch sensitive surface 931 may be implemented in various types, such as resistive, capacitive, infrared, and surface acoustic wave. The input unit 930 may also include other input devices 932 in addition to the touch-sensitive surface 931. In particular, other input devices 932 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The display unit 940 may be used to display information input by or provided to the user and various graphic user interfaces of the terminal, which may be configured by graphics, text, icons, video, and any combination thereof. The Display unit 940 may include a Display panel 941, and optionally, the Display panel 941 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch-sensitive surface 931 may overlay the display panel 941, and when a touch operation is detected on or near the touch-sensitive surface 931, the touch operation is transmitted to the processor 980 to determine the type of touch event, and the processor 980 then provides a corresponding visual output on the display panel 941 according to the type of touch event. Where the touch-sensitive surface 931 and the display panel 941 may implement input and output functions as two separate components, in some embodiments the touch-sensitive surface 931 and the display panel 941 may be integrated to implement input and output functions.
The terminal may also include at least one sensor 950, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel 941 according to the brightness of ambient light, and a proximity sensor that may turn off the display panel 941 and/or a backlight when the terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when the terminal is stationary, and can be used for applications of recognizing terminal gestures (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal, detailed description is omitted here.
Audio circuitry 960, speaker 961, microphone 962 may provide an audio interface between a user and the terminal. The audio circuit 960 may transmit the electrical signal converted from the received audio data to the speaker 961, and convert the electrical signal into a sound signal for output by the speaker 961; on the other hand, the microphone 962 converts the collected sound signal into an electric signal, converts the electric signal into audio data after being received by the audio circuit 960, and outputs the audio data to the processor 980 for processing, and then transmits the audio data to another terminal via the RF circuit 910, or outputs the audio data to the memory 920 for further processing. The audio circuit 960 may also include an earbud jack to provide communication of peripheral headphones with the terminal.
WiFi belongs to a short-distance wireless transmission technology, and the terminal can help a user to send and receive e-mails, browse webpages, access streaming media and the like through a WiFi module 970, and provides wireless broadband internet access for the user. Although fig. 9 shows the WiFi module 970, it is understood that it does not belong to the essential constitution of the terminal and can be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 980 is a control center of the terminal, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the terminal and processes data by operating or executing software programs and/or modules stored in the memory 920 and calling data stored in the memory 920, thereby integrally monitoring the terminal. Optionally, processor 980 may include one or more processing cores; preferably, the processor 980 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 980.
The terminal also includes a power supply 990 (e.g., a battery) for supplying power to the various components, which may be logically connected to the processor 980 via a power management system, such that the functions of managing charging, discharging, and power consumption are performed via the power management system. Power supply 990 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and the like.
Although not shown, the terminal may further include a camera, a bluetooth module, and the like, which are not described herein again. In this embodiment, the terminal further includes a memory and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the one or more processors. The one or more programs include instructions for performing the method of reporting client side provided by the above-described method embodiments.
It will be understood by those skilled in the art that the structure shown in fig. 9 is only an illustration and is not intended to limit the structure of the electronic device. For example, the terminal may also include more or fewer components than shown in fig. 9, or have a different configuration than shown in fig. 9.
An embodiment of the present invention further provides a computer-readable storage medium, which may be disposed in a terminal to store at least one instruction, at least one program, a code set, or a set of instructions related to implementing a reporting method for live broadcast on a reporting client side, where the at least one instruction, the at least one program, the code set, or the set of instructions are loaded and executed by the processor to implement the method for reporting the client side provided by the foregoing method embodiment.
The embodiment of the invention provides a server, which comprises a processor and a memory, wherein at least one instruction, at least one program, a code set or an instruction set is stored in the memory, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to realize the reporting method for live broadcast on the reporting server side, which is provided by the above method embodiment.
Fig. 10 is a block diagram of a hardware structure of a server for operating a reporting method for live broadcasting according to an embodiment of the present invention, as shown in fig. 10, the server may have a relatively large difference due to different configurations or performances, and may include one or more Central Processing Units (CPUs) 1010 (the processor 1010 may include but is not limited to a Processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 1030 for storing data, and one or more storage media 1020 (e.g., one or more mass storage devices) for storing an application 1023 or data 1022. Memory 1030 and storage media 1020 may be, among other things, transient or persistent storage. The program stored in the storage medium 1020 may include one or more modules, each of which may include a series of instruction operations for a server. Still further, the central processor 1010 may be configured to communicate with the storage medium 1020 and execute a series of instruction operations in the storage medium 1020 on the server 1000. The server 1000 may also include one or more power supplies 1060, one or more wired or wireless network interfaces 1050, one or more input-output interfaces 1040, and/or one or more operating systems 1021, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, and so forth.
Input-output interface 1040 may be used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the server. In one example, i/o Interface 1040 includes a Network adapter (NIC) that may be coupled to other Network devices via a base station to communicate with the internet. In one example, the input/output interface 1040 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
It will be understood by those skilled in the art that the structure shown in fig. 10 is merely illustrative and is not intended to limit the structure of the electronic device. For example, the server may also include more or fewer components than shown in FIG. 10, or have a different configuration than shown in FIG. 10.
An embodiment of the present invention further provides a computer-readable storage medium, where the storage medium may be disposed in a server to store at least one instruction, at least one program, a code set, or an instruction set related to implementing a reporting method for live broadcast on a reporting server side, where the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the method on the reporting server side provided by the foregoing method embodiment.
Optionally, in this embodiment, the storage medium may include, but is not limited to: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
It should be noted that: the precedence order of the above embodiments of the present invention is only for description, and does not represent the merits of the embodiments. And specific embodiments thereof have been described above. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (10)

1. A reporting method for live broadcasting, the method comprising:
receiving a gesture track input in a live video playing process to obtain a target gesture;
when the target gesture is matched with a preset reporting gesture, acquiring a video stream identifier of the live video;
generating a reporting instruction according to the video stream identification;
and sending the reporting instruction to a reporting server so that the reporting server responds to the reporting instruction to determine a target live broadcast video stream matched with the video stream identification, records audio data and video image data of the target live broadcast video stream, and performs reporting processing according to the recorded audio data and video image data.
2. The reporting method for a live broadcast of claim 1, wherein the generating a reporting directive according to the video stream identification comprises:
acquiring violation levels corresponding to preset reporting gestures matched with the target gestures;
and generating the reporting instruction according to the video stream identification and the violation level.
3. The reporting method for the live broadcast according to claim 2, further comprising a preset reporting gesture setting step, wherein the preset reporting gesture setting step comprises:
responding to a preset reporting gesture setting request, and acquiring an input preset reporting gesture;
displaying violation level options;
and responding to a selection signal of the violation level option, and determining the violation level corresponding to the preset reporting gesture.
4. A reporting method for live broadcasting, the method comprising:
receiving a reporting instruction, wherein the reporting instruction carries a video stream identifier of a reported live video; the reporting instruction is generated when a target gesture received by the reporting client in the live video playing process is matched with a preset reporting gesture;
responding to the report instruction, and determining a target live broadcast video stream matched with the video stream identification;
recording audio data and video image data of the target live broadcast video stream;
and reporting according to the recorded audio data and video image data.
5. The reporting method for live broadcasting according to claim 4, wherein the reporting process according to the recorded audio data and video image data comprises:
respectively extracting the characteristics of the recorded audio data and video image data to obtain audio characteristics and video image characteristics;
determining label information of the audio data according to the audio features, and determining label information of the video image data according to the video image features;
determining the label information of the target live broadcast video stream according to the label information of the audio data and the label information of the video image data;
determining a reporting processing strategy according to the label information of the target live broadcast video stream;
and reporting processing is carried out according to the reporting processing strategy.
6. The reporting method for the live broadcast according to claim 5, wherein the tag information includes a tag type, the tag type includes an illegal tag and a non-illegal tag, and when the tag type is an illegal tag, the tag information further includes an illegal level;
the determining the tag information of the target live video stream according to the tag information of the audio data and the tag information of the video image data includes:
determining that the label type of the target live broadcast video stream is an illegal label under the condition that the illegal label exists in the label type of the audio data and the label type of the video image data;
taking the violation level with the highest level in the label information corresponding to the violation label as the violation level of the target live broadcast video stream;
and under the condition that no illegal tag exists in the tag type of the audio data and the tag type of the video image data, determining that the tag type of the target live broadcast video stream is a non-illegal tag.
7. The reporting method for a live broadcast of claim 6, wherein the reporting instruction includes a violation level of a reported live video stream;
the determining a reporting processing strategy according to the tag information of the target live broadcast video stream comprises:
under the condition that the label type of the target live broadcast video stream is an illegal label, determining a punishment grade of an anchor client corresponding to the video stream identifier based on the illegal grade of the target live broadcast video stream, and determining an incentive grade of the reporting client based on the illegal grade in the reporting instruction and the illegal grade of the target live broadcast video stream;
and under the condition that the label type of the target live broadcast video stream is a non-violation label, determining a punishment grade of the reporting client based on the violation grade in the reporting instruction.
8. The reporting method for a live broadcast of claim 7, wherein the determining a reward level for the reporting client based on the violation level in the reporting directive and the violation level of the target live video stream comprises:
when the violation level in the reporting instruction is matched with the violation level of the target live broadcast video stream, determining an incentive level for the reporting client based on the violation level of the reporting instruction;
and when the violation level in the reporting instruction is not matched with the violation level of the target live broadcast video stream, determining the reward level for the reporting client based on the violation level of the target live broadcast video stream.
9. A reporting device for live broadcasting, the device comprising:
the first receiving module is used for receiving a gesture track input in the live video playing process to obtain a target gesture;
the first acquisition module is used for acquiring a video stream identifier of the live video when the target gesture is matched with a preset reporting gesture;
the generating module is used for generating a reporting instruction according to the video stream identification;
and the sending module is used for sending the reporting instruction to a reporting server so that the reporting server responds to the reporting instruction to determine a target live broadcast video stream matched with the video stream identifier, records audio data and video image data of the target live broadcast video stream, and reports according to the recorded audio data and video image data.
10. A reporting device for live broadcasting, the device comprising:
the second receiving module is used for receiving a reporting instruction, and the reporting instruction carries a video stream identifier of a reported live video; the reporting instruction is generated when a target gesture received by the reporting client in the live video playing process is matched with a preset reporting gesture;
the first determining module is used for responding to the reporting instruction and determining a target live broadcast video stream matched with the video stream identification;
the recording module is used for recording audio data and video image data of the target live broadcast video stream;
and the report processing module is used for reporting according to the recorded audio data and video image data.
CN201910782515.4A 2019-08-23 2019-08-23 Reporting method and device for live broadcast Active CN110784727B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910782515.4A CN110784727B (en) 2019-08-23 2019-08-23 Reporting method and device for live broadcast

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910782515.4A CN110784727B (en) 2019-08-23 2019-08-23 Reporting method and device for live broadcast

Publications (2)

Publication Number Publication Date
CN110784727A CN110784727A (en) 2020-02-11
CN110784727B true CN110784727B (en) 2022-04-19

Family

ID=69383368

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910782515.4A Active CN110784727B (en) 2019-08-23 2019-08-23 Reporting method and device for live broadcast

Country Status (1)

Country Link
CN (1) CN110784727B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113722632A (en) * 2020-05-26 2021-11-30 北京达佳互联信息技术有限公司 Data processing method, device, terminal and storage medium
CN113938692B (en) * 2020-07-13 2024-02-09 广州壹点通网络科技有限公司 Video live broadcast risk control method and device
CN112217841A (en) * 2020-12-09 2021-01-12 平安国际智慧城市科技股份有限公司 Live broadcast room management method and device, computer equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103716690A (en) * 2013-12-27 2014-04-09 广州华多网络科技有限公司 Multimedia live broadcast whistle-blowing method, terminal, server and system
CN107864401A (en) * 2017-11-08 2018-03-30 北京密境和风科技有限公司 It is a kind of based on live monitoring method, device, system and terminal device
CN109714605A (en) * 2018-12-28 2019-05-03 广州华多网络科技有限公司 Report data processing method, device, terminal device and server
CN109831698A (en) * 2018-12-28 2019-05-31 广州华多网络科技有限公司 Signal auditing method, device, electronic equipment and computer-readable storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170279757A1 (en) * 2016-03-22 2017-09-28 Facebook, Inc. Systems and methods for identifying matching content

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103716690A (en) * 2013-12-27 2014-04-09 广州华多网络科技有限公司 Multimedia live broadcast whistle-blowing method, terminal, server and system
WO2015096729A1 (en) * 2013-12-27 2015-07-02 广州华多网络科技有限公司 Method, terminal, server, and system for multimedia live broadcast report
CN107864401A (en) * 2017-11-08 2018-03-30 北京密境和风科技有限公司 It is a kind of based on live monitoring method, device, system and terminal device
CN109714605A (en) * 2018-12-28 2019-05-03 广州华多网络科技有限公司 Report data processing method, device, terminal device and server
CN109831698A (en) * 2018-12-28 2019-05-31 广州华多网络科技有限公司 Signal auditing method, device, electronic equipment and computer-readable storage medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
直播分享网站节目监管策略研究;司凯威;《数字传媒研究》;20160415(第04期);53-55、81 *
网络直播泛娱乐化乱象解读与有序治理;隗辉等;《湖北社会科学》;20180426(第02期);196-200 *

Also Published As

Publication number Publication date
CN110784727A (en) 2020-02-11

Similar Documents

Publication Publication Date Title
CN108632658B (en) Bullet screen display method and terminal
CN109769065B (en) Message display method and device, mobile terminal and storage medium
WO2015180672A1 (en) Video-based interaction method, terminal, server and system
CN105867751B (en) Operation information processing method and device
CN109756767B (en) Preview data playing method, device and storage medium
CN110784727B (en) Reporting method and device for live broadcast
CN104852885B (en) Method, device and system for verifying verification code
CN108494665B (en) Group message display method and mobile terminal
CN106254910B (en) Method and device for recording image
CN108810057B (en) User behavior data acquisition method and device and storage medium
CN106126570B (en) Information service system
CN106412818B (en) Method and device for positioning equipment
CN114339375B (en) Video playing method, method for generating video catalogue and related products
CN111932322A (en) Advertisement display method, related device, equipment and storage medium
CN114357278B (en) Topic recommendation method, device and equipment
CN108540649B (en) Content display method and mobile terminal
CN107562917B (en) User recommendation method and device
CN110069675A (en) A kind of search method and mobile terminal
CN106302101B (en) Message reminding method, terminal and server
CN105095161B (en) Method and device for displaying rich text information
CN111666498B (en) Friend recommendation method based on interaction information, related device and storage medium
CN106446042B (en) Information display method and device
CN112270238A (en) Video content identification method and related device
CN106161188B (en) Message sending method, message display method and device
CN110888572A (en) Message display method and terminal equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40021507

Country of ref document: HK

SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant