CN111107385A - Live video processing method and device - Google Patents

Live video processing method and device Download PDF

Info

Publication number
CN111107385A
CN111107385A CN201911377328.4A CN201911377328A CN111107385A CN 111107385 A CN111107385 A CN 111107385A CN 201911377328 A CN201911377328 A CN 201911377328A CN 111107385 A CN111107385 A CN 111107385A
Authority
CN
China
Prior art keywords
live video
preset position
video
desensitized
type information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911377328.4A
Other languages
Chinese (zh)
Inventor
李先
康子建
贺向波
段粲超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Reach Best Technology Co Ltd
Beijing Dajia Internet Information Technology Co Ltd
Original Assignee
Reach Best Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Reach Best Technology Co Ltd filed Critical Reach Best Technology Co Ltd
Priority to CN201911377328.4A priority Critical patent/CN111107385A/en
Publication of CN111107385A publication Critical patent/CN111107385A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44004Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4882Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present disclosure relates to a live video processing method, apparatus, computer device and storage medium, wherein the method comprises: identifying a preset position in a live video; if the fact that notification type information is displayed at a preset position in the live video is recognized, desensitizing the notification type information displayed at the preset position in the live video to obtain a desensitized live video; sending the desensitized live video to a server; and the server is used for pushing the desensitized live video to a user terminal for playing. The method can solve the problem of low hiding efficiency of the notification information in the related technology, thereby improving the hiding efficiency of the notification information; meanwhile, the method can improve the hiding effect of the notification information.

Description

Live video processing method and device
Technical Field
The present disclosure relates to the field of video processing technologies, and in particular, to a live video processing method and apparatus, a computer device, and a storage medium.
Background
With the continuous development of internet technology, more and more multimedia live broadcast displays are in front of people; in the live broadcast process, a communication information containing sensitive information, such as a short message verification code, may pop up from an interface of a main broadcast terminal, and the communication information may be seen by a user watching the live broadcast; it needs to be hidden to protect the privacy information of the anchor.
In the related art, the communication information is generally closed manually by the anchor to be hidden; however, if different types of notification information are required to be manually closed, the process is complicated, and a certain amount of time is consumed, which results in low efficiency of hiding the notification information.
Disclosure of Invention
The present disclosure provides a live video processing method, apparatus, computer device, and storage medium, to at least solve the problem of low hiding efficiency of notification-type information in the related art. The technical scheme of the disclosure is as follows:
according to a first aspect of the embodiments of the present disclosure, a method for processing a live video is provided, including:
identifying a preset position in a live video;
if the fact that the notification type information is displayed at the preset position in the live video is recognized,
desensitizing the notification information displayed in the preset position in the live video to obtain a desensitized live video;
sending the desensitized live video to a server; and the server is used for pushing the desensitized live video to a user terminal for playing.
In an exemplary embodiment, the identifying the preset position in the live video includes:
caching video data of the live video in a preset time period;
and identifying a preset position in the live video according to the cached video data.
In an exemplary embodiment, the identifying the preset position in the live video includes:
acquiring an image of a preset position in the live video;
extracting image features in the image;
if the image features are identified to be matched with preset image features, confirming that the preset position in the live video displays notification information; the preset image characteristics are image characteristics corresponding to display images of the notification information in the live video.
In an exemplary embodiment, the desensitizing the notification type information displayed in the preset position in the live video to obtain a desensitized live video includes:
determining a video frame containing the notification type information from the live video;
and desensitizing the notification type information displayed in the preset position in the video frame to obtain a desensitized live video.
In an exemplary embodiment, the desensitizing the notification class information displayed in the preset position in the video frame includes:
desensitizing the notification type information displayed in the preset position in the video frame according to a desensitizing algorithm;
or the like, or, alternatively,
and carrying out fuzzy processing on the notification information displayed in the preset position in the video frame.
According to a second aspect of the embodiments of the present disclosure, there is provided a method for processing a live video, including:
receiving a desensitized live video sent by a main broadcasting terminal; the anchor terminal is used for identifying a preset position in the live video, and if the fact that notification type information is displayed at the preset position in the live video is identified, desensitizing the notification type information displayed at the preset position in the live video to obtain the live video after desensitizing;
and pushing the desensitized live video to a user terminal for playing.
According to a third aspect of the embodiments of the present disclosure, a method for processing a live video is provided, including:
receiving video data of a live video sent by a main broadcasting terminal;
according to the video data, recognizing a preset position in the live video;
if the fact that notification type information is displayed at a preset position in the live video is recognized, desensitizing the notification type information displayed at the preset position in the live video to obtain a desensitized live video;
and pushing the desensitized live video to a user terminal for playing.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a processing apparatus for live video, including:
a video identification module configured to perform identification of a preset position in a live video;
the desensitization processing module is configured to perform desensitization processing on notification type information displayed in a preset position in the live video if the notification type information is displayed in the preset position in the live video is identified, so as to obtain a desensitized live video;
a video stream sending module configured to execute sending the desensitized live video to a server; and the server is used for pushing the desensitized live video to a user terminal for playing.
In an exemplary embodiment, the video identification module is further configured to perform caching of video data of the live video within a preset time period; and identifying a preset position in the live video according to the cached video data.
In an exemplary embodiment, the video recognition module is further configured to perform acquiring an image of a preset position in the live video; extracting image features in the image; if the image features are identified to be matched with preset image features, confirming that the preset position in the live video displays notification information; the preset image characteristics are image characteristics corresponding to display images of the notification information in the live video.
In an exemplary embodiment, the desensitization processing module is further configured to perform determining a video frame containing the notification class information from the live video; and desensitizing the notification type information displayed in the preset position in the video frame to obtain a video stream after desensitizing.
In an exemplary embodiment, the desensitization processing module is further configured to perform desensitization processing on notification class information displayed in the preset position in the video frame according to a desensitization algorithm; or, performing fuzzy processing on the notification type information displayed in the preset position in the video frame.
According to a fifth aspect of the embodiments of the present disclosure, there is provided a processing apparatus for live video, including:
the live video receiving module is configured to execute receiving of the desensitized live video sent by the anchor terminal; the anchor terminal is used for identifying a preset position in the live video, and if the fact that notification type information is displayed at the preset position in the live video is identified, desensitizing the notification type information displayed at the preset position in the live video to obtain the live video after desensitizing;
and the live video pushing module is configured to execute pushing of the desensitized live video to a user terminal for playing.
According to a sixth aspect of the embodiments of the present disclosure, there is provided a processing apparatus for live video, including:
the video data receiving module is configured to execute receiving of video data of live video sent by the anchor terminal;
the live video identification module is configured to identify a preset position in the live video according to the video data;
the information processing module is configured to perform desensitization processing on the notification type information displayed in the preset position in the live video if the notification type information is displayed in the preset position in the live video, so as to obtain a desensitized live video;
and the video pushing module is configured to push the desensitized live video to a user terminal for playing.
According to a seventh aspect of embodiments of the present disclosure, there is provided a computer device comprising a memory storing a computer program and a processor implementing the method as in the implementation of the first, second or third aspect when executing the computer program.
According to an eighth aspect of embodiments of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method as in the implementation of the first, second or third aspect.
According to a ninth aspect of embodiments of the present disclosure, there is provided a computer program product comprising: computer program code which, when run by a computer, causes the computer to perform the method of the above aspects.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
if the fact that the notification information is displayed at the preset position in the live video is recognized, desensitization processing is conducted on the notification information displayed at the preset position in the live video, the live video after desensitization processing is sent to a server, and the live video after desensitization processing is pushed to a user terminal through the server to be played; the method and the device achieve the purpose of automatically desensitizing the notification information displayed in the preset position in the live video, and the whole process does not need anchor operation, thereby simplifying the hiding process of the notification information and further improving the hiding efficiency of the notification information; meanwhile, the notification information displayed in the preset position in the live video is subjected to real-time desensitization treatment, so that the hiding effect of the notification information is better, and the hiding effect of the notification information is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
Fig. 1 is a diagram illustrating an application environment of a method for processing live video according to an exemplary embodiment.
Fig. 2 is a flow diagram illustrating a method of processing live video in accordance with an exemplary embodiment.
Fig. 3 is an interface diagram illustrating a live video according to an example embodiment.
Fig. 4 is an interface diagram illustrating a live video without desensitization processing and a live video after desensitization processing according to an example embodiment.
Fig. 5 is a flowchart illustrating steps for identifying preset locations in a live video according to an exemplary embodiment.
Fig. 6 is a flow chart illustrating steps of a method of processing live video according to another exemplary embodiment.
Fig. 7 is a flowchart illustrating steps of a method of processing live video according to yet another exemplary embodiment.
Fig. 8 is a block diagram illustrating a processing device of live video in accordance with an exemplary embodiment.
Fig. 9 is a block diagram illustrating a processing device of live video according to another example embodiment.
Fig. 10 is a block diagram illustrating a processing device of live video according to yet another example embodiment.
FIG. 11 is an internal block diagram of a computer device, shown in accordance with an exemplary embodiment.
Fig. 12 is an internal structural diagram of a computer device according to another exemplary embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
Fig. 1 is an application environment diagram illustrating a method for processing live video according to an exemplary embodiment. Referring to fig. 1, the application environment diagram includes an anchor terminal 110 and a server 120 connected via a network, and the server 120 is further connected with a plurality of user terminals 130, such as a user terminal 130a, a user terminal 130b, and the like. Specifically, referring to fig. 1, in a screen recording live scene, the anchor terminal 110 identifies a preset position in a live video; if the fact that the notification information is displayed at the preset position in the live video is recognized, desensitizing the notification information displayed at the preset position in the live video to obtain the desensitized live video; and sending the desensitized live video to the corresponding server 120. The server 120 pushes the desensitized live video to the user terminal 130, and plays the desensitized live video through the user terminal 130, so that the user sees the desensitized notification information, such as the notification information after the blurring process, on the live video.
The anchor terminal 110 is an electronic device with a screen recording and live broadcasting function, and the electronic device may be a smart phone, a tablet computer, or the like; the server 120 may be implemented as a stand-alone server or a server cluster composed of a plurality of servers; the user terminal 130 refers to an electronic device capable of watching live broadcast, and the electronic device may be a smart phone, a tablet computer, a notebook computer, a desktop computer, or the like.
Fig. 2 is a flowchart illustrating a method for processing live video according to an exemplary embodiment, where the method for processing live video, as shown in fig. 2, is used in the anchor terminal shown in fig. 1, and includes the following steps:
in step S21, a preset position in the live video is identified.
The live video refers to a video corresponding to the live video recorded on the screen of the main broadcasting terminal, such as a singing live video, a game live video, a dancing live video and the like. The preset position refers to a display position of the notification information in the live video, and generally refers to a position right above the live video, as shown in fig. 3. Of course, other positions may also be referred to, and the present application is not limited in particular.
The notification information refers to information received by an application (such as WeChat, QQ, Taobao, etc.) in the anchor terminal, such as WeChat information, QQ information, short message verification code information, etc.
Specifically, the anchor terminal identifies an image of a preset position in the live video in real time based on an image identification algorithm to determine whether the preset position in the live video displays notification information.
Illustratively, the anchor terminal identifies icons, characters and the like displayed at a preset position in the live video in real time to judge whether the characteristic information of the icons, the characters and the like displayed at the preset position conforms to the characteristic information of the notification type information, and if the characteristic information of the icons, the characters and the like displayed at the preset position conforms to the characteristic information of the notification type information, the anchor terminal confirms that the notification type information is displayed at the preset position in the live video.
In step S22, if it is recognized that notification type information is displayed at the preset position in the live video, desensitizing the notification type information displayed at the preset position in the live video to obtain a desensitized live video.
The desensitization processing refers to a processing mode of performing data deformation on some sensitive information through a data desensitization rule so as to hide or fuzzily process real sensitive information; the data desensitization rules specifically include: data masking, data emulation, critical part replacement, data random replacement, data invalidation, etc. Of course, the anchor terminal may perform, in addition to desensitization processing on the notification type information displayed in the preset position in the live video, blurring processing on the notification type information displayed in the preset position in the live video, where the blurring processing includes mosaic, a frosted layer, or a mode of replacing a display area of the notification type information with a specific graphic, and the specific application is not limited in this application.
Specifically, the anchor terminal matches the feature information displayed in the preset position in the live video with the feature information of the notification type information, and if the matching is successful, it is determined that the notification type information is displayed in the preset position in the live video.
Illustratively, referring to fig. 4(a), the anchor terminal recognizes that a first line in the preset positions in the live video displays an icon and an icon name, a second line displays text information (such as a verification code: 2567), and the matching of the feature information and the feature information of the notification type information is successful, and confirms that the notification type information is displayed in the preset positions in the live video.
Further, the anchor terminal acquires a preset desensitization processing file, and carries out desensitization processing, such as key part replacement and the like, on notification type information displayed in a preset position in the live video according to the preset desensitization processing file to obtain the desensitized live video; the preset desensitization processing file is a desensitization algorithm file capable of automatically desensitizing data. Therefore, the aim of automatically carrying out desensitization processing on the notification information displayed in the live video is fulfilled, and the main broadcasting operation is not needed in the whole process, so that the hiding process of the notification information is simplified, and the hiding efficiency of the notification information is improved.
Exemplarily, referring to fig. 4(b), the anchor terminal performs data invalidation on the text information displayed in the second line in the preset position in the live video, and invalidates the text information into invalid information such as "×", so as to achieve the purpose of hiding the notification information displayed in the preset position in the live video; certainly, the anchor terminal may also perform key part replacement processing on the text information displayed in the second line in the preset position in the live video, for example, perform random replacement processing on the short message verification code "123456" to obtain "FFFFFF", or perform key part replacement processing on the short message verification code "123456" to obtain "1 × 6", and the like. In this way, the notification information displayed in the live video is desensitized in real time, so that the hiding effect of the notification information is better, and the hiding effect of the notification information is improved.
It should be noted that the anchor terminal may also perform desensitization processing on the notification type information displayed at the preset position in the live video through other desensitization processing manners, so as to achieve the purpose of hiding the notification type information displayed at the preset position in the live video, as long as the live video after the desensitization processing is pushed to the user terminal through the server, the user cannot obtain information before the desensitization processing according to the information after the desensitization processing, and the specific application is not limited.
In step S23, the desensitized live video is sent to a server; the server is used for pushing the desensitized live video to the user terminal for playing.
Specifically, the anchor terminal sends the desensitized live video to a corresponding server, such as a live server; after receiving the desensitized live video, the server pushes the desensitized live video to a user terminal according to the pushing time, and plays the desensitized live video through the user terminal; at this time, the user sees the notification-like information after the desensitization process on the live screen, such as fig. 4 (b).
Illustratively, the anchor terminal encodes and encapsulates the desensitized live video to obtain a corresponding video stream, and sends the video stream to a corresponding server; after receiving the video stream, the server pushes the video stream to the user terminal; and the user terminal decodes the video stream to obtain the desensitized live video and plays the desensitized live video.
According to the processing method of the live video, if the fact that the notification information is displayed at the preset position in the live video is recognized, desensitization processing is conducted on the notification information displayed at the preset position in the live video, the live video after desensitization processing is sent to a server, and the live video after desensitization processing is pushed to a user terminal through the server to be played; the method and the device achieve the purpose of automatically desensitizing the notification information displayed in the preset position in the live video, and the whole process does not need anchor operation, thereby simplifying the hiding process of the notification information and further improving the hiding efficiency of the notification information; meanwhile, the notification information displayed in the preset position in the live video is subjected to real-time desensitization treatment, so that the hiding effect of the notification information is better, and the hiding effect of the notification information is improved.
In an exemplary embodiment, step S21 further includes: caching video data of a live video in a preset time period; and identifying a preset position in the live video according to the cached video data.
The preset time period is used to identify the duration of the cached live video, such as 1 second, 300 milliseconds, and the like. Considering that there is a time delay in the process of identifying the preset position in the live video, for example, if the preset position in the live video is identified to display the notification type information after 200 milliseconds, video data of 200 milliseconds of the live video at least needs to be cached; and the process of displaying the notification information has an animation effect, when the first few video frames of the animation are played, the anchor terminal cannot recognize that the notification information is displayed at the preset position in the live video, for example, if the animation effect is 300 milliseconds, video data of the live video of 300 milliseconds at least needs to be cached.
Specifically, the anchor terminal generally caches video data of a live video in a preset time period in a local database, delays the video data for a short time, then pushes the corresponding live video to a corresponding server, and distributes the live video to the user terminal through the server for playing, so that the user sees a delayed live video on a user terminal interface.
Further, after caching video data of the live video in a preset time period in a local database, the anchor terminal identifies a preset position in the live video according to the cached video data so as to identify whether feature information displayed in the preset position in the live video matches with feature information of the notification type information. Therefore, the notification type information displayed in the preset position in the live video can be conveniently recognized subsequently, and desensitization processing can be carried out on the notification type information displayed in the preset position in the live video.
In an exemplary embodiment, as shown in fig. 5, step S21 may further include the following steps:
in step S51, an image of a preset position in the live video is acquired.
Specifically, the anchor terminal acquires a preset candidate frame, and acquires an image of a preset position in a live video according to the preset candidate frame; and the size of the preset candidate frame is matched with the size of the image at the preset position in the live video.
In step S52, image features in the image are extracted.
The image characteristics are used for representing characteristic information of images at preset positions in the live video.
Specifically, the anchor terminal inputs an image at a preset position in a live video into a pre-trained feature extraction model, and extracts image features in the image through the pre-trained feature extraction model; the pre-trained feature extraction model refers to a neural network model capable of extracting image features, such as a convolutional neural network model.
In step S53, if it is recognized that the image feature matches the preset image feature, it is determined that notification type information is displayed at a preset position in the live video; the preset image characteristics are image characteristics corresponding to display images of the notification information in the live video.
Specifically, the anchor terminal matches the extracted image features with preset image features, and if the extracted image features are matched with the preset image features, it is determined that notification type information is displayed at a preset position in a live video; and if the extracted image features are not matched with the preset image features, confirming that the notification information is not displayed at the preset position in the live video.
Exemplarily, referring to fig. 4(a), if the anchor terminal recognizes that an icon displayed at a preset position in the live video matches a preset short message icon, the icon name matches a preset short message icon name, and the text information format matches a preset short message format, it is determined that short message information is displayed at the preset position in the live video. For another example, if the anchor terminal recognizes that the icon displayed at the preset position in the live video matches with the preset WeChat icon, the icon name matches with the preset WeChat icon name, and the text information format matches with the preset WeChat information format, it is determined that the WeChat information is displayed at the preset position in the live video.
According to the technical scheme provided by the embodiment of the disclosure, the preset position in the live video is identified, so that whether the preset position in the live video displays the notification information or not is accurately determined, and the subsequent desensitization treatment of the notification information displayed at the preset position in the live video is facilitated, so that the purpose of hiding the notification information displayed at the preset position in the live video is achieved.
In an exemplary embodiment, step S22 may further include: determining a video frame containing notification type information from a live video; and carrying out desensitization treatment on the notification information displayed in the preset position in the video frame to obtain the desensitized live video.
Each live video is composed of a plurality of video frames, and each video frame in the live video is provided with a corresponding video identifier for identifying the specific position of the video frame in the live video; in an actual scene, the video identifier may refer to a timestamp, a video frame number, and the like.
Specifically, in the process of identifying a preset position in a live video, if it is identified that notification-type information is displayed at the preset position in the live video, the anchor terminal acquires a video identifier, such as a timestamp, corresponding to the live video; inquiring video data cached in a local database according to a video identifier corresponding to a live video, and determining video data of the live video corresponding to the video identifier, such as determining video data of the live video corresponding to the timestamp; determining a video frame containing notification information from the video data of the live video; for example, the anchor terminal obtains a video frame identifier, such as a timestamp, of a video frame including the notification type information, and determines, from video data of a live video, a video frame corresponding to the video frame identifier as the video frame including the notification type information. After the video frame containing the notification information is determined, the anchor terminal may perform desensitization processing, such as data invalidation processing, on the notification information displayed in a preset position in the video frame, so as to obtain a desensitized live video.
In the technical scheme provided by the embodiment of the disclosure, only the video frames containing the notification information in the live video are desensitized, and the entire live video is not required to be desensitized, so that the hiding process of the notification information is simplified, and the hiding efficiency of the notification information is further improved; meanwhile, the notification information displayed in the live video is subjected to real-time desensitization treatment, so that the hiding effect of the notification information is better, and the hiding effect of the notification information is improved.
In an exemplary embodiment, after determining the video frame containing the notification class information, the anchor terminal may further identify an information type of the notification class information; obtaining a desensitization processing file corresponding to the information type; and according to the desensitization processing file, carrying out desensitization processing on the notification type information displayed in the preset position in the video frame to obtain the desensitized live video.
Wherein, the corresponding information types are different for different notification information; for example, the type of the information corresponding to the WeChat information is different from that of the short message information.
Specifically, the anchor terminal matches notification type information displayed at a preset position in a live video with preset notification type information, and if the matching is successful, the information type corresponding to the preset notification type information is used as the information type of the notification type information displayed at the preset position in the live video; inquiring a local database storing desensitization processing files corresponding to a plurality of information types, and acquiring the desensitization processing files corresponding to the information types; and according to the desensitization processing file, carrying out desensitization processing on the notification type information displayed in the preset position in the video frame to obtain the desensitized live video.
According to the technical scheme provided by the embodiment of the disclosure, the corresponding desensitization processing file is obtained according to the information type corresponding to the notification type information; according to the desensitization processing file, the notification type information displayed in the preset position in the video frame is subjected to corresponding desensitization processing, and anchor operation is not needed in the whole process, so that the hiding process of the notification type information is simplified, and the hiding efficiency of the notification type information is improved.
In an exemplary embodiment, desensitizing notification-class information displayed in a preset position in a video frame includes: desensitizing the notification type information displayed in the preset position in the video frame according to a desensitizing algorithm; or, the notification information displayed in the preset position in the video frame is subjected to fuzzy processing.
The desensitization algorithm is a data processing mode for desensitizing data so that the data subjected to desensitization cannot obtain the data before desensitization.
Illustratively, the anchor terminal performs data invalidation processing on the notification class information displayed in the preset position in the video frame according to a desensitization algorithm, and replaces the notification class information with "×", as shown in fig. 4 (b); for another example, the anchor terminal may replace a display area of the notification type information displayed in the preset position in the video frame with a mosaic, a masking layer, or a specific graphic, etc., so as to achieve the purpose of blurring the notification type information displayed in the preset position in the video frame.
According to the technical scheme provided by the embodiment of the disclosure, the notification type information displayed in the preset position in the video frame is desensitized or blurred, so that the purpose of hiding the notification type information displayed in the preset position in the video frame is achieved, and the anchor operation is not required in the whole process, so that the hiding process of the notification type information is simplified, and the hiding efficiency of the notification type information is improved.
In an exemplary embodiment, step S23 may further include: and sending the desensitized live video to a server according to preset pushing time.
The preset push time refers to the time when the anchor terminal sends the live video to the server.
Specifically, the anchor terminal sends the desensitized live video to the server according to preset push time, the server distributes the desensitized live video to the user terminal for playing, and at this time, the user corresponding to the user terminal sees a delayed live picture. Therefore, the push time is preset, so that the fact that the anchor terminal successfully completes desensitization processing on the live video is facilitated.
Fig. 6 is a flowchart illustrating a method for processing live video, which is used in the server shown in fig. 1, according to an exemplary embodiment, and includes the following steps:
in step S61, receiving a desensitized live video sent by the anchor terminal; and the anchor terminal is used for identifying a preset position in the live video, and if the fact that the notification type information is displayed at the preset position in the live video is identified, desensitizing the notification type information displayed at the preset position in the live video to obtain the live video after desensitizing.
In step S62, the desensitized live video is pushed to the user terminal for playing.
The processing method of the live video provided by the embodiment of the disclosure achieves the purpose of automatically desensitizing the notification information displayed in the preset position in the live video, and the whole process does not need anchor operation, so that the hiding process of the notification information is simplified, and the hiding efficiency of the notification information is improved; meanwhile, the notification information displayed in the preset position in the live video is subjected to real-time desensitization treatment, so that the hiding effect of the notification information is better, and the hiding effect of the notification information is improved.
The detailed description of the above steps has been described in detail in the examples of the method and will not be elaborated upon here.
Fig. 7 is a flowchart illustrating a method for processing live video, which is used in the server shown in fig. 1, according to an exemplary embodiment, and includes the following steps:
in step S71, video data of a live video transmitted by the anchor terminal is received.
Specifically, in a screen recording live scene of a user corresponding to a main broadcast terminal, a generated live video is collected through the main broadcast terminal, the live video is subjected to preprocessing, encoding and packaging processing to obtain video data of the live video, the video data of the live video is sent to a corresponding server, and the server receives the video data of the live video.
In step S72, a preset position in the live video is identified according to the video data.
Specifically, the server identifies a preset position in the live video according to the video data to identify whether the feature information displayed in the preset position in the live video matches with the feature information of the notification type information. Therefore, the notification type information displayed in the preset position in the live video can be conveniently recognized subsequently, and desensitization processing can be carried out on the notification type information displayed in the preset position in the live video.
Illustratively, the server acquires an image of a preset position in a live video according to the video data; extracting image features in the image; if the image characteristics are identified to be matched with the preset image characteristics, confirming that the preset position in the live video displays notification information; the preset image characteristics are image characteristics corresponding to display images of the notification information in the live video.
For example, the server acquires a preset candidate frame, and acquires an image of a preset position in a live video according to the preset candidate frame; the size of the preset candidate frame is matched with the size of an image at a preset position in the live video; inputting an image at a preset position in a live video into a pre-trained feature extraction model, and extracting image features in the image through the pre-trained feature extraction model; the pre-trained feature extraction model refers to a neural network model capable of extracting image features, such as a convolutional neural network model; matching the extracted image features with preset image features, and if the extracted image features are matched with the preset image features, confirming that notification information is displayed at a preset position in a live video; and if the extracted image features are not matched with the preset image features, confirming that the notification information is not displayed at the preset position in the live video.
In step S73, if it is recognized that notification type information is displayed at the preset position in the live video, desensitizing the notification type information displayed at the preset position in the live video to obtain a desensitized live video.
Specifically, if the server recognizes that the image features corresponding to the images at the preset positions in the live video are matched with the preset image features, and the preset positions in the live video display notification type information, performing desensitization processing on the notification type information displayed at the preset positions in the live video according to a desensitization algorithm to obtain the desensitized live video; such as data invalidation, random replacement, and key part replacement for notification information displayed in a preset position in the live video.
In addition, when it is recognized that the notification type information is displayed at the preset position in the live video, the server may further perform a blurring process on the notification type information displayed at the preset position in the live video, for example, replace a display area of the notification type information displayed at the preset position in the live video with a mosaic, a masking layer, or a specific graphic, so as to achieve a purpose of blurring the notification type information displayed at the preset position in the live video.
In step S74, the desensitized live video is pushed to the user terminal for playing.
Specifically, the server pushes the desensitized live video to the user terminal, and the desensitized live video is played through the user terminal; at this time, the user sees the notification-like information after the desensitization process on the live screen, such as fig. 4 (b).
According to the processing method of the live video, if the fact that the notification information is displayed at the preset position in the live video is recognized, desensitization processing is conducted on the notification information displayed at the preset position in the live video, and the live video after desensitization processing is pushed to the user terminal to be played; the method and the device achieve the purpose of automatically desensitizing the notification information displayed in the preset position in the live video, and the whole process does not need anchor operation, thereby simplifying the hiding process of the notification information and further improving the hiding efficiency of the notification information; meanwhile, the notification information displayed in the preset position in the live video is subjected to real-time desensitization treatment, so that the hiding effect of the notification information is better, and the hiding effect of the notification information is improved.
Fig. 8 is a block diagram illustrating a processing device of live video in accordance with an exemplary embodiment. Referring to fig. 8, the apparatus includes a video identification module 810, a desensitization processing module 820, and a video transmission module 830.
A video identification module 810 configured to perform identification of a preset position in the live video;
a desensitization processing module 820 configured to perform desensitization processing on notification type information displayed in a preset position in a live video if it is identified that the notification type information is displayed in the preset position in the live video, so as to obtain a desensitized live video;
a video sending module 830 configured to perform sending of the desensitized live video to a server; the server is used for pushing the desensitized live video to the user terminal for playing.
According to the processing device for the live video, provided by the embodiment of the disclosure, if the fact that the notification information is displayed at the preset position in the live video is recognized, desensitization processing is performed on the notification information displayed at the preset position in the live video, the live video after desensitization processing is sent to a server, and the live video after desensitization processing is pushed to a user terminal through the server to be played; the method and the device achieve the purpose of automatically desensitizing the notification information displayed in the preset position in the live video, and the whole process does not need anchor operation, thereby simplifying the hiding process of the notification information and further improving the hiding efficiency of the notification information; meanwhile, the notification information displayed in the preset position in the live video is subjected to real-time desensitization treatment, so that the hiding effect of the notification information is better, and the hiding effect of the notification information is improved.
In an exemplary embodiment, the video identification module 810 is further configured to perform caching of video data of the live video within a preset time period; and identifying a preset position in the live video according to the cached video data.
In an exemplary embodiment, the video identification module 810 is further configured to perform acquiring an image of a preset position in a live video; extracting image features in the image; if the image characteristics are identified to be matched with the preset image characteristics, confirming that the preset position in the live video displays notification information; the preset image characteristics are image characteristics corresponding to display images of the notification information in the live video.
In an exemplary embodiment, the desensitization processing module 820 is further configured to determine a video frame containing notification-type information from the live video; and carrying out desensitization treatment on the notification information displayed in the preset position in the video frame to obtain the desensitized live video.
In an exemplary embodiment, the desensitization processing module 820 is further configured to perform desensitization processing on notification class information displayed in a preset position in a video frame according to a desensitization algorithm; or, the notification information displayed in the preset position in the video frame is subjected to fuzzy processing.
Fig. 9 is a block diagram illustrating a processing device of live video in accordance with an exemplary embodiment. Referring to fig. 9, the apparatus includes a live video receiving module 910 and a live video pushing module 920.
A live video receiving module 910 configured to perform receiving of a desensitized live video sent by a main broadcast terminal; the anchor terminal is used for identifying a preset position in the live video, and if the fact that the notification information is displayed at the preset position in the live video is identified, desensitizing the notification information displayed at the preset position in the live video to obtain the live video after desensitizing;
and the live video pushing module 920 is configured to execute pushing of the desensitized live video to the user terminal for playing.
Fig. 10 is a block diagram illustrating a processing device of live video in accordance with an exemplary embodiment. Referring to fig. 10, the apparatus includes a video data receiving module 1010, a live video recognition module 1020, an information processing module 1030, and a video push module 1040.
A video data receiving module 1010 configured to perform receiving video data of a live video transmitted by a host terminal;
a live video recognition module 1020 configured to perform recognition of a preset position in a live video according to video data;
the information processing module 1030 is configured to perform desensitization processing on notification type information displayed in a preset position in the live video if the notification type information is displayed in the preset position in the live video is identified, so as to obtain a desensitized live video;
and the video pushing module 1040 is configured to push the desensitized live video to the user terminal for playing.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
FIG. 11 is a block diagram illustrating a computer device in accordance with an example embodiment. The computer device may be a main broadcasting terminal, and its internal structure diagram may be as shown in fig. 11. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a method of processing live video. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
FIG. 12 is a block diagram illustrating a computer device according to an example embodiment. The computer device may be a server, and its internal structure diagram may be as shown in fig. 12. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing data such as live video and the like. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method of processing live video.
It will be appreciated by those skilled in the art that the configurations shown in fig. 11 or 12 are block diagrams of only some of the configurations relevant to the present disclosure, and do not constitute a limitation on the computing devices to which the present disclosure may be applied, and that a particular computing device may include more or less components than shown in the figures, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of the above-described method of processing live video. Here, the steps of the processing method of the live video may be steps in the processing method of the live video of the above embodiments.
In one embodiment, a computer readable storage medium is provided, storing a computer program that, when executed by a processor, causes the processor to perform the steps of the above-described live video processing method. Here, the steps of the processing method of the live video may be steps in the processing method of the live video of the above embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (10)

1. A method for processing live video, the method comprising:
identifying a preset position in a live video;
if the fact that notification type information is displayed at a preset position in the live video is recognized, desensitizing the notification type information displayed at the preset position in the live video to obtain a desensitized live video;
sending the desensitized live video to a server; and the server is used for pushing the desensitized live video to a user terminal for playing.
2. The method of claim 1, wherein the identifying the preset position in the live video comprises:
caching video data of the live video in a preset time period;
and identifying a preset position in the live video according to the cached video data.
3. The method according to claim 1 or 2, wherein the identifying the preset position in the live video comprises:
acquiring an image of a preset position in the live video;
extracting image features in the image;
if the image features are identified to be matched with preset image features, confirming that the preset position in the live video displays notification information; the preset image characteristics are image characteristics corresponding to display images of the notification information in the live video.
4. The method according to claim 1, wherein the desensitizing the notification type information displayed in the preset position in the live video to obtain a desensitized live video includes:
determining a video frame containing the notification type information from the live video;
and desensitizing the notification type information displayed in the preset position in the video frame to obtain a desensitized live video.
5. The method according to claim 4, wherein the desensitizing the notification class information displayed in the preset position in the video frame comprises:
desensitizing the notification type information displayed in the preset position in the video frame according to a desensitizing algorithm;
or the like, or, alternatively,
and carrying out fuzzy processing on the notification information displayed in the preset position in the video frame.
6. A method for processing live video, the method comprising:
receiving a desensitized live video sent by a main broadcasting terminal; the anchor terminal is used for identifying a preset position in the live video, and if the fact that notification type information is displayed at the preset position in the live video is identified, desensitizing the notification type information displayed at the preset position in the live video to obtain the live video after desensitizing;
and pushing the desensitized live video to a user terminal for playing.
7. A method for processing live video, the method comprising:
receiving video data of a live video sent by a main broadcasting terminal;
according to the video data, recognizing a preset position in the live video;
if the fact that notification type information is displayed at a preset position in the live video is recognized, desensitizing the notification type information displayed at the preset position in the live video to obtain a desensitized live video;
and pushing the desensitized live video to a user terminal for playing.
8. An apparatus for processing live video, the apparatus comprising:
a video identification module configured to perform identification of a preset position in a live video;
the desensitization processing module is configured to perform desensitization processing on notification type information displayed in a preset position in the live video if the notification type information is displayed in the preset position in the live video is identified, so as to obtain a desensitized live video;
a video sending module configured to send the desensitized live video to a server; and the server is used for pushing the desensitized live video to a user terminal for playing.
9. An apparatus for processing live video, the apparatus comprising:
the live video receiving module is configured to execute receiving of the desensitized live video sent by the anchor terminal; the anchor terminal is used for identifying a preset position in the live video, and if the fact that notification type information is displayed at the preset position in the live video is identified, desensitizing the notification type information displayed at the preset position in the live video to obtain the live video after desensitizing;
and the live video pushing module is configured to execute pushing of the desensitized live video to a user terminal for playing.
10. An apparatus for processing live video, the apparatus comprising:
the video data receiving module is configured to execute receiving of video data of live video sent by the anchor terminal;
the live video identification module is configured to identify a preset position in the live video according to the video data;
the information processing module is configured to perform desensitization processing on the notification type information displayed in the preset position in the live video if the notification type information is displayed in the preset position in the live video, so as to obtain a desensitized live video;
and the video pushing module is configured to push the desensitized live video to a user terminal for playing.
CN201911377328.4A 2019-12-27 2019-12-27 Live video processing method and device Pending CN111107385A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911377328.4A CN111107385A (en) 2019-12-27 2019-12-27 Live video processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911377328.4A CN111107385A (en) 2019-12-27 2019-12-27 Live video processing method and device

Publications (1)

Publication Number Publication Date
CN111107385A true CN111107385A (en) 2020-05-05

Family

ID=70424056

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911377328.4A Pending CN111107385A (en) 2019-12-27 2019-12-27 Live video processing method and device

Country Status (1)

Country Link
CN (1) CN111107385A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022105341A1 (en) * 2020-11-18 2022-05-27 北京达佳互联信息技术有限公司 Video data processing method and apparatus, computer storage medium, and electronic device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160261927A1 (en) * 2013-10-09 2016-09-08 Disney Enterprises, Inc. Method and System for Providing and Displaying Optional Overlays
CN107948666A (en) * 2017-11-28 2018-04-20 北京潘达互娱科技有限公司 Internet video live broadcasting method, device, electronic equipment and computer-readable storage medium
CN108124173A (en) * 2017-12-11 2018-06-05 深圳创维-Rgb电子有限公司 A kind of one-to-many throw shields display methods, system and storage medium
CN108235054A (en) * 2017-12-15 2018-06-29 北京奇虎科技有限公司 A kind for the treatment of method and apparatus of live video data
CN109672908A (en) * 2018-12-27 2019-04-23 北京潘达互娱科技有限公司 A kind of method for protecting privacy, device and mobile terminal
US20190149852A1 (en) * 2016-07-15 2019-05-16 Tencent Technology (Shenzhen) Company Limited Live broadcasting method, method for presenting live broadcasting data stream, and terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160261927A1 (en) * 2013-10-09 2016-09-08 Disney Enterprises, Inc. Method and System for Providing and Displaying Optional Overlays
US20190149852A1 (en) * 2016-07-15 2019-05-16 Tencent Technology (Shenzhen) Company Limited Live broadcasting method, method for presenting live broadcasting data stream, and terminal
CN107948666A (en) * 2017-11-28 2018-04-20 北京潘达互娱科技有限公司 Internet video live broadcasting method, device, electronic equipment and computer-readable storage medium
CN108124173A (en) * 2017-12-11 2018-06-05 深圳创维-Rgb电子有限公司 A kind of one-to-many throw shields display methods, system and storage medium
CN108235054A (en) * 2017-12-15 2018-06-29 北京奇虎科技有限公司 A kind for the treatment of method and apparatus of live video data
CN109672908A (en) * 2018-12-27 2019-04-23 北京潘达互娱科技有限公司 A kind of method for protecting privacy, device and mobile terminal

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022105341A1 (en) * 2020-11-18 2022-05-27 北京达佳互联信息技术有限公司 Video data processing method and apparatus, computer storage medium, and electronic device

Similar Documents

Publication Publication Date Title
CN111669612B (en) Live broadcast-based information delivery method and device and computer-readable storage medium
CN111954052B (en) Method for displaying bullet screen information, computer equipment and readable storage medium
CN109660823A (en) Video distribution method, apparatus, electronic equipment and storage medium
CN109992237B (en) Intelligent voice equipment control method and device, computer equipment and storage medium
US11087140B2 (en) Information generating method and apparatus applied to terminal device
CN109309842B (en) Live broadcast data processing method and device, computer equipment and storage medium
CN111954060B (en) Barrage mask rendering method, computer device and readable storage medium
CN108171160B (en) Task result identification method and device, storage medium and electronic equipment
CN107733769B (en) Method and device for displaying user information
CN112153582B (en) Verification code short message display method and device
CN110166795A (en) A kind of video interception method and device
CN112839223A (en) Image compression method, image compression device, storage medium and electronic equipment
CN110909241B (en) Information recommendation method, user identification recommendation method, device and equipment
CN113014934A (en) Product display method, product display device, computer equipment and storage medium
CN112307464A (en) Fraud identification method and device and electronic equipment
CN113407436A (en) Play component compatibility detection method and device, computer equipment and storage medium
CN113727039B (en) Video generation method and device, electronic equipment and storage medium
CN114157568A (en) Browser security access method, device, equipment and storage medium
CN111107385A (en) Live video processing method and device
CN111526380B (en) Video processing method, video processing device, server, electronic equipment and storage medium
CN112328895A (en) User portrait generation method, device, server and storage medium
CN115526772B (en) Video processing method, device, equipment and storage medium
CN111866573B (en) Video playing method and device, electronic equipment and storage medium
CN114827735A (en) Video review method, device, equipment and storage medium
CN111954081B (en) Method for acquiring mask data, computer device and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200505