CN108449627B - Video processing method, video source identification method, video processing device, video source identification device and video source identification medium - Google Patents

Video processing method, video source identification method, video processing device, video source identification device and video source identification medium Download PDF

Info

Publication number
CN108449627B
CN108449627B CN201810220768.8A CN201810220768A CN108449627B CN 108449627 B CN108449627 B CN 108449627B CN 201810220768 A CN201810220768 A CN 201810220768A CN 108449627 B CN108449627 B CN 108449627B
Authority
CN
China
Prior art keywords
source information
target pixel
video frame
determining
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810220768.8A
Other languages
Chinese (zh)
Other versions
CN108449627A (en
Inventor
章勋
张文超
应加宽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Vision World Technology Co ltd
Original Assignee
Beijing Vision World Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Vision World Technology Co ltd filed Critical Beijing Vision World Technology Co ltd
Priority to CN201810220768.8A priority Critical patent/CN108449627B/en
Publication of CN108449627A publication Critical patent/CN108449627A/en
Application granted granted Critical
Publication of CN108449627B publication Critical patent/CN108449627B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H04N21/4351—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream involving reassembling additional data, e.g. rebuilding an executable program from recovered modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched

Abstract

The invention discloses a video processing method and a corresponding device. The method comprises the following steps: the method comprises the steps of acquiring source information of stream data, determining a target pixel for displaying the source information in a video frame of the stream data, and adding the source information in the video frame by adjusting the target pixel. In the method, the source information can be identified on the video frame by the target pixel, and after the illegal video is diffused in the network, the source of the video can be identified according to the video frame or the screenshot of the video frame and the like, so that the illegal action is processed, and the problem that the source cannot be positioned after the video or the screenshot of the video is spread is solved.

Description

Video processing method, video source identification method, video processing device, video source identification device and video source identification medium
Technical Field
The present invention relates to the field of video processing technologies, and in particular, to a video processing method, a video source identification method, a video processing apparatus, a video source identification apparatus, an electronic device, and a computer-readable storage medium.
Background
The stream data is data which can be transmitted on the network by adopting a streaming transmission mode, and can be applied to the fields of video live broadcast, network monitoring and the like. With the development of network applications such as live video or remote cameras, the supervision of video content becomes more difficult.
When the live broadcast equipment is used for live broadcasting illegal contents by a user, the influence on a video live broadcast platform is great, and the identity of the user who broadcasts the illegal contents is difficult to find after the phenomenon occurs.
Especially, when a live video or a screenshot of a video is transmitted to a social media or a website through other network approaches, or a reporter records an obtained video or an intercepted screenshot of the video, it is difficult to find a source of the recorded or first uploaded illegal video content, and then it is difficult to further process an illegal user.
Disclosure of Invention
In view of the above problems, the present invention has been made to provide a video processing method, a video source identification method, a video processing method, a video source identification apparatus, an electronic device, and a computer-readable storage medium that overcome or at least partially solve the above problems.
According to an aspect of the present invention, there is provided a video processing method including: acquiring source information of stream data; determining a target pixel in a video frame of the streaming data to display the source information; adding the source information in the video frame by adjusting the target pixel.
According to another aspect of the present invention, there is provided a method for identifying a video source, including: acquiring a video frame displaying source information of stream data; identifying a target pixel in the video frame, the target pixel to display the source information in a video frame of the streaming data; determining the source information displayed by the target pixel.
According to another aspect of the present invention, there is provided a video processing apparatus including:
the information acquisition module is used for acquiring source information of the streaming data;
a target pixel determination module to determine a target pixel in a video frame of the streaming data to display the source information;
a pixel adjustment module, configured to add the source information to the video frame by adjusting the target pixel.
According to another aspect of the present invention, there is provided an apparatus for identifying a video source, including:
the video frame acquisition module is used for acquiring a video frame for displaying source information of the stream data;
a target pixel identification module to identify a target pixel in the video frame, the target pixel to display the source information in a video frame of the streaming data;
and the source information determining module is used for determining the source information displayed by the target pixel.
According to another aspect of the present invention, there is provided an electronic apparatus including: a processor; and a memory configured to store computer-executable instructions that, when executed, cause the electronic device to perform a video processing method, a method of identifying a video source according to the above.
According to another aspect of the present invention, there is provided a computer-readable storage medium storing one or more programs which, when executed by an electronic device, cause the electronic device to perform a video processing method, a video source identification method according to the above.
According to the video processing method and the corresponding device, the source information of the streaming data is obtained, the target pixel displaying the source information in the video frame of the streaming data is determined, the source information can be identified on the video frame by adjusting the target pixel and adding the source information in the video frame, and after the illegal video is diffused in a network, the source of the video can be identified according to the screenshot of the video frame or the video frame, so that the illegal behavior can be processed, and the problem that the source cannot be positioned after the video or the video screenshot is transmitted is solved.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a schematic flow chart illustrating steps of a video processing method according to a first embodiment of the present invention;
fig. 2 is a flow chart illustrating steps of a video processing method according to a second embodiment of the present invention;
fig. 3 is a flowchart illustrating steps of a video source identification method according to a third embodiment of the present invention;
fig. 4 is a block diagram showing a schematic configuration of a video processing apparatus according to a fourth embodiment of the present invention;
fig. 5 is a schematic block diagram of a video source identification apparatus according to a fifth embodiment of the present invention;
FIG. 6 schematically illustrates a block diagram for executing a computing device in accordance with the present invention; and
fig. 7 schematically shows a storage unit for holding or carrying program code implementing the method according to the invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Referring to fig. 1, a schematic flowchart illustrating a step flow of a video processing method according to a first embodiment of the present invention may specifically include the following steps:
step 101, obtaining source information of stream data.
In the embodiment of the present invention, the streaming data is data that can be transmitted over a network in a streaming manner, for example, in a live video application or a remote camera application, video streaming data is transmitted between transmission nodes in a streaming manner. The source information of the stream data includes identification information and address information of a device that generates the stream data, stream data provider information, and the like, for example, a device identification of a recording device of the video stream data, a network address of the recording device of the video stream data, a network account registered on the recording device of the video stream data, and the like, or any other suitable information indicating a source of the stream data, which is not limited in this embodiment of the present invention.
In a specific implementation, streaming data is transmitted from a client that records a video to a client that plays the video via one or more servers. The client that plays the video may actively request the source information of the streaming data from the server before playing the video, or the client that records the video actively sends the source information to the client that plays the video, or any other suitable manner may obtain the source information.
The application scenes of the stream data processing comprise a live video application scene and a remote camera application scene, and specifically, in the live video application scene, a live video client can acquire source information of recorded video stream data and further process the source information to add in a video frame when a video is played; in a remote camera application scenario, a client of a remote camera may obtain source information of recorded video stream data, and add the source information to a video frame through further processing when playing a video.
Step 102, determining a target pixel in a video frame of the stream data for displaying the source information.
In an embodiment of the invention, the video is composed of a plurality of still pictures, i.e. video frames. A plurality of video frames are packaged to obtain stream data, and then the stream data is analyzed to obtain a plurality of video frames.
In the embodiment of the present invention, a part of pixels in a video frame is adjusted to display source information in the video frame, and the pixels for displaying the source information are marked as target pixels.
In this embodiment of the present invention, the determined target pixel may be in any position in the video frame, for example, in a lower right corner area of the video frame, or in a set area in the video frame, or in any other suitable position, which is not limited in this embodiment of the present invention.
In this embodiment of the present invention, the source information may be represented by a shape formed by the target pixel, or by an attribute value of the target pixel, or by any other suitable manner, which is not limited in this embodiment of the present invention. The attribute value of the pixel includes a gray value, an RGB channel value, a YUV value, or any other applicable attribute value, which is not limited in this embodiment of the present invention.
For example, the source information is the device number "SX 1923" of the image pickup device, and it is possible to determine a plurality of pixels forming a character shape of "SX 1923" as target pixels in the lower right corner area of the video frame, or determine 6 or more pixels as target pixels in the lower right corner area of the video frame with "SX 1923" as one hexadecimal data, and then adjust the attribute value of the target pixels to represent one-bit hexadecimal data with the attribute values of 1 or more target pixels.
In the embodiment of the present invention, the coordinates of the target pixel are determined in the video frame according to the way in which the target pixel represents the source information, in one implementation, the coordinates of the target pixel forming the character shape are determined in the video frame according to the character shape corresponding to the source information, in another implementation, the coordinates of the target pixel are determined according to the set shape, for example, the coordinates of the target pixel are determined according to a square in the range of the number of the target pixel in the lower right corner of the video frame, and specifically, any other suitable way may also be included to determine the target pixel.
Step 103, adding the source information in the video frame by adjusting the target pixel.
In the embodiment of the invention, after the target pixel is determined, the target pixel is adjusted, so that the source information is added into the video frame, and the mode of adjusting the target pixel can be in various modes.
In an implementation manner, when the source information is represented by a shape formed by the target pixels, the target pixels are uniformly adjusted to be the same, or at least one attribute value of the target pixels is adjusted, or any other suitable manner, which is not limited in this embodiment of the present invention. For example, the target pixels are all adjusted to white, or the R (red) value in the RGB color space of the target pixels is adjusted to 255. The adjusted target pixel can be identified, and then the shape formed by the target pixel is obtained.
In another implementation, the source information is represented by the attribute value of the target pixel, and the attribute value of the target pixel is adjusted to the agreed attribute value according to the attribute value corresponding to each character in the source information agreed in advance. For example, if a set of RGB values (R value 255, G value 250, and B value 240) is appointed to represent the number "5", and another set of RGB values (R value 250, G value 240, and B value 230) is appointed to represent the letter "G", then the two destination pixels corresponding to the character "5G" in the source information are adjusted to the corresponding RGB values according to the appointment. The adjusted target pixel can be identified, then the attribute value of the target pixel is obtained, and each character in the source information is obtained according to the attribute value corresponding to each appointed character.
According to the video processing method, the source information of the streaming data is obtained, the target pixel for displaying the source information in the video frame of the streaming data is determined, the source information can be identified on the video frame by adjusting the target pixel and adding the source information in the video frame, and after the illegal video is diffused in a network, the source of the video can be identified according to screenshots and the like of the video frame or the video frame, so that illegal behaviors can be processed, and the problem that the source cannot be positioned after the video or the screenshot of the video is spread is solved.
In the embodiment of the present invention, it is preferable that the target pixel satisfies an identification requirement determined in accordance with a minimum recognizable area of the human eye and a minimum recognizable area of the identification device.
In order to reduce the display effect of the original video frame as much as possible, that is, reduce the influence on the video playback effect after the source information is displayed in the video frame, it is necessary to make the target pixel satisfy the identification requirement in the video frame.
Specifically, the identification requirement includes that the occupied area of a plurality of target pixels in the video frame is within a set area range, the number of the target pixels is within a set number range, the size of the area occupied by the plurality of target pixels is within a set size range, and the like, so that the occupied area or the number or the size of the target pixels in the video frame cannot be too large, the display effect of the video frame is affected, and the target pixels can be identified.
For example, in one implementation, since the video frame resolution refers to the number of pixels contained in a unit inch, the area of each pixel can be calculated based on the video frame resolution. For example, if the resolution is 72dpi, i.e., 72 pixels per inch, then 1/72 inches per pixel. The occupied area can be obtained by dividing the number of the target pixels by the resolution of the video frame, and the occupied area needs to meet the identification requirement, namely the occupied area is required to be within a set range, so that the determined number of the target pixels is required to be smaller than the product of the maximum value of the set range of the occupied area and the resolution and larger than the product of the minimum value of the set range of the occupied area and the resolution.
The minimum recognizable area of the human eye may be determined by taking an average value of the minimum recognizable areas, or taking a maximum value of the minimum recognizable areas, or any other suitable manner according to test data for human eye recognition under various areas, which is not limited in the embodiment of the present invention. The upper limit of the occupied area is the minimum recognizable area of human eyes, so that after the target pixels are adjusted in the video frames, the human eyes cannot or are difficult to observe the adjustment, and the influence on the video playing effect is reduced.
The identification device refers to a device that can identify a target pixel in a video or a picture, for example, a smart phone, a server that identifies a video, or any other suitable device, which is not limited in this embodiment of the present invention. The minimum recognizable area of the recognition device may be determined by taking an average value of the minimum recognizable areas, or taking a maximum value of the minimum recognizable areas, or any other suitable manner according to test data recognized by the recognition device under various areas, which is not limited in the embodiment of the present invention. The lower limit of the occupied area is the minimum recognizable area of the recognition device, so that after the target pixel is adjusted in the video frame, the recognition device can recognize the adjustment of the target pixel.
In this embodiment of the present invention, preferably, the determining a target pixel used for displaying the source information in a video frame of the stream data includes: and determining a character shape corresponding to the source information, and determining a target pixel forming the character shape in the video frame.
The corresponding character shape is set according to the type of the displayed symbol, and the character shape is used to represent various characters in the source information, such as numbers, letters, and the like, or any other suitable characters, which is not limited in this embodiment of the present invention. And determining a corresponding character shape according to the source information, and determining a target pixel which can form the character shape in the video frame. For example, the source information is the device number "LX 2018" of the image pickup device, and in the upper left corner area in the video frame, pixels whose number of character shapes forming "LX 2018" is less than 50 are determined as the target pixels.
In this embodiment of the present invention, preferably, the adding the source information in the video frame by adjusting the target pixel includes: and adjusting at least one attribute value of a target pixel in the video frame.
When the attribute value of the target pixel is adjusted, different types of attribute values may be adjusted for different target pixels, or the same type of attribute value may also be adjusted, and the adjustment range of the attribute values may be the same or different, the attribute value may be adjusted to a set value, the original attribute value may also be increased or decreased, or the attribute value may be adjusted in any other suitable manner, which is not limited in this embodiment of the present invention.
In this embodiment of the present invention, preferably, the adjusting at least one attribute value of a target pixel in the video frame includes: determining correction data of the attribute value of the target pixel in the video frame according to the attribute value of the target pixel in the video frame; and adjusting the attribute value of the target pixel according to the correction data.
The correction data is used to adjust the attribute value, and the adjusted attribute value can be determined by combining the original attribute value of the target pixel and the correction data, and for example, if the correction data for the R value is "+ 100", the original R value of the target pixel is added to 100 to be the adjusted R value.
The correction data may be determined according to the attribute value of the target pixel, and specifically, the type of the attribute value to which the correction data is directed may be determined according to the size of various attribute values of the target pixel, and the adjustment range of the correction data for the attribute value, for example, the attribute value RGB value of the target pixel is (R value 255, G value 250, B value 240), since the R value 255 is already the maximum value, the correction data for the R value may be determined to be "-100", and the other two attribute values may not be adjusted.
In the embodiment of the present invention, preferably, before the determining the target pixel used for displaying the source information in the video frame of the stream data, the method further includes: and determining the number of target pixels according to the resolution of the video frame and the information content of the source information.
The video frame resolution is the number of pixels contained in a unit inch, so the area of each pixel can be calculated from the video frame resolution. For example, if the resolution is 72dpi, i.e., 72 pixels per inch, then 1/72 inches per pixel. The information amount is a measure of the source information, including the number of characters in the source information. The number of target pixels required to display the source information is not necessary, for example, three target pixels may be used to represent the number "one" and five target pixels may also be used to represent the number "one". The upper limit and the lower limit of the number of the target pixels are in proportion to the resolution of the video frame and the information amount of the source information, and the number of the target pixels can be determined according to the resolution of the video frame and the information amount of the source information.
In this embodiment of the present invention, preferably, the obtaining source information of the streaming data includes: and acquiring the required source information according to the service type and/or the playing time of the stream data. The service type includes a live video application, a remote camera application, and the like, and refers to a type of service for which stream data is used. The play time refers to the time when the stream data is played on the play client. The source information to be acquired is different under different service types or different playing time. For example, in a live video application service, the source information includes an equipment identifier of a client that records streaming data and a network account number that uploads the streaming data, and in a remote camera application, the source information includes an equipment identifier of a camera that records the streaming data.
In this embodiment of the present invention, preferably, the adding the source information in the video frame by adjusting the target pixel includes: and adjusting the attribute value of the target pixel within a preset adjustment range, wherein the preset adjustment range is determined according to the minimum recognizable difference value of human eyes and the minimum recognizable difference value of the recognition equipment.
When the attribute value of the target pixel is adjusted, the adjustment needs to be performed within a preset adjustment range, so that after the target pixel is adjusted in a video frame, human eyes cannot or hardly observe the adjustment, the influence on the video playing effect is reduced, and the identification device can identify the adjustment of the target pixel.
The minimum recognizable difference value of the human eye refers to the minimum recognizable difference value before and after the adjustment of the attribute value that can be recognized by the human eye, and specifically, the minimum recognizable difference value of the human eye can be determined by taking the average value of the minimum recognizable difference values, or taking the maximum value of the minimum recognizable difference values, or any other suitable manner according to the test data recognized by the human eye under the difference values before and after the adjustment of the attribute values with different sizes.
The identification device refers to a device that can identify a target pixel in a video or a picture, for example, a smart phone, a server that identifies a video, or any other suitable device, which is not limited in this embodiment of the present invention. The minimum recognizable difference value of the identification device refers to the minimum recognizable difference value before and after the adjustment of the attribute value that can be recognized by the identification device, and specifically, the minimum recognizable difference value of the identification device may be determined by taking the average value of the minimum recognizable difference values, or taking the maximum value of the minimum recognizable difference values, or by any other suitable method, according to the test data recognized by the identification device, under the difference values before and after the adjustment of the attribute values of different sizes.
In this embodiment of the present invention, preferably, after the obtaining of the source information of the streaming data, the method includes: and encoding the source information.
The encoding process includes encoding the source information according to an agreed manner, and specifically, the source information may be encoded according to the agreed manner by converting the source information into binary data, octal data, hexadecimal data, or any other suitable manner, which is not limited in this embodiment of the present invention.
In the embodiment of the present invention, preferably, the source information includes at least one of identification information of the stream data generation device, address information of the stream data generation device, and stream data provider information.
The stream data generation device refers to a device that generates stream data, the identification information includes a name, a number, a factory number, and the like of the device, and the address information includes an IP address, a physical address, and the like. The streaming data provider information refers to information of a person who provides streaming data in a service of the streaming data, for example, a name, an address, a unit, a telephone, a gender, and the like of a person corresponding to a network account number providing the streaming data in a live video platform, or any other suitable information, which is not limited in this embodiment of the present invention.
Although the video processing process is described in the above embodiments, the apparatus/device for processing video to add source information is not limited to this example, and those skilled in the art should understand that the addition of source information can be implemented by a recording end, a service end, a playing end or an additional apparatus, and the corresponding embodiments should also be covered by the scope of the present invention.
Referring to fig. 2, a schematic flow chart illustrating steps of a video processing method according to a second embodiment of the present invention is shown, which may specifically include the following steps:
step 201, obtaining source information of the stream data.
In the embodiment of the present invention, the implementation manner of this step may refer to the description in the foregoing embodiment, and details are not described herein.
Step 202, determining the number and position of target pixels displaying the source information according to a preset encoding rule.
In this embodiment of the present invention, the preset encoding rule may include a rule about the number and the position of the target pixel, a rule about the corresponding sequence between the source information and the plurality of target pixels, a rule about the position of the target pixel in the preset position, or any other applicable rule, which is not limited in this embodiment of the present invention. For example, the preset encoding rule includes that the target pixel is located in a 10-by-10 pixel region in the lower right corner of the video frame, each character in the source information is represented by 3 target pixels, and the like.
In the embodiment of the invention, according to the preset encoding rule and the source information, the number of target pixels displaying the source information in the video frame and the position of the target pixels in the video frame can be determined.
In the embodiment of the present invention, preferably, the preset encoding rule includes a corresponding order between the source information and a plurality of target pixels, or a position of the target pixel in a preset position.
The corresponding sequence of the source information and the target pixels comprises a plurality of target pixels which sequentially represent the source information, a plurality of target pixels which reversely represent the source information or a set sequence which represents the source information. For example, the source information is a device number "SX 1923" of the image pickup device, one character is identified by one target pixel, 6 target pixels are required to represent the source information, 6 pixels adjacent from left to right in the lower right corner of the video frame are determined as target pixels according to a preset encoding rule, the corresponding sequence of the device number "SX 1923" and the 6 target pixels may be determined as that the 1 st target pixel from left to right represents a character "S", the 2 nd target pixel represents a character "1", the 3 rd target pixel represents a character "2", the 4 th target pixel represents a character "X", the 5 th target pixel represents a character "9", and the 6 th target pixel represents a character "3", that is, the preset encoding rule is agreed to represent the source information in an interval sequence.
The positions of the target pixels in the preset positions include pixels of partial positions among pixels in the preset positions of the video frame, and the other pixels in the preset positions are not used as target pixels and are not used for representing source information. Similarly, the position of another pixel that is not the target pixel in the preset position may be defined in the preset encoding rule, which corresponds to the position of the target pixel in the preset position being defined in reverse. For example, the preset encoding rule specifies that, in a preset 10-by-10 pixel position in the lower right corner of the video frame, one pixel is selected as a target pixel every 2 pixels, and the other pixels are not selected as target pixels.
Step 203, determine a first adjustment value of each target pixel corresponding to the source information.
In this embodiment of the present invention, the source information may be represented by an adjusted attribute value of the target pixel, or represented by an arrangement of attribute values of a plurality of target pixels, or represented in any other suitable manner, which is not limited in this embodiment of the present invention. For example, the letter "a" is represented by an R value of "255", or the number "0" is represented by a white target pixel, and the number "1" is represented by a black target pixel, or the letter "B" is represented by three target pixels of R values arranged as "255", "0", "255".
In the embodiment of the present invention, the first adjustment value is used to represent source information, and the first adjustment value of each target pixel may be determined according to the source information.
Step 204, adjusting the attribute value of the target pixel in the video frame to a first adjustment value.
In the embodiment of the invention, the source information is added to the video frame by adjusting the attribute value of the target pixel in the video frame to the first adjustment value.
In this embodiment of the present invention, preferably, the target pixel includes a rule identification pixel, and the determining the target pixel used for displaying the source information in the video frame of the stream data further includes: and determining rule identification pixels of the adopted preset coding rules identified in the video frames. The rule identification pixel is used for identifying the adopted preset coding rule, the preset coding rule may include a plurality of types, and the adopted preset coding rule may be identified by the rule identification pixel, for example, the preset coding rule includes two types, which are respectively numbered 1 and 2, so that the preset coding rule with the pixel identification number of 1 may be identified by a white rule, and the preset coding rule with the pixel identification number of 2 may be identified by a black rule. Specifically, any suitable manner may be adopted, and the rule identification pixel identifier is used to preset the encoding rule, which is not limited in the embodiment of the present invention.
Determining the target pixel in the video frame may include determining a rule-identifying pixel, for example, the target pixel is 7 pixels from left to right, the 7 th pixel from left to right is determined as the rule-identifying pixel, or the target pixel is a pixel adjacent to 5 rows and 5 columns, and the 5 th pixel is determined as the rule-identifying pixel.
Correspondingly, the adding the source information to the video frame by adjusting the target pixel further includes: determining a second adjustment value of the rule identification pixel corresponding to the preset coding rule; and adjusting the attribute value of the rule identification pixel in the video frame to be a second adjustment value.
And the second adjusting value of the rule identification pixel is used for expressing a preset coding rule, determining the second adjusting value of the rule identification pixel according to whether the preset coding rule is adopted or not, and then adjusting the attribute value of the rule identification pixel in the video frame to be the second adjusting value.
According to the video processing method, the source information of the streaming data is obtained, the number and the position of the target pixels for displaying the source information are determined according to the preset coding rule, the first adjusting value of the target pixels corresponding to the source information is determined, the attribute value of the target pixels in the video frame is adjusted to be the first adjusting value, the source information is added into the video frame, the source information can be identified on the video frame, after the illegal video is diffused in a network, the source of the video can be identified according to the screenshot of the video frame or the video frame, so that the illegal behavior can be processed, and the problem that the source cannot be located after the video or the video screenshot is spread is solved.
Referring to fig. 3, a schematic flow chart illustrating steps of a video source identification method according to a third embodiment of the present invention is shown, which may specifically include the following steps:
step 301, a video frame showing source information of stream data is obtained.
In the embodiment of the present invention, the video frame displaying the source information of the stream data may be obtained from a video, or may be a screenshot of a video obtained from a network, or obtained in any other suitable manner, which is not limited in this embodiment of the present invention. For example, a user submits a video screenshot through a report portal, and the server obtains the submitted video frame.
Step 302, identify a target pixel in the video frame.
In an embodiment of the invention, the target pixel is used to display the source information in a video frame of the streaming data. The method for identifying the target pixel may be multiple, and includes identifying a pixel that is adjusted according to at least one attribute value in the video frame as the target pixel, or acquiring an attribute value of a pixel at a preset position in the video frame, and determining the target pixel that is adjusted according to the attribute value of the pixel at the preset position, or identifying a pixel that is adjusted to a first adjustment value according to the attribute value of the pixel at the preset position as the target pixel, or any other suitable identification method, which is not limited in this embodiment of the present invention.
Step 303, determining the source information displayed by the target pixel.
In embodiments of the present invention, the source information displayed may be determined based on the target pixel. The method for determining the source information corresponds to a method for adding the source information to the video frame, and may include multiple methods, including determining the corresponding source information according to a character shape formed by the target pixel, or determining the corresponding source information according to the first adjustment value of the target pixel, or determining the source information in any other suitable method.
According to the method for identifying the video source, the video frame for displaying the source information of the streaming data is obtained, the target pixel in the video frame is identified, the source information displayed by the target pixel is determined, the target pixel is used for displaying the source information in the video frame of the streaming data, the source information can be identified on the video frame, after the illegal video is diffused in the network, the source of the video can be identified according to the screenshot of the video frame or the video frame, so that the illegal behavior can be processed, and the problem that the source cannot be located after the video or the video screenshot is spread is solved.
In this embodiment of the present invention, preferably, the determining the source information displayed by the target pixel includes: determining a character shape formed by the target pixel; and determining source information corresponding to the character shape. And determining the formed character shape according to the target pixel, and determining corresponding source information according to the character shape. For example, the character shape formed by a plurality of target pixels is "SX 2018", and the corresponding determined source information is "SX 2018".
In this embodiment of the present invention, preferably, the identifying the target pixel in the video frame includes: and identifying a target pixel in the video frame, wherein at least one attribute value is adjusted. The method includes acquiring attribute values of all or part of pixels in a video frame, identifying a pixel having an attribute value exceeding a set difference value with an adjacent pixel by comparing, and determining the identified pixel as a target pixel with an adjusted attribute value, or determining a pixel with an attribute value being a set first adjustment value, or determining the identified pixel as a target pixel with an adjusted attribute value, or any other suitable manner, which is not limited in this embodiment of the present invention.
In this embodiment of the present invention, preferably, the identifying a target pixel in the video frame for which at least one attribute value is adjusted includes: acquiring an attribute value of a pixel at a preset position in the video frame; and determining a target pixel with the adjusted attribute value according to the attribute value of the pixel at the preset position.
The position area where the target pixel is located is predetermined and is marked as a preset position. The method includes obtaining an attribute value of a pixel at a preset position, determining a pixel with an attribute value exceeding a set difference value as a target pixel with an adjusted attribute value by comparing pixels with adjacent pixels, or determining a pixel with an attribute value being a set first adjustment value as a target pixel with an adjusted attribute value, or any other suitable manner, which is not limited in this embodiment of the present invention.
In this embodiment of the present invention, preferably, the identifying the target pixel in the video frame includes: and identifying a target pixel of the video frame, wherein the attribute value is adjusted to a first adjustment value. And searching pixels with attribute values of the first adjustment values in the video frames, and identifying the pixels as target pixels.
In this embodiment of the present invention, preferably, the determining the source information displayed by the target pixel includes: and determining the source information according to the first adjusting value of the target pixel.
The source information may be represented by the first adjustment value of the adjusted target pixel, or by an arrangement of the first adjustment values of a plurality of target pixels, or by any other suitable manner, which is not limited in this embodiment of the present invention. For example, the letter "a" is represented by an R value of "255", or the number "0" is represented by a white target pixel, and the number "1" is represented by a black target pixel, or the letter "B" is represented by three target pixels of R values arranged as "255", "0", "255".
In this embodiment of the present invention, preferably, the determining the source information according to the first adjustment value of the target pixel includes: and determining the source information according to the preset coding rule and the first adjusting value of each target pixel.
The preset encoding rule is predetermined, and the corresponding order of the source information and the plurality of target pixels or the position of the target pixel in the preset position can be determined according to the preset encoding rule. According to the preset encoding rule and the first adjustment value of each target pixel, the source information can be determined.
For example, the preset encoding rule specifies that the source information is represented in an interval order, the first adjustment values (for R values in RGB color space) of the 6 target pixels from left to right are "255", "200", "150", "100", "50" and "0", respectively, and represent the characters "S", "9", "X", "2", "1" and "3", respectively, and the source information is determined to be "SX 1923" according to the order specified by the preset encoding rule.
In this embodiment of the present invention, preferably, the target pixels include rule identification pixels, and before determining the source information according to the preset encoding rule and the first adjustment value of each target pixel, the method further includes: identifying a rule identification pixel of which the attribute value is adjusted to a second adjustment value in the video frame; and determining the adopted preset coding rule according to the rule identification pixel.
And searching pixels with attribute values being the second adjustment values in the video frames, and identifying the pixels as rule identification pixels. And identifying the pixels according to the rule, and determining the adopted preset encoding rule.
In this embodiment of the present invention, preferably, after the determining the source information displayed by the target pixel, the method further includes: and determining the streaming data generation equipment and/or the streaming data provider according to the source information.
The source information includes identification information of the streaming data generation apparatus, address information of the streaming data generation apparatus, streaming data provider information, and the like, and the streaming data generation apparatus and/or the streaming data provider may be determined based on the source information.
In the embodiment of the present invention, preferably, the method further includes: and sending a processing instruction to the streaming data generation equipment or executing an action restriction strategy to the streaming data provider according to a preset sending rule.
The processing instruction is a processing instruction sent to the streaming data generating device, and when the streaming data generating device receives the processing instruction, corresponding operations are executed according to the content of the processing instruction, for example, shutdown, disconnection of network transmission, video recording restriction, or any other suitable processing instruction is executed, which is not limited in this embodiment of the present invention.
The action restriction policy refers to a policy for restricting an action of the streaming data provider, and may be executed by a server or a client, for example, the policy includes a restriction that login of an account of the streaming data provider is prohibited for 30 days, a restriction that a video uploaded by the account of the streaming data provider is manually checked, or any other applicable action restriction policy, which is not limited in this embodiment of the present invention.
The preset sending rule is used for judging whether to send a processing instruction to the stream data generating device or execute a behavior limiting policy to the stream data provider, for example, if the content of the video frame is in violation, the processing instruction is sent or the behavior limiting policy is executed.
In the embodiment of the present invention, preferably, the processing instruction includes at least one of a shutdown instruction, a network transmission cut-off instruction, a function restriction instruction, and a warning notification instruction, and the behavior restriction policy includes at least one of an audit restriction increase and a function restriction increase.
The shutdown instruction refers to an instruction to shut down the streaming data generation apparatus, the network transmission cut-off instruction refers to an instruction to cut off network transmission of the streaming data, the function restriction instruction refers to an instruction to prohibit turning on of a specified function of the streaming data generation apparatus, the warning notification instruction refers to an instruction to initiate warning notification through a display or a speaker, or the like. The increase of the audit limit refers to a limit of adding a specified audit flow to the video uploaded by the streaming data provider, and the increase of the function limit refers to a limit of a specified function to the streaming data provider.
Referring to fig. 4, a schematic block diagram of a video processing apparatus according to a fourth embodiment of the present invention is shown, which may specifically include the following modules:
an information obtaining module 401, configured to obtain source information of the stream data;
a target pixel determination module 402 for determining a target pixel in a video frame of the streaming data for displaying the source information;
a pixel adjusting module 403, configured to add the source information to the video frame by adjusting the target pixel.
In the embodiment of the present invention, it is preferable that the target pixel satisfies an identification requirement determined in accordance with a minimum recognizable area of the human eye and a minimum recognizable area of the identification device.
In the embodiment of the present invention, preferably, the target pixel determination module includes:
the character shape determining submodule is used for determining the character shape corresponding to the source information;
a pixel determination sub-module for determining a target pixel in the video frame that forms the character shape.
In the embodiment of the present invention, preferably, the pixel adjusting module includes:
and the attribute value adjusting submodule is used for adjusting at least one attribute value of the target pixel in the video frame.
In the embodiment of the present invention, preferably, the attribute value adjusting submodule includes:
the correction data determining unit is used for determining correction data of the attribute value of the target pixel in the video frame according to the attribute value of the target pixel in the video frame;
and the attribute value adjusting unit is used for adjusting the attribute value of the target pixel according to the correction data.
In the embodiment of the present invention, preferably, the pixel adjusting module includes:
a first adjustment value determining submodule, configured to determine a first adjustment value of each target pixel corresponding to the source information;
and the first adjusting submodule is used for adjusting the attribute value of the target pixel in the video frame to a first adjusting value.
In the embodiment of the present invention, preferably, the target pixel determination module includes:
and the number and position determining submodule is used for determining the number and the position of the target pixel for displaying the source information according to a preset coding rule.
In the embodiment of the present invention, preferably, the preset encoding rule includes at least one of a corresponding order of the source information and a plurality of target pixels, and a position of the target pixel in a preset position.
In this embodiment of the present invention, preferably, the target pixel includes a rule identification pixel, and the target pixel determination module further includes:
a pixel determination submodule for determining a rule identification pixel of a preset encoding rule adopted in the video frame;
the pixel adjustment module further comprises:
a second adjustment value determining submodule, configured to determine a second adjustment value of each rule identification pixel corresponding to the preset encoding rule;
and the second adjusting submodule is used for adjusting the attribute value of the rule identification pixel in the video frame to be a second adjusting value.
In the embodiment of the present invention, preferably, the apparatus further includes:
a quantity determining module, configured to determine, before the determining of the target pixel used for displaying the source information in the video frame of the stream data, a quantity of the target pixel according to a resolution of the video frame and an information amount of the source information.
In the embodiment of the present invention, preferably, the information obtaining module is specifically configured to obtain the required source information according to the service type and/or the playing time of the stream data.
In the embodiment of the present invention, preferably, the target pixel adjusting module is specifically configured to adjust the attribute value of the target pixel within a preset adjusting range, where the preset adjusting range is determined according to the minimum recognizable difference value of the human eye and the minimum recognizable difference value of the recognition device.
In the embodiment of the present invention, preferably, the apparatus includes:
and the encoding processing module is used for encoding the source information after the source information of the stream data is acquired.
In the embodiment of the present invention, preferably, the source information includes at least one of identification information of the stream data generation device, address information of the stream data generation device, and stream data provider information.
According to the video processing device, the source information of the streaming data is obtained, the target pixel displaying the source information in the video frame of the streaming data is determined, the source information can be identified on the video frame by adjusting the target pixel and adding the source information in the video frame, and after the illegal video is diffused in a network, the source of the video can be identified according to screenshots and the like of the video frame or the video frame, so that illegal behaviors can be processed, and the problem that the source cannot be positioned after the video or the screenshot is transmitted is solved.
Referring to fig. 5, a schematic block diagram of a video source identification apparatus according to a fifth embodiment of the present invention is shown, which may specifically include the following modules:
a video frame acquiring module 501, configured to acquire a video frame showing source information of stream data;
a target pixel identification module 502 for identifying a target pixel in the video frame, the target pixel being used to display the source information in the video frame of the streaming data;
a source information determining module 503, configured to determine source information displayed by the target pixel.
In the embodiment of the present invention, preferably, the source information determining module includes:
the character shape determining submodule is used for determining the character shape formed by the target pixel;
and the source information determining submodule is used for determining the source information corresponding to the character shape.
In the embodiment of the present invention, preferably, the target pixel identification module includes:
and the target pixel identification submodule is used for identifying the target pixel of which at least one attribute value is adjusted in the video frame.
In the embodiment of the present invention, preferably, the target pixel identification submodule includes:
the attribute value acquisition unit is used for acquiring the attribute value of the pixel at the preset position in the video frame;
and the pixel determining unit is used for determining a target pixel with an adjusted attribute value according to the attribute value of the pixel at the preset position.
In the embodiment of the present invention, preferably, the target pixel identification module includes:
and the pixel identification submodule is used for identifying a target pixel of which the attribute value is adjusted to a first adjustment value in the video frame.
In the embodiment of the present invention, preferably, the source information determining module includes:
and the source information determining submodule is used for determining the source information according to the first adjusting value of the target pixel.
In the embodiment of the present invention, preferably, the source information determining sub-module includes:
and the information determining unit is used for determining the source information according to the preset coding rule and the first adjusting value of each target pixel.
In this embodiment of the present invention, preferably, the target pixel includes a rule identification pixel, and the apparatus further includes:
the identification pixel identification module is used for identifying a rule identification pixel of which the attribute value is adjusted to a second adjustment value in the video frame before determining the source information according to the preset coding rule and the first adjustment value of each target pixel;
and the rule determining module is used for determining the adopted preset coding rule according to the rule identification pixel.
In the embodiment of the present invention, preferably, the apparatus further includes:
and the equipment determining module is used for determining the streaming data generating equipment and/or the streaming data provider according to the source information after the source information displayed by the target pixel is determined.
In the embodiment of the present invention, preferably, the apparatus further includes:
and the sending and executing module is used for sending a processing instruction to the streaming data generating equipment or executing an action limiting strategy to the streaming data provider according to a preset sending rule.
In the embodiment of the present invention, preferably, the processing instruction includes at least one of a shutdown instruction, a network transmission cut-off instruction, a function restriction instruction, and a warning notification instruction, and the behavior restriction policy includes at least one of an audit restriction increase and a function restriction increase.
According to the identification device for the video source, the video frame for displaying the source information of the streaming data is obtained, the target pixel in the video frame is identified, the source information displayed by the target pixel is determined, the target pixel is used for displaying the source information in the video frame of the streaming data, the source information can be identified on the video frame, after the illegal video is diffused in a network, the source of the video can be identified according to screenshots and the like of the video frame or the video frame, so that the illegal behavior can be processed, and the problem that the source cannot be located after the video or the video screenshot is spread is solved.
The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It will be appreciated by those skilled in the art that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components of the video processing method, the video source identification method and apparatus according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
The embodiment of the invention provides electronic equipment, which comprises a processor; and a memory configured to store computer-executable instructions that, when executed, cause the electronic device to perform a video processing method, a method of identifying a video source according to any of the above embodiments.
Embodiments of the present invention also provide a computer-readable storage medium, where the computer-readable storage medium stores one or more programs that, when executed by an electronic device, cause the electronic device to perform a video processing method and a video source identification method according to any of the above embodiments.
For example, fig. 6 illustrates a computing device, i.e., the electronic device in the foregoing, that can implement a video processing method, a video source-based identification method. The computing device conventionally includes a computer program product or computer-readable medium in the form of a processor 610 and a memory 620. The memory 620 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. The memory 620 has a storage space 630 storing program code 631 for performing any of the method steps of the method described above. For example, the storage space 630 storing the program codes may store the respective program codes 631 respectively for implementing the various steps in the above method. The program code can be read from or written to one or more computer program products. These computer program products comprise a program code carrier such as a hard disk, a Compact Disc (CD), a memory card or a floppy disk. Such a computer program product is typically a portable or fixed storage unit as shown for example in fig. 7. The storage unit may have storage segments, storage spaces, etc. arranged similarly to the memory 620 in the computing device of fig. 6. The program code may be compressed, for example, in a suitable form. Typically, the memory unit comprises computer readable code 631' for performing the steps of the method of the invention, i.e. code that can be read by a processor such as 610, which when run by a computing device causes the computing device to perform the steps of the method described above.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Claims (22)

1. A video processing method, comprising:
acquiring source information of stream data;
determining a target pixel in a video frame of the streaming data to display the source information;
adding the source information in the video frame by adjusting the target pixel;
the target pixel satisfies an identification requirement determined in dependence upon a minimum identifiable area of the human eye and a minimum identifiable area of an identification device;
the adding the source information in the video frame by adjusting the target pixel comprises:
determining a first adjustment value of each target pixel corresponding to the source information;
adjusting the attribute value of a target pixel in the video frame to a first adjustment value;
the determining a target pixel in a video frame of the streaming data to display the source information comprises:
determining the number and the position of target pixels for displaying the source information according to a preset encoding rule;
the preset encoding rule comprises at least one of a corresponding sequence of the source information and a plurality of target pixels and a position of the target pixel in a preset position;
the target pixel comprises a rule identification pixel, and the determining the target pixel used to display the source information in the video frame of the stream data further comprises:
determining rule identification pixels of a preset coding rule adopted in the video frame;
the adding the source information in the video frame by adjusting the target pixel further comprises:
determining a second adjustment value of each rule identification pixel corresponding to the preset coding rule;
and adjusting the attribute value of the rule identification pixel in the video frame to be a second adjustment value.
2. The method of claim 1, wherein prior to said determining a target pixel in a video frame of said streaming data to display said source information, said method further comprises:
and determining the number of target pixels according to the resolution of the video frame and the information content of the source information.
3. The method of claim 1, wherein the obtaining source information of the streaming data comprises:
and acquiring the required source information according to the service type and/or the playing time of the stream data.
4. The method of claim 1, wherein said adding the source information in the video frame by adjusting the target pixel comprises:
and adjusting the attribute value of the target pixel within a preset adjustment range, wherein the preset adjustment range is determined according to the minimum recognizable difference value of human eyes and the minimum recognizable difference value of the recognition equipment.
5. The method of claim 1, wherein after the obtaining source information for streaming data, the method comprises:
and encoding the source information.
6. The method of claim 1, wherein the source information includes at least one of identification information of the streaming data generating apparatus, address information of the streaming data generating apparatus, and streaming data provider information.
7. A method of identifying a video source, comprising:
acquiring a video frame displaying source information of stream data;
identifying a target pixel in the video frame, the target pixel to display the source information in a video frame of the streaming data;
determining source information displayed by the target pixel;
the target pixel satisfies an identification requirement determined in dependence upon a minimum identifiable area of the human eye and a minimum identifiable area of an identification device;
the identifying a target pixel in the video frame comprises:
identifying a target pixel of the video frame with an attribute value adjusted to a first adjustment value;
the determining the source information displayed by the target pixel comprises:
determining the source information according to the first adjusting value of the target pixel;
the determining the source information according to the first adjustment value of the target pixel comprises:
determining the source information according to a preset coding rule and a first adjusting value of each target pixel;
the target pixels comprise rule identification pixels, and before determining the source information according to the preset encoding rule and the first adjustment value of each target pixel, the method further comprises:
identifying a rule identification pixel of which the attribute value is adjusted to a second adjustment value in the video frame;
and determining the adopted preset coding rule according to the rule identification pixel.
8. The method of claim 7, wherein after the determining the source information displayed by the target pixel, the method further comprises:
and determining the streaming data generation equipment and/or the streaming data provider according to the source information.
9. The method of claim 8, wherein the method further comprises:
and sending a processing instruction to the streaming data generation equipment or executing an action restriction strategy to the streaming data provider according to a preset sending rule.
10. The method of claim 9, wherein the processing instructions include at least one of shutdown instructions, network transmission cutoff instructions, functional restriction instructions, and warning notification instructions, and the behavior restriction policy includes at least one of an increase in audit restrictions and an increase in functional restrictions.
11. A video processing apparatus, comprising:
the information acquisition module is used for acquiring source information of the streaming data;
a target pixel determination module to determine a target pixel in a video frame of the streaming data to display the source information;
a pixel adjusting module, configured to add the source information to the video frame by adjusting the target pixel;
the target pixel satisfies an identification requirement determined in dependence upon a minimum identifiable area of the human eye and a minimum identifiable area of an identification device;
the pixel adjustment module includes:
a first adjustment value determining submodule, configured to determine a first adjustment value of each target pixel corresponding to the source information;
the first adjusting submodule is used for adjusting the attribute value of the target pixel in the video frame to a first adjusting value;
the target pixel determination module includes:
the number and position determining submodule is used for determining the number and the position of target pixels for displaying the source information according to a preset coding rule;
the preset encoding rule comprises at least one of a corresponding sequence of the source information and a plurality of target pixels and a position of the target pixel in a preset position;
the target pixel comprises a rule identification pixel, and the target pixel determination module further comprises:
a pixel determination submodule for determining a rule identification pixel of a preset encoding rule adopted in the video frame;
the pixel adjustment module further comprises:
a second adjustment value determining submodule, configured to determine a second adjustment value of each rule identification pixel corresponding to the preset encoding rule;
and the second adjusting submodule is used for adjusting the attribute value of the rule identification pixel in the video frame to be a second adjusting value.
12. The apparatus of claim 11, wherein the apparatus further comprises:
a quantity determining module, configured to determine, before the determining of the target pixel used for displaying the source information in the video frame of the stream data, a quantity of the target pixel according to a resolution of the video frame and an information amount of the source information.
13. The apparatus according to claim 11, wherein the information obtaining module is specifically configured to obtain the required source information according to a service type and/or a playing time of the stream data.
14. The apparatus according to claim 11, wherein the target pixel adjusting module is specifically configured to adjust the attribute value of the target pixel within a preset adjusting range, and the preset adjusting range is determined according to the minimum recognizable difference value of the human eye and the minimum recognizable difference value of the recognition device.
15. The apparatus of claim 11, wherein the apparatus comprises:
and the encoding processing module is used for encoding the source information after the source information of the stream data is acquired.
16. The apparatus of claim 11, wherein the source information includes at least one of identification information of the streaming data generating device, address information of the streaming data generating device, and streaming data provider information.
17. An apparatus for identifying a video source, comprising:
the video frame acquisition module is used for acquiring a video frame for displaying source information of the stream data;
a target pixel identification module to identify a target pixel in the video frame, the target pixel to display the source information in a video frame of the streaming data;
the source information determining module is used for determining the source information displayed by the target pixel;
the target pixel satisfies an identification requirement determined in dependence upon a minimum identifiable area of the human eye and a minimum identifiable area of an identification device;
the target pixel identification module includes:
the pixel identification submodule is used for identifying a target pixel of which the attribute value is adjusted to a first adjustment value in the video frame;
the source information determination module includes:
the source information determining submodule is used for determining the source information according to the first adjusting value of the target pixel;
the source information determination submodule includes:
the information determining unit is used for determining the source information according to the preset coding rule and the first adjusting value of each target pixel;
the target pixel comprises a rule identification pixel, the apparatus further comprising:
the identification pixel identification module is used for identifying a rule identification pixel of which the attribute value is adjusted to a second adjustment value in the video frame before determining the source information according to a preset coding rule and the first adjustment value of each target pixel;
and the rule determining module is used for determining the adopted preset coding rule according to the rule identification pixel.
18. The apparatus of claim 17, wherein the apparatus further comprises:
and the equipment determining module is used for determining the streaming data generating equipment and/or the streaming data provider according to the source information after the source information displayed by the target pixel is determined.
19. The apparatus of claim 18, wherein the apparatus further comprises:
and the sending and executing module is used for sending a processing instruction to the streaming data generating equipment or executing an action limiting strategy to the streaming data provider according to a preset sending rule.
20. The apparatus of claim 19, wherein the processing instructions comprise at least one of shutdown instructions, network transmission cutoff instructions, functional restriction instructions, and warning notification instructions, and the behavior restriction policy comprises at least one of add audit restrictions and add functional restrictions.
21. An electronic device, comprising:
a processor; and
memory configured to store computer-executable instructions that, when executed, cause the electronic device to perform the video processing or identification method of video origin according to any of claims 1-10.
22. A computer readable storage medium storing one or more programs which, when executed by an electronic device, cause the electronic device to perform the video processing or identification method of video origin according to any one of claims 1-10.
CN201810220768.8A 2018-03-16 2018-03-16 Video processing method, video source identification method, video processing device, video source identification device and video source identification medium Active CN108449627B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810220768.8A CN108449627B (en) 2018-03-16 2018-03-16 Video processing method, video source identification method, video processing device, video source identification device and video source identification medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810220768.8A CN108449627B (en) 2018-03-16 2018-03-16 Video processing method, video source identification method, video processing device, video source identification device and video source identification medium

Publications (2)

Publication Number Publication Date
CN108449627A CN108449627A (en) 2018-08-24
CN108449627B true CN108449627B (en) 2021-08-10

Family

ID=63195672

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810220768.8A Active CN108449627B (en) 2018-03-16 2018-03-16 Video processing method, video source identification method, video processing device, video source identification device and video source identification medium

Country Status (1)

Country Link
CN (1) CN108449627B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110267115B (en) * 2019-06-17 2022-04-01 东软集团股份有限公司 Video security control method, device, equipment and medium
CN110381338B (en) * 2019-07-17 2022-02-18 腾讯科技（深圳）有限公司 Video data processing and analyzing method, device, equipment and medium
CN112448868B (en) * 2020-12-02 2022-09-30 新华三人工智能科技有限公司 Network traffic data identification method, device and equipment

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103826168A (en) * 2014-02-25 2014-05-28 深圳市掌网立体时代视讯技术有限公司 Method and system for adding watermark to video
CN103946871A (en) * 2011-12-02 2014-07-23 索尼公司 Image processing device, image recognition device, image recognition method, and program
CN103997652A (en) * 2014-06-12 2014-08-20 北京奇艺世纪科技有限公司 Video watermark embedding method and device
CN104883514A (en) * 2015-05-11 2015-09-02 北京金山安全软件有限公司 Video processing method and device
US9449357B1 (en) * 2012-08-24 2016-09-20 Digimarc Corporation Geometric enumerated watermark embedding for spot colors
WO2016148919A1 (en) * 2015-03-19 2016-09-22 Sony Corporation System for distributing metadata embedded in video
CN106570549A (en) * 2016-10-28 2017-04-19 网易（杭州）网络有限公司 Coding pattern generation and identification methods and coding pattern generation and identification devices
CN106951812A (en) * 2017-03-31 2017-07-14 腾讯科技（深圳）有限公司 Recognize method, device and the terminal of Quick Response Code
CN107103597A (en) * 2016-02-19 2017-08-29 青岛海信电器股份有限公司 A kind of pixel location determining method and device
CN107665299A (en) * 2016-07-28 2018-02-06 中兴通讯股份有限公司 A kind of Terminal fingerprints generation method and device

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4710763B2 (en) * 2006-08-31 2011-06-29 富士ゼロックス株式会社 Image processing program, instruction device, and image processing system
CN102122385B (en) * 2011-02-28 2012-02-29 北京工业大学 Digital watermark method capable of simultaneously resisting various attacks
CN103324873B (en) * 2013-07-15 2016-06-15 上海北丞电子发展有限公司 Copyright management watermark delivery system and watermark embedding method
CN105100959A (en) * 2014-05-06 2015-11-25 北京金石威视科技发展有限公司 Evidence-obtaining marking method and device and digital home theater
CN107027055A (en) * 2017-04-28 2017-08-08 安徽四创电子股份有限公司 A kind of video based on digital watermark is traced to the source and encryption method

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103946871A (en) * 2011-12-02 2014-07-23 索尼公司 Image processing device, image recognition device, image recognition method, and program
US9449357B1 (en) * 2012-08-24 2016-09-20 Digimarc Corporation Geometric enumerated watermark embedding for spot colors
CN103826168A (en) * 2014-02-25 2014-05-28 深圳市掌网立体时代视讯技术有限公司 Method and system for adding watermark to video
CN103997652A (en) * 2014-06-12 2014-08-20 北京奇艺世纪科技有限公司 Video watermark embedding method and device
WO2016148919A1 (en) * 2015-03-19 2016-09-22 Sony Corporation System for distributing metadata embedded in video
CN104883514A (en) * 2015-05-11 2015-09-02 北京金山安全软件有限公司 Video processing method and device
CN107103597A (en) * 2016-02-19 2017-08-29 青岛海信电器股份有限公司 A kind of pixel location determining method and device
CN107665299A (en) * 2016-07-28 2018-02-06 中兴通讯股份有限公司 A kind of Terminal fingerprints generation method and device
CN106570549A (en) * 2016-10-28 2017-04-19 网易（杭州）网络有限公司 Coding pattern generation and identification methods and coding pattern generation and identification devices
CN106951812A (en) * 2017-03-31 2017-07-14 腾讯科技（深圳）有限公司 Recognize method, device and the terminal of Quick Response Code

Also Published As

Publication number Publication date
CN108449627A (en) 2018-08-24

Similar Documents

Publication Publication Date Title
Novozamsky et al. Imd2020: A large-scale annotated dataset tailored for detecting manipulated images
CN108449627B (en) Video processing method, video source identification method, video processing device, video source identification device and video source identification medium
CN110418153B (en) Watermark adding method, device, equipment and storage medium
CN108810619B (en) Method and device for identifying watermark in video and electronic equipment
CN110366001B (en) Method and device for determining video definition, storage medium and electronic device
CN110876079B (en) Video processing method, device and equipment
CN110889824A (en) Sample generation method and device, electronic equipment and computer readable storage medium
CN105791893B (en) Video file encryption and decryption method and device
CN109804409A (en) The method and apparatus of image procossing
CN108833974B (en) Method and device for removing semitransparent watermark in video and electronic equipment
CN112162888A (en) Method and device for determining reason of black screen of display and computer storage medium
CN115761567A (en) Video processing method and device, electronic equipment and computer readable storage medium
CN108540824B (en) Video rendering method and device
CN110930354B (en) Video picture content analysis system for smooth transition of image big data
CN111866514B (en) Method and device for compressing video and decompressing video
CN113613015A (en) Tamper-resistant video generation method and device, electronic equipment and readable medium
CN114095722A (en) Definition determining method, device and equipment
CN114004726A (en) Watermark display method, watermark display device, computer equipment and storage medium
CN108810618B (en) Method and device for identifying watermark in video and electronic equipment
CN107659830B (en) Interactive activity access method, system and terminal equipment
CN113379582A (en) Information adding method, information extracting device and electronic equipment
CN111833456A (en) Image processing method, device, equipment and computer readable storage medium
CN107545214B (en) Image serial number determining method, feature setting method and device and intelligent equipment
CN112584152B (en) Method for detecting difference in remote desktop and dynamically encoding partitioned areas, electronic device and computer readable storage medium
CN112399096B (en) Video processing method, device and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant