CN106686395A - Illegal-video live-broadcast detection method and system - Google Patents
Illegal-video live-broadcast detection method and system Download PDFInfo
- Publication number
- CN106686395A CN106686395A CN201611250132.5A CN201611250132A CN106686395A CN 106686395 A CN106686395 A CN 106686395A CN 201611250132 A CN201611250132 A CN 201611250132A CN 106686395 A CN106686395 A CN 106686395A
- Authority
- CN
- China
- Prior art keywords
- live
- video data
- illegal
- live broadcast
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 88
- 238000000034 method Methods 0.000 claims abstract description 35
- 238000012550 audit Methods 0.000 claims description 4
- 238000013473 artificial intelligence Methods 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000002411 adverse Effects 0.000 description 1
- 230000000740 bleeding effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000009931 harmful effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2407—Monitoring of transmitted content, e.g. distribution time, number of downloads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/44—Event detection
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
An embodiment of the invention provides an illegal-video live-broadcast detection method and system. The method includes: receiving a detection request sent by a distribution server, wherein a real time messaging protocol (RTMP) address is carried in the detection request, and the RTMP address is the address used by live videos distributed to the terminal by the distribution server; acquiring live video data of terminal from the RTMP address and acquiring keyframe of the live videos; generating images corresponding to the keyframe; judging whether the images contains illegal information or not; if yes, determining the video data to be illegal video data. With the method, the live videos of the terminal can be detected in real time, and detection efficiency of the live videos is improved.
Description
Technical Field
The invention relates to the technical field of internet, in particular to a live illegal video detection method and system.
Background
The video live broadcast has become a big-head standard distribution service of the mobile internet, and a network user can live broadcast video data through a terminal, wherein the network user who broadcasts the video data live broadcast is also called as a main broadcast.
At present, the detection method for individual anchor live illegal video mainly includes: the method comprises the following steps that a network user reports and monitors personnel in real time, wherein the network user reports: when a network user watches the live illegal video or the live illegal video, reporting to monitoring personnel of a live broadcast platform or reporting to related departments; the real-time monitoring of the monitoring personnel is as follows: and monitoring personnel of the live broadcast platform watch live broadcast videos for 24 hours to monitor whether the live broadcast platform has anchor illegal videos.
Along with live broadcast platform civilization, more and more people carry out the video live broadcast through live broadcast platform, when the network user watched illegal video data, when going to report this illegal video data again, this illegal video data has led to the fact harmful effects, and meanwhile, the control personnel judge live broadcast video whether illegal through watching live broadcast video, cause the human cost too big, detect live broadcast video's efficiency lower.
Disclosure of Invention
The embodiment of the invention aims to provide a method and a system for detecting live illegal videos, so as to improve the detection efficiency of the live illegal videos. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention discloses a method for detecting live illegal video, including:
receiving a detection request sent by a distribution server; the detection request carries a real-time messaging protocol (RTMP) address; the RTMP address is: the distribution server distributes the address used by the live video to the terminal;
acquiring video data live broadcast by the terminal from the RTMP address, and acquiring a key frame in the video data;
generating a picture corresponding to the key frame;
judging whether the picture contains illegal information or not;
and when the picture contains illegal information, determining that the video data is illegal video data.
Optionally, the acquiring the key frame in the video data includes:
and acquiring a key frame from the video data according to the identification bit of the key frame, wherein the key frame is a frame with full-frame image information.
Optionally, the determining whether the picture contains illegal information includes:
comparing the picture with illegal information in a stored fingerprint database;
and when the picture comprises the illegal information stored in the fingerprint database, judging that the picture comprises the illegal information.
Optionally, the detection request further includes: a live ID, the live ID being: the distribution server distributes the identifier of a live broadcast room used by the live broadcast video to the terminal;
after determining that the video data is an illegal video, the method further comprises:
and determining a live broadcast room for live broadcasting the video data according to the picture and the live broadcast ID.
In a second aspect, an embodiment of the present invention discloses a method for detecting live illegal video, including:
receiving a live broadcast request sent by a terminal, wherein the live broadcast request carries an account and a password of a main broadcast;
judging whether the live broadcast request is legal or not;
when the live broadcast request is legal, allocating a real-time messaging protocol (RTMP) address and a live broadcast ID to the terminal; the RTMP address is: the distribution server distributes the address used by the live video to the terminal;
acquiring video data live broadcast by the terminal from the RTMP address, and acquiring a key frame in the video data;
generating a picture corresponding to the key frame;
judging whether the picture contains illegal information or not;
and when the picture contains illegal information, determining that the video data is illegal video data.
In a third aspect, an embodiment of the present invention discloses a system for detecting live illegal video, where the system includes: the system comprises a scheduling server, at least one screenshot server and a detection server;
wherein,
the dispatching server is used for receiving the detection request sent by the distribution server; the detection request carries a real-time messaging protocol (RTMP) address; the RTMP address is: the distribution server distributes the address used by the live video to the terminal; the system comprises at least one screenshot server and a target screenshot server, wherein the target screenshot server is used for determining the screenshot server from the at least one screenshot server, and the target screenshot server is the screenshot server with the lowest load in the at least one screenshot server; sending the detection request to the target screenshot server;
the target screenshot server is used for acquiring video data live broadcast by the terminal from the RTMP address and acquiring key frames in the video data; and generating a picture corresponding to the key frame;
the detection server is used for judging whether the picture contains illegal information or not; and when the picture contains illegal information, determining that the video data is illegal video data.
Optionally, the target screenshot server is specifically configured to,
and acquiring a key frame from the video data according to the identification bit of the key frame, wherein the key frame is a frame with full-frame image information.
Optionally, the detection server is specifically configured to,
and when the information contained in the picture is the same as the illegal information contained in the fingerprint database, judging that the picture contains the illegal information.
Optionally, the detection request further includes: a live ID, the live ID being: the distribution server distributes the identifier of a live broadcast room used by the live broadcast video to the terminal;
the system further comprises: an audit server;
and the auditing server is used for determining a live broadcast room for live broadcasting the video data according to the pictures and the live broadcast ID.
In a fourth aspect, an embodiment of the present invention further discloses a system for detecting live illegal video, where the system includes: a distribution server and a detection subsystem;
wherein,
the distribution server is used for receiving a live broadcast request sent by a terminal, wherein the live broadcast request carries an account and a password of a main broadcast; and, is used for judging whether the said live broadcast request is legal; when the live broadcast request is legal, allocating a real-time messaging protocol (RTMP) address and a live broadcast ID to the terminal; sending a detection request to the detection subsystem, wherein the detection request carries an RTMP address and an ID; the RTMP address is an address used by the terminal for live broadcasting video; the live ID is: the distribution server distributes the identifier of a live broadcast room used by the live broadcast video to the terminal;
the detection subsystem is used for receiving a detection request sent by the distribution server; the RTMP is used for acquiring video data of the live broadcast of the terminal from the RTMP address and acquiring a key frame in the video data; and generating a picture corresponding to the key frame; and judging whether the picture contains illegal information; and determining the video data to be illegal when the picture contains illegal information.
The method and the system for detecting the live illegal video provided by the embodiment of the invention receive a detection request sent by a distribution server, wherein the detection request carries a real-time messaging protocol (RTMP) address, obtain video data live by a terminal from the RTMP address, obtain a key frame in the video data, generate a picture corresponding to the key frame, judge whether the picture contains illegal information, and when the picture contains the illegal information, determine that the video data is illegal video data, namely determine that the terminal live broadcasting the video data is live illegal video data. Therefore, in the embodiment of the invention, the illegal video data which is live broadcast can be detected in time, the adverse effect of the illegal video data on network users is reduced, meanwhile, the embodiment of the invention can reduce the labor cost and improve the detection efficiency of the illegal video which is live broadcast.
Of course, it is not necessary for any product or method of practicing the invention to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a live illegal video detection method according to an embodiment of the present invention;
fig. 2 is another flowchart of a live illegal video detection method according to an embodiment of the present invention;
fig. 3 is another flowchart of a live illegal video detection method according to an embodiment of the present invention;
fig. 4 is a flowchart of another method for detecting live illegal video according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a live illegal video detection system according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of another live illegal video detection system according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a system for detecting live illegal video according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The live broadcast platform is an interactive platform provided by various large mobile internet businesses for network users, and at present, more and more network users use the live broadcast platform to broadcast video data. The live platform is actually a network system consisting of a plurality of servers. When a network user needs to live broadcast video data, a terminal where the network user is located firstly sends a live broadcast request to an allocation server, the allocation server allocates a Real Time Messaging Protocol (RTMP) address and a live broadcast ID (used for representing an identity of the terminal live broadcast video data) to the terminal after receiving the live broadcast request, meanwhile, the allocation server sends the RTMP address and the live broadcast ID to a storage server, the storage server obtains the video data which the network user is live broadcasting from the RTMP address, and an auditor watches the obtained video data for 24 hours. Therefore, when a plurality of network users live broadcast video data on the live broadcast platform, a plurality of auditors are required to watch the video data obtained by different RTMP addresses at the same time, so that the labor cost is overlarge, and the efficiency of detecting live broadcast video is lower.
In order to solve the problems in the prior art, embodiments of the present invention provide a method and a system for detecting live illegal videos, so as to improve the detection efficiency of live illegal videos.
First, a method for detecting live illegal video provided by an embodiment of the present invention is described below.
It should be noted that the live illegal video detection method provided by the embodiment of the present invention is applied to a detection server of each live platform of the mobile internet.
As shown in fig. 1, a method for detecting a live illegal video according to an embodiment of the present invention may include the following steps:
s101, receiving a detection request sent by a distribution server; the detection request carries a real-time messaging protocol (RTMP) address.
Wherein, the RTMP address is: and the distribution server distributes the address used by the live video to the terminal.
It can be understood that when a network user logs in a live broadcast platform and requests a distribution server to perform live broadcast video data, a detection request sent by the distribution server is received, where the detection request carries an RTMP address. The RTMP address supports an open protocol for audio, video and data transfer between the player and the server.
In practical application, when a network user logs in a live broadcast platform, a terminal where the network user is located sends a live broadcast request to a distribution server, wherein the live broadcast request is as follows: the terminal requests the distribution server to distribute an address capable of uploading video data; meanwhile, the distribution server sends a detection request to the detection server to request the detection server to detect the video data uploaded by the terminal.
S102, acquiring the video data live broadcast by the terminal from the RTMP address, and acquiring the key frame in the video data.
It can be understood that, after the detection server receives the detection request sent by the distribution server, the detection server obtains the video data live broadcast by the terminal according to the RTMP address in the detection request.
It should be noted that, before sending the detection request, the distribution server first distributes the RTMP address and the live ID of the live video to the terminal used by the network user, where the terminal includes: cell-phone, panel computer, desktop computer and the electronic equipment that can live the video. Therefore, the detection server can acquire the video data which is live broadcast by the terminal according to the RTMP address, namely the detection server downloads the video data from the path of the RTMP address. Meanwhile, when the video data is downloaded, key frames in the video data are acquired.
Specifically, the acquiring a key frame in the video data includes:
and acquiring a key frame from the video data according to the identification bit of the key frame, wherein the key frame is a frame with full-frame image information.
It should be noted that when the terminal generates video data, the video data is encoded, the video data is composed of frame groups, non-key frames (other frames except for the key frame in the frame group) of each frame group are encoded according to a base frame (i.e. a first frame, also called a key frame) of the frame group, the key frame is a full-frame compression encoded frame, the key frame does not need to refer to the non-key frame in the frame group when being encoded, and the key frame needs to be encoded by referring to the key frame when being encoded, so that the key frame has full-frame image information. Typically, key frames have identification bits that are used to distinguish between key frames and non-key frames. When the video data is acquired, extracting all key frames in the video data according to the flag bits of the key frames in the video data.
And S103, generating a picture corresponding to the key frame.
Specifically, the key frame has full-frame picture information, so that a complete picture can be reconstructed from the key frame.
It is understood that one key frame corresponds to one picture, for example, 1000 pictures may be generated when 1000 key frames are obtained in the video data, and 2000 pictures may be generated when 2000 key frames are obtained in the video data.
And S104, judging whether the picture contains illegal information.
And generating a picture corresponding to the key frame according to the key frame in the video data, wherein the information of the picture comprises all the information of the image background and the motion of the network user uploaded by the terminal, so that whether the video data uploaded by the terminal is illegal or not is determined by judging whether the picture comprises illegal information or not.
Specifically, in a possible implementation manner of the embodiment of the present invention, the determining whether the picture contains illegal information includes the following steps:
step one, the picture is compared with the stored illegal information in the fingerprint database.
And step two, when the picture comprises the illegal information stored in the fingerprint database, judging that the picture comprises the illegal information.
In practical application, the average value of the color values of the picture can be used as attribute information of the picture, the average value of the color values of the picture is compared with the average value of the color values in the stored fingerprint library according to the average value of the color values of the picture, and when the average value of the color values of the picture is larger than the average value of the color values in the fingerprint library, the picture is judged to contain illegal information. For example, the average of the picture color values includes: and when the average value of the red color value is greater than or equal to the average value of the color values in the fingerprint library, judging that the picture contains illegal information, and judging that the video live broadcast by the terminal is possibly a violent bleeding event.
Specifically, in a possible implementation manner of the embodiment of the present invention, AI (Artificial Intelligence) may be adopted to determine whether the picture contains illegal information, where Artificial Intelligence is a branch of computer science, and the Artificial Intelligence essentially refers to a new intelligent machine that can react in a manner similar to human Intelligence, and the picture can be identified through the Artificial Intelligence, and when it is identified that the picture contains illegal information, it is determined that video data corresponding to the picture is illegal video data, and at the same time, it is determined that a terminal that broadcasts the video data is broadcasting the illegal video data live.
S105, when the picture contains illegal information, determining that the video data is illegal video data.
Specifically, when a picture does not contain illegal information, whether the next picture of the picture contains the illegal information or not is judged, a corresponding picture is generated according to a key frame, the number of the key frames determines the number of the generated pictures, whether the corresponding picture generated by the key frame contains the illegal information or not is sequentially judged according to the sequence of obtaining the key frames, when the current picture does not contain the illegal information, whether the next picture after the previous picture has the illegal information or not is continuously judged, and whether the video data is the illegal video data or not can not be determined until all pictures correspondingly generated by the key frame are judged to be finished. And when at least one picture in all pictures generated corresponding to the key frame of the video data contains illegal information, determining the video data as illegal data.
In addition, after the video data is determined to be illegal video data, the RTMP address for uploading the illegal video data can be closed, or a warning is given to a network user who broadcasts the illegal video data according to the illegal grade of the illegal video data, so that the network user stops broadcasting the illegal video data.
According to the detection method of the live broadcast illegal video, the key frame of the video data is obtained from the obtained video data, the corresponding picture is generated through the key frame, whether the picture contains illegal information or not is judged through analysis of the picture, and therefore whether the video data is illegal or not is judged.
Further, after determining that the video data is illegal video data, a terminal that broadcasts the illegal video data needs to be processed. In order to meet the above requirement, on the basis of S101 to S105, as shown in fig. 2, the method for detecting live illegal video according to the embodiment of the present invention may further include:
and S106, determining a live broadcast room for live broadcasting the video data according to the picture and the live broadcast ID.
Wherein the detection request further comprises: a live ID, the live ID being: and the distribution server distributes the identifier of the live broadcast room used by the live broadcast video to the terminal.
It should be emphasized that, before receiving a detection request sent by an allocation server, the allocation server allocates an RTMP address and a live ID to a terminal, where the RTMP address is an address from which the terminal uploads video data, and the live ID is a live room of a network user on a live platform, and when the network user logs in the live platform each time, the allocation server randomly allocates a stored and unoccupied live ID to the network user, and when the network user live broadcasts video data, the live room corresponding to the live ID can be searched according to the live ID allocated to the network user, and each live ID uniquely corresponds to one live room. And after finding that the illegal video data are live in the live broadcast room, closing the live broadcast ID corresponding to the live broadcast room, or sending a warning to a network user live broadcasting the illegal video data according to the illegal grade of the illegal video data.
In addition, when the network user is registered on a live broadcast platform, a real-name system is adopted, the network ID of the network user can be determined according to a live broadcast ID corresponding to a live broadcast room, wherein the network ID is an internet identity authentication protocol which has uniqueness and information undeniability, and after the network ID of the network user is determined, the network user can be reported to relevant departments to request the relevant departments to check the network ID, so that the network user is prevented from directly broadcasting illegal videos through different live broadcast platforms again.
The following describes a method for detecting live illegal video according to an embodiment of the present invention with reference to a specific embodiment.
The execution main body of the live illegal video detection method provided by the embodiment of the invention can be a live illegal video detection system.
As shown in fig. 3, a method for detecting live illegal video may include the following steps:
s301, receiving a live broadcast request sent by a terminal.
And the live broadcast request carries an account and a password of the anchor.
It is understood that the network user needs to log in the live platform before live video data, that is, the network user sends a live request to the distribution server, where the live request carries an account and a password of the network user (anchor), but is not limited thereto.
S302, judging whether the live broadcast request is legal or not.
Specifically, whether the account and the password in the live broadcast request are matched with the account and the password stored in the distribution server is judged.
S303, when the live broadcast request is legal, allocating a real-time messaging protocol (RTMP) address and a live broadcast ID to the terminal; the RTMP address is: and the distribution server distributes the address used by the live video to the terminal.
When the account and the password in the live broadcast request are matched with the account and the password stored in the allocation server, the live broadcast request is determined to be legal, and an RTMP address and a live broadcast ID are allocated to the terminal where the anchor is located, so that the anchor can upload video data of the terminal where the anchor is located through the RTMP address, and the video data are live broadcast in a live broadcast room corresponding to the live broadcast ID.
It should be noted that a network user (anchor) assigns an RTMP address and a live ID.
S304, acquiring the video data live broadcast by the terminal from the RTMP address, and acquiring the key frame in the video data.
S305, generating a picture corresponding to the key frame.
S306, judging whether the picture contains illegal information.
S307, when the picture contains illegal information, determining that the video data is illegal video data.
In this embodiment, S304 to S307 are similar to S102 to S105 of the above embodiment, and are not repeated herein.
Compared with the prior art, the method and the device have the advantages that the picture corresponding to the key frame is generated through the key frame of the video data, whether the picture is illegal or not is judged, whether the video data are illegal or not is determined indirectly finally, labor cost is reduced, whether the live video data of the terminal are illegal or not is detected in time, and detection efficiency of live illegal videos is improved.
Further, after determining that the video data is illegal video data, a terminal that broadcasts the illegal video data needs to be processed. In order to meet the above requirement, on the basis of S301 to S107, as shown in fig. 4, the method for detecting live illegal video according to the embodiment of the present invention may further include:
and S308, determining a live broadcast room for live broadcasting the video data according to the picture and the live broadcast ID.
S308 is similar to S106 of the above embodiment, and is not described herein again.
Corresponding to the above provided embodiment of the method for detecting live illegal video, an embodiment of the present invention further provides a system for detecting live illegal video, and as shown in fig. 5, the system 500 may include:
dispatch server 510, at least one screenshot server 520, and detection server 530.
The scheduling server 510 is configured to receive a detection request sent by a distribution server; the detection request carries a real-time messaging protocol (RTMP) address; the RTMP address is: the distribution server distributes the address used by the live video to the terminal; and is configured to determine a target screenshot server from the at least one screenshot server 520, where the target screenshot server is a screenshot server with a lowest load in the at least one screenshot server; and sending the detection request to the target screenshot server.
The target screenshot server 521 is configured to obtain video data live broadcast by the terminal from the RTMP address, and obtain a key frame in the video data; and generating a picture corresponding to the key frame.
The detection server 530 is configured to determine whether the picture contains illegal information; and when the picture contains illegal information, determining that the video data is illegal video data.
Specifically, the target screenshot server 521 is specifically configured to obtain a key frame from the video data according to an identification bit of the key frame, where the key frame is a frame with full-frame image information.
Specifically, the detection server 530 is specifically configured to determine that a picture includes illegal information when the information included in the picture is the same as the illegal information included in the fingerprint library.
Specifically, the detection request further includes: a live ID, the live ID being: and the distribution server distributes the identifier of the live broadcast room used by the live broadcast video to the terminal.
In the embodiment of the invention, the picture corresponding to the key frame is generated through the key frame of the video data, whether the picture is illegal or not is judged, and finally whether the video data is illegal or not is indirectly determined, so that the labor cost is reduced, whether the live video data of the terminal is illegal or not is timely detected, and the detection efficiency of the live illegal video is improved.
Further, on the basis of including a scheduling server, at least one screenshot server, and a detection server, as shown in fig. 6, the detection system for live illegal video provided in the embodiment of the present invention may further include: an audit server 540.
The audit server 540 is configured to determine a live broadcast room in which the video data is live according to the picture and the live broadcast ID.
As shown in fig. 7, a system for detecting live illegal video according to an embodiment of the present invention includes: distribution server 710 and detection subsystem 720.
The distribution server 710 is configured to receive a live broadcast request sent by a terminal, where the live broadcast request carries an account and a password of a main broadcast; and, is used for judging whether the said live broadcast request is legal; when the live broadcast request is legal, allocating a real-time messaging protocol (RTMP) address and a live broadcast ID to the terminal; sending a detection request to the detection subsystem, wherein the detection request carries an RTMP address and an ID; the RTMP address is an address used by the terminal for live broadcasting video; the live ID is: and the distribution server distributes the identifier of the live broadcast room used by the live broadcast video to the terminal.
The detection subsystem 720 is configured to receive a detection request sent by the distribution server; the RTMP is used for acquiring video data of the live broadcast of the terminal from the RTMP address and acquiring a key frame in the video data; and generating a picture corresponding to the key frame; and judging whether the picture contains illegal information; and determining the video data to be illegal when the picture contains illegal information.
In the embodiment of the invention, the picture corresponding to the key frame is generated through the key frame of the video data, whether the picture is illegal or not is judged, and finally whether the video data is illegal or not is indirectly determined, so that the labor cost is reduced, whether the live video data of the terminal is illegal or not is timely detected, and the detection efficiency of the live illegal video is improved.
For the system embodiment, since it is basically similar to the method embodiment, the description is simple, and the relevant points can be referred to the partial description of the method embodiment.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (10)
1. A method for detecting live illegal video is characterized by comprising the following steps:
receiving a detection request sent by a distribution server; the detection request carries a real-time messaging protocol (RTMP) address; the RTMP address is: the distribution server distributes the address used by the live video to the terminal;
acquiring video data live broadcast by the terminal from the RTMP address, and acquiring a key frame in the video data;
generating a picture corresponding to the key frame;
judging whether the picture contains illegal information or not;
and when the picture contains illegal information, determining that the video data is illegal video data.
2. The method of claim 1, wherein the obtaining key frames in the video data comprises:
and acquiring a key frame from the video data according to the identification bit of the key frame, wherein the key frame is a frame with full-frame image information.
3. The method of claim 1, wherein determining whether the picture contains illegal information comprises:
comparing the picture with illegal information in a stored fingerprint database;
and when the picture comprises the illegal information stored in the fingerprint database, judging that the picture comprises the illegal information.
4. The method of claim 1, wherein the detecting the request further comprises: a live ID, the live ID being: the distribution server distributes the identifier of a live broadcast room used by the live broadcast video to the terminal;
after determining that the video data is an illegal video, the method further comprises:
and determining a live broadcast room for live broadcasting the video data according to the picture and the live broadcast ID.
5. A method for detecting live illegal video is characterized by comprising the following steps:
receiving a live broadcast request sent by a terminal, wherein the live broadcast request carries an account and a password of a main broadcast;
judging whether the live broadcast request is legal or not;
when the live broadcast request is legal, allocating a real-time messaging protocol (RTMP) address and a live broadcast ID to the terminal; the RTMP address is: the distribution server distributes the address used by the live video to the terminal;
acquiring video data live broadcast by the terminal from the RTMP address, and acquiring a key frame in the video data;
generating a picture corresponding to the key frame;
judging whether the picture contains illegal information or not;
and when the picture contains illegal information, determining that the video data is illegal video data.
6. A system for detecting live illegal video, the system comprising: the system comprises a scheduling server, at least one screenshot server and a detection server;
wherein,
the dispatching server is used for receiving the detection request sent by the distribution server; the detection request carries a real-time messaging protocol (RTMP) address; the RTMP address is: the distribution server distributes the address used by the live video to the terminal; the system comprises at least one screenshot server and a target screenshot server, wherein the target screenshot server is used for determining the screenshot server from the at least one screenshot server, and the target screenshot server is the screenshot server with the lowest load in the at least one screenshot server; sending the detection request to the target screenshot server;
the target screenshot server is used for acquiring video data live broadcast by the terminal from the RTMP address and acquiring key frames in the video data; and generating a picture corresponding to the key frame;
the detection server is used for judging whether the picture contains illegal information or not; and when the picture contains illegal information, determining that the video data is illegal video data.
7. The system of claim 6, wherein the target screenshot server is specifically configured to,
and acquiring a key frame from the video data according to the identification bit of the key frame, wherein the key frame is a frame with full-frame image information.
8. The system according to claim 6, characterized in that the detection server is specifically configured to,
and when the information contained in the picture is the same as the illegal information contained in the fingerprint database, judging that the picture contains the illegal information.
9. The system of claim 6, wherein the detection request further comprises: a live ID, the live ID being: the distribution server distributes the identifier of a live broadcast room used by the live broadcast video to the terminal;
the system further comprises: an audit server;
and the auditing server is used for determining a live broadcast room for live broadcasting the video data according to the pictures and the live broadcast ID.
10. A system for detecting live illegal video, the system comprising: a distribution server and a detection subsystem;
wherein,
the distribution server is used for receiving a live broadcast request sent by a terminal, wherein the live broadcast request carries an account and a password of a main broadcast; and, is used for judging whether the said live broadcast request is legal; when the live broadcast request is legal, allocating a real-time messaging protocol (RTMP) address and a live broadcast ID to the terminal; sending a detection request to the detection subsystem, wherein the detection request carries an RTMP address and an ID; the RTMP address is an address used by the terminal for live broadcasting video; the live ID is: the distribution server distributes the identifier of a live broadcast room used by the live broadcast video to the terminal;
the detection subsystem is used for receiving a detection request sent by the distribution server; the RTMP is used for acquiring video data of the live broadcast of the terminal from the RTMP address and acquiring a key frame in the video data; and generating a picture corresponding to the key frame; and judging whether the picture contains illegal information; and determining the video data to be illegal when the picture contains illegal information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611250132.5A CN106686395B (en) | 2016-12-29 | 2016-12-29 | live illegal video detection method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611250132.5A CN106686395B (en) | 2016-12-29 | 2016-12-29 | live illegal video detection method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106686395A true CN106686395A (en) | 2017-05-17 |
| CN106686395B CN106686395B (en) | 2019-12-13 |
Family
ID=58871893
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611250132.5A Active CN106686395B (en) | 2016-12-29 | 2016-12-29 | live illegal video detection method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106686395B (en) |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107257496A (en) * | 2017-06-14 | 2017-10-17 | 广州市千钧网络科技有限公司 | A kind of live control method, device and mobile terminal |
| CN107613316A (en) * | 2017-09-07 | 2018-01-19 | 武汉斗鱼网络科技有限公司 | A kind of network direct broadcasting plug-flow verification method and system |
| CN108038722A (en) * | 2017-12-07 | 2018-05-15 | 深圳慧逛信息服务有限公司 | A kind of interactive marketing system |
| CN108156469A (en) * | 2017-12-15 | 2018-06-12 | 北京奇虎科技有限公司 | A kind of detection method and device that legitimacy is broadcast live |
| CN108521576A (en) * | 2018-03-16 | 2018-09-11 | 腾讯科技(成都)有限公司 | Display methods, device, storage medium and the electronic device of media resource |
| CN108933769A (en) * | 2017-05-27 | 2018-12-04 | 武汉斗鱼网络科技有限公司 | Streaming media screenshot system, method and device |
| CN108965918A (en) * | 2018-07-19 | 2018-12-07 | 腾讯科技（深圳）有限公司 | streaming media processing method, device, system and computer readable storage medium |
| CN109005425A (en) * | 2018-08-26 | 2018-12-14 | 俞绍富 | Network video monitor and control system |
| CN109145940A (en) * | 2018-07-02 | 2019-01-04 | 北京陌上花科技有限公司 | Image-recognizing method and device |
| CN109271534A (en) * | 2018-10-19 | 2019-01-25 | 武汉斗鱼网络科技有限公司 | A kind of live data identification framework, method, server and storage medium |
| CN109600622A (en) * | 2018-08-31 | 2019-04-09 | 北京微播视界科技有限公司 | Audio/video information processing method, device and electronic equipment |
| CN109618175A (en) * | 2018-12-12 | 2019-04-12 | 合肥海辉智能科技有限公司 | A kind of monitoring network audio and video management system |
| CN109831698A (en) * | 2018-12-28 | 2019-05-31 | 广州华多网络科技有限公司 | Signal auditing method, device, electronic equipment and computer-readable storage medium |
| CN110147469A (en) * | 2019-05-14 | 2019-08-20 | 腾讯音乐娱乐科技（深圳）有限公司 | A kind of data processing method, equipment and storage medium |
| CN110392271A (en) * | 2018-04-20 | 2019-10-29 | 华为技术有限公司 | The method and apparatus that live video examines |
| CN110740347A (en) * | 2019-10-31 | 2020-01-31 | 北京金山云网络技术有限公司 | Video content detection system, method, device, server and storage medium |
| CN110944217A (en) * | 2019-12-12 | 2020-03-31 | 北京达佳互联信息技术有限公司 | Live broadcast information processing method and device, server and storage medium |
| CN110971928A (en) * | 2018-09-30 | 2020-04-07 | 武汉斗鱼网络科技有限公司 | Picture identification method and related device |
| CN110971939A (en) * | 2018-09-30 | 2020-04-07 | 武汉斗鱼网络科技有限公司 | Illegal picture identification method and related device |
| CN111343146A (en) * | 2020-02-04 | 2020-06-26 | 北京字节跳动网络技术有限公司 | Data auditing method, system, computer readable medium and electronic equipment |
| CN111355970A (en) * | 2019-05-15 | 2020-06-30 | 深圳市鸿合创新信息技术有限责任公司 | Live broadcast management method and device and electronic equipment |
| CN112015946A (en) * | 2019-05-30 | 2020-12-01 | 中国移动通信集团重庆有限公司 | Video detection method and device, computing equipment and computer storage medium |
| CN112217841A (en) * | 2020-12-09 | 2021-01-12 | 平安国际智慧城市科技股份有限公司 | Live broadcast room management method and device, computer equipment and storage medium |
| CN112235601A (en) * | 2020-10-13 | 2021-01-15 | 中国联合网络通信集团有限公司 | Live broadcast behavior correction method, terminal, edge server and computer equipment |
| CN113438503A (en) * | 2021-05-28 | 2021-09-24 | 曙光网络科技有限公司 | Video file restoration method and device, computer equipment and storage medium |
| CN114640655A (en) * | 2020-12-16 | 2022-06-17 | 慧盾信息安全科技(北京)有限公司 | Safe video retrieval system and method based on HLS video playing |
| CN114745558A (en) * | 2021-01-07 | 2022-07-12 | 北京字节跳动网络技术有限公司 | Live broadcast monitoring method, device, system, equipment and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103944888A (en) * | 2014-04-02 | 2014-07-23 | 天脉聚源(北京)传媒科技有限公司 | Resource sharing method, device and system |
| CN105704139A (en) * | 2016-03-16 | 2016-06-22 | 杭州狮说教育科技有限公司 | RTMP protocol-based streaming media service user authentication method |
| CN105847874A (en) * | 2016-04-20 | 2016-08-10 | 乐视控股（北京）有限公司 | Live broadcasting device and live broadcasting terminal |
| CN105872773A (en) * | 2016-06-01 | 2016-08-17 | 北京奇虎科技有限公司 | Video broadcast monitoring method and device |
| CN105915953A (en) * | 2016-06-12 | 2016-08-31 | 腾讯科技（深圳）有限公司 | Method, apparatus and system for discriminating live video |
| CN106101845A (en) * | 2016-07-04 | 2016-11-09 | 天脉聚源(北京)传媒科技有限公司 | The creation method of a kind of net cast and device |
-
2016
- 2016-12-29 CN CN201611250132.5A patent/CN106686395B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103944888A (en) * | 2014-04-02 | 2014-07-23 | 天脉聚源(北京)传媒科技有限公司 | Resource sharing method, device and system |
| CN105704139A (en) * | 2016-03-16 | 2016-06-22 | 杭州狮说教育科技有限公司 | RTMP protocol-based streaming media service user authentication method |
| CN105847874A (en) * | 2016-04-20 | 2016-08-10 | 乐视控股（北京）有限公司 | Live broadcasting device and live broadcasting terminal |
| CN105872773A (en) * | 2016-06-01 | 2016-08-17 | 北京奇虎科技有限公司 | Video broadcast monitoring method and device |
| CN105915953A (en) * | 2016-06-12 | 2016-08-31 | 腾讯科技（深圳）有限公司 | Method, apparatus and system for discriminating live video |
| CN106101845A (en) * | 2016-07-04 | 2016-11-09 | 天脉聚源(北京)传媒科技有限公司 | The creation method of a kind of net cast and device |
Cited By (39)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108933769A (en) * | 2017-05-27 | 2018-12-04 | 武汉斗鱼网络科技有限公司 | Streaming media screenshot system, method and device |
| CN107257496A (en) * | 2017-06-14 | 2017-10-17 | 广州市千钧网络科技有限公司 | A kind of live control method, device and mobile terminal |
| CN107613316A (en) * | 2017-09-07 | 2018-01-19 | 武汉斗鱼网络科技有限公司 | A kind of network direct broadcasting plug-flow verification method and system |
| CN107613316B (en) * | 2017-09-07 | 2020-01-03 | 武汉斗鱼网络科技有限公司 | Live network push stream verification method and system |
| CN108038722A (en) * | 2017-12-07 | 2018-05-15 | 深圳慧逛信息服务有限公司 | A kind of interactive marketing system |
| CN108156469A (en) * | 2017-12-15 | 2018-06-12 | 北京奇虎科技有限公司 | A kind of detection method and device that legitimacy is broadcast live |
| CN108156469B (en) * | 2017-12-15 | 2021-05-04 | 北京奇虎科技有限公司 | Method and device for detecting validity of live broadcast |
| CN108521576A (en) * | 2018-03-16 | 2018-09-11 | 腾讯科技(成都)有限公司 | Display methods, device, storage medium and the electronic device of media resource |
| CN110392271A (en) * | 2018-04-20 | 2019-10-29 | 华为技术有限公司 | The method and apparatus that live video examines |
| CN109145940A (en) * | 2018-07-02 | 2019-01-04 | 北京陌上花科技有限公司 | Image-recognizing method and device |
| CN108965918B (en) * | 2018-07-19 | 2020-04-03 | 腾讯科技（深圳）有限公司 | Streaming media processing method, device, system and computer readable storage medium |
| CN108965918A (en) * | 2018-07-19 | 2018-12-07 | 腾讯科技（深圳）有限公司 | streaming media processing method, device, system and computer readable storage medium |
| CN109005425A (en) * | 2018-08-26 | 2018-12-14 | 俞绍富 | Network video monitor and control system |
| CN109600622B (en) * | 2018-08-31 | 2021-04-02 | 北京微播视界科技有限公司 | Audio and video information processing method and device and electronic equipment |
| CN109600622A (en) * | 2018-08-31 | 2019-04-09 | 北京微播视界科技有限公司 | Audio/video information processing method, device and electronic equipment |
| CN110971928A (en) * | 2018-09-30 | 2020-04-07 | 武汉斗鱼网络科技有限公司 | Picture identification method and related device |
| CN110971939A (en) * | 2018-09-30 | 2020-04-07 | 武汉斗鱼网络科技有限公司 | Illegal picture identification method and related device |
| CN110971928B (en) * | 2018-09-30 | 2022-03-25 | 武汉斗鱼网络科技有限公司 | Picture identification method and related device |
| CN110971939B (en) * | 2018-09-30 | 2022-02-08 | 武汉斗鱼网络科技有限公司 | Illegal picture identification method and related device |
| CN109271534A (en) * | 2018-10-19 | 2019-01-25 | 武汉斗鱼网络科技有限公司 | A kind of live data identification framework, method, server and storage medium |
| CN109618175A (en) * | 2018-12-12 | 2019-04-12 | 合肥海辉智能科技有限公司 | A kind of monitoring network audio and video management system |
| CN109831698A (en) * | 2018-12-28 | 2019-05-31 | 广州华多网络科技有限公司 | Signal auditing method, device, electronic equipment and computer-readable storage medium |
| CN110147469A (en) * | 2019-05-14 | 2019-08-20 | 腾讯音乐娱乐科技（深圳）有限公司 | A kind of data processing method, equipment and storage medium |
| CN110147469B (en) * | 2019-05-14 | 2023-08-08 | 腾讯音乐娱乐科技（深圳）有限公司 | Data processing method, device and storage medium |
| CN111355970A (en) * | 2019-05-15 | 2020-06-30 | 深圳市鸿合创新信息技术有限责任公司 | Live broadcast management method and device and electronic equipment |
| CN112015946A (en) * | 2019-05-30 | 2020-12-01 | 中国移动通信集团重庆有限公司 | Video detection method and device, computing equipment and computer storage medium |
| CN112015946B (en) * | 2019-05-30 | 2023-11-10 | 中国移动通信集团重庆有限公司 | Video detection method, device, computing equipment and computer storage medium |
| CN110740347A (en) * | 2019-10-31 | 2020-01-31 | 北京金山云网络技术有限公司 | Video content detection system, method, device, server and storage medium |
| CN110740347B (en) * | 2019-10-31 | 2022-04-05 | 北京金山云网络技术有限公司 | Video content detection system, method, device, server and storage medium |
| CN110944217A (en) * | 2019-12-12 | 2020-03-31 | 北京达佳互联信息技术有限公司 | Live broadcast information processing method and device, server and storage medium |
| CN111343146A (en) * | 2020-02-04 | 2020-06-26 | 北京字节跳动网络技术有限公司 | Data auditing method, system, computer readable medium and electronic equipment |
| CN111343146B (en) * | 2020-02-04 | 2022-08-09 | 北京字节跳动网络技术有限公司 | Data auditing method, system, computer readable medium and electronic equipment |
| CN112235601A (en) * | 2020-10-13 | 2021-01-15 | 中国联合网络通信集团有限公司 | Live broadcast behavior correction method, terminal, edge server and computer equipment |
| CN112217841A (en) * | 2020-12-09 | 2021-01-12 | 平安国际智慧城市科技股份有限公司 | Live broadcast room management method and device, computer equipment and storage medium |
| CN114640655A (en) * | 2020-12-16 | 2022-06-17 | 慧盾信息安全科技(北京)有限公司 | Safe video retrieval system and method based on HLS video playing |
| CN114640655B (en) * | 2020-12-16 | 2024-05-14 | 慧盾信息安全科技(北京)有限公司 | HLS video playing-based safe video retrieval system and method |
| CN114745558A (en) * | 2021-01-07 | 2022-07-12 | 北京字节跳动网络技术有限公司 | Live broadcast monitoring method, device, system, equipment and medium |
| CN114745558B (en) * | 2021-01-07 | 2024-04-09 | 北京字节跳动网络技术有限公司 | Live broadcast monitoring method, device, system, equipment and medium |
| CN113438503A (en) * | 2021-05-28 | 2021-09-24 | 曙光网络科技有限公司 | Video file restoration method and device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106686395B (en) | 2019-12-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106686395B (en) | live illegal video detection method and system | |
| CN113068052B (en) | Method for determining brushing amount of live broadcast room, live broadcast method and data processing method | |
| CN105915953B (en) | Method, device, system, server and storage medium for live video identification | |
| CN106060442B (en) | Video storage method, device and system | |
| CN110213522B (en) | Video data processing method and device and related equipment | |
| CN108920937A (en) | Screen projection system, screen projection method and screen projection device | |
| CN105308980A (en) | Real-time anti-piracy for broadcast streams | |
| CN110418153B (en) | Watermark adding method, device, equipment and storage medium | |
| CN109729376B (en) | Life cycle processing method, life cycle processing device, life cycle processing equipment and life cycle processing storage medium | |
| CN106993202B (en) | Method and device for recommending home page | |
| DE102012218436B4 (en) | Method, device and computer program product for distributing licensed content among several units | |
| CN107613314B (en) | A kind of method and device detecting brush popularity behavior in live streaming | |
| CN108156469B (en) | Method and device for detecting validity of live broadcast | |
| CN113067808A (en) | Data processing method, live broadcast method, authentication server and live broadcast data server | |
| CN110944217A (en) | Live broadcast information processing method and device, server and storage medium | |
| CN105844121A (en) | Method and system for applying digital watermark to content delivery network (CDN) | |
| CN111432228A (en) | Method, device and equipment for matching anchor and storage medium | |
| CN112165625A (en) | Live broadcast room display method, system, equipment and medium | |
| CN106921867A (en) | A kind of video representativeness picture, fragment determine method and apparatus | |
| CN105872537A (en) | Video playing method, device and system | |
| CN114786038A (en) | Low-custom live broadcast behavior monitoring method based on deep learning | |
| US20070174877A1 (en) | Device and method for automatically obtaining information relating to the audiences of programs transmitted by a communication network | |
| CN107124660B (en) | Method and device for triggering broadcast information of live broadcast room | |
| CN112533018A (en) | Method and device for processing data of live broadcast room | |
| CN112995686B (en) | Data processing method, live broadcast method, authentication server and live broadcast data server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |