CN109151407B - Video data acquisition system - Google Patents

Video data acquisition system Download PDF

Info

Publication number
CN109151407B
CN109151407B CN201811307807.4A CN201811307807A CN109151407B CN 109151407 B CN109151407 B CN 109151407B CN 201811307807 A CN201811307807 A CN 201811307807A CN 109151407 B CN109151407 B CN 109151407B
Authority
CN
China
Prior art keywords
video data
camera
management device
media server
streaming media
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811307807.4A
Other languages
Chinese (zh)
Other versions
CN109151407A (en
Inventor
杨小龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou Gainet Network Technology Co ltd
Original Assignee
Zhengzhou Gainet Network Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou Gainet Network Technology Co ltd filed Critical Zhengzhou Gainet Network Technology Co ltd
Priority to CN201811307807.4A priority Critical patent/CN109151407B/en
Publication of CN109151407A publication Critical patent/CN109151407A/en
Application granted granted Critical
Publication of CN109151407B publication Critical patent/CN109151407B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a video data acquisition system, comprising: the system comprises a camera, management equipment and a streaming media server, wherein the camera is used for collecting video data, the management equipment is used for acquiring the video data collected by the camera in real time and uploading the video data to a public network, and the streaming media server intercepts the video data on the public network and stores the video data. Therefore, the system can upload the video data acquired by the camera to the public network, and intercept and store the video data by using the streaming media server, so that the problems of resource surplus or video data loss and the like caused by fixed local storage space are avoided, and the performance of the video data acquisition system is improved.

Description

Video data acquisition system
Technical Field
The invention relates to the field of monitoring, in particular to a video data acquisition system.
Background
Generally, after the deployment of the monitoring system is completed, the local network cameras need to manage and store the accessed cameras, play back in real time, view return visit information and the like.
At present, the monitoring industry company Dahua and Haikangwei adopts a self-service production network camera (nvr) for management and storage, and real-time playing and viewing return visit information.
However, the conventional nvr stores video data locally, whereas the nvr local storage is fixed, so that after a hard disk is installed, if the usage is small, resources are excessive, and if the usage is excessive, the video data cannot be stored in time, so that the video data is lost. The above problems can be solved by customizing the device, but the overhead is large.
Therefore, the conventional network camera stores video data locally, and the local storage space is fixed, which may cause the problems of resource surplus or video data loss.
Disclosure of Invention
The invention aims to provide a video data acquisition system, which is used for solving the problem that the existing network camera stores video data locally, but the local storage space is fixed, so that the resource excess or the video data loss can be caused.
In order to solve the above technical problem, the present invention provides a video data acquisition system, including: the system comprises a camera, a management device and a streaming media server;
the camera is in communication connection with the management equipment in advance and is used for collecting video data;
the management equipment is used for acquiring the video data in real time and uploading the video data to a public network;
the streaming media server is used for intercepting the video data on the public network and storing the video data.
Preferably, the management device is specifically configured to obtain the video data in real time, set a camera mark for the video data, and further upload the video data to a public network, where the camera mark is identification information of a camera used for acquiring the video data;
the streaming media server is used for intercepting video data on the public network, setting a management equipment mark for the video data and further storing the video data, wherein the management equipment mark is identification information of management equipment used for acquiring the video data in real time.
Preferably, the streaming media server is further configured to store an upload state of the video data, where the upload state includes that uploading is being performed and uploading is completed.
Preferably, the system further comprises a client;
the client is used for sending an acquisition request of target video data to the streaming media server;
the streaming media server is configured to analyze an acquisition request of the target video data, determine whether the target video data is currently uploaded video data, determine a management device flag and a camera flag of the target video data when it is determined that the target video data is currently uploaded video data, and send a live broadcast instruction to a management device provided with the management device flag, where the live broadcast instruction includes the camera flag and identification information of the client;
and the management equipment responds to the live broadcast instruction, establishes communication connection with the client according to the identification information of the client, and sends the video data acquired by the camera provided with the camera mark to the client in real time.
Preferably, the number of the management devices is plural.
Preferably, the power supply parameter of the management device is DC5V 2A.
Preferably, the management device is specifically configured to send a communication connection request based on an onvif protocol to a camera within a range of a current local area network, and a target camera establishes a communication connection with the management device in response to the communication connection request, where the target camera is a camera within the range of the current local area network and supports the onvif protocol.
Preferably, the cameras and the management device are in the same network segment, and the number of the cameras is any positive integer between 1 and N, where N is M-2, and M is the total ip address of the network segment.
The invention provides a video data acquisition system, which comprises: the system comprises a camera, management equipment and a streaming media server, wherein the camera is used for collecting video data, the management equipment is used for acquiring the video data collected by the camera in real time and uploading the video data to a public network, and the streaming media server intercepts the video data on the public network and stores the video data. Therefore, the system can upload the video data acquired by the camera to the public network, and intercept and store the video data by using the streaming media server, so that the problems of resource surplus or video data loss and the like caused by fixed local storage space are avoided, and the performance of the video data acquisition system is improved.
Drawings
In order to more clearly illustrate the embodiments or technical solutions of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a video data acquisition system according to a first embodiment of the present invention;
fig. 2 is a schematic structural diagram of a second embodiment of a video data acquisition system according to the present invention;
fig. 3 is a schematic diagram illustrating a process of establishing a communication connection in a second embodiment of a video data acquisition system according to the present invention;
fig. 4 is a schematic diagram of a video data acquisition process in a second embodiment of a video data acquisition system according to the present invention;
fig. 5 is a schematic diagram of a data structure of a streaming media server in a second embodiment of a video data acquisition system according to the present invention;
fig. 6 is a schematic flow chart illustrating a streaming media server processing a client request according to a second embodiment of the video data acquisition system of the present invention.
Detailed Description
The core of the invention is to provide a video data acquisition system, which realizes the purpose of storing video data in a cloud server, avoids the problems of resource surplus or video data loss and the like caused by fixed local storage space, and improves the performance of the video data acquisition system.
In order that those skilled in the art will better understand the disclosure, the invention will be described in further detail with reference to the accompanying drawings and specific embodiments. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a first embodiment of a video data acquisition system according to the present invention is described as follows, where the first embodiment includes: camera 101, management equipment 102, streaming media server 103.
The camera 101 establishes a communication connection with the management device 102 in advance, and the camera 101 is used for acquiring video data; the management device 102 is configured to obtain the video data in real time and upload the video data to a public network; the streaming media server 103 is configured to intercept video data on the public network and store the video data.
In this embodiment, the streaming media server 103 mainly functions to transmit a video file to the client via a streaming protocol (RTP/RTSP, MMS, RTMP, etc.) for online viewing by the user, and also may receive a real-time video stream from the video capture and compression software, and then live broadcast to the client via the streaming protocol.
It can be seen that, the present embodiment provides a video data acquisition system, including: the system comprises a camera, management equipment and a streaming media server, wherein the camera is used for collecting video data, the management equipment is used for acquiring the video data collected by the camera in real time and uploading the video data to a public network, and the streaming media server intercepts the video data on the public network and stores the video data. Therefore, the system can upload the video data acquired by the camera to the public network, and intercept and store the video data by using the streaming media server, so that the problems of resource surplus or video data loss and the like caused by fixed local storage space are avoided, and the performance of the video data acquisition system is improved.
An embodiment of a video data acquisition system provided by the present invention is described in detail below, and referring to fig. 2, the embodiment two specifically includes: a plurality of cameras 201, a management device 202, a streaming server 203, and a client 204.
The camera 201 and the management device 202 are in the same local area network, and communication connection is established between the camera 201 and the management device in advance. In this embodiment, the specific establishment manner of the communication connection may be:
as shown in fig. 3, it is assumed that there are 1 management device 202 and m cameras in the current local area network, where the cameras include both a camera supporting the onvif protocol and a camera not supporting the onvif protocol, and the camera supporting the onvif protocol is hereinafter referred to as a target camera 201. In the process of establishing a communication connection, a communication connection request based on the onvif protocol is sent by the management apparatus 202 to all camera heads within the range of the current local area network. Then, the target camera 201 establishes a communication connection with the management device 202 in response to the communication connection request, and a camera that does not support the onvif protocol does not establish the communication connection, as shown in fig. 3, both the camera 2 and the camera m establish a communication connection with the management device 202, and the camera 1 does not establish a communication connection with the management device 202. The establishment of the communication connection is realized up to this point, obviously, the camera that does not support the onvif protocol is not a component of the system, and it should be noted that the cameras mentioned below all refer to the cameras that support the onvif protocol, that is, the target cameras.
It is known that the existing webcam allows a small number of cameras to be accessed, generally only 4-16 camera devices are supported, and if the number exceeds the number, new devices need to be customized or developed, which is very costly.
For the above problem, in this embodiment, the common protocol of the cameras, that is, the ovif protocol, is used to transmit the video information of the cameras, and since the onnvif protocol is not limited by the number of the devices, it is only necessary to ensure that the devices are in the same network segment. One network segment includes 255 ip addresses, one gateway occupies one gateway, and one management device 202 occupies one management device, so that 253 cameras can occupy, that is, the maximum access number of the cameras 201 in this embodiment is 253, which greatly improves the access number, and has low cost.
The following describes a video data acquisition process by taking a single communication link as an example, and as shown in fig. 4, the process specifically includes:
the camera 201 collects video data, the management device 202 acquires the video data in real time, sets a camera mark for the video data, and further uploads the video data to the public network, and the streaming media server 203 intercepts the video data on the public network, sets a management device mark for the video data, and further stores the video data. The camera mark is identification information of a camera used for collecting the video data, and the management equipment mark is identification information of management equipment used for acquiring the video data in real time.
As shown in fig. 5, the video data acquired by one management apparatus 202 includes video data acquired by a plurality of cameras 201, and the video data acquired by one camera 201 includes a plurality of pieces of video data.
As shown in fig. 2, the video data acquisition system provided by this embodiment further includes a client 204, where the client 204 is configured to send a request for obtaining video data to the streaming media server 203, and obtain the video data through the management device 202 or the streaming media server 203.
Considering that a user may want to acquire live video data and may want to play back historical video data, the streaming media server 203 of this embodiment may store, in addition to the management device flag and the camera flag, an upload status of video data, that is, a parameter reflecting whether the management device completes a complete upload of certain video data, specifically, the upload status includes that the upload is in progress and the upload is completed.
Let the video data that the client 204 wants to obtain be called target video data, then, after receiving the obtaining request of the target video data sent by the client 204, the streaming media server 203 may first obtain an uploading state of the target video data, and determine how to return the target video data to the client according to the uploading state, as shown in fig. 6, the process mainly includes:
step S601: and receiving an acquisition request of target video data sent by a client.
Step S602: acquiring the uploading state of the target video data, and judging whether the uploading state is uploading, if so, entering step S603, otherwise, entering step S605.
Step S603: and determining a management device mark and a camera mark of the target video data, and sending a live broadcast instruction to the management device provided with the management device mark.
Wherein the live command includes the camera mark and identification information of the client.
Step S604: and the management equipment responds to the live broadcast instruction, establishes communication connection with the client according to the identification information of the client, and sends the video data acquired by the camera provided with the camera mark to the client in real time.
Step S605: and acquiring the target video data and sending the target video data to the client.
Finally, it is worth mentioning that the number of the management devices 202 in this embodiment may be multiple, that is, the streaming media server 203 is connected to multiple management devices 202, and each management device 202 is responsible for acquiring video data acquired by a camera within a range of a local area network thereof and uploading the video data to a public network, so that the streaming media server 203 intercepts and stores the video data.
In addition, considering that the power consumption of the current network camera is higher, generally being DC122A, the power supply parameter of the management device 202 in this embodiment may be DC5V2A, which greatly reduces the power consumption and saves the video capture cost.
In summary, the embodiment provides a video acquisition system, which significantly improves the access number of the cameras, and by uploading video data to the public network, the problem of resource surplus or resource shortage caused by fixed local storage space is avoided, in addition, power consumption is reduced, and the cost of video acquisition is saved.
The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The video capture system provided by the invention is described in detail above. The principles and embodiments of the present invention are explained herein using specific examples, which are presented only to assist in understanding the method and its core concepts. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.

Claims (5)

1. A video data acquisition system, comprising: the system comprises a camera, a management device and a streaming media server;
the camera is in communication connection with the management equipment in advance and is used for collecting video data;
the management equipment is used for acquiring the video data in real time and uploading the video data to a public network;
the streaming media server is used for intercepting video data on the public network and storing the video data;
the management device is specifically configured to obtain the video data in real time, set a camera mark for the video data, and further upload the video data to a public network, where the camera mark is identification information of a camera used for acquiring the video data;
the streaming media server is used for intercepting video data on the public network, setting a management equipment mark for the video data and further storing the video data, wherein the management equipment mark is identification information of management equipment used for acquiring the video data in real time;
the streaming media server is also used for storing the uploading state of the video data, and the uploading state comprises the uploading and the completion of the uploading;
the system further comprises a client;
the client is used for sending an acquisition request of target video data to the streaming media server;
the streaming media server is configured to analyze an acquisition request of the target video data, determine whether the target video data is currently uploaded video data, determine a management device flag and a camera flag of the target video data when it is determined that the target video data is currently uploaded video data, and send a live broadcast instruction to a management device provided with the management device flag, where the live broadcast instruction includes the camera flag and identification information of the client;
and the management equipment responds to the live broadcast instruction, establishes communication connection with the client according to the identification information of the client, and sends the video data acquired by the camera provided with the camera mark to the client in real time.
2. The system of claim 1, wherein the number of management devices is plural.
3. The system of claim 1, wherein the power parameter of the management device is DC5V 2A.
4. The system according to any one of claims 1 to 3, wherein the management device is specifically configured to send a communication connection request based on an onvif protocol to a camera within a range of a current local area network, and a target camera establishes a communication connection with the management device in response to the communication connection request, wherein the target camera is a camera within the range of the current local area network and supporting the onvif protocol.
5. The system of claim 4, wherein the cameras are in the same network segment as the management device, and the number of the cameras is any positive integer between 1 and N, where N is M-2 and M is the total number of ip addresses of the network segment.
CN201811307807.4A 2018-11-05 2018-11-05 Video data acquisition system Active CN109151407B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811307807.4A CN109151407B (en) 2018-11-05 2018-11-05 Video data acquisition system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811307807.4A CN109151407B (en) 2018-11-05 2018-11-05 Video data acquisition system

Publications (2)

Publication Number Publication Date
CN109151407A CN109151407A (en) 2019-01-04
CN109151407B true CN109151407B (en) 2020-11-06

Family

ID=64807788

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811307807.4A Active CN109151407B (en) 2018-11-05 2018-11-05 Video data acquisition system

Country Status (1)

Country Link
CN (1) CN109151407B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109688482B (en) * 2019-01-10 2021-12-24 南京三宝弘正视觉科技有限公司 Video management device, system and method based on fog computing architecture

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2712528A1 (en) * 2010-08-19 2012-02-19 John Phillips Camera installation device
CN104104926A (en) * 2014-07-30 2014-10-15 浙江宇视科技有限公司 Universal plug and play (UPnP) monitoring terminal access method and access device
CN104219477A (en) * 2014-09-11 2014-12-17 太仓思比科微电子技术有限公司 Remote memory system applied to robot monitoring module
CN105307010A (en) * 2015-11-14 2016-02-03 华中科技大学 System and method for uploading video of cloud video living broadcast platform
CN105657440A (en) * 2016-01-05 2016-06-08 福建星网智慧科技股份有限公司 Video broadcast method and system
CN106060076A (en) * 2016-07-11 2016-10-26 北京工商大学 Real-time streaming media multi-path forwarding method and system based on HIKVISION equipment
CN205986953U (en) * 2016-08-15 2017-02-22 浙江工业大学 Thing networking data host computer
US9860490B2 (en) * 2010-11-05 2018-01-02 Tom Galvin Network video recorder system
CN107566786A (en) * 2017-08-11 2018-01-09 深圳英飞拓科技股份有限公司 A kind of method, apparatus and terminal device for obtaining monitor video
CN108183913A (en) * 2018-01-04 2018-06-19 深圳前海安托邦网络科技有限公司 A kind of LAN video camera carries out the management system and method for network flow-medium live streaming

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2712528A1 (en) * 2010-08-19 2012-02-19 John Phillips Camera installation device
US9860490B2 (en) * 2010-11-05 2018-01-02 Tom Galvin Network video recorder system
CN104104926A (en) * 2014-07-30 2014-10-15 浙江宇视科技有限公司 Universal plug and play (UPnP) monitoring terminal access method and access device
CN104219477A (en) * 2014-09-11 2014-12-17 太仓思比科微电子技术有限公司 Remote memory system applied to robot monitoring module
CN105307010A (en) * 2015-11-14 2016-02-03 华中科技大学 System and method for uploading video of cloud video living broadcast platform
CN105657440A (en) * 2016-01-05 2016-06-08 福建星网智慧科技股份有限公司 Video broadcast method and system
CN106060076A (en) * 2016-07-11 2016-10-26 北京工商大学 Real-time streaming media multi-path forwarding method and system based on HIKVISION equipment
CN205986953U (en) * 2016-08-15 2017-02-22 浙江工业大学 Thing networking data host computer
CN107566786A (en) * 2017-08-11 2018-01-09 深圳英飞拓科技股份有限公司 A kind of method, apparatus and terminal device for obtaining monitor video
CN108183913A (en) * 2018-01-04 2018-06-19 深圳前海安托邦网络科技有限公司 A kind of LAN video camera carries out the management system and method for network flow-medium live streaming

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
互联网电子安防系统的设计与实现;柴琨;《中国优秀硕士学位论文全文数据库—信息科技辑》;20150815;第三章,第5.2节,第6.2.1节 *
柴琨.互联网电子安防系统的设计与实现.《中国优秀硕士学位论文全文数据库—信息科技辑》.2015, *

Also Published As

Publication number Publication date
CN109151407A (en) 2019-01-04

Similar Documents

Publication Publication Date Title
EP2688296B1 (en) Video monitoring system and method
EP3481033A1 (en) Base station, and method, apparatus and system for responding to access request
CN108632305B (en) Cloud storage system, media data storage method and system
JP5854194B2 (en) Surveillance camera system and monitoring method
KR20140052355A (en) System for providing video information using ip camera in cloud configuration method thereof
CN103067529A (en) Remote monitoring system
US10356368B2 (en) Method of video surveillance using cellular communication
CN114650592A (en) Wireless network time delay processing method, system and access server
WO2021093653A1 (en) Security method, apparatus and system easy to access by user
CN101867583B (en) Network video releasing method and system thereof
CN102387201B (en) The methods, devices and systems of business data processing
CN106331603A (en) Video monitoring method, apparatus, system and server
CN114339719A (en) DPI data acquisition method and related device
CN109151407B (en) Video data acquisition system
CN112468776A (en) Video monitoring processing method and device, storage medium and electronic device
CN109525862A (en) A kind of multiple terminals live streaming exchange method and system
CN106375933A (en) Projection control method of multiple intelligent hardware devices
CN102256103B (en) Application server and method for realizing camera control
KR101253133B1 (en) The monitoring system used to the cloud service, and its service method
CN115119054A (en) Video virtual dressing and background processing method and device based on IOS (input/output system)
CN210929133U (en) Live pig detection system
CN103248868A (en) Video monitoring system and method based on network file system
US10728438B1 (en) Distributed video and network camera management
CN112019797B (en) National education examination video cloud storage system
CN105872469A (en) System and method for monitoring distributed storage monitoring videos

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant