CN112711964A - Face tracking monitoring system and method - Google Patents

Face tracking monitoring system and method Download PDF

Info

Publication number
CN112711964A
CN112711964A CN201911018280.8A CN201911018280A CN112711964A CN 112711964 A CN112711964 A CN 112711964A CN 201911018280 A CN201911018280 A CN 201911018280A CN 112711964 A CN112711964 A CN 112711964A
Authority
CN
China
Prior art keywords
face image
face
definition
preset
image set
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911018280.8A
Other languages
Chinese (zh)
Inventor
肖新朋
王浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Zongbao Technology Co ltd
Original Assignee
Shanghai Zongbao Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Zongbao Technology Co ltd filed Critical Shanghai Zongbao Technology Co ltd
Priority to CN201911018280.8A priority Critical patent/CN112711964A/en
Publication of CN112711964A publication Critical patent/CN112711964A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/292Multi-camera tracking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/70Multimodal biometrics, e.g. combining information from different biometric modalities
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30232Surveillance

Abstract

The invention provides a face tracking monitoring system and a method, which relate to the field of security monitoring, and the system comprises: the device comprises a camera device, a main control module, a storage module and a terminal; the storage module is used for storing a preset face image, the camera device comprises a main camera and a plurality of groups of auxiliary cameras, the main camera is used for shooting a panoramic image, and the auxiliary cameras are used for shooting a high-definition face image; the main control module comprises a face recognition module and a comparison module, and the face recognition module is used for recognizing a face image in the panoramic image; the comparison module is used for comparing the face image in the panoramic image with face contour information of a preset face image in the storage module and comparing the high-definition face image with pupil iris information; the terminal is used for receiving the face image and the high-definition face image. The face monitoring system is used for solving the technical problems that the face distribution control technology in the prior art is not mature enough, the suspect cannot be shot flexibly and freely in real time, and the suspect cannot be monitored.

Description

Face tracking monitoring system and method
Technical Field
The invention relates to the field of security monitoring, in particular to a face tracking monitoring system and a face tracking monitoring method.
Background
With the development of economy, the speed of urban construction is accelerated, so that the population in cities is dense, the number of floating population is increased, the social crime rate is increased year by year, and the urban management problems of traffic, social security, key area precaution and the like in urban construction are caused. Aiming at the conditions that criminals have strong mobility, the conditions are complex, key personnel are difficult to deploy and control and the like, the current popular method is to establish a set of efficient video monitoring system platform.
The high-definition popularization of a large number of safe cities and social monitoring provides a foundation for face recognition application. After a case, the face recognition contrast is extracted by using video recording, and suspected persons can be effectively positioned by using face bayonet track clue analysis and the like. The human face real-time distribution and control system can be widely applied to places such as shopping malls, hotels, internet cafes, rental houses, bus stations, train stations, squares, traffic key roads and the like.
However, the face control system has many limitations, such as: people are required to play back video and manually search for suspects, which is a great workload when people flow more; the video monitoring camera cannot automatically focus and track shooting, so that transient image blurring and local amplification blurring are caused, and especially the shooting of human faces is realized; the system can not photograph the suspect in real time, flexibly and freely, and can not play a role in monitoring the suspect. Therefore, it is necessary to improve a face arrangement control system, further process and identify the shot picture, and realize tracking and high-definition shooting of the target person.
Disclosure of Invention
In view of the above drawbacks of the prior art, an object of the present invention is to provide a face tracking and monitoring system and method, which are used to solve the technical problems that the face distribution and control technology in the prior art is not mature enough, and cannot flexibly and freely photograph a suspect in real time, and even cannot monitor the suspect.
The invention provides a face tracking monitoring system, which comprises: the device comprises a camera device, a main control module, a storage module and a terminal;
the storage module is used for storing a preset face image, and the preset face image comprises face contour information and pupil iris information;
the camera device comprises a main camera and a plurality of groups of auxiliary cameras, wherein the main camera is used for shooting panoramic images in a monitoring range, and the auxiliary cameras are used for shooting high-definition face images;
the main control module comprises a face recognition module and a comparison module,
the face recognition module is used for recognizing a face image in the panoramic image;
the comparison module is used for comparing the face image in the panoramic image with face contour information of a preset face image in the storage module and comparing the high-definition face image with pupil iris information;
the terminal is used for receiving the face image and the high-definition face image.
In an embodiment of the present invention, the number of the predetermined face images may be one or more, which is determined by the number of people to track and search.
In an embodiment of the present invention, the sub camera includes a focus tracking chip and a focus control chip, and tracks and focuses the face image in the panoramic image.
A face tracking monitoring method, the method comprising:
step 1: the method comprises the steps that a main camera shoots to form a panoramic image, and the panoramic image is transmitted to a face recognition module;
step 2: the face recognition module recognizes a face in the panoramic image to obtain a face image set;
and step 3: the comparison module compares the face image set with face contour information of a preset face image to obtain a similar face image set;
and 4, step 4: tracking the similar face image set by the auxiliary camera, and carrying out focusing shooting on the similar face image set to obtain a high-definition face image set;
and 5: and the comparison module acquires the high-definition face image set and compares the pupil iris information of the preset face image to obtain a suspected face image.
In an embodiment of the present invention, the step 3 specifically includes:
the comparison module acquires a face image set and face contour information of a preset face image;
comparing the face contour information in the face image set with the face contour information of a preset face image one by one;
obtaining a similar face image set similar to face contour information of a preset face image;
and sending the similar face image set to a terminal.
In an embodiment of the present invention, the step 4 specifically includes:
the multiple groups of auxiliary cameras respectively track different faces in the similar face image set;
and automatically focusing and shooting according to the distance of the human face to obtain a plurality of high-definition human face images so as to form a high-definition human face image set.
In an embodiment of the present invention, the step 5 specifically includes:
the comparison module acquires a high-definition face image set and pupil iris information of a preset face image;
comparing the pupil iris information in the high-definition face image set with the pupil iris information of a preset face image one by one,
obtaining a suspected face image which is the same as pupil iris information of a preset face image;
and sending the suspected face image to a terminal.
As described above, the present invention has the following advantageous effects:
1. the invention adopts a plurality of groups of auxiliary cameras to assist the main camera to shoot, overcomes the defects of the main camera, realizes shooting of a panoramic picture, and simultaneously can track and shoot the face of a target person to obtain a high-definition picture.
2. According to the invention, the shot face image is compared with the preset face image for two times, and a plurality of similar faces can be screened out after the face contour information is compared for one time; then, a high-definition face image is obtained through tracking shooting of the auxiliary camera, a target person can be basically determined after the image is compared with the pupil iris information, and the effect of achieving double results with little effort is achieved.
Drawings
Fig. 1 is a schematic diagram of a module structure disclosed in the present invention.
FIG. 2 is a schematic flow chart of the present disclosure.
Description of the element reference numerals
1-a camera device; 11-a main camera; 12-secondary camera; 121-focus tracking chip; 122-focus control chip; 2-a main control module; 21-a face recognition module; 22-a comparison module; 3-a storage module; 4-a terminal;
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
Referring to fig. 1 and fig. 2, the present invention provides a face tracking monitoring system, which includes: the device comprises a camera device 1, a main control module 2, a storage module 3 and a terminal 4;
the storage module 3 is used for storing a preset face image, wherein the preset face image comprises face contour information and pupil iris information;
specifically, the number of the preset face images can be one or more, and is determined by the number of tracked and searched people; the face contour information to be entered includes: face, eyes, nose, mouth, ears, eyebrows, etc.
The camera device 1 comprises a main camera 11 and a plurality of groups of auxiliary cameras 12, wherein the main camera 11 is used for shooting panoramic images in a monitoring range, and the auxiliary cameras 12 are used for shooting high-definition face images;
preferably, the number of the auxiliary cameras 12 can be set to 4, and the auxiliary cameras are fixedly connected with the main camera 11, and the shooting ranges of the four auxiliary cameras 12 cover a panoramic picture shot by the main camera 11;
the sub-camera 12 includes a focus tracking chip 121 and a focus control chip 122, and is used for tracking and focusing a face image in a panoramic image.
The main control module 2 comprises a face recognition module 21 and a comparison module 22,
the face recognition module 21 is used for recognizing a face image in the panoramic image;
the comparison module 22 is used for comparing the face image in the panoramic image with face contour information of a preset face image in the storage module 3, and comparing the high-definition face image with pupil iris information;
the terminal 4 is used for receiving the face image and the high-definition face image, and the terminal 4 can be a mobile phone, a tablet computer, a palm computer, a desktop computer, a personal digital assistant and the like.
A face tracking monitoring method, the method comprising:
step 1: the main camera 11 shoots to form a panoramic image and transmits the panoramic image to the face recognition module 21;
step 2: the face recognition module 21 recognizes a face in the panoramic image to obtain a face image set;
and step 3: the comparison module 22 compares the face image set with face contour information of a preset face image to obtain a similar face image set;
and 4, step 4: the auxiliary camera 12 tracks the similar face image set and carries out focusing shooting on the similar face image set to obtain a high-definition face image set;
and 5: the comparison module 22 obtains the high-definition face image set and compares the pupil iris information of the preset face image to obtain a suspected face image.
The step 3 specifically comprises the following steps:
the comparison module 22 acquires face image sets and face contour information of preset face images;
comparing the face contour information in the face image set with the face contour information of a preset face image one by one;
obtaining a similar face image set similar to face contour information of a preset face image;
and sending the similar face image set to a terminal 4.
In this embodiment, the face image set includes a plurality of face images, and the plurality of face images are compared with one or more preset face images, where the comparison content is: information such as face shape, eyes, nose, mouth, ears, eyebrows, etc.; if the face image similar to the preset face image exists, the image is classified into a similar face image set. When a similar face image is detected, the sub-camera 12 is turned on.
Based on the above embodiment, the step 3 specifically includes:
the multiple groups of auxiliary cameras 12 respectively track different faces in the similar face image set;
and automatically focusing and shooting according to the distance of the human face to obtain a plurality of high-definition human face images so as to form a high-definition human face image set.
The working principle of the auxiliary camera 12 is as follows: according to the position of the similar face image in the panoramic image, the auxiliary cameras 12 are selectively opened, the focus tracking chip 121 marks and tracks the similar face image in the monitoring range, meanwhile, the focusing control chip 122 controls the auxiliary cameras 12 to adjust the focal length according to the distance of a target, focusing shooting is carried out on the target face to obtain a high-definition face image, and a high-definition face image set is formed by a plurality of groups of high-definition face images shot by the auxiliary cameras 12.
Based on the above embodiment, the step 4 specifically includes:
the comparison module 22 acquires the high-definition face image set and the pupil iris information of the preset face image;
comparing the pupil iris information in the high-definition face image set with the pupil iris information of a preset face image one by one,
obtaining a suspected face image which is the same as pupil iris information of a preset face image;
and sending the suspected face image to a terminal 4.
In the embodiment, a final suspected face image is obtained after pupil iris information comparison;
the terminal 4 can immediately receive the similar face image set and the suspected face image, and can capture the target person according to the two images and the specific position.
In summary, the shot face image is compared with the preset face image for two times, and a plurality of similar faces can be screened out after the face outline information is compared for one time; then, a high-definition face image is obtained through tracking shooting of the auxiliary camera 12, a target person can be basically determined after the image is compared with the pupil iris information, labor cost and time cost are saved, and the effect of achieving double results with half the effort is achieved. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.

Claims (7)

1. A face tracking monitoring system, the system comprising: the device comprises a camera device, a main control module, a storage module and a terminal;
the storage module is used for storing a preset face image, and the preset face image comprises face contour information and pupil iris information;
the camera device comprises a main camera and a plurality of groups of auxiliary cameras, wherein the main camera is used for shooting panoramic images in a monitoring range, and the auxiliary cameras are used for shooting high-definition face images;
the main control module comprises a face recognition module and a comparison module,
the face recognition module is used for recognizing a face image in the panoramic image;
the comparison module is used for comparing the face image with face contour information of a preset face image in the storage module and comparing a high-definition face image with pupil iris information;
the terminal is used for receiving the face image and the high-definition face image.
2. The method of claim 1, wherein: the number of the preset face images can be one or more.
3. The method of claim 1, wherein: the auxiliary camera comprises a focus tracking chip and a focusing control chip and is used for tracking and focusing the face image in the panoramic image.
4. A face tracking monitoring method applied to the system according to any one of claims 1 to 3, wherein the method comprises:
step 1: the method comprises the steps that a main camera shoots to form a panoramic image, and the panoramic image is transmitted to a face recognition module;
step 2: the face recognition module recognizes a face in the panoramic image to obtain a face image set;
and step 3: the comparison module compares the face image set with face contour information of a preset face image to obtain a similar face image set;
and 4, step 4: tracking the similar face image set by the auxiliary camera, and carrying out focusing shooting on the similar face image set to obtain a high-definition face image set;
and 5: and the comparison module compares the high-definition face image set with the pupil iris information of the preset face image to obtain a suspected face image.
5. The method according to claim 4, wherein the step 3 specifically comprises:
the comparison module acquires a face image set and face contour information of a preset face image;
comparing the face contour information in the face image set with the face contour information of a preset face image one by one;
obtaining a similar face image set similar to face contour information of a preset face image;
and sending the similar face image set to a terminal.
6. The method of claim 4, wherein: the step 4 specifically includes:
the multiple groups of auxiliary cameras respectively track different faces in the similar face image set;
and automatically focusing and shooting according to the distance of the human face to obtain a plurality of high-definition human face images so as to form a high-definition human face image set.
7. The method of claim 4, wherein: the step 5 specifically includes:
the comparison module acquires a high-definition face image set and pupil iris information of a preset face image;
comparing the pupil iris information in the high-definition face image set with the pupil iris information of a preset face image one by one;
obtaining a suspected face image which is the same as pupil iris information of a preset face image;
and sending the suspected face image to a terminal.
CN201911018280.8A 2019-10-24 2019-10-24 Face tracking monitoring system and method Pending CN112711964A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911018280.8A CN112711964A (en) 2019-10-24 2019-10-24 Face tracking monitoring system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911018280.8A CN112711964A (en) 2019-10-24 2019-10-24 Face tracking monitoring system and method

Publications (1)

Publication Number Publication Date
CN112711964A true CN112711964A (en) 2021-04-27

Family

ID=75541489

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911018280.8A Pending CN112711964A (en) 2019-10-24 2019-10-24 Face tracking monitoring system and method

Country Status (1)

Country Link
CN (1) CN112711964A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113476037A (en) * 2021-06-29 2021-10-08 京东方科技集团股份有限公司 Sleep monitoring method based on child sleep system and terminal processor
CN114285998A (en) * 2021-12-24 2022-04-05 申通庞巴迪(上海)轨道交通车辆维修有限公司 Compartment dynamic portrait grabbing and positioning following view screen monitoring system

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202939756U (en) * 2012-11-29 2013-05-15 长安大学 Dual-video-head target invasion recording system
CN104519326A (en) * 2015-01-09 2015-04-15 成都新舟锐视科技有限公司 Target tracking method combined with multi-monitoring probe system
CN105245850A (en) * 2015-10-27 2016-01-13 太原市公安局 Method, device and system for tracking target across surveillance cameras
CN106060470A (en) * 2016-06-24 2016-10-26 邵文超 Video monitoring method and system
CN106250851A (en) * 2016-08-01 2016-12-21 徐鹤菲 A kind of identity identifying method, equipment and mobile terminal
CN205883437U (en) * 2016-06-24 2017-01-11 邵文超 Video monitoring device
CN106650671A (en) * 2016-12-27 2017-05-10 深圳英飞拓科技股份有限公司 Human face identification method, apparatus and system
CN108040211A (en) * 2018-01-30 2018-05-15 广州市君望机器人自动化有限公司 A kind of face tracking camera and face tracking system
CN108419014A (en) * 2018-03-20 2018-08-17 北京天睿空间科技股份有限公司 The method for capturing face using panoramic camera and the linkage of Duo Tai candid cameras
CN109426769A (en) * 2017-08-24 2019-03-05 合肥虹慧达科技有限公司 The iris identification method and iris authentication system of face auxiliary
CN109635739A (en) * 2018-12-13 2019-04-16 深圳三人行在线科技有限公司 A kind of method for collecting iris and equipment
CN109685033A (en) * 2018-12-29 2019-04-26 深圳三人行在线科技有限公司 Iris identification equipment and method
CN109711290A (en) * 2018-12-13 2019-05-03 深圳三人行在线科技有限公司 A kind of iris identification method and equipment based on dual camera
CN110177257A (en) * 2019-06-26 2019-08-27 北京深醒科技有限公司 A kind of multiple-camera video monitoring apparatus and its human body tracing method

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202939756U (en) * 2012-11-29 2013-05-15 长安大学 Dual-video-head target invasion recording system
CN104519326A (en) * 2015-01-09 2015-04-15 成都新舟锐视科技有限公司 Target tracking method combined with multi-monitoring probe system
CN105245850A (en) * 2015-10-27 2016-01-13 太原市公安局 Method, device and system for tracking target across surveillance cameras
CN106060470A (en) * 2016-06-24 2016-10-26 邵文超 Video monitoring method and system
CN205883437U (en) * 2016-06-24 2017-01-11 邵文超 Video monitoring device
CN106250851A (en) * 2016-08-01 2016-12-21 徐鹤菲 A kind of identity identifying method, equipment and mobile terminal
CN106650671A (en) * 2016-12-27 2017-05-10 深圳英飞拓科技股份有限公司 Human face identification method, apparatus and system
CN109426769A (en) * 2017-08-24 2019-03-05 合肥虹慧达科技有限公司 The iris identification method and iris authentication system of face auxiliary
CN108040211A (en) * 2018-01-30 2018-05-15 广州市君望机器人自动化有限公司 A kind of face tracking camera and face tracking system
CN108419014A (en) * 2018-03-20 2018-08-17 北京天睿空间科技股份有限公司 The method for capturing face using panoramic camera and the linkage of Duo Tai candid cameras
CN109635739A (en) * 2018-12-13 2019-04-16 深圳三人行在线科技有限公司 A kind of method for collecting iris and equipment
CN109711290A (en) * 2018-12-13 2019-05-03 深圳三人行在线科技有限公司 A kind of iris identification method and equipment based on dual camera
CN109685033A (en) * 2018-12-29 2019-04-26 深圳三人行在线科技有限公司 Iris identification equipment and method
CN110177257A (en) * 2019-06-26 2019-08-27 北京深醒科技有限公司 A kind of multiple-camera video monitoring apparatus and its human body tracing method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113476037A (en) * 2021-06-29 2021-10-08 京东方科技集团股份有限公司 Sleep monitoring method based on child sleep system and terminal processor
CN114285998A (en) * 2021-12-24 2022-04-05 申通庞巴迪(上海)轨道交通车辆维修有限公司 Compartment dynamic portrait grabbing and positioning following view screen monitoring system

Similar Documents

Publication Publication Date Title
AU2017250159B2 (en) Video recording method, server, system, and storage medium
Shu et al. Large-scale spatio-temporal person re-identification: Algorithms and benchmark
JP7261296B2 (en) Target object recognition system, method, apparatus, electronic device, and recording medium
CN107169458B (en) Data processing method, device and storage medium
CN108564052A (en) Multi-cam dynamic human face recognition system based on MTCNN and method
Hsu et al. DroneFace: an open dataset for drone research
US9965494B2 (en) Sharing photos
CN109635686A (en) In conjunction with two stages pedestrian's searching method of face and appearance
CN108921038A (en) A kind of classroom based on deep learning face recognition technology is quickly called the roll method of registering
CN106951846A (en) A kind of face 3D models typing and recognition methods and device
CN107451527A (en) A kind of large-scale public place hunting system based on unmanned plane
CN112711964A (en) Face tracking monitoring system and method
Wang et al. Mask-RCNN based people detection using a top-view fisheye camera
CN107820008A (en) A kind of machine room monitoring system and method
CN106385561A (en) Public place video monitoring platform
CN108363771B (en) Image retrieval method for public security investigation application
CN105072478A (en) Life recording system and method based on wearable equipment
CN104765739B (en) Extensive face database search method based on shape space
CN105245845A (en) Method for controlling camera to follow and shoot automatically based on gathering trend in match field
Zheng et al. UAVM'23: 2023 Workshop on UAVs in Multimedia: Capturing the World from a New Perspective
CN110929711B (en) Method for automatically associating identity information and shape information applied to fixed scene
CN110245648A (en) The alert system of wisdom list based on Identification of Images
Shah et al. Video Stitching with Localized 360o Model for Intelligent Car Parking Monitoring and Assistance System
CN202472689U (en) Face posture detection system
CN115272949A (en) Pedestrian tracking method and system based on geographic spatial information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination