CN112954205A - Image acquisition device applied to pedestrian re-identification system - Google Patents
Image acquisition device applied to pedestrian re-identification system Download PDFInfo
- Publication number
- CN112954205A CN112954205A CN202110157342.4A CN202110157342A CN112954205A CN 112954205 A CN112954205 A CN 112954205A CN 202110157342 A CN202110157342 A CN 202110157342A CN 112954205 A CN112954205 A CN 112954205A
- Authority
- CN
- China
- Prior art keywords
- module
- facial
- image acquisition
- power supply
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- General Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
The invention discloses an image acquisition device applied to a pedestrian re-identification system, which comprises an operating system, a central processing unit, a power supply module, a database and a face image acquisition system, wherein the operating system is connected with the central processing unit, the central processing unit is respectively connected with the power supply module, a display module, the database and a data packet Ethernet exchange unit, the database is connected with the face image acquisition system, and the face image acquisition system is connected with a camera shooting unit; the facial image acquisition system comprises a facial feature identification module, a real three-dimensional facial reconstruction system, an attitude matching module, a feature point association module, a facial feature identification module, an expression dynamic tracking module and a structured light acquisition unit; and the facial feature recognition module is used for statically intercepting the dynamic image shot by the camera shooting unit. This be applied to image acquisition device of pedestrian recognition system again, reasonable in design can carry out pedestrian and discern again.
Description
Technical Field
The invention belongs to the technical field of image acquisition, and particularly relates to an image acquisition device applied to a pedestrian re-identification system.
Background
The image is also called a video, which is a reproduction of a substance perceived by a human being. The images can be acquired by optical devices such as cameras, mirrors, telescopes, microscopes, and the like; and the method can also be created manually, such as manually drawing images and the like. The image may be recorded, saved on paper media, film, etc., on media sensitive to light signals. The image designed professionally can be developed into visual language for communication between people, and a large amount of plane painting, three-dimensional sculpture and building in world art can be known.
With the development of society, the application of image acquisition technology is more and more extensive, but the current image acquisition device can not be used for re-identifying pedestrians, so that improvement is needed.
Disclosure of Invention
The present invention is directed to an image capturing device for use in a pedestrian re-identification system, so as to solve the problems mentioned in the background art.
In order to achieve the purpose, the invention provides the following technical scheme: an image acquisition device applied to a pedestrian re-identification system comprises an operating system, a central processing unit, a power supply module, a database and a face image acquisition system, wherein the operating system is connected with the central processing unit, the central processing unit is respectively connected with the power supply module, a display module, the database and a data packet Ethernet exchange unit, the database is connected with the face image acquisition system, and the face image acquisition system is connected with a camera shooting unit;
the facial image acquisition system comprises a facial feature identification module, a real three-dimensional facial reconstruction system, an attitude matching module, a feature point association module, a facial feature identification module, an expression dynamic tracking module and a structured light acquisition unit;
the facial feature recognition module is used for statically intercepting the dynamic image shot by the camera shooting unit and determining facial contour features and facial features through the human face image feature extraction unit;
the real three-dimensional face reconstruction system is used for establishing a three-dimensional face model according to the structured light imaging principle of the structured light acquisition unit;
the gesture matching module is used for selecting a plurality of active selection feature points of each facial feature part and determining the proportional relation between the three-dimensional coordinate value of each facial feature part and the three-dimensional coordinate value of the corresponding virtual feature part;
the characteristic point association module is used for associating the three-dimensional coordinate values of each facial characteristic part with the three-dimensional coordinate values of the corresponding virtual characteristic parts according to the proportional relation;
the expression dynamic tracking module is used for actively selecting a three-dimensional coordinate change value of the feature point in the three-dimensional coordinate system according to the facial feature part;
the structured light acquisition unit is used for acquiring the numerical value and the change of an optical signal of the human face in a dynamic image through a structured light imaging principle to capture facial expressions.
Preferably, the operating system is connected with the alarm, the display module is connected with the touch display screen, the touch display screen is connected with the voice exchange module, and the voice exchange module is respectively connected with the playing module, the wireless communication device and the microphone module.
Preferably, the operating system is used for issuing an operating instruction to the central processing unit, and the touch display screen regulates and controls the operating system through the display module and the central processing unit.
Preferably, the touch display screen is used for receiving information transmitted by the central processing unit and the database and displaying the received information in real time.
Preferably, the data packet ethernet switching unit is connected to a first wireless transceiver, the first wireless transceiver is connected to a second wireless transceiver through a network server, and the second wireless transceiver is connected to a remote control system.
Preferably, the power supply module is respectively connected with the battery power supply and the low-power-consumption voltage reduction circuit, and the power supply module is connected with the wireless transceiver module with the awakening function through a relay.
Preferably, the wireless transceiver module is provided with a timing acquisition period, and after the set acquisition period is reached, the wireless transceiver module inputs a control signal to the power supply module through the relay, the relay starts the power supply module, and the power supply module is in an awakening state.
The invention has the technical effects and advantages that: the image acquisition device applied to the pedestrian re-identification system has the advantages that a user can regulate and control an operating system through a touch display screen or remotely control a remote control system, the remote control system can be specifically one of mobile phones, computers, iPad and display digital equipment, and can be controlled in multiple ways, so that the image acquisition device is more flexible to use, facial feature parts, such as the coordinate values of eyes, eyebrows, mouths, noses, ears and other structures in a three-dimensional coordinate system and the coordinate values of virtual feature structures in the three-dimensional coordinate system are established, and the similarity between the facial feature parts and corresponding virtual feature structures is determined through the limitation of a face identification technology, so that the similarity between a real face and the facial features of virtual persons is ensured; this be applied to image acquisition device of pedestrian recognition system again, reasonable in design can carry out pedestrian and discern again.
Drawings
FIG. 1 is a schematic structural view of the present invention;
FIG. 2 is a block diagram of a touch screen display according to the present invention;
FIG. 3 is a block diagram of the power supply module of the present invention;
fig. 4 is a block diagram of the structure of the face image acquisition system of the present invention.
In the figure: the system comprises an operating system 1, a central processing unit 2, a data packet Ethernet switching unit 3, a first wireless transmitting and receiving device 4, a network server 5, a second wireless transmitting and receiving device 6, a remote control system 7, an alarm 8, a power supply module 9, a touch display screen 10, a display module 11, a database 12, a facial image acquisition system 13, a camera shooting unit 14, a voice switching module 15, a playing module 16, a wireless communication device 17, a microphone module 18, a power supply battery 19, a relay 20, a wireless transmitting and receiving module 21, a low-power-consumption voltage reduction circuit 22, a facial feature recognition module 23, a real three-dimensional facial reconstruction system 24, a pose matching module 25, a feature point association module 26 and an expression dynamic tracking module 27.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention provides an image acquisition device applied to a pedestrian re-identification system as shown in figures 1-4, which comprises an operating system 1, a central processing unit 2, a power supply module 9, a database 12 and a face image acquisition system 13, wherein the operating system 1 is connected with the central processing unit 2, the central processing unit 2 is respectively connected with the power supply module 9, a display module 11, the database 12 and a data packet Ethernet exchange unit 3, the database 12 is connected with the face image acquisition system 13, and the face image acquisition system 13 is connected with a camera shooting unit 14;
the facial image acquisition system 13 comprises a facial feature recognition module 23, a real three-dimensional face reconstruction system 24, a posture matching module 25, a feature point association module 26, a facial feature recognition module 27, an expression dynamic tracking module 28 and a structured light acquisition unit;
the facial feature recognition module 23 is configured to perform static interception on the dynamic image captured by the camera capturing unit 14, and determine facial contour features and facial features through a facial image feature extraction unit;
a real three-dimensional face reconstruction system 24 for establishing a three-dimensional face model according to the structured light imaging principle of the structured light acquisition unit;
the posture matching module 25 is used for selecting a plurality of active selection feature points of each facial feature part and determining the proportional relation between the three-dimensional coordinate value of each facial feature part and the three-dimensional coordinate value of the corresponding virtual feature part;
a feature point association module 26, configured to associate the three-dimensional coordinate values of the facial feature portions with the three-dimensional coordinate values of the corresponding virtual feature portions according to a proportional relationship;
the expression dynamic tracking module 27 is used for actively selecting a three-dimensional coordinate change value of the feature point in the three-dimensional coordinate system according to the facial feature;
the structured light acquisition unit is used for acquiring the numerical value and the change of an optical signal of the human face in a dynamic image through a structured light imaging principle to capture facial expressions.
Specifically, operating system 1 is connected with alarm 8, display module 11 is connected with touch display screen 10, touch display screen 10 is connected with voice exchange module 15, voice exchange module 15 is connected with play module 16, wireless communication equipment 17 and microphone module 18 respectively, and alarm 8 is the buzzer siren, and buzzer siren fixed mounting is on image acquisition device.
Specifically, the operating system 1 is configured to issue an operation instruction to the central processing unit 2, and the touch display screen 10 regulates and controls the operating system 1 through the display module 11 and the central processing unit 2.
Specifically, the touch display screen 10 is configured to receive information transmitted by the central processing unit 2 and the database 12, display the received information in real time, and facilitate regulation and control of the image acquisition device through the touch display screen 10.
Specifically, the packet ethernet switching unit 3 is connected to a first wireless transceiver 4, the first wireless transceiver 4 is connected to a second wireless transceiver 6 through a network server 5, the second wireless transceiver 6 is connected to a remote control system 7, and the remote control system 7 may be one of a mobile phone, a computer, an iPad, and a display digital device.
Specifically, the power supply module 9 is connected with the battery power supply 19 and the low-power-consumption voltage-reducing circuit 22, the power supply module 9 is connected with the wireless transceiver module 21 with the awakening function through the relay 20, and the power supply module 9 provides electric energy for the central processing unit 2.
Specifically, wireless transceiver module 21 is equipped with the timing acquisition cycle, and after reaching the acquisition cycle of setting for, wireless transceiver module 21 passes through relay 20 to power module 9 input control signal, power module 9 is opened to relay 20, power module 9 is in the state of awakening up, is convenient for awaken up power module 9 through the design of relay 20.
Specifically, according to the image acquisition device applied to the pedestrian re-identification system, a user can regulate and control the operating system 1 through the touch display screen 10, or remotely control the remote control system 7, the remote control system 7 can be one of mobile phones, computers, iPads and display digital equipment, and can be controlled in multiple ways, the camera shooting unit 14 is controlled to shoot pedestrians passing through the camera, the shot dynamic images are statically intercepted through the facial feature identification module 23, facial contour features and facial features are determined through the facial image feature extraction unit, and a three-dimensional face model is established through the real three-dimensional face reconstruction system 24 according to the structured light imaging principle of the structured light acquisition unit; selecting a plurality of active selection feature points of each facial feature part through the posture matching module 25, and determining the proportional relation between the three-dimensional coordinate value of each facial feature part and the three-dimensional coordinate value of the corresponding virtual feature part; the feature point association module 26 is used for actively selecting a three-dimensional coordinate change value of a feature point in a three-dimensional coordinate system according to the facial feature part through the expression dynamic tracking module 27 according to the proportional relationship between the three-dimensional coordinate value of each facial feature part and the three-dimensional coordinate value of the corresponding virtual feature part; and finally, the data are uniformly transmitted to a database 12 for comparison, and the compared data are displayed on the touch display screen 10.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that modifications may be made to the embodiments or portions thereof without departing from the spirit and scope of the invention.
Claims (7)
1. The utility model provides an image acquisition device for pedestrian discernment system again, includes operating system (1), central processing unit (2), power module (9), database (12) and face image acquisition system (13), its characterized in that: the operating system (1) is connected with the central processing unit (2), the central processing unit (2) is respectively connected with the power supply module (9), the display module (11), the database (12) and the data packet Ethernet switching unit (3), the database (12) is connected with the face image acquisition system (13), and the face image acquisition system (13) is connected with the camera shooting unit (14);
the facial image acquisition system (13) comprises a facial feature recognition module (23), a real three-dimensional facial reconstruction system (24), a posture matching module (25), a feature point association module (26), a facial feature recognition module (27), an expression dynamic tracking module (28) and a structured light acquisition unit;
the facial feature recognition module (23) is used for statically intercepting the dynamic image shot by the camera shooting unit (14) and determining facial contour features and facial features through a human face image feature extraction unit;
a real three-dimensional face reconstruction system (24) for establishing a three-dimensional face model according to the structured light imaging principle of the structured light acquisition unit;
the posture matching module (25) is used for selecting a plurality of active selection feature points of each facial feature part and determining the proportional relation between the three-dimensional coordinate value of each facial feature part and the three-dimensional coordinate value of the corresponding virtual feature part;
a feature point association module (26) for associating the three-dimensional coordinate values of each facial feature with the three-dimensional coordinate values of the corresponding virtual feature;
the expression dynamic tracking module (27) is used for actively selecting a three-dimensional coordinate change value of the feature point in the three-dimensional coordinate system according to the facial feature part;
the structured light acquisition unit is used for acquiring the numerical value and the change of an optical signal of the human face in a dynamic image through a structured light imaging principle to capture facial expressions.
2. The image capturing device as claimed in claim 1, wherein: operating system (1) is connected with alarm (8), display module (11) is connected with touch display screen (10), touch display screen (10) are connected with voice exchange module (15), voice exchange module (15) are connected with play module (16), wireless communication equipment (17) and microphone module (18) respectively.
3. The image capturing device applied to the pedestrian re-identification system according to claim 2, wherein: the operating system (1) is used for issuing an operating instruction to the central processing unit (2), and the touch display screen (10) regulates and controls the operating system (1) through the display module (11) and the central processing unit (2).
4. The image capturing device applied to the pedestrian re-identification system according to claim 2, wherein: the touch display screen (10) is used for receiving the information transmitted by the central processing unit (2) and the database (12) and displaying the received information in real time.
5. The image capturing device as claimed in claim 1, wherein: the data packet Ethernet switching unit (3) is connected with a first wireless transmitting and receiving device (4), the first wireless transmitting and receiving device (4) is connected with a second wireless transmitting and receiving device (6) through a network server (5), and the second wireless transmitting and receiving device (6) is connected with a remote control system (7).
6. The image capturing device as claimed in claim 1, wherein: the power supply module (9) is respectively connected with the battery power supply (19) and the low-power-consumption voltage reduction circuit (22), and the power supply module (9) is connected with the wireless transceiving module (21) with the awakening function through the relay (20).
7. The image capturing device as claimed in claim 6, wherein: the wireless transceiver module (21) is provided with a timing acquisition period, after the set acquisition period is reached, the wireless transceiver module (21) inputs a control signal to the power supply module (9) through the relay (20), the relay (20) starts the power supply module (9), and the power supply module (9) is in a wake-up state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110157342.4A CN112954205A (en) | 2021-02-04 | 2021-02-04 | Image acquisition device applied to pedestrian re-identification system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110157342.4A CN112954205A (en) | 2021-02-04 | 2021-02-04 | Image acquisition device applied to pedestrian re-identification system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112954205A true CN112954205A (en) | 2021-06-11 |
Family
ID=76242248
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110157342.4A Pending CN112954205A (en) | 2021-02-04 | 2021-02-04 | Image acquisition device applied to pedestrian re-identification system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112954205A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013138838A1 (en) * | 2012-03-21 | 2013-09-26 | Commonwealth Scientific And Industrial Research Organisation | Method and system for facial expression transfer |
| CN108510583A (en) * | 2018-04-03 | 2018-09-07 | 北京华捷艾米科技有限公司 | The generation method of facial image and the generating means of facial image |
| CN109409274A (en) * | 2018-10-18 | 2019-03-01 | 广州云从人工智能技术有限公司 | A kind of facial image transform method being aligned based on face three-dimensional reconstruction and face |
| CN110443885A (en) * | 2019-07-18 | 2019-11-12 | 西北工业大学 | Three-dimensional number of people face model reconstruction method based on random facial image |
| CN111667599A (en) * | 2020-06-09 | 2020-09-15 | 安徽省徽腾智能交通科技有限公司 | Face recognition card punching system and method |
| US20200312043A1 (en) * | 2018-04-18 | 2020-10-01 | Tencent Technology (Shenzhen) Company Limited | Face model processing method and apparatus, non-volatile computer-readable storage medium, and electronic device |
| CN112232310A (en) * | 2020-12-09 | 2021-01-15 | 中影年年(北京)文化传媒有限公司 | Face recognition system and method for expression capture |
-
2021
- 2021-02-04 CN CN202110157342.4A patent/CN112954205A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013138838A1 (en) * | 2012-03-21 | 2013-09-26 | Commonwealth Scientific And Industrial Research Organisation | Method and system for facial expression transfer |
| US20160004905A1 (en) * | 2012-03-21 | 2016-01-07 | Commonwealth Scientific And Industrial Research Organisation | Method and system for facial expression transfer |
| CN108510583A (en) * | 2018-04-03 | 2018-09-07 | 北京华捷艾米科技有限公司 | The generation method of facial image and the generating means of facial image |
| US20200312043A1 (en) * | 2018-04-18 | 2020-10-01 | Tencent Technology (Shenzhen) Company Limited | Face model processing method and apparatus, non-volatile computer-readable storage medium, and electronic device |
| CN109409274A (en) * | 2018-10-18 | 2019-03-01 | 广州云从人工智能技术有限公司 | A kind of facial image transform method being aligned based on face three-dimensional reconstruction and face |
| CN110443885A (en) * | 2019-07-18 | 2019-11-12 | 西北工业大学 | Three-dimensional number of people face model reconstruction method based on random facial image |
| CN111667599A (en) * | 2020-06-09 | 2020-09-15 | 安徽省徽腾智能交通科技有限公司 | Face recognition card punching system and method |
| CN112232310A (en) * | 2020-12-09 | 2021-01-15 | 中影年年(北京)文化传媒有限公司 | Face recognition system and method for expression capture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111738220B (en) | Three-dimensional human body posture estimation method, device, equipment and medium | |
| WO2020224479A1 (en) | Method and apparatus for acquiring positions of target, and computer device and storage medium | |
| CN110647865A (en) | Face gesture recognition method, device, equipment and storage medium | |
| CN108712603B (en) | Image processing method and mobile terminal | |
| CN112348937A (en) | Face image processing method and electronic equipment | |
| CN106295499B (en) | Age estimation method and device | |
| WO2024169314A1 (en) | Method and apparatus for constructing deformable neural radiance field network | |
| CN109981964B (en) | Robot-based shooting method and shooting device and robot | |
| WO2020036821A1 (en) | Identification method and apparatus and computer-readable storage medium | |
| CN112541400B (en) | Behavior recognition method and device based on sight estimation, electronic equipment and storage medium | |
| CN110796005A (en) | Method, device, electronic equipment and medium for online teaching monitoring | |
| CN108881544A (en) | A kind of method taken pictures and mobile terminal | |
| CN113706678A (en) | Method, device and equipment for acquiring virtual image and computer readable storage medium | |
| CN112257552A (en) | Image processing method, device, equipment and storage medium | |
| CN112581358A (en) | Training method of image processing model, image processing method and device | |
| CN110555815B (en) | Image processing method and electronic equipment | |
| CN109639981A (en) | A kind of image capturing method and mobile terminal | |
| CN110891181B (en) | Live broadcast picture display method and device, storage medium and terminal | |
| CN108830901B (en) | Image processing method and electronic equipment | |
| CN112954205A (en) | Image acquisition device applied to pedestrian re-identification system | |
| CN111385481A (en) | Image processing method and device, electronic device and storage medium | |
| CN112449098A (en) | Shooting method, device, terminal and storage medium | |
| CN110443752A (en) | A kind of image processing method and mobile terminal | |
| CN111982293B (en) | Body temperature measuring method and device, electronic equipment and storage medium | |
| CN114996515A (en) | Training method of video feature extraction model, text generation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210611 |