CN113194211B - Control method and system of scanning head - Google Patents
Control method and system of scanning head Download PDFInfo
- Publication number
- CN113194211B CN113194211B CN202110322409.5A CN202110322409A CN113194211B CN 113194211 B CN113194211 B CN 113194211B CN 202110322409 A CN202110322409 A CN 202110322409A CN 113194211 B CN113194211 B CN 113194211B
- Authority
- CN
- China
- Prior art keywords
- preview
- image sensor
- control
- scanning head
- function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/0035—User-machine interface; Control console
- H04N1/00405—Output means
- H04N1/00408—Display of information to the user, e.g. menus
- H04N1/0044—Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00885—Power supply means, e.g. arrangements for the control of power supply to the apparatus or components thereof
- H04N1/00888—Control thereof
- H04N1/00891—Switching on or off, e.g. for saving power when not in use
Abstract
The invention discloses a control method and a system of a scanning head, wherein the method comprises the following steps: s1: creating a control node connected with a scanning head client at a system kernel layer; s2: receiving a switch preview instruction of a system scanning head service through a control node so as to control the switch preview of an image sensor; s3: and triggering or stopping image effect optimization through the ISP of the CPU according to the switch preview of the image sensor. By implementing the invention, the system scanning head service can directly control the on-off preview of the image sensor without a layer-by-layer architecture of a platform, and the time for starting and stopping the preview is shortened, so that the speed requirement that the preview is started and data decoding is obtained by pressing the key each time, and the preview is immediately closed by loosening the key is met, the scanning speed is increased, the speed which is the same as the speed for starting and stopping the preview of the image sensor with an ISP is achieved, and meanwhile, the preview of the image sensor is stopped by loosening the key each time, so that the power consumption is saved.
Description
Technical Field
The present invention relates to the field of scanning head technologies, and in particular, to a method and a system for controlling a scanning head.
Background
The existing scanning head must be optimized by ISP effect, and at present, there are two schemes:
first, image effect optimization is performed using an ISP built in a scanner head image sensor, and control is performed using a configuration of a register built in an image sensor (sensor). The control method is simple, the starting and stopping preview speed is high, but only an image sensor with an ISP can be used, and most of image sensors on the market are not internally provided with an ISP processor, so that the device type selection is limited.
Secondly, using ISP in the platform CPU to optimize the image effect, and using the software control logic of the CPU platform. This control method is applicable to all image sensors including image sensors with built-in ISPs and image sensors without ISPs, but the control logic is complex, as shown in fig. 1, the scan head service must call the API interface of camera: the speed of starting and stopping previewing of the image sensor through the layer of architecture of the system scanning head Service- > API- > Camera Client- > Camera Service- > hal- > user driver- > kernel- > sensor is very slow in final operation, time consumption is long, the requirement for quickly starting previewing and scanning codes by pressing a key by the scanning head cannot be met, the speed requirement for stopping previewing by releasing the key is more than 200ms in time than a built-in ISP control method, and more than 300ms is required for some low-end processors, so that the requirement for the speed of the scanning head cannot be met.
Disclosure of Invention
The present invention provides a method and a system for controlling a scan head, aiming at the defects of the prior art.
The technical scheme adopted by the invention for solving the technical problems is as follows: a control method of constructing a scanning head, comprising the steps of:
s1: a control node connected with a scanning head client is established in a system kernel layer;
s2: receiving a switch preview instruction of a system scanning head service through the control node so as to control the switch preview of the image sensor;
s3: and triggering or stopping image effect optimization through an ISP of the CPU according to the switch preview of the image sensor.
Preferably, in the method for controlling a scanning head according to the present invention, the step S1 includes:
s11: creating character equipment on the system kernel layer and providing a control interface for the scanning head client;
the step S2 includes:
s21: and receiving a switch preview instruction served by the system scanning head through the control interface so as to control the switch preview of the image sensor through the character equipment.
Preferably, in the method for controlling a scanner head according to the present invention, the controlling a preview of an image sensor by the character device includes:
s211: registering an operation function set of the character device at the system kernel layer, wherein the operation function set comprises a starting function open, a closing function close, an opening preview function start _ stream and a closing preview function stop _ stream;
s212: calling the starting function open according to the opening preview instruction, and starting the character equipment to transmit an optical signal;
s213: calling the open preview function start _ stream to write a control register to the image sensor, wherein the control register controls the image sensor to convert optical signals into electric signals and output images;
alternatively, the first and second electrodes may be,
s214: and calling the close preview function stop _ stream to set the control register to control to stop the image sensor from outputting the image according to the close preview instruction, and calling the close function to close the character equipment.
Preferably, in the method for controlling a scanning head according to the present invention, before the step S1, the method further includes: the system scanhead service, the scanhead client, the system kernel layer, and the image sensor are initialized.
Preferably, in the method for controlling a scanning head according to the present invention, before the step S1, the method further includes: and judging the scanning head client side to which the image sensor belongs by acquiring the name identifier of the image sensor.
The present invention also constructs a control system of a scanning head, comprising:
the system comprises a creation module, a scanning head client and a control module, wherein the creation module is used for creating a control node connected with the scanning head client in a system kernel layer;
the preview module is used for receiving a switch preview instruction of a system scanning head service through the control node so as to control the switch preview of the image sensor;
and the image signal processing module is used for triggering or stopping image effect optimization through an ISP of the CPU according to the switch preview of the image sensor.
Preferably, in the control system of a scan head according to the present invention, the creating, at a system kernel layer, a control node connected to a scan head client includes:
creating character equipment in the system kernel layer and providing a control interface for the scanning head client;
the receiving, by the control node, a switch preview instruction serviced by a system scan head to control a switch preview of an image sensor includes:
and receiving a switch preview instruction served by the system scanning head through the control interface so as to control the switch preview of the image sensor through the character equipment.
Preferably, in the control system of a scanner head according to the present invention, the controlling a preview of an image sensor by the character device includes:
registering an operation function set of the character device in the system kernel layer, wherein the operation function set comprises a starting function open, a closing function close, a starting preview function start _ stream and a closing preview function stop _ stream;
calling the starting function open according to the opening preview instruction, and starting the character equipment to transmit an optical signal;
calling the open preview function start _ stream to write a control register on the image sensor, wherein the control register controls the image sensor to convert optical signals into electric signals and output images;
or, according to the off preview instruction, calling the off preview function stop _ stream to set the control register to control to stop the image sensor from outputting the image, and calling the close function to close the character device.
Preferably, in the control system of a scanning head according to the present invention, the system further includes:
and the initialization module is used for initializing the system scanning head service, the scanning head client, the system kernel layer and the image sensor.
Preferably, in the control system of a scanning head according to the present invention, the system further includes:
and the judging module is used for judging the scanning head client side to which the image sensor belongs by acquiring the name identifier of the image sensor.
By implementing the invention, the following beneficial effects are achieved:
on the basis of using the ISP of the platform CPU to optimize the image effect, the invention creates a control node connected with the scanning head client side on the kernel layer of the system, so that the scanning head service of the system can directly control the switch preview of the image sensor through the control node, and then triggers or stops the image effect optimization through the ISP of the CPU, so that the scanning head service of the system can directly control the switch preview of the image sensor without a layer-by-layer framework of the platform, and the time for starting and stopping the preview is shortened, thereby achieving the speed requirements of starting the preview to acquire data decoding by pressing a key each time and immediately closing the preview by releasing the key, accelerating the scanning speed, achieving the same speed as the speed for starting and stopping the preview of the image sensor with the ISP, and simultaneously stopping the image sensor preview by releasing the key each time, thereby saving the power consumption.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
FIG. 1 is a logic diagram of a prior art method for operating an image sensor to start and stop a preview based on a platform ISP effect;
FIG. 2 is a logic diagram of the present invention operating an image sensor to start stop preview based on a platform ISP effect;
FIG. 3 is a first flowchart illustrating a control method of a scan head according to the present invention;
FIG. 4 is a second flowchart illustrating a control method of the scanning head according to the present invention;
FIG. 5 is a block diagram of a control system for the scan head of the present invention.
Detailed Description
For a more clear understanding of the technical features, objects, and effects of the present invention, embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
It should be noted that the flow charts shown in the drawings are only exemplary and do not necessarily include all the contents and operations/steps, nor must they be executed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.
A first embodiment, as shown in fig. 3, discloses a method for controlling a scan head, which performs image effect optimization based on an ISP using a platform CPU, and includes the steps of:
step S1: a control node connected with a scanning head client is established in a system kernel layer; in some embodiments, a control node connected with the scanning head client can be created in a system kernel layer through a software transparent transmission method.
Step S2: receiving a switch preview instruction of a system scanning head service through a control node so as to control the switch preview of an image sensor;
and step S3: and triggering or stopping image effect optimization through the ISP of the CPU according to the switch preview of the image sensor.
In some embodiments, before performing step S1, the method further comprises: and initializing a system scanning head service, a scanning head client, a system kernel layer and an image sensor.
In some embodiments, the terminal may have a plurality of scanning heads, and in order for the scanning heads to accurately control the corresponding image sensors, the step S1 further includes: and judging the scanning head client side to which the image sensor belongs by acquiring the name identifier of the image sensor. Accordingly, this step S1 includes: and creating a control node corresponding to the scanning head client and the image sensor in a system kernel layer.
In this embodiment, as shown in fig. 4, the step S1 includes:
step S11: and creating a character device at a system kernel layer, and providing a control interface for a scanning head client. Wherein the control node comprises a character device and a control interface.
Accordingly, the step S2 includes:
step S21: and receiving a switch preview instruction of a system scanning head service through the control interface so as to control the switch preview of the image sensor through the character device. As shown in fig. 2, the system scanhead service sends a switch preview instruction to the system kernel layer through the control interface after passing through the API interface and the scanhead Client (Camera Client), and then controls the switch preview of the image sensor through the character device of the system kernel layer, thereby bypassing the layer-by-layer calling architecture of the platform Camera and shortening the time for the system scanhead service to operate the image sensor.
Further, in this embodiment, the controlling the switch preview of the image sensor by the character device includes:
step S211: registering an operation function set of character equipment in a system kernel layer, wherein the operation function set comprises a starting function open, a closing function close, an opening preview function start _ stream and a closing preview function stop _ stream;
step S212: calling a starting function open according to the preview starting instruction, and starting character equipment to transmit an optical signal;
step S213: calling an on preview function start _ stream to write a control register on the image sensor, wherein the control register controls the image sensor to convert optical signals into electric signals and output images;
alternatively, the first and second electrodes may be,
step S211: registering an operation function set of character equipment in a system kernel layer, wherein the operation function set comprises a starting function open, a closing function close, a starting preview function start _ stream and a closing preview function stop _ stream;
step S214: according to the off preview instruction, calling an off preview function stop _ stream to set a control register to control to stop the image sensor from outputting the image, and calling a close function to close the character device.
A second embodiment, as shown in fig. 5, discloses a control system of a scan head, which performs image effect optimization based on an ISP using a platform CPU, including:
the system comprises a creation module, a scanning head client and a control module, wherein the creation module is used for creating a control node connected with the scanning head client in a system kernel layer; in some embodiments, a control node connected with the scanning head client can be created in a system kernel layer through a software transparent transmission method.
The preview module is used for receiving a switch preview instruction of a system scanning head service through the control node so as to control the switch preview of the image sensor;
and the image signal processing module is used for triggering or stopping image effect optimization through the ISP of the CPU according to the switch preview of the image sensor.
In some embodiments, the system further comprises an initialization module for initializing the system scan head service, the scan head client, the system kernel layer, and the image sensor.
In some embodiments, the terminal may have a plurality of scan heads, and in order to enable the scan heads to accurately control the corresponding image sensors, the system further includes a determining module for determining a scan head client to which the image sensor belongs by obtaining the name identifier of the image sensor. Accordingly, the creation module is further configured to create a control node corresponding to the scanhead client and the image sensor at a system kernel layer.
In this embodiment, the creating, at a system kernel layer, a control node connected to a scan head client includes:
creating character equipment in a system kernel layer and providing a control interface for a scanning head client;
correspondingly, the receiving, by the control node, a switch preview instruction of a system scan head service to control a switch preview of the image sensor includes:
and receiving a switch preview instruction of a system scanning head service through the control interface so as to control the switch preview of the image sensor through the character device. As shown in fig. 2, the system scanhead service sends a switch preview instruction to the system kernel layer through the control interface after passing through the API interface and the scanhead client, and then controls the switch preview of the image sensor through the character device of the system kernel layer, thereby bypassing the layer-by-layer calling architecture of the platform camera and shortening the time for the system scanhead service to operate the image sensor.
Further, in this embodiment, the controlling the switch preview of the image sensor by the character device includes:
registering an operation function set of character equipment in a system kernel layer, wherein the operation function set comprises a starting function open, a closing function close, an opening preview function start _ stream and a closing preview function stop _ stream;
calling a starting function open according to the preview starting instruction, and starting character equipment to transmit an optical signal;
calling an on preview function start _ stream to write a control register to the image sensor, wherein the control register controls the image sensor to convert an optical signal into an electric signal and output an image;
alternatively, the first and second electrodes may be,
registering an operation function set of character equipment in a system kernel layer, wherein the operation function set comprises a starting function open, a closing function close, a starting preview function start _ stream and a closing preview function stop _ stream;
according to the off preview instruction, an off preview function stop _ stream is called to set a control register to control to stop the image sensor from outputting an image, and a close function is called to close the character device.
By implementing the invention, the following beneficial effects are achieved:
on the basis of using the ISP of the platform CPU to optimize the image effect, the invention creates a control node connected with the scanning head client side on the kernel layer of the system, so that the scanning head service of the system can directly control the switch preview of the image sensor through the control node, and then triggers or stops the image effect optimization through the ISP of the CPU, so that the scanning head service of the system can directly control the switch preview of the image sensor without a layer-by-layer framework of the platform, and the time for starting and stopping the preview is shortened, thereby achieving the speed requirements of starting the preview to acquire data decoding by pressing a key each time and immediately closing the preview by releasing the key, accelerating the scanning speed, achieving the same speed as the speed for starting and stopping the preview of the image sensor with the ISP, and simultaneously stopping the image sensor preview by releasing the key each time, thereby saving the power consumption.
It is to be understood that the foregoing examples, while indicating the preferred embodiments of the invention, are given by way of illustration and description, and are not to be construed as limiting the scope of the invention; it should be noted that, for a person skilled in the art, the above technical features can be freely combined, and several changes and modifications can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention; therefore, all equivalent changes and modifications made within the scope of the claims of the present invention should be covered by the claims of the present invention.
Claims (8)
1. A method of controlling a scanning head, comprising the steps of:
s1: a control node connected with a scanning head client is established in a system kernel layer;
s2: receiving a switch preview instruction of a system scanning head service through the control node so as to control the switch preview of the image sensor;
s3: triggering or stopping image effect optimization through an ISP of a CPU according to the switch preview of the image sensor;
wherein, step S1 includes:
s11: creating character equipment in the system kernel layer and providing a control interface for the scanning head client;
the step S2 comprises the following steps:
s21: and receiving a switch preview instruction served by the system scanning head through the control interface so as to control the switch preview of the image sensor through the character equipment.
2. The method of claim 1, wherein the controlling the on-off preview of the image sensor by the character device comprises:
s211: registering an operation function set of the character device at the system kernel layer, wherein the operation function set comprises a starting function open, a closing function close, an opening preview function start _ stream and a closing preview function stop _ stream;
s212: calling the starting function open according to the preview starting instruction, and starting the character equipment to transmit an optical signal;
s213: calling the open preview function start _ stream to write a control register on the image sensor, wherein the control register controls the image sensor to convert optical signals into electric signals and output images;
alternatively, the first and second liquid crystal display panels may be,
s214: and calling the close preview function stop _ stream to set the control register to control to stop the image sensor from outputting the image according to the close preview instruction, and calling the close function to close the character equipment.
3. The method of claim 1, wherein step S1 is preceded by the step of: the system scanhead service, the scanhead client, the system kernel layer, and the image sensor are initialized.
4. The method for controlling a scan head according to claim 1, wherein the step S1 is preceded by: and judging the scanning head client side to which the image sensor belongs by acquiring the name identifier of the image sensor.
5. A control system for a scan head, comprising:
the system comprises a creation module, a scanning head client and a control module, wherein the creation module is used for creating a control node connected with the scanning head client in a system kernel layer;
the preview module is used for receiving a switch preview instruction of a system scanning head service through the control node so as to control the switch preview of the image sensor;
the image signal processing module is used for triggering or stopping image effect optimization through an ISP (Internet service provider) of the CPU according to the switch preview of the image sensor;
wherein, the creating of the control node connected with the scanning head client at the system kernel layer comprises:
creating character equipment in the system kernel layer and providing a control interface for the scanning head client;
the receiving, by the control node, a switch preview instruction serviced by a system scan head to control a switch preview of an image sensor includes:
and receiving a switch preview instruction served by the system scanning head through the control interface so as to control the switch preview of the image sensor through the character equipment.
6. The system of claim 5, wherein the controlling the preview of the image sensor by the character device comprises:
registering an operation function set of the character device at the system kernel layer, wherein the operation function set comprises a starting function open, a closing function close, an opening preview function start _ stream and a closing preview function stop _ stream;
calling the starting function open according to the opening preview instruction, and starting the character equipment to transmit an optical signal;
calling the open preview function start _ stream to write a control register on the image sensor, wherein the control register controls the image sensor to convert optical signals into electric signals and output images;
or, according to the off preview instruction, calling the off preview function stop _ stream to set the control register to control to stop the image sensor from outputting the image, and calling the close function to close the character device.
7. The scan head control system of claim 5, further comprising:
and the initialization module is used for initializing the system scanning head service, the scanning head client, the system kernel layer and the image sensor.
8. The scan head control system of claim 5, further comprising:
and the judging module is used for judging the scanning head client side to which the image sensor belongs by acquiring the name identifier of the image sensor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110322409.5A CN113194211B (en) | 2021-03-25 | 2021-03-25 | Control method and system of scanning head |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110322409.5A CN113194211B (en) | 2021-03-25 | 2021-03-25 | Control method and system of scanning head |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113194211A CN113194211A (en) | 2021-07-30 |
| CN113194211B true CN113194211B (en) | 2022-11-15 |
Family
ID=76973913
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110322409.5A Active CN113194211B (en) | 2021-03-25 | 2021-03-25 | Control method and system of scanning head |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113194211B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106657757A (en) * | 2015-11-04 | 2017-05-10 | 阿里巴巴集团控股有限公司 | Image preview method of camera application, apparatus and camera application system thereof |
| CN111209904A (en) * | 2018-11-21 | 2020-05-29 | 华为技术有限公司 | Service processing method and related device |
| WO2021047567A1 (en) * | 2019-09-12 | 2021-03-18 | 华为技术有限公司 | Callback stream processing method and device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140111670A1 (en) * | 2012-10-23 | 2014-04-24 | Nvidia Corporation | System and method for enhanced image capture |
| CN104574260B (en) * | 2015-01-09 | 2018-10-16 | 青岛海信移动通信技术股份有限公司 | A kind of generation method and device of image information |
| CN105791679A (en) * | 2016-02-29 | 2016-07-20 | 广东欧珀移动通信有限公司 | Method and device for reducing camera power consumption, and mobile terminal |
| CN106657788A (en) * | 2016-12-28 | 2017-05-10 | 深圳众思科技有限公司 | Image processing method for electronic device and electronic device |
| CN107277353B (en) * | 2017-06-30 | 2019-02-15 | 维沃移动通信有限公司 | A kind of method taken pictures and mobile terminal |
| US11023994B2 (en) * | 2019-04-05 | 2021-06-01 | Apple Inc. | Auto-focus engine architecture for image signal processor |
| CN111526232B (en) * | 2020-05-13 | 2021-07-06 | 青岛海信移动通信技术股份有限公司 | Camera control method based on double-screen terminal and double-screen terminal |
-
2021
- 2021-03-25 CN CN202110322409.5A patent/CN113194211B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106657757A (en) * | 2015-11-04 | 2017-05-10 | 阿里巴巴集团控股有限公司 | Image preview method of camera application, apparatus and camera application system thereof |
| CN111209904A (en) * | 2018-11-21 | 2020-05-29 | 华为技术有限公司 | Service processing method and related device |
| WO2021047567A1 (en) * | 2019-09-12 | 2021-03-18 | 华为技术有限公司 | Callback stream processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113194211A (en) | 2021-07-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111917988B (en) | Remote camera application method, system and medium of cloud mobile phone | |
| WO2019179283A1 (en) | Image recognition method and device | |
| WO2018038277A1 (en) | Message sharing method for sharing image data reflecting status of each user via chat room and computer program for executing same method | |
| JP2016537922A (en) | Pseudo video call method and terminal | |
| US20190051147A1 (en) | Remote control method, apparatus, terminal device, and computer readable storage medium | |
| WO2019052460A1 (en) | Information pushing method, storage medium, terminal device, and server | |
| WO2023030519A1 (en) | Screen projection processing method and related device | |
| WO2013181038A1 (en) | Communicating with an endpoint using matrix barcodes | |
| US20220130320A1 (en) | Control method and system for display switching, electronic device and storage medium | |
| CN113194211B (en) | Control method and system of scanning head | |
| TW201007491A (en) | System and method for efficiently performing image processing operations | |
| CN115374056A (en) | Infrared image data processing method, system, device and storage medium | |
| JP2003067734A (en) | Configurable image-processing logic for use in image processor | |
| CN111881862A (en) | Gesture recognition method and related device | |
| CN113448623A (en) | Image frame processing method, electronic device, chip and storage medium | |
| CN115988341A (en) | Camera and image processing method based on Android system | |
| CN111447360A (en) | Application program control method and device, storage medium and electronic equipment | |
| US20230016941A1 (en) | Method and device for adding emoji, apparatus and storage medium | |
| CN114841854A (en) | Image processing method, device, equipment and storage medium | |
| CN114339045A (en) | Image processing system and display device | |
| CN114157626A (en) | Method, system, storage medium and computer equipment for transmitting photos by photographing | |
| US20210344918A1 (en) | Optimization of multi-sink wi-fi display with intelligent multi-session encoding | |
| US20080095446A1 (en) | Method and system for performing image processing in a computer apparatus | |
| US11128798B2 (en) | Display device and control method thereof | |
| CN110855881B (en) | Shooting processing method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |