CN113761655B - Light supplementing device for rear camera of automobile and light distribution optimization method - Google Patents
Light supplementing device for rear camera of automobile and light distribution optimization method Download PDFInfo
- Publication number
- CN113761655B CN113761655B CN202110969141.4A CN202110969141A CN113761655B CN 113761655 B CN113761655 B CN 113761655B CN 202110969141 A CN202110969141 A CN 202110969141A CN 113761655 B CN113761655 B CN 113761655B
- Authority
- CN
- China
- Prior art keywords
- light
- rear camera
- light supplementing
- lamp
- grid
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000001502 supplementing effect Effects 0.000 title claims abstract description 59
- 238000009826 distribution Methods 0.000 title claims abstract description 19
- 238000000034 method Methods 0.000 title claims abstract description 11
- 238000005457 optimization Methods 0.000 title claims description 12
- 238000003384 imaging method Methods 0.000 claims description 3
- 238000004088 simulation Methods 0.000 claims description 2
- 238000005286 illumination Methods 0.000 abstract description 11
- 239000013589 supplement Substances 0.000 abstract description 8
- 238000011161 development Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000001678 irradiating effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000007790 scraping Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/10—Geometric CAD
- G06F30/15—Vehicle, aircraft or watercraft design
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
- G03B15/02—Illuminating scene
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
- G06F30/23—Design optimisation, verification or simulation using finite element methods [FEM] or finite difference methods [FDM]
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
Abstract
The invention discloses a light supplementing device of a rear camera of an automobile and a light distribution optimizing method, which comprise a light supplementing lamp, wherein the light supplementing lamp is a reversing lamp or a combination of the reversing lamp and a license plate lamp, the illumination range of the rear camera is optimized through light distribution, the input end of the light supplementing lamp is connected with the output end of a whole automobile controller, the whole automobile controller is used for receiving a whole automobile gear signal, and when the whole automobile gear signal is in a reverse gear, the whole automobile controller drives the light supplementing lamp to be started to supplement light for the rear camera. The automobile reversing device can effectively utilize the existing resources of the whole automobile and effectively solve the problem of insufficient ambient light during reversing.
Description
Technical Field
The invention relates to the technical field of automobile reversing assistance, in particular to an automobile rear camera light supplementing device and a light distribution optimizing method.
Background
With the continuous development of economy, the living standard of people is gradually improved, automobiles are popularized in the lives of people, the conservation amount is steadily increased, and the automobiles become common transportation means for people to travel, so that the convenience for people to travel is improved. The rapid increase of the holding capacity of the automobile leads the urban road to be gradually congested, the problem of shortage of parking spaces is also highlighted gradually, and the automobile is limited by objective conditions such as shielding of vision, narrow parking space and the like during parking, so that collision accidents are easy to occur, thereby bringing unnecessary loss. Especially when parking in low bright environment, because the light is insufficient and the visual field blind area is big, the environment behind the car when the car is backward can't accurately be judged for collision or scraping appear very easily when parking.
In order to solve the problem of a blind area of a visual field when a car backs up, cameras are installed behind the car at present, and the processing of displaying the environmental image behind the car, which is shot by the cameras behind the car, on a multimedia display screen in the car or sending the environmental image to an automatic parking system is very popular. However, the general rear camera has only a camera shooting function, has no light supplementing function for the rear camera, cannot carry out light supplementing for the rear camera when the ambient light is insufficient, so that the rear environment image shot by the camera is blurred, a driver or an automatic parking system cannot be helped to judge the rear environment when the vehicle is reversed, the vehicle cannot effectively avoid danger, a vehicle collision accident is caused, the vehicle is damaged, and economic loss is caused.
CN110351491a discloses a light supplementing method, device and system under low-light environment, firstly judging whether the driving environment is in the low-light state; when the driving environment is in the low illumination state, at least one light supplementing lamp corresponding to the looking-around camera is lightened so as to supplement light for the driving environment, and the light supplementing lamp system consists of an independent light supplementing lamp and a control system. The light supplementing lamp corresponding to the looking-around camera can supplement light to the driving environment, so that the driving environment can be accurately recorded by the image shot by the looking-around camera, driving environment information such as lanes, parking spaces and obstacles can be accurately acquired according to the shot images when a driver or a vehicle drives automatically, accurate countermeasures can be taken according to the driving environment information when the driver or the vehicle drives automatically, vehicle accidents caused by the fact that the looking-around camera cannot accurately acquire the driving environment information in a low-light environment are avoided, the influence of the low-light environment on vehicle safety can be effectively overcome, and therefore vehicle safety is improved. The camera light filling scheme has the advantages that the light filling lamp system consists of an optical sensor, a light filling lamp, a corresponding controller and the like, the control method of the light filling lamp system is complex, the independent light filling lamp, the corresponding controller and other parts are required to be developed, the corresponding performance matching is carried out on software, the development and matching period is long, and the investment of hardware development and software development is large. The scheme in the above patent needs to increase independent camera light filling lamp and system and comes the light filling for the camera when making a video recording, has increased development cost and manufacturing cost, is unfavorable for the control of whole car cost.
Disclosure of Invention
The invention aims to provide a light supplementing device for a rear camera of an automobile and a light distribution optimizing method, which can effectively utilize the existing resources of the whole automobile and effectively solve the problem of insufficient ambient light during reversing.
The invention discloses a light supplementing device for a rear camera of an automobile, which comprises a light supplementing lamp, wherein the light supplementing lamp is a reversing lamp or a combination of the reversing lamp and a license plate lamp, the illumination range of the rear camera is optimized through light distribution, the input end of the light supplementing lamp is connected with the output end of a whole automobile controller, the whole automobile controller is used for receiving a whole automobile gear signal, and when the whole automobile gear signal is in a reverse gear, the whole automobile controller drives the light supplementing lamp to be started to supplement light for the rear camera.
Further, the input end of the whole vehicle controller is connected with the output end of the gearbox controller or the engine controller, the input end of the gearbox controller or the engine controller is connected with the output end of the gear shifting mechanism, and the whole vehicle gear signal is sent out through the gearbox controller or the engine controller.
A light distribution optimization method of a rear camera light supplementing device of an automobile comprises the following steps:
s1, arranging model data of a rear camera and a light supplementing lamp in a whole vehicle model in three-dimensional modeling software, wherein the rear camera and the light supplementing lamp meet modeling requirements and whole vehicle arrangement requirements;
s2, importing the arrangement data of the light supplementing lamps in the step S1 into light distribution software, performing road surface illuminance simulation by adopting the light distribution software, dividing grids on an illuminated surface behind a vehicle, and recording brightness values on grid points;
s3, determining target brightness values of all points on the grid points according to the imaging range of the rear camera and the brightness values on the grid points recorded in the S2;
s4, optimizing the light distribution of the light supplementing lamp on the basis of S2, on the premise that the light supplementing lamp meets the light distribution requirement of corresponding regulations, enabling the brightness value of each point on the grid of the light in the grid range irradiated by the light supplementing lamp to be as large as possible, enabling the brightness in the grid range to be uniform or uniformly changed, and recording the brightness value of each point on the grid after optimization;
s5, comparing the brightness value of each point on the grid obtained in the step S4 with the target brightness value in the step S3, if the brightness value of each point on the grid obtained in the step S4 is more than or equal to the target brightness value, completing optimization, and if the brightness value of each point on the grid obtained in the step S4 is less than the target brightness value, carrying out the step S3 and the step S4 again.
The invention relies on the existing hardware, adopts the reversing light or the combination of the reversing light and the license plate light as the light supplementing light of the rear camera to supplement light, improves the illumination of the shooting environment of the rear camera of the automobile in the low illumination environment, ensures that the image shot by the rear camera can accurately feed back the environment behind the automobile, is convenient for drivers or vehicles to take accurate countermeasures according to the driving environment information when automatically parking, increases the driving safety, and has high practical value because no new parts are added, correspondingly does not increase the production cost, and is beneficial to popularization and use.
Drawings
FIG. 1 is a schematic diagram of the structure of the present invention;
FIG. 2 is a schematic flow chart of a light distribution optimization method of the automobile rear camera light supplementing device;
fig. 3 is a schematic diagram of the meshing of the present invention.
In the figure, 1-light supplementing lamp, 2-whole vehicle controller, 3-gearbox controller or engine controller and 4-gear shifting mechanism.
Detailed Description
The present invention will be described in detail with reference to the accompanying drawings.
Referring to fig. 1, the illustrated automobile rear camera light supplementing device comprises a light supplementing lamp 1, wherein the light distribution is optimized to enable the illumination of the light supplementing lamp 1 to be within the illumination range of a rear camera, the input end of the light supplementing lamp 1 is connected with the output end of a whole vehicle controller 2, the whole vehicle controller 2 is used for receiving a whole vehicle gear signal, and when the whole vehicle gear signal is in a reverse gear, the whole vehicle controller 2 drives the light supplementing lamp 1 to be started to supplement light for the rear camera.
The light supplementing lamp 1 is a reversing lamp or a combination of the reversing lamp and a license plate lamp, and when the automobile is reversed, if the small lamp of the whole automobile is not turned on, namely the position lamp and the license plate lamp are not turned on, the light supplementing lamp only turns on the reversing lamp to supplement light for the shooting environment of the rear camera. If the small lamp of the whole vehicle is started, namely the position lamp and the license plate lamp are started, the light supplementing lamp is started for the backup lamp and the license plate lamp at the same time to supplement light for the shooting environment of the rear camera.
The transmission and the reception of the whole vehicle gear signal are specifically as follows: the input end of the whole vehicle controller 2 is connected with the output end of the gearbox controller or the engine controller 3, the input end of the gearbox controller or the engine controller 3 is connected with the output end of the gear shifting mechanism 4, and the gearbox controller or the engine controller 3 is used for receiving the whole vehicle gear signal sent by the gear shifting mechanism 4 and sending the whole vehicle gear signal to the whole vehicle controller 2.
Referring to fig. 2, the light distribution optimization method of the automobile rear camera light supplementing device comprises the following steps:
s1, arranging model data of a rear camera and a light supplementing lamp in a whole vehicle model in three-dimensional modeling software, wherein the rear camera and the light supplementing lamp 1 are used as parts with visible appearance on the whole vehicle, and the whole vehicle modeling requirement needs to be met. The arrangement requirement of the cameras on the whole vehicle is met by the rear camera, the angle of the rear camera can be adjusted according to the installation height on the whole vehicle and the wide angle of shooting, the image shot by the rear camera looks natural, the environment behind the vehicle can be truly fed back, and the light supplementing lamp 1, namely the reversing lamp or the license lamp, is a lamp required by regulations, and the installation position of the light supplementing lamp needs to meet the corresponding lamp regulation requirement.
S2, importing the arrangement data of the light supplementing lamps in the step S1 into light distribution software, on the premise that the light supplementing lamps 1 meet the light distribution requirements of corresponding regulations, adopting the light distribution software to simulate road surface illuminance, irradiating as much light of the light supplementing lamps as possible into the image pickup range of a rear camera, dividing grids on the illuminated surface behind a vehicle and recording brightness values on grid points, wherein the grids are positioned right behind the whole vehicle, the length of the X direction is 10m, the width of each Y is 4m to the left and right, and the distance a is 1m.
And S3, determining target brightness values of all points on the grid points according to the imaging range of the rear camera and the brightness values on the grid points recorded in the S2.
And S4, optimizing the light distribution of the light supplementing lamp on the basis of the step S2, on the premise that the light supplementing lamp meets the light distribution requirement of corresponding regulations, enabling the brightness value of each point on the grid of the light irradiated by the light supplementing lamp in the grid range to be as large as possible, enabling the brightness in the grid range to be uniform or uniformly changed, and recording the brightness value of each point on the grid after optimization.
S5, comparing the brightness value of each point on the grid obtained in the step S4 with the target brightness value in the step S3, if the brightness value of each point on the grid obtained in the step S4 is more than or equal to the target brightness value, completing optimization, and if the brightness value of each point on the grid obtained in the step S4 is less than the target brightness value, carrying out the step S3 and the step S4 again.
According to the invention, by means of existing hardware, the light supplementing is carried out by taking the reversing light or the combination of the reversing light and the license plate light as the light supplementing light of the rear camera at the beginning of design, the illumination of the shooting environment of the rear camera in the low illumination environment is improved, the image shot by the rear camera can be accurately fed back to the rear environment, so that the driver or the automatic parking system of the vehicle can accurately acquire the rear environment information according to the image shot by the rear camera, the driver or the automatic driving of the vehicle can take accurate countermeasures according to the rear environment information, the occurrence of vehicle accidents caused by the fact that the rear camera cannot accurately acquire the rear environment information in the low illumination environment is avoided, the influence of the low illumination environment on the safety of the vehicle can be effectively overcome, the driving safety is improved, and the user experience is improved. And because the invention does not increase hardware and corresponding software, only analyze and design in the initial stage of design, does not increase production cost, well reduces the cost of the vehicle, has very high practical value, is favorable to popularizing and using.
The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, and alternatives falling within the spirit and principles of the invention.
Claims (1)
1. The light distribution optimization method of the automobile rear camera light supplementing device is characterized by comprising the following steps of:
s1, arranging model data of a rear camera and a light supplementing lamp in a whole vehicle model in three-dimensional modeling software, wherein the rear camera and the light supplementing lamp meet modeling requirements and whole vehicle arrangement requirements;
s2, importing the arrangement data of the light supplementing lamps in the step S1 into light distribution software, performing road surface illuminance simulation by adopting the light distribution software, dividing grids on an illuminated surface behind a vehicle, and recording brightness values on grid points;
s3, determining target brightness values of all points on the grid points according to the imaging range of the rear camera and the brightness values on the grid points recorded in the S2;
s4, optimizing the light distribution of the light supplementing lamp on the basis of S2, on the premise that the light supplementing lamp meets the light distribution requirement of corresponding regulations, enabling the brightness value of each point on the grid of the light in the grid range irradiated by the light supplementing lamp to be as large as possible, enabling the brightness in the grid range to be uniform or uniformly changed, and recording the brightness value of each point on the grid after optimization;
s5, comparing the brightness value of each point on the grid obtained in the step S4 with the target brightness value in the step S3, if the brightness value of each point on the grid obtained in the step S4 is more than or equal to the target brightness value, completing optimization, and if the brightness value of each point on the grid obtained in the step S4 is less than the target brightness value, carrying out the step S3 and the step S4 again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110969141.4A CN113761655B (en) | 2021-08-23 | 2021-08-23 | Light supplementing device for rear camera of automobile and light distribution optimization method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110969141.4A CN113761655B (en) | 2021-08-23 | 2021-08-23 | Light supplementing device for rear camera of automobile and light distribution optimization method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113761655A CN113761655A (en) | 2021-12-07 |
| CN113761655B true CN113761655B (en) | 2024-01-19 |
Family
ID=78790813
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110969141.4A Active CN113761655B (en) | 2021-08-23 | 2021-08-23 | Light supplementing device for rear camera of automobile and light distribution optimization method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113761655B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114299749A (en) * | 2021-12-28 | 2022-04-08 | 北京畅停天下停车场服务有限公司 | Domestic vehicle parking system with charging function |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN205490905U (en) * | 2015-12-30 | 2016-08-17 | 中国煤炭科工集团太原研究院有限公司 | Mining safe driving and accident analysis video recording system |
| WO2017101131A1 (en) * | 2015-12-14 | 2017-06-22 | 周勤行 | Vertical adjustment mechanism for use in car-top omnidirectional filming lens |
| CN108289362A (en) * | 2017-12-22 | 2018-07-17 | 武汉普利商用机器有限公司 | A kind of light compensating lamp adaptive control system and method |
| CN108650495A (en) * | 2018-06-28 | 2018-10-12 | 华域视觉科技(上海)有限公司 | A kind of automobile-used panoramic looking-around system and its adaptive light compensation method |
| CN208216611U (en) * | 2018-05-28 | 2018-12-11 | 广州英卓电子科技有限公司 | A kind of monitoring rearview mirror |
| CN208673526U (en) * | 2018-09-05 | 2019-03-29 | 广州南泽电子科技有限公司 | A kind of light sensation and environment light-supplementing control system of parking lot Vehicle License Plate Recognition System |
| CN109658527A (en) * | 2018-12-14 | 2019-04-19 | 广东安居宝数码科技股份有限公司 | Vehicle parking charge management method, device, equipment and storage medium |
| CN110351491A (en) * | 2019-07-25 | 2019-10-18 | 东软睿驰汽车技术（沈阳）有限公司 | A kind of low light compensation method according under environment, apparatus and system |
| CN209787274U (en) * | 2019-04-26 | 2019-12-13 | 陈宗林 | Vehicle-mounted front and rear integrated camera with light supplement lamp |
| CN110712594A (en) * | 2019-11-12 | 2020-01-21 | 合肥长安汽车有限公司 | Device and method for vehicle-mounted reversing video display brightening at night |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102015220911A1 (en) * | 2015-10-27 | 2017-04-27 | Bayerische Motoren Werke Aktiengesellschaft | motor vehicle |
-
2021
- 2021-08-23 CN CN202110969141.4A patent/CN113761655B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017101131A1 (en) * | 2015-12-14 | 2017-06-22 | 周勤行 | Vertical adjustment mechanism for use in car-top omnidirectional filming lens |
| CN205490905U (en) * | 2015-12-30 | 2016-08-17 | 中国煤炭科工集团太原研究院有限公司 | Mining safe driving and accident analysis video recording system |
| CN108289362A (en) * | 2017-12-22 | 2018-07-17 | 武汉普利商用机器有限公司 | A kind of light compensating lamp adaptive control system and method |
| CN208216611U (en) * | 2018-05-28 | 2018-12-11 | 广州英卓电子科技有限公司 | A kind of monitoring rearview mirror |
| CN108650495A (en) * | 2018-06-28 | 2018-10-12 | 华域视觉科技(上海)有限公司 | A kind of automobile-used panoramic looking-around system and its adaptive light compensation method |
| CN208673526U (en) * | 2018-09-05 | 2019-03-29 | 广州南泽电子科技有限公司 | A kind of light sensation and environment light-supplementing control system of parking lot Vehicle License Plate Recognition System |
| CN109658527A (en) * | 2018-12-14 | 2019-04-19 | 广东安居宝数码科技股份有限公司 | Vehicle parking charge management method, device, equipment and storage medium |
| CN209787274U (en) * | 2019-04-26 | 2019-12-13 | 陈宗林 | Vehicle-mounted front and rear integrated camera with light supplement lamp |
| CN110351491A (en) * | 2019-07-25 | 2019-10-18 | 东软睿驰汽车技术（沈阳）有限公司 | A kind of low light compensation method according under environment, apparatus and system |
| CN110712594A (en) * | 2019-11-12 | 2020-01-21 | 合肥长安汽车有限公司 | Device and method for vehicle-mounted reversing video display brightening at night |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113761655A (en) | 2021-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11220216B2 (en) | Vehicle-trailer rearview vision system and method | |
| CN101739843B (en) | Device and method for real-time three-dimensionally sensing safe driving of vehicle having mixed multi-visual information | |
| CN102202214B (en) | Image generation apparatus, image display system and image generation method | |
| CN102198818B (en) | On-vehicle lighting apparatus, image processing device, image display system and lighting method | |
| CN110351491B (en) | Light supplementing method, device and system in low-light environment | |
| CN201484287U (en) | Automobile rear-end collision safety warning device | |
| CN204681510U (en) | A kind of vehicle-mounted traffic violation video apparatus for obtaining evidence | |
| CN113761655B (en) | Light supplementing device for rear camera of automobile and light distribution optimization method | |
| CN208479822U (en) | A kind of automobile-used panoramic looking-around system | |
| CN111347969A (en) | Projection system and method of multimedia image and vehicle | |
| CN203331791U (en) | Sun shield system and vehicle | |
| CN105667386A (en) | Automobile light control system | |
| CN103434448A (en) | System for eliminating vehicle pillar blind zone and use method thereof | |
| CN112721930A (en) | Vehicle cornering deceleration planning method, system, vehicle and storage medium | |
| CN109131080A (en) | Vehicle rearview switching device, method and readable storage medium storing program for executing based on structure light | |
| CN111456811A (en) | Cloud monitoring safety dynamic system for high-speed tunnel | |
| CN112908035A (en) | Automobile auxiliary driving system based on visible light communication and implementation method | |
| US20210070177A1 (en) | Shifting a road view based on a speed for a vehicle | |
| JP2011008459A (en) | In-vehicle camera device | |
| CN113401045A (en) | Multi-purpose vehicle projection lamp system with lamp language function and method | |
| JP7051667B2 (en) | In-vehicle device | |
| DE102011083786A1 (en) | Method for implementing automatic color balancing in towing vehicle with camera system, has performing color balancing on picture information based on available lighting information, and providing color-corrected picture information | |
| CN205220507U (en) | Park auxiliary system and vehicle | |
| TWI809401B (en) | vehicle rear view warning system | |
| CN110712594A (en) | Device and method for vehicle-mounted reversing video display brightening at night |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |