CN110401798B - Method and device for adjusting output resolution of MIPI camera - Google Patents
Method and device for adjusting output resolution of MIPI camera Download PDFInfo
- Publication number
- CN110401798B CN110401798B CN201910697188.2A CN201910697188A CN110401798B CN 110401798 B CN110401798 B CN 110401798B CN 201910697188 A CN201910697188 A CN 201910697188A CN 110401798 B CN110401798 B CN 110401798B
- Authority
- CN
- China
- Prior art keywords
- resolution
- image data
- data
- mipi camera
- output
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to the technical field of MIPI cameras, in particular to a method and a device for adjusting output resolution of an MIPI camera, wherein the method comprises the following steps: step S1, providing a MIPI camera for outputting image data with a first resolution; step S2, providing an image data processor, wherein the image data processor provides a first data channel for outputting image data with a first resolution; the image data processor provides a second data channel for outputting image data with a second resolution; the second data channel provides a data subchannel for outputting image data with a third resolution. Has the advantages that: when the resolution ratio of the MIPI camera is switched by the application layer, the image effect of the MIPI camera corresponding to different resolution ratios does not need to be reloaded, and the image data of the second resolution ratio or the third resolution ratio can be directly called, so that the photographing can be faster, and the problem of different photographing and previewing effects caused by switching of image processing effect setting is reduced.
Description
Technical Field
The invention relates to the technical field of MIPI cameras, in particular to a method and a device for adjusting output resolution of an MIPI camera.
Background
MIPI (Mobile Industry Processor Interface) is an abbreviation for Mobile Industry Processor Interface. MIPI (mobile industry processor interface) is an open standard initiated by the MIPI alliance that is established for mobile application processors.
Adopt the camera module of MIPI interface, owing to adopted differential signal transmission, compare in parallel port and USB camera, it is fast to have, and transmission data volume is big, the low power dissipation, advantage that anti-interference is good, especially present consumer requires more and more high to the resolution ratio of camera, and market mainstream consumer electronic product's camera pixel configuration all is more than ten million, and traditional parallel port and USB camera can't satisfy the requirement of consumer to higher definition already. Therefore, more and more television manufacturers have begun to configure a built-in MIPI camera on their television platform to meet the demand of consumers for high-definition photographing and video.
ISP is a short for Image Signal Processor, that is, an Image Signal Processor, and is generally used to process output data of an Image Sensor, such as AEC (automatic exposure control), AGC (automatic gain control), AWB (automatic White balance), color correction, Lens Shading, Gamma correction, dead pixel removal, Auto Black Level, Auto White Level, and so on. The ISP can significantly improve the picture quality of photographing and video previewing, and is now basically a mobile phone platform standard module. Some smart television products are also equipped with ISPs to improve the image quality of cameras.
In actual use, the user has a higher resolution for taking a picture than for previewing. The user expects that the highest resolution supported by the camera can be used for photographing in order to obtain better photographing effect. In addition, when the algorithm applied to some images is used for processing preview data with large resolution, the capability is limited, and the camera preview data with too high resolution cannot be processed. So it is generally required that the camera video preview be at a lower resolution than the picture taking. For example, a typical phone platform takes a picture of 1600 ten thousand pixels, while the preview is only 200 thousand pixels. Therefore, the output of differentiated camera resolution is a problem which is often faced on mobile phone and television platforms.
In the prior art, as shown in fig. 1, a camera is photographed and previewed, and in the prior art, the camera sensor is switched between different resolutions of different scenes by switching different camera settings during photographing and previewing. In this switching method, since the backend ISP is required to synchronously switch the corresponding image effect processing settings, the consumed time is relatively long, and the inconsistency of the screen effect may occur immediately after the switching.
Disclosure of Invention
Aiming at the problems in the prior art, a method and a device for adjusting the output resolution of an MIPI camera are provided.
The specific technical scheme is as follows:
a method for adjusting output resolution of an MIPI camera comprises the following steps:
step S1, providing a MIPI camera for outputting image data with a first resolution;
step S2, providing an image data processor, wherein the image data processor provides a first data channel for outputting image data with the first resolution;
the image data processor provides a second data channel for outputting image data with a second resolution;
the second data channel provides a data subchannel for outputting image data with a third resolution.
Preferably, the first resolution is 2160P.
Preferably, the second resolution is 1080P.
Preferably, the third resolution is 720P.
Preferably, the second data channel provides a compression unit, and the compression unit is configured to compress the image data of the first resolution to output the image data of the second resolution.
Preferably, the data subchannel provides a cropping unit, and the cropping unit is configured to crop the image data with the second resolution to output the image data with the third resolution.
The invention also includes a device for adjusting the output resolution of the MIPI camera, which is characterized in that the method for adjusting the output resolution of the MIPI camera as claimed in any one of the claims 1 to 6 is adopted, and the adjusting device includes:
the system comprises an MIPI camera, a first image acquisition module and a second image acquisition module, wherein the MIPI camera is used for outputting image data with a first resolution;
the image data processor is connected with the MIPI camera and comprises a first data channel used for outputting image data with the first resolution;
the image data processor comprises a second data channel for outputting image data with a second resolution;
the second data channel includes a data sub-channel for outputting image data with a third resolution.
Preferably, the first resolution is 2160P;
the second resolution is 1080P;
the third resolution is 720P.
Preferably, the second data channel includes a compression unit, and the compression unit is configured to compress the image data of the first resolution to output the image data of the second resolution.
Preferably, the data sub-channel includes a cropping unit, and the cropping unit is configured to crop the image data with the second resolution to output the image data with the third resolution.
The technical scheme of the invention has the beneficial effects that: an image data processor provides a first data channel to output image data with the first resolution, provides a second data channel to output image data with the second resolution, and provides a data sub-channel to output image data with the third resolution; when the resolution of the MIPI camera is switched by the application layer, for example, the switching of photographing and previewing is carried out, the image effect of the MIPI camera corresponding to different resolutions is not required to be reloaded, and the image data of the second resolution or the third resolution can be directly called, so that the photographing can be faster, and the problem of different photographing and previewing effects caused by the fact that the image processing effect setting is switched is solved.
Drawings
Embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings. The drawings are, however, to be regarded as illustrative and explanatory only and are not restrictive of the scope of the invention.
Fig. 1 is a flowchart of a step of processing an image output by an MIPI camera in the prior art;
fig. 2 is a flowchart illustrating steps of a method for adjusting an output resolution of an MIPI camera according to an embodiment of the present invention;
fig. 3 is a schematic block diagram of an adjusting device for an output resolution of an MIPI camera according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict.
The invention is further described with reference to the following drawings and specific examples, which are not intended to be limiting.
The invention comprises a method for adjusting output resolution of an MIPI camera, which comprises the following steps:
step S1, providing a MIPI camera 1, where the MIPI camera 1 is configured to output image data with a first resolution;
step S2, providing an image data processor 2, wherein the image data processor 2 provides a first data channel FR for outputting image data with a first resolution;
the image data processor 2 provides a second data channel DS1 for outputting image data with a second resolution;
the second data channel provides a data sub-channel CORP for outputting image data with a third resolution.
Through the technical scheme of the method for adjusting the output resolution of the MIPI camera, as shown in fig. 2 and 3, for different resolution requirements of photographing and previewing by the MIPI camera 1, the MIPI camera 1 supports output of image data of at least three resolutions, wherein the at least three resolutions provide 2160P resolution or 1080P resolution or 720P resolution. The resolution of MIPI camera 1 is preset with a fixed resolution, i.e. the first resolution may be set to 2160P, for example, while image data processor 2 makes at least two data channel outputs, for example, using first data channel FR and second data channel DS1, where first data channel FR outputs image data with the first resolution, for example, outputs image data with a 2160P resolution, i.e. the resolution with a display format of 3840 × 2160, and is mainly used for taking pictures; the second data channel DS1 outputs image data having a second resolution, for example 1080P resolution, i.e. a display format of 1920 × 1080 resolution, for preview and application specific input.
Further, if it is required to support image data with a resolution lower than that output by the DS1, a data sub-channel CORP is provided on the basis of the second data channel DS1 to output image data with a third resolution, for example, 720P resolution, i.e., 1280 × 720 resolution in display format, for cropping to meet the customized requirement.
Further, the advantage of this solution is that when the resolution of the MIPI camera 1 is switched by the application layer CameraHAL, for example, switching between photographing and preview, the image data of the second resolution or the third resolution can be directly called without reloading the image effect of the MIPI camera corresponding to the different resolution, so that photographing can be faster, and the problem of inconsistency between the photographing effect and the preview effect caused by switching the image processing effect setting is reduced.
The image data processor 2 is an ISP image signal processor, which is generally used to process output data of an image sensor of the MIPI camera 1, and is not described herein again.
In the above technical solution, as a preferred embodiment, the second data channel DS1 provides a compression unit, and the compression unit is configured to compress the image data with the first resolution to output the image data with the second resolution, for example, compress the image data with the 2160P resolution to 1080P resolution for preview and input of specific applications.
Further, when the resolution of the MIPI camera 1 is switched by the application layer, for example, switching between photographing and preview is performed, without reloading the image effect of the MIPI camera corresponding to different resolutions, the image data of the second resolution or the third resolution can be directly called, so that photographing can be faster, and the problem of inconsistency between photographing and preview effects caused by switching of image processing effect settings is reduced.
In the above technical solution, as a preferred embodiment, the data subchannel CORP provides a cropping unit, and the cropping unit is configured to crop the image data with the second resolution to output the image data with the third resolution, for example, crop the image data with 1080P resolution into the image data with 720P resolution to meet the requirement of customization.
Further, when the resolution of the MIPI camera 1 is switched by the application layer, for example, switching between photographing and preview is performed, without reloading the image effect of the MIPI camera corresponding to different resolutions, the image data of the second resolution or the third resolution can be directly called, so that photographing can be faster, and the problem of inconsistency between photographing and preview effects caused by switching of image processing effect settings is reduced.
In a preferred embodiment, as shown in fig. 3, MIPI camera 1 inputs image data at 2160P resolution, first data channel FR outputs image data at the original input resolution, i.e. at 2160P resolution, and second data channel DS1 may set outputs to 1080P resolution image data or 720P resolution image data. For example, the second data channel DS1 needs to output image data with 1080P resolution, and the second resolution is compressed into image data with the third resolution by using a compression unit.
Further, if a lower resolution is desired, cropping may be performed using the cropping unit of the sub-data channel CORP of the second data channel DS1, trimming 1920x1080 pictures into 1280x720 image data.
It should be noted that, by doing so, the content around the frame in the original shot picture is lost. Since the second data channel DS1 itself compresses the first data channel RF, the amount of data already compressed and then clipped may be less demanding on the processing power of the platform CPU. Although we do the cropping, the lost field of view is smaller because the difference between 1080P and 720P is smaller, and will not be described again.
Further, when the resolution of the MIPI camera 1 is switched by the application layer, for example, switching between photographing and preview is performed, without reloading the image effect of the MIPI camera corresponding to different resolutions, the image data of the second resolution or the third resolution can be directly called, so that photographing can be faster, and the problem of inconsistency between photographing and preview effects caused by switching of image processing effect settings is reduced.
The invention provides a device for adjusting output resolution of an MIPI camera, wherein any method for adjusting the output resolution of the MIPI camera is adopted, and the adjusting device comprises the following steps:
the system comprises a MIPI camera 1, a first image processing module and a second image processing module, wherein the MIPI camera 1 is used for outputting image data with a first resolution;
an image data processor 2 connected to the MIPI camera 1, the image data processor 2 including a first data channel FR for outputting image data with a first resolution;
the image data processor 2 comprises a second data channel DS1 for outputting image data with a second resolution;
the second data channel includes a data sub-channel CORP for outputting image data with a third resolution.
Through the technical scheme of the adjusting device for the output resolution of the MIPI camera, as shown in fig. 3, for different resolution requirements of photographing and previewing by the MIPI camera 1, the MIPI camera 1 supports output of image data of at least three resolutions, wherein the at least three resolutions provide 2160P resolution, 1080P resolution or 720P resolution. The resolution of MIPI camera 1 is preset with a fixed resolution, i.e. the first resolution may be set to 2160P, for example, while image data processor 2 makes at least two data channel outputs, for example, using first data channel FR and second data channel DS1, where first data channel FR outputs image data with the first resolution, for example, outputs image data with a 2160P resolution, i.e. the resolution with a display format of 3840 × 2160, and is mainly used for taking pictures; the second data channel DS1 outputs image data having a second resolution, for example 1080P resolution, i.e. a display format of 1920 × 1080 resolution, for preview and application specific input.
Further, if it is required to support image data with a resolution lower than that output by the DS1, a data sub-channel CORP is provided on the basis of the second data channel DS1 to output image data with a third resolution, for example, 720P resolution, i.e., 1280 × 720 resolution in display format, for cropping to meet the customized requirement.
Further, the advantage of this solution is that when the resolution of the MIPI camera 1 is switched by the application layer CameraHAL, for example, switching between photographing and preview, the image data of the second resolution or the third resolution can be directly called without reloading the image effect of the MIPI camera corresponding to the different resolution, so that photographing can be faster, and the problem of inconsistency between the photographing effect and the preview effect caused by switching the image processing effect setting is reduced.
In the above technical solution, as a preferred embodiment, the second data channel DS1 provides a compression unit, and the compression unit is configured to compress the image data with the first resolution to output the image data with the second resolution, for example, compress the image data with the 2160P resolution to 1080P resolution for preview and input of specific applications.
Further, when the resolution of the MIPI camera 1 is switched by the application layer, for example, switching between photographing and preview is performed, without reloading the image effect of the MIPI camera corresponding to different resolutions, the image data of the second resolution or the third resolution can be directly called, so that photographing can be faster, and the problem of inconsistency between photographing and preview effects caused by switching of image processing effect settings is reduced.
In the above technical solution, as a preferred embodiment, the data subchannel CORP provides a cropping unit, and the cropping unit is configured to crop the image data with the second resolution to output the image data with the third resolution, for example, crop the image data with 1080P resolution into the image data with 720P resolution to meet the requirement of customization.
Further, when the resolution of the MIPI camera 1 is switched by the application layer, for example, switching between photographing and preview is performed, without reloading the image effect of the MIPI camera corresponding to different resolutions, the image data of the second resolution or the third resolution can be directly called, so that photographing can be faster, and the problem of inconsistency between photographing and preview effects caused by switching of image processing effect settings is reduced.
While the invention has been described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention.
Claims (10)
1. A method for adjusting output resolution of an MIPI camera is characterized by comprising the following steps:
step S1, providing a MIPI camera for outputting image data with a first resolution;
step S2, providing an image data processor, wherein the image data processor provides a first data channel for outputting image data with the first resolution; the image data processor provides a second data channel for outputting image data with a second resolution; the second data channel provides a data subchannel for outputting image data with a third resolution.
2. The method of adjusting an output resolution of a MIPI camera according to claim 1, wherein the first resolution is 2160P.
3. The adjusting method of the output resolution of the MIPI camera according to claim 1, wherein the second resolution is 1080P.
4. The method of adjusting an output resolution of a MIPI camera according to claim 1, wherein the third resolution is 720P.
5. The method of claim 1, wherein the second data channel provides a compression unit for compressing the image data of the first resolution to output the image data of the second resolution.
6. The method of claim 1, wherein the data subchannel provides a cropping unit for cropping the image data with the second resolution to output the image data with the third resolution.
7. An adjusting device for output resolution of an MIPI camera, which is characterized in that, the adjusting method for output resolution of an MIPI camera as claimed in any one of the claims 1-6 is adopted, the adjusting device comprises:
the system comprises an MIPI camera, a first image acquisition module and a second image acquisition module, wherein the MIPI camera is used for outputting image data with a first resolution;
the image data processor is connected with the MIPI camera and comprises a first data channel used for outputting image data with the first resolution;
the image data processor comprises a second data channel for outputting image data with a second resolution;
the second data channel includes a data sub-channel for outputting image data with a third resolution.
8. The apparatus of claim 7, wherein the first resolution is 2160P;
the second resolution is 1080P;
the third resolution is 720P.
9. The apparatus of claim 7, wherein the second data channel includes a compression unit for compressing the image data of the first resolution to output the image data of the second resolution.
10. The apparatus of claim 7, wherein the data sub-channel includes a cropping unit for cropping the image data with the second resolution to output the image data with the third resolution.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910697188.2A CN110401798B (en) | 2019-07-30 | 2019-07-30 | Method and device for adjusting output resolution of MIPI camera |
| PCT/CN2020/100279 WO2021017756A1 (en) | 2019-07-30 | 2020-07-03 | Method and apparatus for adjusting output resolution of mipi camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910697188.2A CN110401798B (en) | 2019-07-30 | 2019-07-30 | Method and device for adjusting output resolution of MIPI camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110401798A CN110401798A (en) | 2019-11-01 |
| CN110401798B true CN110401798B (en) | 2021-03-09 |
Family
ID=68326604
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910697188.2A Active CN110401798B (en) | 2019-07-30 | 2019-07-30 | Method and device for adjusting output resolution of MIPI camera |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110401798B (en) |
| WO (1) | WO2021017756A1 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110401798B (en) * | 2019-07-30 | 2021-03-09 | 晶晨半导体（深圳）有限公司 | Method and device for adjusting output resolution of MIPI camera |
| CN118660236A (en) * | 2020-07-10 | 2024-09-17 | 华为技术有限公司 | Photographing method and electronic equipment |
| CN112188095B (en) * | 2020-09-25 | 2022-05-20 | 北京小米移动软件有限公司 | Photographing method, photographing device and storage medium |
| CN114630016B (en) * | 2020-12-09 | 2023-04-25 | Oppo广东移动通信有限公司 | Image processing method, image processor and electronic equipment |
| CN112954216A (en) * | 2021-02-19 | 2021-06-11 | 迅镭智能（广州）科技有限公司 | Image processing method based on high-speed shooting instrument and related equipment |
| CN113570803A (en) * | 2021-07-28 | 2021-10-29 | 东莞全芯物联科技有限公司 | AI intelligence alarm host computer based on speech recognition and image recognition technique |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105763782A (en) * | 2016-04-27 | 2016-07-13 | 昆山丘钛微电子科技有限公司 | Dual-camera image decoding and transmission apparatus |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102447847A (en) * | 2011-11-02 | 2012-05-09 | 北京思比科微电子技术股份有限公司 | Multi-image sensor image processing device with MIPI (Mobile Industry Processor Interface) and method |
| JP6239288B2 (en) * | 2013-07-11 | 2017-11-29 | シナプティクス・ジャパン合同会社 | LCD driver IC |
| CN106161987B (en) * | 2015-03-24 | 2019-05-10 | 深圳市巨烽显示科技有限公司 | A kind of more image Display on the same screen methods and more image Display on the same screen systems |
| CN105023549B (en) * | 2015-07-15 | 2017-05-31 | 武汉精测电子技术股份有限公司 | The MIPI figure signals generation device and method of resolution ratio self adaptation |
| CN110401798B (en) * | 2019-07-30 | 2021-03-09 | 晶晨半导体（深圳）有限公司 | Method and device for adjusting output resolution of MIPI camera |
-
2019
- 2019-07-30 CN CN201910697188.2A patent/CN110401798B/en active Active
-
2020
- 2020-07-03 WO PCT/CN2020/100279 patent/WO2021017756A1/en active Application Filing
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105763782A (en) * | 2016-04-27 | 2016-07-13 | 昆山丘钛微电子科技有限公司 | Dual-camera image decoding and transmission apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021017756A1 (en) | 2021-02-04 |
| CN110401798A (en) | 2019-11-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110401798B (en) | Method and device for adjusting output resolution of MIPI camera | |
| EP3694203B1 (en) | Method and device for obtaining exposure compensation value of high-dynamic-range image | |
| US11563897B2 (en) | Image processing method and apparatus which determines an image processing mode based on status information of the terminal device and photographing scene information | |
| US8488019B2 (en) | Image-capturing device, image-capturing method and storage medium storing image-capturing program for generating a wide dynamic range image | |
| JP5739001B2 (en) | Target area extraction | |
| US9294687B2 (en) | Robust automatic exposure control using embedded data | |
| WO2017215501A1 (en) | Method and device for image noise reduction processing and computer storage medium | |
| US10957281B2 (en) | Photographing method by smart television and system thereof | |
| US20090102945A1 (en) | System and method for generating high dynamic range images | |
| US11750934B2 (en) | Imaging apparatus, image processing apparatus, control method of these, and storage medium | |
| US9706074B2 (en) | Method and apparatus for capturing images in an electronic device | |
| EP3836532A1 (en) | Control method and apparatus, electronic device, and computer readable storage medium | |
| US20030174228A1 (en) | System for user-selectable image pre-processing in a digital camera | |
| WO2022151852A1 (en) | Image processing method, apparatus, and system, electronic device, and storage medium | |
| US9503652B2 (en) | Method and apparatus for controlling image generation of image capture device by determining one or more image capture settings used for generating each subgroup of captured images | |
| EP3889883A1 (en) | Image processing method and device, mobile terminal, and storage medium | |
| JP2002288650A (en) | Image processing device, digital camera, image processing method and recording medium | |
| JP2002084440A (en) | Digital camera, image processing method and recording medium | |
| CN116416323A (en) | Image processing method and device, electronic equipment and storage medium | |
| CN105578064B (en) | The control method of photographic device and photographic device | |
| CN114500853A (en) | Electronic device and image display method | |
| KR100459422B1 (en) | Image quality compensation method for mobile communication terminal with camera | |
| KR101652117B1 (en) | Apparatus and method for reducing digital camera shutter lag | |
| US11412173B2 (en) | Image processing device and image processing method | |
| US8854256B2 (en) | Image capture apparatus and method of controlling the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |