CN102866772A - Interactive image system, interactive control device and operating method thereof - Google Patents
Interactive image system, interactive control device and operating method thereof Download PDFInfo
- Publication number
- CN102866772A CN102866772A CN2011101939598A CN201110193959A CN102866772A CN 102866772 A CN102866772 A CN 102866772A CN 2011101939598 A CN2011101939598 A CN 2011101939598A CN 201110193959 A CN201110193959 A CN 201110193959A CN 102866772 A CN102866772 A CN 102866772A
- Authority
- CN
- China
- Prior art keywords
- image
- pixel
- interdynamic
- reference point
- control device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Image Processing (AREA)
Abstract
The invention provides an interactive image system, an interactive control device and an operating method thereof. The interactive image system comprises a host, a light source and the interactive control device, the host generates an interactive image, the light source emits at least one light ray, data are transmitted between the interactive control device and the host, and the interactive control device is changed over an operation state and an idle state. The interactive control device comprises an image sensor and a control circuit, the image sensor captures a first image in the idle state, the first image comprises a reference point image imaged by the light rays, and the control circuit selects a pixel region according to the position of the reference point image of the first image, controls the image sensor to scan the pixel region to obtain a second image, and compares a threshold value with brightness information of at least one pixel in the pixel region of the second image to determine whether the interactive control device is still in the idle state.
Description
Technical field
The present invention relates to a kind of interdynamic image system, interactive control device and How It Works thereof, refer to especially a kind of image sampling condition that under idle state, can adjust image module in the interactive device, thereby save interdynamic image system, interactive control device and the How It Works thereof of electric energy.
Background technology
Existing game remote device, " indicator positioning device of video camera " such as TW patent I267754 number, it can be applicable to light gun game, and this indicator positioning device is provided with control circuit in the photography indicator device, and it is connected with respectively video camera, computing unit and communication interface.This communication interface is connected in main frame, and this video camera the place ahead is provided with filter, and is provided with a plurality of light-emitting components that can supply video camera to take on screen.When a user uses this photography indicator device to carry out the performed program of main frame, when this photo-opportunity is taken display screen, because video camera has filter, thus the light source filtering beyond the spectrum that light-emitting component can be sent, so the light source of light-emitting component only can appear in the captured picture of video camera.This picture being transferred to computing unit calculates the coordinate figure of video camera aiming point and is sent to main frame, the control that makes main frame can utilize this coordinate figure to be correlated with again.
Yet in actual use, in order to promote the property convenient for control of telechiric device, telechiric device utilizes and carries out data transmission between wireless telecommunications and main frame, and uses the whole required electric energy of battery module supply telechiric device.Because telechiric device comprises several dissipative cells, the power consumption of necessary each element of reduce is to prolong the life-span of battery module.Usually calculate the precision of aiming point coordinate in order to promote computing unit, the image capture frequency acquisition image that the better use of video camera is higher, but high image capture rate can increase the computational load of computing unit relatively, and then the total consumption electric energy of increase telechiric device, and the serviceable life of reducing battery module.
The TW patent disclosure discloses a kind of " displacement detection apparatus and electricity saving method thereof " for No. 200912700.This displacement detection apparatus should be a mouse, comprises a light source and an image acquisition unit, and wherein image acquisition unit can capture light source projects continuously in a surperficial formed image.Displacement detection apparatus can calculate the alternate position spike of references object in the aforementioned continuous image to obtain motion vector (motion vector), when motion vector value within a schedule time all less than a threshold values, then displacement detection apparatus is identified and is in idle state and non-operating state.If displacement detection apparatus is in idle state, can reduce the glow frequency of light source, so can reduce power consumption.Similarly, the TW patent disclosure discloses a kind of " displacement detection apparatus and electricity saving method thereof " for No. 200943131, it can be according to the displacement of this displacement detection apparatus between the double light emission period of light source, adjusting the light period of light source, and expects and can reduce power consumption.
The target that is different from aforementioned two publication instructionss is mouse, the TW patent discloses a kind of " interdynamic image system, interactive device and How It Works thereof " for I338241 number, can be by the sampling frequency of image module in the modulation interactive device in real time, to save the consumption electric energy of interactive device integral body.No matter reduce the sampling frequency of image module, or reduce the glow frequency of light source, these prior aries still are acquisition complete picture (frame) and the data of processing this complete picture, therefore still can't effectively reduce power consumption.
In view of this, the present invention proposes a kind of image sampling condition that can adjust image module in the interactive device under idle state namely for above-mentioned the deficiencies in the prior art, thereby saves interdynamic image system, interactive control device and the How It Works thereof of electric energy.
Can consult United States Patent (USP) or publication US 7,839,388 with the patent that this case may be relevant; US 7,738, and 013; US 7,738, and 013; US 7,619, and 669; US 20070024587 etc.
Summary of the invention
One of the object of the invention is to overcome the deficiencies in the prior art and defective, proposes a kind of interdynamic image system that can save electric energy.
One of another purpose of the present invention is, proposes a kind of interactive control device for interdynamic image system.
One of a further object of the present invention is, proposes a kind of How It Works of interdynamic image system.
For reaching above-mentioned purpose, with regard to one of them viewpoint speech, the invention provides a kind of interdynamic image system, comprise: a main frame produces interactive image; One light source sends at least one light; An and interactive control device, and data transmission between this main frame, and between a mode of operation and an idle state, switch, comprising: an image sensor, acquisition one first image under this idle state, wherein this first image comprises a reference point image of this image formation by rays; An and control circuit, a pixel region is chosen in position according to this reference point image in this first image, controlling this image sensor scans this pixel region and obtains one second image, relatively whether the monochrome information of interior at least one pixel of this pixel region in a threshold values and this second image still is in this idle state to confirm this interactive control device.
In a kind of enforcement kenel, this pixel region is the identical or partial pixel scope of these reference point image respective pixel lattice therein, and for example: there is the pixel coverage of high-high brightness the centre.
In a kind of enforcement kenel, this pixel region is the expansion pixel coverage that comprises these reference point image respective pixel lattice therein.
In a kind of enforcement kenel, this monochrome information is the brightness value of a pixel in this pixel region or the average brightness of a plurality of pixels therein.
With regard to another viewpoint speech, the invention provides a kind of interactive control device, acceptance is sent at least one light from a light source, and between a mode of operation and an idle state, switch, this interactive control device comprises: an image sensor, acquisition one first image under this idle state, wherein this first image comprises a reference point image of this image formation by rays; An and control circuit, a pixel region is chosen in position according to this reference point image in this first image, controlling this image sensor scans this pixel region and obtains one second image, relatively whether the monochrome information of interior at least one pixel of this pixel region in a threshold values and this second image still is in this idle state to confirm this interactive control device.
With regard to another viewpoint speech, the present invention provides again a kind of How It Works of interdynamic image system, comprises: acquisition one first image under idle state; At least one pixel region is chosen in position according at least one reference point image in this first image; Scan this pixel region to obtain one second image; And the monochrome information that compares interior at least one pixel of this pixel region in a threshold values and this second image, whether still be in this idle state to confirm this interdynamic image system.
In a kind of enforcement kenel, this interdynamic image system is identified and still is in this idle state therein, then reduces the sampling frequency of image in this interdynamic image system or reduces the glow frequency of light source in this interdynamic image system.
In a kind of enforcement kenel, this interdynamic image system is identified and is not in this idle state, then enters this mode of operation therein.
Illustrate in detail below by specific embodiment, when the effect that is easier to understand purpose of the present invention, technology contents, characteristics and reaches.
Description of drawings
Fig. 1 shows the synoptic diagram of the interdynamic image system of one embodiment of the invention;
Fig. 2 A~2D shows that interactive control device acquisition of the present invention comprises the image of a plurality of reference point images;
Fig. 3 is the process flow diagram of the How It Works of idle state affirmation of the present invention.
Symbol description among the figure
10 interdynamic image systems
11 interactive control devices
111 wireless modules
112 control circuits
113 image sensors
12 main frames
121 wireless modules
122 processors
13 light sources
131 reference point
14 video displays
21~23 reference point images
20a~20d image
241~245 pixel regions
31~36 steps
Embodiment
The remote control that the present invention is applicable to webpage in the interactive game program implementation, display of game host browse and other remote control audio-video system (for example: operation intelligent television smart TV), but because of game host for the most common at present, so followingly be illustrated as an example of game host example.
With reference to shown in Figure 1, it discloses the synoptic diagram of the interdynamic image system of one embodiment of the invention.Interdynamic image system 10 comprises an interactive control device 11, a main frame 12, a light source 13 and a video display 14.The embodiment of main frame 12 can be a game host, a computer system host or an interactive image and dials and put device, can carry out the interactive game program, is shown in to produce interactive image on this video display 14 to control for the user.Main frame 12 comprises a wireless module 121 and a processor 122, and by 111 transmitted in both directions data of wireless module (RF1 and RF2) in wireless module 121 and the interactive control device 11, processor 122 can be according to described data to carry out interactive game.This main frame 12 can also wired or wireless mode be connected with this display 14, or directly this main frame 12 is arranged at this display 14 inside.
Show a cursor on the screen of this video display 14, what embodiment included, but not limited to the point of impact of a light gun and image clicks arrow etc.Interactive control device 11 comprises a wireless module 111, a control circuit 112 and an image sensor 113, the image of reference point 131 in the image sensor 113 fechtable light sources 13 wherein, and control circuit 112 determines position, moving direction and the amount of movement of interactive control device 11 that is the location of aforementioned cursor and displacement according to the image of reference point 131.
The embodiment of the reference point 131 of light source 13 can be, but be not limited to, the reference point of the various shapes that the luminescence unit of several infrared light light emitting diodes or specific wavelength rearranges, it can be electrically connected to main frame 12 or this video display 14, and independently power supply is supplied electric energy required when luminous voluntarily.This light source 13 also can be integrated among this display 14 or this main frame 12.In addition, the number of reference point 131 is not limited in the icon 6, can also be one or more.The image of the described reference point 131 of interactive control device 11 acquisition changes to judge this interactive control device 11 and relative position and/or the angle of this reference point, with relative to the control cursor on video display 14 the position and move.Interactive control device 11 is in order to control this main frame 12 performed games or a computer software.When this main frame 12 performed persons were a Games Software, this interactive device 11 was such as can be used as (but being not limited to) light gun, a billiard stick, a golf clubs, a tennis racket, a bat, a Badminton racket and table tennis bat etc. to control the carrying out of game.When main frame 12 performed persons were a computer software, this interactive device 11 for example can be used as a pointer (cursor) locating device to control the carrying out of this computer software.
Fig. 2 A~2D shows that interactive control device acquisition of the present invention comprises the image of a plurality of reference point images.Image 20a~20d is that a plurality of reference point image in the image in the image sensor 113 among Fig. 2 A~2D.Fig. 2 A is by being captured a complete image at idle state, and the reference point image is reference point (bright spot) imaging zone.Reference point image 21~23 is illustration only among this figure, is not limited to the pixel of a unit, and a unit also can represent a plurality of pixels among the figure again.In addition; image 20a~20d is the image that interactive control device 11 captures under idle state; the decision mechanism that so switches to idle state by mode of operation can adopt the disclosed method of any prior art, such as: the aforementioned motion vector that utilizes judges that methods such as entering idle state all belongs to protection scope of the present invention.
For confirming that at least one reference point image is not present in position, image 20a Central Plains among the image 20b, and interactive control device 11 is switched to mode of operation, the monochrome information of the pixel of these three reference point images 21~23 among the correspondence image 20a among control circuit 112 meeting comparison one threshold values and the image 20b, for example: among the image 20b among the correspondence image 20a brightness value of the pixel cell of reference point image 22 or average brightness be lower than a reservation threshold, can judge that then this reference point image 22 or bright spot left position, image 20a Central Plains.Otherwise, if the brightness of this pixel cell is higher than a reservation threshold, then can judge this reference point image 22 still in position, image 20a Central Plains, if reference point image 21 and 23 can think then that also in their position originally interactive control device 11 still is in idle state.When confirming that interactive control device 11 also is in idle state, control circuit 112 can be further reduces the sampling frequency (frame rate) of image sensor 113, or reduces the glow frequency of light source 13, to save power consumption.Can determine to disappear in a bright spot according to system requirements namely switches to mode of operation, as long as or have a bright spot sustainable existence namely to remain on idle state, further also can be set as to have at least that N bright spot existence just can remain on idle state.
Fig. 2 B is the pixel compartments of three reference point images among the scan image 20a only, so may leave idle state because of noise or the trickle misidentification interactive control device 11 that rocks of desktop.So the pixel compartments of three reference point images is benchmark in can image 20a, and to around enlarge that to select a plurality of pixel compartments be sweep limit again, as three pixel regions 241~243 being arranged as sweep limit among Fig. 2 A, or be called the concern district, that is other regional pixel compartments can be closed when next picture scanning.Pixel region can be the sweep limit of aforementioned expansion among the present invention, or the pixel coverage at script reference point image place.Fig. 2 C namely is that next picture scans resulting image 20c, and reference point image 22~23 does not all change its position in the pixel region 242~243, but the position of reference point image 21 changes in the pixel region 241.Because reference point image 21 still is arranged in pixel region 241, so control circuit 112 can judge that interactive control device 11 does not leave idle state.If or detecting pixel region 241 has at least one bright spot to exist, just can judge that interactive control device 11 does not leave idle state.So-called bright spot exists or judges that namely the brightness value of a pixel can assert then that greater than a reservation threshold this pixel is the bright spot place.
Referring to Fig. 2 D, pixel region 244 and 245 is sweep limit for choosing the column of pixels lattice according to the position of three reference point images 21~23 among the image 20a among the image 20d.At other embodiment, can also select whole hurdle pixel compartments is sweep limit, and the sweep limit of aforementioned each embodiment can be set as with reference to 21~23 corresponding formed objects of image, the pixel compartments that enlarges or dwindle.
Previous embodiment is with the sketch illustration, and this paragraph is to adopt actual example to be further described.The pixel compartments size of one image sensor is 128 * 96, if two reference point images are arranged in the first image, and each reference point image size is about 30~50 pixels.Two pixel regions are made as 50 pixel compartments, so image sensor only needs to open 0.81% pixel compartments and get final product, it is calculated as follows: (50 * 2)/(128 * 96)=0.00813.Equally, the circuit modules such as signal and image processing can reduce the processed pixels number in proportion in the interactive control device 11, therefore can further reduce power consumption.
Fig. 3 is the process flow diagram of the How It Works of interdynamic image system of the present invention.Referring to step 31, under idle state, interactive control device can be opened whole pixel compartments of image sensor to capture one first image.At least one pixel region is chosen in position according at least one reference point image in the first image, and pixel region can be same range as or the expanded scope that comprises the respective pixel lattice of reference point image again, shown in step 32.According to shown in the step 33, the pixel compartments in the image sensor scanning element zone is to obtain one second image.Shown in step 34, compare the monochrome information of interior at least one pixel of this pixel region in a threshold values th and this second image, for example: whether brightness value or average brightness still are in this idle state to confirm this interactive control device.Shown in step 35, when confirming that interactive control device also is in idle state, can be further the sampling frequency of image sensor be reduced, or reduce the glow frequency of light source, to save power consumption.If sampling frequency or glow frequency have been down to lowest frequency value, just do not need to downgrade again, and direct rebound step 33.Otherwise, if the brightness value of this pixel is lower than threshold values th, can judge that then this reference point image not in position, the first image Central Plains, then requires dynamic control device to enter mode of operation, shown in step 36.
Below for preferred embodiment the present invention is described, just the above for making those skilled in the art be easy to understand content of the present invention, is not to limit interest field of the present invention only.Under same spirit of the present invention, those skilled in the art can think and various equivalence changes.For example, the scope of pixel region is selected and quantity, can be different from the illustration of previous embodiment.Perhaps, confirm that the reference point image still is positioned at the method for each pixel region, for example: by the brightness correlation values of single pixel in the compared pixels zone or the brightness correlation values of a plurality of pixels, the category of also protecting for the present invention.Scope of the present invention should contain above-mentioned and other all equivalences change.
Claims (20)
1. an interdynamic image system is characterized in that, comprises:
One main frame produces interactive image;
One light source sends at least one light; And
One interactive control device, and data transmission between this main frame, and between a mode of operation and an idle state, switch, comprising:
One image sensor, acquisition one first image under this idle state, wherein this first image comprises a reference point image of this image formation by rays; And
One control circuit, a pixel region is chosen in position according to this reference point image in this first image, controlling this image sensor scans this pixel region and obtains one second image, relatively whether the monochrome information of interior at least one pixel of this pixel region in a threshold values and this second image still is in this idle state to confirm this interactive control device.
2. interdynamic image system as claimed in claim 1, wherein, this pixel region is the same pixel scope of these reference point image respective pixel lattice.
3. interdynamic image system as claimed in claim 1, wherein, this pixel region is the expansion pixel coverage that comprises these reference point image respective pixel lattice.
4. interdynamic image system as claimed in claim 1, wherein, this pixel region is the partial pixel scope of these reference point image respective pixel lattice.
5. interdynamic image system as claimed in claim 1, wherein, this monochrome information is the brightness value of a pixel in this pixel region or the average brightness of a plurality of pixels.
6. interdynamic image system as claimed in claim 1, wherein, this light source comprises the reference point that a plurality of meetings emit beam.
7. interdynamic image system as claimed in claim 1, wherein, this interactive control device is identified and still is in this idle state, and then this control circuit reduces the sampling frequency of this image sensor or notifies this main frame to reduce the glow frequency of this light source.
8. an interactive control device is accepted to send at least one light from a light source, and is switched between a mode of operation and an idle state, it is characterized in that this interactive control device comprises:
One image sensor, acquisition one first image under this idle state, wherein this first image comprises a reference point image of this image formation by rays; And
One control circuit, a pixel region is chosen in position according to this reference point image in this first image, controlling this image sensor scans this pixel region and obtains one second image, relatively whether the monochrome information of interior at least one pixel of this pixel region in a threshold values and this second image still is in this idle state to confirm this interactive control device.
9. interactive control device as claimed in claim 8, wherein, this pixel region is the same pixel scope of these reference point image respective pixel lattice.
10. interactive control device as claimed in claim 8, wherein, this pixel region is the expansion pixel coverage that comprises these reference point image respective pixel lattice.
11. interactive control device as claimed in claim 8, wherein, this pixel region is the partial pixel scope of these reference point image respective pixel lattice.
12. interactive control device as claimed in claim 8, wherein, this monochrome information is the brightness value of a pixel in this pixel region or the average brightness of a plurality of pixels.
13. interactive control device as claimed in claim 8, wherein, this interactive control device is identified and still is in this idle state, and then this control circuit reduces the sampling frequency of this image sensor or notifies this main frame to reduce the glow frequency of this light source.
14. the How It Works of an interdynamic image system is characterized in that, comprises:
Acquisition one first image under idle state;
At least one pixel region is chosen in position according at least one reference point image in this first image;
Scan this pixel region to obtain one second image; And
Relatively whether the monochrome information of interior at least one pixel of this pixel region in a threshold values and this second image still is in this idle state to confirm this interdynamic image system.
15. the How It Works of interdynamic image system as claimed in claim 14, wherein, this pixel region is the same pixel scope of these reference point image respective pixel lattice.
16. the How It Works of interdynamic image system as claimed in claim 14, wherein, this pixel region is the expansion pixel coverage that comprises these reference point image respective pixel lattice.
17. the How It Works of interdynamic image system as claimed in claim 14, wherein, this pixel region is the partial pixel scope of these reference point image respective pixel lattice.
18. the How It Works of interdynamic image system as claimed in claim 14, wherein, this monochrome information is the brightness value of a pixel in this pixel region or the average brightness of a plurality of pixels.
19. the How It Works of interdynamic image system as claimed in claim 14, wherein, this interdynamic image system is identified and still is in this idle state, then reduces the sampling frequency of image in this interdynamic image system or reduces the glow frequency of light source in this interdynamic image system.
20. the How It Works of interdynamic image system as claimed in claim 14, wherein, this interdynamic image system is identified and is not in this idle state, then enters this mode of operation.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201110193959.8A CN102866772B (en) | 2011-07-07 | 2011-07-07 | Interdynamic image system, interactive control device and How It Works thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201110193959.8A CN102866772B (en) | 2011-07-07 | 2011-07-07 | Interdynamic image system, interactive control device and How It Works thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
CN102866772A true CN102866772A (en) | 2013-01-09 |
CN102866772B CN102866772B (en) | 2016-02-17 |
Family
ID=47445678
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201110193959.8A Active CN102866772B (en) | 2011-07-07 | 2011-07-07 | Interdynamic image system, interactive control device and How It Works thereof |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN102866772B (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI281623B (en) * | 2005-05-10 | 2007-05-21 | Pixart Imaging Inc | Orientation point orientating method of orientation device and device thereof |
CN101128794A (en) * | 2005-01-12 | 2008-02-20 | 辛克光学公司 | Handheld vision based absolute pointing system |
US20100277411A1 (en) * | 2009-05-01 | 2010-11-04 | Microsoft Corporation | User tracking feedback |
CN102043459A (en) * | 2009-10-21 | 2011-05-04 | 宏碁股份有限公司 | Energy-saving mode detection method, detection device and detection system for display |
-
2011
- 2011-07-07 CN CN201110193959.8A patent/CN102866772B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101128794A (en) * | 2005-01-12 | 2008-02-20 | 辛克光学公司 | Handheld vision based absolute pointing system |
TWI281623B (en) * | 2005-05-10 | 2007-05-21 | Pixart Imaging Inc | Orientation point orientating method of orientation device and device thereof |
US20100277411A1 (en) * | 2009-05-01 | 2010-11-04 | Microsoft Corporation | User tracking feedback |
CN102043459A (en) * | 2009-10-21 | 2011-05-04 | 宏碁股份有限公司 | Energy-saving mode detection method, detection device and detection system for display |
Also Published As
Publication number | Publication date |
---|---|
CN102866772B (en) | 2016-02-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10290281B2 (en) | Display device and control method | |
JP4990211B2 (en) | System and method for labeling feature clusters in a frame of image data for optical navigation | |
JP5049228B2 (en) | Dialogue image system, dialogue apparatus and operation control method thereof | |
US9304574B2 (en) | Remote device and power saving method of interactive system | |
CN113766129B (en) | Video recording method, video recording device, electronic equipment and medium | |
CN101561720B (en) | Displacement detection device and power-saving method thereof | |
US9058064B2 (en) | Interactive image system, interactive control device and operation method thereof | |
JP4648958B2 (en) | System and method for optical navigation for identifying and labeling cluster pixels in image frame data | |
CN112333382B (en) | Shooting method and device and electronic equipment | |
US20130229514A1 (en) | Displacement detection device and operating method thereof | |
CN107710736A (en) | Aid in the method and system of user's capture images or video | |
US20040001074A1 (en) | Image display apparatus and method, transmitting apparatus and method, image display system, recording medium, and program | |
CN112291480B (en) | Tracking focusing method, tracking focusing device, electronic device and readable storage medium | |
CN104113737A (en) | System for preventing monitoring video from being replaced and method thereof | |
CN102866772B (en) | Interdynamic image system, interactive control device and How It Works thereof | |
CN103566587B (en) | The electricity saving method of remote control unit and interactive system | |
CN113473008A (en) | Shooting method and device | |
CN103853350B (en) | Cursor control system and method | |
EP3579547B1 (en) | Information processing device and information processing method | |
CN113038094B (en) | Image acquisition method and device | |
CN113706553B (en) | Image processing method and device and electronic equipment | |
CN116433767B (en) | Target object detection method, target object detection device, electronic equipment and storage medium | |
CN112399076B (en) | Video shooting method and device | |
Chen et al. | Automatic Generation of Personalized Golf Video Using Integrated Technologies and Methods | |
CN102968896B (en) | Optical remote-control system and light source control method used for optical remote-control system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant |