CN1157650C - System and method for inputting coordinate and control information to computer - Google Patents
System and method for inputting coordinate and control information to computer Download PDFInfo
- Publication number
- CN1157650C CN1157650C CNB011080477A CN01108047A CN1157650C CN 1157650 C CN1157650 C CN 1157650C CN B011080477 A CNB011080477 A CN B011080477A CN 01108047 A CN01108047 A CN 01108047A CN 1157650 C CN1157650 C CN 1157650C
- Authority
- CN
- China
- Prior art keywords
- coordinate
- signal
- image
- camera
- computing machine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Position Input By Displaying (AREA)
Abstract
The present invention relates to a system and a method which are used for computer coordinate and control information input, which belongs to a computer application technology. The system comprises a signal collection processor, a light emitting pen and a computer program, wherein the signal collection processor is composed of a photo shooting device (1), a signal processing circuit (2), an interface (3), direction indicator, etc. The method of the present invention comprises: (1). the position of a target point is marked by a light spot generated by the light emitting pen, the photo shooting device is introduced to collect an image at real time, an image signal is analyzed at real time by using the signal processing circuit to extract the position information of the light spot, and the position information of the light spot is input into a computer through an interface circuit; (2). a coordinate correcting and computing process is introduced, and coordinates in an imaging coordinate system are converted into corresponding coordinates in a computer display coordinate system.
Description
Technical field
The present invention relates to a kind of system, and carry out coordinate rectification and control information generation and import needed method to computing machine input coordinate information and control information.Belong to the Computer Applied Technology field.
Background technology
Using to people of the projection display brings great convenience, and be irreplaceable in many application.But in use have following problem: 1. the control operation of pair computing machine is undertaken by keyboard and Genius mouse before must getting back to computing machine.2. must use other blank or blackboard when needing writing words or picture, therefore need folding and unfolding screen constantly.These problems have been brought inconvenience to the user, have influenced work efficiency, and the equipment complexity takes up room greatly simultaneously.So need a kind of can directly on display screen, writing and draw, the equipment and the method that can send control information at a distance simultaneously.
In addition, in application such as multimedia teaching, need to write in time to write down and send to far, also need the handwriting information collection with picture information.
Prior art is to adopt hand-held wired or wireless handwriting pad to write and transmitting control commands.Its shortcoming is the inconsistent problem of trick, and intuitive is poor when causing using, and efficient is low.Or adopting the technology of similar touch-screen, its shortcoming is that screen size is restricted, and is not portable.
Summary of the invention
The purpose of this invention is to provide and a kind ofly can gather coordinate information on the display screen in real time, can on screen, directly carry out emulation by a kind of lip pencil device and write, and can utilize such pen to carry out control signal generation and input system for computer and method.The present invention is suitable for for other computer utility occasions that need intuitive operation control too except being applied to the use occasion of the projection display.
The system and method that is used for computing machine coordinate and control information input of the present invention, its system is made up of signal acquisition process device and light pen.The signal acquisition process device is formed by camera head, signal processing circuit and in the required interface circuit of compunication again.Utilize native system to adopt following method: (1). indicate the position of impact point with the luminous point of light pen generation, introduce camera head simultaneously and carry out real time image collection, handle the positional information that picture signal is extracted luminous point with the signal processing circuit real-time analysis, and, go out the coordinate of luminous point in the camera head imaging coordinate system according to these information analyses by interface circuit input computing machine; (2). introducing coordinate rectification computation process is corresponding coordinate in the computer display co-ordinate system with the coordinate conversion in the imaging coordinate system, for the calculating that realizes that above-mentioned coordinate transform is required, in the system initialization process, introduce a step of gathering one group of reference point sample coordinate; (3). with the generation of light pen luminous point with disappear as control signal so that computing machine is operated.
Light pen is the lip pencil device with luminescent device, can utilize its nib luminous, also can utilize its emitted light beams irradiating object to produce luminous point.Because therefore the brightness of luminous point that light pen produces can analyze the light pen light spot position with image analysis method far above displayed image brightness.If the light source of light pen adopts the light source with obvious spectrum peak dot, for example semiconductor diode or laser instrument, in the imaging optical path of camera head, introduce the optical filter of corresponding light spectral property simultaneously, then can improve the relative brightness of light pen luminous point greatly, thereby can adopt simple hardware circuit to realize the extraction of luminous point coordinate information.If particularly adopt the light source of semiconductor laser, adopt then better effects if of bandpass filter in the imaging optical path as light pen.In the case, can adopt the simple numerical logic,, isolate the pixel at bright spot place as brightness and a threshold value are compared.Further can utilize hardware or software to obtain its centre coordinate.
The position coordinates that draws by said method is the coordinate in the camera head imaging coordinate system, and it is subjected to the influence of camera direction, position, resolution and image dsitortion situation.Corresponding to same physical location, the coordinate figure in the displaing coordinate system is different.In order being the coordinate of same physical location in displaing coordinate system with the luminous point coordinate conversion in the imaging coordinate system, need to carry out certain coordinate transform and calculate.Corresponding to arbitrary physical location on the screen, the coordinate of note in the imaging coordinate system be (u, v), the coordinate of displaing coordinate in being be (x y), promptly needs transforming function transformation function Fx, Fy, make x=Fx (u, v), y=Fy (u, v).
Because the right one-to-one relationship of effective range internal coordinate in the continuity of real system and two coordinate systems, this conversion can utilize common mathematical method to realize.In order to adapt to the numerical evaluation ability of computing machine, can adopt numerical algorithm to carry out conversion process.In order to realize this coordinate transform calculating, need the corresponding relation sample of the coordinate figure in one group of two coordinate system, organize sample in the hope of the required parameter of transformation calculations according to this.
The method of collection reference point sample coordinate figure of the present invention is: select the reference point array of the one group of capable N of taking advantage of row of M in displaing coordinate system, they evenly distribute in displaing coordinate system.Gather the coordinate figure of this group point in the camera head imaging coordinate system then, obtain such one group of corresponding relation: (Xm, Yn)＜-(Um, Vn), wherein ((Um Vn) is coordinate in the imaging coordinate system for Xm, the Yn) coordinate of fastening for displaing coordinate.M is 1,2 ..., M, n are 1,2 ..., N.M, the size of N is decided with the linearity of imaging.When linear degree is high, can get less value, as 2; When distortion is big, should get bigger value, as greater than 4.According to this group relation, utilize mathematical method, can obtain of the conversion of the imager coordinate of arbitrfary point on the screen to displaing coordinate.M among the present invention, the scope of N is between 2 to 100.
The specific implementation of gathering reference point sample coordinate figure has automatically and manual two kinds.Manual mode is: on screen, show a reference point (Xm, position Yn) wait for that then the luminous point that light pen produces occurs thereon, note luminous point the coordinate figure of imaging coordinate system (Um, Vn).So finish all coordinates of reference points samplings.Automated manner is: by the image that demonstration has above-mentioned reference point locations feature on the display that is controlled at of software, gather and the image of records photographing, image is analyzed coordinate figure with the imaging coordinate system that draws each reference point correspondence.In order to improve visual signal to noise ratio (S/N ratio), can repeatedly make the image brightness counter-rotating, the synchronous acquisition recording picture carries out the picture information that relevant treatment must make new advances.For example for the first time making the position corresponding to reference point is bright spot, and all the other positions are for deceiving each pixel brightness of the image that record acquisition arrives.With the image brightness counter-rotating, each pixel brightness value of image and primary subtracting each other with gathering for the second time then can strengthen the contrast of bright spot, and can eliminate surround lighting stably for the second time.
Owing to adopted above-mentioned coordinate transform calculation procedure, can realize computer cursor real-time follow-up light pen place physical location, realize that the emulation on the screen is write, promptly the actual physics track of crossing at light pen shows the track image in real time.So just solved the inconsistent problem of said trick.
In order directly and intuitively to send operating control signal such as mouse buttons signal etc. before screen, the different led pulse sequences that the present invention adopts light pen to send realize sending control information.Keyswitch can be set on light pen, control circuit is arranged in the light pen, make when different key is pressed, light pen produces different pulse train.As long as pulse width is compared with the shooting sampling period enough greatly with gap and variation thereof, then system can identify different signals.
On light pen, can also introduce a roller, in order to produce the signal of analog mouse device roller action.Promptly when roller rotated in different directions, light pen produced different switching-burstings.The introducing of roller can increase the dirigibility of operation.
Further improvement for light pen is: emulation is for convenience write, and introduces a sensor, for example pressure transducer, displacement transducer or vibration transducer in the light pen.It links to each other with nib, and purpose is whether the induction nib contacts writing plane.Its installation makes it to respond to pressure or the vibration that nib is subjected to.A kind of possible connected mode is: control circuit links to each other with the output of sensor.Control circuit is according to the switch motion of signal of sensor control illuminator.When contact screen, will be luminous automatically.Thereby emulation is write more natural.This improvement function can individualism, also can be present in simultaneously with other function in the pen.
The above coordinate collection and transform method also can be applied to existing electric whiteboard system.Different is that the written handwriting that does not pass through display shows, and above-mentioned displaing coordinate system is corresponding to a rectangular coordinate system of setting on the blank.Can gather the sample coordinate and carry out coordinate transform with similar manual methods.
Description of drawings
Accompanying drawing 1: native system signal acquisition process device is formed synoptic diagram.
Accompanying drawing 2: the composition synoptic diagram of signal processing circuit.
Accompanying drawing 3: the system schematic of a plurality of camera heads.
Embodiment
The composition synoptic diagram of the signal acquisition process device shown in the accompanying drawing 1 is the basic coordinate and the signal acquisition process device of control information input system.Its composition is: camera head 1 is connected in signal processing circuit 2, is connected in computing machine by interface 3 again.Trafficator 4 also links to each other with interface 3.As an embodiment, interface 3 can be a spp, and camera head 1 can be the black and white camera of being exported by the analog video that CCD or cmos image sensor constitute.The outputting video signal of this camera is handled the back by signal processing circuit and is produced light spot position information, and the eight bit data port lines by parallel interface 3 is transferred to computing machine.Trafficator 4 is red semiconductor laser diodes, and its beam direction is identical with the direction of camera, and its switch is controlled by a control line of interface 3.
Computing machine and signal acquisition process device communication function, determine reference point and sample coordinate gatherer process, coordinate transformation process, control signal analysis and computer system such as operated at functional utilization software to cooperate realization.
Shown in the accompanying drawing 2 be the signal processing circuit 2 in the accompanying drawing 1 composition and with the annexation of camera head 1, interface 3.It in the frame of broken lines composition of signal processing circuit.It is by A/D change-over circuit 12, and video synchronization signal produces circuit 11, DLC (digital logic circuit) 13, and crystal oscillator 14, read-write memory 15 is formed.The A/D change-over circuit is based on monolithic A/D converter ic.DLC (digital logic circuit) is made of as Lattice ispLSI 1032E CPLD.
Its principle of work is: A/D change-over circuit 12 will be converted to digital signal by the image brightness signal of camera 1 output, transfer to DLC (digital logic circuit) 13, and its clock signal is from crystal oscillator 14.Circuit for generating synchronous signals 11 extracts video synchronization signal from composite video signal, also export 13 to.Realized the major function of light spot position information extraction in the native system in the DLC (digital logic circuit) 13.Its main logic comprises: threshold ratio, row counting, column count and with communicating by letter of interface etc.Promptly in every picture field, count line number, in every row,, in every, the row signal is counted according to doing column count by 14 clock signals that produce according to line synchronizing signal.When each brightness data produces, itself and a fixed threshold are compared, when greater than this threshold value, the row, column count value that is about to this moment is temporary in the storer 15.The parallel port that computing machine is set works in the EPP pattern, and data are sent to computing machine at the video field blanking interval by interface 3.
Present embodiment mainly is applicable to the occasion of projector as graphoscope, also is suitable for other occasions that need visual control and screen to write.With the projector applications occasion is example, and the signal acquisition process device shown in the accompanying drawing 1 is positioned near the projector, and camera is towards screen.Its output signal is sent to computing machine by interface.Light pen is not luminous under normal conditions.Will be luminous when button is pressed.When pressing, different key will send multi-form light signal.In the time of when pulse width and at interval suitably, computer software can be distinguished out different signals, with the method can the analog mouse device press key message.
In order to carry out the conversion of imager coordinate to displaing coordinate, the software of present embodiment possesses sample coordinate capture program, its flow process is: pointwise shows one group of capable N row point of equally distributed M on screen, wait for that the user lights light pen, the coordinate figure under the computer recording under the imaging coordinate system of correspondence on each point.The imaging coordinate system coordinate of trying to achieve on the screen arbitrarily any with numerical method is the conversion of coordinate to displaing coordinate, thereby reaches the purpose of light pen indicating positions and displaing coordinate position consistency.Software reaches the purpose that emulation is write showing person's handwriting in real time on the actual path of light pen process under the different states.Or carry out moving cursor, discern the pulsed illumination signal of light pen, and then carry out mutual work with operating system.
In order to reach the purpose that improves Optical Signal To Noise Ratio, in camera 1, introduced bandpass filter.Optical filter can be special-purpose interference fringe pass filter, also can be by carrying out optical coating and adopt coloured optical glass to form on lens.The luminous peak wavelength of the logical window wavelength of the band of optical filter and light pen is identical.This measure is especially effective when adopting laser instrument.
In the right direction in order to guarantee camera in use, introduced trafficator 4.Because its laser beam is identical with the direction of camera, so can whether correct according to the sensing of the discriminating direction camera of light beam, if promptly direction indication laser 4 shines screen center, then camera is in the right direction.The switch of trafficator 4 can be controlled by a switch that is located on the shell, also can be by interface by computer control.Control by interface in the present embodiment.
If introduce two or more direction indication lasers, positioning shooting head better then.Utilize two or more direction indication lasers accurately position and the direction of correction signal Acquisition Processor.Method is to show fixing position feature on display screen, and this group laser beam is radiated on the ad-hoc location separately.In this case, may use the sample coordinate figure or the fixing algorithm parameter of use that prestore to carry out coordinate transform.
The present invention also has following two embodiment:
Embodiment one: on the basis of above-mentioned basic embodiment, in order to adapt to the application of large display screen curtain, present embodiment is done following improvement: signal processing circuit has coordinate analysis pattern and two kinds of mode of operations of image acquisition pattern.Transmit control command by computer interface and give signal processing circuit, it is switched between two kinds of patterns.Under the coordinate analysis pattern, its function is with aforementioned the same.Under the image acquisition pattern, signal processing circuit transfers to computing machine with the original figure picture intelligence.In the present embodiment, adopt aforementioned automated manner to carry out the collection of reference point sample coordinate, promptly on computer display, show image earlier with reference point locations feature, gather image then and be transferred to computing machine, carry out graphical analysis with software and obtain the coordinate figure of reference point in imaging coordinate system.
For signal to noise ratio (S/N ratio) is provided, can make image brightness counter-rotating repeatedly, synchronously the recording picture line correlation of going forward side by side is handled.
Embodiment two: the embodiment of the system of a plurality of camera heads shown in the accompanying drawing 3.Wherein 17 is signal processing circuits, the 16th, and camera.Different with above embodiment is that it comprises two cameras of photographed screen image from different directions.They are installed in the position near screen plane.According to geometrical principle, when two cameras fixedly the time, the lateral angles of any point in two camera viewfinder ranges promptly prolonged the angle of launching on the screen orientation on the screen, unique its position that determined.Signal processing circuit is used for extracting the visual angle information of luminous point camera from picture signal, thereby system can further calculate coordinate information.In this system, picture pick-up device can adopt one-dimensional image device such as linear array CCD or cmos imaging device.Two above cameras also can be set according to actual needs, its signal is carried out Combined Treatment.The advantage of present embodiment is: 1. since camera near screen, be not vulnerable to block.2. the linear array image sensor has higher sweep speed, thereby system responses is faster.
Claims (2)
1, a kind of system that is used for computing machine coordinate and control information input, comprise signal acquisition process device and light pen, it is characterized in that: the composition of described signal acquisition process device is that camera head (1) is connected in signal processing circuit (2), be connected in interface (3) again, interface (3) can communicate with computing machine; The optical filter that is used to improve Optical Signal To Noise Ratio is housed in the imaging optical path of described camera head, and the luminous peak wavelength of the logical window wavelength of the band of described optical filter and light pen is identical; Be connected with a trafficator (4) on the camera of described camera head, the beam direction of described trafficator (4) is identical with the direction of camera; Described signal processing circuit is made up of following assembly: will be converted to digital signal by the image brightness signal of camera (1) output, and transfer to the A/D change-over circuit (12) of DLC (digital logic circuit) (13); Extract video synchronization signal from composite video signal, the video synchronization signal that exports DLC (digital logic circuit) (13) to produces circuit (11); Extract light spot position information, carry out threshold ratio, row counting, column count and with the DLC (digital logic circuit) (13) of interface communication; The crystal oscillator of clock signal (14); Storage is greater than the read-write memory (15) of threshold value row, column counting.
2, a kind ofly be used for the method that computing machine coordinate and control information input system adopted and be:
1). utilize the position of the luminous point indicating target point of light pen generation, introduce camera head simultaneously and carry out real time image collection, carrying out the image analysis processing with circuit obtains the positional information of luminous point and by interface input computing machine, goes out the coordinate of luminous point in the video camera imaging coordinate system according to these information calculations;
It is characterized in that also adopting:
2). introducing coordinate transform computation process is corresponding coordinate in the computer display co-ordinate system with the coordinate conversion in the imaging coordinate system, in order to realize above-mentioned transformation calculations, introduce a step of gathering reference point sample coordinate in the system initialization process, this step is:
(1). an above position indicating characteristic point in displaing coordinate system, utilize luminous point to occur in its position and write down the collection that its coordinate figure in imaging coordinate system is realized the sample coordinate;
(2). on computer display, show image earlier with reference point locations feature, gather image then and be transferred to computing machine, again brightness and predetermined threshold are compared, isolate the pixel at bright spot place, obtain the coordinate figure of reference point in imaging coordinate system;
(3). make image brightness counter-rotating repeatedly, recording picture synchronously, and, finish the conversion of imager coordinate to displaing coordinate by transforming function transformation function.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB011080477A CN1157650C (en) | 2001-01-16 | 2001-01-16 | System and method for inputting coordinate and control information to computer |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB011080477A CN1157650C (en) | 2001-01-16 | 2001-01-16 | System and method for inputting coordinate and control information to computer |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1305143A CN1305143A (en) | 2001-07-25 |
| CN1157650C true CN1157650C (en) | 2004-07-14 |
Family
ID=4656936
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB011080477A Expired - Fee Related CN1157650C (en) | 2001-01-16 | 2001-01-16 | System and method for inputting coordinate and control information to computer |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1157650C (en) |
Families Citing this family (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1331030C (en) * | 2001-12-21 | 2007-08-08 | 英国电讯有限公司 | Device and method for calculating a location on a display |
| US7116840B2 (en) * | 2002-10-31 | 2006-10-03 | Microsoft Corporation | Decoding and error correction in 2-D arrays |
| JP4218952B2 (en) * | 2003-09-30 | 2009-02-04 | キヤノン株式会社 | Data conversion method and apparatus |
| JP4019114B1 (en) * | 2006-09-04 | 2007-12-12 | 株式会社Ｉ・Ｐソリューションズ | Information output device |
| CN101162406B (en) * | 2006-10-09 | 2010-05-12 | 李嘉晃 | Virtual input mechanism and input method thereof |
| CN101957665B (en) * | 2009-07-15 | 2014-02-19 | 鸿富锦精密工业（深圳）有限公司 | Drawing board system |
| CN101753994B (en) * | 2009-12-31 | 2015-06-03 | 马宇尘 | Scene recording and disseminating method and system |
| CN102346572B (en) * | 2010-08-04 | 2014-01-15 | 宝硕财务科技股份有限公司 | Remote synchronization display system and method for light spot |
| CN102135842B (en) | 2011-04-06 | 2013-02-27 | 南京方瑞科技有限公司 | Synchronous light pen electronic whiteboard system |
| CN102221933B (en) * | 2011-07-03 | 2013-04-17 | 吉林大学 | Method for accurately calculating screen coordinates of touch points in distortion projection plane of electronic white board |
| CN102915234A (en) * | 2011-08-04 | 2013-02-06 | 中国移动通信集团公司 | Method and device for realizing program interface in application program |
| CN102663906A (en) * | 2012-05-05 | 2012-09-12 | 山东长征教育科技有限公司 | Omnibearing interactive wireless teaching system |
| CN102724464B (en) * | 2012-05-23 | 2014-12-17 | 海信集团有限公司 | Projection display device, projection display system and projection display control method |
| CN102842144B (en) * | 2012-08-13 | 2016-06-22 | 胡宵 | The acquisition device of a kind of smooth painting and calligraphy track data and method |
| CN104349114A (en) * | 2013-08-01 | 2015-02-11 | 波利康公司 | Content sharing method, device and system |
| CN104978077B (en) * | 2014-04-08 | 2020-01-31 | 联想(北京)有限公司 | interaction method and system |
| CN105758385A (en) * | 2016-03-19 | 2016-07-13 | 广州能欣计算机技术有限公司 | Rapid multi-laser-point positioning method and system based on vision |
| CN106527762A (en) * | 2016-11-10 | 2017-03-22 | 深圳市鹰眼在线电子科技有限公司 | Cursor coordinate determining method, cursor coordinate determining device and mouse control system |
| CN110895665B (en) | 2018-09-12 | 2023-03-31 | 上海耕岩智能科技有限公司 | Coordinate transformation method for under-screen imaging, storage medium and electronic equipment |
| CN109814740B (en) * | 2019-02-22 | 2022-04-15 | 曲阜学能通教育科技有限公司 | Interactive intelligent painting and calligraphy equipment and interactive method |
| CN111240527A (en) * | 2020-03-26 | 2020-06-05 | 小蒙(北京)智能科技有限公司 | Coordinate acquisition method, data processing method, device and system based on light touch |
-
2001
- 2001-01-16 CN CNB011080477A patent/CN1157650C/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN1305143A (en) | 2001-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1157650C (en) | System and method for inputting coordinate and control information to computer | |
| CN102622108B (en) | A kind of interactive projection system and its implementation | |
| CN103092432B (en) | The trigger control method of man-machine interactive operation instruction and system and laser beam emitting device | |
| US8485668B2 (en) | 3D interaction for mobile device | |
| US7257255B2 (en) | Capturing hand motion | |
| US6100538A (en) | Optical digitizer and display means for providing display of indicated position | |
| CN100555179C (en) | A kind of based on cmos digital imageing sensor locating device and localization method | |
| TWI450159B (en) | Optical touch device, passive touch system and its input detection method | |
| US20060007134A1 (en) | Pointing input system and method using one or more array sensors | |
| RU2456659C2 (en) | Image capturing device, image display and capturing device and electronic device | |
| US20060012579A1 (en) | Coordinate input apparatus and its control method | |
| CN102945091B (en) | A kind of man-machine interaction method based on laser projection location and system | |
| KR19980033069A (en) | Information input device, information input method and solid state imaging device | |
| CN110297556B (en) | Electronic projection drawing board system based on image recognition technology and processing method thereof | |
| CN102662498A (en) | Wireless control method and system for projection demonstration | |
| CN101882012A (en) | Pen type interactive system based on projection tracking | |
| CN101324824A (en) | System and method for positioning split joint wall based on image inductor | |
| TW201423612A (en) | Device and method for recognizing a gesture | |
| CN106598356B (en) | Method, device and system for detecting positioning point of input signal of infrared emission source | |
| CN103150059B (en) | Electronic system and track detection method | |
| CN1746831A (en) | Interactive projection system | |
| CN201413506Y (en) | Image trapping positioning device | |
| CN103327385B (en) | Based on single image sensor apart from recognition methods and device | |
| CN202584030U (en) | Interactive projection system and shooting game equipment | |
| US9489077B2 (en) | Optical touch panel system, optical sensing module, and operation method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C06 | Publication | ||
| PB01 | Publication | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C19 | Lapse of patent right due to non-payment of the annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |