CN117130495A - Suspension processing method of optical electronic pen based on gyroscope sensor - Google Patents
Suspension processing method of optical electronic pen based on gyroscope sensor Download PDFInfo
- Publication number
- CN117130495A CN117130495A CN202310126354.XA CN202310126354A CN117130495A CN 117130495 A CN117130495 A CN 117130495A CN 202310126354 A CN202310126354 A CN 202310126354A CN 117130495 A CN117130495 A CN 117130495A
- Authority
- CN
- China
- Prior art keywords
- electronic pen
- movement
- unit
- trajectory
- display panel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003287 optical effect Effects 0.000 title claims abstract description 60
- 239000000725 suspension Substances 0.000 title claims abstract description 30
- 238000003672 processing method Methods 0.000 title claims abstract description 11
- 238000000034 method Methods 0.000 claims abstract description 7
- 238000007667 floating Methods 0.000 claims abstract description 6
- 238000004364 calculation method Methods 0.000 claims description 30
- 230000001133 acceleration Effects 0.000 claims description 28
- 238000005339 levitation Methods 0.000 claims description 25
- 238000013507 mapping Methods 0.000 claims description 16
- 230000004044 response Effects 0.000 claims description 9
- 238000003860 storage Methods 0.000 claims description 2
- 238000004378 air conditioning Methods 0.000 claims 1
- 238000004590 computer program Methods 0.000 claims 1
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 16
- 238000004891 communication Methods 0.000 description 13
- 239000000470 constituent Substances 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000000926 separation method Methods 0.000 description 3
- 230000001678 irradiating effect Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000005096 rolling process Methods 0.000 description 2
- 238000000149 argon plasma sintering Methods 0.000 description 1
- 239000007795 chemical reaction product Substances 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000002990 reinforced plastic Substances 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
Abstract
A suspension processing method of an optical electronic pen based on a gyroscope sensor. The present invention relates to a technique for achieving suspension in an optical electronic pen in general. In particular, the invention relates to a suspension processing technology of an optical electronic pen based on a gyroscope sensor, which comprises the following steps: the suspension function of manipulating the pen head in a spaced manner on the surface of the display panel is precisely implemented in the optical electronic pen using the gyro sensor. According to the invention, the suspension function can be accurately realized in the optical electronic pen. According to the present invention, the floating function is accurately realized, and the optical electronic pen can be favorably used together with the display panel of an electronic device such as a tablet PC or a laptop.
Description
Technical Field
The present invention relates to a technique for achieving suspension in an optical electronic pen in general.
In particular, the invention relates to a suspension processing technology of an optical electronic pen based on a gyroscope sensor, which comprises the following steps: the suspension function of manipulating a pen tip (pen tip) on the surface of a display panel in a spaced manner is precisely implemented in an optical electronic pen using a gyro sensor.
Background
In general, an electronic pen (smart pen, touch pen) is used for the purpose of displaying the contents of a user's notes to an electronic device (e.g., laptop, smart phone, electronic blackboard, etc.) and storing them as a file, and when the user writes on a special paper printed with a dot pattern (dot pattern), the electronic pen reads its track information and wirelessly transmits it to the electronic device.
In addition, electronic pen functions are applied to high-end products such as tablet PCs and laptop computers, and note application programs (APP) such as Notability, goodNotes are also developed, whereby the demand for electronic pens for electronic devices is also increasing.
As electronic pen solutions, EMR (electromagnetic resonance ) type stylus (stylus pen) technology and electrostatic type active pen (active pen) technology are generally used. However, in the case of a display of 10 inches or more, it is technically difficult to secure performance, and since it is necessary to provide a two-dimensional sensor array, manufacturing cost increases significantly with an increase in the size of the display, and there is a problem that it is difficult to cope with changes in form factors such as folding, rolling, sliding, and the like.
Under such a background, an optical electronic pen (optical digital pen) has been developed as a pen solution for electronic devices. In the optical system, the position code may be formed on the display by attaching the transparent film having the dot pattern to the display, so that even if the size of the display increases, the deterioration of the pen characteristics and the increase in the manufacturing cost hardly occur, and the change in the form factor such as folding, rolling, and sliding can be dealt with.
Fig. 1 is a diagram conceptually showing a device configuration of the optical electronic pen 10, and fig. 2 is a block diagram showing an assisting operation between the optical electronic pen 10 and the smart terminal device 30.
When writing is performed on the display panel 200 in a state where the pen body 11 is held (grip), an action trace is formed in a state where the pen tip 12 abuts against the surface of the display panel 200. In this case, the display panel 200 may be made of various materials, such as a general paper material, or a Liquid Crystal (LCD) or an Organic Light Emitting Diode (OLED) element made of glass or reinforced plastic.
The electronic-pen control section 14 can recognize a contact event between the electronic-pen tip 12 and the display panel 200 through pressure sensing of the pressure sensing unit 13, thereby recognizing the fact that the user is writing. The pressure sensing unit 13 is supported rearward by the pressure sensor support unit 13a, and thus can sense the pressure applied to the nib 12 at the start of writing. When recognizing writing, the electronic-pen control section 14 controls the IR light emitting unit 17 to irradiate light (e.g., infrared (IR) light) to the outer surface of the display panel 200 with the movement of the pen head 12.
The light irradiated by the IR light emitting unit 17 is reflected at the surface of the display panel 200, and the IR light receiving unit 16 receives the reflected light thereof. A position code 210 is printed or displayed on the display panel 200. The position code 210 may be embodied as a dot pattern constructed according to a particular encoding rule. A transparent film to which a transparent dot pattern absorbing an infrared light source is applied is attached to the display panel 200, and the IR light emitting unit 17 irradiates infrared rays thereon.
When the IR light receiving unit 16 collects the reflected light (IR reflected light), the position code 210 information corresponding to the movement locus of the pen head 12 is obtained together. The IR receiving unit 16 is composed of an IR filter portion 16a, a CMOS optical portion 16b, and an IR sensor portion 16c, and may further include a lens or the like.
The coordinate calculating section 14a of the electronic pen control unit 14 analyzes the position code 210 obtained by the IR light receiving unit 16 to obtain a series of coordinate information of the movement of the pen head 12 on the display panel 200. The coordinate information obtained by the coordinate calculation unit 14a is transmitted to the terminal communication unit 31 of the intelligent terminal device 30 by short-range wireless communication (for example, bluetooth) through the wireless communication unit 18.
The hardware control unit 14b of the electronic pen control unit 14 controls the hardware of the optical electronic pen 10 as a whole. In particular, the IR light emitting unit 17 is controlled to be turned on (turn-on) or off (turn-off) according to the pressure information transmitted from the pressure sensing unit 13. When the pressure is detected, the IR light emitting unit 17 is turned on, thereby starting to irradiate light onto the display panel 200, in response to which the IR light receiving unit 16 starts to obtain the position code 210, the coordinate information is obtained by the coordinate calculating section 14a, and the electronic pen control section 14 starts to supply a series of coordinate information based on the pen point movement to the smart terminal apparatus 30. When the pressure is not detected, the IR light emitting unit 17 is turned off to interrupt the irradiation of light, whereby the electronic pen control section 14 also stops the supply of the coordinate information to the smart terminal apparatus 30.
On the intelligent terminal device 30 side, the terminal communication unit 31 receives a series of coordinate information from the electronic pen 10, and the trajectory calculation unit 32a of the terminal control unit 32 calculates the movement trajectory of the pen tip 12 based on the series of coordinate information. The trajectory display unit 32b of the terminal control unit 32 displays the movement trajectory of the pen head 12 on the terminal panel unit 33. At this time, the terminal panel part 33 generally corresponds to the display panel 200, but is not limited thereto.
Disclosure of Invention
Problems to be solved by the invention
The present invention aims to provide a technique for achieving suspension in an optical electronic pen in general.
In particular, the present invention aims to provide a suspension processing technique for an optical electronic pen based on a gyro sensor, as follows: the suspension function of manipulating the pen head in a spaced manner on the surface of the display panel is precisely implemented in the optical electronic pen using the gyro sensor.
Means for solving the problems
In order to achieve the above object, the present invention provides a suspension processing method of an optical electronic pen based on a gyro sensor, the method comprising the steps of: the electronic pen control part 170 performs on or off control of the IR light emitting part 140 according to whether the electronic pen 100 is in contact with the display panel 200; the IR light emitting part 140 irradiates light to the display panel 200 formed with the position code 210 in response to the on control; the IR light receiving component 160 receives the reflected light reflected by the display panel 200 to sense the position code 210 of the position of the electronic pen head 120; the coordinate calculation unit 171 analyzes the position code 210 obtained by the IR light receiving member 160 to obtain a series of coordinate information of the movement of the electronic pen head 120; when the coordinate information of the position of the electronic pen head 120 on the display panel 200 is provided from the above-described coordinate calculating section 171 based on the position code 210, the trajectory calculating section 321 enters the electronic pen normal mode; the trajectory calculation unit 321 calculates a movement trajectory (hereinafter, referred to as a "first movement trajectory") of the electronic pen head 120 on the display panel 200 based on the series of coordinate information obtained by the coordinate calculation unit 171 based on the position code 210; the trajectory display unit 325 displays the first movement trajectory on the terminal panel unit 330 in the normal mode of the electronic pen; the gyro sensor 135 detects a triaxial acceleration and a rotational angular velocity related to the motion of the electronic pen 100; the movement collection unit 322 collects a series of triaxial acceleration and rotational angular velocity information detected by the gyro sensor 135; the movement mapping unit 323 compares the series of triaxial acceleration information and rotational angular velocity information collected by the movement collection unit 322 in the normal mode of the electronic pen with the first movement trajectory calculated by the trajectory calculation unit 321 based on the position code 210, thereby calculating the correlation between the triaxial acceleration information and rotational angular velocity information and the first movement trajectory; the levitation processing part 324 enters a levitation mode in response to sensing a movement in a vertical direction with respect to the display panel 200 according to the triaxial acceleration information; the levitation processor 324 calculates the three-axis acceleration and the rotational angular velocity detected by the gyro sensor 135 in the levitation mode as the correlation calculated by the movement mapping unit 323, and calculates the movement trajectory (hereinafter referred to as a "second movement trajectory") of the electronic pen head 120; the trajectory display unit 325 displays the second movement trajectory on the terminal panel unit 330 in the hover mode.
Effects of the invention
According to the invention, the suspension function can be accurately realized in the optical electronic pen.
According to the present invention, the floating function is accurately realized, and the optical electronic pen can be favorably used together with the display panel of an electronic device such as a tablet PC or a laptop.
Drawings
Fig. 1 is a diagram showing a device structure of an optical electronic pen.
Fig. 2 is a block diagram showing an assisting action between the optical electronic pen and the smart terminal device.
Fig. 3 is a diagram conceptually showing a floating operation of the optical electronic pen.
Fig. 4 is a diagram showing a device configuration of the optical electronic pen of the present invention.
Fig. 5 is a block diagram showing the overall configuration of the suspension processing system of the optical electronic pen of the present invention.
Fig. 6 is a diagram showing the concept of the normal mode of the electronic pen and the operation of the movement mapping section in the present invention.
Fig. 7 is a diagram showing the concept of the levitation pattern and the operation of the levitation processing section in the present invention.
Fig. 8 is a sequence diagram showing a suspension processing method of the optical electronic pen based on the gyro sensor of the present invention.
Detailed Description
The present invention will be described in detail with reference to the accompanying drawings.
In describing the optical electronic pen device of the present invention, a detailed description will be omitted for the parts overlapping with the conventional art.
Fig. 3 is a diagram conceptually showing a floating operation of the optical electronic pen 10.
In the field of electronic pens, hover (suspension) refers to the operation of the pen head 12 of the electronic pen 10 in a state of physically not contacting the display panel 200. As shown in fig. 3 (a), the pen tip 12 and the display panel 200 are not in contact, but can be handled in a state where they are in contact when the user operates the electronic pen 10 with the pen tip 12 slightly spaced from the display panel 200 as in fig. 3 (b) and 3 (c).
Such a levitation operation is relatively easy to implement in an electromagnetic resonance (EMR) mode or an electrostatic mode electronic pen. However, in the optical electronic pen, there are technical difficulties in realizing the hover function.
Referring to fig. 3 (a) to 3 (c), as the electronic pen 10 is further from the display panel 200, the areas (w 1 to w 3) covered by the IR light receiving means 16 gradually widen. This means that the greater the separation distance h, the less accurate the optical recognition of the position code 210. As shown in fig. 3 (a), the recognition area of the optical electronic pen 10 is generally 3.048mm x 3.048mm in a state where the pen tip 12 contacts the display panel 200. For the hover operation, when the electronic pen 10 is spaced apart from the display panel 200 by, for example, 50mm, the coverage of the IR light receiving part 16 is expanded by several hundred times, which can only cause a decrease in the recognition performance of the position code. Because of such inaccuracy in recognition of the position code, errors in the note trajectory also increase.
In addition, the method comprises the following steps. It is not realistic to keep the separation distance h between the electronic pen 10 and the display panel 200 constant in the hover operation, but it is natural that the separation distance h varies irregularly. Therefore, the accuracy of the optical recognition irregularly fluctuates in the middle of performing the hover operation, which may become a cause of increasing errors in the note trajectory.
Thus, it is difficult for the optical electronic pen 10 to realize the floating function with high quality.
Fig. 4 is a diagram showing the device configuration of the optical electronic pen 100 of the present invention, and fig. 5 is a block diagram showing the overall configuration of the levitation processing system of the optical electronic pen of the present invention.
The present invention is a gyroscopic sensor-based suspension processing system for an optical electronic pen that provides suspension operations based on a gyroscopic sensor 135 for the optical electronic pen 100.
Referring to fig. 4 and 5, the optical electronic pen 100 of the present invention includes a pen body member 110, an electronic pen tip 120, a pressure sensor member 130, a gyro sensor 135, an IR light emitting member 140, an IR light scattering member 150, an IR light receiving member 160, an electronic pen control member 170, and a wireless communication member 180.
First, the pen body part 110 forms the body of the optical electronic pen 100, preferably in the form of a long rod (bar) for a user to hold with his hand.
The electronic pen tip 120 forms a tip of the optical electronic pen 100, and is disposed at one end of the pen body member 110 intersecting the display panel 200. The electronic pen head 120 may be configured to slide on the upper surface of the display panel 200 according to a user's operation.
The pressure sensor part 130 serves as a constituent element for sensing the pressure applied to the electronic pen tip 120, thereby detecting an event in which the electronic pen tip 120 physically contacts the display panel 200. A sensor support member 131 is disposed behind the pressure sensor member 130 to support the pressure sensor member 130 in the rear direction. On the other hand, in order to stably move the electronic pen tip 120 in and out of the pen body member 110, a tension member (not shown) is provided, for example, by a spring or the like to provide restoring force to the electronic pen tip 120.
The gyro sensor 135 is a component provided inside the main body 110 of the electronic pen 100 and detects a triaxial acceleration and a rotational angular velocity (angular velocity) related to the movement of the electronic pen 100. In general, a gyro sensor (gyro sensor) is a sensor that detects angular velocity (angular velocity) of rotation of an object, and detects azimuth (point of the compass) information and gravity action direction information using the earth magnetic field.
On the other hand, the gyro sensor 135 is a structure provided for tracking the movement (dynamics) of the pen tip 120 in the present invention. In view of this, the gyro sensor 135 is preferably disposed at the inner lower portion of the electronic pen main body 110, i.e., at a position near the electronic pen tip 120 at the inner side of the electronic pen main body 110. With such a configuration, the gyro sensor 135 is relatively less affected by the movement of the head portion of the electronic pen body 110, but is relatively more affected by the movement of the electronic pen tip 120, thereby facilitating tracking of the movement of the electronic pen tip 120.
The IR light emitting member 140 is a component for irradiating (irradiating) light (for example, IR light) to the display panel 200 formed with the position code 210.
The IR light receiving means 160 receives reflected light reflected by the display panel 200 incident on the inside of its effective light receiving area (FOV) to sense the constituent elements of the position code 210 of the position where the electronic pen head 120 is located. For ease of illustration, the FOV of the IR light receiving component 160 is shown with a thick dashed line.
The electronic pen control unit 170 is a component for controlling the operation of the optical electronic pen 100 as a whole. The electronic-pen control section 170 recognizes that the electronic pen tip 120 moves on the display panel 200 based on the pressure information transmitted from the pressure sensor section 130. In response, the electronic-pen control part 170 turns on the IR light emitting part 140, and then obtains a series of coordinate information of the movement of the electronic pen head 120 on the display panel 200 from the reflected light received through the IR light receiving part 160 and transmits to the wireless communication part 180.
For this purpose, the electronic pen control unit 170 includes a coordinate calculation unit 171 and a hardware control unit 172. The coordinate calculating unit 171 is a component for analyzing the position code 210 obtained by the IR light receiving member 160 to obtain a series of coordinate information of the movement of the electronic pen head 120, and the hardware control unit 172 is a component for controlling the on or off of the IR light emitting member 140 based on the pressure information transmitted from the pressure sensor member 130. The hardware control unit 172 may be configured to turn on the IR light emitting member 140 when the pressure sensor member 130 detects pressure, and turn off the IR light emitting member 140 when the pressure sensor member 130 does not detect pressure.
The wireless communication section 180 is a constituent element for transmitting the coordinate information supplied from the electronic pen control section 170 to the external smart terminal apparatus 300 by short-range wireless communication (for example, bluetooth).
Referring to fig. 5, the intelligent terminal apparatus 300 according to the present invention includes a terminal communication unit 310, a terminal control unit 320, and a terminal panel unit 330.
The terminal communication unit 310 is a component for performing short-range wireless communication (for example, bluetooth). Specifically, the terminal communication unit 310 receives a series of coordinate information from the electronic pen control unit 170 of the optical electronic pen 100 by short-range wireless communication (for example, bluetooth).
The terminal panel 330 is a component for providing a screen display to a user. The terminal panel part 330 generally corresponds to the display panel 200, but is not limited thereto.
The terminal control unit 320 includes a trajectory calculation unit 321, a movement collection unit 322, a movement mapping unit 323, a suspension processing unit 324, and a trajectory display unit 325 as components for controlling the overall operation of the intelligent terminal device 300. In fig. 5, the trajectory calculation unit 321, the movement collection unit 322, the movement mapping unit 323, and the suspension processing unit 324 are illustrated as being provided in the terminal control unit 320 of the intelligent terminal apparatus 300, but this is only one example. According to an embodiment, all or a part of these constituent elements may be provided in the electronic pen control section 170 of the optical electronic pen 100.
First, the trajectory calculation unit 321 is a component for calculating the movement trajectory of the electronic pen head 120 on the display panel 200 based on a series of coordinate information obtained by the coordinate calculation unit 171. In this specification, for convenience of explanation, a movement trajectory calculated based on a series of coordinate information provided by the electronic pen 100 reading out the position code 210 is referred to as a 'first movement trajectory'. When the coordinate information is supplied from the electronic pen control section 170, the trajectory calculation section 321 is regarded as the electronic pen 100 touching the display panel 200 and enters the normal mode (normal mode) of the electronic pen.
The movement collection unit 322 is a component for collecting a series of triaxial acceleration and rotational angular velocity information detected by the gyro sensor 135 of the optical electronic pen 100.
The movement mapping unit 323 is a component for comparing the series of triaxial acceleration information and rotational angular velocity information collected by the movement collection unit 322 in the normal mode of the electronic pen with the first movement trajectory calculated by the trajectory calculation unit 321, and thereby calculating the correlation between the triaxial acceleration information and rotational angular velocity information and the movement trajectory of the electronic pen head 120 on the display panel 200.
Fig. 6 is a diagram showing the concept of the normal mode of the electronic pen and the operation of the movement mapping unit 323 in the present invention.
Referring to fig. 6, in the normal mode of the electronic pen, the electronic pen tip 120 is in physical contact with the display panel 200. Based on the pressure information provided by the pressure sensor section 130, the electronic pen control section 170 recognizes such a state and performs on control of the IR light emitting section 140, whereby reflected light starts to enter the IR light receiving section 160.
In this state, the coordinate calculation unit 171 of the electronic pen control unit 170 obtains a series of coordinate information based on the movement of the electronic pen tip 120, and the trajectory calculation unit 321 calculates the movement trajectory (first movement trajectory) of the electronic pen tip 120 on the display panel 200 based on the series of coordinate information.
On the other hand, in response to the user operating the electronic pen 100, the gyro sensor 135 outputs a gyro sensor value (triaxial acceleration information, rotational angular velocity information), and the movement collection portion 322 collects the gyro sensor value.
The first movement locus (change in optical information) calculated by the locus calculating section 321 and the gyro sensor value (physical movement) collected by the movement collecting section 322 are generated based on the movement of the electronic pen 100, and thus there is a correlation between them. In this way, the movement mapping unit 323 compares the physical movement information (gyro sensor value) collected by the movement collection unit 322 with the change in the optical information (first movement locus) calculated by the locus calculation unit 321, and calculates the correlation between them. The correlation includes information about what kind of relationship exists between the triaxial acceleration information and the rotational angular velocity information and the movement trajectory of the electronic pen head 120.
In the electronic pen normal mode, the accuracy of the coordinate information obtained by the coordinate calculation section 171 is high, and therefore the correlation calculated by the movement mapping section 323 is reliable.
The hover processing unit 324 is a component for recognizing that the electronic pen 100 is in a hover mode (hover mode) and calculating the movement trajectory of the electronic pen head 120 in a hover operation by using the sensor value of the gyro sensor 135. In this specification, for convenience of explanation, the movement trajectory calculated in the levitation mode is referred to as a 'second movement trajectory'.
When the levitation processing section 324 senses a motion in a vertical direction (for example, a z direction) with respect to the display panel 200 based on the triaxial acceleration information output from the gyro sensor 135, it enters a levitation mode. As this means that the electronic pen head 120 is spaced apart from the display panel 200 as shown in fig. 3 (b), 3 (c).
In the hover mode, the hover processing unit 324 calculates a second movement locus, which is a movement locus of the electronic pen head 120, by calculating the three-axis acceleration and the rotational angular velocity detected in real time by the gyro sensor 135 into the correlation calculated in advance by the movement mapping unit 323.
Fig. 7 is a diagram showing the concept of the levitation pattern and the operation of the levitation processing section 324 of the present invention.
Referring to fig. 7, the electronic pen head 120 is spaced apart from the display panel 200 in the hover mode. In this state, it is difficult to trust the optical recognition result for the position code 210, and according to the embodiment, the IR light emitting part 140 is turned off to be controlled, so that the optical recognition of the position code 210 cannot be performed.
Fig. 7 shows 2 examples of calculating the second movement locus by the levitation processing section 324 in the levitation mode. Fig. 7 (a) shows an example in which the three-axis acceleration and the rotational angular velocity detected in real time by the gyro sensor 135 are calculated by the correlation calculated in advance by the movement mapping unit 323, and the second movement trace is calculated. Fig. 7 (b) shows an example in which the three-axis acceleration and the rotational angular velocity detected in real time by the gyro sensor 135 are calculated into the correlation calculated in advance by the movement mapping unit 323 to preliminarily obtain a result value, and the second movement locus is calculated based on a combination of the result value and the coordinate information obtained by the coordinate calculation unit 171.
The embodiment of fig. 7 (a) is a configuration in which the second correlation is calculated based on only the sensor value of the gyro sensor 135, and the embodiment of fig. 7 (b) is a configuration in which the second correlation is calculated reflecting not only the sensor value of the gyro sensor 135 but also the value of the position code 210 sensed by the IR light receiving unit 160. Although the latter embodiment can improve the accuracy of the levitation operation, it is necessary to maintain the on state of the IR light emitting part 140 during the period in which the pressure sensor part 130 does not detect the pressure, and thus it is disadvantageous to the battery operation time of the electronic pen 100.
The trajectory display unit 325 is a component for displaying a first movement trajectory on the terminal panel unit 330 in the normal mode of the electronic pen and displaying a second movement trajectory on the terminal panel unit 330 in the hover mode. At this time, the trajectory display unit 325 preferably sets the initial start position of the second movement trajectory to the final position of the first movement trajectory when switching from the normal mode to the hover mode of the electronic pen, so that the movement trajectory of the electronic pen tip 120 is smoothly connected without jumping during the mode switching (transition state).
Fig. 8 is a sequence diagram showing a suspension processing method of the optical electronic pen based on the gyro sensor of the present invention.
Since the operation mode of the suspension processing system of the optical electronic pen based on the gyro sensor will be described in detail with reference to fig. 4 to 7, a suspension processing method of the optical electronic pen based on the gyro sensor will be described in detail with reference to fig. 8.
Step (S100): first, the electronic pen control part 170 performs on or off control of the IR light emitting part 140 according to whether the electronic pen 100 is in contact with the display panel 200. As one embodiment of implementing the same, when the pressure sensor part 130 of the electronic pen 100 senses the pressure applied to the electronic pen head 120, the hardware control part 172 of the electronic pen control part 170 performs on or off control of the IR light emitting part 140 of the electronic pen 100 according to the pressure information transmitted from the pressure sensor part 130.
Step (S110, S120): the IR light emitting part 140 irradiates light to the display panel 200 formed with the position code 210 in response to the on control of the electronic pen control part 170. The IR light receiving means 160 receives the reflected light reflected by the display panel 200 to sense the position code 210 of the position of the electronic pen tip 120, and the coordinate calculating section 171 analyzes the position code 210 obtained by the IR light receiving means 160 to obtain a series of coordinate information of the movement of the electronic pen tip 120.
Step (S130, S140): the trajectory calculation unit 321 enters the electronic pen normal mode when the coordinate calculation unit 171 starts providing the coordinate information. The trajectory calculation unit 321 calculates a first movement trajectory, which is a movement trajectory of the electronic pen head 120 on the display panel 200, based on the series of coordinate information obtained by the coordinate calculation unit 171, and the trajectory display unit 325 displays the first movement trajectory on the terminal panel unit 330.
Steps (S150 to S170): in the normal mode of the electronic pen, the gyro sensor 135 detects the triaxial acceleration and the rotational angular velocity related to the movement of the electronic pen 100, and the movement collection unit 322 collects a series of triaxial acceleration and rotational angular velocity information detected by the gyro sensor 135. The movement mapping unit 323 compares the series of triaxial acceleration information and rotational angular velocity information collected by the movement collection unit 322 with the first movement trajectory calculated by the trajectory calculation unit 321, and calculates a correlation between the triaxial acceleration information and rotational angular velocity information and the movement trajectory of the electronic pen head 120 on the display panel 200.
Step (S180, S190): when the levitation processing part 324 senses a movement in a vertical direction with respect to the display panel 200 according to the triaxial acceleration information provided by the gyro sensor 135, a levitation mode is entered in response thereto. In the hover mode, the hover processing unit 324 calculates a second movement locus, which is a movement locus of the electronic pen head 120, by calculating the three-axis acceleration and the rotational angular velocity detected by the gyro sensor 135 in the hover mode, into the correlation calculated by the movement mapping unit 323.
Referring to fig. 7 (b), as described above, according to an embodiment, the levitation processing unit 324 may be configured to adjust (fine) the calculated second movement trajectory based on the coordinate information obtained by the coordinate calculation unit 171. For example, in the case where there is a difference between the first movement locus preliminarily calculated by the correlation and the coordinate information obtained by the coordinate calculation section 171, they are weighted-averaged according to a predetermined ratio.
In addition, it is preferable that the trajectory display unit 325 sets the initial start position of the second movement trajectory to the final position of the first movement trajectory when switching from the normal mode of the electronic pen to the hover mode, and connects the movement trajectories of the electronic pen tip 120 during the mode switching.
Finally, the trajectory display unit 325 displays the second movement trajectory on the terminal panel unit 330.
On the other hand, the present invention may be embodied in the form of a computer-readable code in a nonvolatile recording medium readable by a computer. The nonvolatile recording medium may be a storage device of various forms, such as a hard disk, SSD, CD-ROM, NAS, magnetic tape, network disk, and cloud disk.
Claims (4)
1. A suspension processing method of an optical electronic pen based on a gyro sensor, wherein a suspension operation is provided to the optical electronic pen (100) based on the gyro sensor,
the method comprises the following steps:
the electronic pen control part (170) controls the IR light emitting part (140) to be turned on or off according to whether the electronic pen (100) is contacted with the display panel (200);
the IR light emitting means (140) irradiates light to the display panel (200) formed with the position code (210) in response to the above-described ON control;
an IR light receiving part (160) receives reflected light reflected by the display panel (200) and senses a position code (210) of the position of the electronic pen head (120);
a coordinate calculation unit (171) that analyzes the position code (210) obtained by the IR light receiving member (160) to obtain a series of coordinate information of the movement of the electronic pen head (120);
when the coordinate information of the position of the electronic pen head (120) on the display panel (200) is provided from the coordinate calculating part (171) based on the position code (210), the track calculating part (321) enters an electronic pen normal mode;
the trajectory calculation unit (321) calculates, as a first trajectory, a trajectory of the electronic pen head (120) on the display panel (200) from a series of coordinate information obtained by the coordinate calculation unit (171) based on the position code (210);
a track display unit (325) for displaying the first movement track on a terminal panel unit (330) in an electronic pen normal mode;
a gyro sensor (135) for detecting a triaxial acceleration and a rotational angular velocity related to the motion of the electronic pen (100);
a movement collection unit (322) that collects a series of triaxial acceleration and rotational angular velocity information detected by the gyro sensor (135);
a movement mapping unit (323) that compares a series of triaxial acceleration information and rotational angular velocity information collected by the movement collection unit (322) in the normal mode of the electronic pen with the first movement trajectory calculated by the trajectory calculation unit (321) based on the position code (210), and calculates a correlation between the triaxial acceleration information and rotational angular velocity information and the first movement trajectory;
a levitation processing section (324) that enters a levitation mode in response to sensing a movement in a vertical direction with respect to the display panel (200) based on the three-axis acceleration information;
the levitation processing unit (324) calculates a movement trajectory of the electronic pen head (120) as a second movement trajectory by calculating a three-axis acceleration and a rotation angular velocity detected by the gyro sensor (135) into the correlation calculated by the movement mapping unit (323) in the levitation mode; a kind of electronic device with high-pressure air-conditioning system
The trajectory display unit (325) displays the second movement trajectory on the terminal panel unit (330) in the hover mode.
2. The suspension processing method of the optical electronic pen based on the gyro sensor according to claim 1, further comprising the steps of:
the track display unit (325) sets the initial start position of the second movement track to the final position of the first movement track when switching from the normal mode to the floating mode of the electronic pen, thereby connecting the movement track of the electronic pen head (120) during the mode switching.
3. The suspension processing method of the optical electronic pen based on the gyro sensor according to claim 1, further comprising the steps of:
the levitation processing section (324) adjusts the second movement path based on the coordinate information obtained by the coordinate calculation section (171) in the levitation mode.
4. A computer program stored in a storage medium to cause a computer to execute the suspension processing method of the gyro sensor-based optical electronic pen according to any one of claims 1 to 3.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020220065694A KR102472784B1 (en) | 2022-05-27 | 2022-05-27 | method of providing hovering for an optical digital pen by use of a gyro sensor |
| KR10-2022-0065694 | 2022-05-27 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117130495A true CN117130495A (en) | 2023-11-28 |
Family
ID=84440750
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310126354.XA Pending CN117130495A (en) | 2022-05-27 | 2023-02-01 | Suspension processing method of optical electronic pen based on gyroscope sensor |
Country Status (2)
| Country | Link |
|---|---|
| KR (1) | KR102472784B1 (en) |
| CN (1) | CN117130495A (en) |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100349031B1 (en) * | 2000-12-15 | 2002-08-17 | 핑거시스템 주식회사 | A pen type light mouse device |
| KR100408518B1 (en) | 2001-04-12 | 2003-12-06 | 삼성전자주식회사 | Pen input device and Measuring method of coordinate |
| KR100438846B1 (en) | 2003-10-07 | 2004-07-06 | 함종훈 | Pen-type mouse apparatus |
| KR102092132B1 (en) | 2012-11-30 | 2020-04-14 | 삼성전자주식회사 | Electronic apparatus providing hovering input effect and control method thereof |
| KR102109649B1 (en) | 2013-06-04 | 2020-05-13 | 삼성전자 주식회사 | Method for correcting coordination of electronic pen and potable electronic device supporting the same |
| KR101672731B1 (en) | 2015-01-20 | 2016-11-04 | 주식회사 트레이스 | 3d hovering digitizer system using pen tilt |
| KR101796925B1 (en) * | 2016-04-14 | 2017-11-16 | (주)이케이네트웍스 | Apparatus for electric handwriting and system including therefor |
| KR200485305Y1 (en) | 2017-09-11 | 2017-12-19 | (주)딥스원에듀 | Electronic pen for writing on pattern film having dot pattern |
| KR102213541B1 (en) | 2019-08-01 | 2021-02-08 | 주식회사 이지시스템 | Method for improving recognition rate using a digital pen for film printed pattern |
| KR20210125193A (en) * | 2020-04-08 | 2021-10-18 | 삼성전자주식회사 | Display system, method for controlling display system and display apparatus |
-
2022
- 2022-05-27 KR KR1020220065694A patent/KR102472784B1/en active IP Right Grant
-
2023
- 2023-02-01 CN CN202310126354.XA patent/CN117130495A/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| KR102472784B1 (en) | 2022-12-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9910514B2 (en) | Wireless positioning pen with pressure-sensitive tip | |
| US9195351B1 (en) | Capacitive stylus | |
| US6897854B2 (en) | Electronic pen input device and coordinate detecting method therefor | |
| US20120019488A1 (en) | Stylus for a touchscreen display | |
| US20090115744A1 (en) | Electronic freeboard writing system | |
| US20120299848A1 (en) | Information processing device, display control method, and program | |
| US20100123659A1 (en) | In-air cursor control | |
| US20120162061A1 (en) | Activation objects for interactive systems | |
| US20190094993A1 (en) | User interface devices for virtual reality system | |
| KR20060072085A (en) | Mouse input device with secondary input device | |
| US20140320481A1 (en) | Display control | |
| KR20150011885A (en) | User Interface Providing Method for Device and Device Thereof | |
| KR100360477B1 (en) | Wireless electronic pen | |
| CN117130495A (en) | Suspension processing method of optical electronic pen based on gyroscope sensor | |
| US9442577B2 (en) | System for inputting graphical elements | |
| US20140055424A1 (en) | Method and Apparatus Pertaining to Detecting a Light-Emitting Stylus' Position | |
| KR101014574B1 (en) | Pen mouse and method of driving the same | |
| US20200057518A1 (en) | Smart touch pad device | |
| KR102429967B1 (en) | system and method of providing display edge processing for an optical digital pen by use of a gyro sensor | |
| US11106282B2 (en) | Mobile device and control method thereof | |
| EP2965177B1 (en) | Using portable electronic devices for user input on a computer | |
| KR102478738B1 (en) | optical digital pen by use of light scattering | |
| KR102559810B1 (en) | an optical digital pen of providing eraser mode by use of pressure sensor | |
| KR102264854B1 (en) | Handwriting tracking device and method using 3-axis acceleration sensor | |
| WO2023047512A1 (en) | Information processing device, program, and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |