JP2001005600A - Handwritten input method and handwritten input device and recording medium recording program for allowing computer to realize handwritten input processing - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a simple, compact, and light handwritten input device with a simple constitution capable of which can perform an input operation from a position separated from an input device. SOLUTION: This handwritten input device is provided with a light emitting means 101 carried by an operator for radiating lights L, a light receiving means 103 for receiving the lights L radiated from the light emitting means 101, a storage means 103 for storing the locus of the movement of the lights L received by the light receiving means 103, and a recognizing means 104 for recognizing the locus of the movement of the lights outputted from the storage means 103 as information Dr corresponding to the locus of the movement of the lights L, and for outputting the recognized information Dr.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a handwriting input method, a handwriting input device, and a recording medium on which a program for causing a computer to execute a handwriting input process is recorded. The present invention relates to a handwriting input method, a handwriting input device, and a recording medium that records a program for causing a computer to implement a handwriting input process, which is suitable for input operations such as the above.

[0002]

2. Description of the Related Art Hitherto, as a data input device, there have been input devices such as a pressure-sensitive tablet and a touch panel, which capture coordinates of an operator's hand on a two-dimensional plane.
These input devices detect an input operation by allowing an operator to directly touch a surface of the input device with a finger or an input pen.

As a device for detecting coordinates in a three-dimensional space, Japanese Patent Application Laid-Open No. 60-60502 discloses a three-dimensional position designation device for inputting coordinates in a three-dimensional space of XYZ. The technology described in this publication will be described as a first conventional example.

FIG. 7 is an overall perspective view for explaining the concept of a first conventional three-dimensional position designation apparatus. As shown in FIG. 7, when the pen 502 points to a position to be designated in the target space 501 and the switch 503 is pressed, a lamp 504 at the tip of the pen 502 lights up. At that time, the calculator 509 is interrupted by the voltage across the resistor 5. These are CCD cameras that look at the xy plane and the yz plane, respectively.
08 to obtain (x, y, z) coordinates,
Send to The computer 509 uses the pen 502
Reads the position specified by.

Japanese Patent Application Laid-Open No. 60-38604 discloses that
A space coordinate measuring device in a three-dimensional space is disclosed, and the technology disclosed in the publication will be described as a second conventional example.

FIG. 8 is an overall perspective view for explaining the concept of a second conventional spatial coordinate measuring apparatus. As shown in FIG. 8, the bright point of the light pen 601 is made coincident with the measurement point, and an image including the bright point is displayed on the controller 602 using the industrial TV camera 603.
Take in. The controller 602 detects a deviation between the bright spot position on the screen and a predetermined position on the screen, generates drive signals to the servomotors 605 and 606 in the vertical and horizontal directions so that the two coincide, and servo-controls the camera 603. At this time, the servo motors 605 and 606 are provided with
Camera 6 using horizontal angle detectors 607 and 608
03 can be detected. Next, using the auxiliary camera 604, the bright spot of the light pen 601 is captured as an image,
From the deviation angle from the optical axis of the camera 603, the distance to the bright spot can be detected by triangulation. Camera 6 thus detected
The controller 602 calculates the three-dimensional spatial coordinates of the measurement point based on the movement angle of 03 and the bright point.

Further, a radio wave transmitting means is incorporated into the input pen, and a radio input device for determining the position of the input pen in a three-dimensional space by receiving the radio waves, and a gyro sensor is incorporated into the input pen, and There is also a gyro-type input device that obtains coordinates of the input pen in a three-dimensional space by detecting the posture, acceleration, and the like of the pen.

[0008]

However, each of the above conventional examples has the following problems.

First, a special input device such as a flat tablet or a flat touch panel is required as an input device for recognizing the position of the input pen, and there has been a problem that the manufacturing cost is increased. The reason is that input devices capable of detecting such a two-dimensional operation are generally expensive.

Second, since a contact-type input device such as a flat tablet or a flat touch panel is used,
There has been a problem that an operator cannot perform an input operation from a place away from these input devices. The reason is that in order to apply an input operation to these contact-type input devices, it is necessary to apply an input operation by directly touching the surface of the input device.

As a third point, an input device such as a flat tablet or a flat touch panel for inputting an input operation by an operator is required, and there is a problem that an installation area is enlarged. The reason is that the operator needs to directly apply the two-dimensional input operation on the input device, and the input device needs a sufficient area according to the input operation.

As a fourth point, the first and second prior arts merely disclose that the position of the input pen is simply output as it is as coordinates in a three-dimensional space, and the input device for character recognition and the like are not disclosed. It does not suggest any configuration specifically applied to the apparatus or a specific method thereof.

Fifth, in a radio-type or gyro-type handwriting input device, the structure of the input pen is complicated, the size of the input pen is large, the weight is increased, and the manufacturing cost is significantly increased. was there. The reason is that it is necessary to incorporate a complicated electronic circuit such as a modulation circuit and a transmission circuit and a special functional device such as a gyro sensor in the input pen.

Here, the present invention enables a computer to perform a handwriting input method, a handwriting input device, and a handwriting input process, which can perform an input operation even from a position distant from an input device, and have a simple configuration, small size and light weight. And a recording medium storing the program.

[0015]

In order to solve the above-mentioned problems, the present invention employs the following novel characteristic methods and means.

A feature of the handwriting input method of the present invention is that a light emitting means (101) for emitting light (L in FIG. 1) held by an operator;
In a handwriting input device including a light receiving means (103) for receiving the light (L) emitted from the light emitting means (101), a movement locus of the light (L) received by the light receiving means (103) is stored. Then, the trajectory of the movement of the light (L) is recognized as information (Dr) corresponding to the trajectory of the movement of the light (L), and the recognized information (Dr) is output.

The handwriting input device according to the present invention is characterized by a light emitting means (101) for emitting light (L in FIG. 1) held by the operator;
Light receiving means (103) for receiving the light (L) emitted from the light emitting means (101), and storage means (103) for outputting a locus of movement of the light (L) received by the light receiving means (103)
And the trajectory of the movement of the light (L) output from the storage means (103), and the information (D) corresponding to the trajectory of the movement of the light (L).
r), and a recognition means (104) for outputting the recognized information (Dr).

The characteristics of the recording medium on which the program for causing the computer to implement the handwriting input process of the present invention is characterized by a light emitting means (101) which the operator emits light (L in FIG. 1), and a light emitting means A handwriting input device including light receiving means (103) for receiving light (L) emitted from (101), wherein a movement locus of light (L) received by light receiving means (103) is stored; An object of the present invention is to cause a computer to recognize a trajectory of movement of light (L) as information (Dr) corresponding to a trajectory of movement of light (L) and output the recognized information (Dr).

By adopting such a method and means, a recording medium storing a program for causing a computer to implement a handwriting input method, a handwriting input device, and a handwriting input process according to the present invention has a small space. Since the trajectory of light is captured as an image and recognized and output as information corresponding to the image, the operator can perform an input operation even from a position distant from the light receiving means.

[0020]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 is a conceptual perspective view of the overall configuration of a handwriting input device according to an embodiment of the present invention. The handwriting input device shown in FIG. 1 includes an input pen 101 and a light receiving device 102.

The input pen 101 is light-emitting means for emitting light L, and is held by an operator.

The light receiving device 102 includes a light receiving / storage unit 103
And a character recognizing unit 104 and a display unit 105, and detects a locus of movement of the light L emitted from the input pen 101,
The display unit 105 displays the recognition result data Dr corresponding to this locus.
To be displayed.

The light receiving / storing unit 103 includes the input pen 10
The light L emitted from 1 is photoelectrically converted and accumulated, and the locus of movement of the accumulated light L is output as accumulated image data Di.

The character recognition unit 104 includes a light receiving / storage unit 104
The stored image data Di output from the image data is compared with the comparison target image data (D1 in FIG. 6B, FIG. 6C)
D2) is compared and recognized using a pattern matching process or the like, and the recognized result is output as recognition result data Dr.

The display unit 105 displays the recognition result data Dr output from the recognition unit 104 as an image on a display screen.

FIG. 2 shows the input pen 101 of the embodiment shown in FIG.
FIG. 3 is a perspective side view for explaining the structure of FIG. Input pen 10 shown in FIG.
1 includes a light source 202, a power supply 203, and a switch 204.

The light source 202 emits various lights L such as infrared light and visible light.

The power supply 203 is a power supply unit including a battery or the like built in the input pen 101, and supplies a current to the light source 202.

The switch 204 includes a light source 202 and a power supply 20.
3 is electrically connected in series, and an operator supplies a current to the light source 202 by pressing the switch 204.

FIG. 3 shows the light receiving / storage unit 1 according to the embodiment of FIG.
FIG. 3 is a conceptual diagram for explaining the configuration of a third embodiment. 3 includes an optical filter 302, a lens 303, a shutter 304, a CCD 305, an A / D converter 306, a detected image data storage unit 307, and a CPU 30.
8, an interface unit 309, a shutter control unit 310, and a bus 311.

The optical filter 302 is provided for the input pen 101.
A wavelength-selective filter or the like having a characteristic of transmitting only light having a wavelength near the wavelength of light L emitted from FIG.
It is arranged facing the opening 103a.

The lens 303 is an optical lens focused on the surface of the CCD 305, is disposed inside the optical filter 302, and converts the light L transmitted through the optical filter 302 into CC light.
An image is formed on the surface of D305.

The shutter 304 is connected to the lens 303 and the CC
D305, and is opened and closed at regular time intervals.
The light L incident on the CD 305 is divided at regular intervals.

A CCD (Charge Coupled Device) 305 is various kinds of image pickup devices such as a two-dimensional CCD image sensor and the like.
The light L imaged on the two-dimensional light receiving plane 305 is
The detected image signal Sd represents the amount of incident light of each pixel 05 in FIG.

The A / D converter 306 includes a CCD 305
Performs analog-to-digital conversion on the detected image signal Sd output from the controller and outputs the detected image signal as detected image data Dd.

The detected image data storage unit 307 is composed of a storage element such as a memory, and converts the detected image data Dd output from the A / D converter 306 into light L on a two-dimensional plane defined by the field of view of the CCD 305. Is stored internally as stored image data Di representing the trajectory of the movement.

The CPU 308 includes an A / D converter 306
Means for integrally controlling each part of the shutter control unit 310.

The interface unit 309 includes the CPU 30
According to the control of No. 8, the stored image data Di stored in the detected image data storage unit 307 is output.

The shutter control unit 310 includes a CPU 308
, The shutter control signal Ssc is output at a fixed cycle, and the shutter 304 is opened and closed at a fixed cycle.

The bus 311 is connected to the A / D converters 306 to
The shutter control units 310 are mutually connected.

FIG. 4 is a conceptual diagram illustrating the configuration of the recognition unit 104 in the embodiment of FIG. 4 includes an interface unit 401, a comparison target image data storage unit 402, a CPU 403, and an interface unit 404.
And a bus 405.

The interface unit 401 fetches the stored image data Di output from the light receiving / storage unit 103.

The comparison target image data storage unit 402 is a storage means such as a memory, and stores the comparison target image data D1 (FIG. 6B) and the comparison target image data D2 (FIG. 6C) used for the pattern matching processing. Is stored.

The CPU 403 compares the stored image data Di with the comparison target image data D1 and D2 using a method such as a pattern matching process, and recognizes one of the comparison target image data D1 and D2 corresponding to the storage image data Di. Output as result data Dr.

The interface unit 404 is connected to the CPU 40
3 and outputs the recognition result data Dr output from No.3.

The bus 405 is connected to the interface unit 401.
To connect the interface units 404 to each other.

FIG. 5 is a processing flowchart of a handwriting input method applied to the handwriting input device of the embodiment of FIG.

First, as shown in FIG. 1, an operator (not shown) holds the input pen 101 and holds it toward the light receiving / storage unit 103.

Switch 204 of input pen 101 (FIG. 2)
Is not pressed, no current is supplied to the light source 202 (FIG. 2), so that the light source 202 (FIG. 2) does not emit light and the light L
Does not radiate. Also, as shown in FIG. 3, light from the surrounding environment is blocked by the optical filter 302. Therefore, CCD3
In No. 05, the detection image signal Sd is not output because the light L does not enter (Step S1).

Since the detected image signal Sd is not supplied to the A / D converter 306, the process returns to step S1 again (step S2). Thus, steps S1 and S2 are repeated until light L is incident on CCD 305.

When the operator presses the switch 204 (FIG. 2) of the input pen 101, a current is supplied from the power supply 203 (FIG. 2) to the light source 202 (FIG. 2), and the light source 202 (FIG. 2)
Emits light and emits light L.

The light L emitted from the light source 202 (FIG. 2) of the input pen 101 is received and stored in the light receiving / storing unit 10 as shown in FIG.
3 through the optical filter 302, is refracted by the lens 303, and forms an image on the surface of the CCD 305 (step S).
1).

When the light L enters the CCD 305, the CCD
305 outputs a detection image signal Sd of a level corresponding to the amount of incident light of each pixel, and the detection image signal Sd is supplied to the A / D converter 306 (step S2).

The A / D converter 306 performs A / D conversion of the supplied detected image signal Sd and outputs the detected image signal Sd to the bus 311 as detected image data Dd. The detected image data Dd output to the bus 311 is transmitted to the CCD 30 by the CPU 308.
5 shows a luminance level for each coordinate on a two-dimensional plane defined by a range of five visual fields. The CPU 308 determines, for each pixel,
The detected image data Dd and the detected image data storage unit 307
Is ORed with the accumulated image data Di, which is the detected image data Dd already accumulated in step S3, and is successively accumulated as accumulated image data Di (step S3).

The CCD 305 takes in the light L again (step S4).

The CPU 308 repeats steps S3 to S5 until the supply of the detected image signal Sd is interrupted.

The electric charge accumulated in each pixel of the CCD 305 is read out at regular intervals, and the locus of the movement of the light L formed on the surface of the CCD 305 is stored in the detected image data storage unit 307 as accumulated image data Di. To go.

When the operator releases the switch 204 (FIG. 2) of the input pen 101, the light source 202 (FIG. 2) is turned off and the supply of the light L incident on the CCD 305 in FIG.
The supply of the detected image signal Sd from the CCD 305 to the A / D converter 306 stops. The CPU 308 determines that the input operation has been completed, and ends the operation of storing the detected image data Dd (step S5).

Next, the CPU 308 stores the stored image data Di (FIG. 6) stored in the detected image data storage unit 307.
(A)) is output to the recognition unit 104 (step S6).

CPU 403 of recognition section 104 shown in FIG.
The comparison target image data D1 (FIG. 6 (b)) and the comparison target image data D2 (FIG. 6 (c)) stored in the comparison target image data storage unit 402 are stored in advance. ) Are recognized by performing a pattern matching process (step S7).

In the pattern matching process, the number of matching pixels constituting the image data, the degree of matching of the position of the line segment forming the image data, and the similarity of the stroke direction and length of the line segment are similar. This is a process of comparing and judging over the entire image data.

In this example, as a result of the pattern matching processing, the CPU 403 obtains the accumulated image data Di (FIG. 6A).
Is determined to match the comparison target image data D1 (FIG. 6B). As a result, the CPU 403 converts the comparison target image data D1 (FIG. 6B) into the recognition result data Dr.
(FIG. 6D).

As a result, the display unit 105 of FIG. 1 displays the recognition result data Dr (FIG. 6D) as an image on the screen.

As described above, in the present embodiment, the locus of movement of light emitted from the input pen held by the operator is stored, and is recognized and output as information corresponding to the locus. You will be able to perform input operations even when you are away.

In the above embodiment, the light receiving / storage unit 1
Although the recognition unit 104, the recognition unit 104, and the display unit 105 are separated from each other, they may be arbitrarily connected and integrally formed.

Further, the light receiving / storage unit 103 and the recognition unit 10
4. The display unit 105 may be configured by a computer or the like.

In this case, the A / D converter 306 to the bus 311 and the interface unit 401 to the bus 405 may be integrated on hardware.

Further, when each component is realized by the computer, a program for realizing the handwriting input processing by the computer is stored in the light receiving / storage unit 103 and the recognition unit 104.
Instead of being incorporated as firmware in the CPUs 308 and 403 which are the control computers, the computer may perform the same processing using a software program or the like.

As a recording medium of this software program, a detected image data storage unit 307 and a comparison target image data storage unit 402 are used, such as a memory card, a floppy disk, a hard disk, a CD-ROM, and a DVD-RAM.
The program stored in this recording medium is stored in C
The PUs 308 and 403 may read the data.

In the above embodiment, the light source 202
Light having an arbitrary wavelength, for example, ultraviolet light may be used as the light L emitted from the light source.

As the character recognition method in the recognition unit 104, the comparison target image data D1 and D2 are stored in advance and recognized using the pattern matching process. However, any other recognition method may be used.

As the shutter 304, any of a mechanical shutter and an electric shutter may be used.

Although a two-dimensional CCD image sensor has been exemplified as the CCD 305, various image pickup devices such as a two-dimensional CMOS image sensor may be used.

Further, the shutter control unit 310 opens and closes the shutter 304 at regular intervals so that the detected image data Dd is taken from the CCD 305 to the detected image data storage unit 307 in synchronization with the opening / closing cycle. The shutter 304 and the shutter control unit 310 are omitted, and the difference between the detected image data Dd detected immediately before and the detected image data Dd currently detected is detected image data Dd.
May be used as the detected image data Dd taken from the CCD 305 into the detected image data storage unit 307, and the trajectory of the light L may be obtained.

[0075]

By adopting the above method and means, a handwriting input method, a handwriting input device, and a recording medium which records a program for realizing a handwriting input process on a computer are as follows. The following effects are exhibited.

First, there is an advantage that a special input device such as a tablet or a touch panel is not required. The reason is that the input operation of the operator is detected and recognized as a trajectory of light arriving from a place remote from the light receiving device.

Second, there is an advantage that the input operation can be performed even when the operator is away from the light receiving device, the operation range is wide, and the operability is high. The reason is that, as long as the operator is within the visual field range and the distance range where the light reaches the light receiving device, an input operation such as directly contacting the input pen with the light receiving device is unnecessary.

Third, there is an advantage that the input pen can be made small, lightweight and inexpensive. The reason is that the input pen only needs to have a function of emitting light, so that the structure is very simple.

Fourth, there is an advantage that the input device and the light receiving device are very small and lightweight. The reason is that a small and lightweight CCD is used as the image pickup device.

[Brief description of the drawings]

FIG. 1 is a conceptual perspective view of the overall configuration of a handwriting input device according to an embodiment of the present invention.

FIG. 2 is a perspective side view for explaining the structure of an input pen 101 in the embodiment of FIG.

FIG. 3 is a light receiving / storing unit 103 in the embodiment of FIG.
FIG. 3 is a conceptual diagram for explaining the configuration of FIG.

FIG. 4 is a conceptual diagram illustrating the configuration of a recognition unit 104 in the embodiment of FIG.

FIG. 5 is a processing flowchart of a handwriting input method applied to the embodiment of FIG. 1;

6A is a conceptual explanatory diagram of accumulated image data Di in the embodiment of FIG. 1, FIG. 6B is a conceptual explanatory diagram of comparison target image data D1 in the embodiment of FIG. 1, and FIG. FIG. 4 is a conceptual explanatory diagram of comparison target image data D2 in the first embodiment, and FIG. 4D is a conceptual explanatory diagram of recognition result data Dr in the embodiment of FIG.

FIG. 7 is a conceptual overall perspective view of a three-dimensional position designation device of a first conventional example.

FIG. 8 is an overall conceptual explanatory perspective view of a spatial coordinate measuring device according to a second conventional example.

[Brief description of reference numerals]

 Reference Signs List 101 input pen 102 light receiving device 103 light receiving / storage unit 104 recognition unit 105 display unit 202 light source 203 power supply 204 switch 302 optical filter 303 lens 304 shutter 305 CCD 306 A / D converter 307 detected image data storage unit 308 CPU 309 interface unit 310 shutter Control unit 311 Bus 401 Interface unit 402 Image data storage unit for comparison 403 CPU 404 Interface unit 405 Bus 501 Target space 502 Pen 503 Switch 504 Lamp 505 Resistance 506, 507 TV camera 508 Converter 509 Computer 601 Light pen 602 Controller 603 Industrial use Camera 604 Auxiliary camera 605, 606 Servo motor 607, 608 Angle detector

Claims (12)

[Claims] 1. A light emitting means for emitting light that an operator has,
A handwriting input device comprising: a light receiving unit that receives the light emitted from the light emitting unit; wherein a trajectory of the movement of the light received by the light receiving unit is stored; A handwriting input method comprising: recognizing information corresponding to a locus of light movement; and outputting the recognized information. 2. A light emitting means for emitting light held by an operator, a light receiving means for receiving the light emitted from the light emitting means, and a storage for storing a locus of movement of the light received by the light receiving means. Means for recognizing the trajectory of the movement of the light output from the storage means as information corresponding to the trajectory of the movement of the light, and outputting the recognized information. Handwriting input device. 3. The recognizing means compares a locus of movement of the light with a previously stored pattern, and, among the patterns, information corresponding to the pattern that matches the locus, as the recognized information. 3. The handwriting input device according to claim 2, wherein the handwriting input device outputs. 4. The handwriting input device according to claim 2, further comprising display means for displaying said recognized information output from said recognition means. 5. The recognition means recognizes a trajectory of the movement of the light from when the light is received until the light is interrupted as information corresponding to the trajectory of the movement of the light, and outputs the recognized information. The handwriting input device according to claim 2, wherein: 6. The light-emitting means has a pen-like shape in which the light source is disposed at a tip end.
Handwritten input device as described. 7. The handwriting input device according to claim 2, wherein the light is visible light. 8. The handwriting input device according to claim 2, wherein the light is infrared light. 9. The handwriting input device according to claim 2, wherein the light is ultraviolet light. 10. The light receiving means, an optical filter having wavelength selectivity for transmitting the light emitted from the light emitting means, a lens for converging the light transmitted through the optical filter, and the converged light. 3. The handwriting input device according to claim 2, further comprising: a CCD for receiving light. 11. The light receiving means, an optical filter having wavelength selectivity for transmitting the light emitted from the light emitting means, a lens for converging the light transmitted through the optical filter, and the converged light And a shutter provided between the lens and the image sensor, the shutter being capable of blocking the light, and a shutter control means for opening and closing the shutter at a constant period. 2. The handwriting input device according to 2. 12. A handwriting input device comprising: a light emitting means for emitting light held by an operator; and a light receiving means for receiving the light emitted from the light emitting means, wherein the light received by the light receiving means is provided. Storing the trajectory of the light movement as information corresponding to the trajectory of the light movement, and outputting the recognized information to the computer. A recording medium on which a program for causing a program to be recorded is recorded.