TWI540516B - Three dimensional hand-writing input method - Google Patents

Description

Handwriting input method in three-dimensional space

The invention relates to a handwriting input method in a three-dimensional space, in particular to a handwriting input method for performing three-dimensional space by using image capturing and analyzing.

The existing handwriting input method is mainly performed on a touch panel, and the purpose of handwriting input is achieved by detecting the movement track of the finger or the pen on the touchpad.

Nowadays, 3D somatosensory games and devices are very popular, but in these three-dimensional somatosensory devices, text is input as a virtual keyboard, which is not convenient for those who are not accustomed to using keyboard input.

In view of this, an object of the present invention is to provide a handwriting input method in a three-dimensional space, in which a user can achieve an input effect by moving a finger in a space.

A preferred embodiment of the three-dimensional handwriting input method of the present invention includes the following steps: providing an image capturing unit and an operation unit; continuously capturing an image of a person by the image capturing unit, and transmitting the image to the image The operation unit performs analysis; when the person's hand in the image is raised, the operation unit determines that the person wants to input text; when the person's hand starts to move, the operation unit determines the person's hand Moving direction; when the moving direction of the hand of the person is toward the image capturing unit, the computing unit determines that the person starts writing; after determining to start writing, the image capturing unit captures the person The movement track of the hand, and the movement track is transmitted to the operation unit, and converted into a text for input; when the movement direction of the hand of the person is away from the image capture unit, the operation unit determines that the person stops Writing; and when the person in the image puts down the hand, the arithmetic unit determines that the person ends the text input.

In the above preferred embodiment, when the hand of the person in the image is raised, the operation unit determines that the character input is to be performed, and at this time, the operation unit records the coordinates of the hand of the person, and sets the coordinate to a reference coordinate, the transport unit determines a direction of movement of the person's hand based on the reference coordinate.

In the above preferred embodiment, the image capturing unit includes a sensor capable of three-dimensional photography. The arithmetic unit determines that the hand of the person is approaching or away from the image capturing unit by the change of the three-dimensional coordinates of the hand of the person.

In the above preferred embodiment, the image capturing unit includes a sensor capable of two-dimensional photography. The computing unit determines that the hand of the person is approaching or away from the image capturing unit by a change in the size of the image of the hand of the person.

The above preferred embodiment further includes the following steps: when the operation unit determines that the person stops writing, the movement trajectory of the person's hand is not converted into a text input.

The above preferred embodiment further includes the steps of: providing a text database and a display unit; the computing unit compares the movement track with the text in the text database, and then displays the most approximate text on the display unit. And by the person to make a choice.

In the preferred embodiment described above, the movement trajectory is displayed on the display unit.

In the handwriting method of the present invention, the hand is moved forward to determine that the pen is written downward, and the hand is moved backward to determine that the pen is stopped to write, which conforms to the intuition and habit of human writing, is easy to promote and use, and is in accordance with the habit of human use. It is easier to use in somatosensory devices and games.

The above and other objects, features, and advantages of the present invention will become more apparent from the description of the accompanying claims.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram showing an input system for performing a handwriting input method in a three-dimensional space of the present invention. 2 to 8 are schematic views of a handwriting input method in a three-dimensional space according to the present invention. 9A and 9B are flowcharts of a handwriting input method in a three-dimensional space according to the present invention.

As shown in FIG. 1 , the handwriting input method of the three-dimensional space of the present invention is implemented by at least one image capturing unit 10 , a display unit 20 , an arithmetic unit 30 , and a storage unit 40 . The image capturing unit 10 is connected to the arithmetic unit 30, and the display unit 20 is also connected to the arithmetic unit 30. The image captured by the image capturing unit 10 is transmitted to the arithmetic unit 30 for analysis, and the display unit 20 can display the content to be displayed by the computing unit 30, such as the input content. A text database is stored in the storage unit 40. The present invention performs handwriting input by a gesture of a person, and the movement track generated by the gesture is compared with the text database in the storage unit 40, and the content to be input is displayed by the display unit 20.

As shown in FIG. 2 to FIG. 8 , a person 100 stands within the image capturing range 15 of the image capturing unit 10, and the image capturing unit 10 continuously captures the image of the person 100, and the captured image is transmitted to the image. The arithmetic unit 30 performs analysis, and the result of the analysis is displayed on the display unit 20.

As shown in FIG. 2, when the person 100 stands within the image capturing range 15, the image capturing unit 10 captures the image of the person 100 and transmits it to the computing unit 30. The computing unit 30 determines the hand 102 of the person 100 (in the present In the embodiment, the right hand is taken as an example, but not limited to the right hand, and the left hand can also be lifted.

As shown in FIG. 3, when the hand 102 of the person 100 is raised, the arithmetic unit 30 determines that the person 100 wants to perform character input. At this time, the arithmetic unit 30 records the coordinates of the hand 102 of the person 100, and sets the coordinate as a reference coordinate. The arithmetic unit 30 determines the moving direction of the hand 102 of the person 100 based on the reference coordinates.

As shown in FIG. 4, when the hand 102 of the person 100 starts moving, the arithmetic unit 30 determines the moving direction of the hand 102 of the person 100 by the image transmitted by the image capturing unit 10. When the hand 102 of the person 100 moves forward (toward the direction of the image capturing unit 10), the arithmetic unit 30 determines that the person 100 wants to start writing.

As shown in FIG. 5, when the computing unit 30 determines that the person 100 wants to start writing, the image capturing unit 10 captures the movement trajectory of the hand 102 of the person 100 and transmits it to the arithmetic unit 30, and the movement trajectory is synchronously displayed on Display unit 20.

As shown in FIG. 6, when the hand 102 of the person 100 is backward (away from the image capturing unit 10), the arithmetic unit judges that the person stops writing. At this time, the arithmetic unit 30 pairs the movement trajectory with the text database stored in the storage unit 40, and displays the text closest to the movement trajectory on the display unit 20. Another type is to display a plurality of characters close to the movement trajectory on the display unit 20 for the person 100 to select. When the operation unit 30 determines that the person 100 stops writing, even if the person 100 moves the hand 102, the operation unit 30 regards only the movement of the movement track as a simple movement, and does not judge the writing, and does not capture the movement track. . When the hand 102 of the person 100 moves forward again, the arithmetic unit 30 will again judge that the person 100 wants to start writing.

As shown in FIGS. 7 and 8, when the person 100 puts down the hand 102, the arithmetic unit 30 determines that the person 100 wants to end the character input.

9A and 9B illustrate a three-dimensional handwriting input method of the present invention. When a person enters an image capturing range, the image of the person is captured, and then the person's hand in the image is lifted. If the person's hand is lifted, Enter the text input mode. In the text input mode, if the person's hand moves forward, the person starts to write. At this time, the movement track of the person's hand is captured. When the person's hand moves backward, the person stops writing. In this way, the captured movement track is compared with the text in the text library, and then the text is displayed on the display unit. When the person's hand is put down, the text input mode is ended. When the person leaves the image capture range, the image capture is stopped.

The image capturing unit 10 may be a sensor for two-dimensional imaging, such as a general network camera, an industrial camera, etc., and the computing unit 30 determines that the hand 102 of the person 100 is close by the change in the size of the image of the hand 102 of the person 100. Or away from the image capturing unit 10.

The image capturing unit 10 may also be a three-dimensional sensor, such as a camera plus an infrared sensor, a stereo camera, etc., to capture the three-dimensional coordinates of the hand 102, and the arithmetic unit 30 is represented by the three-dimensional coordinates of the hand 102 of the person 100. The hand 102 of the judge 100 is judged to be approaching or moving away from the image capturing unit 10.

Although in the above-described embodiment, the hand is used as a feature for starting or ending the character input mode, the present invention is not limited thereto, and other gestures may be used as the start character input mode or the end.

In the handwriting method of the present invention, the hand is moved forward to determine that the pen is written downward, and the hand is moved backward to determine that the pen is stopped to write, which conforms to the intuition and habit of human writing, is easy to promote and use, and is in accordance with the habit of human use. It is easier to use in somatosensory devices and games.

While the present invention has been described in its preferred embodiments, the present invention is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.

10. . . Image capture unit

15. . . Image capture range

20. . . Display unit

30. . . Arithmetic unit

40. . . Storage unit

100. . . personnel

102. . . hand

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram showing an input system for performing a handwriting input method in a three-dimensional space of the present invention.

2 to 8 are schematic views of a handwriting input method in a three-dimensional space according to the present invention.

9A and 9B are flowcharts of a handwriting input method in a three-dimensional space according to the present invention.

Claims (10)

A three-dimensional handwriting input method includes the following steps: providing an image capturing unit and an operation unit; the image capturing unit continuously captures an image of a person, and transmits the image to the operation unit for analysis; When the person's hand in the image is raised, the operation unit determines that the person wants to input text, and at this time, the operation unit records the coordinates of the person's hand and sets the coordinate as a reference coordinate; when the person's When the hand starts to move, the operation unit determines the moving direction of the hand of the person according to the reference coordinate; when the moving direction of the hand of the person is toward the image capturing unit, the computing unit determines that the person starts writing After determining that the writing is started, the image capturing unit captures the movement track of the hand of the person, and transmits the movement track to the operation unit, and converts the text into a text for input; when the person When the moving direction of the hand is away from the image capturing unit, the computing unit determines that the person stops writing; and when the person in the image puts down the hand , The computing unit determines that the person end text input. The handwriting input method of the three-dimensional space according to claim 1, wherein the image capturing unit comprises a sensor capable of three-dimensional photography. The handwriting input method of the three-dimensional space described in claim 2, wherein the operation unit determines that the hand of the person approaches or moves away from the image capturing unit by changing the three-dimensional coordinates of the hand of the person. The handwriting input method of the three-dimensional space according to claim 1, wherein the image capturing unit comprises a sensor capable of two-dimensional photography. The handwriting input method of the three-dimensional space described in claim 4, wherein the computing unit determines that the hand of the person is approaching or away from the image capturing unit by a change in the size of the image of the hand of the person. The handwriting input method of the three-dimensional space according to claim 1, further comprising the step of: when the operation unit determines that the person stops writing, the movement track of the hand of the person is not converted into a text input. The handwriting input method of the three-dimensional space described in claim 6 further includes the following steps: providing a text database and a display unit; the operation unit compares the movement track with the text in the text database, and then The most recent text is displayed on the display unit and selected by the person. The handwriting input method of the three-dimensional space according to claim 7, wherein the movement track is displayed on the display unit. The handwriting input method of the three-dimensional space described in claim 1 of the patent application further includes the following steps: Providing a text database and a display unit; the operation unit compares the movement track with the text in the text database, and then displays the most approximate text on the display unit, and is selected by the person. The handwriting input method of the three-dimensional space according to claim 9, wherein the movement track is displayed on the display unit.