WO2017215375A1

WO2017215375A1 - Information input device and method

Info

Publication number: WO2017215375A1
Application number: PCT/CN2017/083775
Authority: WO
Inventors: 齐向前
Original assignee: 齐向前
Priority date: 2016-06-12
Filing date: 2017-05-10
Publication date: 2017-12-21
Also published as: CN105824431B; CN105824431A

Abstract

The present invention discloses an information input device and a method. The information input device according to the present invention comprises: a finger position capturing unit worn on a user's thumb for capturing relative movement and relative position of a pad of the thumb and the remaining four fingers; a gesture detection unit for detecting the user's gesture on the basis of the relative movement and the relative position of the pad of the thumb and the remaining four fingers captured by the finger position capturing unit; and an information identification unit for identifying the gesture detected by the gesture detection unit as input information based on a predetermined mapping relationship. The information identification unit is connected to an information processing device via cable or wireless signal so as to transmit the identified input information to the information processing device, for the purpose of processing the received input information to input a corresponding character or execute a corresponding command on an electronic device. According to the present invention, the user can perform complicated and comprehensive information input with simple and convenient gesture operation.

Description

Information input device and method

Technical field

The present invention relates to an electronic device, and more particularly to an information input device and method of an electronic device.

Background technique

In recent years, with the development of miniaturization of electronic devices, the keyboards originally equipped with electronic devices are no longer becoming standard devices for electronic devices, and instead are non-physical devices that do not occupy device space, such as virtual keyboards or voice input.

However, the current voice input technology is still in the development stage, and its recognition result is still far from the effect that people really need, and in some occasions, voice input is not convenient. In addition, the current virtual keyboard technology displays the keyboard on the display of the electronic device. Since the display cannot be too large, the displayed virtual keyboard has no buttons, and the user can easily press the wrong button. Although some virtual keyboards are not full-letter QWERT keyboards, but use one key to represent two or more input candidate characters, such input makes the user's operation very cumbersome, and also causes errors due to space constraints. There is also a keyboard projected on the surface of the object, but it cannot be used anytime, anywhere, such as inconvenient walking.

Accordingly, there is a need for an information input apparatus and method that enables a user to operate in a simple and convenient manner for complex and comprehensive information input.

Summary of the invention

It is an object of the present invention to provide an information input apparatus and method that enable a user to operate with simple and convenient gestures for complex and comprehensive information input.

According to a first aspect of the present invention, there is provided an information input device comprising: a finger position capturing unit that is worn on a thumb of a user for capturing relative motion and relative position of a thumb of the thumb and the remaining four fingers; a gesture detecting unit for capturing the thumb according to the finger position capturing unit The relative movement and relative position of the finger pad and the remaining four fingers are used to detect the gesture of the user; the information recognition unit is configured to recognize the gesture detected by the gesture detecting unit as the input information based on the predetermined mapping relationship.

Preferably, in the information input device, the finger position capturing unit, the gesture detecting unit and the information identifying unit are integrated, and the outer shape is a ring shape and is placed on the thumb of the user.

Alternatively, in the information input device, the finger position capturing unit, the gesture detecting unit, and the information identifying unit are respectively placed at different positions, and connected by a cable or a wireless signal.

Preferably, in the information input device, the finger position capturing unit includes one or more of the following sensors: an optical camera, an electromagnetic wave radar, an acoustic sensor, a laser radar, an ultrasonic sensor, a surface wave radar, and an ammeter.

Preferably, in the information input device, the relative movement of the thumb and the remaining four fingers of the thumb includes at least one of sliding and tapping.

When the relative motion of the thumb and the remaining four fingers is sliding, the gesture detecting unit respectively slides the thumb of the thumb along each of the remaining four fingers and the sliding between any two fingers of the remaining four fingers. The gesture is detected as a corresponding gesture, and the information recognition unit respectively identifies the gesture as the corresponding input information based on the predetermined mapping relationship.

When the relative motion of the thumb and the remaining four fingers is a tap, the gesture detecting unit detects the tapping of the thumb of the thumb on each joint or knuckle of each finger of the remaining four fingers as corresponding Gestures, and the information recognition unit respectively identifies the gestures as corresponding input information based on a predetermined mapping relationship.

Preferably, the gesture detecting unit determines that the relative motion of the thumb and the remaining four fingers of the thumb is a sliding or tapping according to one or more of the following factors:

(1) the relative distance between the thumb of the thumb and any one of the remaining four fingers;

(2) the jitter of the finger;

(3) the color or expansion of the surface of the finger skin;

(4) changes in surface waves;

(5) Changes in sound waves or ultrasound

(6) changes in the surface current of the finger skin,

Each of the above factors is detected by one or more sensors.

According to a second aspect of the present invention, there is provided an information input method comprising: capturing, by a finger position capturing unit worn on a thumb of a user, a relative motion and a relative position of a thumb and a remaining four fingers of the thumb; The relative motion and relative position of the thumb of the thumb captured by the capture unit and the remaining four fingers are used to detect the gesture of the user; the detected gesture is recognized as input information based on a predetermined mapping relationship.

According to a third aspect of the invention, there is provided an electronic device comprising: the information input device according to the first aspect of the invention; the information processing device for receiving the input information from the information input device, and receiving the information The input information is processed to input a corresponding character on the electronic device or to execute a corresponding command; and display means for displaying a corresponding character or a corresponding command according to the processing result of the information processing device.

According to the technique of the present invention, a user inputs using a finger of the same hand in contact with each other. This type of input takes advantage of the person's ability to perceive his own posture. The user usually can touch the other fingertips with the thumb even without the need for additional training. Therefore, with a little practice, the input speed with this input method can exceed the touch screen and keyboard input methods.

Moreover, the techniques of the present invention are particularly well suited for situations where shaking or inconvenience is placed in the line of sight.

According to the technique of the present invention, the user is enabled to perform complicated and comprehensive information input with simple and convenient gestures.

DRAWINGS

The invention will now be described in connection with the embodiments with reference to the accompanying drawings. In the drawing:

FIG. 1 is a schematic diagram illustrating a user wearing an information input device according to the present invention.

2 is a schematic diagram illustrating the arrangement of virtual key positions on the remaining four fingers.

FIG. 3 is an example of a screen captured by the finger position capturing unit.

4 is another example of a screen captured by the finger position capturing unit.

Figure 5 is an illustration illustrating the distance from the finger ring to the remaining four fingers of the user.

Figure 6 is another example illustrating the distance from the finger ring to the remaining four fingers of the user.

Figure 7 is yet another example illustrating the distance from the finger ring to the remaining four fingers of the user.

Figure 8 is a schematic block diagram of an information input device in accordance with the present invention.

Figure 9 is a flow chart of an information input method in accordance with the present invention.

Figure 10 is a schematic block diagram of an electronic device including an information input device in accordance with the present invention.

detailed description

Specific embodiments of the present invention will be explained in detail below with reference to the accompanying drawings.

According to the present invention, it is only necessary to wear a sensor-equipped finger ring on the thumb to monitor the movement of a plurality of fingers, mainly the interaction between the thumb and the other four fingers, and after being recognized by the system, sent to other devices as a control command. .

The present invention will be further described below in conjunction with the accompanying drawings and embodiments. The description is based on the left hand and the right hand.

FIG. 1 is a schematic diagram illustrating a user wearing an information input device according to the present invention. As shown in FIG. 1, the shape of the information input device is a ring shape and can be placed on the thumb of the user.

The finger ring of FIG. 1 is provided with a finger position capturing unit such as an optical camera, and other sensors, switches, and the like may be provided. The power supply, data processing system, display system, and signal transmission system required for gesture recognition can be integrated in the ring or in a wristband or watch. The cable or wireless signal is connected to the finger ring to reduce the volume of the ring. And weight. The ring (and its associated wristband or watch) can be integrated with other functions, such as a smartphone, or connected to an electronic device via a cable or wireless signal.

In use, the finger is worn on the second knuckle of the thumb finger, and the camera is oriented toward the fingertip, as shown in FIG.

The invention mainly monitors the mutual movement of the thumb of the same hand and the other four fingers. Most of these actions occur in the case of a virtual hand fist. At this time, the index finger, the middle finger, the ring finger and the little finger form a curved surface, and the face is set as a hand. The XY plane of the coordinate system, with the four fingers pointing to the X axis and the upward pointing to the Y axis. The thumb in the relaxed state is in a posture pointing to the XY plane, and the direction perpendicular to the XY plane is the Z-axis, pointing to the direction indicated by the thumb.

Due to the first joint of the thumb (the first joint near the fingertip, the joints and knuckles are counted from the fingertips later), they can only be rotated in one direction, that is, the Y-axis is up and down. When the thumb is straight, the fingertip is pointed, and the Z axis of the ring is pointed in the same direction. The movement of the first joint of the thumb is also within the field of view of the camera, and is limited to the Y-axis direction.

Therefore, the relative positional relationship between the thumbtip and the other four fingers when the thumb is straight, and the relative positional relationship between the thumb and the other four fingers on the thumb are completely corresponding, and the change caused by the bending of the thumbtip is also in the field of view of the camera. Within the range, it can be corrected by the camera.

The XY axis can be used to scan a finger through an optical camera (visible or infrared), electromagnetic wave radar, acoustic sensor, lidar, ammeter, ultrasonic sensor or surface wave radar. In the description of the present invention, an optical camera is taken as an example. As the thumb moves, the finger image in the field of view of the camera moves accordingly. By recognizing the contour of the finger in the picture and the wrinkles of the joint, it can be judged that the position of the knuckles and joints of each finger in the picture is determined. The knuckles and joints are continuously tracked to determine the relative position and relative motion of the thumb and other fingers in both the X and Y directions.

According to one embodiment of the invention, the relative position is combined to determine whether the relative motion is a slip or a tap.

It is important to accurately determine the tapping of the thumb and other fingers for the key function. Pass The distance sensor can determine the distance between the thumb and other fingers. Through other sensors, you can monitor the sound and vibration of the thumb hitting other fingers, including sound waves propagating through the skin and sound waves propagating through the air. This will be described in detail below.

The thumb and four other fingers can be monitored by monitoring the relative positional relationship between the finger ring and the other four fingers on the XY plane and the Z axis through the sensor on the finger ring, and correcting the movement of the first joint of the thumb by the finger ring. The interaction between the two actions can be transformed into two directions of movement on the XY plane and movement in the Z-axis direction, for a total of three degrees of freedom.

The data of the three degrees of freedom direction action is sufficient to interact with most existing computing devices, for example, instead of a mouse, the XY direction corresponds to the mouse pointer movement, and the Z direction corresponds to a mouse click. Or instead of the touch screen, the XY direction corresponds to the finger movement, and the Z direction is used to determine whether it is a dangling movement or a touch screen movement.

At the same time, it is also possible to have a more suitable operation method for finger movements, for example, using the index finger, the middle finger, the ring finger and the little finger as a four-segment touch bar. The command is input by the contact of the thumb finger on the four fingers, specifically tapping and sliding.

2 is a schematic diagram illustrating the arrangement of virtual key positions on the remaining four fingers. The left index finger, the middle finger, the ring finger, and the little finger each have three knuckles and two joints. These positions are shown by the dotted circle in Figure 2. The ring can recognize the thumb to hit these parts, so that they can be used as a keyboard, 20 positions in the left hand (such as Figure 2), 20 positions in the right hand, forming a 40-key keyboard that can hold 26 English letters, 10 numbers and other functions. In some cases, when there is not a large number of buttons, it is also possible to switch to a position where only three knuckles of each finger are used by the software to form a keyboard with 12 keys, and a total of 24 left and right hands.

Different keys can be used for different functions.

The display device can display a virtual keyboard and a pointer representing the position of the thumb according to the relative positions of the thumb and other fingers, and assist the user to click the button.

Most people can use their thumbs to accurately tap the different positions on their fingers with their eyes closed. Therefore, unlike a fixed-size physical keyboard or a virtual keyboard on a touch screen, it is as convenient as a small hand.

These positions can be tapped by recognizing the thumb finger as a key input, and the thumb can be recognized as an input by sliding at these positions. For example: when playing a song or video, the thumb slides on the index finger to adjust the volume, the middle finger slides to adjust the time, and the ring finger slides to replace the next file. While browsing the image, swipe the index finger to zoom in and out, and slide the middle finger to replace the image. Slide between at least two fingers to achieve numerical selection or scrolling of vertical scroll bars. Slide on the little finger to achieve scrolling of the horizontal scroll bar. In addition, the three joints of the index finger, the middle finger, the ring finger, and the little finger can be corresponding to the runner, thereby implementing scroll input.

In the following, how to identify these actions will be described by way of specific embodiments.

Example 1:

A wide-angle camera is provided on the ring and a distance sensor.

The wide-angle camera has a large viewing angle to see the other four fingers in the field of view most of the time.

By recognizing the folds on the inside of the finger knuckles and the bending of the fingers, the three knuckles of each finger can be identified and divided into two joints of the three phalanx, and a total of five positions can be used as buttons.

The relative position of the thumb finger and the other four fingers on the screen photographed by the camera, as shown in FIGS. 3 and 4, can determine the movement of the thumb in the XY plane direction. FIG. 3 is an example of a screen captured by the finger position capturing unit. 4 is another example of a screen captured by the finger position capturing unit.

However, it is not easy to judge the distance between the thumb and other fingers in the Z-axis direction, and it is not easy to distinguish whether the thumb is a dangling movement (for example, can be a meaningless gesture) or a contact with other finger movements (for example, a gesture of sliding or tapping).

Figures 3 and 4 simulate the picture of the camera. Due to the wide-angle lens, the picture will be distorted.

Through distance sensors (such as ultrasound, capacitive sensing, dual camera ranging, laser ranging, etc.), monitor the distance between the finger and the index finger, the middle finger, the ring finger, and the little finger to determine the distance between the thumb and the other four fingers, ie the thumb is The displacement of the Z axis. Figure 5 is an illustration illustrating the distance from the finger ring to the remaining four fingers of the user. When the finger detects that the distance D of the front object is greater than the distance from the finger ring to the tip of the thumb, it is determined that the thumb is not likely to contact other fingers. Conversely, Figure 6 is another example illustrating the distance from the finger ring to the rest of the user's four fingers. When the ring detects that the distance of the object in front is smaller than the distance from the finger to the tip of the thumb, it is determined that the thumb is likely to be in contact with other fingers. Figure 7 is yet another example illustrating the distance from the finger ring to the remaining four fingers of the user. However, in this case, the thumb does not actually touch the other fingers, so it is necessary to judge with the camera screen.

The necessary condition for the thumb to touch other fingers is that the thumb on the picture taken by the camera is above the other fingers and connected, as shown in Figure 6, while the distance sensor detects that the distance of the front finger is small enough (this distance is based on the thumb) The belly is measured when it is directly above the other fingers, and varies from person to person.

As mentioned earlier, the processing system determines the position of the four fingers and joints based on the fingers and wrinkles in the camera screen. By tracking the movement of these fingers and joints in the picture, it is possible to determine the position directly below the thumb (usually The center of the screen of the camera is which part of the finger is the phalanx or which joint.

At the same time, due to the thumb stroke, the picture will appear fast up and down (Y direction jitter), through the implementation of the settings, the processing system can remember the speed range, amplitude range and frequency range of this jitter. It is thus distinguished from the usual movement and can be used to assist in determining the stroke of the thumb.

As shown in FIG. 3 and FIG. 4, according to the difference between the upper and lower frames, it can be judged that the thumb moves downward. When a finger is not in the picture, the processing system will locate the finger held in the picture according to the previous data to ensure that the tracking is always correct.

In this way, in combination with the determination of the tap and the tracking of the position of the finger joint, the embodiment can be monitored in real time. It is used as a command to control the input of the electronic device by measuring which part of the other finger is hit by the thumb finger and which direction the finger is moving at which speed.

Example 2:

The wide-angle camera is still set on the ring, and the camera's viewing angle is so large that most of the other four fingers can be seen in the field of view.

The relative position of the thumb finger and the other four fingers on the screen photographed by the camera, as shown in FIGS. 3 and 4, can determine the movement of the thumb in the XY plane direction.

The surface wave radar is arranged on the ring, and the radar echo when the thumb touches other fingers and the thumb are in a floating state, and the change can be made to determine whether the thumb touches other fingers or not, and the direction of the XY axis is determined. A camera or radar can be used to implement functions like a keyboard and a touchpad.

Example 3:

The relative position of the thumb finger and the other four fingers on the screen photographed by the camera, as shown in FIGS. 4 and 5, can determine the movement of the thumb in the XY plane direction.

An acoustic sensor or an ultrasonic sensor is disposed on the finger ring, and when the thumb hits other fingers, a vibration wave is generated on the surface of the skin, and the acoustic wave sensor determines that the thumb is hitting other fingers according to the analyzed skin surface vibration and airborne sound, instead of Hanging to move, due to fingerprints, thumb in other Specific sounds and skin vibrations are also produced when sliding on the finger, and acoustic or ultrasonic sensors can also monitor the vibrations to determine that the thumb is moving rather than floating.

According to the above embodiment, the principle of the information input by the present invention is basically explained. The information input device and the information input method according to the present invention will be described in detail below with specific reference to Figs. 8 and 9.

As shown in FIG. 8, the information input device 800 according to the present invention includes: a finger position capturing unit 801 which is worn on the thumb of the user for capturing the relative motion and relative position of the thumb and the remaining four fingers of the thumb; The gesture detecting unit 802 is configured to detect a gesture of the user according to the relative motion and relative position of the thumb and the remaining four fingers of the thumb captured by the finger position capturing unit 801; and the information identifying unit 803 is configured to determine, according to the predetermined mapping relationship, The gesture detected by the gesture detecting unit 802 is recognized as input information.

In a preferred embodiment of the present invention, the finger position capturing unit 801, the gesture detecting unit 802, and the information identifying unit 803 may be integrated together, and the outer shape is a ring shape, which is placed on the thumb of the user. Shown in 1.

In addition, the finger position capturing unit 801, the gesture detecting unit 802, and the information identifying unit 803 may also be respectively placed at different positions, and connected by a cable or a wireless signal. For example, only the finger position capturing unit 801 is placed on the finger ring and placed over the user's thumb.

According to the present invention, the finger position capturing unit 801 includes one or more of the following sensors: an optical camera, an electromagnetic wave radar, an acoustic sensor, a laser radar, an ultrasonic sensor, a surface wave radar, and an ammeter. According to a preferred embodiment of the invention, the finger position capture unit 801 is an imaging unit, for example implemented with an optical camera. However, those skilled in the art should understand that the finger position capturing unit 801 can also be implemented by other sensors. For example, one or more of electromagnetic wave radar, acoustic sensor, laser radar, ultrasonic sensor, surface wave radar, and ammeter can accurately capture the relative motion and relative position of the thumb and the remaining four fingers of the thumb. Information input.

Further, the present invention may further include a sensor such as a gyroscope or the like that detects the movement of the entire hand (for example, a speed sensor or an acceleration sensor). In this way, when the gesture detecting unit 802 detects the gesture of the user, it not only according to the relative motion and relative position of the thumb and the remaining four fingers of the thumb captured by the finger position capturing unit 801, but also according to the wide range of the entire hand. The movement. For example, the user's gesture may be a slight movement of the finger while moving the palm of the hand. The gesture detecting unit 802 of the present invention also detects such a user gesture in which the overall movement of the hand is combined with the finger motion.

According to an embodiment of the invention, the relative movement of the thumb and the remaining four fingers of the thumb may comprise at least one of a slip and a tap.

As mentioned in the foregoing, the dangling movement of the thumb can be considered a meaningless gesture, and the thumb can be a swipe or tap gesture if it touches other fingers. It will be understood by those skilled in the art that although in the particular embodiment of the invention, the dangling movement of the thumb can be considered a meaningless gesture, the present invention does not exclude the dangling movement of the thumb in certain situations or in certain embodiments. It is meaningful that such a situation is also included in the scope of the present invention.

When the relative motion of the thumb and the remaining four fingers is sliding, the gesture detecting unit 802 respectively slides the thumb of the thumb along each finger of the remaining four fingers and between any two fingers of the remaining four fingers. The slip detection is a corresponding gesture, and the information recognition unit 803 separately recognizes the gesture as the corresponding input information based on a predetermined mapping relationship. For example, as described above, when playing a song or video, the thumb slides along the index finger to adjust the volume, slides along the middle finger to adjust the time, and slides along the ring finger to replace the next media file. While browsing the image, swipe along the index finger to zoom in and out, and slide along the middle finger to change the image. In addition, sliding between at least two fingers to achieve numerical or content selection (eg, scrolling when entering the year, month, date, or scrolling when selecting an option) or vertical scrolling. Slide on the little finger to achieve scrolling of the horizontal scroll bar.

Although in the above, the sliding is described as sliding between at least two fingers, it will be understood by those skilled in the art that moving in the Y direction on one of the fingers can also be considered as sliding. The manner in which the slip is recognized can be varied, and the description in the embodiments of the present invention does not affect The scope of the invention. In other words, it is also within the scope of the present invention to recognize the movement in the Y direction on one finger as slip. Further description will be made below for sliding on a finger.

When the relative motion of the thumb and the remaining four fingers is a tap, the gesture detecting unit 802 detects the taps of the thumb of the thumb on the respective joints or knuckles of each of the remaining four fingers as corresponding The gesture, and the information recognition unit 803 separately identifies the gesture as the corresponding input information based on the predetermined mapping relationship. As shown in FIG. 2, multiple keys can be implemented on four fingers of one hand, and more keys can be realized by both hands, thereby realizing the configuration of the QWERT full keyboard. Of course, in order for the user to input accurately, the arrangement of the keys can be less tight, thereby avoiding the occurrence of erroneous input.

It will be understood by those skilled in the art that in addition to the above two cases, there may be slippage on each joint or knuckle of each of the remaining four fingers (as mentioned above). For example, the three joints of the index finger, the middle finger, the ring finger, and the little finger may be corresponding to the runner; therefore, sliding in the Y direction at the corresponding position means turning the wheel, thereby selecting a corresponding value according to the display on the display device or content.

In addition, the sliding may also be a clockwise or counterclockwise circle on the plane formed by the four fingers to express a certain input information.

The gesture detecting unit 802 can determine, according to one or more of the following factors, that the relative motion of the thumb and the remaining four fingers of the thumb is a sliding or tapping:

(2) the jitter of the finger;

(3) the color or expansion of the surface of the finger skin;

(4) changes in surface waves;

(5) changes in sound waves or ultrasound;

(6) changes in the surface current of the finger skin,

Each of the above factors is detected by one or more sensors.

For the contact, the distance sensor can be used to judge the thumb and the remaining four fingers. The relative distance of the meaning. After judging the formation of the contact, it can be further determined whether the relative motion is a slip or a tap.

In addition, it is also possible to directly judge whether or not a tap or a slip is formed without judging the contact.

The method of determining whether a tap or slide is formed may include that the finger may be shaken when a tap or slide occurs, and such jitter may be captured by a finger position capturing unit 801 such as a camera or other sensor.

Further, as described in Embodiments 2 and 3, a surface wave radar and an acoustic wave or ultrasonic sensor may be used to detect a change in surface waves or a change in sound waves or ultrasonic waves on a finger, thereby judging whether or not there is a tap or a slip.

In addition to the detection methods mentioned in the above embodiments, it can also be judged by the color or expansion change of the finger image (for example, by a camera), the change of the surface current of the finger skin (for example, by a general or special galvanometer). Whether there is a tap or slide.

These detection and determination methods can be implemented using one or more sensors. These sensors may all be integrated on the finger ring, ie integrated with the finger position capture unit 801, or are themselves the sensors to which the finger position capture unit 801 belongs.

Figure 9 is a flow chart of an information input method in accordance with the present invention. As shown in FIG. 9, the information input method 900 according to the present invention begins in step 901, in which the relative motion and relative position of the thumb and the remaining four fingers of the thumb are captured by the finger position worn by the finger on the user's thumb. Capture.

Next, in step 903, the user's gesture is detected based on the relative motion and relative position of the thumb and the remaining four fingers of the thumb captured by the finger position capturing unit.

At step 905, the detected gesture is identified as input information based on a predetermined mapping relationship. Method 900 then ends.

As described above, the information input device according to the present invention may be part of an electronic device (e.g., a computing device). Figure 10 is a schematic block diagram of an electronic device including an information input device in accordance with the present invention.

As shown in FIG. 10, an electronic device 1000 according to the present invention includes: an information input device 800 as shown in FIG. 8; an information processing device 1010 for receiving input information from the information input device 800, and receiving the received information. The input information is processed to input corresponding characters or execute corresponding commands on the electronic device 1000; the display device 1020 is configured to display corresponding characters or corresponding commands according to the processing result of the information processing device 1010.

The connection between the information input device 800, the information processing device 1010, and the display device 1020 may be through a cable or a wireless signal. For example, the information input device 800 may be disposed as a finger ring on the thumb of the user; and the information processing device 1010 may be disposed on the wristband or on the smart phone (ie, the electronic device 1000), and through the wire or wirelessly through the information input device 800. The signals are connected; the display device 1020 can also be disposed on a wristband or a wristwatch or a smart phone, can be integrated with the information processing device 1010, or can be connected by wires or by wireless signals.

According to the present invention, on the one hand, the user can view on the display device 1020 whether the information input by the information input device 800 is accurate; on the other hand, the user can input under the guidance of the display device 1020, thereby completing more accurate and complicated. And comprehensive input.

The following summarizes several important features of the invention:

1. The finger position capturing unit (formed as a finger ring) is worn on the user's thumb. The purpose of this is to make the various sensors closer to the finger, thereby more accurately detecting the relative position and relative motion between the fingers. In particular, the optical camera is worn on the user's thumb to create a unique viewing angle that allows for better input using the plane formed by the remaining four fingers. Moreover, the way of forming the ring is very simple and does not impose an additional burden on the user.

2, using the four-finger knuckles and joints, can form different key positions, thus meeting the full keyboard, The need for multi-character, high-accuracy input. For the QWERT requirements, the full keyboard can be implemented with both hands; the need to reduce the erroneous input rate can be achieved by reducing the tightness of the four-finger key placement.

3. Using optical camera, surface wave radar, sonic radar and other means to detect the jitter on the finger, thereby judging the gesture of tapping or sliding between the fingers.

4. Using the detection signals of various sensors, the relative motion and relative position between the thumb and the remaining four fingers are combined to identify various gestures, and finally converted into different input information.

5. In addition to the above-described sensor for detecting the relative motion and relative position between the finger pad of the thumb and the remaining four fingers, the present invention may further include a sensor such as a gyroscope or the like that detects the movement of the entire hand (for example, a speed sensor or an acceleration sensor). ). In this way, when detecting the user's gesture, not only the relative motion and relative position of the thumb and the remaining four fingers but also the wide range of movement of the entire hand can be used. For example, the user's gesture may be a slight movement of the finger while moving the palm of the hand. Those skilled in the art will appreciate that it is within the scope of the invention to detect such user gestures in which the overall movement of the hand is combined with the action of the fingers.

In addition to the above description, reference may also be made to the following supplementary notes.

Supplementary Note 1: The present invention claims a finger position detecting device which is a ring suitable for wearing on a thumb, the device comprising a processor, a memory, a sensor and a transmitter for the memory The storage processor executes instructions for generating a signal to be transmitted according to the finger position signal detected by the sensor when the processor executes the instruction, and outputting the signal to be transmitted by the transmitter.

Supplementary note 2: The finger position detecting device according to supplementary note 1, wherein the processor is configured to determine a positional relationship between the thumb and at least one other finger according to the finger position signal detected by the sensor, and according to the position The relationship generates the signal to be transmitted.

Supplementary Note 3: The device of Supplementary Note 1 or 2, wherein the sensor comprises a sensor for monitoring the relative position of the thumb to at least one other finger.

Supplementary note 4: The device according to supplementary note 3, wherein the sensor for monitoring the relative position of the thumb and the at least one other finger comprises an optical camera, an electromagnetic wave radar, an acoustic sensor, a laser radar, a sonar, a surface wave radar At least one of them.

A device according to supplementary note 3, wherein the sensor further comprises a sensor for monitoring the thumb to strike the at least one other finger.

A device according to supplementary note 5, wherein the sensor for monitoring the thumb tapping the at least one other finger comprises an acoustic sensor.

Supplementary note: The device of claim 3, wherein the sensor further comprises a sensor for monitoring whether the thumb is suspended or in contact with other fingers.

Supplementary Note 8: The device according to Supplementary Note 5, wherein the sensor for monitoring whether the thumb is suspended or in contact with other fingers comprises a surface wave radar or an acoustic wave sensor.

Supplementary note 9: The method of supplementary note 2, wherein the memory is further used for storing And storing, by the processor, a virtual button corresponding to the location relationship according to the location relationship and a mapping relationship between the location relationship and the virtual button, and corresponding to the location relationship according to the location relationship The virtual button generates the signal to be transmitted.

Supplementary Note 10: The present invention also claims an information input method for recognizing a positional relationship between a thumb and at least one other finger by a finger-shaped finger position detecting device suitable for wearing on a thumb, and determining according to the positional relationship The information entered.

Supplementary Note 11: The method according to supplementary note 10, further comprising

Setting a mapping relationship between the location relationship and a virtual button;

Storing the mapping relationship;

The determining the input information according to the location relationship includes: determining a virtual button corresponding to the location relationship according to the location relationship and the mapping relationship.

The method of supplementary note 11, wherein the mapping relationship between the positional relationship and the virtual button is set to: the index finger, the middle finger, the ring finger, and the little finger are corresponding to the four-segment touch bar. The index finger, the middle finger, the ring finger, and the little finger each have three joints and two joints, and they are corresponding to five key positions. The three joints of the index finger, middle finger, ring finger and little finger correspond to the runner.

The method of supplementary note 11, wherein the recognizing the positional relationship of the thumb with the at least one other finger by the finger-shaped finger position detecting means adapted for wearing on the thumb comprises: detecting the finger position signal And determining a positional relationship between the thumb and at least one other finger according to the finger position signal.

The method of supplementary note 13, wherein the detecting the finger position signal comprises: collecting an image of the finger through the optical camera, identifying and tracking the position of the finger and the joint in the image, thereby determining the positional relationship between the thumb and the other finger .

Various embodiments and implementations of the invention have been described above. However, the spirit and scope of the present invention are not limited thereto. Those skilled in the art will be able to make further applications in accordance with the teachings of the present invention, and such applications are within the scope of the present invention.

Claims

An information input device includes:

a finger position capturing unit that is worn on the thumb of the user for capturing the relative motion and relative position of the thumb and the remaining four fingers of the thumb;

a gesture detecting unit, configured to detect a gesture of the user according to the relative motion and relative position of the finger pad of the thumb captured by the finger position capturing unit and the remaining four fingers;

The information identifying unit is configured to recognize the gesture detected by the gesture detecting unit as the input information based on the predetermined mapping relationship.
The information input device according to claim 1, wherein said finger position capturing unit, said gesture detecting unit, and said information recognizing unit are integrated, and the outer shape is a ring shape and is fitted over the thumb of the user.
The information input device according to claim 1, wherein said finger position capturing unit, said gesture detecting unit, and said information identifying unit are respectively placed at different positions, and are connected by a cable or a wireless signal.
The information input device according to claim 1, wherein said finger position capturing unit comprises one or more of the following: an optical camera, an electromagnetic wave radar, an acoustic sensor, a laser radar, an ultrasonic sensor, a surface wave radar, an ammeter.
The information input device according to claim 1, wherein the relative movement of the thumb and the remaining four fingers of the thumb includes at least one of a sliding and a tap.
The information input device according to claim 5, wherein when the relative motion of the finger pad and the remaining four fingers is sliding, the gesture detecting unit respectively slides the thumb of the thumb along each finger of the remaining four fingers And the sliding detection between any two fingers of the remaining four fingers is a corresponding gesture, and the information recognition unit respectively identifies the gesture as the corresponding input information based on the predetermined mapping relationship.
The information input device according to claim 5, wherein when the relative motion of the thumb and the remaining four fingers is a tap, the gesture detecting unit respectively places the thumb of the thumb on each of the remaining four fingers The taps on the respective joints or knuckles are detected as corresponding gestures, and the information recognition unit respectively identifies the gestures as corresponding input information based on a predetermined mapping relationship.
The information input device according to claim 5, wherein the gesture detecting unit determines that the relative motion of the thumb and the remaining four fingers of the thumb is a sliding or tapping according to one or more of the following factors:

(1) the relative distance between the thumb of the thumb and any one of the remaining four fingers;

(2) the jitter of the finger;

(3) the color or expansion of the surface of the finger skin;

(4) changes in surface waves;

(5) changes in sound waves or ultrasound;

(6) changes in the surface current of the finger skin,

Each of the above factors is detected by one or more sensors.
An information input method includes:

Capturing the relative motion and relative position of the thumb of the thumb and the remaining four fingers by the finger position capturing unit worn on the thumb of the user;

Detecting a user's gesture according to the relative motion and relative position of the thumb of the thumb captured by the finger position capturing unit and the remaining four fingers;

The detected gesture is identified as input information based on a predetermined mapping relationship.
An electronic device comprising:

The information input device according to claim 1;

An information processing device, configured to receive input information from the information input device, and process the received input information to input a corresponding character on the electronic device or execute a corresponding command;

The display device is configured to display a corresponding character or a corresponding command according to the processing result of the information processing device.