WO2017215375A1 - Dispositif et procédé d'entrée d'informations - Google Patents

Dispositif et procédé d'entrée d'informations Download PDF

Info

Publication number
WO2017215375A1
WO2017215375A1 PCT/CN2017/083775 CN2017083775W WO2017215375A1 WO 2017215375 A1 WO2017215375 A1 WO 2017215375A1 CN 2017083775 W CN2017083775 W CN 2017083775W WO 2017215375 A1 WO2017215375 A1 WO 2017215375A1
Authority
WO
WIPO (PCT)
Prior art keywords
thumb
finger
fingers
information
remaining
Prior art date
Application number
PCT/CN2017/083775
Other languages
English (en)
Chinese (zh)
Inventor
齐向前
Original Assignee
齐向前
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 齐向前 filed Critical 齐向前
Publication of WO2017215375A1 publication Critical patent/WO2017215375A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures

Definitions

  • the present invention relates to an electronic device, and more particularly to an information input device and method of an electronic device.
  • the current voice input technology is still in the development stage, and its recognition result is still far from the effect that people really need, and in some occasions, voice input is not convenient.
  • the current virtual keyboard technology displays the keyboard on the display of the electronic device. Since the display cannot be too large, the displayed virtual keyboard has no buttons, and the user can easily press the wrong button.
  • some virtual keyboards are not full-letter QWERT keyboards, but use one key to represent two or more input candidate characters, such input makes the user's operation very cumbersome, and also causes errors due to space constraints.
  • an information input device comprising: a finger position capturing unit that is worn on a thumb of a user for capturing relative motion and relative position of a thumb of the thumb and the remaining four fingers; a gesture detecting unit for capturing the thumb according to the finger position capturing unit The relative movement and relative position of the finger pad and the remaining four fingers are used to detect the gesture of the user; the information recognition unit is configured to recognize the gesture detected by the gesture detecting unit as the input information based on the predetermined mapping relationship.
  • the finger position capturing unit, the gesture detecting unit and the information identifying unit are integrated, and the outer shape is a ring shape and is placed on the thumb of the user.
  • the finger position capturing unit, the gesture detecting unit, and the information identifying unit are respectively placed at different positions, and connected by a cable or a wireless signal.
  • the finger position capturing unit includes one or more of the following sensors: an optical camera, an electromagnetic wave radar, an acoustic sensor, a laser radar, an ultrasonic sensor, a surface wave radar, and an ammeter.
  • the relative movement of the thumb and the remaining four fingers of the thumb includes at least one of sliding and tapping.
  • the gesture detecting unit When the relative motion of the thumb and the remaining four fingers is sliding, the gesture detecting unit respectively slides the thumb of the thumb along each of the remaining four fingers and the sliding between any two fingers of the remaining four fingers.
  • the gesture is detected as a corresponding gesture, and the information recognition unit respectively identifies the gesture as the corresponding input information based on the predetermined mapping relationship.
  • the gesture detecting unit detects the tapping of the thumb of the thumb on each joint or knuckle of each finger of the remaining four fingers as corresponding Gestures, and the information recognition unit respectively identifies the gestures as corresponding input information based on a predetermined mapping relationship.
  • the gesture detecting unit determines that the relative motion of the thumb and the remaining four fingers of the thumb is a sliding or tapping according to one or more of the following factors:
  • Each of the above factors is detected by one or more sensors.
  • an information input method comprising: capturing, by a finger position capturing unit worn on a thumb of a user, a relative motion and a relative position of a thumb and a remaining four fingers of the thumb; The relative motion and relative position of the thumb of the thumb captured by the capture unit and the remaining four fingers are used to detect the gesture of the user; the detected gesture is recognized as input information based on a predetermined mapping relationship.
  • an electronic device comprising: the information input device according to the first aspect of the invention; the information processing device for receiving the input information from the information input device, and receiving the information The input information is processed to input a corresponding character on the electronic device or to execute a corresponding command; and display means for displaying a corresponding character or a corresponding command according to the processing result of the information processing device.
  • a user inputs using a finger of the same hand in contact with each other.
  • This type of input takes advantage of the person's ability to perceive his own posture.
  • the user usually can touch the other fingertips with the thumb even without the need for additional training. Therefore, with a little practice, the input speed with this input method can exceed the touch screen and keyboard input methods.
  • the techniques of the present invention are particularly well suited for situations where shaking or inconvenience is placed in the line of sight.
  • the user is enabled to perform complicated and comprehensive information input with simple and convenient gestures.
  • FIG. 1 is a schematic diagram illustrating a user wearing an information input device according to the present invention.
  • FIG. 2 is a schematic diagram illustrating the arrangement of virtual key positions on the remaining four fingers.
  • FIG. 3 is an example of a screen captured by the finger position capturing unit.
  • Figure 5 is an illustration illustrating the distance from the finger ring to the remaining four fingers of the user.
  • Figure 6 is another example illustrating the distance from the finger ring to the remaining four fingers of the user.
  • Figure 7 is yet another example illustrating the distance from the finger ring to the remaining four fingers of the user.
  • Figure 8 is a schematic block diagram of an information input device in accordance with the present invention.
  • FIG. 9 is a flow chart of an information input method in accordance with the present invention.
  • Figure 10 is a schematic block diagram of an electronic device including an information input device in accordance with the present invention.
  • a sensor-equipped finger ring on the thumb to monitor the movement of a plurality of fingers, mainly the interaction between the thumb and the other four fingers, and after being recognized by the system, sent to other devices as a control command.
  • FIG. 1 is a schematic diagram illustrating a user wearing an information input device according to the present invention.
  • the shape of the information input device is a ring shape and can be placed on the thumb of the user.
  • the finger ring of FIG. 1 is provided with a finger position capturing unit such as an optical camera, and other sensors, switches, and the like may be provided.
  • the power supply, data processing system, display system, and signal transmission system required for gesture recognition can be integrated in the ring or in a wristband or watch.
  • the cable or wireless signal is connected to the finger ring to reduce the volume of the ring. And weight.
  • the ring (and its associated wristband or watch) can be integrated with other functions, such as a smartphone, or connected to an electronic device via a cable or wireless signal.
  • the finger is worn on the second knuckle of the thumb finger, and the camera is oriented toward the fingertip, as shown in FIG.
  • the invention mainly monitors the mutual movement of the thumb of the same hand and the other four fingers. Most of these actions occur in the case of a virtual hand fist. At this time, the index finger, the middle finger, the ring finger and the little finger form a curved surface, and the face is set as a hand.
  • the XY plane of the coordinate system with the four fingers pointing to the X axis and the upward pointing to the Y axis.
  • the thumb in the relaxed state is in a posture pointing to the XY plane, and the direction perpendicular to the XY plane is the Z-axis, pointing to the direction indicated by the thumb.
  • the joints and knuckles are counted from the fingertips later
  • they can only be rotated in one direction, that is, the Y-axis is up and down.
  • the thumb is straight, the fingertip is pointed, and the Z axis of the ring is pointed in the same direction.
  • the movement of the first joint of the thumb is also within the field of view of the camera, and is limited to the Y-axis direction.
  • the relative positional relationship between the thumbtip and the other four fingers when the thumb is straight, and the relative positional relationship between the thumb and the other four fingers on the thumb are completely corresponding, and the change caused by the bending of the thumbtip is also in the field of view of the camera. Within the range, it can be corrected by the camera.
  • the XY axis can be used to scan a finger through an optical camera (visible or infrared), electromagnetic wave radar, acoustic sensor, lidar, ammeter, ultrasonic sensor or surface wave radar.
  • an optical camera is taken as an example.
  • the thumb moves, the finger image in the field of view of the camera moves accordingly.
  • the knuckles and joints are continuously tracked to determine the relative position and relative motion of the thumb and other fingers in both the X and Y directions.
  • the relative position is combined to determine whether the relative motion is a slip or a tap.
  • the distance sensor can determine the distance between the thumb and other fingers. Through other sensors, you can monitor the sound and vibration of the thumb hitting other fingers, including sound waves propagating through the skin and sound waves propagating through the air. This will be described in detail below.
  • the thumb and four other fingers can be monitored by monitoring the relative positional relationship between the finger ring and the other four fingers on the XY plane and the Z axis through the sensor on the finger ring, and correcting the movement of the first joint of the thumb by the finger ring.
  • the interaction between the two actions can be transformed into two directions of movement on the XY plane and movement in the Z-axis direction, for a total of three degrees of freedom.
  • the data of the three degrees of freedom direction action is sufficient to interact with most existing computing devices, for example, instead of a mouse, the XY direction corresponds to the mouse pointer movement, and the Z direction corresponds to a mouse click. Or instead of the touch screen, the XY direction corresponds to the finger movement, and the Z direction is used to determine whether it is a dangling movement or a touch screen movement.
  • the command is input by the contact of the thumb finger on the four fingers, specifically tapping and sliding.
  • FIG. 2 is a schematic diagram illustrating the arrangement of virtual key positions on the remaining four fingers.
  • the left index finger, the middle finger, the ring finger, and the little finger each have three knuckles and two joints. These positions are shown by the dotted circle in Figure 2.
  • the ring can recognize the thumb to hit these parts, so that they can be used as a keyboard, 20 positions in the left hand (such as Figure 2), 20 positions in the right hand, forming a 40-key keyboard that can hold 26 English letters, 10 numbers and other functions.
  • the display device can display a virtual keyboard and a pointer representing the position of the thumb according to the relative positions of the thumb and other fingers, and assist the user to click the button.
  • These positions can be tapped by recognizing the thumb finger as a key input, and the thumb can be recognized as an input by sliding at these positions. For example: when playing a song or video, the thumb slides on the index finger to adjust the volume, the middle finger slides to adjust the time, and the ring finger slides to replace the next file. While browsing the image, swipe the index finger to zoom in and out, and slide the middle finger to replace the image. Slide between at least two fingers to achieve numerical selection or scrolling of vertical scroll bars. Slide on the little finger to achieve scrolling of the horizontal scroll bar. In addition, the three joints of the index finger, the middle finger, the ring finger, and the little finger can be corresponding to the runner, thereby implementing scroll input.
  • a wide-angle camera is provided on the ring and a distance sensor.
  • the wide-angle camera has a large viewing angle to see the other four fingers in the field of view most of the time.
  • the three knuckles of each finger can be identified and divided into two joints of the three phalanx, and a total of five positions can be used as buttons.
  • FIG. 3 is an example of a screen captured by the finger position capturing unit.
  • 4 is another example of a screen captured by the finger position capturing unit.
  • the thumb is a dangling movement (for example, can be a meaningless gesture) or a contact with other finger movements (for example, a gesture of sliding or tapping).
  • Figures 3 and 4 simulate the picture of the camera. Due to the wide-angle lens, the picture will be distorted.
  • FIG. 5 is an illustration illustrating the distance from the finger ring to the remaining four fingers of the user.
  • Figure 6 is another example illustrating the distance from the finger ring to the rest of the user's four fingers.
  • Figure 7 is yet another example illustrating the distance from the finger ring to the remaining four fingers of the user. However, in this case, the thumb does not actually touch the other fingers, so it is necessary to judge with the camera screen.
  • the necessary condition for the thumb to touch other fingers is that the thumb on the picture taken by the camera is above the other fingers and connected, as shown in Figure 6, while the distance sensor detects that the distance of the front finger is small enough (this distance is based on the thumb) The belly is measured when it is directly above the other fingers, and varies from person to person.
  • the processing system determines the position of the four fingers and joints based on the fingers and wrinkles in the camera screen. By tracking the movement of these fingers and joints in the picture, it is possible to determine the position directly below the thumb (usually The center of the screen of the camera is which part of the finger is the phalanx or which joint.
  • the processing system can remember the speed range, amplitude range and frequency range of this jitter. It is thus distinguished from the usual movement and can be used to assist in determining the stroke of the thumb.
  • the processing system will locate the finger held in the picture according to the previous data to ensure that the tracking is always correct.
  • the embodiment in combination with the determination of the tap and the tracking of the position of the finger joint, the embodiment can be monitored in real time. It is used as a command to control the input of the electronic device by measuring which part of the other finger is hit by the thumb finger and which direction the finger is moving at which speed.
  • the wide-angle camera is still set on the ring, and the camera's viewing angle is so large that most of the other four fingers can be seen in the field of view.
  • the three knuckles of each finger can be identified and divided into two joints of the three phalanx, and a total of five positions can be used as buttons.
  • the relative position of the thumb finger and the other four fingers on the screen photographed by the camera, as shown in FIGS. 3 and 4, can determine the movement of the thumb in the XY plane direction.
  • the surface wave radar is arranged on the ring, and the radar echo when the thumb touches other fingers and the thumb are in a floating state, and the change can be made to determine whether the thumb touches other fingers or not, and the direction of the XY axis is determined.
  • a camera or radar can be used to implement functions like a keyboard and a touchpad.
  • the wide-angle camera is still set on the ring, and the camera's viewing angle is so large that most of the other four fingers can be seen in the field of view.
  • the three knuckles of each finger can be identified and divided into two joints of the three phalanx, and a total of five positions can be used as buttons.
  • the relative position of the thumb finger and the other four fingers on the screen photographed by the camera, as shown in FIGS. 4 and 5, can determine the movement of the thumb in the XY plane direction.
  • An acoustic sensor or an ultrasonic sensor is disposed on the finger ring, and when the thumb hits other fingers, a vibration wave is generated on the surface of the skin, and the acoustic wave sensor determines that the thumb is hitting other fingers according to the analyzed skin surface vibration and airborne sound, instead of Hanging to move, due to fingerprints, thumb in other Specific sounds and skin vibrations are also produced when sliding on the finger, and acoustic or ultrasonic sensors can also monitor the vibrations to determine that the thumb is moving rather than floating.
  • Figure 8 is a schematic block diagram of an information input device in accordance with the present invention.
  • the information input device 800 includes: a finger position capturing unit 801 which is worn on the thumb of the user for capturing the relative motion and relative position of the thumb and the remaining four fingers of the thumb;
  • the gesture detecting unit 802 is configured to detect a gesture of the user according to the relative motion and relative position of the thumb and the remaining four fingers of the thumb captured by the finger position capturing unit 801; and the information identifying unit 803 is configured to determine, according to the predetermined mapping relationship, The gesture detected by the gesture detecting unit 802 is recognized as input information.
  • the finger position capturing unit 801, the gesture detecting unit 802, and the information identifying unit 803 may be integrated together, and the outer shape is a ring shape, which is placed on the thumb of the user. Shown in 1.
  • the finger position capturing unit 801, the gesture detecting unit 802, and the information identifying unit 803 may also be respectively placed at different positions, and connected by a cable or a wireless signal.
  • the finger position capturing unit 801 is placed on the finger ring and placed over the user's thumb.
  • the finger position capturing unit 801 includes one or more of the following sensors: an optical camera, an electromagnetic wave radar, an acoustic sensor, a laser radar, an ultrasonic sensor, a surface wave radar, and an ammeter.
  • the finger position capture unit 801 is an imaging unit, for example implemented with an optical camera.
  • the finger position capturing unit 801 can also be implemented by other sensors.
  • electromagnetic wave radar, acoustic sensor, laser radar, ultrasonic sensor, surface wave radar, and ammeter can accurately capture the relative motion and relative position of the thumb and the remaining four fingers of the thumb. Information input.
  • the present invention may further include a sensor such as a gyroscope or the like that detects the movement of the entire hand (for example, a speed sensor or an acceleration sensor).
  • a sensor such as a gyroscope or the like that detects the movement of the entire hand (for example, a speed sensor or an acceleration sensor).
  • the gesture detecting unit 802 detects the gesture of the user, it not only according to the relative motion and relative position of the thumb and the remaining four fingers of the thumb captured by the finger position capturing unit 801, but also according to the wide range of the entire hand.
  • the movement For example, the user's gesture may be a slight movement of the finger while moving the palm of the hand.
  • the gesture detecting unit 802 of the present invention also detects such a user gesture in which the overall movement of the hand is combined with the finger motion.
  • the relative movement of the thumb and the remaining four fingers of the thumb may comprise at least one of a slip and a tap.
  • the dangling movement of the thumb can be considered a meaningless gesture, and the thumb can be a swipe or tap gesture if it touches other fingers. It will be understood by those skilled in the art that although in the particular embodiment of the invention, the dangling movement of the thumb can be considered a meaningless gesture, the present invention does not exclude the dangling movement of the thumb in certain situations or in certain embodiments. It is meaningful that such a situation is also included in the scope of the present invention.
  • the gesture detecting unit 802 respectively slides the thumb of the thumb along each finger of the remaining four fingers and between any two fingers of the remaining four fingers.
  • the slip detection is a corresponding gesture
  • the information recognition unit 803 separately recognizes the gesture as the corresponding input information based on a predetermined mapping relationship. For example, as described above, when playing a song or video, the thumb slides along the index finger to adjust the volume, slides along the middle finger to adjust the time, and slides along the ring finger to replace the next media file. While browsing the image, swipe along the index finger to zoom in and out, and slide along the middle finger to change the image. In addition, sliding between at least two fingers to achieve numerical or content selection (eg, scrolling when entering the year, month, date, or scrolling when selecting an option) or vertical scrolling. Slide on the little finger to achieve scrolling of the horizontal scroll bar.
  • numerical or content selection eg, scrolling when entering the year, month, date, or scrolling when selecting an option
  • sliding is described as sliding between at least two fingers, it will be understood by those skilled in the art that moving in the Y direction on one of the fingers can also be considered as sliding.
  • the manner in which the slip is recognized can be varied, and the description in the embodiments of the present invention does not affect The scope of the invention. In other words, it is also within the scope of the present invention to recognize the movement in the Y direction on one finger as slip. Further description will be made below for sliding on a finger.
  • the gesture detecting unit 802 detects the taps of the thumb of the thumb on the respective joints or knuckles of each of the remaining four fingers as corresponding The gesture, and the information recognition unit 803 separately identifies the gesture as the corresponding input information based on the predetermined mapping relationship.
  • multiple keys can be implemented on four fingers of one hand, and more keys can be realized by both hands, thereby realizing the configuration of the QWERT full keyboard.
  • the arrangement of the keys can be less tight, thereby avoiding the occurrence of erroneous input.
  • each joint or knuckle of each of the remaining four fingers may be corresponding to the runner; therefore, sliding in the Y direction at the corresponding position means turning the wheel, thereby selecting a corresponding value according to the display on the display device or content.
  • the sliding may also be a clockwise or counterclockwise circle on the plane formed by the four fingers to express a certain input information.
  • the gesture detecting unit 802 can determine, according to one or more of the following factors, that the relative motion of the thumb and the remaining four fingers of the thumb is a sliding or tapping:
  • Each of the above factors is detected by one or more sensors.
  • the distance sensor can be used to judge the thumb and the remaining four fingers. The relative distance of the meaning. After judging the formation of the contact, it can be further determined whether the relative motion is a slip or a tap.
  • the method of determining whether a tap or slide is formed may include that the finger may be shaken when a tap or slide occurs, and such jitter may be captured by a finger position capturing unit 801 such as a camera or other sensor.
  • a surface wave radar and an acoustic wave or ultrasonic sensor may be used to detect a change in surface waves or a change in sound waves or ultrasonic waves on a finger, thereby judging whether or not there is a tap or a slip.
  • the detection methods mentioned in the above embodiments it can also be judged by the color or expansion change of the finger image (for example, by a camera), the change of the surface current of the finger skin (for example, by a general or special galvanometer). Whether there is a tap or slide.
  • These detection and determination methods can be implemented using one or more sensors. These sensors may all be integrated on the finger ring, ie integrated with the finger position capture unit 801, or are themselves the sensors to which the finger position capture unit 801 belongs.
  • Figure 9 is a flow chart of an information input method in accordance with the present invention.
  • the information input method 900 begins in step 901, in which the relative motion and relative position of the thumb and the remaining four fingers of the thumb are captured by the finger position worn by the finger on the user's thumb. Capture.
  • step 903 the user's gesture is detected based on the relative motion and relative position of the thumb and the remaining four fingers of the thumb captured by the finger position capturing unit.
  • the detected gesture is identified as input information based on a predetermined mapping relationship.
  • Method 900 then ends.
  • the information input device may be part of an electronic device (e.g., a computing device).
  • Figure 10 is a schematic block diagram of an electronic device including an information input device in accordance with the present invention.
  • an electronic device 1000 includes: an information input device 800 as shown in FIG. 8; an information processing device 1010 for receiving input information from the information input device 800, and receiving the received information.
  • the input information is processed to input corresponding characters or execute corresponding commands on the electronic device 1000;
  • the display device 1020 is configured to display corresponding characters or corresponding commands according to the processing result of the information processing device 1010.
  • the connection between the information input device 800, the information processing device 1010, and the display device 1020 may be through a cable or a wireless signal.
  • the information input device 800 may be disposed as a finger ring on the thumb of the user; and the information processing device 1010 may be disposed on the wristband or on the smart phone (ie, the electronic device 1000), and through the wire or wirelessly through the information input device 800.
  • the signals are connected; the display device 1020 can also be disposed on a wristband or a wristwatch or a smart phone, can be integrated with the information processing device 1010, or can be connected by wires or by wireless signals.
  • the user can view on the display device 1020 whether the information input by the information input device 800 is accurate; on the other hand, the user can input under the guidance of the display device 1020, thereby completing more accurate and complicated. And comprehensive input.
  • the finger position capturing unit (formed as a finger ring) is worn on the user's thumb.
  • the purpose of this is to make the various sensors closer to the finger, thereby more accurately detecting the relative position and relative motion between the fingers.
  • the optical camera is worn on the user's thumb to create a unique viewing angle that allows for better input using the plane formed by the remaining four fingers.
  • the way of forming the ring is very simple and does not impose an additional burden on the user.
  • the present invention may further include a sensor such as a gyroscope or the like that detects the movement of the entire hand (for example, a speed sensor or an acceleration sensor). ).
  • a sensor such as a gyroscope or the like that detects the movement of the entire hand (for example, a speed sensor or an acceleration sensor).
  • the user's gesture may be a slight movement of the finger while moving the palm of the hand.
  • a user inputs using a finger of the same hand in contact with each other.
  • This type of input takes advantage of the person's ability to perceive his own posture.
  • the user usually can touch the other fingertips with the thumb even without the need for additional training. Therefore, with a little practice, the input speed with this input method can exceed the touch screen and keyboard input methods.
  • the techniques of the present invention are particularly well suited for situations where shaking or inconvenience is placed in the line of sight.
  • the user is enabled to perform complicated and comprehensive information input with simple and convenient gestures.
  • the present invention claims a finger position detecting device which is a ring suitable for wearing on a thumb, the device comprising a processor, a memory, a sensor and a transmitter for the memory
  • the storage processor executes instructions for generating a signal to be transmitted according to the finger position signal detected by the sensor when the processor executes the instruction, and outputting the signal to be transmitted by the transmitter.
  • Supplementary note 2 The finger position detecting device according to supplementary note 1, wherein the processor is configured to determine a positional relationship between the thumb and at least one other finger according to the finger position signal detected by the sensor, and according to the position The relationship generates the signal to be transmitted.
  • Supplementary Note 3 The device of Supplementary Note 1 or 2, wherein the sensor comprises a sensor for monitoring the relative position of the thumb to at least one other finger.
  • Supplementary note 4 The device according to supplementary note 3, wherein the sensor for monitoring the relative position of the thumb and the at least one other finger comprises an optical camera, an electromagnetic wave radar, an acoustic sensor, a laser radar, a sonar, a surface wave radar At least one of them.
  • a device according to supplementary note 3, wherein the sensor further comprises a sensor for monitoring the thumb to strike the at least one other finger.
  • a device according to supplementary note 5, wherein the sensor for monitoring the thumb tapping the at least one other finger comprises an acoustic sensor.
  • the device of claim 3 wherein the sensor further comprises a sensor for monitoring whether the thumb is suspended or in contact with other fingers.
  • Supplementary Note 8 The device according to Supplementary Note 5, wherein the sensor for monitoring whether the thumb is suspended or in contact with other fingers comprises a surface wave radar or an acoustic wave sensor.
  • Supplementary note 9 The method of supplementary note 2, wherein the memory is further used for storing And storing, by the processor, a virtual button corresponding to the location relationship according to the location relationship and a mapping relationship between the location relationship and the virtual button, and corresponding to the location relationship according to the location relationship
  • the virtual button generates the signal to be transmitted.
  • the present invention also claims an information input method for recognizing a positional relationship between a thumb and at least one other finger by a finger-shaped finger position detecting device suitable for wearing on a thumb, and determining according to the positional relationship The information entered.
  • Supplementary Note 11 The method according to supplementary note 10, further comprising
  • the determining the input information according to the location relationship includes: determining a virtual button corresponding to the location relationship according to the location relationship and the mapping relationship.
  • the mapping relationship between the positional relationship and the virtual button is set to: the index finger, the middle finger, the ring finger, and the little finger are corresponding to the four-segment touch bar.
  • the index finger, the middle finger, the ring finger, and the little finger each have three joints and two joints, and they are corresponding to five key positions.
  • the three joints of the index finger, middle finger, ring finger and little finger correspond to the runner.
  • the recognizing the positional relationship of the thumb with the at least one other finger by the finger-shaped finger position detecting means adapted for wearing on the thumb comprises: detecting the finger position signal And determining a positional relationship between the thumb and at least one other finger according to the finger position signal.
  • the detecting the finger position signal comprises: collecting an image of the finger through the optical camera, identifying and tracking the position of the finger and the joint in the image, thereby determining the positional relationship between the thumb and the other finger .

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

La présente invention concerne un dispositif d'entrée d'informations et un procédé. Le dispositif d'entrée d'informations selon la présente invention comprend : une unité de capture de position de doigt portée sur le pouce de l'utilisateur pour capturer un mouvement relatif et une position relative d'un tampon du pouce et des quatre autres doigts restants ; une unité de détection de geste pour détecter le geste de l'utilisateur sur la base du mouvement relatif et de la position relative du tampon du pouce et des quatre autres doigts restants capturés par l'unité de capture de position de doigt ; et une unité d'identification d'informations pour identifier le geste détecté par l'unité de détection de geste en tant qu'informations d'entrée sur la base d'une relation de correspondance prédéterminée. L'unité d'identification d'informations est connectée à un dispositif de traitement d'informations par l'intermédiaire d'un câble ou d'un signal sans fil de manière à transmettre les informations d'entrée identifiées au dispositif de traitement d'informations, dans le but de traiter les informations d'entrée reçues afin d'entrer un caractère correspondant ou d'exécuter une commande correspondante sur un dispositif électronique. Selon la présente invention, l'utilisateur peut effectuer une saisie d'informations compliquée et complète avec une opération de geste simple et commode.
PCT/CN2017/083775 2016-06-12 2017-05-10 Dispositif et procédé d'entrée d'informations WO2017215375A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610407561.2A CN105824431B (zh) 2016-06-12 2016-06-12 信息输入装置与方法
CN201610407561.2 2016-06-12

Publications (1)

Publication Number Publication Date
WO2017215375A1 true WO2017215375A1 (fr) 2017-12-21

Family

ID=56532057

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/083775 WO2017215375A1 (fr) 2016-06-12 2017-05-10 Dispositif et procédé d'entrée d'informations

Country Status (2)

Country Link
CN (1) CN105824431B (fr)
WO (1) WO2017215375A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110968181A (zh) * 2018-09-29 2020-04-07 深圳市掌网科技股份有限公司 一种手指弯曲程度检测装置及方法
CN111124129A (zh) * 2019-12-26 2020-05-08 何强 一种建立操作手指触元的方法
US11397468B2 (en) 2020-03-31 2022-07-26 Apple Inc. Skin-to-skin contact detection
US11397466B2 (en) 2020-03-31 2022-07-26 Apple Inc. Skin-to-skin contact detection
WO2023236052A1 (fr) * 2022-06-07 2023-12-14 北京小米移动软件有限公司 Procédé et appareil de détermination d'informations d'entrée, dispositif, et support de stockage

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105824431B (zh) * 2016-06-12 2018-12-04 齐向前 信息输入装置与方法
CN107995965A (zh) * 2016-09-29 2018-05-04 深圳市柔宇科技有限公司 控制方法、控制装置及智能穿戴设备
CN106569610A (zh) * 2016-11-09 2017-04-19 李飞洋 一种通过大拇指弯曲度检测实现电子设备输入功能的方法
US10579151B2 (en) * 2017-01-04 2020-03-03 Htc Corporation Controller for finger gesture recognition and method for recognizing finger gesture
CN108459703A (zh) * 2017-03-21 2018-08-28 周晋 基于指纹识别、运动传感的vr或ar人机交互方案和设备
GB2574786B (en) * 2017-10-12 2020-12-02 Wexler David Electronic body percussion
CN107632716B (zh) * 2017-11-07 2024-03-08 王可攀 一种输入信息处理装置及其处理输入信息的方法
CN108088437B (zh) * 2017-12-04 2021-01-19 成都思悟革科技有限公司 一种依托动作捕捉的智能辅助锻炼系统
CN108459709B (zh) * 2018-02-02 2021-06-22 河南大学 基于光学图像捕捉与处理的可穿戴式输入装置及方法
CN108415571A (zh) * 2018-03-08 2018-08-17 李飞洋 一种基于大拇指运动引起的数据分析的体感设备实现方法
RU2765237C2 (ru) * 2018-03-16 2022-01-27 Дмитрий Леонидович Раков Способ ввода информации и устройство для его осуществления
CN110442228A (zh) * 2018-05-02 2019-11-12 宏碁股份有限公司 手势输入装置
CN108873715A (zh) * 2018-07-04 2018-11-23 深圳众厉电力科技有限公司 基于手势识别的智能家居控制系统
CN109240508B (zh) * 2018-09-30 2020-01-24 清华大学 手背皮肤形变还原手指运动方法
JP2020086939A (ja) * 2018-11-26 2020-06-04 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
CN109814712B (zh) * 2019-01-09 2022-01-25 成都大学 一种基于虚拟交互装置的手势识别系统
CN109947245A (zh) * 2019-03-12 2019-06-28 合肥工业大学 用于操作腕表式设备的手指动作指令集及其生成方法
CN110377155B (zh) * 2019-07-11 2022-11-18 成都思悟革科技有限公司 一种基于用户手势的控制装置及控制指令生成方法
IL290206A (en) * 2019-07-31 2022-07-01 Thumbray Tech A wrist-worn data entry device
CN110658889A (zh) * 2019-09-23 2020-01-07 上海闻泰信息技术有限公司 可穿戴设备控制方法、装置、设备及存储介质
CN113741699A (zh) * 2021-09-15 2021-12-03 刘志超 一种基于智能戒指的手势输入设备及其系统、方法
CN114690905A (zh) * 2022-03-30 2022-07-01 歌尔股份有限公司 一种手势控制方法、系统、装置、可穿戴产品及介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103246349A (zh) * 2013-04-03 2013-08-14 汕头大学 穿戴式手指感应无线通信的输入方法及其使用该方法的装置
CN104919391A (zh) * 2012-11-24 2015-09-16 奥普迪格股份有限公司 计算接口系统
CN105824431A (zh) * 2016-06-12 2016-08-03 齐向前 信息输入装置与方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204119281U (zh) * 2013-07-25 2015-01-21 上海科斗电子科技有限公司 与手机配套的指环
CN104157116B (zh) * 2014-06-26 2017-12-12 京东方科技集团股份有限公司 智能戒指及可佩戴智能显示系统
CN104484037A (zh) * 2014-12-12 2015-04-01 三星电子（中国）研发中心 通过可穿戴设备进行智能控制的方法及该可穿戴设备
CN104503573A (zh) * 2014-12-16 2015-04-08 苏州佳世达电通有限公司 手势操作方法及手势操作装置
CN104503576A (zh) * 2014-12-22 2015-04-08 山东超越数控电子有限公司 一种基于手势识别的计算机操作方法
CN105630157A (zh) * 2015-11-27 2016-06-01 东莞酷派软件技术有限公司 控制方法及控制装置、终端和控制系统

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104919391A (zh) * 2012-11-24 2015-09-16 奥普迪格股份有限公司 计算接口系统
CN103246349A (zh) * 2013-04-03 2013-08-14 汕头大学 穿戴式手指感应无线通信的输入方法及其使用该方法的装置
CN105824431A (zh) * 2016-06-12 2016-08-03 齐向前 信息输入装置与方法

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110968181A (zh) * 2018-09-29 2020-04-07 深圳市掌网科技股份有限公司 一种手指弯曲程度检测装置及方法
CN110968181B (zh) * 2018-09-29 2023-07-18 深圳市掌网科技股份有限公司 一种手指弯曲程度检测装置及方法
CN111124129A (zh) * 2019-12-26 2020-05-08 何强 一种建立操作手指触元的方法
CN111124129B (zh) * 2019-12-26 2023-10-27 何强 一种建立操作手指触元的方法
US11397468B2 (en) 2020-03-31 2022-07-26 Apple Inc. Skin-to-skin contact detection
US11397466B2 (en) 2020-03-31 2022-07-26 Apple Inc. Skin-to-skin contact detection
US11625098B2 (en) 2020-03-31 2023-04-11 Apple Inc. Skin-to-skin contact detection
US11941175B2 (en) 2020-03-31 2024-03-26 Apple Inc. Skin-to-skin contact detection
WO2023236052A1 (fr) * 2022-06-07 2023-12-14 北京小米移动软件有限公司 Procédé et appareil de détermination d'informations d'entrée, dispositif, et support de stockage

Also Published As

Publication number Publication date
CN105824431A (zh) 2016-08-03
CN105824431B (zh) 2018-12-04

Similar Documents

Publication Publication Date Title
WO2017215375A1 (fr) Dispositif et procédé d'entrée d'informations
US11099655B2 (en) System and method for gesture based data and command input via a wearable device
US10511778B2 (en) Method and apparatus for push interaction
US11567573B2 (en) Neuromuscular text entry, writing and drawing in augmented reality systems
EP3090331B1 (fr) Systèmes avec techniques pour une commande d'interface utilisateur
JP6524661B2 (ja) 入力支援方法、入力支援プログラムおよび入力支援装置
KR100630806B1 (ko) 동작 인식 장치를 이용한 명령 입력 방법
JP5802667B2 (ja) ジェスチャ入力装置およびジェスチャ入力方法
US20100103104A1 (en) Apparatus for user interface based on wearable computing environment and method thereof
US10042438B2 (en) Systems and methods for text entry
JP5658500B2 (ja) 情報処理装置及びその制御方法
Murugappan et al. Extended multitouch: recovering touch posture and differentiating users using a depth camera
CN105159539A (zh) 可穿戴设备的触控响应方法、装置及可穿戴设备
CN104571521B (zh) 手写记录装置和手写记录方法
CN101847057A (zh) 一种触摸板获取输入信息的方法
US11886643B2 (en) Information processing apparatus and information processing method
CN107272892A (zh) 一种虚拟触控系统、方法及装置
Liang et al. DRG-Keyboard: Enabling subtle gesture typing on the fingertip with dual IMU rings
TWI536794B (zh) 具非接觸式手部控制功能之行動電話
JP2010086367A (ja) 位置情報入力装置、位置情報入力方法、プログラム、情報処理システム、及び電子装置
KR102322968B1 (ko) 사용자의 손동작에 따른 명령 입력 장치 및 이를 이용한 명령 입력 방법
KR101499044B1 (ko) 사용자의 손동작 및 음성에 기초하여 사용자가 의도한 텍스트를 취득하는 웨어러블 컴퓨터 및 사용자가 의도한 텍스트를 취득하는 방법
CN108021238A (zh) 新概念盲打键盘
KR101805111B1 (ko) 그립형 입력인터페이스 장치 및 그 방법
US20230031200A1 (en) Touchless, Gesture-Based Human Interface Device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17812486

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17812486

Country of ref document: EP

Kind code of ref document: A1