WO2015067481A1 - Wearable electronic device, electronic system, as well as associated method and computer program product - Google Patents

Wearable electronic device, electronic system, as well as associated method and computer program product Download PDF

Info

Publication number
WO2015067481A1
WO2015067481A1 PCT/EP2014/072816 EP2014072816W WO2015067481A1 WO 2015067481 A1 WO2015067481 A1 WO 2015067481A1 EP 2014072816 W EP2014072816 W EP 2014072816W WO 2015067481 A1 WO2015067481 A1 WO 2015067481A1
Authority
WO
WIPO (PCT)
Prior art keywords
wearable
hand
electronic device
thumb
carrier
Prior art date
Application number
PCT/EP2014/072816
Other languages
French (fr)
Inventor
Jozef Hubertus GELISSEN
Guido Theodorus Gerardus Volleberg
Original Assignee
Koninklijke Philips N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips N.V. filed Critical Koninklijke Philips N.V.
Publication of WO2015067481A1 publication Critical patent/WO2015067481A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014Hand-worn input/output arrangements, e.g. data gloves
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • G06F3/005Input arrangements through a video camera
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures

Definitions

  • the present invention relates to a wearable electronic device.
  • the present invention relates to a system comprising a wearable electronic device and a device that is controllable by the wearable electronic device.
  • the present invention further relates to an associated method.
  • the present invention still further relates to a computer program product.
  • Gesture control is popular for various applications like videogames or controlling hardware.
  • US20060121958 discloses a wearable mobile phone capable of detecting EMG changed by hand motion of a user and a control method of an input unit of the wearable mobile phone.
  • the wearable mobile phone includes an EMG measuring unit having a plurality of EMG measuring sensors for detecting the EMG changed by hand motion of a user.
  • the EMG measuring unit is made in a ring shape to be worn on a wrist of the user.
  • An EMG transferring unit is connected to the EMG measuring unit for transferring the EMG measured by the EMG measuring unit.
  • An EMG determining unit is mounted to one side of the EMG transferring unit 20 for receiving EMG from the EMG transferring unit to determine the hand motion and extract an input signal for the mobile phone corresponding to the hand motion.
  • a mobile phone functioning unit receives the input signal from the EMG determining unit for functioning the mobile function and has an antenna and a sound transferring device.
  • US2009/005699 discloses an input system that executes an input to an information processing apparatus depending on the hand motion of a person.
  • At least one myoelectric sensor is provided on an area between a wrist of the person and bases of a second finger to a fifth finger, and detects a myoelectric signal depending on the hand motion.
  • a standard value obtaining portion outputs a command to make the person maintain a hand in a constant posture in a state where the myoelectric sensors is worn on the hand, and obtains a value based on the myoelectric signal detected by the myoelectric sensor after the output of the command, as a standard value.
  • a calibration portion calibrates a myoelectric signal depending on the hand motion after the standard value is obtained by the standard value obtaining portion, with the standard value.
  • a wearable electronic device comprising a wearable carrier, a plurality of sensors mounted on the wearable carrier to provide information indicative of a sensed relative position of the thumb of a hand with respect to the hand, and a signal processing unit to process said information.
  • At least one of said sensors is an electrode mounted on an inner surface of the wearable carrier.
  • the electrode contactss a surface of the skin to sense electro-myographic signals of a muscle controlling the thumb denoted as Opponens Pollicis'.
  • the improved wearable device has a plurality of sensors mounted on the wearable carrier to provide information indicative of a sensed relative position of the thumb with respect to the hand.
  • the electrode(s) used to determine EMG-signals face a relatively glabrous (hairless) part of the skin, allowing for a reliable EMG-signal detection.
  • the shape of the hand offers a better opportunity to reproducibly place the electrode(s) to a particular position.
  • the wearable carrier may be an open or closed glove.
  • the glove may additionally have an esthetical and/or protective purpose.
  • the glove may for example be worn as a gauntlet by a driver on a motor cycle or by an engineer working in a manufacturing plant.
  • the plurality of sensors includes in addition to said electrode at least a camera mounted in a position facing a surface of the fingers at a side of the hand palm.
  • the signal processing unit includes an image processing module coupled to said camera to provide an output signal indicative of an indicated position on the fingers.
  • the at least one electrode e.g. an electrode for providing EMG activity of the thumb muscle denoted as Opponens PoUicis', which controls opposition of the thumb reliably indicates whether the user aims to select a function associated with a particular relative position.
  • a function is selected for example if an amplitude of the measured EMG-activity exceeds a predetermined minimum value and/or if the EMG-activity is continuously present during a predetermined minimum time interval for example. Additional means may be provided to confirm a determination on the basis of the measured EMG activity. For example an inertial sensor, such as a gyroscope or an acceleration sensor may be present, allowing a user to confirm an input by a predetermined movement (e.g. shaking or turning) of the hand.
  • a predetermined movement e.g. shaking or turning
  • the electrode is part of a set of at least three electrodes mounted on an inner surface of the wearable carrier.
  • the electrodes contact a surface of the skin to measure electro-myographic signals from respective muscles controlling the thumb. It has been found that the relative position of the thumb can be determined with sufficient accuracy using such a set of at least three electrodes. In that case no additional sensors, such as a camera or an inertial sensor is superfluous. This is advantageous in that a single type of signal processing circuitry may be used for processing the sensed signals. Nevertheless optionally other sensors may be added if desired, for example to increase robustness.
  • the set of electrodes includes a first, a second and a third electrode that are arranged on the wearable carrier to contact the skin of the hand at a position respectively coinciding with the Flexor PoUicis Brevis, the Abductor PoUicis Brevis, and the Opponens PoUicis.
  • This combination of electrodes is considered to be the most suitable one for determining the relative position of the thumb.
  • the wearable electronic device has the signal processing unit to determine whether a position of a top of the thumb coincides with one of the finger phalanges and to generate a signal indicative for the finger phalanges at that position.
  • the phalanges are clearly separate locations so that the user can easily learn to correlate functions or values associated with these locations, for example the digits of a phone. This obviates the necessity to provide the user with additional means that show the associations, such as a projector or an augmented reality device.
  • the wearable electronic device includes a projector to project an image at the surface of the fingers at a side of the hand palm. This provides the user a clear indication as to which function or value is associated with a certain location.
  • the wearable electronic device may be combined with an augmented reality device that visualizes the image showing the available functions and/or values to its carrier.
  • a feedback unit may be provided to control the projector or the augmented reality device using the information indicative of the sensed relative position. This enables the user to provide input dependent on the current context.
  • the wearable electronic device may further comprise a wireless communication device that is mounted on the wearable carrier and coupled to the signal processing unit to transmit output data generated by the signal processing unit to a controllable device.
  • a wireless communication device may be arranged to receive feedback signals from the controllable device and the wearable device may further comprise an output device mounted on the wearable carrier to output said feedback signals.
  • the output device may for example provide visual, auditory or sensory feedback. Also an augmented reality device may be used for this purpose.
  • an electronic system comprises in addition to the wearable electronic device according to one of the embodiments as described above further a controllable device that is coupled to the wearable electronic device to receive control signals from the wearable electronic device.
  • the controllable device may be mounted on the wearable carrier or may be a separate device.
  • a wearable device comprising a wearable carrier and a plurality of sensors as well as a signal processing unit mounted on said wearable carrier, the plurality of sensors including at least one electrode mounted on an inner surface of the wearable carrier, wearing the wearable device on a hand, wherein the at least one electrode contacts a surface of the hand's skin to sense electro-myographic signals of a muscle controlling the hand's thumb Opponens Pollicis',
  • the wearable device provides for an improved accuracy, in that the at least one electrode can be reliably positioned to a users hand due to the more complicated outer shape of the hand as compared to the wrist.
  • a calibration procedure may be applied that comprises the steps of obtaining feedback signals indicative for a sensed relative position of the thumb with respect to fingers of the hand, from an independent source, and using said feedback signals to calibrate the signal processing unit.
  • the independent source is the user.
  • the calibration procedure may for example require the user to act by touching respective finger phalanges and confirm each of these actions by other input, e.g. keyboard or voice recognition.
  • an image recognition system coupled to a camera may provide for confirmation.
  • the calibration procedure may be applied when wearing the device for the first time. Often this may be sufficient as the electrodes in the inventive wearable device normally have a reproducible position. Nevertheless, in cases wherein the fabric of the wearable substrate is made of a material that tends to stretch during lifetime it may be desired to repeat the calibration procedure. Also in cases wherein the users hand dimension changes, for example due to growth of an adolescent user, it may be desirable to repeat the calibration procedure from time to time. Nevertheless, a subsequent calibration procedure may be a simplified version of the initial calibration procedure. For example, the initial calibration procedure may require the user to touch each finger phalange, while for a subsequent calibration procedure it suffices to touch the four outer phalanges (for example index upper, index bottom, pink upper, pink bottom).
  • an initial calibration procedure takes place if a user for the first time uses the wearable device, and a subsequent simplified calibration procedure may be followed every next time at "power on" of the device.
  • the calibration procedure may be executed regularly if a power- on of the wearable device has taken place a predetermined number (e.g. 10) of times.
  • a subsequent calibration procedure may be initiated each time a certain time- period (e.g. a month) has lapsed.
  • a subsequent calibration procedure may be initiated if either the device has been powered-on for a predetermined number of time or a certain time-period has lapsed, whatever occurs first.
  • a computer program product comprising a computer program which when executed causes a programmable processor to perform each of steps the method specified above.
  • a control system including a wearable electronic device according to one of the embodiments described above and an augmented reality device to augment an image of the hand as perceived by a carrier of the wearable electronic device and the augmented reality device with an image displaying available functions and/or values associated with relative positions of the thumb.
  • FIG. 1 shows an embodiment of a wearable electronic device according to the present invention
  • FIG. 2 schematically shows circuitry used in a system comprising a wearable electronic device of FIG. 1 and controllable device,
  • FIG. 3 shows an example of an open glove suitable to be used as a carrier in a wearable electronic device of FIG. 1,
  • FIG. 4 shows another embodiment of a wearable electronic device according to the present invention
  • FIG. 5 shows an anatomic image of a human hand
  • FIG. 6 schematically shows circuitry used in a system comprising a wearable electronic device of FIG. 4 and controllable device
  • FIG. 7 shows again another embodiment of a wearable electronic device according to the present invention
  • FIG. 7A shows a variation of said embodiment
  • FIG. 8 schematically shows circuitry used in a system comprising a wearable electronic device of FIG. 7 and controllable device
  • FIG. 9 schematically shows circuitry used in a system comprising a still other embodiment of a wearable electronic device and controllable device
  • FIG. 10 schematically shows a method according to the present invention.
  • FIG. 1 shows a first embodiment of a wearable electronic device 1 according to the present invention.
  • the wearable device comprises a wearable carrier 10 in the form of an open glove (See e.g. FIG. 3) that exposes the thumb T and the fingers Fl, F2, F3, F4.
  • a plurality 20 of sensors is mounted on the wearable carrier to provide information indicative of a sensed relative position of the thumb T of a hand with respect to the hand.
  • a signal processing unit 30 that processes the information obtained with the sensors.
  • At least one of said sensors is an electrode 23 mounted on an inner surface of the wearable carrier 10 to during use contact a surface of the skin to sense an activity of a muscle controlling the thumb T.
  • the electrode 23 measures an EMG activity of the thumb muscle denoted as Opponens Pollicis', which controls opposition of the thumb.
  • the plurality 20 of sensors further includes at least a camera 25.
  • the camera 25 is mounted on the wearable carrier 10 in a position facing a surface of the fingers Fl, F2, F3, F4 at a side of the hand palm and an image processing unit (See FIG. 2) is coupled to the camera 25 to provide an output signal indicative of position on the fingers indicated by the thumb T.
  • an image processing unit See FIG. 2
  • the surface of the fingers Fl, F2, F3, F4 is partly obscured by the thumb T. Nevertheless, it has been found that the relative position of the thumb T with respect to the hand provides sufficient information for enabling the user to provide user control without needing image data that actually shows the location where the thumb T touches the surface of the fingers.
  • FIG. 2 shows the signal processing unit 30 of the embodiment of FIG. 1 in more detail.
  • the signal processing unit 30 comprises an image processing module 32 to process image data Di obtained with image sensor 25 and to provide an output signal Pos, indicative of a position of the thumb T relative to the hand, which is also a reliable indicator of a position of the thumb relative to the surface of the fingers Fl, F2, F3, F4, once the thumb T presses the surface of the fingers.
  • the latter is registered by the EMG-processing module 34 that receives the input signal Demg from the sensor 23 and determines that a pressure is exerted if the EMG-signal Demg exceeds a predetermined threshold value.
  • the signals Pos and Press are provided to a signal combination module, which in the embodiment shown provides its output signal to a wireless communication device 60, also mounted on the wearable carrier that transmits the control data Cntrl generated by the signal processing unit 30 to a controllable device 100.
  • the wireless communication device may for example provided for a Blue Tooth connection, and the controllable device may be a phone, an MP3 player, a videogame console, a pc etc.
  • the wearable electronic device 1 and the controllable device 100 form a system according to the present invention.
  • a position Pos as determined by the signal processing unit 30 may have small deviations from the actual position due to deviations in physiologic properties of the wearer of the device 1 as compared to the assumed values. For many applications, this may not be an issue, for example, if the position of the thumb only needs to be determined with a relatively low resolution.
  • feed-back signals may be obtained from an independent source, e.g. a camera 200. These feedback signals can then be used to calibrate the signal processing unit 30.
  • controllable device 100 may also be integrated in the wearable carrier 10, an may for example receive control data Cntrl from the signal processing unit 30 via a wired connection.
  • FIG. 3 shows an example of an open glove 10 that can be used as a carrier 10 for the plurality of sensors 20, the signal processing unit 30, and a wireless communication device 60 or a controllable device 100.
  • FIG. 4 shows an alternative embodiment.
  • the plurality 20 of sensors is a set of electrodes 21, 22, 23 mounted on an inner surface of the wearable carrier 10, in this embodiment a full glove.
  • the electrodes 21, 22, 23 contact a surface of the skin to measure electro-myographic signals from respective muscles that control the thumb.
  • the first electrode 21 coincides with the position of the skin corresponding to the Flexor Pollicis Brevis. This muscle is responsible for flexing and medial rotation of the thumb T.
  • the second electrode 22 coincides with the position of the skin corresponding to the Abductor Pollicis Brevis, which serve to abduct the thumb.
  • the third electrode 23 coincides with the position of the skin corresponding to the Opponens Pollicis, which as mentioned above, serves to oppose the thumb.
  • FIG. 5 is an anatomical drawing, indicating the Flexor Pollicis Brevis (11), the Abductor Pollicis Brevis (12) and the Opponens Pollicis (13).
  • the signal processing unit 30 includes an EMG-processing module 34 that receives the input signal Demgl, Demg2 and Demg3 from the sensor 21 , 22 and 23 and in response generates a control signal Cntrl to control a controllable device 100.
  • FIG. 7 shows another embodiment, wherein the wearable electronic device further includes a projector 40 to project an image at the surface of the fingers at a side of the hand palm.
  • the projector 40 projects the digits 0 to 9 and the characters '*' and '#' in a lay-out comparable to that of a mobile phone.
  • this lay-out may be simply printed on the glove, so that the projector 40 is superfluous.
  • the embodiment shown in FIG. 6 is advantageous in that different or moving images may be displayed dependent on the application or a required type of input.
  • a display may be integrated in the fabric of the glove.
  • the wearable electronic device 1 comprises a transmission unit 60 that transmits data representing the image to be displayed to an augmented reality device 44.
  • the virtual reality device 44 projects the image represented by the transmitted data to the eyes of the observer as if the image were projected onto the hand of the observer. This is advantageous in that the projected image is only visible to the person wearing the virtual reality device 44, therewith preserving privacy.
  • the virtual reality device may be provided in the form of a visor or a pair of glasses, e.g. Google GlassTM.
  • the virtual reality device 44 may receive the data representing the image to be displayed from another device that cooperates with the wearable electronic device.
  • the embodiment described with reference to FIG. 7 may be advantageous, if the user of the wearable electronic device wants to share information with others.
  • FIG. 8 shows the associated circuitry.
  • the embodiment of FIG. 8 further includes a transmission module that 60 that transmits control data Ctrl to a controllable device 100.
  • FIG. 9 shows an alternative embodiment.
  • the wearable electronic device further comprises the wireless communication device 60 to receive feedback signals from the controllable device 100.
  • the output device 40 mounted on the wearable carrier serves to output said feedback signals.
  • the method comprises a step S 1 of providing a wearable device 1 that comprises a wearable carrier 10, and a plurality 20 of sensors as well as a signal processing unit 30 mounted on the wearable carrier.
  • the plurality of sensors includes at least one electrode 23 mounted on an inner surface of the wearable carrier.
  • a wearable device 1 is provided as disclosed with reference to FIG 1 - 3.
  • a wearable device may be provided as disclosed with reference to FIG 4-6, or as disclosed with reference to FIG. 7,8 or with reference to FIG. 9.
  • a second step S2 comprises wearing the wearable device 1 on a hand.
  • the at least one electrode 23 contacts a surface of the skin to sense an activity of a muscle controlling the thumb T.
  • the electrode coincides for example with a position of the skin corresponding to the Opponens Pollicis, which as mentioned above, serves to oppose the thumb.
  • a third step S3 information is provided with said plurality of sensors that is indicative of a sensed relative position of the thumb T with respect to the hand.
  • the obtained information is for example image information Di and or EMG information Demg.
  • a fourth step S4 the information so obtained is processed, e.g. by image processing and/or by EMG-signal processing.
  • control signals Cntrl are generated for controlling (See step S5) a controllable device that receives these control signals in a wired or wireless manner.
  • feed-back signals may be obtained (S6) from an independent source, e.g. a camera 200 as shown in FIG. 2, that provide an accurate indication of the relative position of the thumb T of the hand with respect to the fingers Fl, F2, F3, F4.
  • an independent source e.g. a camera 200 as shown in FIG. 2, that provide an accurate indication of the relative position of the thumb T of the hand with respect to the fingers Fl, F2, F3, F4.
  • the signal processing unit 30 is calibrated in step S7.
  • the elements listed in the apparatus claims are meant to include any hardware (such as separate or integrated circuits or electronic elements) or software (such as programs or parts of programs) which reproduce in operation or are designed to reproduce a specified function, be it solely or in conjunction with other functions, be it in isolation or in co-operation with other elements.
  • the invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the apparatus claim enumerating several means, several of these means can be embodied by one and the same item of hardware.
  • Computer program product' is to be understood to mean any software product stored on a computer-readable medium, such as a floppy disk, downloadable via a network, such as the Internet, or marketable in any other manner.
  • the present invention in particular also pertains to a computer program product comprising a computer program which when executed causes a programmable processor to perform each of steps S2 to S5 of the method described with reference to FIG.10 and optionally also further steps, e.g. steps S6 and S7.
  • first, second, third etc. may be used herein to describe various elements, components, modules and/or units, these elements, components, modules and/or units should not be limited by these terms. These terms are only used to distinguish one element, component, module and/or unit from another element, component, module and/or unit. Thus, a first element, component, module and/or unit discussed herein could be termed a second element, component, module and/or unit without departing from the teachings of the present invention.
  • the terms “comprises,” “comprising,” “includes,” “including,” “has,” “having” or any other variation thereof, are intended to cover a non-exclusive inclusion.
  • a process, method, article, or apparatus that comprises a list of elements is not necessarily limited to only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
  • “or” refers to an inclusive or and not to an exclusive or. For example, a condition A or B is satisfied by any one of the following: A is true (or present) and B is false (or not present), A is false (or not present) and B is true (or present), and both A and B are true (or present).

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Dermatology (AREA)
  • Neurosurgery (AREA)
  • Neurology (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A wearable electronic device (1) is provided that comprises a wearable carrier (10), a plurality (20) of sensors (23, 25; 21,22,23) mounted on the wearable carrier to provide information indicative of a sensed relative position of a thumb (T) of a hand with respect to the hand, and a signal processing unit (30) to process said information. At least one of said sensors is an electrode (23) mounted on an inner surface of the wearable carrier (10) to during use contact a surface of the hand's skin to sense electro-myographic signals of a muscle controlling the thumb (T).

Description

WEARABLE ELECTRONIC DEVICE, ELECTRONIC SYSTEM, AS WELL AS ASSOCIATED METHOD AND COMPUTER PROGRAM PRODUCT
BACKGROUND OF THE INVENTION
Field of the invention
The present invention relates to a wearable electronic device.
The present invention relates to a system comprising a wearable electronic device and a device that is controllable by the wearable electronic device.
The present invention further relates to an associated method.
The present invention still further relates to a computer program product.
Related Art
Gesture control is popular for various applications like videogames or controlling hardware.
US20060121958 discloses a wearable mobile phone capable of detecting EMG changed by hand motion of a user and a control method of an input unit of the wearable mobile phone. The wearable mobile phone includes an EMG measuring unit having a plurality of EMG measuring sensors for detecting the EMG changed by hand motion of a user. The EMG measuring unit is made in a ring shape to be worn on a wrist of the user. An EMG transferring unit is connected to the EMG measuring unit for transferring the EMG measured by the EMG measuring unit. An EMG determining unit is mounted to one side of the EMG transferring unit 20 for receiving EMG from the EMG transferring unit to determine the hand motion and extract an input signal for the mobile phone corresponding to the hand motion. A mobile phone functioning unit receives the input signal from the EMG determining unit for functioning the mobile function and has an antenna and a sound transferring device.
US2009/005699 discloses an input system that executes an input to an information processing apparatus depending on the hand motion of a person. At least one myoelectric sensor is provided on an area between a wrist of the person and bases of a second finger to a fifth finger, and detects a myoelectric signal depending on the hand motion. A standard value obtaining portion outputs a command to make the person maintain a hand in a constant posture in a state where the myoelectric sensors is worn on the hand, and obtains a value based on the myoelectric signal detected by the myoelectric sensor after the output of the command, as a standard value. A calibration portion calibrates a myoelectric signal depending on the hand motion after the standard value is obtained by the standard value obtaining portion, with the standard value.
It is a disadvantage of the wearable mobile phone known from the cited document that the detected signals used for control may suffer from inaccuracies due to the coat of hair between the EMG measuring sensors and the skin surface. Also inaccuracies may be caused by variations in the position of the EMG measuring unit on the users wrist. SUMMARY OF THE INVENTION
It is an object of the present invention to provide a wearable electronic device that mitigates these inaccuracies.
It is a further object of the present invention to provide a system including such a wearable electronic device and a controllable device to be controlled therewith.
It is a further object of the present invention to provide an associated method.
It is a still further object of the present invention to provide an associated computer program product.
According to a first aspect of the present invention a wearable electronic device is provided that comprises a wearable carrier, a plurality of sensors mounted on the wearable carrier to provide information indicative of a sensed relative position of the thumb of a hand with respect to the hand, and a signal processing unit to process said information. At least one of said sensors is an electrode mounted on an inner surface of the wearable carrier. During use, i.e. when the carrier is worn on a user's hand, the electrode contactss a surface of the skin to sense electro-myographic signals of a muscle controlling the thumb denoted as Opponens Pollicis'.
It has been recognized by the present inventors that movements of the hand wherein the thumb points to the finger phalanges can be reasonably well represented by the movements of the thumb alone. In accordance with this recognition, the improved wearable device according to the present invention has a plurality of sensors mounted on the wearable carrier to provide information indicative of a sensed relative position of the thumb with respect to the hand. The electrode(s) used to determine EMG-signals face a relatively glabrous (hairless) part of the skin, allowing for a reliable EMG-signal detection. Moreover, the shape of the hand offers a better opportunity to reproducibly place the electrode(s) to a particular position. The wearable carrier may be an open or closed glove. The glove may additionally have an esthetical and/or protective purpose. The glove may for example be worn as a gauntlet by a driver on a motor cycle or by an engineer working in a manufacturing plant.
In a first embodiment of the wearable electronic device the plurality of sensors includes in addition to said electrode at least a camera mounted in a position facing a surface of the fingers at a side of the hand palm. In said embodiment the signal processing unit includes an image processing module coupled to said camera to provide an output signal indicative of an indicated position on the fingers. The at least one electrode e.g. an electrode for providing EMG activity of the thumb muscle denoted as Opponens PoUicis', which controls opposition of the thumb reliably indicates whether the user aims to select a function associated with a particular relative position. It may be determined that a function is selected for example if an amplitude of the measured EMG-activity exceeds a predetermined minimum value and/or if the EMG-activity is continuously present during a predetermined minimum time interval for example. Additional means may be provided to confirm a determination on the basis of the measured EMG activity. For example an inertial sensor, such as a gyroscope or an acceleration sensor may be present, allowing a user to confirm an input by a predetermined movement (e.g. shaking or turning) of the hand.
In another embodiment wherein the electrode is part of a set of at least three electrodes mounted on an inner surface of the wearable carrier. During use the electrodes contact a surface of the skin to measure electro-myographic signals from respective muscles controlling the thumb. It has been found that the relative position of the thumb can be determined with sufficient accuracy using such a set of at least three electrodes. In that case no additional sensors, such as a camera or an inertial sensor is superfluous. This is advantageous in that a single type of signal processing circuitry may be used for processing the sensed signals. Nevertheless optionally other sensors may be added if desired, for example to increase robustness.
In an embodiment of this embodiment the set of electrodes includes a first, a second and a third electrode that are arranged on the wearable carrier to contact the skin of the hand at a position respectively coinciding with the Flexor PoUicis Brevis, the Abductor PoUicis Brevis, and the Opponens PoUicis. This combination of electrodes is considered to be the most suitable one for determining the relative position of the thumb.
In an embodiment the wearable electronic device has the signal processing unit to determine whether a position of a top of the thumb coincides with one of the finger phalanges and to generate a signal indicative for the finger phalanges at that position. The phalanges are clearly separate locations so that the user can easily learn to correlate functions or values associated with these locations, for example the digits of a phone. This obviates the necessity to provide the user with additional means that show the associations, such as a projector or an augmented reality device.
Nevertheless, for particular applications it may be desired to enable the user to provide input at a higher resolution or to enable the user to provide context sensitive input. In an embodiment the wearable electronic device includes a projector to project an image at the surface of the fingers at a side of the hand palm. This provides the user a clear indication as to which function or value is associated with a certain location. Alternatively the wearable electronic device may be combined with an augmented reality device that visualizes the image showing the available functions and/or values to its carrier.
A feedback unit may be provided to control the projector or the augmented reality device using the information indicative of the sensed relative position. This enables the user to provide input dependent on the current context.
The wearable electronic device may further comprise a wireless communication device that is mounted on the wearable carrier and coupled to the signal processing unit to transmit output data generated by the signal processing unit to a controllable device. Therewith for example an audio or video system can be controlled with the wearable electronic device. The wireless communication device may be arranged to receive feedback signals from the controllable device and the wearable device may further comprise an output device mounted on the wearable carrier to output said feedback signals. The output device may for example provide visual, auditory or sensory feedback. Also an augmented reality device may be used for this purpose.
According to another aspect of the present invention an electronic system is provided. The electronic system comprises in addition to the wearable electronic device according to one of the embodiments as described above further a controllable device that is coupled to the wearable electronic device to receive control signals from the wearable electronic device. The controllable device may be mounted on the wearable carrier or may be a separate device.
According to again another aspect of the present invention a method is provided comprising
providing a wearable device comprising a wearable carrier and a plurality of sensors as well as a signal processing unit mounted on said wearable carrier, the plurality of sensors including at least one electrode mounted on an inner surface of the wearable carrier, wearing the wearable device on a hand, wherein the at least one electrode contacts a surface of the hand's skin to sense electro-myographic signals of a muscle controlling the hand's thumb Opponens Pollicis',
with said plurality of sensors providing information indicative of a sensed relative position of the hand's thumb with respect to the hand, and
with said signal processing unit processing said information to obtain control signals for a controllable device.
As mentioned above, the wearable device according to the present invention provides for an improved accuracy, in that the at least one electrode can be reliably positioned to a users hand due to the more complicated outer shape of the hand as compared to the wrist. If an even better accuracy is required, a calibration procedure may be applied that comprises the steps of obtaining feedback signals indicative for a sensed relative position of the thumb with respect to fingers of the hand, from an independent source, and using said feedback signals to calibrate the signal processing unit. In an embodiment the independent source is the user. The calibration procedure may for example require the user to act by touching respective finger phalanges and confirm each of these actions by other input, e.g. keyboard or voice recognition. Alternatively an image recognition system coupled to a camera may provide for confirmation. The calibration procedure may be applied when wearing the device for the first time. Often this may be sufficient as the electrodes in the inventive wearable device normally have a reproducible position. Nevertheless, in cases wherein the fabric of the wearable substrate is made of a material that tends to stretch during lifetime it may be desired to repeat the calibration procedure. Also in cases wherein the users hand dimension changes, for example due to growth of an adolescent user, it may be desirable to repeat the calibration procedure from time to time. Nevertheless, a subsequent calibration procedure may be a simplified version of the initial calibration procedure. For example, the initial calibration procedure may require the user to touch each finger phalange, while for a subsequent calibration procedure it suffices to touch the four outer phalanges (for example index upper, index bottom, pink upper, pink bottom).
By way of example an initial calibration procedure takes place if a user for the first time uses the wearable device, and a subsequent simplified calibration procedure may be followed every next time at "power on" of the device. Instead of executing a calibration procedure at each power-on, the calibration procedure may be executed regularly if a power- on of the wearable device has taken place a predetermined number (e.g. 10) of times.
Alternatively a subsequent calibration procedure may be initiated each time a certain time- period (e.g. a month) has lapsed. Alternatively a subsequent calibration procedure may be initiated if either the device has been powered-on for a predetermined number of time or a certain time-period has lapsed, whatever occurs first.
According to another aspect of the present invention a computer program product is provided comprising a computer program which when executed causes a programmable processor to perform each of steps the method specified above.
According to still another aspect of the present invention a control system is provided including a wearable electronic device according to one of the embodiments described above and an augmented reality device to augment an image of the hand as perceived by a carrier of the wearable electronic device and the augmented reality device with an image displaying available functions and/or values associated with relative positions of the thumb.
BRIEF DESCRIPTION OF THE DRAWINGS
These and other aspects are described in more detail with reference to the drawing. Therein:
FIG. 1 shows an embodiment of a wearable electronic device according to the present invention,
FIG. 2 schematically shows circuitry used in a system comprising a wearable electronic device of FIG. 1 and controllable device,
FIG. 3 shows an example of an open glove suitable to be used as a carrier in a wearable electronic device of FIG. 1,
FIG. 4 shows another embodiment of a wearable electronic device according to the present invention,
FIG. 5 shows an anatomic image of a human hand,
FIG. 6 schematically shows circuitry used in a system comprising a wearable electronic device of FIG. 4 and controllable device,
FIG. 7 shows again another embodiment of a wearable electronic device according to the present invention,
FIG. 7A shows a variation of said embodiment,
FIG. 8 schematically shows circuitry used in a system comprising a wearable electronic device of FIG. 7 and controllable device,
FIG. 9 schematically shows circuitry used in a system comprising a still other embodiment of a wearable electronic device and controllable device, FIG. 10 schematically shows a method according to the present invention.
DETAILED DESCRIPTION OF EMBODIMENTS
Like reference symbols in the various drawings indicate like elements unless otherwise indicated.
FIG. 1 shows a first embodiment of a wearable electronic device 1 according to the present invention. In the embodiment the wearable device comprises a wearable carrier 10 in the form of an open glove (See e.g. FIG. 3) that exposes the thumb T and the fingers Fl, F2, F3, F4. A plurality 20 of sensors is mounted on the wearable carrier to provide information indicative of a sensed relative position of the thumb T of a hand with respect to the hand. Integrated with the wearable carrier 10 is a signal processing unit 30 that processes the information obtained with the sensors. At least one of said sensors is an electrode 23 mounted on an inner surface of the wearable carrier 10 to during use contact a surface of the skin to sense an activity of a muscle controlling the thumb T. In particular the electrode 23 measures an EMG activity of the thumb muscle denoted as Opponens Pollicis', which controls opposition of the thumb. The plurality 20 of sensors further includes at least a camera 25. The camera 25 is mounted on the wearable carrier 10 in a position facing a surface of the fingers Fl, F2, F3, F4 at a side of the hand palm and an image processing unit (See FIG. 2) is coupled to the camera 25 to provide an output signal indicative of position on the fingers indicated by the thumb T. It is noted that the surface of the fingers Fl, F2, F3, F4 is partly obscured by the thumb T. Nevertheless, it has been found that the relative position of the thumb T with respect to the hand provides sufficient information for enabling the user to provide user control without needing image data that actually shows the location where the thumb T touches the surface of the fingers.
FIG. 2 shows the signal processing unit 30 of the embodiment of FIG. 1 in more detail. The signal processing unit 30 comprises an image processing module 32 to process image data Di obtained with image sensor 25 and to provide an output signal Pos, indicative of a position of the thumb T relative to the hand, which is also a reliable indicator of a position of the thumb relative to the surface of the fingers Fl, F2, F3, F4, once the thumb T presses the surface of the fingers. The latter is registered by the EMG-processing module 34 that receives the input signal Demg from the sensor 23 and determines that a pressure is exerted if the EMG-signal Demg exceeds a predetermined threshold value. The signals Pos and Press are provided to a signal combination module, which in the embodiment shown provides its output signal to a wireless communication device 60, also mounted on the wearable carrier that transmits the control data Cntrl generated by the signal processing unit 30 to a controllable device 100. The wireless communication device may for example provided for a Blue Tooth connection, and the controllable device may be a phone, an MP3 player, a videogame console, a pc etc. The wearable electronic device 1 and the controllable device 100 form a system according to the present invention.
A position Pos as determined by the signal processing unit 30 may have small deviations from the actual position due to deviations in physiologic properties of the wearer of the device 1 as compared to the assumed values. For many applications, this may not be an issue, for example, if the position of the thumb only needs to be determined with a relatively low resolution. Optionally, for example, if the position needs to be determined with a high accuracy, feed-back signals may be obtained from an independent source, e.g. a camera 200. These feedback signals can then be used to calibrate the signal processing unit 30.
Alternatively the controllable device 100 may also be integrated in the wearable carrier 10, an may for example receive control data Cntrl from the signal processing unit 30 via a wired connection.
FIG. 3 shows an example of an open glove 10 that can be used as a carrier 10 for the plurality of sensors 20, the signal processing unit 30, and a wireless communication device 60 or a controllable device 100.
FIG. 4 shows an alternative embodiment. Therein the plurality 20 of sensors is a set of electrodes 21, 22, 23 mounted on an inner surface of the wearable carrier 10, in this embodiment a full glove. During use, i.e. when the glove 10 is worn on the hand the electrodes 21, 22, 23 contact a surface of the skin to measure electro-myographic signals from respective muscles that control the thumb. In the embodiment shown, the first electrode 21 coincides with the position of the skin corresponding to the Flexor Pollicis Brevis. This muscle is responsible for flexing and medial rotation of the thumb T. The second electrode 22 coincides with the position of the skin corresponding to the Abductor Pollicis Brevis, which serve to abduct the thumb. The third electrode 23 coincides with the position of the skin corresponding to the Opponens Pollicis, which as mentioned above, serves to oppose the thumb.
FIG. 5 is an anatomical drawing, indicating the Flexor Pollicis Brevis (11), the Abductor Pollicis Brevis (12) and the Opponens Pollicis (13).
As further shown in more detail in FIG. 6 the signal processing unit 30 includes an EMG-processing module 34 that receives the input signal Demgl, Demg2 and Demg3 from the sensor 21 , 22 and 23 and in response generates a control signal Cntrl to control a controllable device 100.
FIG. 7 shows another embodiment, wherein the wearable electronic device further includes a projector 40 to project an image at the surface of the fingers at a side of the hand palm. In the embodiment shown the projector 40 projects the digits 0 to 9 and the characters '*' and '#' in a lay-out comparable to that of a mobile phone. Alternatively, this lay-out may be simply printed on the glove, so that the projector 40 is superfluous. The embodiment shown in FIG. 6 however is advantageous in that different or moving images may be displayed dependent on the application or a required type of input. In again another embodiment, a display may be integrated in the fabric of the glove.
Again another embodiment is shown in FIG. 7A. Therein the wearable electronic device 1 comprises a transmission unit 60 that transmits data representing the image to be displayed to an augmented reality device 44. The virtual reality device 44 projects the image represented by the transmitted data to the eyes of the observer as if the image were projected onto the hand of the observer. This is advantageous in that the projected image is only visible to the person wearing the virtual reality device 44, therewith preserving privacy. The virtual reality device may be provided in the form of a visor or a pair of glasses, e.g. Google Glass™. Alternatively, the virtual reality device 44 may receive the data representing the image to be displayed from another device that cooperates with the wearable electronic device.
Alternatively, the embodiment described with reference to FIG. 7 may be advantageous, if the user of the wearable electronic device wants to share information with others.
FIG. 8 shows the associated circuitry. The embodiment of FIG. 8 further includes a transmission module that 60 that transmits control data Ctrl to a controllable device 100.
FIG. 9 shows an alternative embodiment. In the embodiment of FIG. 9 the wearable electronic device further comprises the wireless communication device 60 to receive feedback signals from the controllable device 100. The output device 40 mounted on the wearable carrier serves to output said feedback signals.
According to an aspect of the invention a method is provided as shown in
FIG.10.
The method comprises a step S 1 of providing a wearable device 1 that comprises a wearable carrier 10, and a plurality 20 of sensors as well as a signal processing unit 30 mounted on the wearable carrier. The plurality of sensors includes at least one electrode 23 mounted on an inner surface of the wearable carrier. For example a wearable device 1 is provided as disclosed with reference to FIG 1 - 3. Alternatively a wearable device may be provided as disclosed with reference to FIG 4-6, or as disclosed with reference to FIG. 7,8 or with reference to FIG. 9.
A second step S2 comprises wearing the wearable device 1 on a hand. During this step the at least one electrode 23 contacts a surface of the skin to sense an activity of a muscle controlling the thumb T. The electrode coincides for example with a position of the skin corresponding to the Opponens Pollicis, which as mentioned above, serves to oppose the thumb.
In a third step S3 information is provided with said plurality of sensors that is indicative of a sensed relative position of the thumb T with respect to the hand. The obtained information is for example image information Di and or EMG information Demg.
In a fourth step S4, the information so obtained is processed, e.g. by image processing and/or by EMG-signal processing. As a result of this information processing control signals Cntrl are generated for controlling (See step S5) a controllable device that receives these control signals in a wired or wireless manner.
Optionally, for example, if a high accuracy is required, feed-back signals may be obtained (S6) from an independent source, e.g. a camera 200 as shown in FIG. 2, that provide an accurate indication of the relative position of the thumb T of the hand with respect to the fingers Fl, F2, F3, F4. Using these feedback signals the signal processing unit 30 is calibrated in step S7.
As will be apparent to a person skilled in the art, the elements listed in the apparatus claims are meant to include any hardware (such as separate or integrated circuits or electronic elements) or software (such as programs or parts of programs) which reproduce in operation or are designed to reproduce a specified function, be it solely or in conjunction with other functions, be it in isolation or in co-operation with other elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the apparatus claim enumerating several means, several of these means can be embodied by one and the same item of hardware. 'Computer program product' is to be understood to mean any software product stored on a computer-readable medium, such as a floppy disk, downloadable via a network, such as the Internet, or marketable in any other manner. The present invention in particular also pertains to a computer program product comprising a computer program which when executed causes a programmable processor to perform each of steps S2 to S5 of the method described with reference to FIG.10 and optionally also further steps, e.g. steps S6 and S7.
It will be understood that, although the terms first, second, third etc. may be used herein to describe various elements, components, modules and/or units, these elements, components, modules and/or units should not be limited by these terms. These terms are only used to distinguish one element, component, module and/or unit from another element, component, module and/or unit. Thus, a first element, component, module and/or unit discussed herein could be termed a second element, component, module and/or unit without departing from the teachings of the present invention.
As used herein, the terms "comprises," "comprising," "includes," "including," "has," "having" or any other variation thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, article, or apparatus that comprises a list of elements is not necessarily limited to only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Further, unless expressly stated to the contrary, "or" refers to an inclusive or and not to an exclusive or. For example, a condition A or B is satisfied by any one of the following: A is true (or present) and B is false (or not present), A is false (or not present) and B is true (or present), and both A and B are true (or present).
Also, use of the "a" or "an" are employed to describe elements and components of the invention. This is done merely for convenience and to give a general sense of the invention. This description should be read to include one or at least one and the singular also includes the plural unless it is obvious that it is meant otherwise.
Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Although methods and materials similar or equivalent to those described herein can be used in the practice or testing of the present invention, suitable methods and materials are described below. All publications, patent applications, patents, and other references mentioned herein are incorporated by reference in their entirety. In case of conflict, the present specification, including definitions, will control. In addition, the materials, methods, and examples are illustrative only and not intended to be limiting.

Claims

CLAIMS:
1. A wearable electronic device (1) comprising a wearable carrier (10), a plurality (20) of sensors (23, 25; 21,22,23) mounted on the wearable carrier to provide information indicative of a sensed relative position of a thumb (T) of a hand with respect to the hand, and a signal processing unit (30) to process said information, wherein at least one of said sensors is an electrode (23) mounted on an inner surface of the wearable carrier (10) to during use contact a surface of the hand's skin to sense electro -myo graphic signals of a muscle controlling the thumb (T) denoted as Opponens Pollicis'.
2. The wearable electronic device (1) according to claim 1, wherein the plurality (20) of sensors includes at least a camera (25) mounted in a position facing a surface of the hand's fingers (Fl, F2, F3, F4) at a side of the hand's hand palm and wherein the signal processing unit (30) includes an image processing module (32) coupled to said camera to provide an output signal (Pos) indicative of a position on the fingers indicated by the thumb.
3. The wearable electronic device (1) according to claim 1, wherein the electrode
(23) is part of a set of at least three electrodes (21, 22, 23) mounted on an inner surface of the wearable carrier (10) to during use contact a surface of the hand's skin to sense electromyographic signals from respective muscles controlling the thumb.
4. The wearable electronic device (1) according to claim 3, wherein the set of electrodes includes a first, a second and a third electrode (21, 22, 23) that are arranged on the wearable carrier (10) to contact the hand's skin at a position respectively coinciding with the Flexor Pollicis Brevis, the Abductor Pollicis Brevis, and the Opponens Pollicis.
5. The wearable electronic device (1) according to claim 1, having the signal processing unit (30) to determine whether a position of a top of the thumb coincides with one of the finger's phalanges and to generate a signal to identify the finger phalange at that position.
6. The wearable electronic device (1) according to claim 1, including a projector (40) to project an image at the surface of the hand's fingers at a side of the hand's hand palm.
7. The wearable electronic device (1) according to claim 4, further including a feedback unit (50) to control the projector (40) using said information indicative of the sensed relative position.
8. The wearable electronic device (1) according to one of the previous claims, further comprising a wireless communication device (60) mounted on the wearable carrier, the wireless communication device being coupled to the signal processing unit (30) to transmit output data generated by the signal processing unit to a controllable device (100) for control of the controllable device.
9. The wearable electronic device (1) according to claim 8, further comprising the wireless communication device (60) to receive feedback signals from the controllable device (100), the wearable device further comprising an output device (40) mounted on the wearable carrier to output said feedback signals.
10. An electronic system comprising a wearable electronic device (1) according to one of the previous claims and a controllable device (100) coupled to the wearable electronic device to receive control signals (Ctrl) from the wearable electronic device.
11. The electronic system according to claim 10, wherein the controllable device (100) is integrated with the wearable carrier (10) and wherein said control signals (Ctrl) are provided via a wired coupling.
12. The electronic system according to claim 10, wherein the controllable device (100) is separate from the wearable carrier (10) and wherein said control signals (Ctrl) are provided via a wireless coupling.
13. A method comprising
providing (SI) a wearable device (1) comprising a wearable carrier (10), and a plurality (20) of sensors as well as a signal processing unit (30) mounted on said wearable carrier, the plurality of sensors including at least one electrode (23) mounted on an inner surface of the wearable carrier (10
wearing (S2) the wearable device on a hand, wherein the at least one electrode (23) contacts a surface of the hand's skin to sense electro-myographic signals of a muscle controlling the hand's thumb (T) denoted as Opponens Pollicis',
- with said plurality of sensors providing (S3) information indicative of a sensed relative position of the hand's thumb (T) with respect to the hand, and
with said signal processing unit (30) processing (S4) said information to obtain control signals (Cntrl) for a controllable device (100).
14. A method according to claim 13, further comprising the step of obtaining (S6) feedback signals indicative for a sensed relative position of the thumb (T) with respect to fingers (Fl, F2, F3, F4) of the hand, from an independent source, and using said feedback signals to calibrate (S7) the signal processing unit (30).
15. Computer program product comprising a computer program which when executed causes a programmable processor to perform each of steps S2 to S5 of the method specified in claim 13.
16. A control system including a wearable electronic device (1) according to one of the claims 1-9 and an augmented reality device (44) to augment an image of the hand as perceived by a carrier of the wearable electronic device and the augmented reality device with an image displaying available functions and/or values associated with relative positions of the thumb.
PCT/EP2014/072816 2013-11-06 2014-10-24 Wearable electronic device, electronic system, as well as associated method and computer program product WO2015067481A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP13191784 2013-11-06
EP13191784.1 2013-11-06

Publications (1)

Publication Number Publication Date
WO2015067481A1 true WO2015067481A1 (en) 2015-05-14

Family

ID=49584590

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2014/072816 WO2015067481A1 (en) 2013-11-06 2014-10-24 Wearable electronic device, electronic system, as well as associated method and computer program product

Country Status (1)

Country Link
WO (1) WO2015067481A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060121958A1 (en) 2004-12-06 2006-06-08 Electronics And Telecommunications Research Institute Wearable mobile phone using EMG and controlling method thereof
US20090005699A1 (en) 2007-06-07 2009-01-01 Fujitsu Component Limited Input system and computer readable recording medium
CN101371804A (en) * 2008-07-16 2009-02-25 哈尔滨工业大学 On-line recognizing method of hand gesture mode established based on sEMG

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060121958A1 (en) 2004-12-06 2006-06-08 Electronics And Telecommunications Research Institute Wearable mobile phone using EMG and controlling method thereof
US20090005699A1 (en) 2007-06-07 2009-01-01 Fujitsu Component Limited Input system and computer readable recording medium
CN101371804A (en) * 2008-07-16 2009-02-25 哈尔滨工业大学 On-line recognizing method of hand gesture mode established based on sEMG

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
DAVID KIM ET AL: "Digits: Freehand 3D interactions anywhere using a wrist-worn gloveless sensor", PROCEEDINGS OF THE 25TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, UIST '12, 7 October 2012 (2012-10-07), New York, New York, USA, pages 167 - 176, XP055114035, ISBN: 978-1-45-031580-7, DOI: 10.1145/2380116.2380139 *

Similar Documents

Publication Publication Date Title
JP7464762B2 (en) Finger-worn device using sensors and tactile sensation
US11121719B2 (en) Method of detecting user input in a 3D space and a 3D input system employing same
US11144121B2 (en) Wearable interactive user interface
RU2662408C2 (en) Method, apparatus and data processing device
JP6415592B2 (en) Wearable device
Strohmeier et al. zPatch: Hybrid resistive/capacitive etextile input
US10317997B2 (en) Selection of optimally positioned sensors in a glove interface object
US20150233779A1 (en) Gloves with pressure sensors
US20150109197A1 (en) Information processing apparatus, information processing method, and program
EP3598273A1 (en) Adaptive haptic effect rendering based on dynamic system identification
EP3293621A2 (en) Compensated haptic rendering for flexible electronic devices
US11009949B1 (en) Segmented force sensors for wearable devices
CN110221683B (en) Motion detection system, motion detection method, and computer-readable recording medium thereof
US20180011538A1 (en) Multimodal haptic effects
KR101497829B1 (en) Watch type device utilizing motion input
JP2018041164A (en) Operation input device and program
JP2012101284A (en) Intention estimation device for action of person
US11392237B2 (en) Virtual input devices for pressure sensitive surfaces
CN108089710A (en) A kind of electronic equipment control method, device and electronic equipment
WO2015067481A1 (en) Wearable electronic device, electronic system, as well as associated method and computer program product
CN106933342A (en) Body-sensing system, motion sensing control equipment and intelligent electronic device
WO2016121034A1 (en) Wearable device, input method, and program
JP7476505B2 (en) IMAGE PROCESSING DEVICE, MAKEUP SIMULATION DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM
TWI616777B (en) Smart wearable device and the unlock method thereof
KR20160149403A (en) Wearable data input device and method thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14789263

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14789263

Country of ref document: EP

Kind code of ref document: A1