WO2014068371A1 - Upper-arm computer pointing apparatus - Google Patents

Upper-arm computer pointing apparatus Download PDF

Info

Publication number
WO2014068371A1
WO2014068371A1 PCT/IB2012/056081 IB2012056081W WO2014068371A1 WO 2014068371 A1 WO2014068371 A1 WO 2014068371A1 IB 2012056081 W IB2012056081 W IB 2012056081W WO 2014068371 A1 WO2014068371 A1 WO 2014068371A1
Authority
WO
WIPO (PCT)
Prior art keywords
control data
orientation
upper arm
measured
pressure
Prior art date
Application number
PCT/IB2012/056081
Other languages
French (fr)
Inventor
Aryeh Haim KATZ
Miri BERGER KATZ
Original Assignee
Katz Aryeh Haim
Berger Katz Miri
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to KR1020157005413A priority Critical patent/KR20150082174A/en
Priority to EP12887355.1A priority patent/EP2915163A4/en
Priority to US14/426,131 priority patent/US11662699B2/en
Priority to EP19169927.1A priority patent/EP3537424A1/en
Priority to PCT/IB2012/056081 priority patent/WO2014068371A1/en
Priority to AU2012393913A priority patent/AU2012393913B2/en
Application filed by Katz Aryeh Haim, Berger Katz Miri filed Critical Katz Aryeh Haim
Priority to CA2883520A priority patent/CA2883520C/en
Priority to CN201280078092.4A priority patent/CN104903817A/en
Publication of WO2014068371A1 publication Critical patent/WO2014068371A1/en
Priority to HK15110764.6A priority patent/HK1210312A1/en
Priority to AU2017235951A priority patent/AU2017235951B2/en
Priority to US18/319,150 priority patent/US20240126226A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb

Definitions

  • the present invention relates to computer pointing devices and, more particularly, but not exclusively to a computer mouse wearable on the upper arm of a computer user.
  • the most commonly used computer pointing device is the computer mouse.
  • Movement of the mouse about a flat surface typically located on a desktop causes movement of the cursor about the display screen.
  • Selection of objects is accomplished by simultaneously holding the position of the cursor on top of the object while clicking, clicking and holding, or double clicking one or more buttons located on the mouse.
  • mouse manipulation requires the user to: grasp the mouse; move the arm and wrist to position the mouse, as needed, to perform a scrolling function or to activate the buttons.
  • a mouse typically has anywhere from one to three buttons and most commonly has two buttons.
  • a variety of conditions such as cerebral palsy, Parkinson's disease, multiple sclerosis, arthritis, etc., can fully or partially deprive a person of the manual motor control capacities needed to use a mouse, to move a cursor to a specific location on a display screen, and/or to select objects by operation of a mouse button.
  • an upper- arm computer pointing apparatus comprising: at least one orientation measurer, deployable on at least one area of an upper arm of a user, configured to measure orientation of the upper arm, at least one pressure meter, deployable on at least one area of the upper arm, configured to measure pressure applied by muscle of the upper arm, a computer processor, associated with the orientation measurer and pressure meter, configured to derive control data from the measured orientation and pressure, and a data transmitter, associated with the computer processor, configured to transmit the control data to a computing device.
  • an upper-arm computer pointing apparatus comprising: at least one orientation measurer, deployable on at least one area of an upper arm of a user, configured to measure orientation of the upper arm, a computer processor, associated with the orientation measurer, configured to derive control data from the measured orientation, and a data transmitter, associated with the computer processor, configured to transmit the control data to a computing device.
  • an upper-arm computer pointing apparatus comprising: at least one pressure meter, deployable on at least one area of the upper arm, configured to measure pressure applied by muscle of the upper arm, a computer processor, associated with the pressure meter, configured to derive control data from the measured pressure, and a data transmitter, associated with the computer processor, configured to transmit the control data to a computing device.
  • a method for upper-arm computer pointing comprising: measuring orientation of an upper arm of a user, on at least one area of the upper arm, measuring pressure applied by muscle of the upper arm, on at least one area of the upper arm, deriving control data from the measured orientation and pressure, and transmitting the control data to a computing device.
  • a method for upper-arm computer pointing comprising: measuring orientation of the upper arm, on at least one area of the upper arm, deriving control data from the measured orientation, and transmitting the control data to a computing device.
  • a method for upper-arm computer pointing comprising: measuring pressure applied by muscle of the upper arm, on at least one area of the upper arm, deriving control data from the measured pressure, and transmitting the control data to a computing device.
  • Implementation of the method and system of the present invention involves performing or completing certain selected tasks or steps manually, automatically, or a combination thereof.
  • several selected steps could be implemented by hardware or by software on any operating system of any firmware or a combination thereof.
  • selected steps of the invention could be implemented as a chip or a circuit.
  • selected steps of the invention could be implemented as a plurality of software instructions being executed by a computer using any suitable operating system.
  • selected steps of the method and system of the invention could be described as being performed by a data processor, such as a computing platform for executing a plurality of instructions.
  • Fig. 1 is a block diagram schematically illustrating a first apparatus for upper- arm computer pointing, according to an exemplary embodiment of the present invention.
  • Fig. 2 is a block diagram schematically illustrating a second apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • Fig. 3 is a block diagram schematically illustrating a third apparatus for upper- arm computer pointing, according to an exemplary embodiment of the present invention.
  • Fig. 4 is a block diagram schematically illustrating a fourth apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • Fig. 5 is a flowchart illustrating a first method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • Fig. 6 is a flowchart illustrating a second method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • Fig. 7 is a flowchart illustrating a third method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • the present embodiments comprise apparatuses and methods for upper-arm computer pointing.
  • Movement of the mouse about a flat surface typically located on a desktop causes movement of the cursor about the display screen.
  • Selection of objects is accomplished by simultaneously holding the position of the cursor on top of the object while clicking, clicking and holding, or double clicking one or more buttons located on the mouse, etc.
  • a variety of conditions such as cerebral palsy, Parkinson's disease, multiple sclerosis, arthritis, can fully or partially deprive a person of the manual motor control capacities needed to use a mouse, to move a cursor to a specific location on a display screen, and/or to select objects by operation of a mouse button.
  • an upper extremity is amputated because of trauma from war injury, automobile accident, recreation or work-related injury. Malignancy, congenital absence of an extremity and other conditions account for a minority of amputation cases. In some countries, various levels of amputation are the result of punishment, torture and terrorism-related trauma.
  • An apparatus may be worn on an upper arm of a user of a computing device (such as a desktop computer or a smart cellular phone), say as a strap-on device.
  • a computing device such as a desktop computer or a smart cellular phone
  • the apparatus may include one or more pressure meters deployed on the upper arm, for measuring pressure applied on sides of the upper arm by muscle of the upper arm, as described in further detail hereinbelow.
  • the upper arm is the region between the shoulder and the elbow, composed of the humerus bone with the elbow joint at its distal end.
  • the elbow joint is the synovial hinge joint between the humerus bone in the upper arm and the radius and ulna bones in the forearm.
  • Elbow extension primarily results from contraction of the triceps, a large muscle located at the posterior (back) aspect of the upper arm.
  • the triceps muscle usually remains intact following amputation performed below the shoulder.
  • the apparatus may further include one or more orientation measurers (say gyroscopic devices), also deployed on the upper arm, for measuring orientation of the upper arm, as described in further detail hereinbelow.
  • orientation measurers say gyroscopic devices
  • the apparatus further includes a computer processor which derives control data from the measured pressure and orientation, and a transmitter which transmits the derived control data, over a wireless or wired connection, to the computing device.
  • the computer processor may include, but is not limited to: a microprocessor, a microcontroller (typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip), or any other hardware component (say an integrated circuit) capable on performing calculations based on the measured pressures and orientations.
  • a microprocessor typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip
  • any other hardware component say an integrated circuit
  • control data as derived before transmission may already comply with a standard computer mouse protocol, say the standard MicrosoftTM serial mouse protocol that is supported by major operating systems, as known in the art.
  • the apparatus may further include a data converter (say a dedicated driver program) which runs on the computing device and converts the control data into control data that is compliant with a standard computer mouse protocol, or to other computer control data. Consequently, the apparatus may translate movement of muscle of the upper arm, even after amputation, into computer control operations in general, and mouse functions in particular.
  • a data converter say a dedicated driver program
  • the apparatus may thus be suitable for use by amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm.
  • the present embodiment may provide a more intuitive and non-invasive human-computer interface for amputees.
  • the interface may provide a user experience closer to regular mouse operation than other alternatives currently available to arm amputees, as well as encourage continues use of the amputee's arm muscles.
  • the apparatus may also be used by non-amputees.
  • the apparatus may be used by workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse).
  • Fig. 1 is a block diagram schematically illustrating a first apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • An exemplary apparatus 1000 may be worn on an upper arm 101 of a user of a computing device, such as a desktop computer, a computer in an industrial environment, a smart cellular phone, etc., as known in the art.
  • a computing device such as a desktop computer, a computer in an industrial environment, a smart cellular phone, etc.
  • the apparatus 1000 may be worn on the upper arm 101, using a strap or a bracelet that parts of the apparatus 1000 may be fitted on.
  • the apparatus 1000 includes one or more sensors 110, say pressure meters (say Force Sensing Resistors), orientation measurers (say gyroscopic devices), etc., as described in further detail hereinbelow.
  • sensors 110 say pressure meters (say Force Sensing Resistors), orientation measurers (say gyroscopic devices), etc., as described in further detail hereinbelow.
  • the sensors 110 include one or more pairs of pressure meters that are arranged on the strap or bracelet, such that when the apparatus 1000 is worn by the user, each two pressure meters of a pair are deployed on preferable areas of the upper arm 101.
  • the pair of pressure meters is positioned over opposite sides of the muscle (say the triceps), say a first pressure meter 110 opposite a second pressure meter 110.
  • the two pressure meters serve as control references for each other, as providers of complementary information, etc., as described in further detail hereinbelow.
  • the sensors 110 may include one or more pairs of orientation measurers that are arranged on the strap or bracelet, such that when the apparatus 1000 is worn by the user, each two orientation measurers of a pair are deployed on preferable areas of the upper arm 101, say on areas positioned over opposite sides of the muscle (say the triceps).
  • the pair of orientation measurers is positioned over opposite sides of the muscle, say a first orientation measurer 110 opposite a second orientation measurer 110.
  • the two orientation measurers may be serve as control references for each other, as providers of complementary information, etc., as described in further detail hereinbelow.
  • the apparatus 1000 further includes a computer processor 130, connected to the sensors 110, which is programmed to derive control data from the sensor's 110 measurements, as described in further detail hereinbelow.
  • the computer processor 130 may include, but is not limited to: a microprocessor, a microcontroller (typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip), or any other hardware component (say an integrated circuit) capable on performing calculations based on the measurements .
  • a microprocessor typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip
  • any other hardware component say an integrated circuit
  • the apparatus 1000 further includes a transmitter 140 connected to the computer processor 130.
  • the transmitter 140 transmits the derived control data, over a wireless (say
  • Bluetooth ® or over a wired connection, to the computing device.
  • control data as derived before transmission already complies with a standard computer mouse protocol, say with the standard MicrosoftTM serial mouse protocol that is supported by major operating systems, as known in the art.
  • the apparatus 1000 may further include a data converter (not shown), such as a driver program which runs on the computing device.
  • the data converter converts the control data into control data that is compliant with a standard computer mouse protocol or to other computer control data, and inputs the converted data as input to the computing device's operating system, as described in further detail hereinbelow.
  • the apparatus 1000 may translate movement of muscle of the upper arm 101 into computer control operations in general, and mouse functions in particular.
  • the apparatus 1000 may thus be suitable for use by amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm 101.
  • the apparatus 1000 may also be used by non-amputees.
  • the apparatus may be used by workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse).
  • a computing device say a computer in an assembly line or in a warehouse.
  • the apparatus 1000 may also include a power source (not shown), say one or more batteries, as known in the art.
  • a power source say one or more batteries, as known in the art.
  • FIG. 2 is a block diagram schematically illustrating a second apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • An exemplary apparatus 2000 may be worn on an upper arm of a user of a computing device.
  • the computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user of the apparatus 2000, as known in the art.
  • the apparatus 2000 includes one or more orientation measurers 210, deployable on one or more areas of an upper arm of a user, say using a strap or a bracelet wearable on the upper arm, on which the one or more orientation measurers 210 are arranged, as described in further detail hereinabove.
  • Each one of the orientation measurers 210 measures orientation of the upper arm, on the area on which the orientation measurer 210 is deployed.
  • Each one of the orientation measurers 210 may include, but is not limited to one or more of: a gyroscope, a GPS (Global Positioning System) receiver, an accelerometer, an IMU (Inertial Measurement Unit), etc., as known in the art, or any combination thereof.
  • one or more of the orientation measurers 210 measures angular orientation of the upper arm.
  • the orientation measurer 210 may measure an angle of inclination of the orientation measurer 210, and hence of the upper arm, with respect to a preselected surface of reference.
  • the measured angle may also be described as a rotation that would be needed to move the orientation measurer 210 from the surface to the orientation measurer's 210 location, as known in the art.
  • one or more of the orientation measurers 210 measures bi- dimensional positional orientation of the orientation measurer 210, and hence of the upper arm.
  • the orientation measurer 210 may measure position of the orientation measurer's 210 projection on a preselected surface of reference, as known in the art.
  • one or more of the orientation measurers 210 measures tridimensional positional orientation of the orientation measurer 210, and hence of the upper arm.
  • the orientation measurer 210 may measure the orientation measurer's 210 spatial position, with respect to a pre-defined three dimensional coordinate system, as known in the art.
  • the orientation measurers 210 include one or more pairs of orientation measurers 210 that are arranged on the strap or bracelet, such that when the apparatus 2000 is worn by the user, each two orientation measurers 210 of a pair are deployed on preferable areas of the user's upper arm.
  • the pair of orientation measurers 210 is positioned over opposite sides of the muscle (say the triceps), say a first orientation measurer 210 opposite a second orientation measurer 210.
  • the two orientation measurers 210 of each pair serve as control references for each other, as providers of complementary information (i.e. measurement), etc., as described in further detail hereinbelow.
  • the apparatus 2000 further includes one or more pressure meters 220, deployable on one or more areas of an upper arm of a user.
  • Each of the pressure meters 220 measures pressure on the upper arm's area on which the pressure meter 220 is deployed.
  • Each one of the pressure meters 220 may include, but is not limited to one or more of: a conductive polymer based pressure sensor such as an FSR (Force Sensing Resistor), a capacitive-based pressure sensor, an electromagnetic sensor, etc., as known in the art, or any combination thereof.
  • a conductive polymer based pressure sensor such as an FSR (Force Sensing Resistor)
  • FSR Force Sensing Resistor
  • capacitive-based pressure sensor such as an FSR (Force Sensing Resistor)
  • an electromagnetic sensor etc.
  • the pressure meters 220 include one or more pairs of pressure meters 220 that are arranged on the strap or bracelet, such that when the apparatus 2000 is worn by the user, each two pressure meters 220 of a pair are deployed on preferable areas of the user's upper arm.
  • the pair of pressure meters 220 is positioned over opposite sides of the muscle (say the triceps), say a first pressure meter 220 opposite a second pressure meter 220.
  • the two pressure meters 220 of each pair may serve as control references for each other, as providers of complementary information (i.e. measurements), etc., as described in further detail hereinbelow.
  • the apparatus 2000 further includes a computer processor 230, in communication with the orientation measurers 210 and pressure meters 220.
  • the computer processor 230 may include, but is not limited to: a microprocessor, a microcontroller (typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip), or any other hardware component (say an integrated circuit) capable on performing calculations based on the measured orientations and pressures.
  • the computer processor 230 is configured (say by programming), to derive control data from the measured orientation and pressure, as described in further detail hereinbelow.
  • the computer processor 230 compares a measurement of a first one of the orientation measurers 210 with a measurement of a second one of the orientation measurers 210, for deriving the control data.
  • the computer processor 230 may use measurements of two orientation measurers 210 deployed on opposite sides of the upper arm's muscle, as control references of each other (say by verifying that the two measurements do not significantly differ from each other).
  • the computer processor 230 may use measurements of two orientation measurers 210 deployed on opposite sides of the upper arm's muscle, as complementary information, for deriving the control data.
  • the computer processor 230 may use calculations based on measurements by both orientation measurers 210 of the pair, for deriving the control data.
  • the calculations are of a change in angular orientation of a theoretical line which connects the two orientation measurers 210, with respect to a preselected surface of reference.
  • the computer processor 230 may compare a measurement of a first one of the pressure meters 220 with a measurement of a second one of the pressure meters 220, for deriving the control data.
  • the computer processor 230 may use measurements of two pressure meters 220 deployed on opposite sides of the upper arm's muscle, as control references of each other (say by verifying that the two measurements do not significantly differ from each other).
  • the computer processor 230 may use measurements of two pressure meters 220 deployed on opposite sides of the upper arm's muscle, as complementary information, for deriving the control data.
  • the computer processor 230 may use calculations based on measurements by both pressure meters 220 of the pair, for deriving the control data.
  • the apparatus 2000 further includes a data transmitter 240, in communication with the computer processor 230.
  • the transmitter 240 transmits the control data to the computing device in use by the user of apparatus 2000.
  • the transmitter 240 transmits the control data to the computing device over a wired connection.
  • the transmitter 240 may include an electric circuit that transmits the control data over wires.
  • the wires may be connected to one of the computing device's USB (Universal Serial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
  • USB Universal Serial Bus
  • the transmitter 240 transmits the control data to the computing device over a wireless connection.
  • the transmitter 240 may include an electronic communications circuit that transmits the control data as radio-frequency (RF) signals, say in the Bluetooth ® frequency range (2.400 GHz - 2.480 GHz).
  • RF radio-frequency
  • control data is already compliant with a standard computer mouse protocol, say with the standard MicrosoftTM serial mouse protocol (supported by major operating systems), as known in the art.
  • the computer processor 230 does not derive the control data as compliant with a standard mouse protocol, but the apparatus 2000 further includes a data converter (not shown) implemented on the computing device, say a driver program which runs on the computing device.
  • a data converter (not shown) implemented on the computing device, say a driver program which runs on the computing device.
  • the data converter receives the transmitted control data, converts the control data into control data that is compliant with the standard computer mouse protocol, and inputs the compliant control data to the computing device's operating system (say MS ® Windows, Android, etc.).
  • the computing device's operating system say MS ® Windows, Android, etc.
  • the computing device's operating system Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
  • the computer processor 230 may translate changes in pressure, orientation (or both), as measured by the pressure meters 220, orientation measurers 210 (or both), respectively, into computer mouse operation data.
  • the computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse rather than the apparatus 2000.
  • the computer processor 230 may translate a pressure change measured by one or more of the pressure meters 220, into computer mouse clicking operation data included in the derived control data.
  • the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse).
  • the computer processor 230 may translate an angular orientation change measured by one or more of the orientation measurers 210, into computer mouse clicking operation data included in the derived control data.
  • the control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse), as described in further detail hereinbelow.
  • the computer processor 230 may translate a movement in a predefined direction, measured by one or more of the orientation measurers 210, into computer mouse clicking operation data included in the derived control data.
  • the control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse), as described in further detail hereinbelow.
  • the computer processor 230 may translate an angular orientation change measured by one or more of the orientation measurers 210, into mouse speed change data included in the derived control data (say data which brings about a change similar to a change in speed in which a user moves a computer mouse), as described in further detail hereinbelow.
  • the apparatus 2000 may translate movement of muscle of the user's upper arm into computer control operations in general, and mouse functions in particular.
  • the apparatus 2000 may thus be suitable for use by amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
  • the exemplary apparatus 2000 may provide a more intuitive and non-invasive human-computer interface for amputees, as well as encourage continues use of the amputee's arm muscles.
  • the apparatus 2000 may also be used by non-amputees.
  • the apparatus 2000 may be used by workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse).
  • the apparatus 2000 may also include a power source (not shown), say one or more batteries, as known in the art.
  • a power source say one or more batteries, as known in the art.
  • FIG. 3 is a block diagram schematically illustrating a third apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • An exemplary apparatus 3000 may be worn on an upper arm of a user of a computing device.
  • the computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user of the apparatus 3000, as known in the art.
  • the apparatus 3000 includes one or more orientation measurers 310, deployable on one or more areas of an upper arm of a user, say using a strap or a bracelet wearable on the upper arm, on which the one or more orientation measurers 310 are arranged, as described in further detail hereinabove.
  • Each one of the orientation measurers 310 measures orientation of the upper arm, on the area on which the orientation measurer 310 is deployed.
  • Each one of the orientation measurers 310 may include, but is not limited to one or more of: a gyroscope, a GPS (Global Positioning System) receiver, an accelerometer, an IMU (Inertial Measurement Unit), etc., as known in the art, or any combination thereof.
  • one or more of the orientation measurers 310 measures angular orientation of the upper arm.
  • the orientation measurer 310 may measure an angle of inclination of the orientation measurer 310, and hence of the upper arm, with respect to a preselected surface of reference.
  • the measured angle may also be described as a rotation that would be needed to move the orientation measurer 310 from the surface to the orientation measurer's 310 location, as known in the art.
  • one or more of the orientation measurers 310 measures tridimensional positional orientation of the orientation measurer 310, and hence of the upper arm.
  • the orientation measurer 310 may measure position of the orientation measurer's 310 projection on a preselected surface of reference, as known in the art.
  • one or more of the orientation measurers 230 measures tridimensional positional orientation of the orientation measurer 310, and hence of the upper arm.
  • the orientation measurer 310 may measure the orientation measurer's 310 spatial position, with respect to a pre-defined three dimensional coordinate system, as known in the art.
  • the orientation measurers 310 include one or more pairs of orientation measurers 310 that are arranged on the strap or bracelet, such that when the apparatus 3000 is worn by the user, each two orientation measurers 310 of a pair are deployed on preferable areas of the user's upper arm.
  • the pair of orientation measurers 310 is positioned over opposite sides of the muscle (say the triceps), say a first orientation measurer 310 opposite a second orientation measurer 310.
  • the two orientation measurers 310 of each pair serve as control references for each other, as providers of complementary information (i.e. measurement), etc., as described in further detail hereinbelow.
  • the apparatus 3000 further includes a computer processor 330, in communication with the orientation measurers 310.
  • the computer processor 330 is configured (say by programming), to derive control data from the orientation measured by the orientation measurers 310, as described in further detail hereinbelow.
  • the computer processor 330 may include, but is not limited to: a microprocessor, a microcontroller (typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip), or any other hardware component (say an integrated circuit) capable on performing calculations based on the measured orientations.
  • a microprocessor typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip
  • any other hardware component say an integrated circuit
  • the computer processor 330 compares a measurement of a first one of the orientation measurers 310 with a measurement of a second one of the orientation measurers 310, for deriving the control data.
  • the computer processor 330 may use measurements of two orientation measurers 310 deployed on opposite sides of the upper arm's muscle, as control references of each other (say by verifying that the two measurements do not significantly differ from each other).
  • the computer processor 330 may use measurements of two orientation measurers 310 deployed on opposite sides of the upper arm's muscle (say triceps), as complementary information, for deriving the control data.
  • the computer processor 330 may use calculations based on measurements by both orientation measurers 310 of the pair, for deriving the control data.
  • the calculations are of a change in angular orientation of a theoretical line which connects the two orientation measurers 310, with respect to a preselected surface of reference.
  • the apparatus 3000 further includes a data transmitter 340, in communication with the computer processor 330.
  • the transmitter 340 transmits the control data to the computing device in use by the user of apparatus 3000.
  • the transmitter 340 transmits the control data to the computing device over a wired connection.
  • the transmitter 240 may include an electric circuit that transmits the control data over wires connected to one of the computing device's USB (Universal Serial Bus) sockets, etc., as known in the art.
  • USB Universal Serial Bus
  • the transmitter 340 transmits the control data to the computing device over a wireless connection.
  • the transmitter 340 may include an electronic communications circuit that transmits the control data as radio-frequency (RF) signals, say in the Bluetooth ® frequency range.
  • RF radio-frequency
  • the computer processor 330 derives the control data as control data that is already compliant with a standard computer mouse protocol, say with the standard MicrosoftTM serial mouse protocol (supported by major operating systems), as known in the art.
  • the computer processor 330 does not derive the control data as compliant with a standard mouse protocol, but the apparatus 3000 further includes a data converter (not shown) implemented on the computing device, say a driver program which runs on the computing device.
  • the data converter receives the transmitted control data, converts the control data into control data that is compliant with the standard computer mouse protocol, and inputs the compliant control data to the computing device's operating system (say MS ® Windows, Android, etc.).
  • the computing device's operating system Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
  • the computer processor 330 may translate changes in orientation, as measured by the orientation measurers 310, into computer mouse operation data.
  • the computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse rather than the apparatus 3000.
  • the computer processor 330 may translate an angular orientation change measured by one or more of the orientation measurers 310, into computer mouse clicking operation data included in the derived control data.
  • the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse).
  • the computer processor 330 may translate a movement in a predefined direction, measured by one or more of the orientation measurers 310, into computer mouse clicking operation data included in the derived control data.
  • the control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse), as described in further detail hereinbelow.
  • the computer processor 330 may translate an angular orientation change measured by one or more of the orientation measurers 310, into mouse speed change data included in the derived control data (say data which brings about a change similar to a change in speed in which a user moves a computer mouse).
  • the apparatus 3000 may translate movement of muscle of the user's upper arm into computer control operations in general, and mouse functions in particular.
  • the apparatus 3000 may thus be suitable for use by amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
  • the apparatus 3000 may also be used by non-amputees.
  • the apparatus 3000 may be used by workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse).
  • the apparatus 3000 may also include a power source (not shown), say one or more batteries, as known in the art.
  • a power source say one or more batteries, as known in the art.
  • FIG. 4 is a block diagram schematically illustrating a fourth apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • An exemplary apparatus 4000 may be worn on an upper arm of a user of a computing device, as described in further detail hereinabove.
  • the computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user of the apparatus 4000, as known in the art.
  • the apparatus 4000 includes one or more pressure meters 420, deployable on one or more areas of an upper arm of a user.
  • Each of the pressure meters 420 measures pressure on the upper arm's area on which the pressure meter 420 is deployed.
  • Each one of the pressure meters 420 may include, but is not limited to one or more of: a conductive polymer based pressure sensor such as an FSR (Force Sensing Resistor), a capacitive-based pressure sensor, an electromagnetic sensor, etc., as known in the art, or any combination thereof.
  • a conductive polymer based pressure sensor such as an FSR (Force Sensing Resistor)
  • FSR Force Sensing Resistor
  • capacitive-based pressure sensor such as an FSR (Force Sensing Resistor)
  • an electromagnetic sensor etc.
  • the pressure meters 420 include one or more pairs of pressure meters 420 that are arranged on the strap or bracelet, such that when the apparatus 4000 is worn by the user, each two pressure meters 420 of a pair are deployed on preferable areas of the user's upper arm.
  • the pair of pressure meters 420 is positioned over opposite sides of the muscle (say the triceps), say a first pressure meter 420 opposite a second pressure meter 420.
  • the two pressure meters 420 of each pair may serve as control references for each other, as providers of complementary information (i.e. measurements), etc., as described in further detail hereinbelow.
  • the apparatus 4000 further includes a computer processor 430, in communication with the pressure meters 420.
  • the computer processor 430 is configured (say by programming), to derive control data from the measured pressure, as described in further detail hereinbelow.
  • the computer processor 430 may include, but is not limited to: a microprocessor, a microcontroller (typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip), or any other hardware component (say an integrated circuit) capable on performing calculations based on the measured pressures.
  • a microprocessor typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip
  • any other hardware component say an integrated circuit
  • the computer processor 430 may compare a measurement of a first one of the pressure meters 420 with a measurement of a second one of the pressure meters 420, for deriving the control data.
  • the computer processor 430 may use measurements of two pressure meters 420 deployed on opposite sides of the upper arm's muscle, as control references of each other (say by verifying that the two measurements do not significantly differ from each other).
  • the computer processor 430 may use measurements of two pressure meters 420 deployed on opposite sides of the upper arm's muscle, as complementary information, for deriving the control data.
  • the computer processor 430 may use calculations based on measurements by both pressure meters 420 of the pair, for deriving the control data.
  • the apparatus 4000 further includes a data transmitter 440, in communication with the computer processor 430.
  • the transmitter 440 transmits the control data to the computing device in use by the user of apparatus 4000.
  • the transmitter 440 transmits the control data to the computing device over a wired connection.
  • the transmitter 240 may include an electric circuit that transmits the control data over wires.
  • the wires may be connected to one of the computing device's USB (Universal Serial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
  • USB Universal Serial Bus
  • the transmitter 440 transmits the control data to the computing device over a wireless connection.
  • the transmitter 440 may include an electronic communications circuit that transmits the control data as radio-frequency (RF) signals, say in the Bluetooth ® frequency range .
  • RF radio-frequency
  • control data is already compliant with a standard computer mouse protocol, say with the standard MicrosoftTM serial mouse protocol (supported by major operating systems), as known in the art.
  • the computer processor 430 does not derive the control data as compliant with a standard mouse protocol, but the apparatus 4000 further includes a data converter (not shown) implemented on the computing device, say a driver program which runs on the computing device.
  • a data converter (not shown) implemented on the computing device, say a driver program which runs on the computing device.
  • the data converter receives the transmitted control data, converts the control data into control data that is compliant with the standard computer mouse protocol, and inputs the compliant control data to the computing device's operating system (say MS ® Windows, Android, etc.).
  • the computing device's operating system say MS ® Windows, Android, etc.
  • the computing device's operating system Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
  • the computer processor 430 may translate changes in pressure, as measured by the pressure meters 420, into computer mouse operation data.
  • the computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse rather than the apparatus 4000.
  • the computer processor 430 may translate a pressure change measured by one or more of the pressure meters 420 into computer mouse clicking operation data included in the derived control data.
  • the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse).
  • the apparatus 4000 may translate movement of muscle of the user's upper arm into computer control operations in general, and mouse functions in particular.
  • the apparatus 4000 may thus be suitable for use by amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
  • the apparatus 4000 may also be used by non-amputees, say workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse).
  • a computing device say a computer in an assembly line or in a warehouse.
  • the apparatus 4000 may also include a power source (not shown), say one or more batteries, as known in the art.
  • a power source say one or more batteries, as known in the art.
  • FIG. 5 is a flowchart illustrating a first method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • a computing device may be controlled by muscle of an upper arm of a user of the computing device, say through upper arm movement or pressure applied by the muscle on sides of the upper arm, as described in further detail hereinabove.
  • the computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user.
  • orientation of the upper arm of the user is measured 510 on one or more areas of the upper arm, say by the orientation measurers 210 of apparatus 2000.
  • Each one of the orientation measurers 210 measures orientation of the upper arm, on the area on which the orientation measurer 210 is deployed.
  • the orientation may be measured 510 using one or more of: a gyroscope, a
  • the measured 510 orientation is an angular orientation of the upper arm.
  • the angular orientation may be measured 510 as an angle of inclination of the upper arm, with respect to a preselected surface of reference.
  • the measured 510 angle may also be described as a rotation that would be needed to move the upper arm from the surface of reference, to the upper arm's location, as described in further detail hereinabove.
  • the measured 510 orientation is a bi-dimensional positional orientation of the upper arm.
  • the orientation may be measured 510 as position of the orientation measurer's 210 projection on a preselected surface of reference, as described in further detail hereinabove.
  • the measured 510 orientation is a tri-dimensional positional orientation of the upper arm.
  • the orientation may be measured 510 as the orientation measurer's 210 spatial position, with respect to a pre-defined three dimensional coordinate system, as described in further detail hereinabove.
  • the exemplary method further includes measuring 510 of pressure applied by muscle of the upper arm on one or more areas of the upper arm, say by the pressure meters 220 of apparatus 2000 (where each pressure meter 220 is deployed on a respective one of the areas), as described in further detail hereinabove.
  • the method further includes deriving 530 control data from the measured 510 pressure and orientation, say by the computer processor 230 of apparatus 2000, as described in further detail hereinabove.
  • the method further includes comparing an orientation measured
  • the orientations may be measured
  • a pair of orientations measured 510 on opposite sides of the upper arm's muscle may be used as control references of each other
  • a pair of orientations measured 510 on opposite sides of the upper arm's muscle may be used as complementary information, for deriving the control data.
  • calculations based on orientations measured 510 by both orientation measurers 210 of a pair of orientation measurers 210 deployed over opposite sides of the upper arm muscle may be used for deriving the control data.
  • the calculations are of a change in angular orientation of a theoretical line which connects the two orientation measurers 210 of the pair, with respect to a preselected surface of reference, as described in further detail hereinabove.
  • the method may include comparing pressures measured 510 on at least two of the upper arm areas, for deriving the control data, say using a pair of pressure meters 220 deployed on opposite sides of the upper arm's muscle, opposite each other, as described in further detail hereinabove.
  • pressures measured 510 on at least two of the areas are used as control references of each other (say by verifying that the two measured 510 pressures do not significantly differ from each other).
  • pressures measured 510 on at least two of the areas are used as complementary information, for deriving the control data, say through calculations based on pressures measured 510 by both pressure meters 220 of a pair, as described in further detail hereinabove.
  • the derived 530 control data is transmitted 540 to the computing device, say using the transmitter 240 of apparatus 2000.
  • the derived 530 control data is transmitted 540 over a wired connection, say over wires connected to one of the computing device's USB (Universal Serial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
  • a wired connection say over wires connected to one of the computing device's USB (Universal Serial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
  • the derived 530 control data is transmitted 540 over a wireless connection, say as radio-frequency (RF) signals in the Bluetooth ® frequency range (2.400 GHz - 2.480 GHz) or in another frequency range.
  • RF radio-frequency
  • control data is derived 530 as control data that is already compliant with a standard computer mouse protocol, say with the standard MicrosoftTM serial mouse protocol (supported by major operating systems), as known in the art.
  • control data does not comply with a standard mouse protocol, but upon receipt on the computing device, is converted into control data that is compliant with the standard computer mouse protocol, on the computing device, say by the data converter of apparatus 2000.
  • the compliant control data is input to the computing device's operating system (say MS ® Windows, Android, etc.), say by the data converter of apparatus 2000.
  • MS ® Windows, Android, etc. the computing device's operating system
  • the computing device's operating system Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
  • changes in pressure, orientation, or both, as measured 510 on the areas of the upper arm are translated into computer mouse operation data.
  • the computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse.
  • a pressure change measured 510 on one or more areas of the upper arm is translated into computer mouse clicking operation data included in the derived 530 control data.
  • the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse).
  • an angular orientation change measured 510 on one or more areas of the upper arm is translated into computer mouse clicking operation data included in the derived 530 control data.
  • control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse), as described in further detail hereinabove.
  • a movement in a predefined direction, measured 510 on one or more areas of the upper arm, is translated into computer mouse clicking operation data included in the derived 530 control data. Consequently, the control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse), as described in further detail hereinabove.
  • an angular orientation change measured 510 on one or more areas of the upper arm is translated into mouse speed change data included in the derived 530 control data (say data which brings about a change similar to a change in speed in which a user moves a computer mouse).
  • the method may thus be suitable for amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
  • the method is usable for non-amputees too.
  • a computing device say a computer in an assembly line or in a warehouse, as described in further detail hereinabove.
  • FIG. 6 is a flowchart illustrating a second method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • a computing device may be controlled by muscle of an upper arm of a user of a computing device, say by movement of the upper arm, as described in further detail hereinabove.
  • the computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user.
  • orientation of the upper arm of the user is measured 610 on one or more areas of the upper arm, say by the orientation measurers 310 of apparatus 3000.
  • Each one of the orientation measurers 310 measures orientation of the upper arm, on the area on which the orientation measurer 310 is deployed.
  • the orientation may be measured 610 using one or more of: a gyroscope, a
  • the measured 610 orientation is an angular orientation of the upper arm.
  • the angular orientation may be measured 610 as an angle of inclination of the upper arm, with respect to a preselected surface of reference.
  • the measured 610 angle may also be described as a rotation that would be needed to move the upper arm from the surface of reference, to the upper arm's location, as described in further detail hereinabove.
  • the measured 610 orientation is a bi-dimensional positional orientation of the upper arm.
  • the orientation may be measured 610 as position of the orientation measurer's 310 projection on a preselected surface of reference, as described in further detail hereinabove.
  • the measured 610 orientation is a tri-dimensional positional orientation of the upper arm.
  • the orientation may be measured 610 as the orientation measurer's 310 spatial position, with respect to a pre-defined three dimensional coordinate system, as described in further detail hereinabove.
  • the method further includes deriving 630 control data from the measured 610 orientation, say by the computer processor 330 of apparatus 3000, as described in further detail hereinabove.
  • the method further includes comparing an orientation measured 610 on a first area of the upper arm with an orientation measured 610 on a second area of the upper arm, for deriving the control data.
  • the orientations may be measured 610 by a pair of orientation measurers 310 deployed opposite each other, say on opposite sides of the upper arm's muscle, as described in further detail hereinabove.
  • a pair of orientations measured 610 on opposite sides of the upper arm's muscle may be used as control references of each other (say by verifying that the two measured 610 orientations do not significantly differ from each other), as described in further detail hereinabove.
  • a pair of orientations measured 610 on opposite sides of the upper arm's muscle may be used as complementary information, for deriving the control data. For example, calculations based on orientations measured 610 by both orientation measurers 310 of a pair of orientation measurers 310 deployed over opposite sides of the upper arm muscle, may be used for deriving the control data.
  • the calculations are of a change in angular orientation of a theoretical line which connects the two orientation measurers 310 of the pair, with respect to a preselected surface of reference, as described in further detail hereinabove.
  • the derived 630 control data is transmitted 640 to the computing device, say using the transmitter 340 of apparatus 3000.
  • the derived 630 control data is transmitted 640 over a wired connection, say over wires connected to one of the computing device's USB (Universal erial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
  • a wired connection say over wires connected to one of the computing device's USB (Universal erial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
  • the derived 630 control data is transmitted 640 over a wireless connection, say as radio-frequency (RF) signals in the Bluetooth ® frequency range (2.400 GHz - 2.480 GHz) or in another frequency range.
  • RF radio-frequency
  • control data is derived 630 as control data that is already compliant with a standard computer mouse protocol, say with the standard MicrosoftTM serial mouse protocol (supported by major operating systems), as known in the art.
  • control data does not comply with a standard mouse protocol, but upon receipt on the computing device, is converted into control data that is compliant with the standard computer mouse protocol, on the computing device, say by the data converter of apparatus 3000.
  • the compliant control data is input to the computing device's operating system
  • the computing device's operating system Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
  • changes in orientation of the upper arm of the user, as measured 610 on the areas of the upper arm, are translated into computer mouse operation data.
  • the computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse.
  • an angular orientation change measured 610 on one or more areas of the upper arm is translated into computer mouse clicking operation data included in the derived 630 control data.
  • the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse).
  • a movement in a predefined direction, measured 610 on one or more areas of the upper arm, is translated into computer mouse clicking operation data included in the derived 630 control data.
  • control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse), as described in further detail hereinabove.
  • an angular orientation change measured 610 on one or more areas of the upper arm is translated into mouse speed change data included in the derived 630 control data (say data which brings about a change similar to a change in speed in which a user moves a computer mouse).
  • the method may thus be suitable for amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
  • the method is usable for non-amputees too.
  • a computing device say a computer in an assembly line or in a warehouse, as described in further detail hereinabove.
  • FIG. 7 is a flowchart illustrating a third method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
  • a computing device may be controlled by muscle of an upper arm of a user of a computing device, say through pressure applied by the muscle on sides of the upper arm, as described in further detail hereinabove.
  • the computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user.
  • pressure applied by muscle of the upper arm on one or more areas of the upper arm is measured 720, say by the pressure meters 420 of apparatus 4000 (where each pressure meter 420 is deployed on a respective one of the areas), as described in further detail hereinabove.
  • the method further includes deriving 730 control data from the measured 720 pressure, say by the computer processor 430 of apparatus 4000, as described in further detail hereinabove.
  • the method includes comparing pressures measured 720 on at least two of the upper arm areas, for deriving the control data, say using a pair of pressure meters 420 deployed on opposite sides of the upper arm's muscle, opposite each other, as described in further detail hereinabove.
  • pressures measured 720 on at least two of the areas are used as control references of each other (say by verifying that the two measured 720 pressures do not significantly differ from each other).
  • pressures measured 720 on at least two of the areas are used as complementary information, for deriving the control data, say through calculations based on pressures measured 720 by both pressure meters 420 of a pair, as described in further detail hereinabove.
  • the derived 730 control data is transmitted 740 to the computing device, say using the transmitter 440 of apparatus 4000.
  • the derived 730 control data is transmitted 740 over a wired connection, say over wires connected to one of the computing device's USB (Universal erial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
  • a wired connection say over wires connected to one of the computing device's USB (Universal erial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
  • USB Universal erial Bus
  • the derived 730 control data is transmitted 740 over a wireless connection, say as radio-frequency (RF) signals in the Bluetooth ® frequency range (2.400 GHz - 2.480 GHz) or in another frequency range.
  • RF radio-frequency
  • control data is derived 730 as control data that is already compliant with a standard computer mouse protocol, say with the standard MicrosoftTM serial mouse protocol (supported by major operating systems), as known in the art.
  • control data does not comply with a standard mouse protocol, but upon receipt on the computing device, is converted into control data that is compliant with the standard computer mouse protocol, on the computing device, say by the data converter of apparatus 4000.
  • the compliant control data is input to the computing device's operating system (say MS ® Windows, Android, etc.), say by the data converter of apparatus 4000.
  • MS ® Windows, Android, etc. the computing device's operating system
  • the computing device's operating system Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
  • changes in pressure applied to one or more areas of the upper arm, as measured 720 on the areas of the upper arm, are translated into computer mouse operation data.
  • the computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse.
  • a pressure change measured 720 on one or more areas of the upper arm may be translated into computer mouse clicking operation data included in the derived 730 control data.
  • the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft ® Mouse).
  • the method may thus be suitable for amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
  • the method is usable for non-amputees too.
  • a computing device say a computer in an assembly line or in a warehouse, as described in further detail hereinabove.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Automation & Control Theory (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Physiology (AREA)

Abstract

An upper-arm computer pointing apparatus, comprising: at least one orientation measurer, deployable on at least one area of an upper arm of a user, configured to measure orientation of the upper arm, at least one pressure meter, deployable on at least one area of the upper arm, configured to measure pressure applied by muscle of the upper arm, a computer processor, associated with the orientation measurer and pressure meter, configured to derive control data from the measured orientation and pressure, and a data transmitter, associated with the computer processor, configured to transmit the control data to a computing device.

Description

UPPER-ARM COMPUTER POINTING APPARATUS
FIELD AND BACKGROUND OF THE INVENTION
The present invention relates to computer pointing devices and, more particularly, but not exclusively to a computer mouse wearable on the upper arm of a computer user.
The most commonly used computer pointing device is the computer mouse.
Movement of the mouse about a flat surface typically located on a desktop causes movement of the cursor about the display screen. Selection of objects is accomplished by simultaneously holding the position of the cursor on top of the object while clicking, clicking and holding, or double clicking one or more buttons located on the mouse.
For example, mouse manipulation requires the user to: grasp the mouse; move the arm and wrist to position the mouse, as needed, to perform a scrolling function or to activate the buttons.
A mouse typically has anywhere from one to three buttons and most commonly has two buttons.
A variety of conditions, such as cerebral palsy, Parkinson's disease, multiple sclerosis, arthritis, etc., can fully or partially deprive a person of the manual motor control capacities needed to use a mouse, to move a cursor to a specific location on a display screen, and/or to select objects by operation of a mouse button.
Similarly, trauma, malignancy, congenital absence, and other conditions may result in loss of fingers, wrist, forearm, etc. Consequently, a person may be deprived of manual motor control capacities needed to use a computer mouse by moving the mouse about a flat surface and/or clicking the mouse buttons.
SUMMARY OF THE INVENTION
According to one aspect of the present invention, there is provided an upper- arm computer pointing apparatus, comprising: at least one orientation measurer, deployable on at least one area of an upper arm of a user, configured to measure orientation of the upper arm, at least one pressure meter, deployable on at least one area of the upper arm, configured to measure pressure applied by muscle of the upper arm, a computer processor, associated with the orientation measurer and pressure meter, configured to derive control data from the measured orientation and pressure, and a data transmitter, associated with the computer processor, configured to transmit the control data to a computing device.
According to a second aspect of the present invention, there is provided an upper-arm computer pointing apparatus, comprising: at least one orientation measurer, deployable on at least one area of an upper arm of a user, configured to measure orientation of the upper arm, a computer processor, associated with the orientation measurer, configured to derive control data from the measured orientation, and a data transmitter, associated with the computer processor, configured to transmit the control data to a computing device.
According to a third aspect of the present invention, there is provided an upper-arm computer pointing apparatus, comprising: at least one pressure meter, deployable on at least one area of the upper arm, configured to measure pressure applied by muscle of the upper arm, a computer processor, associated with the pressure meter, configured to derive control data from the measured pressure, and a data transmitter, associated with the computer processor, configured to transmit the control data to a computing device.
According to a fourth aspect of the present invention, there is provided a method for upper-arm computer pointing, comprising: measuring orientation of an upper arm of a user, on at least one area of the upper arm, measuring pressure applied by muscle of the upper arm, on at least one area of the upper arm, deriving control data from the measured orientation and pressure, and transmitting the control data to a computing device.
According to a fifth aspect of the present invention, there is provided a method for upper-arm computer pointing, comprising: measuring orientation of the upper arm, on at least one area of the upper arm, deriving control data from the measured orientation, and transmitting the control data to a computing device.
According to a sixth aspect of the present invention, there is provided a method for upper-arm computer pointing, comprising: measuring pressure applied by muscle of the upper arm, on at least one area of the upper arm, deriving control data from the measured pressure, and transmitting the control data to a computing device.
Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The materials, methods, and examples provided herein are illustrative only and not intended to be limiting.
Implementation of the method and system of the present invention involves performing or completing certain selected tasks or steps manually, automatically, or a combination thereof. Moreover, according to actual instrumentation and equipment of preferred embodiments of the method and system of the present invention, several selected steps could be implemented by hardware or by software on any operating system of any firmware or a combination thereof. For example, as hardware, selected steps of the invention could be implemented as a chip or a circuit. As software, selected steps of the invention could be implemented as a plurality of software instructions being executed by a computer using any suitable operating system. In any case, selected steps of the method and system of the invention could be described as being performed by a data processor, such as a computing platform for executing a plurality of instructions.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention is herein described, by way of example only, with reference to the accompanying drawings. With specific reference now to the drawings in detail, it is stressed that the particulars shown are by way of example and for purposes of illustrative discussion of the preferred embodiments of the present invention only, and are presented in order to provide what is believed to be the most useful and readily understood description of the principles and conceptual aspects of the invention. The description taken with the drawings making apparent to those skilled in the art how the several forms of the invention may be embodied in practice.
In the drawings:
Fig. 1 is a block diagram schematically illustrating a first apparatus for upper- arm computer pointing, according to an exemplary embodiment of the present invention.
Fig. 2 is a block diagram schematically illustrating a second apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
Fig. 3 is a block diagram schematically illustrating a third apparatus for upper- arm computer pointing, according to an exemplary embodiment of the present invention. Fig. 4 is a block diagram schematically illustrating a fourth apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
Fig. 5 is a flowchart illustrating a first method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
Fig. 6 is a flowchart illustrating a second method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
Fig. 7 is a flowchart illustrating a third method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
The present embodiments comprise apparatuses and methods for upper-arm computer pointing.
Currently, the most commonly used computer pointing device is the computer mouse.
Movement of the mouse about a flat surface typically located on a desktop causes movement of the cursor about the display screen. Selection of objects is accomplished by simultaneously holding the position of the cursor on top of the object while clicking, clicking and holding, or double clicking one or more buttons located on the mouse, etc.
A variety of conditions, such as cerebral palsy, Parkinson's disease, multiple sclerosis, arthritis, can fully or partially deprive a person of the manual motor control capacities needed to use a mouse, to move a cursor to a specific location on a display screen, and/or to select objects by operation of a mouse button.
In many cases, an upper extremity is amputated because of trauma from war injury, automobile accident, recreation or work-related injury. Malignancy, congenital absence of an extremity and other conditions account for a minority of amputation cases. In some countries, various levels of amputation are the result of punishment, torture and terrorism-related trauma.
An amputated person experiences loss of fingers, wrist, forearm, or other body extremity.
Consequently, the amputated person is deprived of manual motor control capacities needed to use a computer mouse by moving the mouse about a flat surface and/or clicking the mouse buttons. An apparatus according to an exemplary embodiment of the present invention may be worn on an upper arm of a user of a computing device (such as a desktop computer or a smart cellular phone), say as a strap-on device.
The apparatus may include one or more pressure meters deployed on the upper arm, for measuring pressure applied on sides of the upper arm by muscle of the upper arm, as described in further detail hereinbelow.
The upper arm is the region between the shoulder and the elbow, composed of the humerus bone with the elbow joint at its distal end. The elbow joint is the synovial hinge joint between the humerus bone in the upper arm and the radius and ulna bones in the forearm.
Elbow extension primarily results from contraction of the triceps, a large muscle located at the posterior (back) aspect of the upper arm. The triceps muscle usually remains intact following amputation performed below the shoulder.
The apparatus may further include one or more orientation measurers (say gyroscopic devices), also deployed on the upper arm, for measuring orientation of the upper arm, as described in further detail hereinbelow.
The apparatus further includes a computer processor which derives control data from the measured pressure and orientation, and a transmitter which transmits the derived control data, over a wireless or wired connection, to the computing device.
The computer processor may include, but is not limited to: a microprocessor, a microcontroller (typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip), or any other hardware component (say an integrated circuit) capable on performing calculations based on the measured pressures and orientations.
The control data as derived before transmission, may already comply with a standard computer mouse protocol, say the standard Microsoft™ serial mouse protocol that is supported by major operating systems, as known in the art.
Alternatively, the apparatus may further include a data converter (say a dedicated driver program) which runs on the computing device and converts the control data into control data that is compliant with a standard computer mouse protocol, or to other computer control data. Consequently, the apparatus may translate movement of muscle of the upper arm, even after amputation, into computer control operations in general, and mouse functions in particular.
The apparatus may thus be suitable for use by amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm.
By employing operation of the muscle (say the triceps) of the upper arm (i.e. a stump), the present embodiment, may provide a more intuitive and non-invasive human-computer interface for amputees. The interface may provide a user experience closer to regular mouse operation than other alternatives currently available to arm amputees, as well as encourage continues use of the amputee's arm muscles.
The apparatus may also be used by non-amputees. For example, the apparatus may be used by workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse).
The principles and operation of an apparatus and method according to the present invention may be better understood with reference to the drawings and accompanying description.
Before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of the components set forth in the following description or illustrated in the drawings.
The invention is capable of other embodiments or of being practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein is for the purpose of description and should not be regarded as limiting.
Reference is now made to Fig. 1, which is a block diagram schematically illustrating a first apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
An exemplary apparatus 1000, according to an exemplary embodiment of the present invention, may be worn on an upper arm 101 of a user of a computing device, such as a desktop computer, a computer in an industrial environment, a smart cellular phone, etc., as known in the art. For example, the apparatus 1000 may be worn on the upper arm 101, using a strap or a bracelet that parts of the apparatus 1000 may be fitted on.
The apparatus 1000 includes one or more sensors 110, say pressure meters (say Force Sensing Resistors), orientation measurers (say gyroscopic devices), etc., as described in further detail hereinbelow.
Optionally, the sensors 110 include one or more pairs of pressure meters that are arranged on the strap or bracelet, such that when the apparatus 1000 is worn by the user, each two pressure meters of a pair are deployed on preferable areas of the upper arm 101.
In one example, the pair of pressure meters is positioned over opposite sides of the muscle (say the triceps), say a first pressure meter 110 opposite a second pressure meter 110.
Optionally, the two pressure meters serve as control references for each other, as providers of complementary information, etc., as described in further detail hereinbelow.
Similarly, the sensors 110 may include one or more pairs of orientation measurers that are arranged on the strap or bracelet, such that when the apparatus 1000 is worn by the user, each two orientation measurers of a pair are deployed on preferable areas of the upper arm 101, say on areas positioned over opposite sides of the muscle (say the triceps).
In one example, the pair of orientation measurers is positioned over opposite sides of the muscle, say a first orientation measurer 110 opposite a second orientation measurer 110.
Optionally, the two orientation measurers may be serve as control references for each other, as providers of complementary information, etc., as described in further detail hereinbelow.
The apparatus 1000 further includes a computer processor 130, connected to the sensors 110, which is programmed to derive control data from the sensor's 110 measurements, as described in further detail hereinbelow.
The computer processor 130 may include, but is not limited to: a microprocessor, a microcontroller (typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip), or any other hardware component (say an integrated circuit) capable on performing calculations based on the measurements .
The apparatus 1000 further includes a transmitter 140 connected to the computer processor 130.
The transmitter 140 transmits the derived control data, over a wireless (say
Bluetooth®) or over a wired connection, to the computing device.
Optionally, the control data as derived before transmission, already complies with a standard computer mouse protocol, say with the standard Microsoft™ serial mouse protocol that is supported by major operating systems, as known in the art.
Alternatively, the apparatus 1000 may further include a data converter (not shown), such as a driver program which runs on the computing device. The data converter converts the control data into control data that is compliant with a standard computer mouse protocol or to other computer control data, and inputs the converted data as input to the computing device's operating system, as described in further detail hereinbelow.
Consequently, the apparatus 1000 may translate movement of muscle of the upper arm 101 into computer control operations in general, and mouse functions in particular.
The apparatus 1000 may thus be suitable for use by amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm 101.
The apparatus 1000 may also be used by non-amputees. For example, the apparatus may be used by workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse).
The apparatus 1000 may also include a power source (not shown), say one or more batteries, as known in the art.
Reference is now made to Fig. 2, which is a block diagram schematically illustrating a second apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
An exemplary apparatus 2000, according to an exemplary embodiment of the present invention, may be worn on an upper arm of a user of a computing device. The computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user of the apparatus 2000, as known in the art.
The apparatus 2000 includes one or more orientation measurers 210, deployable on one or more areas of an upper arm of a user, say using a strap or a bracelet wearable on the upper arm, on which the one or more orientation measurers 210 are arranged, as described in further detail hereinabove.
Each one of the orientation measurers 210 measures orientation of the upper arm, on the area on which the orientation measurer 210 is deployed.
Each one of the orientation measurers 210 may include, but is not limited to one or more of: a gyroscope, a GPS (Global Positioning System) receiver, an accelerometer, an IMU (Inertial Measurement Unit), etc., as known in the art, or any combination thereof.
Optionally, one or more of the orientation measurers 210 measures angular orientation of the upper arm.
For example, the orientation measurer 210 may measure an angle of inclination of the orientation measurer 210, and hence of the upper arm, with respect to a preselected surface of reference. The measured angle may also be described as a rotation that would be needed to move the orientation measurer 210 from the surface to the orientation measurer's 210 location, as known in the art.
Optionally, one or more of the orientation measurers 210 measures bi- dimensional positional orientation of the orientation measurer 210, and hence of the upper arm. For example, the orientation measurer 210 may measure position of the orientation measurer's 210 projection on a preselected surface of reference, as known in the art.
Optionally, one or more of the orientation measurers 210 measures tridimensional positional orientation of the orientation measurer 210, and hence of the upper arm. For example, the orientation measurer 210 may measure the orientation measurer's 210 spatial position, with respect to a pre-defined three dimensional coordinate system, as known in the art.
Optionally, the orientation measurers 210 include one or more pairs of orientation measurers 210 that are arranged on the strap or bracelet, such that when the apparatus 2000 is worn by the user, each two orientation measurers 210 of a pair are deployed on preferable areas of the user's upper arm.
In one example, the pair of orientation measurers 210 is positioned over opposite sides of the muscle (say the triceps), say a first orientation measurer 210 opposite a second orientation measurer 210.
Optionally, the two orientation measurers 210 of each pair serve as control references for each other, as providers of complementary information (i.e. measurement), etc., as described in further detail hereinbelow.
The apparatus 2000 further includes one or more pressure meters 220, deployable on one or more areas of an upper arm of a user.
Each of the pressure meters 220 measures pressure on the upper arm's area on which the pressure meter 220 is deployed.
Each one of the pressure meters 220 may include, but is not limited to one or more of: a conductive polymer based pressure sensor such as an FSR (Force Sensing Resistor), a capacitive-based pressure sensor, an electromagnetic sensor, etc., as known in the art, or any combination thereof.
Optionally, the pressure meters 220 include one or more pairs of pressure meters 220 that are arranged on the strap or bracelet, such that when the apparatus 2000 is worn by the user, each two pressure meters 220 of a pair are deployed on preferable areas of the user's upper arm.
In one example, the pair of pressure meters 220 is positioned over opposite sides of the muscle (say the triceps), say a first pressure meter 220 opposite a second pressure meter 220.
The two pressure meters 220 of each pair may serve as control references for each other, as providers of complementary information (i.e. measurements), etc., as described in further detail hereinbelow.
The apparatus 2000 further includes a computer processor 230, in communication with the orientation measurers 210 and pressure meters 220.
The computer processor 230 may include, but is not limited to: a microprocessor, a microcontroller (typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip), or any other hardware component (say an integrated circuit) capable on performing calculations based on the measured orientations and pressures. The computer processor 230 is configured (say by programming), to derive control data from the measured orientation and pressure, as described in further detail hereinbelow.
Optionally, the computer processor 230 compares a measurement of a first one of the orientation measurers 210 with a measurement of a second one of the orientation measurers 210, for deriving the control data.
In one example, the computer processor 230 may use measurements of two orientation measurers 210 deployed on opposite sides of the upper arm's muscle, as control references of each other (say by verifying that the two measurements do not significantly differ from each other).
In a second example, the computer processor 230 may use measurements of two orientation measurers 210 deployed on opposite sides of the upper arm's muscle, as complementary information, for deriving the control data.
For example, the computer processor 230 may use calculations based on measurements by both orientation measurers 210 of the pair, for deriving the control data.
Optionally, the calculations are of a change in angular orientation of a theoretical line which connects the two orientation measurers 210, with respect to a preselected surface of reference.
Similarly, the computer processor 230 may compare a measurement of a first one of the pressure meters 220 with a measurement of a second one of the pressure meters 220, for deriving the control data.
In one example, the computer processor 230 may use measurements of two pressure meters 220 deployed on opposite sides of the upper arm's muscle, as control references of each other (say by verifying that the two measurements do not significantly differ from each other).
In a second example, the computer processor 230 may use measurements of two pressure meters 220 deployed on opposite sides of the upper arm's muscle, as complementary information, for deriving the control data.
For example, the computer processor 230 may use calculations based on measurements by both pressure meters 220 of the pair, for deriving the control data.
The apparatus 2000 further includes a data transmitter 240, in communication with the computer processor 230. The transmitter 240 transmits the control data to the computing device in use by the user of apparatus 2000.
Optionally, the transmitter 240 transmits the control data to the computing device over a wired connection. For example, the transmitter 240 may include an electric circuit that transmits the control data over wires. The wires may be connected to one of the computing device's USB (Universal Serial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
Optionally, the transmitter 240 transmits the control data to the computing device over a wireless connection. For example, the transmitter 240 may include an electronic communications circuit that transmits the control data as radio-frequency (RF) signals, say in the Bluetooth® frequency range (2.400 GHz - 2.480 GHz).
Optionally, the computer processor 230 derives the control data as control data that is already compliant with a standard computer mouse protocol, say with the standard Microsoft™ serial mouse protocol (supported by major operating systems), as known in the art.
Optionally, the computer processor 230 does not derive the control data as compliant with a standard mouse protocol, but the apparatus 2000 further includes a data converter (not shown) implemented on the computing device, say a driver program which runs on the computing device.
The data converter receives the transmitted control data, converts the control data into control data that is compliant with the standard computer mouse protocol, and inputs the compliant control data to the computing device's operating system (say MS® Windows, Android, etc.).
Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
Stated differently, the computer processor 230 may translate changes in pressure, orientation (or both), as measured by the pressure meters 220, orientation measurers 210 (or both), respectively, into computer mouse operation data. The computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse rather than the apparatus 2000. In one example, the computer processor 230 may translate a pressure change measured by one or more of the pressure meters 220, into computer mouse clicking operation data included in the derived control data.
Once the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse).
In a second example, the computer processor 230 may translate an angular orientation change measured by one or more of the orientation measurers 210, into computer mouse clicking operation data included in the derived control data. The control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse), as described in further detail hereinbelow.
In a third example, the computer processor 230 may translate a movement in a predefined direction, measured by one or more of the orientation measurers 210, into computer mouse clicking operation data included in the derived control data. The control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse), as described in further detail hereinbelow.
In a fourth example, the computer processor 230 may translate an angular orientation change measured by one or more of the orientation measurers 210, into mouse speed change data included in the derived control data (say data which brings about a change similar to a change in speed in which a user moves a computer mouse), as described in further detail hereinbelow.
Consequently, the apparatus 2000 may translate movement of muscle of the user's upper arm into computer control operations in general, and mouse functions in particular.
The apparatus 2000 may thus be suitable for use by amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
By employing operation of the muscle of the upper arm, the exemplary apparatus 2000 may provide a more intuitive and non-invasive human-computer interface for amputees, as well as encourage continues use of the amputee's arm muscles.
The apparatus 2000 may also be used by non-amputees. For example, the apparatus 2000 may be used by workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse).
The apparatus 2000 may also include a power source (not shown), say one or more batteries, as known in the art.
Reference is now made to Fig. 3, which is a block diagram schematically illustrating a third apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
An exemplary apparatus 3000, according to an exemplary embodiment of the present invention, may be worn on an upper arm of a user of a computing device.
The computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user of the apparatus 3000, as known in the art.
The apparatus 3000 includes one or more orientation measurers 310, deployable on one or more areas of an upper arm of a user, say using a strap or a bracelet wearable on the upper arm, on which the one or more orientation measurers 310 are arranged, as described in further detail hereinabove.
Each one of the orientation measurers 310 measures orientation of the upper arm, on the area on which the orientation measurer 310 is deployed.
Each one of the orientation measurers 310 may include, but is not limited to one or more of: a gyroscope, a GPS (Global Positioning System) receiver, an accelerometer, an IMU (Inertial Measurement Unit), etc., as known in the art, or any combination thereof.
Optionally, one or more of the orientation measurers 310 measures angular orientation of the upper arm.
For example, the orientation measurer 310 may measure an angle of inclination of the orientation measurer 310, and hence of the upper arm, with respect to a preselected surface of reference. The measured angle may also be described as a rotation that would be needed to move the orientation measurer 310 from the surface to the orientation measurer's 310 location, as known in the art. Optionally, one or more of the orientation measurers 310 measures tridimensional positional orientation of the orientation measurer 310, and hence of the upper arm. For example, the orientation measurer 310 may measure position of the orientation measurer's 310 projection on a preselected surface of reference, as known in the art.
Optionally, one or more of the orientation measurers 230 measures tridimensional positional orientation of the orientation measurer 310, and hence of the upper arm. For example, the orientation measurer 310 may measure the orientation measurer's 310 spatial position, with respect to a pre-defined three dimensional coordinate system, as known in the art.
Optionally, the orientation measurers 310 include one or more pairs of orientation measurers 310 that are arranged on the strap or bracelet, such that when the apparatus 3000 is worn by the user, each two orientation measurers 310 of a pair are deployed on preferable areas of the user's upper arm.
In one example, the pair of orientation measurers 310 is positioned over opposite sides of the muscle (say the triceps), say a first orientation measurer 310 opposite a second orientation measurer 310.
Optionally, the two orientation measurers 310 of each pair serve as control references for each other, as providers of complementary information (i.e. measurement), etc., as described in further detail hereinbelow.
The apparatus 3000 further includes a computer processor 330, in communication with the orientation measurers 310.
The computer processor 330 is configured (say by programming), to derive control data from the orientation measured by the orientation measurers 310, as described in further detail hereinbelow.
The computer processor 330 may include, but is not limited to: a microprocessor, a microcontroller (typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip), or any other hardware component (say an integrated circuit) capable on performing calculations based on the measured orientations.
Optionally, the computer processor 330 compares a measurement of a first one of the orientation measurers 310 with a measurement of a second one of the orientation measurers 310, for deriving the control data. In one example, the computer processor 330 may use measurements of two orientation measurers 310 deployed on opposite sides of the upper arm's muscle, as control references of each other (say by verifying that the two measurements do not significantly differ from each other).
In a second example, the computer processor 330 may use measurements of two orientation measurers 310 deployed on opposite sides of the upper arm's muscle (say triceps), as complementary information, for deriving the control data.
For example, the computer processor 330 may use calculations based on measurements by both orientation measurers 310 of the pair, for deriving the control data.
Optionally, the calculations are of a change in angular orientation of a theoretical line which connects the two orientation measurers 310, with respect to a preselected surface of reference.
The apparatus 3000 further includes a data transmitter 340, in communication with the computer processor 330.
The transmitter 340 transmits the control data to the computing device in use by the user of apparatus 3000.
Optionally, the transmitter 340 transmits the control data to the computing device over a wired connection. For example, the transmitter 240 may include an electric circuit that transmits the control data over wires connected to one of the computing device's USB (Universal Serial Bus) sockets, etc., as known in the art.
Optionally, the transmitter 340 transmits the control data to the computing device over a wireless connection. For example, the transmitter 340 may include an electronic communications circuit that transmits the control data as radio-frequency (RF) signals, say in the Bluetooth® frequency range.
Optionally, the computer processor 330 derives the control data as control data that is already compliant with a standard computer mouse protocol, say with the standard Microsoft™ serial mouse protocol (supported by major operating systems), as known in the art.
Optionally, the computer processor 330 does not derive the control data as compliant with a standard mouse protocol, but the apparatus 3000 further includes a data converter (not shown) implemented on the computing device, say a driver program which runs on the computing device. The data converter receives the transmitted control data, converts the control data into control data that is compliant with the standard computer mouse protocol, and inputs the compliant control data to the computing device's operating system (say MS® Windows, Android, etc.).
Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
That is to say the computer processor 330 may translate changes in orientation, as measured by the orientation measurers 310, into computer mouse operation data. The computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse rather than the apparatus 3000.
In one example, the computer processor 330 may translate an angular orientation change measured by one or more of the orientation measurers 310, into computer mouse clicking operation data included in the derived control data.
Once the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse).
In a second example, the computer processor 330 may translate a movement in a predefined direction, measured by one or more of the orientation measurers 310, into computer mouse clicking operation data included in the derived control data. The control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse), as described in further detail hereinbelow.
In a third example, the computer processor 330 may translate an angular orientation change measured by one or more of the orientation measurers 310, into mouse speed change data included in the derived control data (say data which brings about a change similar to a change in speed in which a user moves a computer mouse).
Consequently, the apparatus 3000 may translate movement of muscle of the user's upper arm into computer control operations in general, and mouse functions in particular. The apparatus 3000 may thus be suitable for use by amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
The apparatus 3000 may also be used by non-amputees. For example, the apparatus 3000 may be used by workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse).
The apparatus 3000 may also include a power source (not shown), say one or more batteries, as known in the art.
Reference is now made to Fig. 4, which is a block diagram schematically illustrating a fourth apparatus for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
An exemplary apparatus 4000, according to an exemplary embodiment of the present invention, may be worn on an upper arm of a user of a computing device, as described in further detail hereinabove.
The computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user of the apparatus 4000, as known in the art.
The apparatus 4000 includes one or more pressure meters 420, deployable on one or more areas of an upper arm of a user.
Each of the pressure meters 420 measures pressure on the upper arm's area on which the pressure meter 420 is deployed.
Each one of the pressure meters 420 may include, but is not limited to one or more of: a conductive polymer based pressure sensor such as an FSR (Force Sensing Resistor), a capacitive-based pressure sensor, an electromagnetic sensor, etc., as known in the art, or any combination thereof.
Optionally, the pressure meters 420 include one or more pairs of pressure meters 420 that are arranged on the strap or bracelet, such that when the apparatus 4000 is worn by the user, each two pressure meters 420 of a pair are deployed on preferable areas of the user's upper arm. In one example, the pair of pressure meters 420 is positioned over opposite sides of the muscle (say the triceps), say a first pressure meter 420 opposite a second pressure meter 420.
The two pressure meters 420 of each pair may serve as control references for each other, as providers of complementary information (i.e. measurements), etc., as described in further detail hereinbelow.
The apparatus 4000 further includes a computer processor 430, in communication with the pressure meters 420.
The computer processor 430 is configured (say by programming), to derive control data from the measured pressure, as described in further detail hereinbelow.
The computer processor 430 may include, but is not limited to: a microprocessor, a microcontroller (typically having a processing unit as well as a fixed amount of RAM, ROM and other peripherals, embedded on a single chip), or any other hardware component (say an integrated circuit) capable on performing calculations based on the measured pressures.
The computer processor 430 may compare a measurement of a first one of the pressure meters 420 with a measurement of a second one of the pressure meters 420, for deriving the control data.
In one example, the computer processor 430 may use measurements of two pressure meters 420 deployed on opposite sides of the upper arm's muscle, as control references of each other (say by verifying that the two measurements do not significantly differ from each other).
In a second example, the computer processor 430 may use measurements of two pressure meters 420 deployed on opposite sides of the upper arm's muscle, as complementary information, for deriving the control data.
For example, the computer processor 430 may use calculations based on measurements by both pressure meters 420 of the pair, for deriving the control data.
The apparatus 4000 further includes a data transmitter 440, in communication with the computer processor 430.
The transmitter 440 transmits the control data to the computing device in use by the user of apparatus 4000.
Optionally, the transmitter 440 transmits the control data to the computing device over a wired connection. For example, the transmitter 240 may include an electric circuit that transmits the control data over wires. The wires may be connected to one of the computing device's USB (Universal Serial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
Optionally, the transmitter 440 transmits the control data to the computing device over a wireless connection. For example, the transmitter 440 may include an electronic communications circuit that transmits the control data as radio-frequency (RF) signals, say in the Bluetooth® frequency range .
Optionally, the computer processor 430 derives the control data as control data that is already compliant with a standard computer mouse protocol, say with the standard Microsoft™ serial mouse protocol (supported by major operating systems), as known in the art.
Optionally, the computer processor 430 does not derive the control data as compliant with a standard mouse protocol, but the apparatus 4000 further includes a data converter (not shown) implemented on the computing device, say a driver program which runs on the computing device.
The data converter receives the transmitted control data, converts the control data into control data that is compliant with the standard computer mouse protocol, and inputs the compliant control data to the computing device's operating system (say MS® Windows, Android, etc.).
Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
Stated differently, the computer processor 430 may translate changes in pressure, as measured by the pressure meters 420, into computer mouse operation data. The computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse rather than the apparatus 4000.
For example, the computer processor 430 may translate a pressure change measured by one or more of the pressure meters 420 into computer mouse clicking operation data included in the derived control data.
Once the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse).
Consequently, the apparatus 4000 may translate movement of muscle of the user's upper arm into computer control operations in general, and mouse functions in particular.
The apparatus 4000 may thus be suitable for use by amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
The apparatus 4000 may also be used by non-amputees, say workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse).
The apparatus 4000 may also include a power source (not shown), say one or more batteries, as known in the art.
Reference is now made to Fig. 5, which is a flowchart illustrating a first method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
In a first exemplary method, according to an exemplary embodiment of the present invention, a computing device may be controlled by muscle of an upper arm of a user of the computing device, say through upper arm movement or pressure applied by the muscle on sides of the upper arm, as described in further detail hereinabove.
The computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user.
In the exemplary method, orientation of the upper arm of the user is measured 510 on one or more areas of the upper arm, say by the orientation measurers 210 of apparatus 2000. Each one of the orientation measurers 210 measures orientation of the upper arm, on the area on which the orientation measurer 210 is deployed.
The orientation may be measured 510 using one or more of: a gyroscope, a
GPS (Global Positioning System) receiver, an accelerometer, an IMU (Inertial Measurement Unit), etc., as known in the art, or any combination thereof. Optionally, the measured 510 orientation is an angular orientation of the upper arm.
For example, the angular orientation may be measured 510 as an angle of inclination of the upper arm, with respect to a preselected surface of reference. The measured 510 angle may also be described as a rotation that would be needed to move the upper arm from the surface of reference, to the upper arm's location, as described in further detail hereinabove.
Optionally, the measured 510 orientation is a bi-dimensional positional orientation of the upper arm.
For example, the orientation may be measured 510 as position of the orientation measurer's 210 projection on a preselected surface of reference, as described in further detail hereinabove.
Optionally, the measured 510 orientation is a tri-dimensional positional orientation of the upper arm.
For example, the orientation may be measured 510 as the orientation measurer's 210 spatial position, with respect to a pre-defined three dimensional coordinate system, as described in further detail hereinabove.
The exemplary method further includes measuring 510 of pressure applied by muscle of the upper arm on one or more areas of the upper arm, say by the pressure meters 220 of apparatus 2000 (where each pressure meter 220 is deployed on a respective one of the areas), as described in further detail hereinabove.
The method further includes deriving 530 control data from the measured 510 pressure and orientation, say by the computer processor 230 of apparatus 2000, as described in further detail hereinabove.
Optionally, the method further includes comparing an orientation measured
510 on a first area of the upper arm with an orientation measured 510 on a second area of the upper arm, for deriving the control data. The orientations may be measured
510 by a pair of orientation measurers 210 deployed on opposite sides of the upper arm's muscle, as described in further detail hereinabove.
In one example, a pair of orientations measured 510 on opposite sides of the upper arm's muscle (say the triceps), may be used as control references of each other
(say by verifying that the two measured 510 orientations do not significantly differ from each other), as described in further detail hereinabove. In a second example, a pair of orientations measured 510 on opposite sides of the upper arm's muscle, may be used as complementary information, for deriving the control data.
For example, calculations based on orientations measured 510 by both orientation measurers 210 of a pair of orientation measurers 210 deployed over opposite sides of the upper arm muscle, may be used for deriving the control data.
Optionally, the calculations are of a change in angular orientation of a theoretical line which connects the two orientation measurers 210 of the pair, with respect to a preselected surface of reference, as described in further detail hereinabove.
Similarly, the method may include comparing pressures measured 510 on at least two of the upper arm areas, for deriving the control data, say using a pair of pressure meters 220 deployed on opposite sides of the upper arm's muscle, opposite each other, as described in further detail hereinabove.
In one example, pressures measured 510 on at least two of the areas are used as control references of each other (say by verifying that the two measured 510 pressures do not significantly differ from each other).
In a second example, pressures measured 510 on at least two of the areas, are used as complementary information, for deriving the control data, say through calculations based on pressures measured 510 by both pressure meters 220 of a pair, as described in further detail hereinabove.
Then, the derived 530 control data is transmitted 540 to the computing device, say using the transmitter 240 of apparatus 2000.
Optionally, the derived 530 control data is transmitted 540 over a wired connection, say over wires connected to one of the computing device's USB (Universal Serial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
Optionally, the derived 530 control data is transmitted 540 over a wireless connection, say as radio-frequency (RF) signals in the Bluetooth® frequency range (2.400 GHz - 2.480 GHz) or in another frequency range.
Optionally, the control data is derived 530 as control data that is already compliant with a standard computer mouse protocol, say with the standard Microsoft™ serial mouse protocol (supported by major operating systems), as known in the art.
Optionally, the derived 530 control data does not comply with a standard mouse protocol, but upon receipt on the computing device, is converted into control data that is compliant with the standard computer mouse protocol, on the computing device, say by the data converter of apparatus 2000.
The compliant control data is input to the computing device's operating system (say MS® Windows, Android, etc.), say by the data converter of apparatus 2000.
Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
Stated differently, in the exemplary method, changes in pressure, orientation, or both, as measured 510 on the areas of the upper arm, are translated into computer mouse operation data. The computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse.
In one example, a pressure change measured 510 on one or more areas of the upper arm, is translated into computer mouse clicking operation data included in the derived 530 control data.
Once the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse).
In a second example, an angular orientation change measured 510 on one or more areas of the upper arm, is translated into computer mouse clicking operation data included in the derived 530 control data.
Consequently, the control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse), as described in further detail hereinabove.
In a third example, a movement in a predefined direction, measured 510 on one or more areas of the upper arm, is translated into computer mouse clicking operation data included in the derived 530 control data. Consequently, the control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse), as described in further detail hereinabove.
In a fourth example, an angular orientation change measured 510 on one or more areas of the upper arm, is translated into mouse speed change data included in the derived 530 control data (say data which brings about a change similar to a change in speed in which a user moves a computer mouse).
The method may thus be suitable for amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
The method is usable for non-amputees too. For example, for workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse), as described in further detail hereinabove.
Reference is now made to Fig. 6, which is a flowchart illustrating a second method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
In a second exemplary method, according to an exemplary embodiment of the present invention, a computing device may be controlled by muscle of an upper arm of a user of a computing device, say by movement of the upper arm, as described in further detail hereinabove.
The computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user.
In the exemplary method, orientation of the upper arm of the user is measured 610 on one or more areas of the upper arm, say by the orientation measurers 310 of apparatus 3000. Each one of the orientation measurers 310 measures orientation of the upper arm, on the area on which the orientation measurer 310 is deployed.
The orientation may be measured 610 using one or more of: a gyroscope, a
GPS (Global Positioning System) receiver, an accelerometer, an IMU (Inertial Measurement Unit), etc., as known in the art, or any combination thereof. Optionally, the measured 610 orientation is an angular orientation of the upper arm.
For example, the angular orientation may be measured 610 as an angle of inclination of the upper arm, with respect to a preselected surface of reference. The measured 610 angle may also be described as a rotation that would be needed to move the upper arm from the surface of reference, to the upper arm's location, as described in further detail hereinabove.
Optionally, the measured 610 orientation is a bi-dimensional positional orientation of the upper arm.
For example, the orientation may be measured 610 as position of the orientation measurer's 310 projection on a preselected surface of reference, as described in further detail hereinabove.
Optionally, the measured 610 orientation is a tri-dimensional positional orientation of the upper arm.
For example, the orientation may be measured 610 as the orientation measurer's 310 spatial position, with respect to a pre-defined three dimensional coordinate system, as described in further detail hereinabove.
The method further includes deriving 630 control data from the measured 610 orientation, say by the computer processor 330 of apparatus 3000, as described in further detail hereinabove.
Optionally, the method further includes comparing an orientation measured 610 on a first area of the upper arm with an orientation measured 610 on a second area of the upper arm, for deriving the control data. The orientations may be measured 610 by a pair of orientation measurers 310 deployed opposite each other, say on opposite sides of the upper arm's muscle, as described in further detail hereinabove.
In one example, a pair of orientations measured 610 on opposite sides of the upper arm's muscle (say the triceps), may be used as control references of each other (say by verifying that the two measured 610 orientations do not significantly differ from each other), as described in further detail hereinabove.
In a second example, a pair of orientations measured 610 on opposite sides of the upper arm's muscle, may be used as complementary information, for deriving the control data. For example, calculations based on orientations measured 610 by both orientation measurers 310 of a pair of orientation measurers 310 deployed over opposite sides of the upper arm muscle, may be used for deriving the control data.
Optionally, the calculations are of a change in angular orientation of a theoretical line which connects the two orientation measurers 310 of the pair, with respect to a preselected surface of reference, as described in further detail hereinabove.
Then, the derived 630 control data is transmitted 640 to the computing device, say using the transmitter 340 of apparatus 3000.
Optionally, the derived 630 control data is transmitted 640 over a wired connection, say over wires connected to one of the computing device's USB (Universal erial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
Optionally, the derived 630 control data is transmitted 640 over a wireless connection, say as radio-frequency (RF) signals in the Bluetooth® frequency range (2.400 GHz - 2.480 GHz) or in another frequency range.
Optionally, the control data is derived 630 as control data that is already compliant with a standard computer mouse protocol, say with the standard Microsoft™ serial mouse protocol (supported by major operating systems), as known in the art.
Optionally, the derived 630 control data does not comply with a standard mouse protocol, but upon receipt on the computing device, is converted into control data that is compliant with the standard computer mouse protocol, on the computing device, say by the data converter of apparatus 3000.
The compliant control data is input to the computing device's operating system
(say MS® Windows, Android, etc.), say by the data converter of apparatus 3000.
Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
Stated differently, in the exemplary method, changes in orientation of the upper arm of the user, as measured 610 on the areas of the upper arm, are translated into computer mouse operation data. The computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse. In one example, an angular orientation change measured 610 on one or more areas of the upper arm, is translated into computer mouse clicking operation data included in the derived 630 control data.
Once the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse).
In a second example, a movement in a predefined direction, measured 610 on one or more areas of the upper arm, is translated into computer mouse clicking operation data included in the derived 630 control data.
Consequently, the control data may cause the computing device to reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse), as described in further detail hereinabove.
In a third example, an angular orientation change measured 610 on one or more areas of the upper arm, is translated into mouse speed change data included in the derived 630 control data (say data which brings about a change similar to a change in speed in which a user moves a computer mouse).
The method may thus be suitable for amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
The method is usable for non-amputees too. For example, for workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse), as described in further detail hereinabove.
Reference is now made to Fig. 7, which is a flowchart illustrating a third method for upper-arm computer pointing, according to an exemplary embodiment of the present invention.
In a third exemplary method, according to an exemplary embodiment of the present invention, a computing device may be controlled by muscle of an upper arm of a user of a computing device, say through pressure applied by the muscle on sides of the upper arm, as described in further detail hereinabove. The computing device may include, but is not limited to: a desktop computer, a computer in an industrial environment, a smart cellular phone, etc, or any other computing device in use by the user.
In the exemplary method, pressure applied by muscle of the upper arm on one or more areas of the upper arm is measured 720, say by the pressure meters 420 of apparatus 4000 (where each pressure meter 420 is deployed on a respective one of the areas), as described in further detail hereinabove.
The method further includes deriving 730 control data from the measured 720 pressure, say by the computer processor 430 of apparatus 4000, as described in further detail hereinabove.
Optionally, the method includes comparing pressures measured 720 on at least two of the upper arm areas, for deriving the control data, say using a pair of pressure meters 420 deployed on opposite sides of the upper arm's muscle, opposite each other, as described in further detail hereinabove.
In one example, pressures measured 720 on at least two of the areas are used as control references of each other (say by verifying that the two measured 720 pressures do not significantly differ from each other).
In a second example, pressures measured 720 on at least two of the areas, are used as complementary information, for deriving the control data, say through calculations based on pressures measured 720 by both pressure meters 420 of a pair, as described in further detail hereinabove.
Then, the derived 730 control data is transmitted 740 to the computing device, say using the transmitter 440 of apparatus 4000.
Optionally, the derived 730 control data is transmitted 740 over a wired connection, say over wires connected to one of the computing device's USB (Universal erial Bus) sockets, to a communications socket of a communications card installed in the computing device, etc., as known in the art.
Optionally, the derived 730 control data is transmitted 740 over a wireless connection, say as radio-frequency (RF) signals in the Bluetooth® frequency range (2.400 GHz - 2.480 GHz) or in another frequency range.
Optionally, the control data is derived 730 as control data that is already compliant with a standard computer mouse protocol, say with the standard Microsoft™ serial mouse protocol (supported by major operating systems), as known in the art.
Optionally, the derived 730 control data does not comply with a standard mouse protocol, but upon receipt on the computing device, is converted into control data that is compliant with the standard computer mouse protocol, on the computing device, say by the data converter of apparatus 4000.
The compliant control data is input to the computing device's operating system (say MS® Windows, Android, etc.), say by the data converter of apparatus 4000.
Upon receipt of the control data compliant with the standard computer mouse protocol, the computing device's operating system reacts as if the control data originates from operations performed on a standard computer mouse.
Stated differently, in the exemplary method, changes in pressure applied to one or more areas of the upper arm, as measured 720 on the areas of the upper arm, are translated into computer mouse operation data. The computer mouse operation data causes the computing device to react as if the user uses a standard computer mouse.
For example, a pressure change measured 720 on one or more areas of the upper arm, may be translated into computer mouse clicking operation data included in the derived 730 control data.
Once the computing device's operating system receives the control data in a format compliant with a standard mouse protocol, the computing device reacts as if the control data originates from clicking a regular computer mouse (say a standard Microsoft® Mouse).
The method may thus be suitable for amputees that hitherto have to rely on devices oriented towards paralyzed users and based on eye movement, brain waves or even air flow, etc., rather than operation of the muscle of the upper arm, as described in further detail hereinabove.
The method is usable for non-amputees too. For example, for workers who have to carry equipment or row materials in their hands, while interacting with a computing device (say a computer in an assembly line or in a warehouse), as described in further detail hereinabove.
It is expected that during the life of this patent many relevant devices and systems will be developed and the scope of the terms herein, particularly of the terms "Computer", "Computing Device", "Computer Processor", "Electric Circuit", "Wires", "Communications Card", "Operating System", "Radio Frequency (RF) Signals", "USB (Universal Serial Bus)", "Smart Cellular Phone", "Gyroscope", "GPS (Global Positioning System)", "IMU (Inertial Measurement Unit)", "Conductive Polymer", "Pressure Sensor", "FSR (Force Sensing Resistor)", "Capacitive-based Pressure Sensor", "Electromagnetic Pressure Sensor" and "Computer Mouse", is intended to include all such new technologies a priori.
It is appreciated that certain features of the invention, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the invention, which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable subcombination.
Although the invention has been described in conjunction with specific embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, it is intended to embrace all such alternatives, modifications and variations that fall within the spirit and broad scope of the appended claims. All publications, patents and patent applications mentioned in this specification are herein incorporated in their entirety by reference into the specification, to the same extent as if each individual publication, patent or patent application was specifically and individually indicated to be incorporated herein by reference. In addition, citation or identification of any reference in this application shall not be construed as an admission that such reference is available as prior art to the present invention.

Claims

WHAT IS CLAIMED IS:
1. An upper-arm computer pointing apparatus, comprising:
at least one orientation measurer, deployable on at least one area of an upper arm of a user, configured to measure orientation of the upper arm;
at least one pressure meter, deployable on at least one area of the upper arm, configured to measure pressure applied by muscle of the upper arm;
a computer processor, associated with said orientation measurer and pressure meter, configured to derive control data from the measured orientation and pressure; and
a data transmitter, associated with said computer processor, configured to transmit the control data to a computing device.
2. The apparatus of claim 1, wherein said data transmitter is further configured to transmit the control data to the computing device over a wireless connection.
3. The apparatus of claim 1, further comprising a data converter, implemented on said computing device, configured to receive the transmitted control data and convert the control data into mouse protocol compliant control data.
4. The apparatus of claim 1, wherein said computer processor is further configured to derive the control data as mouse protocol compliant control data.
5. The apparatus of claim 1, wherein said pressure meters comprise at least two pressure meters deployable on the upper arm, over opposite sides of the muscle, and said computer processor is further configured to compare a measurement of a first one of said pressure meters with a measurement of a second one of said pressure meters, for deriving the control data.
6. The apparatus of claim 1, wherein said orientation measurers comprise at least two orientation measurers deployable on the upper arm, and said computer processor is further configured to compare a measurement of a first one of said orientation measurers with a measurement of a second one of said orientation measurers, for deriving the control data.
7. The apparatus of claim 1, wherein at least one of said orientation measurers comprises a GPS (Global Positioning System) receiver.
8. The apparatus of claim 1, wherein at least one of said orientation measurers comprises an IMU (Inertial Measurement Unit).
9. The apparatus of claim 1, wherein at least one of said pressure meters comprises an FSR (Force Sensing Resistor).
10. The apparatus of claim 1, where said computer processor is further configured to translate a pressure change measured by at least one of said pressure meters into clicking operation data included in the derived control data.
11. The apparatus of claim 1, where said computer processor is further configured to translate an angular orientation change measured by at least one of said orientation measurers into clicking operation data included in the derived control data.
12. The apparatus of claim 1, where said computer processor is further configured to translate a movement in a predefined direction, measured by at least one of said orientation measurers, into clicking operation data included in the derived control data.
13. The apparatus of claim 1, where said computer processor is further configured to translate an angular orientation change measured by at least one of said orientation measurers, into mouse speed change data included in the derived control data.
14. The apparatus of claim 1, wherein at least one of said orientation measurers is further configured to measure angular orientation of the upper arm.
15. The apparatus of claim 1, wherein at least one of said orientation measurers is further configured to measure bi-dimensional positional orientation of the upper arm.
16. The apparatus of claim 1, wherein at least one of said orientation measurers is further configured to measure tri-dimensional positional orientation of the upper arm.
17. An upper-arm computer pointing apparatus, comprising:
at least one orientation measurer, deployable on at least one area of an upper arm of a user, configured to measure orientation of the upper arm;
a computer processor, associated with said orientation measurer, configured to derive control data from said measured orientation; and
a data transmitter, associated with said computer processor, configured to transmit the control data to a computing device.
18. The apparatus of claim 17, further comprising a data converter, implemented on said computing device, configured to receive the transmitted control data and convert the control data into mouse protocol compliant control data.
19. The apparatus of claim 17, wherein said computer processor is further configured to derive the control data as mouse protocol compliant control data.
20. The apparatus of claim 17, wherein said orientation measurers comprise at least two orientation measurers deployable on the upper arm, and said computer processor is further configured to compare a measurement of a first one of said orientation measurers with a measurement of a second one of said orientation measurers, for deriving the control data.
21. The apparatus of claim 17, wherein at least one of said orientation measurers comprises a GPS (Global Positioning System) receiver.
22. The apparatus of claim 17, wherein at least one of said orientation measurers comprises an IMU (Inertial Measurement Unit).
23. The apparatus of claim 17, where said computer processor is further configured to translate an angular orientation change measured by at least one of said orientation measurers into clicking operation data included in the derived control data.
24. The apparatus of claim 17, where said computer processor is further configured to translate a movement in a predefined direction, measured by at least one of said orientation measurers, into clicking operation data included in the derived control data.
25. The apparatus of claim 17, where said computer processor is further configured to translate an angular orientation change measured by at least one of said orientation measurers, into mouse speed change data included in the derived control data.
26. The apparatus of claim 17, wherein at least one of said orientation measurers is further configured to measure angular orientation of the upper arm.
27. The apparatus of claim 17, wherein at least one of said orientation measurers is further configured to measure bi-dimensional positional orientation of the upper arm.
28. The apparatus of claim 17, wherein at least one of said orientation measurers is further configured to measure tri-dimensional positional orientation of the upper arm.
29. An upper-arm computer pointing apparatus, comprising:
at least one pressure meter, deployable on at least one area of the upper arm, configured to measure pressure applied by muscle of the upper arm;
a computer processor, associated with said pressure meter, configured to derive control data from the measured pressure; and a data transmitter, associated with said computer processor, configured to transmit the control data to a computing device.
30. The apparatus of claim 29, wherein said data transmitter is further configured to transmit the control data to the computing device over a wireless connection.
31. The apparatus of claim 29, further comprising a data converter, implemented on said computing device, configured to receive the transmitted control data and convert the control data into mouse protocol compliant control data.
32. The apparatus of claim 29, wherein said computer processor is further configured to derive the control data as mouse protocol compliant control data.
33. The apparatus of claim 29, wherein said pressure meters comprise at least two pressure meters deployable on the upper arm, over opposite sides of the muscle, and said computer processor is further configured to compare a measurement of a first one of said pressure meters with a measurement of a second one of said pressure meters, for deriving the control data.
34. The apparatus of claim 29, wherein at least one of said pressure meters comprises an FSR (Force Sensing Resistor).
35. The apparatus of claim 29, where said computer processor is further configured to translate a pressure change measured by at least one of said pressure meters into clicking operation data included in the derived control data.
36. A method for upper-arm computer pointing, comprising:
measuring orientation of an upper arm of a user, on at least one area of the upper arm;
measuring pressure applied by muscle of the upper arm, on at least one area of the upper arm;
deriving control data from said measured orientation and pressure; and transmitting the control data to a computing device.
37. The method of claim 36, further comprising: on said computing device, receiving the control data and converting the control data into mouse protocol compliant data.
38. The method of claim 36, wherein said deriving the control data comprises deriving the control data as mouse protocol compliant control data.
39. The method of claim 36, further comprising comparing a pressure measured on a first area of the upper arm with a pressure measured on a second area of the upper arm, for deriving the control data, the areas being positioned over opposite sides of the muscle.
40. The method of claim 36, further comprising comparing an orientation measured on a first area of the upper arm with an orientation measured on a second area of the upper arm, for deriving the control data.
41. The method of claim 36, further comprising translating a measured pressure change into clicking operation data included in the derived control data.
42. The method of claim 36, further comprising translating a measured angular orientation change into clicking operation data included in the derived control data.
43. The method of claim 36, further comprising translating a measured movement in a predefined direction into clicking operation data included in the derived control data.
44. The method of claim 36, further comprising translating a measured angular orientation change into a mouse speed change data included in the derived control data.
45. The method of claim 36, wherein said measured orientation is an angular orientation of the upper arm.
46. The method of claim 36, wherein said measured orientation is a bi- dimensional positional orientation of the upper arm.
47. The method of claim 36, wherein said measured orientation is a tridimensional positional orientation of the upper arm.
48. A method for upper- arm computer pointing, comprising:
measuring orientation of the upper arm, on at least one area of the upper arm;
deriving control data from said measured orientation; and transmitting the control data to a computing device.
49. The method of claim 48, further comprising: on said computing device, receiving the control data and converting the control data into mouse protocol compliant data.
50. The method of claim 48, wherein said deriving the control data comprises deriving the control data as mouse protocol compliant control data.
51. The method of claim 48, further comprising comparing an orientation measured on a first area of the upper arm with an orientation measured on a second area of the upper arm, for deriving the control data.
52. The method of claim 48, further comprising translating a measured pressure change into clicking operation data included in the derived control data.
53. The method of claim 48, further comprising translating a measured angular orientation change into clicking operation data included in the derived control data.
54. The method of claim 48, further comprising translating a measured movement in a predefined direction into clicking operation data included in the derived control data.
55. The method of claim 48, further comprising translating a measured angular orientation change into mouse speed change data included in the derived control data.
56. The method of claim 48, wherein said measured orientation is an angular orientation of the upper arm.
57. The method of claim 48, wherein said measured orientation is a bi- dimensional positional orientation of the upper arm.
58. The method of claim 48, wherein said measured orientation is a tridimensional positional orientation of the upper arm.
59. A method for upper-arm computer pointing, comprising:
measuring pressure applied by muscle of the upper arm, on at least one area of the upper arm;
deriving control data from said measured pressure; and transmitting the control data to a computing device.
60. The method of claim 59, further comprising: on said computing device, receiving the control data and converting the control data into mouse protocol compliant data.
61. The method of claim 59, wherein said deriving the control data comprises deriving the control data as mouse protocol compliant control data.
62. The method of claim 59, further comprising comparing a pressure measured on a first area of the upper arm with a pressure measured on a second area of the upper arm, for deriving the control data, the areas being positioned over opposite sides of the muscle.
63. The method of claim 59, further comprising translating a measured pressure change into clicking operation data included in the derived control data.
PCT/IB2012/056081 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus WO2014068371A1 (en)

Priority Applications (11)

Application Number Priority Date Filing Date Title
EP12887355.1A EP2915163A4 (en) 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus
US14/426,131 US11662699B2 (en) 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus
EP19169927.1A EP3537424A1 (en) 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus
PCT/IB2012/056081 WO2014068371A1 (en) 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus
AU2012393913A AU2012393913B2 (en) 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus
KR1020157005413A KR20150082174A (en) 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus
CA2883520A CA2883520C (en) 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus
CN201280078092.4A CN104903817A (en) 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus
HK15110764.6A HK1210312A1 (en) 2012-11-01 2015-10-30 Upper-arm computer pointing apparatus
AU2017235951A AU2017235951B2 (en) 2012-11-01 2017-09-28 Upper-arm computer pointing apparatus
US18/319,150 US20240126226A1 (en) 2012-11-01 2023-05-17 Upper-arm computer pointing apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IB2012/056081 WO2014068371A1 (en) 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US14/426,131 A-371-Of-International US11662699B2 (en) 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus
US18/319,150 Continuation US20240126226A1 (en) 2012-11-01 2023-05-17 Upper-arm computer pointing apparatus

Publications (1)

Publication Number Publication Date
WO2014068371A1 true WO2014068371A1 (en) 2014-05-08

Family

ID=50626565

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2012/056081 WO2014068371A1 (en) 2012-11-01 2012-11-01 Upper-arm computer pointing apparatus

Country Status (8)

Country Link
US (2) US11662699B2 (en)
EP (2) EP3537424A1 (en)
KR (1) KR20150082174A (en)
CN (1) CN104903817A (en)
AU (2) AU2012393913B2 (en)
CA (1) CA2883520C (en)
HK (1) HK1210312A1 (en)
WO (1) WO2014068371A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014194422A1 (en) * 2013-06-04 2014-12-11 University Of Manitoba System and method for quantifying mid-air interactions and gesture based text entry map designed to optimize mid-air interactions
WO2016132177A1 (en) 2015-02-19 2016-08-25 Aryeh Haim Katz Remote controlled physical activity monitoring
WO2022098973A1 (en) * 2020-11-06 2022-05-12 Hourglass Medical Llc Switch system for operating a controlled device
EP3134802B1 (en) * 2014-04-21 2022-08-24 Activbody, Inc. Pressure sensitive peripheral devices, and associated methods of use
US11553313B2 (en) 2020-07-02 2023-01-10 Hourglass Medical Llc Clench activated switch system
US11662804B2 (en) 2021-04-21 2023-05-30 Hourglass Medical Llc Voice blanking muscle movement controlled systems
US11662699B2 (en) 2012-11-01 2023-05-30 6Degrees Ltd. Upper-arm computer pointing apparatus
US11698678B2 (en) 2021-02-12 2023-07-11 Hourglass Medical Llc Clench-control accessory for head-worn devices

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110148755A1 (en) 2009-12-18 2011-06-23 Electronics And Telecommunications Research Institute User interface apparatus and user interfacing method based on wearable computing environment
US20110199296A1 (en) 2010-02-18 2011-08-18 Simpson Samuel K Single wrist user input system
US20120127070A1 (en) 2010-11-22 2012-05-24 Electronics And Telecommunications Research Institute Control signal input device and method using posture recognition
US20120157886A1 (en) * 2010-12-17 2012-06-21 Industrial Technology Research Institute Mechanomyography Signal Input Device, Human-Machine Operating System and Identification Method Thereof

Family Cites Families (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6413190B1 (en) * 1999-07-27 2002-07-02 Enhanced Mobility Technologies Rehabilitation apparatus and method
JP2002358149A (en) * 2001-06-01 2002-12-13 Sony Corp User inputting device
US7497827B2 (en) * 2004-07-13 2009-03-03 Dexcom, Inc. Transcutaneous analyte sensor
NL1021653C2 (en) * 2002-10-15 2004-05-11 Robert Leonard Krullaards Training facility.
US20060079801A1 (en) * 2004-09-16 2006-04-13 Deluca Carlo J Sensor system for detecting and processing EMG signals
US8614676B2 (en) 2007-04-24 2013-12-24 Kuo-Ching Chiang User motion detection mouse for electronic device
US20100201512A1 (en) * 2006-01-09 2010-08-12 Harold Dan Stirling Apparatus, systems, and methods for evaluating body movements
US7647195B1 (en) * 2006-07-11 2010-01-12 Dp Technologies, Inc. Method and apparatus for a virtual accelerometer system
US9114030B2 (en) * 2007-02-06 2015-08-25 Deka Products Limited Partnership System for control of a prosthetic device
US8386025B2 (en) * 2007-04-30 2013-02-26 IctalCare A/S, Delta Device and method for monitoring muscular activity
CN101868770B (en) 2007-11-19 2013-09-11 诺基亚公司 Input device
US20090153477A1 (en) 2007-12-12 2009-06-18 Saenz Valentin L Computer mouse glove
US20090196460A1 (en) 2008-01-17 2009-08-06 Thomas Jakobs Eye tracking system and method
JP2011512964A (en) * 2008-02-29 2011-04-28 センサリー メディカル,インク. Apparatus and method for treating restless leg syndrome
US9002680B2 (en) 2008-06-13 2015-04-07 Nike, Inc. Foot gestures for computer input and interface control
US8170656B2 (en) * 2008-06-26 2012-05-01 Microsoft Corporation Wearable electromyography-based controllers for human-computer interface
US8447704B2 (en) * 2008-06-26 2013-05-21 Microsoft Corporation Recognizing gestures from forearm EMG signals
US20100022354A1 (en) * 2008-07-25 2010-01-28 Expresso Fitness Corp. Exercise equipment with movable handle bars to simulate steering motion in a simulated environment and methods therefor
US20100184564A1 (en) * 2008-12-05 2010-07-22 Nike, Inc. Athletic Performance Monitoring Systems and Methods in a Team Sports Environment
US20100210975A1 (en) * 2009-01-21 2010-08-19 SwimSense, LLC Multi-state performance monitoring system
GB0901020D0 (en) * 2009-01-21 2009-03-04 Birmingham City University A motion capture apparatus
US8581856B2 (en) * 2009-05-27 2013-11-12 Microsoft Corporation Touch sensitive display apparatus using sensor input
WO2011020869A1 (en) 2009-08-20 2011-02-24 Massimiliano Ciccone Foot controller
US20110054782A1 (en) 2009-08-27 2011-03-03 Kaahui Keaka K A Method and apparatus of measuring and analyzing user movement
US8482525B2 (en) * 2009-09-30 2013-07-09 Robby Moore Knee operated computer mouse
US8362350B2 (en) * 2009-12-07 2013-01-29 Neven Kockovic Wearable trigger electronic percussion music system
WO2011083442A1 (en) 2010-01-08 2011-07-14 Dayton Technologies Limited Hand wearable control apparatus
US20110199303A1 (en) * 2010-02-18 2011-08-18 Simpson Samuel K Dual wrist user input system
JP2013140190A (en) * 2010-04-21 2013-07-18 Sharp Corp Display device
US20120053440A1 (en) * 2010-08-31 2012-03-01 Rehabilitation Institute Of Chicago Method for Reflex Threshold Estimation in Spastic Muscles
US20120075173A1 (en) * 2010-09-23 2012-03-29 Nokia Corporation Apparatus and method for user input
US8593286B2 (en) * 2010-12-01 2013-11-26 At&T Intellectual Property I, L.P. System and method for wireless monitoring of sports activities
US9035776B2 (en) * 2011-01-20 2015-05-19 At&T Intellectual Property I, L.P. Wireless monitoring of safety helmets
WO2012129669A1 (en) * 2011-03-28 2012-10-04 Gestsure Technologies Inc. Gesture operated control for medical information systems
US8818478B2 (en) * 2011-03-31 2014-08-26 Adidas Ag Sensor garment
US20120259648A1 (en) * 2011-04-07 2012-10-11 Full Recovery, Inc. Systems and methods for remote monitoring, management and optimization of physical therapy treatment
CN102247151B (en) 2011-04-25 2013-01-02 中国科学院合肥物质科学研究院 Muscle tension sensor and muscle tension detecting method
US20120316456A1 (en) * 2011-06-10 2012-12-13 Aliphcom Sensory user interface
US8961185B2 (en) * 2011-08-19 2015-02-24 Pulson, Inc. System and method for reliably coordinating musculoskeletal and cardiovascular hemodynamics
EP2786131B1 (en) * 2011-09-01 2018-11-07 Mc10, Inc. Electronics for detection of a condition of tissue
US9367085B2 (en) * 2012-01-26 2016-06-14 Google Technology Holdings LLC Portable electronic device and method for controlling operation thereof taking into account which limb possesses the electronic device
WO2014041032A1 (en) * 2012-09-11 2014-03-20 L.I.F.E. Corporation S.A. Wearable communication platform
WO2014060938A1 (en) * 2012-10-16 2014-04-24 Night-Sense, Ltd Comfortable and personalized monitoring device, system, and method for detecting physiological health risks
CN104903817A (en) 2012-11-01 2015-09-09 阿里耶·海姆·卡茨 Upper-arm computer pointing apparatus
EP3060119B1 (en) * 2013-10-21 2021-06-23 Apple Inc. Method for sensing a physical activity of a user
US9993688B2 (en) * 2014-01-13 2018-06-12 Skye Health, Inc. Device and method for sensing, guiding, and/or tracking pelvic exercise
US10383550B2 (en) * 2014-07-17 2019-08-20 Elwha Llc Monitoring body movement or condition according to motion regimen with conformal electronics
US10232165B2 (en) * 2015-01-29 2019-03-19 Elwha Llc Garment system including at least one sensor and at least one actuator responsive to the sensor and related methods
WO2016038531A1 (en) * 2014-09-08 2016-03-17 Koninklijke Philips N.V. Optical shape sensing for soft tissue balancing in orthopedics
US10082872B2 (en) * 2014-12-30 2018-09-25 Immersion Corporation Deformable haptic wearables with variable physical properties
WO2016186904A1 (en) * 2015-05-18 2016-11-24 Vayu Technology Corp. Devices for measuring human gait and related methods of use
US10401167B2 (en) * 2015-09-17 2019-09-03 Apple Inc. Wearable ambient pressure gauge
US10462748B2 (en) * 2016-03-24 2019-10-29 Immersion Corporation Energy savings mode for silent haptics

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110148755A1 (en) 2009-12-18 2011-06-23 Electronics And Telecommunications Research Institute User interface apparatus and user interfacing method based on wearable computing environment
US20110199296A1 (en) 2010-02-18 2011-08-18 Simpson Samuel K Single wrist user input system
US20120127070A1 (en) 2010-11-22 2012-05-24 Electronics And Telecommunications Research Institute Control signal input device and method using posture recognition
US20120157886A1 (en) * 2010-12-17 2012-06-21 Industrial Technology Research Institute Mechanomyography Signal Input Device, Human-Machine Operating System and Identification Method Thereof

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
KARLSSON S. G.: "User control of lower limb prosthetics", January 2010 (2010-01-01), LETURPRENT, REYKJAVIK, ICELAND, XP055197460, Retrieved from the Internet <URL:http://skemman.is/stream/get/1946/4396/12811/2/SGK_MSc_Thesis_fixed.pdf> [retrieved on 20100131] *
See also references of EP2915163A4

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11662699B2 (en) 2012-11-01 2023-05-30 6Degrees Ltd. Upper-arm computer pointing apparatus
WO2014194422A1 (en) * 2013-06-04 2014-12-11 University Of Manitoba System and method for quantifying mid-air interactions and gesture based text entry map designed to optimize mid-air interactions
EP3134802B1 (en) * 2014-04-21 2022-08-24 Activbody, Inc. Pressure sensitive peripheral devices, and associated methods of use
WO2016132177A1 (en) 2015-02-19 2016-08-25 Aryeh Haim Katz Remote controlled physical activity monitoring
EP3258845A4 (en) * 2015-02-19 2018-09-26 6Degrees Ltd. Remote controlled physical activity monitoring
US11571143B2 (en) 2015-02-19 2023-02-07 6Degrees Ltd. Remote controlled physical activity monitoring
US12070305B2 (en) 2015-02-19 2024-08-27 6Degrees Ltd. Remote controlled physical activity monitoring
US11778428B2 (en) 2020-07-02 2023-10-03 Hourglass Medical Llc Clench activated switch system
US11553313B2 (en) 2020-07-02 2023-01-10 Hourglass Medical Llc Clench activated switch system
WO2022098973A1 (en) * 2020-11-06 2022-05-12 Hourglass Medical Llc Switch system for operating a controlled device
US11698678B2 (en) 2021-02-12 2023-07-11 Hourglass Medical Llc Clench-control accessory for head-worn devices
US12073019B2 (en) 2021-02-12 2024-08-27 Hourglass Medical Llc Clench-control accessory for head-worn devices
US11662804B2 (en) 2021-04-21 2023-05-30 Hourglass Medical Llc Voice blanking muscle movement controlled systems
US12073014B2 (en) 2021-04-21 2024-08-27 Hourglass Medical Llc Voice blanking muscle movement controlled systems

Also Published As

Publication number Publication date
US11662699B2 (en) 2023-05-30
AU2012393913A1 (en) 2015-03-12
CA2883520C (en) 2022-10-25
AU2017235951A1 (en) 2017-10-19
AU2017235951B2 (en) 2019-11-14
CN104903817A (en) 2015-09-09
EP3537424A1 (en) 2019-09-11
AU2012393913B2 (en) 2017-07-06
EP2915163A4 (en) 2016-06-29
CA2883520A1 (en) 2014-05-08
HK1210312A1 (en) 2016-04-15
US20240126226A1 (en) 2024-04-18
US20150234367A1 (en) 2015-08-20
EP2915163A1 (en) 2015-09-09
KR20150082174A (en) 2015-07-15

Similar Documents

Publication Publication Date Title
US20240126226A1 (en) Upper-arm computer pointing apparatus
US20120184871A1 (en) Exercise monitor and method for monitoring exercise
CN108196686B (en) Hand motion gesture capturing device, method and virtual reality interaction system
AU2019271907B2 (en) System, apparatus and method for measurement of muscle stiffness
US20220155866A1 (en) Ring device having an antenna, a touch pad, and/or a charging pad to control a computing device based on user motions
WO2017111972A1 (en) System and method to collect gesture input through wrist tendon and muscle sensing
CN102024316B (en) Wireless intelligent sensing method, device and system
US10152052B1 (en) Portable single-handed remote control system for unmanned aerial vehicle
WO2018064634A1 (en) Determination of cursor position on remote display screen based on bluetooth angle of arrival
WO2015153690A1 (en) Wearable motion sensing computing interface
EP4455803A2 (en) Upper-arm computer pointing apparatus
KR20150102312A (en) Walk posture measurement system using pressure sensor and bluetooth
CN104102355A (en) Method for designing USB (universal serial bus) keyboard and mouse combination equipment
CN105824402A (en) Method for realizing mouse function of wearable equipment and wearable equipment
CN205608660U (en) A motion capture gloves and virtual reality system for virtual reality system
CN113869180A (en) Finger gesture sensing device and method based on wireless coupling resonance
CN114073518A (en) Exercise state monitoring system, training support system, exercise state monitoring method, and computer-readable medium
TWI710389B (en) Positioning control method and positioning control system
CN112823742B (en) Joint bending state judging device and method
KR20190099625A (en) Band type wearable motion measurement controller
Karimi et al. A wearable 3D motion sensing system integrated with a Bluetooth smart phone application: A system level overview
CN205540578U (en) Control gloves based on gesture recognition
CN108151726B (en) Motion information detection system and method
CN111514018A (en) Positioning control method and positioning control system
CN205229983U (en) Bluetooth wireless mouse

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12887355

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2883520

Country of ref document: CA

Ref document number: 20157005413

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 14426131

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2012887355

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2012393913

Country of ref document: AU

Date of ref document: 20121101

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE