CN108897444A - The method and system of cursor control are realized using wearable wristband type universal serial mouse - Google Patents
The method and system of cursor control are realized using wearable wristband type universal serial mouse Download PDFInfo
- Publication number
- CN108897444A CN108897444A CN201810646129.8A CN201810646129A CN108897444A CN 108897444 A CN108897444 A CN 108897444A CN 201810646129 A CN201810646129 A CN 201810646129A CN 108897444 A CN108897444 A CN 108897444A
- Authority
- CN
- China
- Prior art keywords
- pressure
- mouse
- wrist
- pressure value
- gesture identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F3/0383—Signal control means within the pointing device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
Abstract
The invention discloses a kind of method and system that cursor control is realized using wearable wristband type universal serial mouse, above scheme is woth no need to complicated external equipment, it only needs user to wear the bracelet for being equipped with a small amount of pressure sensor in wrist, the mouse control with high robust low latency can be completed；Above scheme greatly improves the convenience of mouse, is applicable to a variety of occasions.
Description
Technical field
The present invention relates to field of computer technology more particularly to a kind of wearable wristband type universal serial mouse of utilization to realize that cursor controls
Method and system.
Background technique
The high speed development of computer-related technologies significantly improves the daily routines such as people's working entertainment.But as
The mouse of one of the important input equipment of computer still has some problems demands to solve at present.Firstly, the mouse of current mainstream,
Roller-ball mouse and optical mouse can be divided by type, and these two types of mouses are required to work on flat hard carrying desktop,
Otherwise its sensitivity used will be will affect.The rigid requirement limits the working environment of mouse to a certain extent, and affects
The use portability of mouse.On the other hand, when operating mouse, it is desirable that user's hand placement is on mouse.Due to human body forearm
Construction, wrist can be in bending state when using mouse, this causes the median nerve at wrist that will be chronically to suffer oppression
State be easy to cause wrist and shoulder fatigue.In addition, it is also that carpal tunnel syndrome (is commonly called as mouse that median nerve suffers oppression for a long time
Hand) one of main reason.
Demand is the driving source of innovation, and the scholars of field of human-computer interaction are unfolded to how to design the new interactive device of one kind
Research, it is intended to substitute mouse and be interacted with computer.The solution of existing novel mouse can be divided mainly into based on video
Mouse control and sensor-based mouse control are these two types of.
Mouse control solution principle based on video is：Computer obtains the motion profile letter of user using camera
Breath, and the movement of user is mapped in the movement of mouse, to complete the relevant operation to mouse.But video system light
It is affected according to condition, energy consumption is big, and directly carries out camera shooting to user and be easy to cause privacy concern.
Sensor-based mouse control scheme is using small, the portable feature of sensor bulk, by mouse and wearable
Equipment combines, by monitor a certain position of human body the direction of motion and motion amplitude, come control mouse the direction of motion and
Distance.The motion information of user's hand is such as obtained using bending sensor and inertial sensor based on the scheme of data glove,
But this scheme needs user to wear additional gloves, influences user experience, and can fetter the proper motion of hand, is unfavorable for day
It is often used.Scheme based on EMG (electromyogram) obtains hand exercise by arranging a large amount of electrode sensor in user's fore-arm
When electromyography signal, from electromyography signal obtain hand exercise situation.However, the deployment time of larger scale electrode array is long, and meeting
Other activities of user are interfered with, therefore usage scenario is limited.
Summary of the invention
The object of the present invention is to provide a kind of method and system that cursor control is realized using wearable wristband type universal serial mouse, only
The bracelet equipped with a small amount of pressure sensor is needed, the mouse control of high-precision low latency can be completed, meanwhile, cost is relatively low,
It is easy to spread.
The purpose of the present invention is what is be achieved through the following technical solutions：
A method of realizing that cursor controls using wearable wristband type universal serial mouse, including：
Pressure Value Data is acquired using multiple pressure sensors in wearable wristband type universal serial mouse, and is arranged according to specific format
Column；
Wrist pressure entire change information is analyzed according to the pressure Value Data after arrangement, to judge the movement shape of hand
State；
According to the judging result of hand exercise state, extract collected pressure Value Data time upper correlation information,
Spatially correlation information and energy information, and in this, as characteristic information to be identified；
Based on preparatory trained machine learning model, processing calculating is carried out to the characteristic information to be identified, thus complete
At gesture identification；
According to gesture identification as a result, with reference to the gesture and cursor operations that prestore contrast relationship, complete to the real-time of cursor
Control.
A kind of system for realizing cursor control using wearable wristband type universal serial mouse, including：
Wrist pressure acquisition module, for acquiring the pressure Value Data of multiple pressure sensors；
Signal acquisition and transmission module, for obtaining the pressure Value Data of multiple pressure sensors, and according to specific format
Arrangement；
Data processing and condition judgment module, for analyzing wrist pressure entire change according to the pressure Value Data after arrangement
Information, to judge the motion state of hand；
Characteristic extracting module extracts collected pressure Value Data for the judging result according to hand exercise state
Correlation information, spatially correlation information and energy information on time, and in this, as characteristic information to be identified；
Gesture recognition module, for based on preparatory trained machine learning model, to the characteristic information to be identified into
Row processing calculates, to complete gesture identification；
Cursor control module, for according to gesture identification as a result, with reference to the gesture and cursor operations that prestore contrast relationship,
Complete the real-time control to cursor.
As seen from the above technical solution provided by the invention, woth no need to complicated external equipment, it is only necessary to Yong Hu
Wrist wears the bracelet for being equipped with a small amount of pressure sensor, and the mouse control with high robust low latency can be completed；On
The scheme of stating greatly improves the convenience of mouse, is applicable to a variety of occasions.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, required use in being described below to embodiment
Attached drawing be briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for this
For the those of ordinary skill in field, without creative efforts, it can also be obtained according to these attached drawings other
Attached drawing.
Fig. 1 is a kind of stream of method that cursor control is realized using wearable wristband type universal serial mouse provided in an embodiment of the present invention
Cheng Tu；
Fig. 2 is the structural schematic diagram of wearable wristband type universal serial mouse provided in an embodiment of the present invention；
Fig. 3 is the structural schematic diagram of four pressure sensors of single-row arrangement provided in an embodiment of the present invention；
Fig. 4 is a kind of showing for system that cursor control is realized using wearable wristband type universal serial mouse provided in an embodiment of the present invention
It is intended to.
Specific embodiment
With reference to the attached drawing in the embodiment of the present invention, technical solution in the embodiment of the present invention carries out clear, complete
Ground description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Based on this
The embodiment of invention, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, belongs to protection scope of the present invention.
User's most of brachiocubital muscle of hand that all relies on when completing hand exercise carries out driving completion, and
Forearm muscle be by wrist at tendon be connected with hand muscle.It is slapped when manpower and is in different conditions, that is, doing different gestures
When movement, the state of tendon is different at wrist, also not identical for the pressure of wrist.If it is possible to obtain user
Tendon of wrist is in the pressure value that bracelet is given in the case of different gestures, so that it may extract associated change from these pressure values
Information determines the classification of gesture by related algorithm as feature.Specific above-mentioned principle, the embodiment of the present invention provide a kind of benefit
The method for realizing cursor control with wearable wristband type universal serial mouse, as shown in Figure 1, it mainly includes the following steps：
Step 11 acquires pressure Value Data using multiple pressure sensors in wearable wristband type universal serial mouse, and according to spy
The formula that fixes arrangement.
In the embodiment of the present invention, 4 pressure sensors, each pressure sensor acquisition are equipped in wearable wristband type universal serial mouse
The pressure data of user's wrist different location.Each pressure sensor can acquire current suffered pressure value, cooperate more
Road selector conveys the collected pressure value of corresponding pressure sensor, and carries out analog-to-digital conversion to per pressure value all the way, obtains
The pressure Value Data of digital signal form, then the pressure Value Data of digital signal form is arranged according to specific format.
As shown in Fig. 2, 4 pressure sensors are located at wrist front, the wrist back side, wrist left side and wrist right side；
The position of pressure sensor 24, placement at left and right sides of the pressure sensor 23 at wrist front and the back side, wrist needs to consider
The influence of wrist muscle 21, wrist tendon 22 and wrist bone 25.The pressure sensor 23 at wrist front and the back side is slightly larger than hand
Pressure sensor 24 at left and right sides of wrist covers at the main tendon of wrist.
In the embodiment of the present invention, the pressure sensor in wearable wristband type universal serial mouse is diaphragm pressure sensor；Such as Fig. 3 institute
Show, each pressure sensor is supported using silicagel pad, and the size of silicagel pad is adjusted with the size of pressure sensor, is allowed to lucky
It is bonded user's wrist skin.In Fig. 3, the pressure sensor in 31-- wrist front and the back side, the pressure at left and right sides of 32-- wrist
Sensor, 33-watchbands, 34-- silicagel pad.
Step 12 analyzes wrist pressure entire change information according to the pressure Value Data after arrangement, to judge hand
Motion state.
In the embodiment of the present invention, the wrist pressure entire change information includes：The each pressure sensor of current slot
The peak-to-valley value of the pressure Value Data of acquisition.
The motion state of the hand includes：Current hand remains static and motion state.
Step 13, according to the judging result of hand exercise state, extract the time upper correlation of collected pressure Value Data
Property information, spatially correlation information and energy information, and in this, as characteristic information to be identified.
In the embodiment of the present invention, the time of the pressure Value Data, upper correlation information was that each pressure sensor is being worked as
The mean value of the pressure value of preceding period represents the pressure condition in region corresponding to current slot pressure sensor；
The spatially correlation information of the pressure Value Data is that the pressure mean value of each pressure sensor is divided by all pressures
Maximum value in force snesor pressure mean value characterizes carpal area pressure distribution situation；
The energy information of the pressure Value Data includes：After each pressure sensor data of present period is normalized
Quadratic term characterizes the violent situation of the pressure data variation of each pressure sensor corresponding region under current slot, and each
The sum of a sensing data quadratic term characterizes the severe degree of current slot pressure data entire change.
Step 14 is based on preparatory trained machine learning model, carries out processing calculating to the characteristic information to be identified,
To complete gesture identification.
Since hand is put when different user wrist thickness is different, the position difference of wearing bracelet and user use bracelet every time
Position difference is put, even same gesture, caused wrist pressure distribution is also different.Using pressure value absolute value simultaneously
The different situation of different gesture bring pressure cannot be reacted well, therefore, to obtain higher recognition accuracy, used
Pressure value is relative value, and reference pressure value is to lay flat the pressure value of gesture.This method further comprises the initial of reference pressure value
Change and update method：
1, user completes the wearing of bracelet according to own situation, and keeps gesture laid-flat status 1 to 2 seconds, system record
The pressure value of this period and as reference pressure value.
2, when current gesture is judged as by system lays flat gesture, system records the pressure value of current slot, and accordingly
Update reference value.
In the embodiment of the present invention, reference pressure value can help to extract the upper correlation information of the time on pressure Value Data and
Spatially correlation information；In other words, on the time correlation information and spatially correlation information need according to reference pressure value
To extract；In conjunction with the mode provided in an embodiment of the present invention being updated to reference pressure value, gesture identification can be improved
Accuracy rate.
It will be understood by those skilled in the art that there is certain correlative connection between different gesture types and characteristic information,
Also the one-to-one correspondence of characteristic information and gesture type can be completed by various machine learning methods.Illustratively, engineering
The method of habit is best with SVM method effect at present, and the method used includes but is not limited to the methods of perceptron, random forest.
Illustratively, gesture identification result mainly includes：The static shape that stationary state that palm is laid flat, palm are lifted up
Stationary state to the stationary state of left avertence, from palm to right avertence of stationary state that state, palm are clenched fist, palm, index finger this root hand
The hammer action etc. of this two fingers of the hammer action and index finger and middle finger of finger.
Step 15, according to gesture identification as a result, with reference to the gesture and cursor operations that prestore contrast relationship, complete to cursor
Real-time control.
In the embodiment of the present invention, if gesture identification result is the stationary state that palm is laid flat, controls mouse and keep in situ；
If gesture identification result is the stationary state that palm is lifted up, controls mouse and moved up by predetermined speed；
If gesture identification result is the stationary state that palm is clenched fist, controls mouse and moved down by predetermined speed；
If gesture identification result is stationary state of the palm to left avertence, controls mouse and be moved to the left by predetermined speed；
If gesture identification result is stationary state of the palm to right avertence, controls mouse and move right by predetermined speed；
If gesture identification result is the hammer action of this root finger of index finger, mouse is controlled in current location and carries out left button
Single-click operation；
If gesture identification result be this two fingers of index finger and middle finger hammer action, control mouse current location into
Row right button single-click operation.
The embodiment of the present invention provides the scheme that above scheme is different from other wearable mouses, and above scheme only used
Equipped with the bracelet of a small amount of pressure sensor, given the position of pressure sensor, and from the pressure value information of pressure sensor
In extracted more effective feature, used it is more efficient and have more robustness algorithm, realize and passed using a small amount of pressure
The mouse control of sensor completion real-time.
Above scheme of the embodiment of the present invention, it is only necessary to user uses the bracelet for a small amount of pressure sensor worn in wrist,
The high-precision real-time control to computer mouse can be completed；On the one hand, this programme had both improved the convenience of mouse control, also right
The layout of pressure sensor has carried out the optimization for portability, is extracted more simple and effective spy to collected pressure information
Sign, has selected more advanced algorithm, therefore the precision of mouse control and real-time are also protected；It is provided by the present invention to wear
Mouse is worn, not needing carrying desktop can be used, such as allow to use in the air, and compared with prior art, use scope is wider.
Interactive gesture motion is optimized in another aspect this programme, so as to reduce the hair of the hands disease such as carpal tunnel syndrome
Sick probability.In current experiment, the accuracy rate of operation is 93% or so.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment can
The mode of necessary general hardware platform can also be added to realize by software by software realization.Based on this understanding,
The technical solution of above-described embodiment can be embodied in the form of software products, which can store non-easy at one
In the property lost storage medium (can be CD-ROM, USB flash disk, mobile hard disk etc.), including some instructions are with so that a computer is set
Standby (can be personal computer, server or the network equipment etc.) executes method described in each embodiment of the present invention.
Another embodiment of the present invention also provides a kind of system for realizing cursor control using wearable wristband type universal serial mouse, this is
Method described in above-described embodiment may be implemented in system, as shown in figure 4, the system mainly includes：
Wrist pressure acquisition module 41, for acquiring the pressure Value Data of multiple pressure sensors；
Signal acquisition and transmission module 42, for obtaining the pressure Value Data of multiple pressure sensors, and according to particular bin
Formula arrangement；
Data processing and condition judgment module 43, for totally being become according to the pressure Value Data analysis wrist pressure after arrangement
Change information, to judge the motion state of hand；
Characteristic extracting module 44 extracts collected pressure Value Data for the judging result according to hand exercise state
Time upper correlation information, spatially correlation information and energy information, and in this, as characteristic information to be identified；
Gesture recognition module 45, for being based on preparatory trained machine learning model, to the characteristic information to be identified
Processing calculating is carried out, to complete gesture identification；
Cursor control module 46, for according to gesture identification as a result, with reference to the gesture and cursor operations prestored control close
System completes the real-time control to cursor.
In the embodiment of the present invention, wrist pressure acquisition module 41 and signal acquisition are all set in transmission module 42 and can wear
It wears in wristband type universal serial mouse；
The wrist pressure acquisition module includes：4 pressure sensors, multiple selector and A/D module；Each pressure passes
The pressure data of sensor acquisition user's wrist different location；4 pressure sensors are located at wrist front, the wrist back side, hand
On the left of wrist and on the right side of wrist；Each pressure sensor can acquire current suffered pressure value, and cooperation multiple selector is defeated
Send corresponding pressure sensor collected pressure value, A/D module carries out analog-to-digital conversion to per pressure value all the way, obtains number letter
The pressure Value Data of number form；
Signal acquisition includes with transmission module：Signal acquisition unit and wireless transport module；Signal acquisition unit, being used for will
The pressure Value Data of digital signal form is arranged according to specific format；Wireless transport module, for handling signal acquisition unit
Pressure Value Data afterwards is transferred to data processing and condition judgment module.
In the embodiment of the present invention, the pressure sensor in wearable wristband type universal serial mouse is diaphragm pressure sensor, uses silicon
Rubber mat supports each pressure sensor, and the size of silicagel pad is adjusted with the size of pressure sensor, be allowed to be bonded user just
Wrist skin.
In the embodiment of the present invention, the time of the pressure Value Data, upper correlation information was that each pressure sensor is being worked as
The mean value of the pressure value of preceding period represents the pressure condition in region corresponding to current slot pressure sensor；
The spatially correlation information of the pressure Value Data is that the pressure mean value of each pressure sensor is divided by all pressures
Maximum value in force snesor pressure mean value characterizes carpal area pressure distribution situation；
The energy information of the pressure Value Data includes：After each pressure sensor data of present period is normalized
Quadratic term characterizes the violent situation of the pressure data variation of each pressure sensor corresponding region under current slot, and each
The sum of a sensing data quadratic term characterizes the severe degree of current slot pressure data entire change.
In the embodiment of the present invention, it is described according to gesture identification as a result, with reference to the gesture and cursor operations prestored control close
System, completion include to the real-time control of cursor：
If gesture identification result is the stationary state that palm is laid flat, controls mouse and keep in situ；
If gesture identification result is the stationary state that palm is lifted up, controls mouse and moved up by predetermined speed；
If gesture identification result is the stationary state that palm is clenched fist, controls mouse and moved down by predetermined speed；
If gesture identification result is stationary state of the palm to left avertence, controls mouse and be moved to the left by predetermined speed；
If gesture identification result is stationary state of the palm to right avertence, controls mouse and move right by predetermined speed；
If gesture identification result is the hammer action of this root finger of index finger, mouse is controlled in current location and carries out left button
Single-click operation；
If gesture identification result be this two fingers of index finger and middle finger hammer action, control mouse current location into
Row right button single-click operation.
It will be understood by those skilled in the art that data processing and condition judgment module 43, characteristic extracting module 44, gesture are known
Other module 45 may be disposed in computer with cursor control module 46, meanwhile, computer also has matched display equipment, uses
With display highlighting control process.
It should be noted that specific implementation of the functions implemented by the various functional modules included in the above system exists
It has had a detailed description in each embodiment of front, therefore has repeated no more herein.
It is apparent to those skilled in the art that for convenience and simplicity of description, only with above-mentioned each function
The division progress of module can according to need and for example, in practical application by above-mentioned function distribution by different function moulds
Block is completed, i.e., the internal structure of system is divided into different functional modules, to complete all or part of function described above
Energy.
The foregoing is only a preferred embodiment of the present invention, but scope of protection of the present invention is not limited thereto,
Within the technical scope of the present disclosure, any changes or substitutions that can be easily thought of by anyone skilled in the art,
It should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with the protection model of claims
Subject to enclosing.
Claims (10)
1. a kind of method for realizing cursor control using wearable wristband type universal serial mouse, which is characterized in that including：
Pressure Value Data is acquired using multiple pressure sensors in wearable wristband type universal serial mouse, and is arranged according to specific format；
Wrist pressure entire change information is analyzed according to the pressure Value Data after arrangement, to judge the motion state of hand；
According to the judging result of hand exercise state, the time upper correlation information, space of collected pressure Value Data are extracted
Upper correlation information and energy information, and in this, as characteristic information to be identified；
Based on preparatory trained machine learning model, processing calculating is carried out to the characteristic information to be identified, to complete hand
Gesture identification；
According to gesture identification as a result, with reference to the gesture and cursor operations that prestore contrast relationship, complete to the real-time control of cursor.
2. a kind of method for realizing cursor control using wearable wristband type universal serial mouse according to claim 1, feature exist
In equipped with 4 pressure sensors, the pressure of each pressure sensor acquisition user's wrist different location in wearable wristband type universal serial mouse
Force data；4 pressure sensors are located at wrist front, the wrist back side, wrist left side and wrist right side；
Each pressure sensor can acquire current suffered pressure value, cooperation multiple selector conveying relevant pressure sensing
The collected pressure value of device, and analog-to-digital conversion is carried out to per pressure value all the way, the pressure Value Data of digital signal form is obtained,
The pressure Value Data of digital signal form is arranged according to specific format again.
3. a kind of method for realizing cursor control using wearable wristband type universal serial mouse according to claim 1 or 2, feature
It is, the pressure sensor in wearable wristband type universal serial mouse is diaphragm pressure sensor, and each pressure is supported using silicagel pad
The size of sensor, silicagel pad is adjusted with the size of pressure sensor, is allowed to be bonded user's wrist skin just.
4. a kind of method for realizing cursor control using wearable wristband type universal serial mouse according to claim 1, feature exist
In,
Time of the pressure Value Data, upper correlation information was, each pressure sensor current slot pressure value it is equal
Value, represents the pressure condition in region corresponding to current slot pressure sensor；
The spatially correlation information of the pressure Value Data is that the pressure mean value of each pressure sensor is passed divided by all pressure
Maximum value in sensor pressure mean value characterizes carpal area pressure distribution situation；
The energy information of the pressure Value Data includes：The each pressure sensor data of present period be normalized after square
, characterize the violent situation and each biography of the pressure data variation of each pressure sensor corresponding region under current slot
The sum of sensor data quadratic term characterizes the severe degree of current slot pressure data entire change.
5. a kind of method for realizing cursor control using wearable wristband type universal serial mouse according to claim 1, feature exist
In, it is described according to gesture identification as a result, with reference to the gesture and cursor operations that prestore contrast relationship, complete real-time control to cursor
System includes：
If gesture identification result is the stationary state that palm is laid flat, controls mouse and keep in situ；
If gesture identification result is the stationary state that palm is lifted up, controls mouse and moved up by predetermined speed；
If gesture identification result is the stationary state that palm is clenched fist, controls mouse and moved down by predetermined speed；
If gesture identification result is stationary state of the palm to left avertence, controls mouse and be moved to the left by predetermined speed；
If gesture identification result is stationary state of the palm to right avertence, controls mouse and move right by predetermined speed；
If gesture identification result is the hammer action of this root finger of index finger, controls mouse and clicked in current location progress left button
Operation；
If gesture identification result is the hammer action of this two fingers of index finger and middle finger, mouse is controlled in current location and carries out the right side
Key single-click operation.
6. a kind of system for realizing cursor control using wearable wristband type universal serial mouse, which is characterized in that including：
Wrist pressure acquisition module, for acquiring the pressure Value Data of multiple pressure sensors；
Signal acquisition and transmission module for obtaining the pressure Value Data of multiple pressure sensors, and are arranged according to specific format；
Data processing and condition judgment module, for according to the pressure Value Data analysis wrist pressure entire change letter after arrangement
Breath, to judge the motion state of hand；
Characteristic extracting module extracts the time of collected pressure Value Data for the judging result according to hand exercise state
Upper correlation information, spatially correlation information and energy information, and in this, as characteristic information to be identified；
Gesture recognition module, for being based on preparatory trained machine learning model, at the characteristic information to be identified
Reason calculates, to complete gesture identification；
Cursor control module, for according to gesture identification as a result, with reference to the gesture and cursor operations that prestore contrast relationship, complete
To the real-time control of cursor.
7. a kind of system for realizing cursor control using wearable wristband type universal serial mouse according to claim 6, feature exist
In wrist pressure acquisition module and signal acquisition and transmission module are all set in wearable wristband type universal serial mouse；
The wrist pressure acquisition module includes：4 pressure sensors, multiple selector and A/D module；Each pressure sensor
Acquire the pressure data of user's wrist different location；4 pressure sensors are located at wrist front, the wrist back side, a wrist left side
On the right side of side and wrist；Each pressure sensor can acquire current suffered pressure value, and cooperation multiple selector conveys phase
The collected pressure value of pressure sensor is answered, A/D module carries out analog-to-digital conversion to per pressure value all the way, obtains digital signal shape
The pressure Value Data of formula；
Signal acquisition includes with transmission module：Signal acquisition unit and wireless transport module；Signal acquisition unit, being used for will be digital
The pressure Value Data of signal form is arranged according to specific format；Wireless transport module, for treated by signal acquisition unit
Pressure Value Data is transferred to data processing and condition judgment module.
8. a kind of system for realizing cursor control using wearable wristband type universal serial mouse according to claim 6 or 7, feature
It is, the pressure sensor in wearable wristband type universal serial mouse is diaphragm pressure sensor, and each pressure is supported using silicagel pad
The size of sensor, silicagel pad is adjusted with the size of pressure sensor, is allowed to be bonded user's wrist skin just.
9. a kind of system for realizing cursor control using wearable wristband type universal serial mouse according to claim 6, feature exist
In,
Time of the pressure Value Data, upper correlation information was, each pressure sensor current slot pressure value it is equal
Value, represents the pressure condition in region corresponding to current slot pressure sensor；
The spatially correlation information of the pressure Value Data is that the pressure mean value of each pressure sensor is passed divided by all pressure
Maximum value in sensor pressure mean value characterizes carpal area pressure distribution situation；
The energy information of the pressure Value Data includes：The each pressure sensor data of present period be normalized after square
, characterize the violent situation and each biography of the pressure data variation of each pressure sensor corresponding region under current slot
The sum of sensor data quadratic term characterizes the severe degree of current slot pressure data entire change.
10. a kind of system for realizing cursor control using wearable wristband type universal serial mouse according to claim 6, feature exist
In, it is described according to gesture identification as a result, with reference to the gesture and cursor operations that prestore contrast relationship, complete real-time control to cursor
System includes：
If gesture identification result is the stationary state that palm is laid flat, controls mouse and keep in situ；
If gesture identification result is the stationary state that palm is lifted up, controls mouse and moved up by predetermined speed；
If gesture identification result is the stationary state that palm is clenched fist, controls mouse and moved down by predetermined speed；
If gesture identification result is stationary state of the palm to left avertence, controls mouse and be moved to the left by predetermined speed；
If gesture identification result is stationary state of the palm to right avertence, controls mouse and move right by predetermined speed；
If gesture identification result is the hammer action of this root finger of index finger, controls mouse and clicked in current location progress left button
Operation；
If gesture identification result is the hammer action of this two fingers of index finger and middle finger, mouse is controlled in current location and carries out the right side
Key single-click operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810646129.8A CN108897444A (en) | 2018-06-21 | 2018-06-21 | The method and system of cursor control are realized using wearable wristband type universal serial mouse |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810646129.8A CN108897444A (en) | 2018-06-21 | 2018-06-21 | The method and system of cursor control are realized using wearable wristband type universal serial mouse |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108897444A true CN108897444A (en) | 2018-11-27 |
Family
ID=64345513
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810646129.8A Pending CN108897444A (en) | 2018-06-21 | 2018-06-21 | The method and system of cursor control are realized using wearable wristband type universal serial mouse |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108897444A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022067963A1 (en) * | 2020-09-29 | 2022-04-07 | 泰州翔升科技服务有限公司 | Computer control method and wearable device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105022471A (en) * | 2014-04-23 | 2015-11-04 | 王建勤 | Device and method for carrying out gesture recognition based on pressure sensor array |
| CN105204640A (en) * | 2015-09-24 | 2015-12-30 | 努比亚技术有限公司 | Wearable mouse |
| US20160070367A1 (en) * | 2014-09-05 | 2016-03-10 | Htc Corporation | Wearable electronic device and cursor control device |
| CN107145236A (en) * | 2017-05-12 | 2017-09-08 | 中国科学技术大学 | A kind of gesture identification method and system based on tendon of wrist pressure correlation characteristic |
-
2018
- 2018-06-21 CN CN201810646129.8A patent/CN108897444A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105022471A (en) * | 2014-04-23 | 2015-11-04 | 王建勤 | Device and method for carrying out gesture recognition based on pressure sensor array |
| US20160070367A1 (en) * | 2014-09-05 | 2016-03-10 | Htc Corporation | Wearable electronic device and cursor control device |
| CN105204640A (en) * | 2015-09-24 | 2015-12-30 | 努比亚技术有限公司 | Wearable mouse |
| CN107145236A (en) * | 2017-05-12 | 2017-09-08 | 中国科学技术大学 | A kind of gesture identification method and system based on tendon of wrist pressure correlation characteristic |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022067963A1 (en) * | 2020-09-29 | 2022-04-07 | 泰州翔升科技服务有限公司 | Computer control method and wearable device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Truong et al. | Capband: Battery-free successive capacitance sensing wristband for hand gesture recognition | |
| CN114341779B (en) | Systems, methods, and interfaces for performing input based on neuromuscular control | |
| US9999391B2 (en) | Wearable electromyogram sensor system | |
| CN112789577B (en) | Neuromuscular text input, writing and drawing in augmented reality systems | |
| US20150109202A1 (en) | Systems, articles, and methods for gesture identification in wearable electromyography devices | |
| US20170215768A1 (en) | Wearable controller for wrist | |
| JP2022500729A (en) | Neuromuscular control of augmented reality system | |
| CN105022471A (en) | Device and method for carrying out gesture recognition based on pressure sensor array | |
| CN103677289A (en) | Intelligent interactive glove and interactive method | |
| Bachynskyi et al. | Informing the design of novel input methods with muscle coactivation clustering | |
| WO2009044967A1 (en) | Bracelet keyboard and key-in method therby | |
| Zhang et al. | Recognizing hand gestures with pressure-sensor-based motion sensing | |
| US10521018B2 (en) | Human body-based interaction method and interaction apparatus | |
| CN103513770A (en) | Man-machine interface equipment and man-machine interaction method based on three-axis gyroscope | |
| CN103677265A (en) | Intelligent sensing glove and intelligent sensing method | |
| Ortega-Avila et al. | Non-invasive optical detection of hand gestures | |
| Dong et al. | Wearable sensing devices for upper limbs: A systematic review | |
| CN107145236A (en) | A kind of gesture identification method and system based on tendon of wrist pressure correlation characteristic | |
| US11237632B2 (en) | Ring device having an antenna, a touch pad, and/or a charging pad to control a computing device based on user motions | |
| Liu et al. | WR-Hand: Wearable armband can track user's hand | |
| Lee et al. | Taiwan sign language (TSL) recognition based on 3D data and neural networks | |
| Jiang et al. | Development of a real-time hand gesture recognition wristband based on sEMG and IMU sensing | |
| Fan et al. | Wearable motion attitude detection and data analysis based on Internet of Things | |
| Makaussov et al. | A low-cost, IMU-based real-time on device gesture recognition glove | |
| CN108897444A (en) | The method and system of cursor control are realized using wearable wristband type universal serial mouse |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181127 |
|
| RJ01 | Rejection of invention patent application after publication |