CN104679246B - The Wearable and control method of human hand Roaming control in a kind of interactive interface - Google Patents
The Wearable and control method of human hand Roaming control in a kind of interactive interface Download PDFInfo
- Publication number
- CN104679246B CN104679246B CN201510076982.7A CN201510076982A CN104679246B CN 104679246 B CN104679246 B CN 104679246B CN 201510076982 A CN201510076982 A CN 201510076982A CN 104679246 B CN104679246 B CN 104679246B
- Authority
- CN
- China
- Prior art keywords
- action
- human hand
- control
- interactive interface
- roaming
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses the Wearable and control method of human hand Roaming control in a kind of interactive interface, wearable device is annular in shape, it need to be worn on when using at user's wrist, the equipment specifically includes human hand movement data obtaining module, data processing module, control scheduling module and low coverage radio receiving transmitting module.A kind of method of interactive interface human hand Roaming control is, equipment sets up wireless telecommunications with main frame, user is by lifting hand and double or more quick rotation list action or double swerve list action obtain equipment control, system gathers human hand movement information and the movement of simulated light target is shown as on interactive interface in real time, user by a brief period of time or it is single give directions to hit or give more directions hit action and choose required function icon on interactive interface.The equipment that the present invention is provided is low cost low-power consumption wearable device, and the method that the present invention is provided can be supplied to user comfortable natural and the accurate man-machine interaction experience of operation.
Description
Technical field
The present invention relates to the research field of man-machine interaction, the wearing of human hand Roaming control in more particularly to a kind of interactive interface
Formula equipment and control method.
Background technology
With the fast development of computer technology, human-computer interaction technology has also obtained certain development.Traditional man-machine friendship
It is mutually the interactive mode based on mouse-keyboard mostly, to make people have more preferable experience when operating computer, mouse also undergoes
Many revolutionary development.From mechanical mouse to optical mouse, then wireless mouse by now, all show people to mouse
Attention, i.e. attention of the people to man-machine interaction experience.However, above-mentioned mouse is required for a supporting plane to make in operation
Mouse completes accurate operation, but this also exposes some inconveniences, it is generally desirable that free can be set with computer
It is standby to interact operation.Air mouse, it is possible to achieve to the accurate control of mouse without being placed in any plane, Ke Yishi
Even word input operation is now clicked on, but it can not discharge both hands to operate screen as conventional mouse.
It is desirable to there is a kind of mode of operation for discharging both hands, being then based on the gesture control of vision can discharge double completely
Hand, it is possible to achieve the gesture interaction of view-based access control model is not sufficiently stable under mouse roaming and click function, but giant-screen, it is impossible to accurate control
Mouse processed, and there is also the risk of invasion of privacy for camera under domestic environment, it is difficult to popularize.Finger mouse is because in life
There are many activities for being not suitable for wearing finger ring, such as washing one's hands, wash vegetables, cause user continuously to wear finger ring for a long time, because
This Consumer's Experience is not good；, newest armlet is based on muscle sensing gesture, and then cost high-tech is complicated, wears discomfort.Hand of today
Ring group has originally all possessed health monitoring, the function such as managing mobile phone, and people also increasingly receive to wear bracelet this wearable device,
Meanwhile, bracelet is equipped with acceleration transducer, gyroscope substantially, and cost is relatively low, and it is us that mouse is controlled with bracelet
The new technology of proposition, is mapped as simulated light target on interactive interface by the action of gesture and moves, it is possible to achieve stable precise manipulation
Interactive interface, with the advantages such as accurate, release both hands, low cost, technology maturation, small power consumption are operated, disclosure satisfy that user's request.
The content of the invention
It is a primary object of the present invention to overcome the shortcoming and deficiency of prior art there is provided one kind operation it is accurate, can liberate
The Wearable of human hand Roaming control in the low interactive interface of the both hands and cost of people.
Another object of the present invention is to there is provided the Wearable of human hand Roaming control in a kind of above-mentioned interactive interface
Control method.
In order to reach above-mentioned first purpose, the present invention uses following technical scheme：
The Wearable of human hand Roaming control in a kind of interactive interface, including apparatus body is with being located in apparatus body
Circuit module, equipment is ring-type, is worn on when using at user's wrist；
The circuit module includes human hand movement data obtaining module, data processing module, control scheduling module, low coverage
Radio receiving transmitting module, wherein：
Human hand movement data obtaining module：Movable information of the human hand in space coordinates during for obtaining gesture roaming,
And send to data processing module；
Data processing module：For by the movable information carry out Treatment Analysis, and Classification and Identification its roam gesture motion,
It is translated into control signal and sends to main frame；
Control scheduling module：Control, triggering or stopping interactive interface roam operation are allocated according to human hand movement situation
Function；
Low coverage radio receiving transmitting module：For being connected with main frame, wireless telecommunications are set up, and will control on the basis of communication is set up
Information processed is sent to main frame.
It is preferred that, the human hand movement data obtaining module includes：
3-axis acceleration sensor, linear translation acceleration of the human hand in space coordinates during for obtaining gesture roaming
A=(ax, ay, az)；
Three-axis gyroscope, axial rotation angular velocity vector Ω of the human hand in space coordinates during for obtaining gesture roaming=
(wx, wy, wz)。
It is preferred that, the communication is one kind in Bluetooth, ZigBee, WiFi wireless communication mode.
In order to reach above-mentioned second purpose, the present invention uses following technical scheme：
The control method of the wearable device of human hand Roaming control, comprises the steps in a kind of interactive interface：
S1, when equipment and main frame distance be the first preset range when, low coverage radio receiving transmitting module sends wireless messages automatically,
It is attached with main frame, sets up wireless telecommunications, system enters holding state；
S2, human hand movement data obtaining module obtain movable information of the human hand in space coordinates, the motion in real time
Information includes acceleration information and angular velocity information, and sends to data processing module；
S3, when detect user lift hand and it is double or more than twice quick rotation wrist more than the first predetermined angular
When, then control scheduling module distributes control for it, and equipment enters working condition, interactive interface display simulation cursor；
S4, human hand movement data obtaining module obtain the movable information in space coordinates, number when human hand is roamed in real time
The movable information is subjected to Treatment Analysis according to processing module, and Classification and Identification its be roaming action, and by recognition result data
Send to main frame；
S5, main frame are received after the recognition result data, by Ω=(ωx,ωy,ωz) handled by Kalman filter
ObtainAnd it is translated into simulated light target analog coordinate on interactive interfaceAnd simultaneous display simulated light target
It is mobile；
S6, when cursor roams to user's required function icon, user make a brief period of time action, human hand movement acquisition of information mould
The action message of block collection human hand now；
S7, data processing module carry out Classification and Identification to above-mentioned movable information and shown on action, interactive interface to choose
It is selected for user's required function icon；
S8, S2 is repeated to S7 steps, until detecting, user's arm puts down action naturally and mouse is in interactive interface
Edge is not detected by human hand action more than first scheduled time, or within second scheduled time, then control scheduling module takes
The equipment that disappears control, system enters holding state；Or hand is lifted described in step S3 and double or more until detecting
Quick rotation or double swerve list action, system are again introduced into working condition.
It is preferred that, in step S3, the mode for obtaining equipment control is：Wrist is lifted, and double or more fast
Speed rotates wrist more than the first predetermined angular, once rotates and is defined as wrist by original state along a direction axial rotation, then
Wrist rotation is returned into original state in opposite direction.
It is preferred that, data processing module by the movable information carry out Treatment Analysis, and Classification and Identification its be roaming action,
Detailed process is：
The movable information is carried out A/D samplings and is converted into data signal by S41, data processing module, and carries out Kalman
Filtering fusion treatment obtains nine dimension data information of human hand movement, and the nine dimension datas information includes：3-axis acceleration information A=
(ax,ay,az), three axis angular rate information Ω=(ωx,ωy,ωz) and three-axis attitude angle information Θ=(θx,θy,θz)；
S42, data processing module are according to the above-mentioned multistage characteristic tensor of nine dimension datas information architecture
S43, in short-time analysis window, based on the multistage tensor property x of single framestBuild sequential action recognition feature Xt=
[xt-n,...,xt], wherein n is Short-time Window length；
S44, to sequential action recognition feature principal component analyze, including decentralization, Eigenvalues Decomposition is white with PCA
Change, formula is：
Wherein,For lower-dimensional subspace mapping matrix, M is temporal aspect XtDimension, N be lower-dimensional subspace map
Dimension；
S45, using multi-category support vector machines (SVM) realize to roaming action, a brief period of time action and the classification of click action
Identification, roaming/a brief period of time SVM classifier parameter is obtained based on the training of Structural risk minization principle<W1 SVM,b1>, roaming/click SVM
Parameter<W2 SVM,b1>
gi(Pt)=PtWi SVM+bi
It is preferred that, described to choose action to be a brief period of time action in step S7, i.e., the finger of non-thumb presses pressure in thumb
Quick outwards ejection.
It is preferred that, the step S3, control acquisition, which is acted, to be：Wrist double swerve is acted, i.e., wrist is certainly
Under right relaxation state, along same horizontal line double swerve.
It is preferred that, choose action in the step S7, mode can also be singly to refer to click action, i.e., in addition to forefinger its
Remaining finger holds shape, forefinger do above and below hammer action.
It is preferred that, action is chosen in the step S7, mode can also be, double finger click actions or give more directions are hit
Make, i.e., wrist is under natural relaxation state, and the five fingers open naturally, and forefinger replaces with middle finger makes click action, or in addition to thumb,
Remaining finger alternately makes click action.
The present invention compared with prior art, has the following advantages that and beneficial effect：
1) Wearable of human hand Roaming control uses acceleration transducer and gyro in a kind of interactive interface of the invention
Instrument gathers the movable information of human hand, and precise and stable roaming result is obtained when user gesture is roamed on interactive interface.
2) Wearable of human hand Roaming control is non-portable equipment in a kind of interactive interface of the invention, when using only
It need to be worn at wrist, therefore user has been broken away from the constraint of hand-held interactive device, liberate the both hands of people.
3) method of human hand Roaming control is to carry out man-machine interactive operation based on people in a kind of interactive interface of the invention
When custom design, enable users to naturally complete interactive operation, it is not easy to occur fatigue.
Brief description of the drawings
Fig. 1 is the structural representation of the Wearable of human hand Roaming control in a kind of interactive interface of the invention；
Fig. 2 is the system structure diagram of the Wearable of human hand Roaming control in a kind of interactive interface of the invention；
Fig. 3 is the schematic flow sheet of the method for human hand Roaming control in a kind of interactive interface of the invention；
Fig. 4 is the control acquisition action schematic diagram of the method for human hand Roaming control in a kind of interactive interface of the invention；
Fig. 5 is a brief period of time action schematic diagram of the method for human hand Roaming control in a kind of interactive interface of the invention；
Fig. 6 is that the method for human hand Roaming control in a kind of interactive interface of the invention singly refers to click action schematic diagram；
Fig. 7 is double finger click action schematic diagrames of the method for human hand Roaming control in a kind of interactive interface of the invention；
Fig. 8 is that the giving more directions for method of human hand Roaming control in a kind of interactive interface of the invention hits action schematic diagram.
Embodiment
With reference to embodiment and accompanying drawing, the present invention is described in further detail, but embodiments of the present invention are not limited
In this.
Embodiment
The Wearable of human hand Roaming control in a kind of interactive interface of the present invention, including apparatus body is with being located at equipment
Intrinsic circuit module, wherein, as shown in figure 1, equipment is ring-type, it need to be worn on when using at user's wrist.
As shown in Fig. 2 the circuit module includes human hand movement data obtaining module 21, data processing module 22, control
Scheduling module 23, low coverage radio receiving transmitting module 24 are weighed, wherein：
Human hand movement data obtaining module 21：Motion letter of the human hand in space coordinates during for obtaining gesture roaming
Breath, and send to data processing module；
Data processing module 22：By the movable information carry out Treatment Analysis, and Classification and Identification its roam gesture motion, will
It is converted into control signal and sent to main frame；
Control scheduling module 23：Control, triggering or stopping roam operation function are allocated according to human hand movement situation；
Low coverage radio receiving transmitting module 24：For being connected with main frame, wireless telecommunications are set up, and will on the basis of communication is set up
Control information is sent to main frame.
Specifically, the main frame can have the equipment of larger display screen for computer, intelligent television etc., and main frame also should
There is low coverage radio receiving transmitting module to set up wireless telecommunications with Wearable of the present invention.
Further, the human hand movement data obtaining module 21 includes：
3-axis acceleration sensor 211, linear translation of the human hand in space coordinates adds during for obtaining gesture roaming
Speed A=(ax, ay, az)；
Three-axis gyroscope 212, axial rotation angular velocity vector Ω of the human hand in space coordinates during for obtaining gesture roaming
=(wx, wy, wz)。
Further, the wireless communication, mode can be the wireless communication modes such as Bluetooth, ZigBee, WiFi.
As shown in figure 3, in a kind of interactive interface human hand Roaming control method, wherein, comprise the following steps：
S1 is when equipment is the first preset range with main frame distance, and low coverage radio receiving transmitting module 24 sends wireless communication automatically
Breath, is attached with main frame, sets up wireless telecommunications, system enters holding state；
Concrete application scene can be as follows, near the constantly detection of low coverage radio receiving transmitting module 24 of Wearable of the present invention
(assuming that the first preset range threshold value is 5 meters) whether there is the main frame for having radio receiving transmitting module unlatching work in 5 meters, if so, then
The active of low coverage radio receiving transmitting module 24 of Wearable is connected with the low coverage radio receiving transmitting module of main frame, sets up wireless telecommunications,
Present device enters holding state.
S2 human hand movements data obtaining module 21 obtains movable information (a of the human hand in space coordinates in real timex, ay, az
And wx, wy, wz), and send to data processing module；
S3 when detect user lift hand and it is double (or more) quick rotation wrist more than the first predetermined angular when (such as
Shown in Fig. 4), then control scheduling module 23 distributes control for it, and equipment enters working condition, and interactive interface shows simulated light
Mark；
Concrete application scene can be as follows, and user wants to be roamed on interactive interface with Wearable of the present invention
When, then only need to hand being raised to a comfortable position from the state of naturally drooping, and double (or more) quick rotation hand
More than 90 ° of wrist (assuming that the first predetermined angular threshold value is 90 °), human hand movement data obtaining module 21 is collected after this action message
Send to data processing module 22,02 pair of the data processing module action message carries out Treatment Analysis, and Classification and Identification its be
Control acquisition is acted, and it is that the Wearable distributes control that recognition result, which is sent to control scheduling module 23, if
Standby to enter working condition, interactive interface center shows primary simulation cursor, as shown in Figure 4.
If user only lifts hand and do not rotate wrist, either user only rotates wrist once or user rotates wrist every time
No more than 90 °, then system all not thinks it is control acquisition action, therefore will not also distribute control to current device.
S4 human hand movements data obtaining module 21 obtains the movable information in space coordinates when human hand is roamed in real time
(ax, ay, azAnd wx, wy, wz), data processing module 22 by the movable information carry out Treatment Analysis, and Classification and Identification its be unrestrained
It is travelling to make, and recognition result data are sent to main frame；
S5 main frames are received after the recognition result data, are translated into simulated light target analog coordinate on interactive interface,
And simultaneous display simulated light target is moved；
S6 is when cursor roams to user's required function icon, and user makes a brief period of time action, as shown in figure 5, human hand movement
The action message of the collection of data obtaining module 21 human hand now；
S7 data processing modules 22 carry out Classification and Identification to above-mentioned movable information and shown on action, interactive interface to choose
It is selected for user's required function icon；
S8 repeats S2 to S7 steps, until detecting, user's arm puts down action naturally and mouse is in interactive interface side
Edge is not detected by human hand action more than first scheduled time, or within second scheduled time, then control scheduling module 23 takes
The equipment that disappears control, system enters holding state, until detect lifted described in step S3 hand and it is double (or more) it is fast
Speed rotates list action, and system is again introduced into working condition；
Concrete application scene can be as follows, and user for example wants to browse interactive interface content in detail, temporarily due to a certain factor
When do not need cursor roaming with choose operation, then arm can naturally be put down, equipment judges it after detecting This move
Do not need roam operation temporarily for user and choose operation；Meanwhile, if user is quick to be moved to interactive interface side by simulation cursor
Edge more than 3 seconds (assuming that the first scheduled time threshold value be 3 seconds), or equipment at 15 seconds (assuming that the second scheduled time threshold value is 15
Second) in be not detected by the action of user's hand, then equipment judges that user temporarily need not roam and choose operation, then system entrance is treated
Machine state.If user needs to obtain control again, list action should be lifted, and double (or more) quick turn
Wrist start more than 90 °, equipment detects after This move that then system is again introduced into working condition.
It should be noted that the first scheduled time threshold value of above-mentioned record is 3 seconds and the second scheduled time threshold value is 15 seconds
As just a kind of example, do not constitute and improperly limit, the first scheduled time threshold value and second makes a reservation in the embodiment of the present invention
Time threshold can be identical, all be such as 15 seconds.
Further, the mode of acquisition equipment control is：Wrist is lifted, and double (or more) quick rotation
Wrist rotates more than the first predetermined angular, once and is defined as wrist by original state along a direction axial rotation, then along opposite
Wrist rotation is returned original state by direction.
Further, the step S5, i.e. data processing module 02 carry out Classification and Identification, specific mistake to above-mentioned movable information
Cheng Wei：
The movable information is carried out A/D samplings and is converted into data signal by S51 data processing modules 02, and carries out Kalman
Filtering fusion treatment obtains nine dimension data information (the 3-axis acceleration information A=(a of human hand movementx, ay, az), three axis angular rates
Information Ω=(wx, wy, wz) and three-axis attitude angle information Θ=(θx, θy, θz))；
S52 data processing modules 02 are according to the above-mentioned multistage characteristic tensor of nine dimension datas information architecture
S53 is in short-time analysis window, based on the multistage tensor property x of single framestBuild sequential action recognition feature Xt=
[xt-n..., xt] wherein n be Short-time Window length；
S54 is to sequential action recognition feature principal component analysis (PCA), including decentralization, Eigenvalues Decomposition with
PCA albefactions.
Wherein, M is temporal aspect XtDimension, N be lower-dimensional subspace map dimension；
S55 is realized to roaming action, a brief period of time action and the classification of click action using SVMs (Kernel SVM)
Identification；
Further, it is described to choose action to be a brief period of time action, as shown in figure 5, forefinger (or finger of remaining non-thumb) exists
The pressure of pressing of thumb is quickly outwards ejected.
Further, the step S3, control acquisition action can also be that wrist double swerve is acted, i.e., wrist exists
Under natural relaxation state, along same horizontal line double swerve.
Further, choose action in the step S8, mode can also be singly to refer to click action, i.e., in addition to forefinger its
Remaining finger holds shape, forefinger do above and below hammer action, as shown in Figure 6.
Further, action is chosen in the step S8, mode can also be, double finger click actions or give more directions are hit
Make, i.e., wrist is under natural relaxation state, and the five fingers open naturally, and forefinger replaces with middle finger makes click action, or in addition to thumb,
Remaining finger alternately makes click action.
To sum up, the invention discloses the Wearable and method of human hand Roaming control in a kind of interactive interface.It is wearable
Equipment is annular in shape, need to be worn on when using at user's wrist, the equipment specifically comprising human hand movement data obtaining module, data at
Manage module, control scheduling module and low coverage radio receiving transmitting module.A kind of method of interactive interface human hand Roaming control is, equipment
Set up wireless telecommunications with main frame, user by lift hand and it is double (or more) quick rotation list action or double swerve hand
Wrist acts to obtain equipment control, and system gathers human hand movement information and simulated light target is shown as on interactive interface in real time
It is mobile, user by a brief period of time or it is single give directions to hit or give more directions hit action and choose required function icon on interactive interface, such as Fig. 7, Fig. 8
It is shown.
The Wearable and method of human hand Roaming control in a kind of interactive interface that embodiment of the present invention is provided, at least
Have the advantages that：
1) Wearable of human hand Roaming control uses acceleration transducer and gyro in a kind of interactive interface of the invention
Instrument gathers the movable information of human hand, and precise and stable roaming result is obtained when user gesture is roamed on interactive interface；
2) Wearable of human hand Roaming control is non-portable equipment in a kind of interactive interface of the invention, when using only
It need to be worn at wrist, therefore user has been broken away from the constraint of hand-held interactive device, liberate the both hands of people；
3) method of human hand Roaming control is to carry out man-machine interactive operation based on people in a kind of interactive interface of the invention
When custom design, enable users to naturally complete interactive operation, it is not easy to occur fatigue；
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and this area
Technical staff can design alternative embodiment without departing from the scope of the appended claims.In the claims, no
Any reference symbol between bracket should be constituted limitations on claims.Word " comprising ", which is not excluded the presence of, not to be listed in
Device and step in claim.If those skilled in the art can make without departing from the spirit and scope of the present invention
Dry change and retouching, the protection domain that the present invention is advocated should be to be defined described in claims.
Claims (6)
1. the control method of the wearable device of human hand Roaming control in a kind of interactive interface, it is characterised in that comprise the steps：
S1, when equipment and main frame distance be the first preset range when, low coverage radio receiving transmitting module sends wireless messages automatically, with master
Machine is attached, and sets up wireless telecommunications, and system enters holding state；
S2, human hand movement data obtaining module obtain movable information of the human hand in space coordinates, the movable information in real time
Including acceleration information and angular velocity information, and send to data processing module；
S3, when detecting user's lift hand and double or when quick rotation wrist is more than the first predetermined angular more than twice, then
Control scheduling module distributes control for it, and equipment enters working condition, interactive interface display simulation cursor；
S4, human hand movement data obtaining module are obtained when human hand is roamed at the movable information in space coordinates, data in real time
Manage module and the movable information be subjected to Treatment Analysis, and Classification and Identification its be roaming action, and recognition result data are sent
To main frame；
The movable information is carried out Treatment Analysis by data processing module, and Classification and Identification its be roaming action, detailed process is：
The movable information is carried out A/D samplings and is converted into data signal by S41, data processing module, and carries out Kalman filtering
Fusion treatment obtains nine dimension data information of human hand movement, and the nine dimension datas information includes：3-axis acceleration information A=(ax,
ay,az), three axis angular rate information Ω=(ωx,ωy,ωz) and three-axis attitude angle information Θ=(θx,θy,θz)；
S42, data processing module are according to the above-mentioned multistage characteristic tensor of nine dimension datas information architecture
S43, in short-time analysis window, based on the multistage tensor property x of single framestBuild sequential action recognition feature Xt=
[xt-n,...,xt], wherein n is Short-time Window length；
S44, sequential action recognition feature principal component is analyzed, including decentralization, Eigenvalues Decomposition and PCA albefactions,
Formula is：
<mrow>
<msub>
<mi>P</mi>
<mi>t</mi>
</msub>
<mo>=</mo>
<msup>
<mrow>
<mo>(</mo>
<msub>
<mi>X</mi>
<mi>t</mi>
</msub>
<mo>-</mo>
<msub>
<mover>
<mi>X</mi>
<mo>&OverBar;</mo>
</mover>
<mi>t</mi>
</msub>
<mo>)</mo>
</mrow>
<mi>T</mi>
</msup>
<msubsup>
<mi>W</mi>
<mrow>
<mi>M</mi>
<mo>&times;</mo>
<mi>N</mi>
</mrow>
<mrow>
<mi>P</mi>
<mi>C</mi>
<mi>A</mi>
</mrow>
</msubsup>
</mrow>
Wherein,For lower-dimensional subspace mapping matrix, M is temporal aspect XtDimension, N be lower-dimensional subspace map dimension
Degree；
S45, realized to the Classification and Identification of roaming action, a brief period of time action and click action, base using multi-category support vector machines SVM
Roaming/a brief period of time SVM classifier parameter is obtained in the training of Structural risk minization principle<W1 SVM,b1>, roaming/click SVM parameters
gi(Pt)=PtWi SVM+bi
S5, main frame are received after the recognition result data, by Ω=(ωx,ωy,ωz) obtained by Kalman filter processingAnd it is translated into simulated light target analog coordinate on interactive interfaceAnd simultaneous display simulated light target is moved；
S6, when cursor roams to user's required function icon, user makes a brief period of time action, and human hand movement data obtaining module adopts
Collect the action message of human hand now；
S7, data processing module carry out Classification and Identification to above-mentioned movable information and are shown as using on action, interactive interface to choose
Family required function icon is selected；
S8, S2 is repeated to S7 steps, until detecting, user's arm puts down action naturally and mouse is in interactive interface edge
More than first scheduled time, or human hand action is not detected by within second scheduled time, then control scheduling module is cancelled and set
Standby control, system enters holding state；Or hand is lifted described in step S3 and double or more quick until detecting
Rotate or double swerve list action, system is again introduced into working condition.
2. control method according to claim 1, it is characterised in that in step S3, the mode for obtaining equipment control is：
Wrist is lifted, and double or more quick rotation wrist is more than the first predetermined angular, once rotate be defined as wrist by
Original state along a direction axial rotation, then in opposite direction by wrist rotation return original state.
3. control method according to claim 1, it is characterised in that in step S7, described to choose action to be a brief period of time action,
The finger of i.e. non-thumb is in thumb by the quick outwards ejection of pressure.
4. control method according to claim 1, it is characterised in that the step S3, control acquisition action can be with
For：Wrist double swerve is acted, i.e. wrist is under natural relaxation state, along same horizontal line double swerve.
5. control method according to claim 1, it is characterised in that choose action in the step S7, mode may be used also
Think, singly refer to click action, i.e., remaining finger holds shape in addition to forefinger, forefinger do above and below hammer action.
6. control method according to claim 1, it is characterised in that choose action in the step S7, mode may be used also
Think, double finger click actions or giving more directions and hitting action, i.e. wrist under natural relaxation state, the five fingers open naturally, forefinger and in
Refer to and alternately make click action, or in addition to thumb, remaining finger alternately makes click action.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510076982.7A CN104679246B (en) | 2015-02-11 | 2015-02-11 | The Wearable and control method of human hand Roaming control in a kind of interactive interface |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510076982.7A CN104679246B (en) | 2015-02-11 | 2015-02-11 | The Wearable and control method of human hand Roaming control in a kind of interactive interface |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104679246A CN104679246A (en) | 2015-06-03 |
| CN104679246B true CN104679246B (en) | 2017-10-20 |
Family
ID=53314440
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510076982.7A Active CN104679246B (en) | 2015-02-11 | 2015-02-11 | The Wearable and control method of human hand Roaming control in a kind of interactive interface |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104679246B (en) |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106354378B (en) * | 2015-07-13 | 2019-11-15 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus for quickly choosing multiple targets |
| CN105094327B (en) * | 2015-07-22 | 2018-11-30 | 深圳多新哆技术有限责任公司 | Adjust the method and device of virtual article attitude angle in Virtual Space |
| CN105068653A (en) * | 2015-07-22 | 2015-11-18 | 深圳多新哆技术有限责任公司 | Method and apparatus for determining touch event in virtual space |
| CN105068462A (en) * | 2015-09-02 | 2015-11-18 | 肖继林 | Pull rod lifting motor control mechanism |
| CN105204579A (en) * | 2015-09-27 | 2015-12-30 | 孙博 | Modular integrated-type host device |
| CN105259885A (en) * | 2015-11-18 | 2016-01-20 | 马群毅 | Internet type workshop equipment operating system |
| CN105425632A (en) * | 2015-11-18 | 2016-03-23 | 马群毅 | Internet man-machine interaction system |
| US9971560B2 (en) * | 2016-05-05 | 2018-05-15 | Motorola Solutions, Inc. | Displaying messages using body-worn electronic display devices |
| CN106293131A (en) * | 2016-08-16 | 2017-01-04 | 广东小天才科技有限公司 | expression input method and device |
| CN106512391B (en) * | 2016-11-09 | 2019-07-12 | 华南理工大学广州学院 | A kind of bimanual input recognition methods and the driving simulation system based on it, method |
| CN106502416B (en) * | 2016-11-09 | 2019-04-02 | 华南理工大学广州学院 | A kind of driving simulation system and its control method of intelligent recognition bimanual input |
| CN107016347A (en) * | 2017-03-09 | 2017-08-04 | 腾讯科技（深圳）有限公司 | A kind of body-sensing action identification method, device and system |
| CN106990841A (en) * | 2017-03-30 | 2017-07-28 | 无锡云瞳信息科技有限公司 | Gesture identification method and the wearable video camera of intelligence based on motion sensor |
| CN108900698A (en) * | 2018-05-31 | 2018-11-27 | 努比亚技术有限公司 | Method, wearable device, terminal and the computer storage medium of controlling terminal |
| CN109409427A (en) * | 2018-10-25 | 2019-03-01 | 珠海市君天电子科技有限公司 | A kind of key detecting method and device |
| CN111367356B (en) * | 2018-12-24 | 2022-01-25 | 群光电子股份有限公司 | Method for controlling electronic device through knocking and knocking control group |
| CN110046009B (en) * | 2019-02-19 | 2022-08-23 | 创新先进技术有限公司 | Recording method, recording device, server and readable storage medium |
| CN109976518A (en) * | 2019-03-12 | 2019-07-05 | 合肥工业大学 | A kind of man-machine interaction method based on PVDF sensor array |
| CN112346560A (en) * | 2020-09-29 | 2021-02-09 | 广东乐芯智能科技有限公司 | Method for controlling application interface by bracelet |
| CN112346559A (en) * | 2020-09-29 | 2021-02-09 | 广东乐芯智能科技有限公司 | Application interface control system |
| CN112214073A (en) * | 2020-09-29 | 2021-01-12 | 泰州翔升科技服务有限公司 | Computer control method and wearable device |
| CN117786643B (en) * | 2024-02-22 | 2024-05-07 | 清华大学 | User identity authentication method and related equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103186256A (en) * | 2011-12-31 | 2013-07-03 | 北京德信互动网络技术有限公司 | Human-machine interaction system |
| CN103513788A (en) * | 2013-09-13 | 2014-01-15 | 广东欧珀移动通信有限公司 | Gesture recognition method and system based on gyroscope sensor and mobile terminal |
| CN103984416A (en) * | 2014-06-10 | 2014-08-13 | 北京邮电大学 | Gesture recognition method based on acceleration sensor |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060028429A1 (en) * | 2004-08-09 | 2006-02-09 | International Business Machines Corporation | Controlling devices' behaviors via changes in their relative locations and positions |
| US8503932B2 (en) * | 2008-11-14 | 2013-08-06 | Sony Mobile Comminications AB | Portable communication device and remote motion input device |
| KR101413539B1 (en) * | 2010-11-22 | 2014-07-02 | 한국전자통신연구원 | Apparatus and Method of Inputting Control Signal by using Posture Recognition |
-
2015
- 2015-02-11 CN CN201510076982.7A patent/CN104679246B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103186256A (en) * | 2011-12-31 | 2013-07-03 | 北京德信互动网络技术有限公司 | Human-machine interaction system |
| CN103513788A (en) * | 2013-09-13 | 2014-01-15 | 广东欧珀移动通信有限公司 | Gesture recognition method and system based on gyroscope sensor and mobile terminal |
| CN103984416A (en) * | 2014-06-10 | 2014-08-13 | 北京邮电大学 | Gesture recognition method based on acceleration sensor |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104679246A (en) | 2015-06-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104679246B (en) | The Wearable and control method of human hand Roaming control in a kind of interactive interface | |
| Perng et al. | Acceleration sensing glove (ASG) | |
| CN105278681B (en) | Gestures detection is lifted in equipment | |
| CN102262476B (en) | Tactile Communication System And Method | |
| CN102915111B (en) | A kind of wrist gesture control system and method | |
| CN103677289A (en) | Intelligent interactive glove and interactive method | |
| CN108958615A (en) | A kind of display control method, terminal and computer readable storage medium | |
| CN108509037A (en) | A kind of method for information display and mobile terminal | |
| CN104656888A (en) | Device control using a wearable device | |
| CN104834372A (en) | Multifunctional wearable human-computer interaction input equipment based on MEMS (Micro Electro Mechanical Systems) acceleration sensor | |
| CN103677265B (en) | Intelligent sensing glove and intelligent sensing method | |
| CN102063183A (en) | Virtual input device of grove type | |
| CN107390867B (en) | Man-machine interaction system based on android watch | |
| CN109828732A (en) | A kind of display control method and terminal device | |
| CN104123072B (en) | It is a kind of for providing the method and apparatus of the dummy keyboard in mobile device | |
| CN110531904A (en) | A kind of background task display methods and terminal | |
| CN108717324A (en) | Intelligent wearable device and its control method, computer readable storage medium | |
| CN108415641A (en) | A kind of processing method and mobile terminal of icon | |
| CN108958593A (en) | A kind of method and mobile terminal of determining communication object | |
| CN109634438A (en) | A kind of control method and terminal device of input method | |
| CN105677040A (en) | Terminal control method, device and wearable device | |
| CN103995585B (en) | Show the gesture control apparatus and method for of big-wall | |
| CN109643190A (en) | The extension interaction of portable electronic device | |
| CN110519517A (en) | Copy bootstrap technique, electronic equipment and computer readable storage medium | |
| CN110113486A (en) | A kind of moving method and terminal of application icon |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20181213 Address after: 510330 Room 7,500, Haicheng West Street, Xingang East Road, Haizhu District, Guangzhou City, Guangdong Province Patentee after: Guangzhou Boguanwen Language Technology Co., Ltd. Address before: 510640 No. five, 381 mountain road, Guangzhou, Guangdong, Tianhe District Patentee before: South China University of Technology |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20190926 Address after: 510000 820, room 8, 8, 116 Heng Road, Dongguan, Guangzhou, Guangdong. Patentee after: Guangzhou Bo Wei Intelligent Technology Co., Ltd. Address before: 510330 Room 7,500, Haicheng West Street, Xingang East Road, Haizhu District, Guangzhou City, Guangdong Province Patentee before: Guangzhou Boguanwen Language Technology Co., Ltd. |