CN112269471B - Intelligent wrist strap equipment and single-hand control method, device, system and storage medium thereof - Google Patents

Intelligent wrist strap equipment and single-hand control method, device, system and storage medium thereof Download PDF

Info

Publication number
CN112269471B
CN112269471B CN202011235876.6A CN202011235876A CN112269471B CN 112269471 B CN112269471 B CN 112269471B CN 202011235876 A CN202011235876 A CN 202011235876A CN 112269471 B CN112269471 B CN 112269471B
Authority
CN
China
Prior art keywords
wrist
gesture
arm
control
control gesture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011235876.6A
Other languages
Chinese (zh)
Other versions
CN112269471A (en
Inventor
郭书蕾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Puchun Technology Shenzhen Co ltd
Original Assignee
Puchun Technology Shenzhen Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Puchun Technology Shenzhen Co ltd filed Critical Puchun Technology Shenzhen Co ltd
Priority to CN202011235876.6A priority Critical patent/CN112269471B/en
Publication of CN112269471A publication Critical patent/CN112269471A/en
Application granted granted Critical
Publication of CN112269471B publication Critical patent/CN112269471B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0412—Digitisers structurally integrated in a display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses an intelligent wrist strap device, a single-hand control method, a device, a system and a computer readable storage medium thereof, wherein the single-hand control method of the intelligent wrist strap device comprises the following steps: performing gesture recognition to obtain a control gesture, wherein the gesture recognition is to recognize a hand wearing the intelligent wrist strap device; determining an operation instruction according to the control gesture; and controlling the intelligent wrist band equipment to execute corresponding operation according to the operation instruction. The invention can realize the single-hand control of the intelligent wrist strap device so as to improve the operation convenience of the intelligent wrist strap device.

Description

Intelligent wrist strap equipment and single-hand control method, device, system and storage medium thereof
Technical Field
The invention relates to the technical field of intelligent wrist strap equipment, in particular to intelligent wrist strap equipment, a single-hand control method, a single-hand control device, a single-hand control system and a computer readable storage medium.
Background
With the rapid development of science and technology, more and more people use smart wristband devices, such as smart watches, smart phone watches, smart bracelets, and the like. The control mode of the existing intelligent wrist strap equipment is mostly realized by using a mechanical key or a touch screen. However, in order to pursue portability and a compact design of the smart band device, the size of the mechanical key or the touch screen is limited, which affects the user experience.
At present, in order to solve the limitation of contact operation such as mechanical keys or touch screens, non-contact operation is adopted to control the intelligent wrist strap device. However, the smart wristband device is required to be worn by one hand and controlled by the other hand in the existing non-contact operation and contact operation, that is, the user must coordinate the two hands at the same time to control the smart wristband device, so that under the condition that at least one hand of the user is occupied, for example, under special conditions such as a portable heavy object and a bike, the smart wristband device cannot be controlled by the two hands at the same time, the use difficulty of the smart wristband device is increased, and the use experience of the user is influenced.
Disclosure of Invention
The invention mainly aims to provide an intelligent wrist strap device, a one-hand control method, a one-hand control device, a one-hand control system and a computer readable storage medium thereof, and aims to realize one-hand control of the intelligent wrist strap device so as to improve the operation convenience of the intelligent wrist strap device.
In order to achieve the above object, the present invention provides a one-hand control method of an intelligent wristband device, including the steps of:
performing gesture recognition to obtain a control gesture, wherein the gesture recognition is to recognize a hand wearing the intelligent wrist strap device;
determining an operation instruction according to the control gesture;
and controlling the intelligent wrist band equipment to execute corresponding operation according to the operation instruction.
Optionally, the step of performing gesture recognition to obtain a control gesture includes:
performing gesture recognition on the hand to obtain a hand control gesture;
and performing gesture recognition on the arm wrist to obtain the arm wrist control gesture.
Optionally, a signal transmitter and a signal receiver are arranged on one side of the smart wristband device close to the hand, gesture recognition is performed on the hand, and the step of obtaining a hand control gesture includes:
transmitting a gesture recognition signal to one side of the hand through the signal transmitter;
detecting whether the signal receiver receives a gesture reflection signal based on the gesture recognition signal;
if the signal receiver receives the gesture reflection signal, obtaining a tilt control gesture;
and if the signal receiver does not receive the gesture reflection signal, obtaining a flat control gesture.
Optionally, after the step of obtaining the flat-palm control gesture if the signal receiver does not receive the gesture reflection signal, the method further includes:
when the tilt control gesture is recognized, detecting whether other control gestures are recognized or not within a first preset time;
if the flat control gesture is recognized, obtaining a non-contact short key control gesture;
and if the other control gestures are not recognized, obtaining a non-contact long key control gesture.
Optionally, the step of performing gesture recognition on the arm and wrist to obtain the arm and wrist control gesture includes:
detecting whether the arm wrist is horizontally lifted;
if the arm wrist is lifted horizontally, obtaining an arm wrist horizontal lifting control gesture; and/or
Detecting whether the arm wrist rotates;
if the arm wrist rotates, detecting the rotation direction of the arm wrist;
if the rotation direction is to rotate towards the inner side of the body and then return to the original position, obtaining an in-arm rotation control gesture;
if the rotation direction is to rotate towards the outer side of the body and then return to the original position, the external rotation control gesture of the arm wrist is obtained; and/or
Detecting whether the arm wrist swings;
if the arm wrist swings, detecting the swinging direction of the arm wrist;
if the swinging direction is swinging upwards and then returning to the original position, obtaining an arm and wrist tilting control gesture;
if the swing direction is swinging downwards and then returning to the original position, obtaining a control gesture that the arm wrist is declined;
if the swinging direction is swinging leftwards and then returning to the original position, obtaining a left-leaning control gesture of the arm wrist;
and if the swinging direction is swinging to the right and then returning to the original position, obtaining the right-leaning control gesture of the arm wrist.
Optionally, after the step of detecting the rotation direction of the arm wrist if the arm wrist rotates, the method further includes:
detecting the rotation speed and/or the rotation amplitude of the arm wrist;
determining an operation speed corresponding to the control gesture according to the rotation speed and/or the rotation amplitude, wherein the operation speed comprises a screen scrolling speed, a cursor moving speed and a page sliding speed;
wherein, if the wrist swings, then detect after the step of the swing direction of wrist, still include:
detecting the swing speed and/or swing amplitude of the arm wrist;
and determining an operation speed corresponding to the control gesture according to the swing speed and/or the swing amplitude, wherein the operation speed comprises a screen scrolling speed, a cursor moving speed and a page sliding speed.
Optionally, after the step of performing gesture recognition on the arm and obtaining the arm control gesture, the method further includes:
detecting the interval time of the hand control gesture and the arm and wrist control gesture;
judging whether the interval time is less than a second preset time or not;
and if the interval time is less than the second preset time, combining the hand control gesture and the arm and wrist control gesture to obtain a combined control gesture.
Optionally, the combined control gesture comprises: an inward rotation control gesture of a palm tilting arm, an outward rotation control gesture of a palm tilting arm, an inward rotation control gesture of a palm leveling arm, an outward rotation control gesture of a palm leveling arm, an upward tilt control gesture of a palm leveling arm, a downward tilt gesture of a palm leveling arm, an upward tilt control gesture of a palm tilting arm, a downward tilt gesture of a palm tilting arm, a left tilt control gesture of a palm tilting, and a right tilt control gesture of a palm tilting.
Optionally, the recognition manner of the hand control gesture includes: a signal reflection mode, a photographing recognition mode, and an event camera mode.
Optionally, the operation instruction includes: the system comprises a screen lightening instruction, a screen turning instruction, a screen scrolling instruction, a cursor moving instruction, a selecting instruction, a confirming instruction, a backspacing instruction, a quitting instruction, a volume adjusting instruction and a switching instruction.
Optionally, the method for controlling the smart wristband device with one hand further includes:
when the intelligent wrist strap device is in a screen-off state, detecting whether an arm wrist wearing the intelligent wrist strap device is horizontally lifted;
and if the arm wrist is lifted horizontally, controlling the intelligent wrist strap equipment to light.
Optionally, the method for controlling the smart wristband device with one hand further includes:
when the mobile phone is in a screen-off state, starting a hand gesture misoperation function;
when the hand gesture misoperation function is started, detecting whether a non-contact short key control gesture is continuously identified;
if the non-contact short key control gesture is continuously recognized, determining the recognition times of the non-contact short key control gesture;
judging whether the identification times are equal to preset times or not;
and if the identification times are equal to the preset times, closing the hand gesture misoperation function.
Optionally, the method for controlling the smart wristband device with one hand further includes:
determining the type of the control gesture when the screen is on a bright screen;
if the control gesture is a palm-flat wrist-to-wrist control gesture, determining the rotation direction and the swing direction of the arm wrist according to the palm-flat wrist-to-wrist control gesture;
determining a screen rolling direction according to the rotating direction and the swinging direction, wherein the screen rolling direction comprises a front direction, a rear direction, a left direction and a right direction;
controlling the intelligent wrist strap equipment to scroll according to the screen scrolling direction;
if the control gesture is a palm tilting and wrist turning control gesture, determining the rotation direction and the swing direction of the wrist according to the palm tilting and wrist turning control gesture;
determining a cursor moving direction according to the rotating direction and the swinging direction, wherein the cursor moving direction comprises a front direction, a rear direction, a left direction and a right direction;
and controlling the intelligent wrist band equipment to move the cursor according to the cursor moving direction.
In addition, in order to achieve the above object, the present invention provides a one-handed control device of a smart wristband apparatus, the control device including:
the gesture recognition module is used for performing gesture recognition to obtain a control gesture, wherein the gesture recognition is used for recognizing a hand wearing the intelligent wrist strap device;
the instruction determining module is used for determining an operation instruction according to the control gesture;
and the operation execution module is used for controlling the intelligent wrist band equipment to execute corresponding operation according to the operation instruction.
In addition, to achieve the above object, the present invention also provides a smart band apparatus, including: the single-hand control program of the intelligent wrist band device comprises a memory, a processor and a single-hand control program of the intelligent wrist band device, wherein the single-hand control program of the intelligent wrist band device is stored on the memory and can run on the processor, and the steps of the single-hand control method of the intelligent wrist band device are realized when the single-hand control program of the intelligent wrist band device is executed by the processor.
In addition, in order to achieve the above object, the present invention further provides a one-handed control system of a smart band device, wherein the one-handed control system of the smart band device includes: the single-hand control program of the intelligent wrist band device comprises a memory, a processor and a single-hand control program of the intelligent wrist band device, wherein the single-hand control program of the intelligent wrist band device is stored on the memory and can run on the processor, and the steps of the single-hand control method of the intelligent wrist band device are realized when the single-hand control program of the intelligent wrist band device is executed by the processor.
Further, to achieve the above object, the present invention also provides a computer readable storage medium having stored thereon a one-handed control program of a smart band device, which when executed by a processor, implements the steps of the one-handed control method of a smart band device as described above.
The invention provides an intelligent wrist strap device, a single-hand control method, a single-hand control device, a single-hand control system and a computer readable storage medium thereof, wherein the single-hand control method, the single-hand control device and the single-hand control system are used for performing gesture recognition to obtain a control gesture, wherein the gesture recognition is used for recognizing a hand wearing the intelligent wrist strap device; determining an operation instruction according to the control gesture; and controlling the intelligent wrist band equipment to execute corresponding operation according to the operation instruction. According to the method and the device, the control gesture made by the user is recognized, and the operation instruction of the control gesture and the operation corresponding to the operation instruction are determined, so that the intelligent wrist strap device is controlled. The control gesture is a gesture made by a hand wearing the intelligent wrist strap device, so that a user only needs to control the intelligent wrist strap device by using one hand wearing the intelligent wrist strap device without controlling the intelligent wrist strap device by using two hands simultaneously.
Drawings
Fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a first embodiment of a method for controlling a smart wristband apparatus according to the present invention with one hand;
FIG. 3 is a schematic processing flow diagram of a one-handed control method of the smart wristband apparatus according to the present invention;
FIG. 4 is a schematic diagram of a tilt control gesture of the single-hand control method of the smart band device according to the present invention;
FIG. 5 is a schematic diagram of a flat-palm control gesture of the single-hand control method of the smart wristband apparatus according to the present invention;
fig. 6 is a functional block diagram of a first embodiment of the single-hand control device of the smart wristband apparatus according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention.
The terminal of the embodiment of the invention is an intelligent wrist strap device, and the intelligent wrist strap device can be a terminal device such as an intelligent watch, an intelligent telephone watch and an intelligent bracelet.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU (Central Processing Unit), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a one-hand control program of the smart band device.
In the terminal shown in fig. 1, the processor 1001 may be configured to call a one-handed control program of the smart wristband device stored in the memory 1005 and perform a one-handed control method of the smart wristband device provided by an embodiment of the present invention.
Based on the hardware structure, various embodiments of the single-hand control method of the intelligent wrist strap device are provided.
The invention provides a single-hand control method of intelligent wrist strap equipment.
Referring to fig. 2, fig. 2 is a schematic flowchart of a first embodiment of a method for controlling a smart wristband device according to the present invention with one hand.
In this embodiment, the method for controlling the smart band device with one hand includes:
step S10, performing gesture recognition to obtain a control gesture, wherein the gesture recognition is to recognize a hand wearing the intelligent wrist strap device;
in this embodiment, gesture recognition is performed to obtain a control gesture, wherein the gesture recognition is performed on a hand wearing the smart band device, and a user can complete the corresponding control gesture only by using one hand. The control gestures include hand control gestures, arm and wrist control gestures, and the like.
In addition, the hand control gesture recognition method includes: a signal reflection system, a camera recognition system, an event camera system, and the like. The signal reflection mode is that the hand reflects a gesture recognition signal to recognize a gesture, and specifically, when the hand is tilted, the gesture recognition signal emitted by the intelligent wrist band device is reflected back, so that the intelligent wrist band device receives the reflected gesture recognition signal, and the hand control gesture is a tilt control gesture; if the hand is kept flat, the gesture recognition signal transmitted by the intelligent wrist strap device cannot be reflected back, so that the hand control gesture is a flat control gesture. The hand gesture recognition signal includes infrared signals, ultrasonic signals, electric wave signals and other wavelength light wave signals. The photographing identification mode is to photograph the hand according to a certain period, compare the photograph obtained by photographing with the hand characteristic information to identify whether the hand is tilted, and specifically, if the photograph obtained by photographing contains the hand characteristic information, determine that the hand is tilted. The control gesture can be shot in time and cannot be missed when the period is usually taken for multiple times within 1 second. The hand feature information may be a hand contour, and the captured photo may be analyzed by an edge detection algorithm or the like to obtain the hand feature information. The event camera mode can sensitively capture moving objects, namely, as long as the hand tilts up, the event camera can timely capture the objects and perform gesture recognition, and specifically, in the whole event camera visual field, an event can be transmitted back as long as one pixel value changes. Because the time between adjacent events is less than 1 microsecond, the event camera has the advantages of high dynamic range and low time delay, and because of the low time delay, the event camera can not generate fuzziness when shooting a high-speed object.
In addition, it should be noted that the recognition mode of the arm control gesture is to detect the motion state of the smart band device through an acceleration sensor and an angular velocity sensor (gyroscope), and it can be understood that the smart band device is relatively stationary with respect to the hand wearing the smart band device, and thus the motion state of the arm can be indirectly detected. The acceleration sensor and the angular velocity sensor are both installed inside the intelligent wrist strap device. Certainly also can install on the wrist strap, however, install in the inside of intelligent wrist strap equipment, compare and install on the wrist strap, the weight of reducible wrist strap to promote user's the comfort of wearing, and other devices such as acceleration sensor and angular velocity sensor and treater are all in the inside of intelligent wrist strap equipment, reducible power consumptive, in order to improve the use efficiency of intelligent wrist strap equipment. It can be understood that the acceleration sensor and the angular velocity sensor are combined and adjusted with each other, so that the accuracy of detecting the motion state can be further ensured.
In addition, it should be noted that the control gesture may also be a combination of the hand control gesture and the arm and wrist control gesture, so as to obtain a combined control gesture. The combination mode of the combined control gestures is that two gestures are combined. Wherein the combined control gesture includes: the hand-tilting control gesture comprises a hand-tilting arm wrist outward turning control gesture, a hand-tilting arm wrist inward turning control gesture, a hand-flattening arm wrist outward turning control gesture, a hand-flattening arm wrist upward tilting control gesture, a hand-flattening arm wrist downward tilting gesture, a hand-tilting arm wrist upward tilting control gesture, a hand-tilting arm wrist downward tilting control gesture, a hand-tilting left tilting control gesture and a hand-tilting right tilting control gesture. This combined control gesture requires the user to complete multiple gesture actions in a short amount of time. Of course, the combined control gesture may also include: an arm tilt-up inward turning control gesture, an arm tilt-up outward turning control gesture, an arm wrist tilt-down inward turning control gesture, an arm wrist tilt-down outward turning control gesture, an arm wrist left tilt inward turning control gesture, an arm wrist left tilt outward turning control gesture, an arm wrist right tilt inward turning control gesture, and an arm wrist right tilt outward turning control gesture.
In a specific embodiment, the gesture recognition may be performed on a finger to obtain a finger control gesture, where the finger control gesture includes a grabbing control gesture and a finger mutual click control gesture, and the grabbing control gesture is a gesture in which the fingers are opened to be closed by the fingers in a short time, and the finger mutual click may be a gesture performed by a thumb and an index finger, or a gesture performed by a thumb and a middle finger, for example, an OK gesture, an orchid finger gesture, and the like, which are not described in detail herein.
Step S20, determining an operation instruction according to the control gesture;
and step S30, controlling the intelligent wrist strap device to execute corresponding operation according to the operation instruction.
In the embodiment, an operation instruction is determined according to the control gesture, and then the smart wristband device is controlled to execute corresponding operation according to the operation instruction. The operation instructions comprise a screen lightening instruction, a screen turning instruction, a screen scrolling instruction, a cursor moving instruction, a selection instruction, a confirmation instruction, a backspacing instruction, an exit instruction, a volume adjusting instruction and a switching instruction.
It should be noted that the operation instruction needs to be determined according to a mapping relationship between a preset control gesture and the operation instruction, where the mapping relationship may be set by a manufacturer of the smart wristband device, or the control gesture of the user may be entered in advance and mapped with each operation instruction, so as to implement personalized setting for the user.
In addition, it should be further noted that the control gesture corresponding to the screen-turning-off instruction may be a control gesture in which the arm is tilted downward, specifically, after the user makes the control gesture in which the arm is tilted downward, when no other control gesture occurs within a fixed time, the smart wristband device turns off the screen, where the fixed time is set according to actual needs, for example, 5 seconds, 4 seconds, 3 seconds, and the like, and this is not limited specifically here.
In addition, it should be noted that the control gesture corresponding to the scroll instruction may be a flat palm wrist-to-wrist control gesture, and the operation corresponding to the scroll instruction only scrolls the screen, but the cursor does not move, and the cursor points to the highlighted option by default. It can be understood that the palm-flat wrist-turning control gesture includes two actions of wrist turning and wrist returning to the original position. The operation corresponding to the screen scrolling command includes front and back screen scrolling and left and right screen scrolling, and can be performed through a combined control gesture, such as a palm-arm-flat inward-turning control gesture, a palm-arm-flat outward-turning control gesture, a palm-arm-wrist-tilt inward-turning control gesture, a palm-arm-tilt outward-turning control gesture, a palm-arm-wrist-tilt inward-turning control gesture, and a palm-arm-wrist-tilt downward-turning control gesture. Specifically, the flatpalm arm wrist flatly-lifted outward-turning control gesture corresponds to forward screen scrolling, the flatpalm arm wrist flatly-lifted inward-turning control gesture corresponds to backward screen scrolling, the flatpalm arm wrist upward-tilting control gesture corresponds to leftward screen scrolling, and the flatpalm arm wrist downward-tilting inward-turning control gesture corresponds to rightward screen scrolling. The speed of the scrolling screen is related to the amplitude and speed of the rotation of the wrist, for example, the fast rotation of the wrist can scroll a plurality of options at a time, and the slow rotation of the wrist can scroll only one option at a time. It is understood that the scrolling of the screen options can adopt a closed loop mode, for example, there are 9 options, when the 9 th option is scrolled, the 1 st option is scrolled, so that the user can scroll towards one direction, and the use convenience of the smart wristband device is improved.
In addition, it should be noted that the control gesture corresponding to the cursor movement instruction may be a palm tilting wrist turning control gesture, and an operation corresponding to the cursor movement instruction only moves the cursor without scrolling. It will be appreciated that the cursor will typically by default point to an option which will typically be highlighted. The wrist-turning action in the palm-raising wrist-turning control gesture comprises two actions of arm-wrist turning and returning to the original position. The operation corresponding to the cursor movement instruction comprises the cursor front-back movement and the cursor left-right movement, and can be operated through a combined control gesture, such as a palm tilting outward wrist turning control gesture, a palm tilting inward wrist turning control gesture, a palm tilting arm wrist tilting up control gesture and a palm tilting arm wrist tilting down control gesture. Specifically, the palm tilting and wrist turning control gesture corresponds to forward movement of the cursor, the palm tilting and wrist turning control gesture corresponds to backward movement of the cursor, the wrist tilting up control gesture corresponding to leftward movement of the cursor, and the wrist tilting down control gesture corresponding to rightward movement of the cursor. In addition, the cursor positioning function corresponding to the cursor movement instruction can be set by the user to select whether to start the cursor positioning function.
In addition, it should be noted that the control gestures corresponding to the selection instruction and the confirmation instruction may be non-contact short-key control gestures, and the non-contact short-key control gestures are tilting control gestures and flat control gestures which are continuously performed in a short time. The control gestures corresponding to the backspacing instruction and the quitting instruction can be non-contact long key control gestures, and the non-contact long key control gestures are relatively short time and continuously make tilt control gestures and flat control gestures in a long time. For a specific implementation process, reference is made to the following third embodiment, which is not described in detail herein.
In this embodiment, to prevent the hand gesture error operation, the hand gesture recognition function may be locked. Specifically, when the mobile terminal is in a screen-off state, the mobile terminal can be in a locked state by default, if a user needs to perform hand gesture recognition, a non-contact short key control gesture needs to be continuously performed for multiple times to perform unlocking, wherein the times can be set according to actual needs, for example, 2, 3, 4 and the like, and only the requirement that the times are greater than or equal to 2 is met. It can be understood that the locking function of hand gesture recognition can be set by the user to select whether to start the locking function.
In the embodiment, for convenience of understanding, the operation interface of the smart wristband device is exemplified by a plurality of primary options and a plurality of secondary options, and the processing modules of the smart wristband device may be divided into an arm motion recognition module 200, a main control system module 100, and a hand gesture recognition module 300. Referring to fig. 3, fig. 3 is a schematic processing flow diagram of a one-hand control method of the smart wristband device according to the present invention. Specifically, step 101: when the mobile phone is in a screen-off state, periodically identifying whether a user lifts a wrist or not; step 102: if the user lifts the wrist, the user enters a main interface of the intelligent wrist strap equipment and starts hand gesture recognition operation, namely hardware for hand gesture recognition is powered on, and meanwhile, a hand gesture misoperation function enters a locking state; step 103: the main control system periodically reads gesture signals (non-contact short keys) to the hand gesture recognition module; step 104: the main control system reads the non-contact short keys twice continuously, and the hand gesture is operated by mistake to unlock; step 105: the main control system periodically reads gesture signals (non-contact short keys) to the hand gesture recognition module; step 106: the main control system reads the non-contact short keys, enters a first-level option, a first-level option 1 is highlighted, and a cursor points to the highlighted option; step 107: the master control system reads arm wrist action data (the arm wrist is horizontally lifted); step 108: the main control system reads hand gesture signals (non-contact short keys); step 109: the main control system judges that no wrist turning action is performed, a cursor is not moved, a screen is not rolled, and a non-contact short key is read, then a menu of a first-level option 1 is entered, 3 options including a second-level option 1, a second-level option 2 and a second-level option 3 are displayed on an interface, wherein the second-level option 2 in the middle of the interface is highlighted, and the cursor points to the highlighted option; step 110: reading arm wrist action data (wrist transferring); step 111: if the main control system reads that the arm wrist action data is wrist turning, displaying that an interface option rolls for one screen, moving a secondary option 1 out of the screen, displaying 3 options including a secondary option 2, a secondary option 3 and a secondary option 4 on the interface, wherein the option of the secondary option 3 in the middle of the interface is highlighted, and a cursor points to the highlighted option; step 112: the main control system reads hand gesture signals (non-contact short keys); step 113: the main control system reads the confirmation of the non-contact short key, enters a 'second-level option 3' interface, and waits for starting the confirmation of the 'second-level option 3' function operation; step 114: the main control system reads hand gesture signals (non-contact short keys); step 115: the main control system reads the confirmation of the non-contact short key and starts the function of 'second level option 3'; step 116: the main control system reads hand gesture signals (non-contact long keys); step 117: the main control system reads a non-contact long key, and then displays whether the interface prompt ends the function of 'second-level option 3', the interface prompt options 'No' and 'Yes' are highlighted, and the cursor points to the 'No' option; step 118: the master control system reads hand gesture signals (upwarping palms); step 119: the master control system reads arm movement data (the arm is inclined downwards); step 120: when the master control system reads a gesture signal that the palm is tilted and the wrist is tilted downwards, the cursor moves to point to a 'Yes' option; step 121: the main control system reads hand gesture signals (non-contact short keys); step 122: and the main control system reads the non-contact short key, confirms that the function of the 'second-level option 3' is finished, and displays an interface to return to the previous-level menu.
The embodiment of the invention provides a single-hand control method of intelligent wrist strap equipment, which comprises the steps of performing gesture recognition to obtain a control gesture, wherein the gesture recognition is to recognize a hand wearing the intelligent wrist strap equipment; determining an operation instruction according to the control gesture; and controlling the intelligent wrist band equipment to execute corresponding operation according to the operation instruction. According to the embodiment of the invention, the control gesture made by the user is recognized, and the operation instruction of the control gesture and the operation corresponding to the operation instruction are determined, so that the intelligent wrist strap device is controlled. The control gesture is a gesture made by a hand wearing the intelligent wrist strap device, so that a user only needs to control the intelligent wrist strap device by using one hand wearing the intelligent wrist strap device without controlling the intelligent wrist strap device by using two hands simultaneously.
Further, based on the first embodiment described above, a second embodiment of the single-hand control method of the smart wristband device of the present invention is proposed.
In this embodiment, the step S10 includes:
step a11, performing gesture recognition on the hand to obtain a hand control gesture;
in this embodiment, the hand is subjected to gesture recognition to obtain a hand control gesture. It should be noted that the hand control gesture includes a tilt control gesture, a flat control gesture, and the like. Referring to fig. 4, fig. 4 is a schematic view of a tilt control gesture of the single-hand control method of the smart band device of the present invention. The warped palm control gesture is that the back of the hand and the wrist are not on the same horizontal line, and the corresponding action of the warped palm control gesture comprises the following steps: opening finger tilted back of hand, opening fist tilted back of hand, opening finger tilted palm and fist tilted palm; referring to fig. 5, fig. 5 is a schematic view of a flat-palm control gesture of the single-hand control method of the smart band device of the present invention. The flat control gesture is that the back of the hand and the wrist are at the same horizontal line or approximate to the same horizontal line, and the corresponding actions of the flat control gesture comprise: open fingers and keep the palm flat, open fingers and keep the back of the hand flat, and grasp a fist and keep the back of the hand flat, etc.
Further, step a11 includes:
step a111, transmitting a gesture recognition signal to one side of the hand by the signal transmitter;
step a112, detecting whether the signal receiver receives a gesture reflection signal based on the gesture recognition signal;
a113, if the signal receiver receives the gesture reflection signal, obtaining a tilt control gesture;
step a114, if the signal receiver does not receive the gesture reflection signal, a flat-palm control gesture is obtained.
In this embodiment, a signal transmitter transmits a gesture recognition signal to one side of a hand, and then, based on the gesture recognition signal, it is detected whether a signal receiver receives a gesture reflection signal, if the signal receiver receives the gesture reflection signal, a tilt control gesture is obtained, and if the signal receiver does not receive the gesture reflection signal, a flat control gesture is obtained.
Wherein, the smart wrist strap device is provided with a signal transmitter and a signal receiver on one side close to the hand. Specifically, referring to fig. 4, two holes are formed in the front end of the edge of one side of the wrist of the smart wristband device, one hole is used for signal transmission, and the other hole is used for signal reception. The transmitting opening of the signal transmitter is aligned with the transmitting hole, and the receiving opening of the signal receiver is aligned with the receiving hole. Referring to fig. 5, a signal is emitted from a hole and then spread into a fan shape at an angle after being emitted. Of course, only one hole may be opened for both signal transmission and signal reception. In addition, if the edge of the smart wristband device is made of a light-transmitting material or a signal can penetrate through the edge, no hole needs to be formed. In addition, referring to fig. 5, holes may be provided at both left and right sides to set a left and right hand wearing mode, so that the user can wear both left and right hands.
It should be noted that, the signal may be encoded and then transmitted, and accordingly, the received reflected signal needs to be decoded. The interference of external light can be reduced through coding, so that the accuracy of gesture recognition detection is further improved.
The signal is preferably an infrared signal, and may be a signal such as an electromagnetic wave, a light wave, a laser, or an ultrasonic wave. In a specific embodiment, the hand can be further subjected to gesture recognition through the strength of the reflected signal and the time for which the reflected signal is kept. Gesture recognition can also be performed by judging the distance, specifically, the time of transmitting a signal and the time of receiving a reflected signal are respectively recorded, then the time of receiving the transmitted signal is subtracted from the time of transmitting the signal to obtain a time difference, and finally, the time difference is divided by the signal transmission speed, such as the light speed, to obtain a distance value. It can be understood that the smart wristband device is very close to the hand, so that whether the palm is tilted or not can be detected through the distance value.
Further, the recognition mode of the hand control gesture comprises the following steps: a signal reflection mode, a photographing recognition mode, and an event camera mode.
In this embodiment, the signal reflection manner is to identify a gesture by using the reflection of the hand on the gesture identification signal, specifically, if the hand is tilted, the gesture identification signal transmitted by the smart band device is reflected back, so that the smart band device receives the reflected gesture identification signal, and the hand control gesture is a tilt control gesture; if the hand is kept flat, the gesture recognition signal transmitted by the intelligent wrist strap device cannot be reflected back, so that the hand control gesture is a flat control gesture. The hand gesture recognition signal includes infrared signals, ultrasonic signals, electric wave signals and other wavelength light wave signals.
The photographing identification mode is to photograph the hand according to a certain period, compare the photographed photograph with the hand characteristic information to identify whether the hand is tilted, and specifically, if the photographed photograph contains the hand characteristic information, determine that the hand is tilted. The control gesture can be shot in time and cannot be missed when the period is usually taken for multiple times within 1 second. The hand feature information may be a hand contour, and the captured photo may be analyzed by an edge detection algorithm or the like to obtain the hand feature information.
The event camera mode can sensitively capture moving objects, namely, as long as the hand tilts up, the event camera can capture the moving objects in time and perform gesture recognition, and specifically, in the whole event camera field, an event can be returned as long as one pixel value changes. Because the time between adjacent events is less than 1 microsecond, the event camera has the advantages of high dynamic range and low time delay, and because of the low time delay, the event camera cannot generate blur when shooting a high-speed object.
Further, after the step a114, the method further includes:
step A, when the tilt control gesture is recognized, detecting whether other control gestures are recognized or not within a first preset time;
b, if the flat control gesture is recognized, obtaining a non-contact short key control gesture;
and C, if the other control gestures are not recognized, obtaining a non-contact long key control gesture.
In this embodiment, when the tilt control gesture is recognized, whether other control gestures are recognized or not is detected within a first preset time, if the flat control gesture is recognized, a non-contact short key control gesture is obtained, and if other control gestures are not recognized, a non-contact long key control gesture is obtained. It can be understood that if the wrist rotation is recognized within the first preset time, the non-contact short key control gesture cannot be obtained, that is, after the tilt control gesture is recognized, when the wrist rotation is recognized within the first preset time, the control gesture is not the non-contact key control gesture.
The first preset time is the time interval between recognition of the tilt control gesture and recognition of the flat control gesture again. The first preset time may be set according to actual needs, for example, 1 second, 0.9 second, 1.1 second, and the like, and is not limited herein.
Specifically, the palm flattening after the palm tilting of the hand can be a non-contact key control gesture, and then the non-contact key control gesture is divided into a non-contact short key control gesture and a non-contact long key control gesture according to the length of the palm tilting holding time. The non-contact short key control gesture and the non-contact long key control gesture are both composed of two basic control gestures, and the two basic control gestures are a tilted palm control gesture and a flat palm control gesture. The maximum holding time of the non-contact short key control gesture can be set to be 1 second, and it can be understood that if the holding time of the palm tilting is longer than the maximum holding time, the non-contact key is a non-contact long key.
In addition, it should be noted that the operation instruction corresponding to the non-contact short-key control gesture may be a selection instruction and a confirmation instruction, and the operation instruction corresponding to the non-contact long-key control gesture may be a rollback instruction and an exit instruction. Of course, the non-contact short key control gesture and the non-contact long key control gesture may also correspond to other operation instructions, and are not limited specifically here.
Step a12, performing gesture recognition on the arm wrist to obtain an arm wrist control gesture;
in this embodiment, the wrist is subjected to gesture recognition to obtain a wrist control gesture. It should be noted that the arm control gesture includes an arm flat lifting control gesture, an arm inward turning control gesture, an arm outward turning control gesture, an arm upward tilting control gesture, an arm downward tilting control gesture, an arm left tilting control gesture, an arm right tilting control gesture, and the like. This arm wrist adversion control gesture rotates to the health inboard for the arm wrist and gets back to the original position again, and this arm wrist is outward rotated the control gesture and is rotated to the health outside for the arm wrist and gets back to the original position again, and this arm wrist tilt-up control gesture is that the arm wrist is not in the horizontality and tilt up, and this arm wrist down dip control gesture is that the arm wrist is not in the horizontality and the downward sloping, and this arm wrist left tilt control gesture is that the arm wrist swings left, and this arm wrist right tilt control gesture is that the arm wrist swings right.
Specifically, step a12 includes:
step a1201, detecting whether the arm wrist is horizontally lifted;
step a1202, if the arm is horizontally lifted, obtaining an arm horizontal lifting control gesture; and/or
Step a1203, detecting whether the arm wrist rotates;
step a1204, if the arm wrist rotates, detecting the rotation direction of the arm wrist;
step a1205, if the rotation direction is to rotate towards the inner side of the body and then return to the original position, obtaining an inward rotation control gesture of the arm wrist;
step a1206, if the rotation direction is to rotate towards the outer side of the body and then return to the original position, obtaining an external rotation control gesture of the arm and the wrist; and/or
Step a1207, detecting whether the arm wrist swings;
step a1208, if the arm wrist swings, detecting the swinging direction of the arm wrist;
step a1209, if the swinging direction is swinging upwards and then returning to the original position, obtaining an arm and wrist tilting control gesture;
step a1210, if the swing direction is swinging downwards and then returning to the original position, obtaining a control gesture that the arm and the wrist are declined;
step a1211, if the swinging direction is swinging leftwards and then returning to the original position, obtaining a left-leaning control gesture of the arm wrist;
in step a1212, if the swing direction is swing to the right and then return to the original position, a wrist right tilt control gesture is obtained.
In this embodiment, whether the arm is flatly lifted is detected, if the arm is flatly lifted, a control gesture for flatly lifting the arm is obtained, and/or whether the arm is rotated is detected, if the arm is rotated, a rotation direction of the arm is detected, if the rotation direction is to rotate towards the inner side of the body and then return to the original position, a control gesture for inward rotation of the arm is obtained, and if the rotation direction is to rotate towards the outer side of the body and then return to the original position, a control gesture for outward rotation of the arm is obtained; and/or detecting whether the arm wrist swings, if the arm wrist swings, detecting the swinging direction of the arm wrist, if the swinging direction is upward swinging and then returns to the original position, obtaining an arm wrist tilting control gesture, if the swinging direction is downward swinging and then returns to the original position, obtaining an arm declining control gesture, if the swinging direction is leftward swinging and then returns to the original position, obtaining an arm left tilting control gesture, and if the swinging direction is rightward swinging and then returns to the original position, obtaining an arm right tilting control gesture.
It should be noted that the recognition mode of the arm-wrist control gesture is to detect the motion state of the smart wristband device through an acceleration sensor and an angular velocity sensor (gyroscope), and it can be understood that the smart wristband device is relatively stationary with respect to the hand wearing the smart wristband device, and therefore the motion state of the wrist can be indirectly detected.
In addition, it should be noted that the acceleration sensor and the angular velocity sensor are both installed inside the smart wristband device. Certainly also can install on the wrist strap, however, install in the inside of intelligent wrist strap equipment, compare and install on the wrist strap, the weight of reducible wrist strap to promote user's the comfort of wearing, and other devices such as acceleration sensor and angular velocity sensor and treater are all in the inside of intelligent wrist strap equipment, reducible power consumptions, in order to improve the use efficiency of intelligent wrist strap equipment.
It can be understood that the acceleration sensor and the angular velocity sensor are combined and adjusted with each other, so that the accuracy of detecting the rotation direction of the wrist can be further ensured.
Further, after step a1204, the method further comprises:
d, detecting the rotation speed and/or the rotation amplitude of the arm wrist;
and E, determining an operation speed corresponding to the control gesture according to the rotation speed and/or the rotation amplitude, wherein the operation speed comprises a screen scrolling speed, a cursor moving speed and a page sliding speed.
In this embodiment, the rotation speed and/or the rotation amplitude of the wrist are detected, and then the operation speed corresponding to the control gesture is determined according to the rotation speed and/or the rotation amplitude, where the operation speed includes a scrolling speed, a cursor moving speed, and a page sliding speed.
The scrolling speed, the cursor moving speed and the page sliding speed are related to the amplitude and the speed of the rotation of the wrist, for example, the fast rotation of the wrist can scroll a plurality of options at a time, and the slow rotation of the wrist can scroll only one option at a time. It is understood that the scrolling of the screen options can adopt a closed loop mode, for example, there are 9 options, when the 9 th option is scrolled, the 1 st option is scrolled, so that the user can scroll towards one direction, and the use convenience of the smart wristband device is improved.
Wherein, whether pivoted detection mode of arm wrist detects the motion state of intelligent wrist strap equipment for through acceleration sensor and angular rate sensor (gyroscope), can understand that intelligent wrist strap equipment is static relatively with the hand of wearing this intelligent wrist strap equipment, consequently can detect the motion state of arm wrist indirectly.
Note that the acceleration sensor and the angular velocity sensor are both installed inside the smart band device. Certainly also can install on the wrist strap, however, install in the inside of intelligent wrist strap equipment, compare and install on the wrist strap, the weight of reducible wrist strap to promote user's the comfort of wearing, and other devices such as acceleration sensor and angular velocity sensor and treater are all in the inside of intelligent wrist strap equipment, reducible power consumptions, in order to improve the use efficiency of intelligent wrist strap equipment.
It can be understood that the acceleration sensor and the angular velocity sensor are combined and adjusted with each other, so that the accuracy of detecting the movement track of the wrist can be further ensured.
Further, after the step a1208, the method further includes:
step F, detecting the swing speed and/or swing amplitude of the arm wrist;
and G, determining an operation speed corresponding to the control gesture according to the swing speed and/or the swing amplitude, wherein the operation speed comprises a screen scrolling speed, a cursor moving speed and a page sliding speed.
In this embodiment, the swing speed and/or swing amplitude of the arm wrist are detected, and then the operation speed corresponding to the control gesture is determined according to the swing speed and/or swing amplitude, where the operation speed includes a scroll speed, a cursor movement speed, and a page sliding speed.
The scrolling speed, the cursor moving speed and the page sliding speed are related to the amplitude and the speed of the movement of the wrist, for example, the fast rotating wrist can scroll a plurality of options at a time, and the slow rotating wrist can scroll only one option at a time. It is understood that the scrolling of the screen options can adopt a closed loop mode, for example, there are 9 options, when the 9 th option is scrolled, the 1 st option is scrolled, so that the user can scroll towards one direction, and the use convenience of the smart wristband device is improved.
It should be noted that the detection mode of whether the arm wrist swings is to detect the motion state of the smart band device by an acceleration sensor and an angular velocity sensor (gyroscope), and it can be understood that the smart band device is relatively stationary with respect to the hand wearing the smart band device, and thus the motion state of the arm wrist can be indirectly detected.
In this embodiment, each part of the opponent is subjected to gesture recognition, so that the control gestures are diversified in variety, various requirements of the user are met, and the use experience of the user is improved.
Further, based on the second embodiment described above, a third embodiment of the single-handed control method of the smart wristband device of the present invention is proposed.
In this embodiment, after the step a12, the method for controlling a smart wristband device with one hand further includes:
step H, detecting the interval time of the hand control gesture and the arm and wrist control gesture;
step I, judging whether the interval time is less than a second preset time or not;
and step J, if the interval time is less than the second preset time, combining the hand control gesture and the arm and wrist control gesture to obtain a combined control gesture.
In this embodiment, the interval time of the hand control gesture and the arm control gesture is detected, and then, whether the interval time is less than a second preset time is determined, and if the interval time is less than the second preset time, the hand control gesture and the arm control gesture are combined to obtain a combined control gesture.
The second preset time may be set according to actual needs, for example, 1 second, 1.1 second, 0.9 second, and the like, and is not limited herein.
It should be noted that, the combination manner of the combined control gesture is that two are combined, where the combined control gesture includes: an inward rotation control gesture of a palm tilting arm, an outward rotation control gesture of a palm tilting arm, an inward rotation control gesture of a palm leveling arm, an outward rotation control gesture of a palm leveling arm, an upward tilt control gesture of a palm leveling arm, a downward tilt gesture of a palm leveling arm, an upward tilt control gesture of a palm tilting arm, a downward tilt gesture of a palm tilting arm, a left tilt control gesture of a palm tilting, and a right tilt control gesture of a palm tilting.
Of course, the combined control gesture may also include: an arm tilt-up inward turning control gesture, an arm tilt-up outward turning control gesture, an arm wrist tilt-down inward turning control gesture, an arm wrist tilt-down outward turning control gesture, an arm wrist left tilt inward turning control gesture, an arm wrist left tilt outward turning control gesture, an arm wrist right tilt inward turning control gesture, and an arm wrist right tilt outward turning control gesture.
In the embodiment, various complex control gestures can be realized by combining the control gestures of all parts of the hand so as to meet various requirements of users, and thus, the use experience of the users is further improved.
Further, based on the first embodiment described above, a fourth embodiment of the single-handed control method of the smart wristband device of the present invention is proposed.
In this embodiment, the method for controlling a smart band device with one hand according to the present invention further includes:
step K, detecting whether the arm wrist wearing the intelligent wrist strap equipment is horizontally lifted or not when the screen is turned off;
and step L, if the arm wrist is horizontally lifted, controlling the intelligent wrist strap equipment to light.
In this embodiment, when intelligent wrist strap equipment is in and puts the screen, whether the arm wrist of wearing intelligent wrist strap equipment is flat lifted, if the arm wrist is flat lifted, then control intelligent wrist strap equipment bright screen. The bright screen is used for emitting light for a screen of the intelligent wrist strap device to display a main interface of the intelligent wrist strap device, so that a user can make a corresponding control gesture based on the main interface.
It should be noted that the arm should be lifted to enable the user to see the display content of the screen, specifically, the screen surface can be seen by 60 degrees forward, backward, leftward, rightward, and rightward compared to the horizontal plane.
It will be appreciated that a flat lift of the wrist will typically lift from the sides of the thigh, resulting in a violent rotation of the wrist. In addition, if the screen surface of the intelligent wrist strap device is basically unchanged compared with the horizontal plane, whether the arm wrist is horizontally lifted or not can be determined by detecting whether the arm wrist shakes violently back and forth, left and right or up and down.
In addition, whether the arm is lifted or not can be detected by the acceleration sensor and the angular velocity sensor. It can be understood that the smart band device is relatively stationary with respect to the hand wearing the smart band device, and thus the motion state of the arm wrist can be indirectly detected. The acceleration sensor and the angular velocity sensor are both installed inside the intelligent wrist strap device. Certainly also can install on the wrist strap, however, install in the inside of intelligent wrist strap equipment, compare and install on the wrist strap, the weight of reducible wrist strap to further promote user's the comfort of wearing, and acceleration sensor and other devices such as angular velocity sensor and treater all are in the inside of intelligent wrist strap equipment, compare and supply power alone, and reducible power consumptions of this embodiment are with the use efficiency who improves intelligent wrist strap equipment. It can be understood that the acceleration sensor and the angular velocity sensor are combined and adjusted with each other, so that the accuracy of the arm wrist flat lifting detection can be further ensured.
In this embodiment, when intelligent wrist strap equipment is in the screen of resting, whether need detect the user and put down the arm wrist, if detect the user and put down the arm wrist, steerable intelligent wrist strap equipment is bright to begin to carry out hand gesture recognition, power consumption can be reduced to the hardware of hand gesture recognition is gone up promptly, with the use efficiency of further improving intelligent wrist strap equipment.
Further, based on the first embodiment described above, a fifth embodiment of the single-hand control method of the smart wristband device of the present invention is proposed.
In this embodiment, the method for controlling a smart band device with one hand according to the present invention further includes:
step M, when the mobile terminal is in a screen-off state, starting a hand gesture misoperation function;
step N, when the hand gesture misoperation function is started, detecting whether a non-contact short key control gesture is continuously identified;
step O, if the non-contact short key control gesture is continuously recognized, determining the recognition times of the non-contact short key control gesture;
step P, judging whether the identification times are equal to preset times or not;
and step Q, if the identification times are equal to the preset times, closing the hand gesture misoperation function.
In this embodiment, when the screen is turned off, the hand gesture misoperation function is turned on, when the hand gesture misoperation function is turned on, whether a non-contact short key control gesture is continuously recognized is detected, if the non-contact short key control gesture is continuously recognized, the recognition frequency of the non-contact short key control gesture is determined, then, whether the recognition frequency is equal to the preset frequency is judged, and if the recognition frequency is equal to the preset frequency, the hand gesture misoperation function is turned off.
It should be noted that, when the smart wristband device is in the screen, that is, when the screen is locked, the user generally does not need to control the smart wristband device, and therefore, the function of misoperation of the hand gesture can be opened, that is, the hand gesture recognition is locked, so that the smart wristband device is prevented from being triggered when the user does other things, and the smart wristband device is made to perform invalid operation.
In addition, it should be further noted that when the hand gesture misoperation function is turned on, if the user needs to turn off the hand gesture misoperation function, that is, unlock the locked hand gesture recognition, the user needs to continuously make a non-contact short-key control gesture so as to continuously recognize the non-contact short-key control gesture by the smart wristband device, wherein a time interval of each non-contact short-key control gesture is usually within 0.5 second or 1 second, and may be specifically set according to actual needs, which is not specifically limited herein. The non-contact short key control gesture is that the palm of the hand is raised and then flattened, wherein the maximum holding time of the raised palm can be set to be 1 second, namely the palm needs to be flattened within 1 second after the palm is raised.
The preset number of times is greater than or equal to 2, and specifically, the preset number of times can be set according to actual needs, for example, 2 times, 3 times, and the like, and is not limited specifically here. The preset times can also be set by the user to realize the personalized requirements of the user.
In this embodiment, when intelligent terminal is in and is out of the screen, open hand gesture maloperation function to avoid intelligent wrist strap equipment to discern the hand control gesture that non-user intended, thereby promote intelligent of intelligent wrist strap equipment. Meanwhile, the intelligent wrist strap equipment can close the hand gesture misoperation function only after continuously recognizing the non-contact short key control gesture, and the user can close the hand gesture misoperation function only according to the requirement, so that the effectiveness of the hand gesture misoperation is improved.
Further, based on the first embodiment described above, a sixth embodiment of the single-hand control method of the smart wristband device of the present invention is proposed.
In this embodiment, the method for controlling a smart band device with one hand according to the present invention further includes:
step R, when the screen is on bright screen, determining the type of the control gesture;
step S, if the control gesture is a palm-flat wrist-to-wrist control gesture, determining the rotation direction and the swing direction of the arm wrist according to the palm-flat wrist-to-wrist control gesture;
step T, determining a screen rolling direction according to the rotation direction and the swing direction, wherein the screen rolling direction comprises a front direction, a rear direction, a left direction and a right direction;
step U, controlling the intelligent wrist strap equipment to scroll according to the screen scrolling direction;
step V, if the control gesture is a palm tilting and wrist turning control gesture, determining the rotation direction and the swing direction of the wrist according to the palm tilting and wrist turning control gesture;
step W, determining the cursor moving direction according to the rotating direction and the swinging direction, wherein the cursor moving direction comprises a front direction, a rear direction, a left direction and a right direction;
and step X, controlling the intelligent wrist band equipment to move the cursor according to the cursor moving direction.
In this embodiment, when the screen is bright, determining the type of the control gesture, if the control gesture is a palm-to-wrist control gesture, determining a rotation direction and a swing direction of the arm wrist according to the palm-to-wrist control gesture, and then determining a screen rolling direction according to the rotation direction and the swing direction, wherein the screen rolling direction includes front, back, left and right, and controlling the intelligent wrist band device to roll the screen according to the screen rolling direction; and if the control gesture is a palm tilting and wrist turning control gesture, determining the rotation direction and the swing direction of the arm wrist according to the palm tilting and wrist turning control gesture, and finally determining the cursor movement direction according to the rotation direction and the swing direction, wherein the cursor movement direction comprises front, back, left and right, and the intelligent wrist band device is controlled to move the cursor according to the cursor movement direction.
The type of the control gesture is determined, and specifically, whether the control gesture is a palm flat to wrist control gesture or a palm tilted to wrist flat to control gesture is determined. The palm-flat wrist-to-wrist control gesture is a combination of a palm-flat control gesture and a wrist-to-wrist rotation control gesture, such as a palm-to-wrist in-turn control gesture, a palm-to-wrist out-of-turn control gesture, a palm-to-wrist in-turn tilt-up control gesture, a palm-to-wrist out-of-turn tilt-up control gesture, a palm-to-wrist in-turn tilt-down control gesture, a palm-to-wrist out-of-turn tilt-down control gesture, and the like. The palm tilting and wrist turning control gesture is a combination of a palm tilting control gesture and an arm wrist turning control gesture, such as a palm tilting arm wrist outward turning control gesture, a palm tilting arm inward turning control gesture, a palm tilting arm upward tilting control gesture, a palm tilting arm downward tilting control gesture and the like.
It should be noted that, for the palm-to-palm wrist control gesture, that is, for the screen scrolling, the screen scrolling direction may be determined according to the rotation direction and the swing direction of the wrist, and for the convenience of understanding of those skilled in the art, the following description is given by way of example, and the mapping relationship between the rotation direction and the swing direction and the screen scrolling direction is not limited. The gesture of controlling the rotation of the outer palm arm corresponds to leftward screen scrolling, the gesture of controlling the rotation of the inner palm arm corresponds to rightward screen scrolling, the gesture of controlling the tilting of the outer palm arm corresponds to forward screen scrolling, and the gesture of controlling the tilting of the inner palm arm corresponds to backward screen scrolling.
It will be appreciated that the speed at which the screen is scrolled is related to the magnitude and speed of rotation of the wrist, for example, a fast rotating wrist may scroll through multiple items at a time, and a slow rotating wrist may scroll through only one item at a time. The scrolling of the screen options can adopt a closed loop mode, for example, the number of the options is 9, when the option is scrolled to the 9 th option, the option can be scrolled to the 1 st option, so that the user can scroll towards one direction, and the use convenience of the intelligent wrist strap device is improved.
In addition, it should be noted that, for the palm tilting wrist control gesture, that is, for the cursor movement, the screen scrolling direction may be determined according to the rotation direction and the swing direction of the wrist, and for the convenience of understanding of those skilled in the art, the following description is given by way of example, and the mapping relationship between the rotation direction and the swing direction and the screen scrolling direction is not limited. The outward turning control gesture of the wrist with tilted palm arm corresponds to forward movement of the cursor, the inward turning control gesture of the wrist with tilted palm arm corresponds to backward movement of the cursor, the upward tilting control gesture of the wrist with tilted palm arm corresponds to leftward movement of the cursor, and the downward tilting control gesture of the wrist with tilted palm arm corresponds to rightward movement of the cursor.
In this embodiment, through flat palm commentaries on classics wrist control gesture and stick up palm commentaries on classics wrist control gesture and roll the screen respectively and remove the cursor to make user's accessible gesture control intelligent wrist strap equipment, and through rolling the screen and cursor removal selection user's self required function option, thereby further improved the experience sense and the intelligent of intelligent wrist strap equipment.
The invention also provides a single-hand control device of the intelligent wrist strap equipment.
Referring to fig. 6, fig. 6 is a functional module schematic diagram of a first embodiment of a single-hand control device of a smart wristband apparatus according to the present invention.
In this embodiment, the one-handed control device of the smart wristband apparatus includes:
the gesture recognition module 10 is configured to perform gesture recognition to obtain a control gesture, where the gesture recognition is to recognize a hand wearing the smart wristband device;
the instruction determining module 20 is configured to determine an operation instruction according to the control gesture;
and the operation execution module 30 is configured to control the smart wristband device to execute a corresponding operation according to the operation instruction.
Each virtual function module of the single-hand control device of the smart band device is stored in the memory 1005 of the smart band device shown in fig. 1, and is used for implementing all functions of a single-hand control program of the smart band device; when executed by the processor 1001, the modules may perform control functions of the smart wristband device.
Further, the gesture recognition module 10 includes:
the hand recognition unit is used for carrying out gesture recognition on the hand to obtain a hand control gesture;
and the arm and wrist recognition unit is used for carrying out gesture recognition on the arm and wrist to obtain an arm and wrist control gesture.
Further, the hand recognition unit includes:
the signal transmitting subunit is used for transmitting a gesture recognition signal to one side of the hand through the signal transmitter;
the signal receiving subunit is used for detecting whether the signal receiver receives a gesture reflection signal or not based on the gesture recognition signal;
the palm tilting acquisition subunit is used for acquiring a palm tilting control gesture if the signal receiver receives the gesture reflection signal;
the palm leveling acquisition subunit is further configured to obtain a palm leveling control gesture if the signal receiver does not receive the gesture reflection signal.
Further, the hand recognition unit further includes:
the gesture detection subunit is used for detecting whether other control gestures are recognized or not within a first preset time when the tilt control gesture is recognized;
the non-contact short key identification subunit is used for obtaining a non-contact short key control gesture if the flat control gesture is identified;
and the non-contact long key identification subunit is used for obtaining a non-contact long key control gesture if the other control gestures are not identified.
Further, the arm wrist recognition unit includes:
the horizontal lifting detection subunit is used for detecting whether the arm wrist is horizontally lifted or not;
the horizontal lifting acquisition subunit is used for acquiring an arm wrist horizontal lifting control gesture if the arm wrist is horizontally lifted; and/or
A rotation detection subunit for detecting whether the arm wrist swings
A rotation direction detection subunit, configured to detect a rotation direction of the arm wrist if the arm wrist rotates;
the arm wrist inward turning acquisition subunit is used for acquiring an arm wrist inward turning control gesture if the rotation direction is to rotate towards the inner side of the body and then return to the original position;
the arm wrist external rotation acquisition subunit is used for acquiring an arm wrist external rotation control gesture if the rotation direction is to rotate towards the outside of the body and then return to the original position; and/or
The swing detection subunit is used for detecting whether the arm wrist swings or not;
a swing direction detection subunit, configured to detect a swing direction of the arm wrist if the arm wrist swings;
the upward inclination acquisition subunit is used for acquiring an arm wrist upward inclination control gesture if the swinging direction is upward swinging and then returns to the original position;
the declination acquisition subunit is used for acquiring a declination control gesture of the arm if the swinging direction is downward swinging and then returns to the original position;
the left inclination acquisition subunit is used for acquiring a left inclination control gesture of the arm wrist if the swinging direction is swinging leftwards and then returning to the original position;
and the right inclination acquisition subunit is used for acquiring a right inclination control gesture of the arm wrist if the swinging direction is swinging to the right and then returning to the original position.
Further, the arm wrist recognition unit further includes:
the first speed detection subunit is used for detecting the rotation speed and/or the rotation amplitude of the arm wrist;
and the first speed determination subunit is used for determining an operation speed corresponding to the control gesture according to the rotation speed and/or the rotation amplitude, wherein the operation speed comprises a scrolling speed, a cursor moving speed and a page sliding speed.
Further, the arm wrist recognition unit further includes:
the second speed detection subunit is used for detecting the swing speed and/or swing amplitude of the arm wrist;
and the second speed determining subunit is used for determining an operation speed corresponding to the control gesture according to the swing speed and/or the swing amplitude, wherein the operation speed comprises a scrolling speed, a cursor moving speed and a page sliding speed.
Further, the gesture recognition module 10 further includes:
the time detection unit is used for detecting the interval time of the hand control gesture and the arm and wrist control gesture;
the time judging unit is used for judging whether the interval time is less than a second preset time or not;
and the combination acquisition unit is used for combining the hand control gesture and the arm and wrist control gesture to obtain a combined control gesture if the interval time is less than the second preset time.
Further, the combined control gesture includes: an inward rotation control gesture of a palm tilting arm, an outward rotation control gesture of a palm tilting arm, an inward rotation control gesture of a palm leveling arm, an outward rotation control gesture of a palm leveling arm, an upward tilt control gesture of a palm leveling arm, a downward tilt gesture of a palm leveling arm, an upward tilt control gesture of a palm tilting arm, a downward tilt gesture of a palm tilting arm, a left tilt control gesture of a palm tilting, and a right tilt control gesture of a palm tilting.
Further, the recognition mode of the hand control gesture comprises the following steps: a signal reflection mode, a photographing recognition mode, and an event camera mode.
Further, the operation instruction comprises: the system comprises a screen lightening instruction, a screen turning instruction, a screen scrolling instruction, a cursor moving instruction, a selecting instruction, a confirming instruction, a backspacing instruction, a quitting instruction, a volume adjusting instruction and a switching instruction.
Further, the single-hand control device of the smart band device further includes:
the arm wrist detection module is used for detecting whether an arm wrist wearing the intelligent wrist strap equipment is horizontally lifted or not when the arm wrist is positioned at a screen-off position;
and the screen-lighting control module is used for controlling the screen lighting of the intelligent wrist strap equipment if the arm wrist is horizontally lifted.
Further, the single-hand control device of the smart band device further includes:
the function starting module is used for starting the hand gesture misoperation function when the screen is turned on;
the gesture detection module is used for detecting whether a non-contact short key control gesture is continuously identified or not when the hand gesture misoperation function is started;
the number determining module is used for determining the identification number of the non-contact short key control gesture if the non-contact short key control gesture is continuously identified;
the number judgment module is used for judging whether the identification number is equal to a preset number or not;
and the function closing module is used for closing the hand gesture misoperation function if the identification times are equal to the preset times.
Further, the single-hand control device of the smart band device further comprises:
the gesture determining module is used for determining the type of the control gesture when the screen is on a bright screen;
the arm-wrist direction determining module is used for determining the rotation direction and the swing direction of the arm wrist according to the palm-flat wrist-to-wrist control gesture if the control gesture is the palm-flat wrist-to-wrist control gesture;
the rolling direction determining module is used for determining a screen rolling direction according to the rotating direction and the swinging direction, wherein the screen rolling direction comprises a front direction, a rear direction, a left direction and a right direction;
the screen scrolling control module is used for controlling the intelligent wrist strap equipment to scroll according to the screen scrolling direction;
the arm wrist direction determining module is further used for determining the rotation direction and the swing direction of the arm wrist according to the palm tilting and wrist turning control gesture if the control gesture is the palm tilting and wrist turning control gesture;
the moving direction determining module is used for determining the moving direction of the cursor according to the rotating direction and the swinging direction, wherein the moving direction of the cursor comprises a front direction, a rear direction, a left direction and a right direction;
and the cursor movement control module is used for controlling the intelligent wrist band equipment to move the cursor according to the cursor movement direction.
The function implementation of each module in the single-hand control device of the smart wristband apparatus corresponds to each step in the single-hand control method embodiment of the smart wristband apparatus, and the function and implementation process thereof are not described in detail here.
The present invention also provides a one-handed control system of an intelligent wristband apparatus, the one-handed control system of the intelligent wristband apparatus including: a memory, a processor and a one-handed control program of the smart band device stored on the memory and executable on the processor, the one-handed control program of the smart band device implementing the steps of the one-handed control method of the smart band device as described in any one of the above embodiments when executed by the processor.
The specific embodiment of the single-hand control system of the smart wristband device of the present invention is basically the same as the embodiments of the single-hand control method of the smart wristband device, and will not be described herein again.
The present invention also provides a computer readable storage medium having stored thereon a one-hand control program of a smart band device, which when executed by a processor, implements the steps of the one-hand control method of a smart band device as described in any one of the above embodiments.
The specific embodiment of the computer-readable storage medium of the present invention is substantially the same as the embodiments of the single-hand control method of the smart wristband device, and is not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (12)

1. A single-hand control method of an intelligent wrist-worn device is characterized by comprising the following steps:
performing gesture recognition to obtain a control gesture, wherein the gesture recognition is to recognize a hand wearing the intelligent wrist-worn device, and a recognition device of the gesture recognition is located on a main body of the intelligent wrist-worn device;
determining an operation instruction according to the control gesture;
controlling the intelligent wrist-worn device to execute corresponding operation according to the operation instruction;
the step of performing gesture recognition to obtain a control gesture comprises:
performing gesture recognition on the hand to obtain a hand control gesture;
performing gesture recognition on the arm wrist to obtain an arm wrist control gesture;
wherein, the mode of carrying out gesture recognition to the hand includes: a signal reflection mode;
the gesture recognition method for the arm wrist comprises the following steps: detecting the motion state of the arm wrist through an acceleration sensor and an angular velocity sensor;
wherein, one side that intelligence wrist worn equipment is close to the hand is provided with signal transmitter and signal receiver, carry out gesture recognition to the hand, the step that obtains the hand control gesture includes:
transmitting a gesture recognition signal to one side of the hand through the signal transmitter;
detecting whether the signal receiver receives a gesture reflection signal based on the gesture recognition signal;
if the signal receiver receives the gesture reflection signal, obtaining a tilt control gesture;
if the signal receiver does not receive the gesture reflection signal, a flat control gesture is obtained;
after the step of carrying out gesture recognition to the arm wrist to obtain arm wrist control gesture, still include:
detecting the interval time of the hand control gesture and the arm and wrist control gesture;
judging whether the interval time is less than a second preset time or not;
and if the interval time is less than the second preset time, combining the hand control gesture and the arm and wrist control gesture to obtain a combined control gesture.
2. The method for controlling the smart wrist-worn device with one hand according to claim 1, wherein after the step of obtaining the palm-flat control gesture if the signal receiver does not receive the gesture reflection signal, the method further comprises:
when the tilt control gesture is recognized, detecting whether other control gestures are recognized or not within a first preset time;
if the flat control gesture is recognized, obtaining a non-contact short key control gesture;
and if the other control gestures are not recognized, obtaining a non-contact long key control gesture.
3. The method for controlling the wrist-worn device by one hand according to claim 1, wherein the step of performing gesture recognition on the wrist to obtain the wrist control gesture comprises:
detecting whether the arm wrist is horizontally lifted;
if the arm wrist is lifted horizontally, obtaining an arm wrist horizontal lifting control gesture; and/or
Detecting whether the arm wrist rotates;
if the arm wrist rotates, detecting the rotation direction of the arm wrist;
if the rotation direction is to rotate towards the inner side of the body and then return to the original position, obtaining an in-arm rotation control gesture;
if the rotation direction is to rotate towards the outer side of the body and then return to the original position, the external rotation control gesture of the arm wrist is obtained; and/or
Detecting whether the arm wrist swings;
if the arm wrist swings, detecting the swinging direction of the arm wrist;
if the swinging direction is swinging upwards and then returning to the original position, obtaining an arm and wrist tilting control gesture;
if the swing direction is swinging downwards and then returning to the original position, obtaining a control gesture that the arm wrist is declined;
if the swinging direction is swinging leftwards and then returning to the original position, obtaining a left-leaning control gesture of the arm wrist;
and if the swinging direction is swinging to the right and then returning to the original position, obtaining the right-leaning control gesture of the arm wrist.
4. The method for controlling the smart wrist-worn device with one hand according to claim 3, wherein the step of detecting the rotation direction of the wrist if the wrist rotates further comprises:
detecting the rotation speed and/or the rotation amplitude of the arm wrist;
determining an operation speed corresponding to the control gesture according to the rotation speed and/or the rotation amplitude, wherein the operation speed comprises a screen scrolling speed, a cursor moving speed and a page sliding speed;
wherein, if the wrist swings, then detect after the step of the swing direction of wrist, still include:
detecting the swing speed and/or swing amplitude of the arm wrist;
and determining an operation speed corresponding to the control gesture according to the swing speed and/or the swing amplitude, wherein the operation speed comprises a screen scrolling speed, a cursor moving speed and a page sliding speed.
5. The method of one-handed control of an intelligent wrist-worn device according to claim 1, wherein the combined control gesture comprises: an inward rotation control gesture of a palm tilting arm, an outward rotation control gesture of a palm tilting arm, an inward rotation control gesture of a palm leveling arm, an outward rotation control gesture of a palm leveling arm, an upward tilt control gesture of a palm leveling arm, a downward tilt gesture of a palm leveling arm, an upward tilt control gesture of a palm tilting arm, a downward tilt gesture of a palm tilting arm, a left tilt control gesture of a palm tilting, and a right tilt control gesture of a palm tilting.
6. The method for one-handed control of an intelligent wrist-worn device according to any one of claims 1 to 5, wherein the operation instructions include: the method comprises the steps of screen lightening, screen turning-off, scrolling, cursor moving, selecting, confirming, backing-off, quitting, volume adjusting and switching.
7. The method for controlling the smart wrist-worn device by one hand according to any one of claims 1 to 5, further comprising:
starting a hand gesture misoperation function;
when the hand gesture misoperation function is started, detecting whether a non-contact short key control gesture is continuously identified;
if the non-contact short key control gesture is continuously recognized, determining the recognition times of the non-contact short key control gesture;
judging whether the identification times are equal to preset times or not;
and if the identification times are equal to the preset times, closing the hand gesture misoperation function.
8. The method for controlling the smart wrist-worn device by one hand according to any one of claims 1 to 5, further comprising:
determining the type of the control gesture when the screen is on a bright screen;
if the control gesture is a palm-flat wrist-to-wrist control gesture, determining the rotation direction and the swing direction of the arm wrist according to the palm-flat wrist-to-wrist control gesture;
determining a screen rolling direction according to the rotating direction and the swinging direction, wherein the screen rolling direction comprises a front direction, a rear direction, a left direction and a right direction;
controlling the intelligent wrist-worn device to scroll according to the screen scrolling direction;
if the control gesture is a palm tilting and wrist turning control gesture, determining the rotation direction and the swing direction of the wrist according to the palm tilting and wrist turning control gesture;
determining a cursor moving direction according to the rotating direction and the swinging direction, wherein the cursor moving direction comprises a front direction, a rear direction, a left direction and a right direction;
and controlling the intelligent wrist-worn equipment to move the cursor according to the cursor moving direction.
9. The utility model provides a singlehanded controlling means of intelligence wrist equipment of wearing which characterized in that, singlehanded controlling means of intelligence wrist equipment of wearing includes:
the gesture recognition module is used for performing gesture recognition to obtain a control gesture, wherein the gesture recognition is used for recognizing a hand wearing the intelligent wrist-worn device, and a recognition device for the gesture recognition is located on a main body of the intelligent wrist-worn device;
the instruction determining module is used for determining an operation instruction according to the control gesture;
the operation execution module is used for controlling the intelligent wrist-worn device to execute corresponding operation according to the operation instruction;
the gesture recognition module is further used for performing gesture recognition on a hand to obtain a hand control gesture, performing gesture recognition on an arm and a wrist to obtain an arm and wrist control gesture, and combining the hand control gesture and the arm and wrist control gesture to obtain the control gesture;
wherein, the mode of carrying out gesture recognition to the hand includes: a signal reflection mode;
the gesture recognition method for the arm wrist comprises the following steps: detecting the motion state of the arm wrist through an acceleration sensor and an angular velocity sensor;
the intelligent wrist-worn device is characterized in that a signal transmitter and a signal receiver are arranged on one side, close to the hand, of the intelligent wrist-worn device, the gesture recognition module is further used for transmitting a gesture recognition signal to one side of the hand through the signal transmitter, detecting whether the signal receiver receives a gesture reflection signal or not based on the gesture recognition signal, if the signal receiver receives the gesture reflection signal, obtaining a palm tilting control gesture, and if the signal receiver does not receive the gesture reflection signal, obtaining a palm flat control gesture;
the gesture recognition module is further used for detecting the interval time of the hand control gesture and the arm control gesture, judging whether the interval time is less than second preset time, and if the interval time is less than the second preset time, combining the hand control gesture and the arm control gesture to obtain a combined control gesture.
10. An intelligent wrist-worn device, comprising: a memory, a processor and a single-handed control program of the intelligent wrist-worn device stored on the memory and capable of running on the processor, wherein the single-handed control program of the intelligent wrist-worn device realizes the steps of the single-handed control method of the intelligent wrist-worn device according to any one of claims 1 to 8 when being executed by the processor.
11. A one-handed control system of an intelligent wrist-worn device, the one-handed control system of the intelligent wrist-worn device comprising: a memory, a processor and a single-handed control program of the intelligent wrist-worn device stored on the memory and operable on the processor, the single-handed control program of the intelligent wrist-worn device implementing the steps of the single-handed control method of the intelligent wrist-worn device according to any one of claims 1 to 8 when executed by the processor.
12. A computer-readable storage medium, wherein the computer-readable storage medium stores thereon a one-hand control program of an intelligent wrist-worn device, and the one-hand control program of the intelligent wrist-worn device, when executed by a processor, implements the steps of the one-hand control method of the intelligent wrist-worn device according to any one of claims 1 to 8.
CN202011235876.6A 2020-11-06 2020-11-06 Intelligent wrist strap equipment and single-hand control method, device, system and storage medium thereof Active CN112269471B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011235876.6A CN112269471B (en) 2020-11-06 2020-11-06 Intelligent wrist strap equipment and single-hand control method, device, system and storage medium thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011235876.6A CN112269471B (en) 2020-11-06 2020-11-06 Intelligent wrist strap equipment and single-hand control method, device, system and storage medium thereof

Publications (2)

Publication Number Publication Date
CN112269471A CN112269471A (en) 2021-01-26
CN112269471B true CN112269471B (en) 2022-05-13

Family

ID=74339855

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011235876.6A Active CN112269471B (en) 2020-11-06 2020-11-06 Intelligent wrist strap equipment and single-hand control method, device, system and storage medium thereof

Country Status (1)

Country Link
CN (1) CN112269471B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230359422A1 (en) * 2022-05-03 2023-11-09 Meta Platforms Technologies, Llc Techniques for using in-air hand gestures detected via a wrist-wearable device to operate a camera of another device, and wearable devices and systems for performing those techniques

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103941860A (en) * 2014-03-31 2014-07-23 天津三星通信技术研究有限公司 Gesture recognition system of wrist strap type portable terminal and method of gesture recognition system
CN104090649A (en) * 2014-05-20 2014-10-08 上海翰临电子科技有限公司 Intelligent watchband and operating control method thereof
CN104205015A (en) * 2012-04-09 2014-12-10 高通股份有限公司 Control of remote device based on gestures
CN105759961A (en) * 2016-02-03 2016-07-13 林勇 Intelligent device and intelligent device control method
CN108181990A (en) * 2018-01-19 2018-06-19 昆山国显光电有限公司 Control method and smartwatch based on infrared gesture identification
CN108536291A (en) * 2018-03-29 2018-09-14 努比亚技术有限公司 A kind of application operating method, wearable device and storage medium
CN108717324A (en) * 2018-04-11 2018-10-30 努比亚技术有限公司 Intelligent wearable device and its control method, computer readable storage medium
CN110058767A (en) * 2019-03-26 2019-07-26 努比亚技术有限公司 Interface operation method, wearable terminal and computer readable storage medium
CN110134225A (en) * 2018-02-09 2019-08-16 景俊年 A kind of Intelligent bracelet and its control method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9477314B2 (en) * 2013-07-16 2016-10-25 Google Technology Holdings LLC Method and apparatus for selecting between multiple gesture recognition systems
CN109692471A (en) * 2018-12-29 2019-04-30 歌尔科技有限公司 A kind of wearable device and exchange method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104205015A (en) * 2012-04-09 2014-12-10 高通股份有限公司 Control of remote device based on gestures
CN103941860A (en) * 2014-03-31 2014-07-23 天津三星通信技术研究有限公司 Gesture recognition system of wrist strap type portable terminal and method of gesture recognition system
CN104090649A (en) * 2014-05-20 2014-10-08 上海翰临电子科技有限公司 Intelligent watchband and operating control method thereof
CN105759961A (en) * 2016-02-03 2016-07-13 林勇 Intelligent device and intelligent device control method
CN108181990A (en) * 2018-01-19 2018-06-19 昆山国显光电有限公司 Control method and smartwatch based on infrared gesture identification
CN110134225A (en) * 2018-02-09 2019-08-16 景俊年 A kind of Intelligent bracelet and its control method
CN108536291A (en) * 2018-03-29 2018-09-14 努比亚技术有限公司 A kind of application operating method, wearable device and storage medium
CN108717324A (en) * 2018-04-11 2018-10-30 努比亚技术有限公司 Intelligent wearable device and its control method, computer readable storage medium
CN110058767A (en) * 2019-03-26 2019-07-26 努比亚技术有限公司 Interface operation method, wearable terminal and computer readable storage medium

Also Published As

Publication number Publication date
CN112269471A (en) 2021-01-26

Similar Documents

Publication Publication Date Title
US11307718B2 (en) Gesture-based small device input
KR102253313B1 (en) Operation method and apparatus using fingerprint identification, and mobile terminal
CN106959841B (en) Method and device for calling functions in application
CN103262008B (en) Intelligent wireless mouse
EP2733574B1 (en) Controlling a graphical user interface
US10031586B2 (en) Motion-based gestures for a computing device
US8228292B1 (en) Flipping for motion-based input
US8542186B2 (en) Mobile device with user interaction capability and method of operating same
CN103294366B (en) A kind of screen unlock method and electronic equipment
US20130069883A1 (en) Portable information processing terminal
CN108595002B (en) Information processing method and electronic equipment
CN109144181A (en) Gestures detection is lifted in equipment
US20140176477A1 (en) Input device, input support method, and program
CN104049759A (en) Instruction input and protection method integrating touch screen and behavior sensing
CA2746253A1 (en) Interface adaptation system
US11385784B2 (en) Systems and methods for configuring the user interface of a mobile device
WO2006036069A1 (en) Information processing system and method
CN102937869A (en) Method and device for triggering control command on terminal equipment
CN105487689A (en) Ring mouse and method for operating mobile terminal through same
WO2016131245A1 (en) Method and apparatus for controlling operation of terminal
CN112269471B (en) Intelligent wrist strap equipment and single-hand control method, device, system and storage medium thereof
CN111880715A (en) Method and device for editing virtual control in interface, mobile terminal and storage medium
CN111813280B (en) Display interface control method and device, electronic equipment and readable storage medium
US20230266831A1 (en) Method and device for obtaining user input
CN107809525A (en) Mobile terminal and its control method, storage device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220414

Address after: 518000 Room 204, No. 7, Lane 1, Lingxia garden, district 36, Shanghe community, Xin'an street, Bao'an District, Shenzhen, Guangdong Province

Applicant after: Puchun Technology (Shenzhen) Co.,Ltd.

Address before: 518000 101, 6 Zizhu 6th Road, Futian District, Shenzhen City, Guangdong Province

Applicant before: Guo Shulei

GR01 Patent grant
GR01 Patent grant