CN106527670A - Hand gesture interaction device - Google Patents
Hand gesture interaction device Download PDFInfo
- Publication number
- CN106527670A CN106527670A CN201510567528.1A CN201510567528A CN106527670A CN 106527670 A CN106527670 A CN 106527670A CN 201510567528 A CN201510567528 A CN 201510567528A CN 106527670 A CN106527670 A CN 106527670A
- Authority
- CN
- China
- Prior art keywords
- hand
- module
- gesture
- gesture motion
- motion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention provides a hand gesture interaction device, comprising a radar module, a sensor module, a processor module, a power module, a storage module and a communication module. By use of the characteristics of high speed transmission and high data band width of a 60-GHz millimeter wave, the hand gesture interaction device provided by the embodiment of the invention can accurately measure hand gestures and integrates the gestures into wearable equipment, a user can input and control the equipment without a touch-control pen and a touch-control screen, does not need to additionally mount a camera in the equipment, thus the input efficiency and the user experience are improved; the position of the user can be unrestricted so that the user can carry out high-precision and multifunctional input and control on the equipment under the condition of non-contact or a certain distance.
Description
Technical field
The present invention relates to Internet of Things field, is based especially on the gesture motion interactive device of the wireless radar of 60GHz high frequency millimeter ripples.
Background technology
The practice of technology of Internet of things can trace back to the network cola machine for vending of nineteen ninety Xerox earliest, and with development and various hardware, the extreme enrichment of application software of Internet technology, technology of Internet of things has also obtained great development.Internet of Things is considered the application extension of the Internet, and the essence of Internet of Things is summed up and is mainly reflected in three aspects：One is the Internet feature, i.e., the thing to needing networking must realize the internet for interconnecting；Two is to recognize and communication feature, that is, " thing " for including Internet of Things must possess the function that automatic identification is communicated with thing thing；Three is intelligent feature, i.e., network system should have automatization, self-feedback and Based Intelligent Control the characteristics of.
At present, very many to the concrete applicationization of technology of Internet of things, such as smart home technology manages each system relationship in family by network, is uniformly controlled；Such as car networking technology, associates the vehicle in a region by network again, realizes monitoring, scheduling, tracking etc. application.Put forward many future thrusts at present, it is big such as the wisdom earth, smart city, it is little to wisdom water utilities, wisdom combustion gas etc., it is contemplated that the next generation internet technology with technology of Internet of things as core will greatly change the work and life of people.
The main idea of technology of Internet of things is exactly that thing thing is connected, information mutual communication, and with the rise of intelligent terminal and mobile Internet, the information interface of Internet of Things will become variation, people also become variation in the input mode of control end, from with single input control apparatus, such as mouse or pointer, the capacitance plate touch-control commonly used till now, the also eye tracking of Google's glasses, blink control, caught using photographic head in various motion sensing controls and grab exercise attitudes, and by wearable device in sensor to perceive movement locus etc. mode realizing being input into and control.
But, the input and control method that presently, there are has been increasingly difficult to meet the demand of Internet of Things development, such as traditional mouse or pointer need extra carrying, and the function of realizing is limited；The mode of screen touch-control, is limited the state of the size dimension and touch-control finger of screen, and when having water or perspiration on hand, locating effect is undesirable, and as device miniaturization, the size of screen are limited, is input into and controls to be affected by bigger；Eye tracking, blink control and motion sensing control etc. are required for using special photographic head and image recognition processing, and high cost, discrimination are low；Wearable device motion sensor is relatively low to the accuracy of identification of action, it is impossible to meet the demand of more gesture commands.
Accordingly, it would be desirable to one kind spatially can carry out method, the equipment of fine gesture identification input and control away from input equipment, such as mobile phone or panel computer, household appliances equipment etc..
The content of the invention
The embodiment of the present invention proposes a kind of gesture motion interactive device, including radar module, sensor assembly, processor module, power module, memory module and communication module；The power module offer device power supply；The radar module is used for sending radio wave measurement hand motion signal；The processor module obtains the current gesture motion information of hand and determines its corresponding implication for processing to the hand motion signal；Memory module is used for storage includes the data of default hand motion information and corresponding gesture motion implication, input content and control information；Communication module is sent control information for communicating with the external world including to control object.
Further, millimeter-wave signal of the radio wave that the radar module sends for 60GHz.
Further, the radar module includes pulse radar part and continuous wave radar part, and pulse radar part sends the pulsed radar signal of 60GHz millimeter waves, for determining the distance of hand motion；Continuous wave radar part sends the continuous wave radar signal of 60Ghz millimeter waves, for determining the speed of hand motion.
Further, also including sensor assembly, for obtaining the heat transfer agent of hand exercise state, heat transfer agent includes one or more of temperature, speed, angle, distance, locus, magnetic field intensity, heart beating feature etc..
Further, the heat transfer agent that the sensor assembly is obtained is used for being turned on and off the gesture identification function of described device.
Further, also including vibration module, for sending vibrating alert information.
Further, it is characterised in that described device is arranged to bracelet, the wearable wrist portion in user.
Further, described device is arranged to ring, the wearable finger section in user.
Gesture motion interactive device provided in an embodiment of the present invention, propagated using 60GHz millimeter waves at a high speed, the characteristics of high data bandwidth, accurate measurement can be carried out to the gesture motion of hand, and it is integrated in wearable device, user can depart from pointer and Touch Screen is input into equipment and is controlled, without additionally arranging photographic head in a device, so as to bring up to efficiency and the Consumer's Experience of input, and the position of user can be liberated, user is allowd to carry out higher precision to equipment in the case of noncontact or certain distance, more multi-functional input and control.
Description of the drawings
Fig. 1 shows a kind of gesture motion interactive device structure chart；
Fig. 2 shows a kind of equipment every empty control method flow chart；
Fig. 3 shows the intersection control routine structure chart based on wireless signal；
Fig. 4 shows one kind every ineffective law, rule, etc. character input method flow chart.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, present example is shown in the drawings, although invention will be described in conjunction with the embodiments, it should be appreciated which does not really want to limit the invention to these embodiments.Conversely, this invention is intended to covering the replacement in the spirit and scope that may include to be limited in claims, modification and equivalents.In addition, in described below to the embodiment of the present invention, it is proposed that many details are so that the present invention is thoroughly understood.However, it will be appreciated by those of ordinary skill in the art that not having these details implement the present invention yet.In other examples, for the aspect for unnecessarily obscuring the present invention, known method, process, part and circuit is not described in detail.
Some parts following detailed description of are to represent to propose according to process, step, logical block, process and other symbols to the operation of the data bit that can be performed on computer storage.These descriptions and expression are means in order to the essence of its work most effectively to be conveyed to other technical staff of the field that the technical staff of data processing field is used.Here, the step of process, computer are performed, logical block, process etc. are usually contemplated as the self-consistent sequence of the step of causing expected result or instruction.The step is the step of needing the physical manipulation to physical quantity.Generally, although unnecessary, this tittle is in the form of the electrical or magnetic signal that can be stored in computer systems, transmit, combine, compare or manipulate in addition.It has been proved that primarily to the reason for public use, these signals are referred to as position, value, element, symbol, character, project, numeral etc. sometimes easily.
However, should keep firmly in mind, all these and similar terms should be associated with appropriate physical quantity and only facilitate labelling suitable for this tittle.Unless specifically stated otherwise, otherwise as described below in apparent to, it should be understood that in the whole present invention, term used is discussed, such as " associate " or " identification " or " reproduction " or " needs " or " it is determined that " or " repetition " or " execution " or " detection " or " guiding " etc., refer to action and the process of electronic system or similar electronic computing device, the data manipulation that physics (electronics) measures of being expressed as in its RS by electronic equipment and it is transformed into electronic device memory or depositor or information Store as other, other data for being similarly represented as physical quantity in transmission or display device.
Fig. 1 illustrates the displaying gesture motion interactive device structure chart of various exemplary embodiments of the invention.
Embodiment one, the gesture motion interactive device 120, including radar module 121, processor module 123, power module 124, memory module 125 and communication module 127.
In the present embodiment, gesture motion interactive device 120 can be used to be input into equipment and be controlled, real time distance is carried out to hand using 60GHz millimeter waves and is tested the speed, obtain current gesture information, and compare with default gesture information, it is determined that the corresponding semanteme of current gesture information, input information or control command is generated, it is achieved thereby that being input into equipment using gesture and being controlled.
Radar module 121, for sending the millimeter-wave signal of 60GHz, and receive the 60GHz millimeter-wave signals for reflecting, including pulse radar part and continuous wave radar part, pulse radar part sends the pulsed radar signal of 60GHz millimeter waves, for determining the distance of hand motion；Continuous wave radar part sends the continuous wave radar signal of 60Ghz millimeter waves, for determining the speed of hand motion.
Processor module 123, for processing to signal, is analyzed including the hand motion distance, velocity information obtained to radar module 121, obtains the current gesture motion information of hand.The characteristics of 60GHz millimeter waves have propagation, high data bandwidth at a high speed; can implement to capture hand motion; processor module 123 is modeled reduction to data such as the real-time range of hand motion, speed; simulate the current gesture motion information of hand; and be responsible for according to the current gesture motion information of the hand that calculates of simulation; default gesture motion information matches with memory module 125, determine corresponding gesture motion implication, input content and control information.
Power module 124, provides power supply for device.
Memory module 125, for depositing data, including default hand motion information and corresponding gesture motion implication, input content and control information etc..
Communication module 127, communicated with the external world, control information is sent including to control object, can use includes bluetooth (such as 4.0 standard of bluetooth), iraser, honeycomb, 802.11 WiFi, induction wireless, super wideband wireless, Zigbee, and other known or untapped short and long range wireless communication modes.It is also an option that further include wired communication mode, such as USB (universal serial bus) (USB) or any of various not wired communication modes.
Preferably, gesture motion interactive device 120 is arranged to bracelet, it is wearable in user on hand, the gesture motion of hand is captured.
Preferably, gesture motion interactive device 120 is arranged to ring, can be worn at user on hand, and the gesture motion of hand is captured.
The characteristics of the present embodiment is using the high speed propagation of 60GHz millimeter waves, high data bandwidth, accurate measurement can be carried out to the gesture motion of hand, and it is integrated in wearable device, user can depart from pointer and Touch Screen is input into equipment and is controlled, without additionally arranging photographic head in a device, so as to bring up to efficiency and the Consumer's Experience of input, and the position of user can be liberated, user is allowd to carry out higher precision, more multi-functional input and control in the case of noncontact or certain distance to equipment.
Embodiment two, the gesture motion interactive device 120, including radar module 121, sensor assembly 122, processor module 123, power module 124, memory module 125 and communication module 127.
In the present embodiment, gesture motion interactive device 120 can be used to be input into equipment and be controlled, real time distance is carried out to hand using 60GHz millimeter waves and is tested the speed, obtain current gesture information, and compare with default gesture information, it is determined that the corresponding semanteme of current gesture information, input information or control command is generated, it is achieved thereby that being input into equipment using gesture and being controlled.
Radar module 121, for sending the millimeter-wave signal of 60GHz, and receive the 60GHz millimeter-wave signals for reflecting, including pulse radar part and continuous wave radar part, pulse radar part sends the pulsed radar signal of 60GHz millimeter waves, for determining the distance of hand motion；Continuous wave radar part sends the continuous wave radar signal of 60Ghz millimeter waves, for determining the speed of hand motion.
Sensor assembly 122, for obtaining the heat transfer agent of hand exercise state.Sensor potentially includes one or more gyroscopes (such as three-axis gyroscope), acceleration (such as three axis accelerometer), gaussmeter (such as three axis magnetometer), proximity transducer（Such as range sensor）, electromyography transducer (such as EMG), temperature sensor, global positioning system (GPS) sensor, sensor may also include vision emitter and sensor, such as may detection light vision or infrared band sensor.
Preferred sensor assembly 122 is additionally operable to the gesture motion information for judging whether to need to obtain hand.An embodiment, the hand temperature of temperature sensor detection wearing people, when the temperature of sensor acquisition is more than 35 degrees Celsius, opens and obtain hand gesture action message function, otherwise, close acquisition hand gesture action message function wherein.Wherein in an embodiment, sensor obtains one specific action of wearer to decide whether to be turned on and off obtaining hand gesture action message function, the specific action could be arranged to the circle of circular motion clockwise and represent that unlatching obtains hand gesture action message function, and the circle of counterclockwise circular motion one is represented closes acquisition hand gesture action message function.
Processor module 123, for processing to signal, is analyzed including the hand motion distance, velocity information obtained to radar module 121, obtains the current gesture motion information of hand.The characteristics of 60GHz millimeter waves have propagation, high data bandwidth at a high speed; can implement to capture hand motion; processor module 123 is modeled reduction to data such as the real-time range of hand motion, speed; simulate the current gesture motion information of hand; and be responsible for according to the current gesture motion information of the hand that calculates of simulation; default gesture motion information matches with memory module 125, determine corresponding gesture motion implication, input content and control information.
Power module 124, provides power supply for device.
Memory module 125, for depositing data, including default hand motion information and corresponding gesture motion implication, input content and control information etc..
Communication module 127, communicated with the external world, control information is sent including to control object, can use includes bluetooth (such as 4.0 standard of bluetooth), iraser, honeycomb, 802.11 WiFi, induction wireless, super wideband wireless, Zigbee, and other known or untapped short and long range wireless communication modes.It is also an option that further include wired communication mode, such as USB (universal serial bus) (USB) or any of various not wired communication modes.
Preferably, gesture motion interactive device 120 is arranged to bracelet, it is wearable in user on hand, the gesture motion of hand is captured.
Preferably, gesture motion interactive device 120 is arranged to ring, can be worn at user on hand, and the gesture motion of hand is captured.
The characteristics of the present embodiment is using the high speed propagation of 60GHz millimeter waves, high data bandwidth, accurate measurement can be carried out to the gesture motion of hand, and it is integrated in wearable device, user can depart from pointer and Touch Screen is input into equipment and is controlled, without additionally arranging photographic head in a device, so as to bring up to efficiency and the Consumer's Experience of input, and the position of user can be liberated, user is allowd to carry out higher precision, more multi-functional input and control in the case of noncontact or certain distance to equipment.
Embodiment three, the gesture motion interactive device 120, including radar module 121, sensor assembly 122, processor module 123, power module 124, memory module 125, shock module 126 and communication module 127.
In the present embodiment, gesture motion interactive device 120 can be used to be input into equipment and be controlled, real time distance is carried out to hand using 60GHz millimeter waves and is tested the speed, obtain current gesture information, and compare with default gesture information, it is determined that the corresponding semanteme of current gesture information, input information or control command is generated, it is achieved thereby that being input into equipment using gesture and being controlled.
Radar module 121, for sending the millimeter-wave signal of 60GHz, and receive the 60GHz millimeter-wave signals for reflecting, including pulse radar part and continuous wave radar part, pulse radar part sends the pulsed radar signal of 60GHz millimeter waves, for determining the distance of hand motion；Continuous wave radar part sends the continuous wave radar signal of 60Ghz millimeter waves, for determining the speed of hand motion.
Sensor assembly 122, for obtaining the heat transfer agent of hand exercise state.Sensor potentially includes one or more gyroscopes (such as three-axis gyroscope), acceleration (such as three axis accelerometer), gaussmeter (such as three axis magnetometer), proximity transducer（Such as range sensor）, electromyography transducer (such as EMG), temperature sensor, global positioning system (GPS) sensor, sensor may also include vision emitter and sensor, such as may detection light vision or infrared band sensor.
The sensor information obtained by preferred sensor assembly 122 is additionally operable to the gesture motion information for judging whether to need to obtain hand.An embodiment, the hand temperature of temperature sensor detection wearing people, when the temperature of sensor acquisition is more than 35 degrees Celsius, opens and obtain hand gesture action message function, otherwise, close acquisition hand gesture action message function wherein.Wherein in an embodiment, sensor obtains one specific action of wearer to decide whether to be turned on and off obtaining hand gesture action message function, the specific action could be arranged to the circle of circular motion clockwise and represent that unlatching obtains hand gesture action message function, and the circle of counterclockwise circular motion one is represented closes acquisition hand gesture action message function.
Processor module 123, for processing to signal, is analyzed including the hand motion distance, velocity information obtained to radar module 121, obtains the current gesture motion information of hand.The characteristics of 60GHz millimeter waves have propagation, high data bandwidth at a high speed; can implement to capture hand motion; processor module 123 is modeled reduction to data such as the real-time range of hand motion, speed; simulate the current gesture motion information of hand; and be responsible for according to the current gesture motion information of the hand that calculates of simulation; default gesture motion information matches with memory module 125, determine corresponding gesture motion implication, input content and control information.
Power module 124, provides power supply for device.
Memory module 125, for depositing data, including default hand motion information and corresponding gesture motion implication, input content and control information etc..
Shock module 126, for providing vibration information, it is possible to use cell phone vibrator or other smaller vibrating devices.Wherein in an embodiment, vibration information can produce a kind of vibrating alert user gesture mistake as the identification of gesture device or the feedback of controlled state for example, when gesture None- identified；Or, after user gesture is recognized and completes object control, produce a kind of vibrating alert user and complete operation.
Communication module 127, communicated with the external world, control information is sent including to control object, can use includes bluetooth (such as 4.0 standard of bluetooth), iraser, honeycomb, 802.11 WiFi, induction wireless, super wideband wireless, Zigbee, and other known or untapped short and long range wireless communication modes.It is also an option that further include wired communication mode, such as USB (universal serial bus) (USB) or any of various not wired communication modes.
Preferably, gesture motion interactive device 120 is arranged to bracelet, it is wearable in user on hand, the gesture motion of hand is captured.
Preferably, gesture motion interactive device 120 is arranged to ring, can be worn at user on hand, and the gesture motion of hand is captured.
The characteristics of the present embodiment is using the high speed propagation of 60GHz millimeter waves, high data bandwidth, accurate measurement can be carried out to the gesture motion of hand, and it is integrated in wearable device, user can depart from pointer and Touch Screen is input into equipment and is controlled, without additionally arranging photographic head in a device, so as to bring up to efficiency and the Consumer's Experience of input, and the position of user can be liberated, user is allowd to carry out higher precision, more multi-functional input and control in the case of noncontact or certain distance to equipment.
Fig. 2 illustrates the presentation device of various exemplary embodiments of the invention every empty control method flow chart.
The characteristics of gesture motion interactive device 120 is using the high speed propagation of 60GHz millimeter waves, high data bandwidth, accurate measurement can be carried out to the gesture motion of hand, and it is integrated in wearable device, user can depart from pointer and Touch Screen is input into equipment and is controlled, without additionally arranging photographic head in a device, so as to bring up to efficiency and the Consumer's Experience of input, and the position of user can be liberated, user is allowd to carry out higher precision, more multi-functional input and control in the case of noncontact or certain distance to equipment.
Therefore, equipment includes every empty control method step：
S101, gesture motion interactive device and device pairing.The purpose matched is effectively to be communicated, according to the communication modes between gesture motion interactive device and equipment, can be matched according to existing communication protocol, for example, when equipment is communicated using bluetooth, gesture motion interactive device is matched with which using bluetooth.Wherein in an embodiment, in order that pairing is with more preferable experience effect, gesture motion interactive device can complete the Pairing behavior specified using specific gesture motion, for example gesture motion interactive device is configured to bracelet or ring, after user wears, pointing to finger needs device to be controlled, after gesture motion interactive device identification gesture motion information, performs automatically and the pairing for needing control device.
S102, obtains radar surveying information and/or obtains sensor information.
The radar module 121 of gesture motion interactive device, can send the millimeter-wave signal of 60GHz, and receive the 60GHz millimeter-wave signals for reflecting, i.e. radar surveying information.Radar module 121 includes pulse radar part and continuous wave radar part, and pulse radar part sends the pulsed radar signal of 60GHz millimeter waves, for determining the distance of hand motion；Continuous wave radar part sends the continuous wave radar signal of 60Ghz millimeter waves, for determining the speed of hand motion.
The sensor assembly 122 of gesture motion interactive device, can obtain the heat transfer agent of hand exercise state.Sensor potentially includes one or more gyroscopes (such as three-axis gyroscope), acceleration (such as three axis accelerometer), gaussmeter (such as three axis magnetometer), proximity transducer（Such as range sensor）, electromyography transducer (such as EMG), temperature sensor, global positioning system (GPS) sensor, sensor may also include vision emitter and sensor, such as may detection light vision or infrared band sensor.
The sensor information obtained by preferred sensor assembly 122 is additionally operable to the gesture motion information for judging whether to need to obtain hand.An embodiment, the hand temperature of temperature sensor detection wearing people, when the temperature of sensor acquisition is more than 35 degrees Celsius, opens and obtain hand gesture action message function, otherwise, close acquisition hand gesture action message function wherein.Wherein in an embodiment, sensor obtains one specific action of wearer to decide whether to be turned on and off obtaining hand gesture action message function, the specific action could be arranged to the circle of circular motion clockwise and represent that unlatching obtains hand gesture action message function, and the circle of counterclockwise circular motion one is represented closes acquisition hand gesture action message function.
S103, calculates gesture information.It is analyzed including the hand motion distance, velocity information obtained to radar module 121, obtains the current gesture motion information of hand.60GHz millimeter waves have propagate at a high speed, high data bandwidth the characteristics of, can be implementing capture hand motion, processor module 123 is modeled reduction to data such as the real-time range of hand motion, speed, simulates the current gesture motion information of hand.
S104, obtains operational control instruction, simulates the current gesture motion information of the hand for calculating according to S103, and the default gesture motion information matches with memory module 125 determine corresponding gesture motion implication, input content and control information.
Preferably, when gesture None- identified, gesture motion interactive device produces a kind of vibrating alert user gesture mistake.
S105, sends operational control instruction and performs to equipment.Operational control instruction is sent on the equipment of pairing and is performed by communication module by gesture motion interactive device.
Preferably, after user gesture interactive motion device completes the control to equipment, produce a kind of vibrating alert user and complete operation.
The characteristics of the present embodiment is using the high speed propagation of 60GHz millimeter waves, high data bandwidth, accurate measurement can be carried out to the gesture motion of hand, and it is integrated in wearable device, user can depart from pointer and Touch Screen is input into equipment and is controlled, without additionally arranging photographic head in a device, so as to bring up to efficiency and the Consumer's Experience of input, and the position of user can be liberated, user is allowd to carry out higher precision, more multi-functional input and control in the case of noncontact or certain distance to equipment.
Fig. 3 illustrates intersection control routine structure chart of the displaying of various exemplary embodiments of the invention based on wireless signal.
Intersection control routine, including gesture motion interactive device 120 and equipment 110a, equipment 110b ... ..., equipment 110g, equipment 130a ... ..., equipment 130g etc. one or more.
Embodiment one, the gesture motion interactive device 120, including radar module 121, processor module 123, power module 124, memory module 125 and communication module 127.The equipment include equipment 110a, equipment 110b ... ..., equipment 110g, equipment 130a ... ..., equipment 130g etc. one or more.
In the present embodiment, gesture motion interactive device 120 can be used to be input into equipment and be controlled, real time distance is carried out to hand using 60GHz millimeter waves wireless signal and is tested the speed, obtain current gesture information, and compare with default gesture information, it is determined that the corresponding semanteme of current gesture information, input information or control command is generated, it is achieved thereby that being input into equipment using gesture and being controlled.
Radar module 121, for sending the millimeter wave wireless signal of 60GHz, and receive the 60GHz millimeter wave wireless signals for reflecting, including pulse radar part and continuous wave radar part, pulse radar part sends the pulsed radar signal of 60GHz millimeter waves, for determining the distance of hand motion；Continuous wave radar part sends the continuous wave radar signal of 60Ghz millimeter waves, for determining the speed of hand motion.
Processor module 123, for processing to signal, is analyzed including the hand motion distance, velocity information obtained to radar module 121, obtains the current gesture motion information of hand.The characteristics of 60GHz millimeter waves have propagation, high data bandwidth at a high speed; can implement to capture hand motion; processor module 123 is modeled reduction to data such as the real-time range of hand motion, speed; simulate the current gesture motion information of hand; and be responsible for according to the current gesture motion information of the hand that calculates of simulation; default gesture motion information matches with memory module 125, determine corresponding gesture motion implication, input content and control information.
Power module 124, provides power supply for device.
Memory module 125, for depositing data, including default hand motion information and corresponding gesture motion implication, input content and control information etc..
Communication module 127, communicated with the external world, control information is sent including to control object, can use includes bluetooth (such as 4.0 standard of bluetooth), iraser, honeycomb, 802.11 WiFi, induction wireless, super wideband wireless, Zigbee, and other known or untapped short and long range wireless communication modes.It is also an option that further include wired communication mode, such as USB (universal serial bus) (USB) or any of various not wired communication modes.
Preferably, gesture motion interactive device 120 is arranged to bracelet, it is wearable in user on hand, the gesture motion of hand is captured.
Preferably, gesture motion interactive device 120 is arranged to ring, can be worn at user on hand, and the gesture motion of hand is captured.
The characteristics of the present embodiment is using the high speed propagation of 60GHz millimeter waves, high data bandwidth, accurate measurement can be carried out to the gesture motion of hand, and it is integrated in wearable device, user can depart from pointer and Touch Screen is input into equipment and is controlled, without additionally arranging photographic head in a device, so as to bring up to efficiency and the Consumer's Experience of input, and the position of user can be liberated, user is allowd to carry out higher precision, more multi-functional input and control in the case of noncontact or certain distance to equipment.
Embodiment two, the gesture motion interactive device 120, including radar module 121, sensor assembly 122, processor module 123, power module 124, memory module 125 and communication module 127.The equipment include equipment 110a, equipment 110b ... ..., equipment 110g, equipment 130a ... ..., equipment 130g etc. one or more.
In the present embodiment, gesture motion interactive device 120 can be used to be input into equipment and be controlled, real time distance is carried out to hand using 60GHz millimeter waves and is tested the speed, obtain current gesture information, and compare with default gesture information, it is determined that the corresponding semanteme of current gesture information, input information or control command is generated, it is achieved thereby that being input into equipment using gesture and being controlled.
Radar module 121, for sending the millimeter-wave signal of 60GHz, and receive the 60GHz millimeter-wave signals for reflecting, including pulse radar part and continuous wave radar part, pulse radar part sends the pulsed radar signal of 60GHz millimeter waves, for determining the distance of hand motion；Continuous wave radar part sends the continuous wave radar signal of 60Ghz millimeter waves, for determining the speed of hand motion.
Sensor assembly 122, for obtaining the heat transfer agent of hand exercise state.Sensor potentially includes one or more gyroscopes (such as three-axis gyroscope), acceleration (such as three axis accelerometer), gaussmeter (such as three axis magnetometer), proximity transducer（Such as range sensor）, electromyography transducer (such as EMG), temperature sensor, global positioning system (GPS) sensor, sensor may also include vision emitter and sensor, such as may detection light vision or infrared band sensor.
Preferred sensor assembly 122 is additionally operable to the gesture motion information for judging whether to need to obtain hand.An embodiment, the hand temperature of temperature sensor detection wearing people, when the temperature of sensor acquisition is more than 35 degrees Celsius, opens and obtain hand gesture action message function, otherwise, close acquisition hand gesture action message function wherein.Wherein in an embodiment, sensor obtains one specific action of wearer to decide whether to be turned on and off obtaining hand gesture action message function, the specific action could be arranged to the circle of circular motion clockwise and represent that unlatching obtains hand gesture action message function, and the circle of counterclockwise circular motion one is represented closes acquisition hand gesture action message function.
Processor module 123, for processing to signal, is analyzed including the hand motion distance, velocity information obtained to radar module 121, obtains the current gesture motion information of hand.The characteristics of 60GHz millimeter waves have propagation, high data bandwidth at a high speed; can implement to capture hand motion; processor module 123 is modeled reduction to data such as the real-time range of hand motion, speed; simulate the current gesture motion information of hand; and be responsible for according to the current gesture motion information of the hand that calculates of simulation; default gesture motion information matches with memory module 125, determine corresponding gesture motion implication, input content and control information.
Power module 124, provides power supply for device.
Memory module 125, for depositing data, including default hand motion information and corresponding gesture motion implication, input content and control information etc..
Communication module 127, communicated with the external world, control information is sent including to control object, can use includes bluetooth (such as 4.0 standard of bluetooth), iraser, honeycomb, 802.11 WiFi, induction wireless, super wideband wireless, Zigbee, and other known or untapped short and long range wireless communication modes.It is also an option that further include wired communication mode, such as USB (universal serial bus) (USB) or any of various not wired communication modes.
Preferably, gesture motion interactive device 120 is arranged to bracelet, it is wearable in user on hand, the gesture motion of hand is captured.
Preferably, gesture motion interactive device 120 is arranged to ring, can be worn at user on hand, and the gesture motion of hand is captured.
The characteristics of the present embodiment is using the high speed propagation of 60GHz millimeter waves, high data bandwidth, accurate measurement can be carried out to the gesture motion of hand, and it is integrated in wearable device, user can depart from pointer and Touch Screen is input into equipment and is controlled, without additionally arranging photographic head in a device, so as to bring up to efficiency and the Consumer's Experience of input, and the position of user can be liberated, user is allowd to carry out higher precision, more multi-functional input and control in the case of noncontact or certain distance to equipment.
Embodiment three, the gesture motion interactive device 120, including radar module 121, sensor assembly 122, processor module 123, power module 124, memory module 125, shock module 126 and communication module 127.The equipment include equipment 110a, equipment 110b ... ..., equipment 110g, equipment 130a ... ..., equipment 130g etc. one or more.
In the present embodiment, gesture motion interactive device 120 can be used to be input into equipment and be controlled, real time distance is carried out to hand using 60GHz millimeter waves and is tested the speed, obtain current gesture information, and compare with default gesture information, it is determined that the corresponding semanteme of current gesture information, input information or control command is generated, it is achieved thereby that being input into equipment using gesture and being controlled.
Radar module 121, for sending the millimeter-wave signal of 60GHz, and receive the 60GHz millimeter-wave signals for reflecting, including pulse radar part and continuous wave radar part, pulse radar part sends the pulsed radar signal of 60GHz millimeter waves, for determining the distance of hand motion；Continuous wave radar part sends the continuous wave radar signal of 60Ghz millimeter waves, for determining the speed of hand motion.
Sensor assembly 122, for obtaining the heat transfer agent of hand exercise state.Sensor potentially includes one or more gyroscopes (such as three-axis gyroscope), acceleration (such as three axis accelerometer), gaussmeter (such as three axis magnetometer), proximity transducer（Such as range sensor）, electromyography transducer (such as EMG), temperature sensor, global positioning system (GPS) sensor, sensor may also include vision emitter and sensor, such as may detection light vision or infrared band sensor.
The sensor information obtained by preferred sensor assembly 122 is additionally operable to the gesture motion information for judging whether to need to obtain hand.An embodiment, the hand temperature of temperature sensor detection wearing people, when the temperature of sensor acquisition is more than 35 degrees Celsius, opens and obtain hand gesture action message function, otherwise, close acquisition hand gesture action message function wherein.Wherein in an embodiment, sensor obtains one specific action of wearer to decide whether to be turned on and off obtaining hand gesture action message function, the specific action could be arranged to the circle of circular motion clockwise and represent that unlatching obtains hand gesture action message function, and the circle of counterclockwise circular motion one is represented closes acquisition hand gesture action message function.
Processor module 123, for processing to signal, is analyzed including the hand motion distance, velocity information obtained to radar module 121, obtains the current gesture motion information of hand.The characteristics of 60GHz millimeter waves have propagation, high data bandwidth at a high speed; can implement to capture hand motion; processor module 123 is modeled reduction to data such as the real-time range of hand motion, speed; simulate the current gesture motion information of hand; and be responsible for according to the current gesture motion information of the hand that calculates of simulation; default gesture motion information matches with memory module 125, determine corresponding gesture motion implication, input content and control information.
Power module 124, provides power supply for device.
Memory module 125, for depositing data, including default hand motion information and corresponding gesture motion implication, input content and control information etc..
Shock module 126, for providing vibration information, it is possible to use cell phone vibrator or other smaller vibrating devices.Wherein in an embodiment, vibration information can produce a kind of vibrating alert user gesture mistake as the identification of gesture device or the feedback of controlled state for example, when gesture None- identified；Or, after user gesture is recognized and completes object control, produce a kind of vibrating alert user and complete operation.
Communication module 127, communicated with the external world, control information is sent including to control object, can use includes bluetooth (such as 4.0 standard of bluetooth), iraser, honeycomb, 802.11 WiFi, induction wireless, super wideband wireless, Zigbee, and other known or untapped short and long range wireless communication modes.It is also an option that further include wired communication mode, such as USB (universal serial bus) (USB) or any of various not wired communication modes.
Preferably, gesture motion interactive device 120 is arranged to bracelet, it is wearable in user on hand, the gesture motion of hand is captured.
Preferably, gesture motion interactive device 120 is arranged to ring, can be worn at user on hand, and the gesture motion of hand is captured.
The characteristics of the present embodiment is using the high speed propagation of 60GHz millimeter waves, high data bandwidth, accurate measurement can be carried out to the gesture motion of hand, and it is integrated in wearable device, user can depart from pointer and Touch Screen is input into equipment and is controlled, without additionally arranging photographic head in a device, so as to bring up to efficiency and the Consumer's Experience of input, and the position of user can be liberated, user is allowd to carry out higher precision, more multi-functional input and control in the case of noncontact or certain distance to equipment
Fig. 4 illustrates displaying one kind of various exemplary embodiments of the invention every ineffective law, rule, etc. character input method flow chart.
The characteristics of gesture motion interactive device 120 is using the high speed propagation of 60GHz millimeter waves, high data bandwidth, accurate measurement can be carried out to the gesture motion of hand, and it is integrated in wearable device, user can depart from pointer and Touch Screen is input into equipment and is controlled, without additionally arranging photographic head in a device, so as to bring up to efficiency and the Consumer's Experience of input, and the position of user can be liberated, user is allowd to carry out higher precision, more multi-functional input and control in the case of noncontact or certain distance to equipment.
Therefore, included every ineffective law, rule, etc. character input method step based on gesture identification：
S201, gesture motion interactive device and device pairing.The purpose matched is effectively to be communicated, according to the communication modes between gesture motion interactive device and equipment, can be matched according to existing communication protocol, for example, when equipment is communicated using bluetooth, gesture motion interactive device is matched with which using bluetooth.Wherein in an embodiment, in order that pairing is with more preferable experience effect, gesture motion interactive device can complete the Pairing behavior specified using specific gesture motion, for example gesture motion interactive device is configured to bracelet or ring, after user wears, pointing to finger needs device to be controlled, after gesture motion interactive device identification gesture motion information, performs automatically and the pairing for needing control device.
S202, obtains sensor information and obtains radar surveying information.
The sensor assembly 122 of gesture motion interactive device, can obtain the heat transfer agent of hand exercise state.Sensor potentially includes one or more gyroscopes (such as three-axis gyroscope), acceleration (such as three axis accelerometer), gaussmeter (such as three axis magnetometer), proximity transducer（Such as range sensor）, electromyography transducer (such as EMG), temperature sensor, global positioning system (GPS) sensor, sensor may also include vision emitter and sensor, such as may detection light vision or infrared band sensor.
The sensor information obtained by preferred sensor assembly 122 is additionally operable to the gesture motion information for judging whether to need to obtain hand.An embodiment, the hand temperature of temperature sensor detection wearing people, when the temperature of sensor acquisition is more than 35 degrees Celsius, opens and obtain hand gesture action message function, otherwise, close acquisition hand gesture action message function wherein.Wherein in an embodiment, sensor obtains one specific action of wearer to decide whether to be turned on and off obtaining hand gesture action message function, the specific action could be arranged to the circle of circular motion clockwise and represent that unlatching obtains hand gesture action message function, and the circle of counterclockwise circular motion one is represented closes acquisition hand gesture action message function.
The radar module 121 of gesture motion interactive device, can send the millimeter-wave signal of 60GHz, and receive the 60GHz millimeter-wave signals for reflecting, i.e. radar surveying information.Radar module 121 includes pulse radar part and continuous wave radar part, and pulse radar part sends the pulsed radar signal of 60GHz millimeter waves, for determining the distance of hand motion；Continuous wave radar part sends the continuous wave radar signal of 60Ghz millimeter waves, for determining the speed of hand motion.
S203, calculates gesture information.It is analyzed including the hand motion distance, velocity information obtained to radar module 121, obtains the current gesture motion information of hand.60GHz millimeter waves have propagate at a high speed, high data bandwidth the characteristics of, can be implementing capture hand motion, processor module 123 is modeled reduction to data such as the real-time range of hand motion, speed, simulates the current gesture motion information of hand.
S204, obtains input word content, simulates the current gesture motion information of the hand for calculating according to S103, carries out track identification, and identify the corresponding word content of gesture motion information by recognizer.
Preferably, when gesture None- identified, gesture motion interactive device produces a kind of vibrating alert user gesture mistake.
S205, confirms the word of input.The word content for identifying is shown on equipment, and user confirms and is input into.
The characteristics of the present embodiment is using the high speed propagation of 60GHz millimeter waves, high data bandwidth, accurate measurement can be carried out to the gesture motion of hand, and it is integrated in wearable device, user can depart from pointer and Touch Screen is input into equipment and is controlled, without additionally arranging photographic head in a device, so as to bring up to efficiency and the Consumer's Experience of input, and the position of user can be liberated, user is allowd to carry out higher precision, more multi-functional input and control in the case of noncontact or certain distance to equipment.
The above is the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; some improvements and modifications can also be made, these improvements and modifications are also considered as protection scope of the present invention.
Claims (8)
1. a kind of gesture motion interactive device, it is characterised in that including radar module, sensor assembly, processor module, power module, memory module and communication module；The power module offer device power supply；The radar module is used for sending radio wave measurement hand motion signal；The processor module obtains the current gesture motion information of hand and determines its corresponding implication for processing to the hand motion signal；Memory module is used for storage includes the data of default hand motion information and corresponding gesture motion implication, input content and control information；Communication module is sent control information for communicating with the external world including to control object.
2. gesture motion interactive device as claimed in claim 1, it is characterised in that millimeter-wave signal of the radio wave that the radar module sends for 60GHz.
3. gesture motion interactive device as claimed in claim 1, it is characterised in that the radar module includes pulse radar part and continuous wave radar part, and pulse radar part sends the pulsed radar signal of 60GHz millimeter waves, for determining the distance of hand motion；Continuous wave radar part sends the continuous wave radar signal of 60Ghz millimeter waves, for determining the speed of hand motion.
4. gesture motion interactive device as claimed in claim 1, it is characterized in that, also include sensor assembly, for obtaining the heat transfer agent of hand exercise state, heat transfer agent includes one or more of temperature, speed, angle, distance, locus, magnetic field intensity, heart beating feature etc..
5. gesture motion interactive device as claimed in claim 4, it is characterised in that the heat transfer agent that the sensor assembly is obtained is used for being turned on and off the gesture identification function of described device.
6. gesture motion interactive device as claimed in claim 1, it is characterised in that also including vibration module, for sending vibrating alert information.
7. the gesture motion interactive device as described in any one in claim 1-6, it is characterised in that described device is arranged to bracelet, the wearable wrist portion in user.
8. the gesture motion interactive device as described in any one in claim 1-6, it is characterised in that described device is arranged to ring, the wearable finger section in user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510567528.1A CN106527670A (en) | 2015-09-09 | 2015-09-09 | Hand gesture interaction device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510567528.1A CN106527670A (en) | 2015-09-09 | 2015-09-09 | Hand gesture interaction device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106527670A true CN106527670A (en) | 2017-03-22 |
Family
ID=58345542
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510567528.1A Pending CN106527670A (en) | 2015-09-09 | 2015-09-09 | Hand gesture interaction device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106527670A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107015645A (en) * | 2017-03-24 | 2017-08-04 | 广州幻境科技有限公司 | A kind of character input method based on gesture |
| CN107132913A (en) * | 2017-03-31 | 2017-09-05 | 南京理工大学 | A kind of multi-user's man-machine interaction method based on millimeter wave |
| CN107967058A (en) * | 2017-12-07 | 2018-04-27 | 联想(北京)有限公司 | Information processing method, electronic equipment and computer-readable recording medium |
| CN108008819A (en) * | 2017-12-12 | 2018-05-08 | 上海爱优威软件开发有限公司 | A kind of page map method and terminal device easy to user's one-handed performance |
| CN108632411A (en) * | 2018-05-11 | 2018-10-09 | Oppo广东移动通信有限公司 | Electronic device |
| CN108828973A (en) * | 2018-07-18 | 2018-11-16 | 常州轻工职业技术学院 | The intelligent electric appliance control system of gesture identification based on computer control |
| WO2019000193A1 (en) * | 2017-06-26 | 2019-01-03 | 国民技术股份有限公司 | Wearable device operating method and wearable device |
| CN109164915A (en) * | 2018-08-17 | 2019-01-08 | 湖南时变通讯科技有限公司 | A kind of gesture identification method, device, system and equipment |
| WO2019165972A1 (en) * | 2018-02-28 | 2019-09-06 | Chan Russell Wade | Wearable gesture recognition device and associated operation method and system |
| CN110908499A (en) * | 2018-09-18 | 2020-03-24 | 西安中兴新软件有限责任公司 | 3D image display method and device and terminal |
| CN111537988A (en) * | 2020-03-31 | 2020-08-14 | 北京小米移动软件有限公司 | Role control method, role control device, and computer-readable storage medium |
| CN116279237A (en) * | 2023-02-21 | 2023-06-23 | 惠州市科宇汽车精密配件有限公司 | Vehicle-mounted non-contact switch control system and control method thereof |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103179359A (en) * | 2011-12-21 | 2013-06-26 | 北京新岸线移动多媒体技术有限公司 | Method and device for controlling video terminal and video terminal |
| CN103324277A (en) * | 2012-03-22 | 2013-09-25 | 扬州永利宁科技有限公司 | Touch free user input recognition |
| CN103455144A (en) * | 2013-08-22 | 2013-12-18 | 深圳先进技术研究院 | Vehicle-mounted man-machine interaction system and method |
| CN103502911A (en) * | 2011-05-06 | 2014-01-08 | 诺基亚公司 | Gesture recognition using plural sensors |
| US20140324888A1 (en) * | 2011-12-09 | 2014-10-30 | Nokia Corporation | Method and Apparatus for Identifying a Gesture Based Upon Fusion of Multiple Sensor Signals |
-
2015
- 2015-09-09 CN CN201510567528.1A patent/CN106527670A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103502911A (en) * | 2011-05-06 | 2014-01-08 | 诺基亚公司 | Gesture recognition using plural sensors |
| US20140324888A1 (en) * | 2011-12-09 | 2014-10-30 | Nokia Corporation | Method and Apparatus for Identifying a Gesture Based Upon Fusion of Multiple Sensor Signals |
| CN103179359A (en) * | 2011-12-21 | 2013-06-26 | 北京新岸线移动多媒体技术有限公司 | Method and device for controlling video terminal and video terminal |
| CN103324277A (en) * | 2012-03-22 | 2013-09-25 | 扬州永利宁科技有限公司 | Touch free user input recognition |
| CN103455144A (en) * | 2013-08-22 | 2013-12-18 | 深圳先进技术研究院 | Vehicle-mounted man-machine interaction system and method |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107015645A (en) * | 2017-03-24 | 2017-08-04 | 广州幻境科技有限公司 | A kind of character input method based on gesture |
| CN107132913A (en) * | 2017-03-31 | 2017-09-05 | 南京理工大学 | A kind of multi-user's man-machine interaction method based on millimeter wave |
| WO2019000193A1 (en) * | 2017-06-26 | 2019-01-03 | 国民技术股份有限公司 | Wearable device operating method and wearable device |
| CN107967058A (en) * | 2017-12-07 | 2018-04-27 | 联想(北京)有限公司 | Information processing method, electronic equipment and computer-readable recording medium |
| CN107967058B (en) * | 2017-12-07 | 2021-04-13 | 联想(北京)有限公司 | Information processing method, electronic device, and computer-readable storage medium |
| CN108008819A (en) * | 2017-12-12 | 2018-05-08 | 上海爱优威软件开发有限公司 | A kind of page map method and terminal device easy to user's one-handed performance |
| WO2019165972A1 (en) * | 2018-02-28 | 2019-09-06 | Chan Russell Wade | Wearable gesture recognition device and associated operation method and system |
| US11705748B2 (en) | 2018-02-28 | 2023-07-18 | Russell Wade Chan | Wearable gesture recognition device for medical screening and associated operation method and system |
| CN108632411A (en) * | 2018-05-11 | 2018-10-09 | Oppo广东移动通信有限公司 | Electronic device |
| CN108828973A (en) * | 2018-07-18 | 2018-11-16 | 常州轻工职业技术学院 | The intelligent electric appliance control system of gesture identification based on computer control |
| CN109164915A (en) * | 2018-08-17 | 2019-01-08 | 湖南时变通讯科技有限公司 | A kind of gesture identification method, device, system and equipment |
| CN110908499A (en) * | 2018-09-18 | 2020-03-24 | 西安中兴新软件有限责任公司 | 3D image display method and device and terminal |
| CN111537988A (en) * | 2020-03-31 | 2020-08-14 | 北京小米移动软件有限公司 | Role control method, role control device, and computer-readable storage medium |
| CN116279237A (en) * | 2023-02-21 | 2023-06-23 | 惠州市科宇汽车精密配件有限公司 | Vehicle-mounted non-contact switch control system and control method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106527670A (en) | Hand gesture interaction device | |
| CN106527671A (en) | Method for spaced control of equipment | |
| EP2990912B1 (en) | Force simulation using orthogonal uniform magnetic field | |
| US10139914B2 (en) | Methods and apparatus for using the human body as an input device | |
| US10814220B2 (en) | Method for controlling display of electronic device using multiple controllers and device for the same | |
| CN108027650A (en) | For measuring the method for the angle between display and the electronic equipment using this method | |
| CN106527672A (en) | Non-contact type character input method | |
| CN106527669A (en) | Interaction control system based on wireless signal | |
| US10911818B2 (en) | Electronic device and method for controlling the same | |
| CN105388994A (en) | Wearable watch and display method thereof | |
| CN107272892B (en) | Virtual touch system, method and device | |
| CN108415675B (en) | Information processing apparatus, information processing system, and information processing method | |
| CN104298340A (en) | Control method and electronic equipment | |
| CN111177137B (en) | Method, device, equipment and storage medium for data deduplication | |
| KR101678292B1 (en) | METHOD, SYSTEM AND COMPUTER-READABLE RECORDING MEDIUM FOR CONTROLLING IoT(Internet of Things) DEVICE USING A WEARABLE DEVICE | |
| CN104238900B (en) | A kind of page positioning method and device | |
| CN106355061A (en) | Gesture authentication device based on millimeter waves | |
| CN104406601A (en) | Navigation method, sending terminal and reception terminal | |
| KR20150092962A (en) | Method for processing data and an electronic device thereof | |
| KR20170057993A (en) | Apparatus and method for tracking position thereof | |
| CN106339618A (en) | Authentication method based on gestures | |
| CN108829329B (en) | Operation object display method and device and readable medium | |
| CN103970291A (en) | Mobile terminal | |
| CN112365088B (en) | Method, device and equipment for determining travel key points and readable storage medium | |
| CN116079703A (en) | Robot teaching method, apparatus, device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170322 |