CN108874142A - A kind of Wireless intelligent control device and its control method based on gesture - Google Patents
A kind of Wireless intelligent control device and its control method based on gesture Download PDFInfo
- Publication number
- CN108874142A CN108874142A CN201810666579.3A CN201810666579A CN108874142A CN 108874142 A CN108874142 A CN 108874142A CN 201810666579 A CN201810666579 A CN 201810666579A CN 108874142 A CN108874142 A CN 108874142A
- Authority
- CN
- China
- Prior art keywords
- gesture
- control
- terminal
- information
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Selective Calling Equipment (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention proposes a kind of Wireless intelligent control device and its control method based on gesture, including image information acquisition device, central control unit, first communication device, at least one secondary communication device, at least one terminal control mechanism and at least one terminal device.By the present invention in that the direct capture to use gesture, eliminates the dependence to external equipment, it can control in the larger context, by specific gesture and not interfere with and conflict mutually between the multiple functions of multiple electric appliances and each function.The present invention does not rely on network simultaneously, and cell phone application is not relied on.
Description
Technical field
The invention belongs to technical field of hand gesture recognition, more particularly to a kind of Wireless intelligent control device based on gesture and
Its control method.
Background technique
The current application direction of wireless control technology is extensive, applies in military affairs, industry, agricultural, the neck such as commercially and civilian
Domain.The advantages of wireless control technology is using wireless remote control device, using advanced electronic equipment and wireless communication technique, into
The control of row distal end.This control mode possesses the wiring at the scene of reduction, and save the cost is easy to the advantages that expanding.
Wireless control technology has nearly low-power consumption short range transmission in transmission, the different transmission mode such as remote transmission,
By different communication protocol and different carrying hardware, there are different communication characteristics to realize different application scene
Wireless communication.Such as Bluetooth transmission, Infrared Transmission, zigbee transmission, and NB-IOT relatively popular at present, LoRa etc..
Most of control mode of controller based on wireless transmission relies on touch-tone controller and touch screen control
The equipment such as device.
The advantages of gesture control is an emerging control technology, gesture control be can by non-contacting mode,
Traditional entity controller is substituted, is exported using the order that the scheme of camera sensing device captures user, by combining artificial intelligence
The image algorithm analysis gesture output of energy is to generate control command.The relevant programme of gesture control has dependent on electromagnetic field, thunder
Up to the control program in the near fields such as wave, ultrasonic wave；Pass through depth transducer（Structure light, ToF（Flight time）, Stereo（Binocular））
Control program；Based on monocular sensor（RGB, gray scale）Control program；Controlling party based on the first-class sensor of infrared photography
Case.
Million king of bear proposes《Gestural control method and system》, a kind of near field capture apparatus has been used, computer point is passed through
The image of analysis processing hand and the aspect of finger obtain gesture.University of Electronic Science and Technology proposes《One kind being used for smart home system
The 3D dynamic gesture identification method of system》, Kinect depth camera has been used, has carried out gesture knowledge by technologies such as recognitions of face
Not.NexHome has used the transmission mode of WiFi and the control mode of intelligence APP to realize wisdom building and wisdom family
Wireless control solution.The capture apparatus that a near field has been used in the method for million king of bear, greatly limits gesture in this way
The advantage of control, reduces command range.In the method that University of Electronic Science and Technology proposes, hand is carried out using Kinect depth camera
The identification of gesture, for cost of this method first on camera with regard to relatively high, the recognition methods simultaneously for gesture is fairly simple,
It is not able to satisfy while controlling the mode of multiple smart homes.Control mode is too simple, will cause very high false recognition rate.Simultaneously
The horizontal view angle of single Kinect camera is limited, only 57 degree, can only capture the movement in smaller range.The side of NexHome
In case, hand-held or fixed controller is relied on, when controlling for equipment, needs the connection of network, by controller, service
Device is attached with the equipment operated is needed, and is then just able to achieve control function.
Summary of the invention
The present invention proposes a kind of Wireless intelligent control device based on gesture and its control to solve existing technical problem
Method processed.By the present invention in that the direct capture to use gesture, eliminates the dependence to external equipment, it can be in biggish range
It is interior, by specific gesture, controls and do not interfere with and conflict mutually between the multiple functions of multiple electric appliances and each function.Together
When the present invention network is not relied on, cell phone application is not relied on.
The purpose of the present invention is achieved through the following technical solutions：A kind of Wireless intelligent control device based on gesture, including
Image information acquisition device, central control unit, first communication device, at least one secondary communication device, at least one terminal
Control device and at least one terminal device；Described image information acquisition device is connect with central control unit, the center control
Device processed is connect by USB serial ports with first communication device, the first communication device and each secondary communication device channel radio
Letter, each secondary communication device pass through UART interface and connect with corresponding terminal control mechanism, each terminal control
Device processed is connected with corresponding terminal device；Gesture letter of the described image information acquisition device for acquisition movement promoter
Breath；The central control unit is obtained corresponding for the gesture information obtained in real time to be read out and analyzed by analysis
The control command is transferred to terminal control mechanism by first communication device and secondary communication device by gesture control order；
The terminal control mechanism is used for the decoding of gesture control command and operating terminal equipment executes, while by the execution of control command
State feeds back to central control unit.
Further, described image information acquisition device includes big visual field short focus monocular gray scale camera and small field of view focal length
Monocular gray scale camera；The big visual field short focus monocular gray scale camera arrives entire scene capture for the capture to panorama
In picture, carry out location action promoter to be analyzed entire picture；The small field of view focal length monocular gray scale camera is used
In the partial gesture action message of capturing motion promoter.
Further, described image information acquisition device further includes infrared light supplementing device and double freedom platform；It is described infrared
Light aid is used in the case that natural light is insufficient, and infrared light supplementing device automatically opens, small field of view focal length monocular gray scale camera
Reflection light of the infrared light supplementing device on object is received, the gray level image information of gesture motion is captured；The small field of view focal length list
Mesh gray scale camera is carried by double freedom platform, the double freedom platform it is horizontal in vertical two freedom degrees respectively into
Row 180 degree and 90 degree of rotation, so as to capture the gesture motion information of any position.
The present invention also proposes that the control method of Wireless intelligent control device described in one kind, the control method include image
Acquisition stage, Image Information Processing stage and gesture command processing stage；Described image obtains stage correspondence image and obtains state,
Described image signal processing stages correspondence image information processing state, the gesture command processing stage correspond to gesture command processing
State；
Described image obtains the stage by big visual field short focus monocular gray scale camera acquisition panoramic picture, gives by USB transmission
Entreat control device to carry out the information processing of panoramic picture, by the processing result of panorama image information call double freedom platform into
Row rotation, to obtain the real-time image information comprising dynamic gesture by small field of view focal length monocular gray scale camera；By obtaining
Activation gesture is taken, the state of the Wireless intelligent control device is converted into Image Information Processing state；There is no activation
In the case where gesture, the Wireless intelligent control device is still within image acquireing state；
Described image signal processing stages obtain real time data by small field of view focal length monocular gray scale camera, by analyzing image
In static gesture and dynamic gesture, the control command information that is exported by gesture of acquisition movement promoter；If had
The gesture of effect, control device will transition to gesture command processing status；If not obtaining complete gesture, control device continues to locate
In Image Information Processing state；If control device does not obtain effective gesture, image acquireing state will transition to；
The gesture command processing stage, the central control unit and terminal control mechanism collaborative work controlling terminal equipment are complete
At function corresponding with gesture control order, and the operating status of terminal device and the information of order performance are recorded, it is complete
It will transition to image acquireing state at Wireless intelligent control device described after whole process.
Further, the described image acquisition stage is specially：The Wireless intelligent control device described first is obtained by USB interface
The image information for taking panorama carries out panoramic picture the extraction and processing of information, by posture analysis, finds and issues activation
The promoter position of movement is calculated by the scale for acting promoter to activation, finds the position of user's hand, confirmation sense
Interest region ROI, spatially by position calculating action promoter hand of the region of interest ROI in panoramic picture
Position, double freedom platform is adjusted by the information of spatial position, makes the horizontal direction and vertical direction of double freedom platform
It is adjusted to that the small field of view focal length monocular gray scale camera carried is made to capture calculated region of interest ROI, to start to obtain
Take the real-time image information of gesture.
Further, described image signal processing stages are specially：By the algorithm of image procossing to the real-time figure of gesture
As being calculated, acquisition acts the static gesture and dynamic gesture of promoter, and the static gesture is one and clenches fist and palm
Combined sequence, the combined composition are to stretch out the five fingers, then clench fist, then stretch out the five fingers again；Work as Wireless intelligent control device
Successful prompt tone will be provided after the combined sequence and starts the analysis of dynamic gesture by identifying；If in the combined sequence
There is a link failure, Wireless intelligent control device will issue miscue sound and start waiting activation sequence again；It is described dynamic
State gesture is that movement promoter's stretching the five fingers draw a track in the sky, and Wireless intelligent control device can track and identify institute
Track is stated, then judges whether the dynamic gesture successfully matches with the template in Wireless intelligent control device according to track；Extremely
This is a complete gesture identification process.
Further, the dynamic gesture defines an operation by two gesture combinations, and first gesture selection needs
The terminal device to be controlled, the function for the terminal device that second gesture selection needs to control.
Further, the gesture command processing stage is specially：The gesture control generated by the Image Information Processing stage
Command information triggers gesture command processing status, and the gesture control command information can be according to logical by central control unit analysis
The format of letter agreement is encoded, and reaches terminal control mechanism, the terminal control by wireless transmission by the data packet of coding
Device processed again decodes the gesture control command information according to communication protocol, is then passed to terminal device, and terminal is set
The information of standby operating status and instruction performance returns in central control unit.
Beneficial effects of the present invention are：
1, traditional equipment is got rid of to need hand-held or find the defect that physical button remote controler carries out wireless control.
2, low-power wireless control method saves the project amount of wiring and optimizes the expansion of system.
3, compared with the gesture control scheme based on depth transducer, the cost of system is reduced.
4, it solves in the control program based on fixed angle sensor, the too small problem of control range.
5, it can be operated in the bad environment of illumination condition and the environment of dark.
6, the auxiliary of the wearable devices such as gloves is not needed to complete the identification of gesture.
Detailed description of the invention
Fig. 1 is a kind of Wireless intelligent control device structure chart based on gesture；
Fig. 2 is image information acquisition device schematic diagram；
Fig. 3 is the state transition graph of the Wireless intelligent control device based on gesture；
Fig. 4 is image capture flow figure；
Fig. 5 is Image Information Processing flow chart；
Fig. 6 is intelligent home control device structure chart of the specific embodiment of the invention based on gesture.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention is clearly and completely retouched
It states, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Based on the present invention
In embodiment, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall within the protection scope of the present invention.
In conjunction with Fig. 1-Fig. 5, the present invention proposes a kind of Wireless intelligent control device based on gesture, including image information acquisition
Device, central control unit, first communication device, at least one secondary communication device, at least one terminal control mechanism and extremely
A few terminal device；Described image information acquisition device is connect with central control unit, and the central control unit passes through USB
Serial ports is connect with first communication device, and the first communication device and each secondary communication device wirelessly communicate, and each described the
Two communication devices pass through UART interface and connect with corresponding terminal control mechanism, and each terminal control mechanism is and accordingly
Terminal device connection；Gesture information of the described image information acquisition device for acquisition movement promoter；The center control
Device obtains corresponding gesture control order for the gesture information obtained in real time to be read out and analyzed, by analysis, will
The control command is transferred to terminal control mechanism by first communication device and secondary communication device；The terminal control mechanism
It is executed for decoding simultaneously operating terminal equipment to gesture control command, while the execution state of control command is fed back into central control
Device processed.
Described image information acquisition device includes big visual field short focus monocular gray scale camera and small field of view focal length monocular gray scale
Camera；The big visual field short focus monocular gray scale camera is for the capture to panorama, by entire scene capture into picture, from
And entire picture is analyzed and carrys out location action promoter；The small field of view focal length monocular gray scale camera is used for capturing motion
The partial gesture action message of promoter.The advantages of using small field of view focal length monocular gray scale camera is raising hand to greatest extent
Area ratio of the portion in whole image, so as to the more accurate information for extracting gesture, reach one it is high-precision
Identification, processing index.
Described image information acquisition device further includes infrared light supplementing device and double freedom platform；The infrared light supplementing device is used for
There is no the indoor environment of light in the case that natural light is insufficient, such as when cloudy day and night, infrared light supplementing device automatically opens,
Small field of view focal length monocular gray scale camera receives reflection light of the infrared light supplementing device on object, captures the grayscale image of gesture motion
As information；The small field of view focal length monocular gray scale camera is carried by double freedom platform, and the double freedom platform is in level
With the rotation for carrying out 180 degree Yu 90 degree in vertical two freedom degrees respectively, in the center alignment range so as to make camera
Any point achievees the purpose that the gesture information for capturing any position.Big visual field short focus monocular gray scale camera and neglect head
Burnt monocular gray scale camera is connect by independent USB line with central control unit respectively.
As shown in Fig. 2, Fig. 2 is image information acquisition device schematic diagram, and wherein in schematic side view, due to visual angle relationship,
Big visual field short focus monocular gray scale camera and infrared light supplementing device are blocked by the small field of view focal length monocular gray scale camera that holder carries,
Therefore it is not embodied in figure.Solid black lines indicate the field range of big visual field short focus monocular gray scale camera, and least commitment is water
It is flat to need to cover the required space detected with vertical angle of view.The small field of view focal length monocular gray scale camera that holder carries can be in water
The flat rotation for carrying out 180 degree Yu 90 degree respectively with vertical direction.
Central control unit is one mini PC host, connect by USB with two cameras thus operate camera into
The reading of row image information；Central control unit uses USB serial ports to connect with first communication device simultaneously.Central control unit is logical
It crosses and the image information read in real time is analyzed, corresponding gesture control order is obtained by analysis, order is passed through into communication
Device is transferred to terminal control mechanism.Terminal control mechanism connects secondary communication device and terminal device, embedding by single-chip microcontroller etc.
Enter the equipment that control function may be implemented in formula work to the coding and decoding of transmission information, and realizes the control for terminal device
System.Communication device in the present invention is TI（Texas Instrument）The cc2530 chip of company, chip have the function of wireless communication.
In conjunction with Fig. 3, the present invention also proposes the control method of Wireless intelligent control device described in one kind, control method summary
For the position of location action promoter, thus the position of location action promoter's gesture, using double freedom platform camera into
Then row partial capture generates command information by the identification, analysis, processing combined to different gestures, is conveyed by Internet of Things
The operation of information and completion to relevant device.The control method includes image-acquisition phase, Image Information Processing stage and hand
The gesture command process stage；Described image obtains stage correspondence image and obtains state, described image signal processing stages correspondence image
Information processing state, the gesture command processing stage correspond to gesture command processing status；
Described image obtains the stage by big visual field short focus monocular gray scale camera acquisition panoramic picture, gives by USB transmission
Entreat control device to carry out the information processing of panoramic picture, by the processing result of panorama image information call double freedom platform into
Row rotation, to obtain the real-time image information comprising dynamic gesture by small field of view focal length monocular gray scale camera；By obtaining
Activation gesture is taken, the state of the Wireless intelligent control device is converted into Image Information Processing state；There is no activation
In the case where gesture, the Wireless intelligent control device is still within image acquireing state；
Described image signal processing stages obtain real time data by small field of view focal length monocular gray scale camera, by analyzing image
In static gesture and dynamic gesture, the control command information that is exported by gesture of acquisition movement promoter；If had
The gesture of effect, control device will transition to gesture command processing status；If not obtaining complete gesture, control device continues to locate
In Image Information Processing state；If control device does not obtain effective gesture, image acquireing state will transition to；
The gesture command processing stage, the central control unit and terminal control mechanism collaborative work controlling terminal equipment are complete
At function corresponding with gesture control order, and the operating status of terminal device and the information of order performance are recorded, it is complete
It will transition to image acquireing state at Wireless intelligent control device described after whole process.
In conjunction with Fig. 4, the described image acquisition stage is specially：The Wireless intelligent control device described first is obtained by USB interface
The image information for taking panorama carries out panoramic picture the extraction and processing of information, by posture analysis, finds and issues activation
The promoter position of movement is calculated by the scale for acting promoter to activation, finds the position of user's hand, confirmation sense
Interest region ROI, spatially by position calculating action promoter hand of the region of interest ROI in panoramic picture
Position, double freedom platform is adjusted by the information of spatial position, makes the horizontal direction and vertical direction of double freedom platform
It is adjusted to that the small field of view focal length monocular gray scale camera carried is made to capture calculated region of interest ROI, to start to obtain
Take the real-time image information of gesture.
In conjunction with Fig. 5, described image signal processing stages are specially：By the algorithm of image procossing to the realtime graphic of gesture
It is calculated, acquisition acts the static gesture and dynamic gesture of promoter, and the static gesture is a sequence clenched fist with palm
Column combination, the combined composition are to stretch out the five fingers, then clench fist, then stretch out the five fingers again；When Wireless intelligent control device is known
Successful prompt tone will be provided not after the combined sequence and starts the analysis of dynamic gesture；If had in the combined sequence
One link failure, Wireless intelligent control device will issue miscue sound and start waiting activation sequence again；The dynamic
Gesture is that movement promoter's stretching the five fingers draw a track in the sky, and Wireless intelligent control device can be tracked and be identified described
Then track judges whether the dynamic gesture successfully matches with the template in Wireless intelligent control device according to track；So far
For a complete gesture identification process.Described image processing algorithm be static gesture sequence detecting method, gesture in real time with
Track method and dynamic gesture detection method etc..
The dynamic gesture defines an operation, the end that first gesture selection needs to control by two gesture combinations
End equipment, the function for the terminal device that second gesture selection needs to control.This design meets while controlling multiple set
Standby demand, and identical gesture can be reused, reduce the difficulty that user remembers excessive gesture.
The gesture command processing stage is specially：The gesture control command information touching generated by the Image Information Processing stage
Gesture command processing status is sent out, the gesture control command information can be according to the lattice of communication protocol by central control unit analysis
Formula is encoded, by coding data packet by wireless transmission reach terminal control mechanism, the terminal control mechanism according to
Communication protocol again decodes the gesture control command information, is then passed to terminal device, and by the operation shape of terminal device
The information of state and instruction performance returns in central control unit.
Whole process is the circulation triggered by gesture instruction, if do not triggered, CS central control device is in
Wait state；In the case where having gesture trigger, central control unit starts to start to process gesture instruction.Central control unit
It will start to encode this instruction, the length of entire data is 8 bytes, including header telegram end, address, function, letter
Breath number, data and verification etc., data format is as shown in table 1.Since communication is two-way, i.e. uplink --- by center control dress
Set and be sent to terminal control mechanism and downlink --- terminal control mechanism is sent to central control unit, therefore communication data content according to
Two kinds of coding forms of uplink and downlink.Downlink is as shown in table 2, and uplink is as shown in table 3, and the main differentiation of the coding of uplink and downlink is in number
According to code.
TableDatagram format
| Message unit | Start | Address | Function code | Information encoding | Data | Verification | Terminate |
| Byte number | 1 | 2 | 1 | 1 | 1 | 1 | 1 |
| Description | 3A（：） | Distinguish information | The XOR of function code and data | 23（#） | |||
| Abbreviation | SD | ADDR | FN | CNT | DA | CD | ED |
TableDownlink data encoded content
| Function code FN | Description | Data |
| 01 | Inquire all terminal power-on states | 00 |
| 02 | Control lamp | 01 is opens, and 00 is closes, and 02 is to choose |
| 03 | Adjust lamp brightness | 01 is adds, and 00 is to subtract |
| 04 | Adjust light color tune | 01 is adds, and 00 is to subtract |
| 05 | Switch curtain | 01 is opens, and 00 is closes, and 02 is chooses, and 03 is to stop |
| 06 | Control multimedia/stopping | 01 is plays, and 00 is stops, and 02 is to choose |
| 07 | Control multimedia audio | 01 is increases, and 02 is to subtract |
| 08 | Control multimedia switching | 01 switches forward, and 00 switches backward |
| 09 | Acknowledge receipt of reply | The function code received |
| 10 | Inquire floor lamp state | 00 |
| 11 | Inquire curtain state | 00 |
| 12 | Inquire multimedia state | 00 |
TableUpstream data encoded content
For the safety of system, each data need to carry out after the receipt verifying work, and first check bit address check needs
It is identical as the device address that instruction needs to operate to verify the address that receiving end receives；Second is verified as the integrality school of information
It tests, i.e., the exclusive or of entire information is identical as the check bit received in information；Third check bit information encoding verification, i.e., with end
The information encoding of the upper instruction stored in end equipment controller compares, if not mutually being all to pass through.
The verification confirmation message that central control unit will wait a terminal control mechanism to return after sending instruction, if
It does not wait until that this information or terminal device verification will unsuccessfully enter the state of a retransmission, i.e., sends upper one
Information is recompiled and is sent；When the number of continuous retransmission same information is more than threshold value, this information will be given up and continued
Handle other information.It, can be according to relevant function code and data after terminal control mechanism receives gesture instruction and verifies successfully
Code operates terminal device；By the operating status and the specified operation of central control unit for terminal device after operation
Content is encoded by the communication protocol of uplink, is then sent to central control unit.Central control unit receives terminal
A confirmation message can be sent after the equipment running status that control device returns.If terminal control mechanism does not receive this really
When recognizing information, the operating status of the automatic retransmitter of meeting.Meeting when central control unit receives the running state information of terminal device
The facility information that Installed System Memory stores up is updated, so as to carry out operation next time according to this operation information.It receives
Confirmation message shows that a complete gesture information extracts and process flow is over, and system is automatically converted into image acquisition
State.
Specific embodiments of the present invention are explained with the application direction of smart home below：
In conjunction with Fig. 6, the program takes control device and control method in the present invention, and camera is placed in above parlor, leads to
Crossing cooperating for two cameras becomes controllable space for whole living room.By image acquiring device and central control unit
Connection, as processing core；Electronic curtain, lamps and lanterns and multimedia equipment etc. are connected single as control with terminal control mechanism
Member；Then communication device is respectively configured for processing core and terminal control mechanism, constitutes hardware device described in the present invention.
Program control method is to obtain the activation gesture of user, is then controlled by the combination of different user gesture different
The function of equipment.Due to needing to control the multiple functions of plurality of devices, the program needs to design the unlatching gesture of every kind of equipment.It opens
After opening the determining equipment for needing to manipulate of gesture, general unlatching is used, is stopped, being increased, functional gesture such as reduction and switching
The concrete function of commanding apparatus.One complete operating process needs user to carry out activation gesture, and equipment selects gesture and sets
The combination of standby operating gesture is completed.
Above to a kind of Wireless intelligent control device and its control method based on gesture provided by the present invention, carry out
It is discussed in detail, used herein a specific example illustrates the principle and implementation of the invention, above embodiments
Illustrate to be merely used to help understand method and its core concept of the invention；At the same time, for those skilled in the art, according to
According to thought of the invention, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification
It should not be construed as limiting the invention.
Claims (8)
1. a kind of Wireless intelligent control device based on gesture, which is characterized in that including image information acquisition device, center control
Device, first communication device, at least one secondary communication device, at least one terminal control mechanism and at least one terminal are set
It is standby；Described image information acquisition device is connect with central control unit, and the central control unit is logical by USB serial ports and first
T unit connection, the first communication device and each secondary communication device wirelessly communicate, and each secondary communication device is equal
It is connected by UART interface with corresponding terminal control mechanism, each terminal control mechanism connects with corresponding terminal device
It connects；Gesture information of the described image information acquisition device for acquisition movement promoter；The central control unit is used for reality
When the gesture information that obtains be read out and analyze, corresponding gesture control order is obtained by analysis, by the control command
Terminal control mechanism is transferred to by first communication device and secondary communication device；The terminal control mechanism is used for gesture control
System order decoding and the execution of operating terminal equipment, while the execution state of control command is fed back into central control unit.
2. the apparatus according to claim 1, it is characterised in that：Described image information acquisition device includes big visual field short focus list
Mesh gray scale camera and small field of view focal length monocular gray scale camera；The big visual field short focus monocular gray scale camera is used for panorama
Capture carry out location action promoter to be analyzed entire picture by entire scene capture into picture；It is described to neglect
Head's coke monocular gray scale camera is used for the partial gesture action message of capturing motion promoter.
3. the apparatus of claim 2, it is characterised in that：Described image information acquisition device further includes infrared light supplementing device
And double freedom platform；The infrared light supplementing device is used in the case that natural light is insufficient, and infrared light supplementing device automatically opens, small
Visual field focal length monocular gray scale camera receives reflection light of the infrared light supplementing device on object, captures the gray level image of gesture motion
Information；The small field of view focal length monocular gray scale camera is carried by double freedom platform, the double freedom platform it is horizontal with
The rotation of 180 degree Yu 90 degree is carried out in vertical two freedom degrees, respectively so as to capture the gesture motion letter of any position
Breath.
4. the control method of Wireless intelligent control device according to any one of claim 1-3, it is characterised in that：It is described
Control method includes image-acquisition phase, Image Information Processing stage and gesture command processing stage；Described image obtains the stage
Correspondence image obtains state, described image signal processing stages correspondence image information processing state, and the gesture command handles rank
The corresponding gesture command processing status of section；
Described image obtains the stage by big visual field short focus monocular gray scale camera acquisition panoramic picture, gives by USB transmission
Entreat control device to carry out the information processing of panoramic picture, by the processing result of panorama image information call double freedom platform into
Row rotation, to obtain the real-time image information comprising dynamic gesture by small field of view focal length monocular gray scale camera；By obtaining
Activation gesture is taken, the state of the Wireless intelligent control device is converted into Image Information Processing state；There is no activation
In the case where gesture, the Wireless intelligent control device is still within image acquireing state；
Described image signal processing stages obtain real time data by small field of view focal length monocular gray scale camera, by analyzing image
In static gesture and dynamic gesture, the control command information that is exported by gesture of acquisition movement promoter；If had
The gesture of effect, control device will transition to gesture command processing status；If not obtaining complete gesture, control device continues to locate
In Image Information Processing state；If control device does not obtain effective gesture, image acquireing state will transition to；
The gesture command processing stage, the central control unit and terminal control mechanism collaborative work controlling terminal equipment are complete
At function corresponding with gesture control order, and the operating status of terminal device and the information of order performance are recorded, it is complete
It will transition to image acquireing state at Wireless intelligent control device described after whole process.
5. according to the method described in claim 4, it is characterized in that：Described image obtain the stage be specially：It is described wireless first
Intelligent controlling device obtains the image information of panorama by USB interface, and the extraction and processing of information are carried out for panoramic picture,
By posture analysis, the promoter position for issuing activation movement is found, is calculated by the scale for acting promoter to activation,
The position of user's hand is found, region of interest ROI is confirmed, passes through position of the region of interest ROI in panoramic picture
The position of calculating action promoter hand spatially adjusts double freedom platform by the information of spatial position, makes double free
The horizontal direction and vertical direction for spending holder are adjusted to make the small field of view focal length monocular gray scale camera of carrying to capture to calculate
Region of interest ROI, thus start obtain gesture real-time image information.
6. according to the method described in claim 4, it is characterized in that：Described image signal processing stages are specially：Pass through image
The algorithm of processing calculates the realtime graphic of gesture, and acquisition acts the static gesture and dynamic gesture of promoter, described quiet
State gesture is a combined sequence clenched fist with palm, and the combined composition is to stretch out the five fingers, then clenches fist, then stretches out again
The five fingers；Successful prompt tone will be provided after Wireless intelligent control device identifies the combined sequence and starts dynamic gesture
Analysis；If there is the failure of link in the combined sequence, Wireless intelligent control device will issue miscue sound and again
Start waiting activation sequence；The dynamic gesture is that movement promoter's stretching the five fingers draw a track, intelligent wireless in the sky
Control device can track and identify the track, then according to track judge the dynamic gesture whether with intelligent wireless control
Template in device is successfully matched；It so far is a complete gesture identification process.
7. according to the method described in claim 6, it is characterized in that：The dynamic gesture defines one by two gesture combinations
A operation, the terminal device that first gesture selection needs to control, the function for the terminal device that second gesture selection needs to control
Energy.
8. according to the method described in claim 4, it is characterized in that：The gesture command processing stage is specially：Believed by image
It ceases the gesture control command information that processing stage generates and triggers gesture command processing status, the gesture control command information is passed through
Central control unit analysis can be encoded according to the format of communication protocol, be reached by the data packet of coding by wireless transmission
The gesture control command information is decoded again according to communication protocol, is then passed by terminal control mechanism, the terminal control mechanism
Reach terminal device, and the information of the operating status of terminal device and instruction performance is returned in central control unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810666579.3A CN108874142B (en) | 2018-06-26 | 2018-06-26 | A kind of Wireless intelligent control device and its control method based on gesture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810666579.3A CN108874142B (en) | 2018-06-26 | 2018-06-26 | A kind of Wireless intelligent control device and its control method based on gesture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108874142A true CN108874142A (en) | 2018-11-23 |
| CN108874142B CN108874142B (en) | 2019-08-06 |
Family
ID=64294761
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810666579.3A Active CN108874142B (en) | 2018-06-26 | 2018-06-26 | A kind of Wireless intelligent control device and its control method based on gesture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108874142B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109996371A (en) * | 2019-04-24 | 2019-07-09 | 深圳尚一互联技术有限公司 | The method of gesture control light for Intelligent bracelet |
| CN111123986A (en) * | 2019-12-25 | 2020-05-08 | 四川云盾光电科技有限公司 | Control device for controlling two-degree-of-freedom turntable based on gestures |
| CN112154402A (en) * | 2019-08-29 | 2020-12-29 | 深圳市大疆创新科技有限公司 | Wearable device, control method thereof, gesture recognition method and control system |
| CN112188105A (en) * | 2020-09-30 | 2021-01-05 | 苏州臻迪智能科技有限公司 | Tracking shooting method and device, intelligent device and computer readable storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101520838A (en) * | 2008-02-27 | 2009-09-02 | 中国科学院自动化研究所 | Automatic-tracking and automatic-zooming method for acquiring iris images |
| CN102932212A (en) * | 2012-10-12 | 2013-02-13 | 华南理工大学 | Intelligent household control system based on multichannel interaction manner |
| CN202939756U (en) * | 2012-11-29 | 2013-05-15 | 长安大学 | Dual-video-head target invasion recording system |
| CN103760976A (en) * | 2014-01-09 | 2014-04-30 | 华南理工大学 | Kinect based gesture recognition smart home control method and Kinect based gesture recognition smart home control system |
| CN103984315A (en) * | 2014-05-15 | 2014-08-13 | 成都百威讯科技有限责任公司 | Domestic multifunctional intelligent robot |
| CN104977904A (en) * | 2014-04-04 | 2015-10-14 | 浙江大学 | Visible and controllable intelligent household control system and control method thereof |
| CN105955041A (en) * | 2016-05-25 | 2016-09-21 | 北京行云时空科技有限公司 | Control method for interaction between wearable equipment and intelligent household, interaction system of wearable equipment and intelligent household and wearable equipment |
| CN107087107A (en) * | 2017-05-05 | 2017-08-22 | 中国科学院计算技术研究所 | Image processing apparatus and method based on dual camera |
-
2018
- 2018-06-26 CN CN201810666579.3A patent/CN108874142B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101520838A (en) * | 2008-02-27 | 2009-09-02 | 中国科学院自动化研究所 | Automatic-tracking and automatic-zooming method for acquiring iris images |
| CN102932212A (en) * | 2012-10-12 | 2013-02-13 | 华南理工大学 | Intelligent household control system based on multichannel interaction manner |
| CN202939756U (en) * | 2012-11-29 | 2013-05-15 | 长安大学 | Dual-video-head target invasion recording system |
| CN103760976A (en) * | 2014-01-09 | 2014-04-30 | 华南理工大学 | Kinect based gesture recognition smart home control method and Kinect based gesture recognition smart home control system |
| CN104977904A (en) * | 2014-04-04 | 2015-10-14 | 浙江大学 | Visible and controllable intelligent household control system and control method thereof |
| CN103984315A (en) * | 2014-05-15 | 2014-08-13 | 成都百威讯科技有限责任公司 | Domestic multifunctional intelligent robot |
| CN105955041A (en) * | 2016-05-25 | 2016-09-21 | 北京行云时空科技有限公司 | Control method for interaction between wearable equipment and intelligent household, interaction system of wearable equipment and intelligent household and wearable equipment |
| CN107087107A (en) * | 2017-05-05 | 2017-08-22 | 中国科学院计算技术研究所 | Image processing apparatus and method based on dual camera |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109996371A (en) * | 2019-04-24 | 2019-07-09 | 深圳尚一互联技术有限公司 | The method of gesture control light for Intelligent bracelet |
| CN112154402A (en) * | 2019-08-29 | 2020-12-29 | 深圳市大疆创新科技有限公司 | Wearable device, control method thereof, gesture recognition method and control system |
| WO2021035646A1 (en) * | 2019-08-29 | 2021-03-04 | 深圳市大疆创新科技有限公司 | Wearable device and control method therefor, gesture recognition method, and control system |
| US11782514B2 (en) | 2019-08-29 | 2023-10-10 | SZ DJI Technology Co., Ltd. | Wearable device and control method thereof, gesture recognition method, and control system |
| CN111123986A (en) * | 2019-12-25 | 2020-05-08 | 四川云盾光电科技有限公司 | Control device for controlling two-degree-of-freedom turntable based on gestures |
| CN112188105A (en) * | 2020-09-30 | 2021-01-05 | 苏州臻迪智能科技有限公司 | Tracking shooting method and device, intelligent device and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108874142B (en) | 2019-08-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108874142B (en) | A kind of Wireless intelligent control device and its control method based on gesture | |
| CN106440192B (en) | Household appliance control method, device and system and intelligent air conditioner | |
| US20190302714A1 (en) | Systems and methods to operate controllable devices with gestures and/or noises | |
| JP6968154B2 (en) | Control systems and control processing methods and equipment | |
| CN109491263B (en) | Intelligent household equipment control method, device and system and storage medium | |
| WO2020244573A1 (en) | Voice instruction processing method and device, and control system | |
| CN104410883B (en) | The mobile wearable contactless interactive system of one kind and method | |
| US8537231B2 (en) | User interface system based on pointing device | |
| CN106020478B (en) | A kind of intelligent terminal control method, device and intelligent terminal | |
| US20130241830A1 (en) | Gesture input apparatus, control program, computer-readable recording medium, electronic device, gesture input system, and control method of gesture input apparatus | |
| CN106970535B (en) | Control method and electronic equipment | |
| CN105760106A (en) | Interaction method and interaction device of intelligent household equipment | |
| CN106488629A (en) | A kind of projection control type intelligence lamp system | |
| CN109542233B (en) | Lamp control system based on dynamic gestures and face recognition | |
| CN105045122A (en) | Intelligent household natural interaction system based on audios and videos | |
| CN102932212A (en) | Intelligent household control system based on multichannel interaction manner | |
| CN102547172B (en) | Remote control television | |
| CN109581886B (en) | Equipment control method, device, system and storage medium | |
| WO2007012253A1 (en) | An intellective blowing air conditioner and an intellective blowing method thereof | |
| CN104869299A (en) | Prompting method and device | |
| CN209417675U (en) | A kind of massage armchair gesture control device | |
| CN112486105B (en) | Equipment control method and device | |
| CN203966055U (en) | Wireless interaction optical projection system | |
| WO2018023515A1 (en) | Gesture and emotion recognition home control system | |
| CN112888118A (en) | Lighting lamp control method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |