CN107998670A - Remote-control toy control system based on plane gesture identification - Google Patents
Remote-control toy control system based on plane gesture identification Download PDFInfo
- Publication number
- CN107998670A CN107998670A CN201711325554.9A CN201711325554A CN107998670A CN 107998670 A CN107998670 A CN 107998670A CN 201711325554 A CN201711325554 A CN 201711325554A CN 107998670 A CN107998670 A CN 107998670A
- Authority
- CN
- China
- Prior art keywords
- gesture
- control
- remote
- light beam
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63H—TOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
- A63H30/00—Remote-control arrangements specially adapted for toys, e.g. for toy vehicles
- A63H30/02—Electrical arrangements
- A63H30/04—Electrical arrangements using wireless transmission
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Remote-control toy control system based on plane gesture identification, belongs to the control technology field of remote-control toy.The present invention is the problem of control form is single in order to solve the existing remote-control toy controller data complex disposal process based on physical button and handle rocker.Its infrared laser is used for the collimated light beam in emission level direction；Camera is used to gather gesture light beam image of the collimated light beam after the reflection of human hand shield；Controller includes image capture module, image processing module, control area identification module, gesture recognition module and order output module；Controller is used to identify user gesture and control remote-control toy to act.The operation that the present invention is used for remote-control toy controls.
Description
Technical field
The present invention relates to a kind of remote-control toy control system based on plane gesture identification, belong to the gesture control of remote-control toy
Technical field processed.
Background technology
Remote controler is the important component of remote-control toy, and existing remote-control toy has telecar, telecontrolled aircraft etc..At present,
Remote controler realizes control using physical button, joystick or button by the way of handle rocker is combined substantially.
Common physical button is push type button, and when being acted on from external force, key contacts are in discrete state, pressing
Button, which gets an electric shock, afterwards closes.The anode of one termination power of usual button, and the other end connects positive pole by a pull-up resistor,
When by key pressing, contact is turned on power cathode, and level signal is pulled low as low level in the bus being connected with the button；Press
After pressing out, due to the effect of key inside spring, contact returns to discrete state again, is disconnected with power cathode, in bus
Level signal again drawn high by positive pole to high level；Pass through the detection to button level signal, it can be determined that whether is button
It is pressed, and then controls telecar etc. to carry out corresponding action.
Current most remote control for toys, using the control mode of physical button.It is but various due to control object
Property and function complexity, the quantity of remote control for toys button sharply increases, and some functions need multiple buttons to be used cooperatively,
Being carried out at the same time operation by two hands could complete.
Above-mentioned control method operating process is complicated, and controlled motion form is relatively simple.
It is existing can be divided into from principle based on the controller of gesture identification based on electromagnetic induction, based on iraser or
Control based on two dimensional image etc..Control based on electromagnetic induction depends on the electromagnetic induction being fixed on metope or lamp body
Equipment, it utilizes disturbance of the human hand after to installation electromagnetical field, by realizing gesture control to the monitoring that electromagnetic field changes.Base
In the control of iraser, a branch of directional light is launched by iraser first, after finger shield lives collimated light beam
The reflected beams of generation can be captured by camera, the imagery exploitation image processing techniques extraction finger captured to camera
The information such as coordinate, number, realize the judgement identification to gesture.Control based on two dimensional image relies primarily on the processing of video image
With analysis, by extracting hand color, shape, movement or Edge texture feature from two dimensional image, the identification of gesture is realized.
The content of the invention
The invention aims to solve at the existing remote-control toy controller data based on physical button and handle rocker
A kind of the problem of reason process is complicated, and control form is single, there is provided remote-control toy control system based on plane gesture identification.
Remote-control toy control system of the present invention based on plane gesture identification, it includes infrared laser, camera
And controller；
Infrared laser is used for the collimated light beam in emission level direction；
Camera is used to gather gesture light beam image of the collimated light beam after the reflection of human hand shield；
The controller includes：
Image capture module, the gesture light beam image obtained for acquisition camera；
Image processing module, for carrying out binary conversion treatment to gesture light beam image, then progressively scans, obtains the hand for making gesture
Refer to number, and obtain the profile of each finger, the center point coordinate for obtaining each finger is calculated according to the profile of each finger；
Control area identification module, according to two setting point coordinates of presetting left control area and right control area line of demarcation, to finger
Center point coordinate judge, obtain the manipulation target area of current gesture light beam image；
Gesture recognition module, the center point coordinate of finger is compared with manipulating the gesture information that pre-sets of target area, is sentenced
It is disconnected to obtain gesture control instruction；
Order output module, for gesture control instruction to be sent to the receiver of remote-control toy.
Advantages of the present invention：The disclosure using embedded platform be used as controller, by camera collection infrared image, by
Controller handles image, identifies user gesture and controls remote-control toy to act.
The disclosure uses gesture control to substitute the controller of conventional physical key-press input, its image recognition based on gesture,
Manipulation is realized without using complicated combination button, and data handling procedure is simple.The disclosure can be real using simple gesture motion
Existing diversified control action, and remote controler need not be held always, as long as the hand motion of user is in the manipulation of setting
Region, it becomes possible to realize control.The manipulation to toy is realized in the identification of the substantially planar gesture of the present invention, simplifies control process,
And provide a kind of novel operation format.
Brief description of the drawings
Fig. 1 is the schematic diagram of the remote-control toy control system of the present invention based on plane gesture identification；
Fig. 2 is the FB(flow block) of controller；
Fig. 3 is the gesture recognition module block diagram of the embodiment of the present disclosure；
Fig. 4 is the gesture recognition module flow chart of the embodiment of the present disclosure；
Fig. 5 is the flow chart of switching on and shutting down module；
Fig. 6 is the flow chart of tank traveling module；
Fig. 7 is the flow chart for controlling gun turret module；
Fig. 8 is the flow chart for opening fire with artillery module；
Fig. 9 is the flow chart of machine gun module.
Embodiment
The disclosure is described in detail to Fig. 1 to Fig. 9 below.
The remote-control toy control system based on plane gesture identification described in the disclosure, it includes infrared laser 1, shooting
First 2 and controller 3；
Infrared laser 1 is used for the collimated light beam in emission level direction；
Camera 2 is used to gather gesture light beam image of the collimated light beam after the reflection of human hand shield；
The controller 3 includes：
Image capture module 3-1, the gesture light beam image obtained for acquisition camera 2；
Image processing module 3-2, for carrying out binary conversion treatment to gesture light beam image, then progressively scans, gesture is made in acquisition
Finger number, and obtain the profile of each finger, calculated according to the profile of each finger and obtain the central point of each finger and sit
Mark；
Control area identification module 3-3, according to two setting point coordinates of presetting left control area and right control area line of demarcation, opponent
The center point coordinate judge of finger, obtains the manipulation target area of current gesture light beam image；
Gesture recognition module 3-4, the center point coordinate of finger is compared with manipulating the gesture information that pre-sets of target area,
Judge to obtain gesture control instruction；
Order output module 3-5, for gesture control instruction to be sent to the receiver of remote-control toy.
Controller 3 further includes described in the disclosure：
Gesture predefines module 3-6, for storing user-defined gesture information, and is used as and pre-sets gesture information.
The disclosure supports User Defined gesture, so as to realize the variation of control gesture, and increases control process
Interest.
Camera 2 described in the disclosure has narrow band filter.
The narrow band filter of the affiliated infrared band of 1 laser beam of infrared laser is added in 2 eyeglass of camera, makes to only have
It could be captured with the approximate infrared light of 1 wavelength of infrared laser by camera 2, it is therefore an objective to unnecessary information is reduced, it is prominent
Important information, can reduce the calculation amount of image processing algorithm, so as to improve recognition efficiency.
The disclosure in use, makes infrared laser 1 launch a branch of horizontal parallel infrared light, then user first
Need can identified operating space input gesture motion, after finger shield parallel infrared light, infrared light reflection can be made, reflected
Image is captured by camera 2, is exported as gesture light beam image to controller 3.
After camera 2 receives the Image Acquisition control instruction of the transmission of controller 3, image is acquired, and can be with
Collection image is written in the FLASH memory of 3 bands of controller, image processing module 3-2 is read from FLASH memory
Image simultaneously carries out image procossing.If gesture recognition module 3-4 cannot be with defining by the gesture identified in gesture light beam image
The gesture that pre-sets realize corresponding matching, then current gesture control failure, repeated acquisition image, until obtaining and pre-seting
The images of gestures that gesture matches, just further sends corresponding instruction to remote-control toy.
If user made correctly, define pre-set gesture, gesture recognition module 3-4, which passes through, orders output
Module 3-5 produces corresponding output, such as exports PWM ripples or GPIO low and high level signals.
Specific embodiment：
For the existing remote-control toy tank of in the market, its matched remote controller is reequiped.Use the stm32f407MCU of stm32 companies
As main control chip, gesture-capture module is used as using the infrared laser of OV7620 cameras and 808nm wavelength.Use Taobao
The remote-control toy tank of upper purchase, and its matched remote controller is reequiped, carry out the defeated of analog telecommand device using the GPIO low and high levels of MCU
Go out signal, to achieve the purpose that to control toy tank.
1）First, hardware initialization is carried out：Initialize camera, using the infrared laser of PWM drivings and for controlling
The GPIO of toy tank；After initialization, start camera and carry out picture catching, after the completion of image acquisition, image is carried out
Contours extract.
2）Contours extract：Binary conversion treatment is carried out with a suitable threshold value to whole image, then progressively scans whole figure
Piece, obtains the number of finger and the profile of each finger, calculates the center of each finger contours, obtain the center of each finger
Point coordinates.
3）The control operation area of tank is subjected to left and right region segmentation：Two points are pre-seted, are formed according to 2 points of coordinate
Straight line, is left operating space by definition of the operating area on the left of straight line, the right operating space of conduct of opposite side.A left side can be defined
Operating space is the traveling control zone of tank, and right operating space is used for controlling the annexes such as gun turret and gun tube.
With reference to shown in Fig. 3 and Fig. 4, in gesture recognition module 3-4, pre-seting gesture information can be：
It can make to identify that double refer to slides up and down gesture in left operating space, as shown in Figure 5 by setting switching on and shutting down module：
When user is made that double gestures for referring to upward sliding, then tank starting ignition, it is dynamic can just to carry out other for tank after igniting
Make；
When user is made that double gestures for being directed toward lower slider, then tank stops working, and tank can no longer carry out other actions at this time, keeps
Halted state.
After tank starting ignition, further gesture setting can be carried out by tank traveling module, as shown in Figure 6：
Tank traveling module is used for the gesture for identifying the slip gesture up and down singly referred in left operating space and lifting hand：
User singly refers to upper cunning, and then tank is advanced forward until user lifts hand；
User singly refers to downslide, and then tank is drawn back until user lifts hand；
User singly refers to left cunning, and then tank is advanced until user lifts hand to the left；
User singly refers to right cunning, and then tanks right is advanced until user lifts hand.
Set again by controlling gun turret module to carry out further gesture, as shown in Figure 7：
Control gun turret module is used for the gesture for identifying the slip gesture up and down singly referred in right operating space and lifting hand：
User singly refer to upper cunning then tank gun tube rise until user lift hand；
User singly refer to glide then tank gun tube decline until user lift hand；
The gun turret that user singly refers to left cunning then tank turns left until user lifts hand；
The gun turret that user singly refers to right cunning then tank turns right until user lifts hand.
Again by open fire with artillery module identify in right operating space two refer to press and lift, as shown in Figure 8：
Two fingers are pressed, and tank is opened fire with artillery until user's finger is lifted.
Again by machine gun module identify in right operating space three refer to press and lift, as shown in Figure 9：
After three fingers are pressed, tank starts machine gun function until user's finger is lifted.
Claims (3)
1. a kind of remote-control toy control system based on plane gesture identification, it is characterised in that it includes infrared laser（1）、
Camera（2）And controller（3）；
Infrared laser（1）Collimated light beam for emission level direction；
Camera（2）For gathering gesture light beam image of the collimated light beam after the reflection of human hand shield；
The controller（3）Including：
Image capture module（3-1）, for acquisition camera（2）The gesture light beam image of acquisition；
Image processing module（3-2）, for carrying out binary conversion treatment to gesture light beam image, then progressively scan, acquisition is sold
The finger number of gesture, and the profile of each finger is obtained, the central point for obtaining each finger is calculated according to the profile of each finger
Coordinate；
Control area identification module（3-3）, it is right according to two setting point coordinates of presetting left control area and right control area line of demarcation
The center point coordinate judge of finger, obtains the manipulation target area of current gesture light beam image；
Gesture recognition module（3-4）, the center point coordinate of finger is compared with manipulating the gesture information that pre-sets of target area
It is right, judge to obtain gesture control instruction；
Order output module（3-5）, for gesture control instruction to be sent to the receiver of remote-control toy.
2. the remote-control toy control system according to claim 1 based on plane gesture identification, it is characterised in that the control
Device processed（3）Further include：
Gesture predefines module（3-6）, for storing user-defined gesture information, and it is used as and pre-sets gesture information.
3. the remote-control toy control system according to claim 1 based on plane gesture identification, it is characterised in that
The camera（2）With narrow band filter.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711325554.9A CN107998670A (en) | 2017-12-13 | 2017-12-13 | Remote-control toy control system based on plane gesture identification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711325554.9A CN107998670A (en) | 2017-12-13 | 2017-12-13 | Remote-control toy control system based on plane gesture identification |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107998670A true CN107998670A (en) | 2018-05-08 |
Family
ID=62058641
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711325554.9A Pending CN107998670A (en) | 2017-12-13 | 2017-12-13 | Remote-control toy control system based on plane gesture identification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107998670A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109583404A (en) * | 2018-12-06 | 2019-04-05 | 哈尔滨拓博科技有限公司 | A kind of plane gestural control system and control method based on characteristic pattern identification |
| CN109656375A (en) * | 2019-02-28 | 2019-04-19 | 哈尔滨拓博科技有限公司 | A kind of multi-mode dynamic hand gesture recognition system, device and method |
| CN111672137A (en) * | 2020-06-17 | 2020-09-18 | 汕头市澄海区致远模型玩具有限公司 | Control method of interactive induction aircraft |
| CN114393571A (en) * | 2022-01-17 | 2022-04-26 | 成都工业学院 | Gesture control system for controlling mechanical arm to operate through gestures |
| CN114978333A (en) * | 2022-05-25 | 2022-08-30 | 深圳玩智商科技有限公司 | Identification equipment, system and method |
| CN116561152A (en) * | 2023-07-12 | 2023-08-08 | 天津南大通用数据技术股份有限公司 | Database log recording method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102902356A (en) * | 2012-09-18 | 2013-01-30 | 华南理工大学 | Gesture control system and control method thereof |
| US20140062858A1 (en) * | 2012-08-29 | 2014-03-06 | Alpine Electronics, Inc. | Information system |
| CN103679145A (en) * | 2013-12-06 | 2014-03-26 | 河海大学 | Automatic gesture recognition method |
| CN103777746A (en) * | 2012-10-23 | 2014-05-07 | 腾讯科技（深圳）有限公司 | Human-machine interactive method, terminal and system |
| CN106778670A (en) * | 2016-12-30 | 2017-05-31 | 上海集成电路研发中心有限公司 | Gesture identifying device and recognition methods |
-
2017
- 2017-12-13 CN CN201711325554.9A patent/CN107998670A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140062858A1 (en) * | 2012-08-29 | 2014-03-06 | Alpine Electronics, Inc. | Information system |
| CN102902356A (en) * | 2012-09-18 | 2013-01-30 | 华南理工大学 | Gesture control system and control method thereof |
| CN103777746A (en) * | 2012-10-23 | 2014-05-07 | 腾讯科技（深圳）有限公司 | Human-machine interactive method, terminal and system |
| CN103679145A (en) * | 2013-12-06 | 2014-03-26 | 河海大学 | Automatic gesture recognition method |
| CN106778670A (en) * | 2016-12-30 | 2017-05-31 | 上海集成电路研发中心有限公司 | Gesture identifying device and recognition methods |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109583404A (en) * | 2018-12-06 | 2019-04-05 | 哈尔滨拓博科技有限公司 | A kind of plane gestural control system and control method based on characteristic pattern identification |
| CN109583404B (en) * | 2018-12-06 | 2019-08-02 | 哈尔滨拓博科技有限公司 | A kind of plane gestural control system and control method based on characteristic pattern identification |
| CN109656375A (en) * | 2019-02-28 | 2019-04-19 | 哈尔滨拓博科技有限公司 | A kind of multi-mode dynamic hand gesture recognition system, device and method |
| CN111672137A (en) * | 2020-06-17 | 2020-09-18 | 汕头市澄海区致远模型玩具有限公司 | Control method of interactive induction aircraft |
| CN114393571A (en) * | 2022-01-17 | 2022-04-26 | 成都工业学院 | Gesture control system for controlling mechanical arm to operate through gestures |
| CN114393571B (en) * | 2022-01-17 | 2024-07-05 | 成都工业学院 | Gesture control system for controlling operation of mechanical arm through gestures |
| CN114978333A (en) * | 2022-05-25 | 2022-08-30 | 深圳玩智商科技有限公司 | Identification equipment, system and method |
| CN114978333B (en) * | 2022-05-25 | 2024-01-23 | 深圳玩智商科技有限公司 | Identification equipment, system and method |
| CN116561152A (en) * | 2023-07-12 | 2023-08-08 | 天津南大通用数据技术股份有限公司 | Database log recording method and device |
| CN116561152B (en) * | 2023-07-12 | 2023-09-29 | 天津南大通用数据技术股份有限公司 | Database log recording method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107998670A (en) | Remote-control toy control system based on plane gesture identification | |
| JP6968154B2 (en) | Control systems and control processing methods and equipment | |
| CN107609383B (en) | 3D face identity authentication method and device | |
| CN107748869B (en) | 3D face identity authentication method and device | |
| CN107633165B (en) | 3D face identity authentication method and device | |
| CN103353935B (en) | A kind of 3D dynamic gesture identification method for intelligent domestic system | |
| CN106933340B (en) | Gesture motion recognition method, control method and device and wrist type equipment | |
| CN105701437B (en) | System for drawing portrait based on robot | |
| CN103605466A (en) | Facial recognition control terminal based method | |
| CN102663364A (en) | Imitated 3D gesture recognition system and method | |
| CN103345301A (en) | Depth information acquisition method and device | |
| CN111726921B (en) | Somatosensory interactive light control system | |
| CN106873789B (en) | Projection system | |
| CN102402289A (en) | Mouse recognition method for gesture based on machine vision | |
| CN110164060B (en) | Gesture control method for doll machine, storage medium and doll machine | |
| CN104834412A (en) | Touch terminal based on non-contact hand gesture recognition | |
| CN112036261A (en) | Gesture recognition method and device, storage medium and electronic device | |
| CN113759748A (en) | Intelligent home control method and system based on Internet of things | |
| CN111461059A (en) | Multi-zone multi-classification extensible gesture recognition control device and control method | |
| CN209854410U (en) | Intelligent electric clothes hanger based on gesture control | |
| CN204808201U (en) | Gesture recognition control system based on vision | |
| CN211577849U (en) | TOF sensor and monocular camera fusion gesture recognition device | |
| CN107371307B (en) | A kind of lamp effect control method and system based on gesture identification | |
| Zhu et al. | Movement tracking in real-time hand gesture recognition | |
| CN109376646A (en) | A kind of electric appliance intelligent controller of image recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180508 |
|
| RJ01 | Rejection of invention patent application after publication |