CN103713776A - Gesture recognition device and gesture recognition method for early childhood education - Google Patents

Gesture recognition device and gesture recognition method for early childhood education Download PDF

Info

Publication number
CN103713776A
CN103713776A CN201210376723.2A CN201210376723A CN103713776A CN 103713776 A CN103713776 A CN 103713776A CN 201210376723 A CN201210376723 A CN 201210376723A CN 103713776 A CN103713776 A CN 103713776A
Authority
CN
China
Prior art keywords
gesture
touch pad
coordinate
camera
hand
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201210376723.2A
Other languages
Chinese (zh)
Inventor
高蓉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Dawu Education Technology Co Ltd
Original Assignee
Nanjing Dawu Education Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Dawu Education Technology Co Ltd filed Critical Nanjing Dawu Education Technology Co Ltd
Priority to CN201210376723.2A priority Critical patent/CN103713776A/en
Publication of CN103713776A publication Critical patent/CN103713776A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

The invention discloses a gesture recognition device and a gesture recognition method applicable to early childhood education. The gesture recognition device comprises a PC (personal computer), a camera, a tailor-made touch panel and a height-adjustable support. The tailor-made touch panel can be a transparent hard plastic plate, is arranged on the support not far away from the camera, is not connected with the camera and the PC, and is not arranged too high (for children use). A multidirectional coordinate system used in the gesture recognition method is engraved on the touch panel, and palm shapes are engraved at joints of an original point, a circle drawn by a center length of radius and direction axes. The coordinate system is usually built as an eight-directional coordinate system, and the upper, the upper right, the right, the lower right, the lower, the lower left, the left and the lower left directions are marked as 1, 2, 3, 4, 5, 6, 7 and 8 respectively. Compared with the prior art, the gesture recognition device has the advantages of simple structure and high applicability; the gesture recognition method matched with the device is quick in operational speed, high in recognition efficiency, standard in operation to some extent and high in speed.

Description

A kind of apparatus and method of the gesture identification for preschool education
Technical field
The present invention relates to computer realm, specifically relates to a kind of apparatus and method of the gesture identification for preschool education.
Background technology
At present, computing machine is in the rapid expansion of modern society's impact, input mode becomes more and more succinctly, more hommization, people constantly propose new requirement and challenge to the level of man-machine interaction and quality, a lot of local all mouses before replacement gradually and keyboard input, the modes such as employing such as phonetic entry, online handwriting input, gesture input, this meets the target of multi-mode human-machine interface technology research, makes user can facilitate, naturally use the known mode of subclass to use computing machine.
Because gesture has intuitive, naturality, gesture has become a kind of important means of man-machine information interaction.Than the data glove proposing before, mark gesture, natural hand etc., dynamic gesture recognition system based on vision is one of focus of current scientific development, a lot of scholar both domestic and external drops into the research that great enthusiasm is carried out relevant direction, meanwhile, the dynamic gesture recognition system based on vision is also the Main Trends of The Development of current and following gesture recognition system.A kind of dynamically isolated Gesture Recognition based on vision that for example Tsing-Hua University provides, proposed again the regular algorithm of dynamic space-time afterwards for gesture identification, and to 12 kinds of gestures, average recognition rate is up to 97%.
Gesture identification be and speech recognition after a large study hotspot of field of human-computer interaction, in man-machine interaction, application prospect is extensive, still also has some shortcomings.For example to identify cursor of mouse action, conventionally can adopt the mode of dot matrix identification.This mode discrimination is higher, but owing to relating to a large amount of recognizers, process is complicated, and institute's recognition reaction is blunt.And for gesture identification, less demanding to track accuracy of identification, but higher to rate request, therefore with regard to a kind of simply and fast recognition method of needs.Particularly, in preschool education field, not only will accomplish simple high speed, also need gesture identifying device safety, method to design original, applicable child operates.
Summary of the invention
The object of the invention is to have overcome deficiency of the prior art, a kind of apparatus and method of the gesture identification for preschool education are provided, this device is simple and compact, be well suited for child's operation, the method fast operation, recognition efficiency are high, can select as the input method of many preschool education softwares.
In order to solve the problems of the technologies described above, the present invention is achieved through the following technical solutions:
The device of this gesture identification for preschool education is comprised of PC, camera and special touch pad and height adjustable support thereof.The touch pad that this piece is special can make a transparent rigid plastic sheet, be placed in before camera above support nearby, be not connected with camera, PC, do not arrange too high (child's use), on touch pad, be carved with the multi-direction coordinate system using in the method, in initial point and the shape of palm on the intersection point place class of certain length drawn circle and axis of orientation as radius of take.
The direction of the gesture identification for preschool education of this and described matched with devices, comprises the following steps:
(1) select the suitable touch pad of a block size to be placed in before camera, over against camera, suitable by highly arranging, half path length recorded thereon and change in coordinate axis direction;
(2) on screen, take current cursor position as initial point, set up multi-direction coordinate system, this coordinate axis is identical with touch pad change in coordinate axis direction, and length is according to processing in proportion;
(3) in conjunction with radius and the direction of touch pad, in gesture computing module, preset the error angular range between each coordinate direction axle, and the minor increment between terminal point coordinate and the starting point left side;
(4) hand is placed on to touch pad initial point, camera photographic images, processes through Hand Gesture Segmentation and gray scale, obtains current hand gesture location, and and screen on initial point overlap; Then along a direction axle, move hand to circumferential position, the terminal hand gesture location after record move;
(5) whether the distance that judges point-to-point transmission is less than minor increment, if be less than minor increment, this exercise void, stops identification; If be greater than or equal to minor increment, whether error in judgement angle within the scope of the angular error of setting, if not, be null result again, stops judging;
(6) if there is result,, from the photo of taking, judge the direction that gesture moves, calculate distance mobile in coordinate axis, obtain direction and coordinate figure that cursor need to move, and export corresponding actions;
(7) one-off has been identified.Then hand leaves touch pad, is put into initial point, starts action recognition next time, so constantly circulation.
Compared with prior art, the invention has the beneficial effects as follows:
The invention provides a kind of apparatus and method of the input of the gesture for preschool education of simple and fast, compared with prior art, its device is simple, applicability is high, the adjustable height touch pad being equipped with for child especially, it is a kind of device of simulated touch plate, and the uncontrollability of gesture identification is become to controlled.And as supporting method with it, fast operation, recognition efficiency are high, operation has certain method for normalizing, and speed is fast.
Accompanying drawing explanation
Fig. 1 is the method operational flowchart of gesture identification of the present invention
Fig. 2 is the schematic diagram of device touch pad of the present invention and support thereof
Embodiment
Below in conjunction with accompanying drawing and embodiment, the present invention is described in further detail:
The device of this gesture identification for preschool education is comprised of PC, camera and special touch pad and height adjustable support thereof.The touch pad that this piece is special can make a transparent rigid plastic sheet, be placed in before camera above support nearby, be not connected with camera, PC, do not arrange too high (child's use), on touch pad, be carved with the multi-direction coordinate system using in the method, in initial point and the shape of palm on the intersection point place class of certain length drawn circle and axis of orientation as radius of take.We generally build up 8 direction coordinate systems coordinate system, upper, upper right, the right side, bottom right, under, lower-left, a left side, upper left submeter label be 1,2,3,4,5,6,7,8.
The undeclared part that relates in the present invention is same as the prior art or adopt prior art to be realized.

Claims (4)

1. apparatus and method for the gesture identification of preschool education, comprise that device is by PC, camera and special touch pad and height adjustable support thereof form, it is characterized in that: described touch pad, the touch pad that this piece is special can make a transparent rigid plastic sheet, be placed in before camera above support nearby, and camera, PC does not connect, do not arrange too high (child's use), on touch pad, be carved with the multi-direction coordinate system using in the method, in initial point and the shape of palm on the intersection point place class of certain length drawn circle and axis of orientation as radius of take, described coordinate system, we generally build up 8 direction coordinate systems coordinate system, upper, upper right, the right side, bottom right, under, lower-left, a left side, upper left submeter label be 1,2,3,4,5,6,7,8.
2. the apparatus and method of the gesture identification for preschool education according to claim 1, it is characterized in that: the step of described method is: (1) selects the suitable touch pad of a block size to be placed in before camera, over against camera, suitable by highly arranging, half path length recorded thereon and change in coordinate axis direction; (2) on screen, a current cursor position is initial point, sets up multi-direction coordinate system, and this coordinate axis is identical with touch pad change in coordinate axis direction, and length is according to processing in proportion; (3) in conjunction with radius and the direction of touch pad, in gesture computing module, preset the error angular range between each coordinate direction axle, and the minor increment between terminal point coordinate and the starting point left side; (4) hand is placed on to touch pad initial point, camera photographic images, processes through Hand Gesture Segmentation and gray scale, obtains current hand gesture location, and and screen on initial point overlap; Then along a direction axle, move hand to circumferential position, the terminal hand gesture location after record move; 5) whether the distance that judges point-to-point transmission is less than minor increment, if be less than minor increment, this exercise void, stops identification; If be greater than or equal to minor increment, whether error in judgement angle within the scope of the angular error of setting, if not, be null result again, stops judging; (6) if there is result,, from the photo of taking, judge the direction that gesture moves, calculate distance mobile in coordinate axis, obtain direction and coordinate figure that cursor need to move, and export corresponding actions; (7) one-off has been identified, and then hand leaves touch pad, is put into initial point, starts action recognition next time, so constantly circulation.
3. the apparatus and method of the gesture identification for preschool education according to claim 1, it is characterized in that: describedly apart from disposal route, be: take current cursor position as initial point, set up multi-direction coordinate system, this coordinate axis is identical with touch pad change in coordinate axis direction, length (for example supposes that the distance between cursor is c according to b processing in proportion, cursor is 3cm to the distance of next target light cursor position now, direction is for to the right, and touch pad mid point From Left hand-type pattern is 27cm, a=27cm so, b=c/a=1/9, so just set up gesture distance and light displacement between relation), described result, from the photo of taking, judges the direction that gesture moves, and calculates distance mobile in coordinate axis, obtains direction and coordinate figure that cursor need to move, and exports corresponding actions.
4. the apparatus and method of the gesture identification for preschool education according to claim 1, it is characterized in that: described in do while setting in advance, radius and direction in conjunction with touch pad, in gesture computing module, preset the error angular range between each coordinate direction axle, and the minor increment between terminal point coordinate and the starting point left side; During described operation, make a decision, mode is for to be placed on touch pad initial point by hand, and camera photographic images is processed through Hand Gesture Segmentation and gray scale, obtains current hand gesture location, and and screen on initial point overlap; Then along a direction axle, move hand to circumferential position, the terminal hand gesture location after record move; In this process, obtain the gesture displacement a ' that analysis obtains through photo, the magnitude relationship of judgement a ' and a.
CN201210376723.2A 2012-10-06 2012-10-06 Gesture recognition device and gesture recognition method for early childhood education Pending CN103713776A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210376723.2A CN103713776A (en) 2012-10-06 2012-10-06 Gesture recognition device and gesture recognition method for early childhood education

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210376723.2A CN103713776A (en) 2012-10-06 2012-10-06 Gesture recognition device and gesture recognition method for early childhood education

Publications (1)

Publication Number Publication Date
CN103713776A true CN103713776A (en) 2014-04-09

Family

ID=50406807

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210376723.2A Pending CN103713776A (en) 2012-10-06 2012-10-06 Gesture recognition device and gesture recognition method for early childhood education

Country Status (1)

Country Link
CN (1) CN103713776A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105407262A (en) * 2014-09-16 2016-03-16 洪永川 Camera
CN110802594A (en) * 2019-11-08 2020-02-18 珠海市一微半导体有限公司 Gesture control method, chip and robot walking baby

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105407262A (en) * 2014-09-16 2016-03-16 洪永川 Camera
CN110802594A (en) * 2019-11-08 2020-02-18 珠海市一微半导体有限公司 Gesture control method, chip and robot walking baby

Similar Documents

Publication Publication Date Title
CN103097996B (en) Motion control touch screen method and apparatus
CN103472916B (en) A kind of man-machine interaction method based on human body gesture identification
US9013430B2 (en) Hand and finger registration for control applications
US20120038652A1 (en) Accepting motion-based character input on mobile computing devices
CN102023784A (en) Method and equipment for inputting characters in non-contact mode
CN109145802B (en) Kinect-based multi-person gesture man-machine interaction method and device
EP2802975A1 (en) Intelligent touchscreen keyboard with finger differentiation
CN101408824A (en) Method for recognizing mouse gesticulation
Jingqiu et al. An ARM-based embedded gesture recognition system using a data glove
Guimbretière et al. Bimanual marking menu for near surface interactions
CN105653071A (en) Information processing method and electronic device
WO2012163124A1 (en) Spatial motion-based input method and terminal
CN105487689A (en) Ring mouse and method for operating mobile terminal through same
KR20150024247A (en) Method and apparatus for executing application using multiple input tools on touchscreen device
CN105242776A (en) Control method for intelligent glasses and intelligent glasses
CN101869484A (en) Medical diagnosis device having touch screen and control method thereof
CN102135839A (en) Terminal and input method thereof
US9342169B2 (en) Terminal device
CN102426491A (en) Multipoint touch realization method and system for touch screen
CN103870170A (en) Cursor control method, terminals and system
CN104268118A (en) Mathematical formula calculator including touch screen and method for identifying mathematical formulas
CN103713776A (en) Gesture recognition device and gesture recognition method for early childhood education
CN105034006A (en) Finger-guessing game robot based on LeapMotion apparatus and finger-guessing game gesture recognition method
CN101794182B (en) Method and equipment for touch input
CN102147681B (en) Input method and device based on touch screen

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20140409