CN104516483A - Gesture language input identification system based on motion-sensing technology - Google Patents

Gesture language input identification system based on motion-sensing technology Download PDF

Info

Publication number
CN104516483A
CN104516483A CN201310449639.3A CN201310449639A CN104516483A CN 104516483 A CN104516483 A CN 104516483A CN 201310449639 A CN201310449639 A CN 201310449639A CN 104516483 A CN104516483 A CN 104516483A
Authority
CN
China
Prior art keywords
operator
input
body sense
motion
action
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310449639.3A
Other languages
Chinese (zh)
Inventor
娄保东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Zhuanchuang Intellectual Property Service Co Ltd
Original Assignee
Nanjing Zhuanchuang Intellectual Property Service Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Zhuanchuang Intellectual Property Service Co Ltd filed Critical Nanjing Zhuanchuang Intellectual Property Service Co Ltd
Priority to CN201310449639.3A priority Critical patent/CN104516483A/en
Publication of CN104516483A publication Critical patent/CN104516483A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • G06V40/28Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Position Input By Displaying (AREA)

Abstract

The invention is applicable to the surdomute, and provides a gesture language input identification system based on motion-sensing technology. The gesture language input identification system based on motion-sensing technology comprises the following steps: configuring a term action characteristic database; configuring a motion-sensing device; obtaining focal points of the body profile and two hands of an operator; identifying that flatly putting two fists at the chest as the beginning of the input; doing gesture language actions by the operator, displaying action traces of the two hands on a display screen; identifying the ending of the input by the motion-sensing device when the operator pauses after an action; characteristically matching corresponding terms via an action trace database by a computer; ranking each candidate term based on the characteristic matched degree; selecting a corresponding term by the gesture of the operator. The gesture language input identification system based on motion-sensing technology does not depend on the conventional keyboard, thereby the surdomute is able to quickly input in the computer by using the gesture language; the operation is simple, and the input is free.

Description

Based on the sign language input recognition system of body sense technology
Technical field
The present invention relates to a kind of Sign Language Recognition input system based on body sense technology, specifically relates to a kind ofly carry out the software of fast input by the identification sign language of body sense technology.
Background technology
Since there being computing machine to start in the world, human-computer interaction technology just produces with it, and simultaneously along with the evolution of computing machine, this technology constantly promotes.So-called man-machine interaction is exactly the mode that people and computing machine are come into contacts with.This is apparent to a great extent, and we of today are easy to, just by input through keyboard instruction, allow computing machine understand these instructions and run some programs.And the mode of man-machine interaction now also gets more and more.
Body sense technology, namely people very directly can use limb action, with device or the environment interaction of periphery, and without the need to using the opertaing device of any complexity, people just can be allowed to do interaction with content with being personally on the scene.The Leap 3D of Kinect and the Leap Motion company of Microsoft is exactly two main brands in current body sense input field, under the prerequisite of operator without the need to hand-held any induction stage property, is caught by camera and sensor, the action of identifying operation person.Along with development and the maturation of body sense technology, body sense technology is applied to computer input field and is achieved, for the mankind provide more comfortable and natural computer input mode.
Image matching technology, the focus that people study and use in recent decades always, it is in transformation space, find one or more conversion, make from two width of the Same Scene of different time, different sensors or different visual angles or multiple image spatially consistent, be all widely used in remote Sensing Image Analysis, submarine inspection, stereoscopic vision, the automatically field such as map, motion analysis at present.The hardware device utilizing some special can reach the Auto-matching of image.But they are mostly expensive, complicated operation, image matching technology provides good solution for this problem.Study feasible image matching technology is the target that people's unremitting effort is pursued always.
On-line handwritten recognition refers to the process orderly trace information produced when writing on handwriting equipment being converted into Hanzi internal code, is actually the mapping process of coordinate sequence to Hanzi internal code of handwriting tracks.Handwriting recognition has developed into a certain degree, can accomplish point-device identification, but but do not have too many development in movement locus identification.
Summary of the invention
The object of the invention is to overcome deficiency of the prior art, provide one and serve deaf-mute colony, solving deaf-mute cannot phonetic entry problem, conventional keyboard need not be relied on, only need to complete corresponding sign language action before body sense equipment inductive spacing, simple to operate, input is freely based on the Sign Language Recognition input system of body sense technology.
In order to solve the problems of the technologies described above, the present invention is achieved through the following technical solutions:
(1) arrange the movement locus storehouse of including each word, corresponding to a word, characteristic action can be multiple, and to reduce, input is improper makes troubles;
(2) body sense equipment is set;
(3) operator keeps right sitting position gesture, obtains importer body contour, naturally reaches out one's hands, and body sense equipment acquisition both hands as body sense focus, and show both hands on a display screen, highlights with comparatively bright-colored;
(4) before the two fist of operator lies against chest, body sense recognition of devices its start for input;
(5) operator does sign language action, display screen display double-handed exercise track;
(6) pause after operator one action, body sense recognition of devices is end of input;
(7) computing machine carries out the corresponding word of characteristic matching by movement locus storehouse;
(8) to be sorted each candidate's word by characteristic matching degree height;
(9) corresponding word is selected by operator's gesture;
Compared with prior art, the invention has the beneficial effects as follows:
At on-keyboard or when needing to input fast, the present invention provides a kind of simple to operate can to deaf-mute colony, inputs input system freely, makes deaf-mute more freely can use computing machine.If apply to office realm, while improving input speed, the work that it also makes deaf-mute can complete a series of normal person just to complete.
Accompanying drawing explanation
Fig. 1 is operational flowchart of the present invention.
Embodiment
Below in conjunction with accompanying drawing and embodiment, the present invention is described in further detail:
(1) arrange the movement locus storehouse of including each word, corresponding to a word, characteristic action can be multiple, and to reduce, input is improper makes troubles;
(2) body sense equipment is set;
(3) operator keeps right sitting position gesture, obtains importer body contour, naturally reaches out one's hands, and body sense equipment acquisition both hands as body sense focus, and show both hands on a display screen, highlights with comparatively bright-colored;
(4) before the two fist of operator lies against chest, body sense recognition of devices its start for input;
(5) operator does sign language action, display screen display double-handed exercise track;
(6) pause after operator one action, body sense recognition of devices is end of input;
(7) computing machine carries out the corresponding word of characteristic matching by movement locus storehouse;
(8) to be sorted each candidate's word by characteristic matching degree height;
(9) corresponding word is selected by operator's gesture.
The undeclared part related in the present invention is same as the prior art or adopt prior art to be realized.

Claims (2)

1., based on a Sign Language Recognition input system for body sense technology, it is characterized in that, comprising:
(1) arrange the movement locus storehouse of including each word, corresponding to a word, characteristic action can be multiple, and to reduce, input is improper makes troubles;
(2) body sense equipment is set;
(3) operator keeps right sitting position gesture, obtains importer body contour, naturally reaches out one's hands, and body sense equipment acquisition both hands as body sense focus, and show both hands on a display screen, highlights with comparatively bright-colored;
(4) before the two fist of operator lies against chest, body sense recognition of devices its start for input;
(5) operator does sign language action, display screen display double-handed exercise track;
(6) pause after operator one action, body sense recognition of devices is end of input;
(7) computing machine carries out the corresponding word of characteristic matching by movement locus storehouse;
(8) to be sorted each candidate's word by characteristic matching degree height;
(9) corresponding word is selected by operator's gesture.
2. handwriting recognition input system according to claim 1, is characterized in that: described body sense identification equipment focus is operator's both hands; Described input start method is for keeping flat two fist before chest; The time length that described part getting stuck is regarded as end of input can be adjusted by operator oneself.
CN201310449639.3A 2013-09-28 2013-09-28 Gesture language input identification system based on motion-sensing technology Pending CN104516483A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310449639.3A CN104516483A (en) 2013-09-28 2013-09-28 Gesture language input identification system based on motion-sensing technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310449639.3A CN104516483A (en) 2013-09-28 2013-09-28 Gesture language input identification system based on motion-sensing technology

Publications (1)

Publication Number Publication Date
CN104516483A true CN104516483A (en) 2015-04-15

Family

ID=52791935

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310449639.3A Pending CN104516483A (en) 2013-09-28 2013-09-28 Gesture language input identification system based on motion-sensing technology

Country Status (1)

Country Link
CN (1) CN104516483A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105975081A (en) * 2016-05-24 2016-09-28 深圳市敢为软件技术有限公司 Motion control method and device
CN106570473A (en) * 2016-11-03 2017-04-19 深圳量旌科技有限公司 Deaf-mute sign language recognition interactive system based on robot
CN107479686A (en) * 2016-06-08 2017-12-15 北京数码视讯科技股份有限公司 A kind of system of gesture identification, method and apparatus

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105975081A (en) * 2016-05-24 2016-09-28 深圳市敢为软件技术有限公司 Motion control method and device
CN107479686A (en) * 2016-06-08 2017-12-15 北京数码视讯科技股份有限公司 A kind of system of gesture identification, method and apparatus
CN106570473A (en) * 2016-11-03 2017-04-19 深圳量旌科技有限公司 Deaf-mute sign language recognition interactive system based on robot

Similar Documents

Publication Publication Date Title
US20150084859A1 (en) System and Method for Recognition and Response to Gesture Based Input
Argyros et al. Vision-based interpretation of hand gestures for remote control of a computer mouse
CN104463152B (en) A kind of gesture identification method, system, terminal device and Wearable
US8902198B1 (en) Feature tracking for device input
US20130335318A1 (en) Method and apparatus for doing hand and face gesture recognition using 3d sensors and hardware non-linear classifiers
JP2013080326A5 (en)
CN103809733A (en) Man-machine interactive system and method
CN110826835A (en) Glove-based acupuncture training method, system, platform and storage medium
Chen et al. Research and implementation of sign language recognition method based on Kinect
Matlani et al. Virtual mouse using hand gestures
CN104460967A (en) Recognition method of upper limb bone gestures of human body
CN106293099A (en) Gesture identification method and system
Francis et al. Significance of hand gesture recognition systems in vehicular automation-a survey
CN104516483A (en) Gesture language input identification system based on motion-sensing technology
Geetha et al. Dynamic gesture recognition of Indian sign language considering local motion of hand using spatial location of Key Maximum Curvature Points
Abdallah et al. An overview of gesture recognition
Dinh et al. Smart home appliance control via hand gesture recognition using a depth camera
CN104951083A (en) Remote gesture input method and input system
Chen et al. A generic framework for the design of visual-based gesture control interface
Soroni et al. Hand Gesture Based Virtual Blackboard Using Webcam
CN203070205U (en) Input equipment based on gesture recognition
CN105045390A (en) Human upper limb skeleton gesture identification method
Dadiz et al. Go-Mo (Go-Motion): An android mobile application detecting motion gestures for generating basic mobile phone commands utilizing KLT algorithm
Pradeep et al. Advancement of sign language recognition through technology using python and OpenCV
Xue et al. Gesture interaction and augmented reality based hand rehabilitation supplementary system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20150415

WD01 Invention patent application deemed withdrawn after publication