CN102723019A - Sign language teaching system - Google Patents
Sign language teaching system Download PDFInfo
- Publication number
- CN102723019A CN102723019A CN2012101610068A CN201210161006A CN102723019A CN 102723019 A CN102723019 A CN 102723019A CN 2012101610068 A CN2012101610068 A CN 2012101610068A CN 201210161006 A CN201210161006 A CN 201210161006A CN 102723019 A CN102723019 A CN 102723019A
- Authority
- CN
- China
- Prior art keywords
- sign language
- data glove
- camera
- computing machine
- teaching software
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a sign language teaching system, which comprises a data glove, a computer with a camera and sign language teaching software, wherein the sign language teaching software is installed in the computer with the camera; a sensor is arranged on the data glove; and the sign language teaching software comprises a sign language resource library, a sign language demonstration module and a video and audio sensing module. According to the sign language teaching system, the deaf and the dumb can conveniently, quickly and efficiently learn a sign language, and learning quality is ensured.
Description
Technical field
The present invention relates to field of systems software, relate in particular to a kind of sign language tutoring system, convenient deaf and dumb personage's study.
Background technology
Sign language is the language that the deaf-mute uses for the deaf and dumb personage communication way that in life, is absolutely necessary, and it is to be aided with the expression posture and the more stable expression system that constitutes by the action of hand shape, is a kind of special language of communicating by action/vision.Human interaction is often excellent in voice and affection, and except adopting natural language (spoken, written language), human body language (expression, body gesture, gesture) also is one of basic mode of human interaction.
Compare with human interaction; Man-machine interaction is just much stiff; Thereby the researching human body language understanding, i.e. the perception of human body language, but and the information fusion of human body language and natural language extremely significant for the practicality of human language understanding level that improves computing machine and reinforcement man-machine interface.Sign language is a very important ingredient of human body language; It is to comprise the maximum a kind of human body language of quantity of information; It is identical with the ability to express of natural languages such as language and written word, thereby the man-machine interaction aspect, and sign language can be used as a kind of means fully; And having very strong visual effect, it is lively, image, directly perceived.
Summary of the invention
The technical matters that the present invention mainly solves has provided a kind of sign language tutoring system, and convenient deaf and dumb personage learns sign language, the rate more quickly and effectively of study, and guaranteed the quality of learning.
To achieve these goals; Technical scheme of the present invention is; A kind of sign language tutoring system is provided, has comprised data glove, have the computing machine and the sign language teaching software of camera, described sign language teaching software is installed in the computing machine that has camera; Described data glove is provided with inductor, and described sign language teaching software comprises:
The sign language resources bank has been included the whole sign language gestures in " Chinese sign language dictionary ";
The sign language demonstration module is play the sign language gesture of including in the sign language resources bank, can according to condition search for broadcast, sees through 3d personage's ratio and goes out gesture and then study sign language;
Audio-visual induction module through the sign language data of camera picked-up target person data glove, and sends to the sign language resources bank with the sign language data and carries out sign language and resolve and produce the discernible Sign Language Recognition information of user.
In preferred embodiment of the present invention, described data glove is connected through USB with computing machine.
In preferred embodiment of the present invention, described inductor comprises finger bend inductor and arm induction device.
A kind of sign language tutoring system of the present invention; Comprise data glove, have the computing machine and the sign language teaching software of camera; With the computing machine is the terminal, and the sign language demonstration module in the sign language teaching software is play the sign language animation with 3d personage's gesture video picture with various visual angles, lets deaf and dumb personage reach the immediate effect of study; And the sign language resources bank and the audio-visual induction module that see through in the sign language teaching software combine video picture and speech recognition; Reach sign language exercise and the function of testting on the line, let deaf and dumb personage easily learn sign language, and guaranteed the quality of study.
Embodiment
Set forth in detail in the face of preferred embodiment of the present invention down, thereby protection scope of the present invention is made more explicit defining so that advantage of the present invention and characteristic can be easier to it will be appreciated by those skilled in the art that.
A kind of sign language tutoring system provided by the invention comprises data glove, has the computing machine and the sign language teaching software of camera.Wherein, the sign language teaching software is installed in the computing machine that has camera, and data glove is provided with inductor, and described sign language teaching software comprises:
The sign language resources bank has been included the whole sign language gestures in " Chinese sign language dictionary ";
The sign language demonstration module is play the sign language gesture of including in the sign language resources bank, can according to condition search for broadcast, sees through 3d personage's ratio and goes out gesture and then study sign language;
Audio-visual induction module through the sign language data of camera picked-up target person data glove, and sends to the sign language resources bank with the sign language data and carries out sign language and resolve and produce the discernible Sign Language Recognition information of user.
Data glove among the present invention is connected through USB with computing machine, and data glove is provided with inductor, and wherein, inductor comprises finger bend inductor and arm induction device.
The finger bend inductor is a kind of meeting changes resistance value along with flexibility a special sensing element.The resistance value of finger bend inductor when keeping flat is approximately 10K ohm, and along with the degree of bending, resistance value also is first linear change at certain segment limit, and the finger bend inductor is approximately 30K ohm to 40K ohm bending to 90 resistance values when spending.
The arm induction device, be a kind of can the sensing 3-axis acceleration and export the accekeration wafer of X axle, Y axle and Z-direction.The arm induction device only need provide the power supply of one group of 3V, and this arm induction device will constantly be seen the data of the 3-axis acceleration position that is sensed at present off.
Data glove among the present invention is connected through USB with computing machine; Open the sign language demonstration module in the sign language teaching software; Can according to condition search for and play the sign language gesture, deaf and dumb personage puts on data glove, carries out learning by imitation; Audio-visual induction module receives the message of the transmission of data glove in the sign language teaching software through the camera of computing machine; Pass to the sign language resources bank to message and carry out the sign language parsing and produce the discernible Sign Language Recognition information of user, realized deaf and dumb personage rate ground study more quickly and effectively, and guaranteed the quality of study.
The sign language tutoring system that the present invention discloses; Comprise data glove, have the computing machine and the sign language teaching software of camera; With the computing machine is the terminal, and the sign language demonstration module in the sign language teaching software is play the sign language animation with 3d personage's gesture video picture with various visual angles, lets deaf and dumb personage reach the immediate effect of study; And the sign language resources bank and the audio-visual induction module that see through in the sign language teaching software combine video picture and speech recognition; Reach sign language exercise and the function of testting on the line, let deaf and dumb personage easily learn sign language, and guaranteed the quality of study.
The above; Be merely embodiment of the present invention; But protection scope of the present invention is not limited thereto; Any those of ordinary skill in the art are in the technical scope that the present invention disclosed, and variation or the replacement that can expect without creative work all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection domain that claims were limited.
Claims (3)
1. sign language tutoring system; It is characterized in that comprise data glove, have the computing machine and the sign language teaching software of camera, described sign language teaching software is installed in the computing machine that has camera; Described data glove is provided with inductor, and described sign language teaching software comprises:
The sign language resources bank has been included the whole sign language gestures in " Chinese sign language dictionary ";
The sign language demonstration module is play the sign language gesture of including in the sign language resources bank, can according to condition search for broadcast, sees through 3d personage's ratio and goes out gesture and then study sign language;
Audio-visual induction module through the sign language data of camera picked-up target person data glove, and sends to the sign language resources bank with the sign language data and carries out sign language and resolve and produce the discernible Sign Language Recognition information of user.
2. sign language tutoring system according to claim 1 is characterized in that described data glove is connected through USB with computing machine.
3. sign language tutoring system according to claim 1 is characterized in that, described inductor comprises finger bend inductor and arm induction device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101610068A CN102723019A (en) | 2012-05-23 | 2012-05-23 | Sign language teaching system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101610068A CN102723019A (en) | 2012-05-23 | 2012-05-23 | Sign language teaching system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102723019A true CN102723019A (en) | 2012-10-10 |
Family
ID=46948762
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012101610068A Pending CN102723019A (en) | 2012-05-23 | 2012-05-23 | Sign language teaching system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102723019A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104599553A (en) * | 2014-12-29 | 2015-05-06 | 闽南师范大学 | Barcode recognition-based sign language teaching system and method |
| CN104599554B (en) * | 2014-12-29 | 2017-01-25 | 闽南师范大学 | Two-dimensional code recognition-based sign language teaching system and method |
| CN108091215A (en) * | 2018-01-09 | 2018-05-29 | 绥化学院 | It is a kind of based on it is multimedia listen barrier student teaching appliance |
| CN110491250A (en) * | 2019-08-02 | 2019-11-22 | 安徽易百互联科技有限公司 | A kind of deaf-mute's tutoring system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101504832A (en) * | 2009-03-24 | 2009-08-12 | 北京理工大学 | Virtual performance system based on hand motion sensing |
| CN101577062A (en) * | 2008-12-30 | 2009-11-11 | 浙江工业大学 | Space encoding-based method for realizing interconversion between sign language motion information and text message |
| CN101609618A (en) * | 2008-12-23 | 2009-12-23 | 浙江工业大学 | Real-time hand language AC system based on space encoding |
| CN102063825A (en) * | 2010-12-15 | 2011-05-18 | 北京理工大学 | Sign language recognizing device based on data gloves |
| WO2011107420A1 (en) * | 2010-03-01 | 2011-09-09 | Institut für Rundfunktechnik GmbH | System for translating spoken language into sign language for the deaf |
-
2012
- 2012-05-23 CN CN2012101610068A patent/CN102723019A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101609618A (en) * | 2008-12-23 | 2009-12-23 | 浙江工业大学 | Real-time hand language AC system based on space encoding |
| CN101577062A (en) * | 2008-12-30 | 2009-11-11 | 浙江工业大学 | Space encoding-based method for realizing interconversion between sign language motion information and text message |
| CN101504832A (en) * | 2009-03-24 | 2009-08-12 | 北京理工大学 | Virtual performance system based on hand motion sensing |
| WO2011107420A1 (en) * | 2010-03-01 | 2011-09-09 | Institut für Rundfunktechnik GmbH | System for translating spoken language into sign language for the deaf |
| CN102063825A (en) * | 2010-12-15 | 2011-05-18 | 北京理工大学 | Sign language recognizing device based on data gloves |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104599553A (en) * | 2014-12-29 | 2015-05-06 | 闽南师范大学 | Barcode recognition-based sign language teaching system and method |
| CN104599554B (en) * | 2014-12-29 | 2017-01-25 | 闽南师范大学 | Two-dimensional code recognition-based sign language teaching system and method |
| CN104599553B (en) * | 2014-12-29 | 2017-01-25 | 闽南师范大学 | Barcode recognition-based sign language teaching system and method |
| CN108091215A (en) * | 2018-01-09 | 2018-05-29 | 绥化学院 | It is a kind of based on it is multimedia listen barrier student teaching appliance |
| CN110491250A (en) * | 2019-08-02 | 2019-11-22 | 安徽易百互联科技有限公司 | A kind of deaf-mute's tutoring system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10564714B2 (en) | Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects | |
| EP3335096A1 (en) | Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects | |
| CN102779000A (en) | User interaction system and method | |
| CN102723019A (en) | Sign language teaching system | |
| CN107272908B (en) | Gesture recognition device, system and gesture recognition method | |
| CN102426486A (en) | Stereo interaction method and operated apparatus | |
| WO2019087564A1 (en) | Information processing device, information processing method, and program | |
| CN105068658A (en) | Man-machine interaction device capable of performing virtual environment control | |
| CN110442233A (en) | A kind of augmented reality key mouse system based on gesture interaction | |
| CN204791614U (en) | Juvenile study machine people of intelligence | |
| Devi et al. | Low cost tangible glove for translating sign gestures to speech and text in Hindi language | |
| CN204613875U (en) | A kind of virtual reality display system | |
| Van Erp et al. | What comes after telepresence? embodiment, social presence and transporting one’s functional and social self | |
| Caporusso et al. | Enabling touch-based communication in wearable devices for people with sensory and multisensory impairments | |
| KR102606116B1 (en) | Head mounted display and, the controlling method thereof | |
| CN204883058U (en) | Virtual helmetmounted display | |
| Kimura et al. | CookieFlavors: easy building blocks for wireless tangible input | |
| Spanogianopoulos et al. | Human computer interaction using gestures for mobile devices and serious games: A review | |
| WO2018158753A1 (en) | System and method enabling an interactive wearable as an educational supplement for hearing impaired individuals | |
| CN107831952A (en) | A kind of Fei Jubian projects Integral electronic touch-control blank | |
| CN208212444U (en) | A kind of child attention training device based on eye movement and touch screen interaction | |
| CN205562963U (en) | Novel interactive experience equipment is felt to body | |
| CN207037599U (en) | A kind of intelligent glasses based on eyeball tracking sensing technology | |
| CN205405935U (en) | Interactive classroom of foreign language environment | |
| CN209343599U (en) | Blind person's sense of touch salient point book |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20121010 |