CN104599554B - Two-dimensional code recognition-based sign language teaching system and method - Google Patents
Two-dimensional code recognition-based sign language teaching system and method Download PDFInfo
- Publication number
- CN104599554B CN104599554B CN201410834753.2A CN201410834753A CN104599554B CN 104599554 B CN104599554 B CN 104599554B CN 201410834753 A CN201410834753 A CN 201410834753A CN 104599554 B CN104599554 B CN 104599554B
- Authority
- CN
- China
- Prior art keywords
- sign language
- quick response
- response code
- instructor
- glove
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Electrically Operated Instructional Devices (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a two-dimensional code recognition-based sign language teaching system and method. The system comprises teaching gloves, a two-dimensional code scanner, a processor and a display device, wherein the front face, the back face and the side face of each fingerstall, palm part and arm part of each glove are provided with two-dimensional codes respectively for referring to the front face, the back face and the side face of each finger, palm and arm of a teacher; the two-dimensional code scanner is used for scanning on the front side or back side of a sign language gesture of the teacher and acquiring two-dimensional code information on the gloves; the processor is installed with sign language simulation software and is provided with a sign language code library and a character database; many simulating hands for making sign language gestures are stored in the sign language code library; character information matched with the meanings of various sign languages are stored in the character database; the display device is used for displaying the simulating hand and the character information corresponding to the sign language action of the teacher. The system and the method have the advantages of easiness in operation, high recognition speed and capability of helping learners to quickly understand the real meanings of the sign languages of the teacher to guarantee quicker learning and higher efficiency of the learner and guarantee the learning quality.
Description
Technical field
The present invention relates to a kind of sign language teaching system, more particularly to a kind of sign language teaching system based on Quick Response Code identification
And method.
Background technology
Sign language is requisite a kind of effective communication approach in deaf and dumb personage's life, is the special language that deaf mute uses
Speech.Sign language is a very important ingredient of Body Languages, and it is to comprise a kind of most Body Languages of quantity of information, and
Vividly, vivid, directly perceived, there is very strong visual effect.However, because many sign languages have usually contained multiple implications, leading to deaf
During mute is learnt by sign language, or other non-deaf mute scholars, during study sign language, often occur
Understand relatively more tired right, the not good problem of learning effect.In this regard, prior art occurs in that some are directed to the Sign Language Recognition of this respect and produce
Product, comparative maturity mainly have two big class:
1st, based on camera technique, comprising: common shooting, infrared photography etc..Purpose is by hand-type and background separation, obtains
The form of handss, the form further according to handss judges its connotation.This technology is to the resolution imaging, the configuration of computer and light etc.
Require very high, recognition speed is slower.
2nd, the data glove being constituted with sensor technology, this glove operation is extremely complex, is not suitable for the religion of common classroom
Learn.
Content of the invention
The invention provides a kind of sign language teaching system based on Quick Response Code identification and method, which overcome background technology institute
The weak point stated.
The technical solution adopted for the present invention to solve the technical problems is: a kind of sign language teaching system based on Quick Response Code identification
System, comprising:
Teaching glove, each fingerstall of this glove, palm part, the front at arm position, reverse side, side are respectively equipped with
Quick Response Code, for referring to front, reverse side and the side of each finger, palm and the arm of instructor；
Dimensional code scanner, for the Quick Response Code on the front side of instructor's sign language attitude or rear side scanning and acquisition glove
Information；
Processor, is provided with sign language simulation software, and it has sign language code database and lteral data storehouse, and sign language encodes library storage
Many is had to make the Simulated hands of sign language attitude, lteral data stock contains the Word message matching with the implication of various sign languages；
Display device, for showing the Simulated hand corresponding with the sign language action of instructor and Word message；
The 2 D code information getting is transferred to processor by dimensional code scanner, and processor enters to the Quick Response Code receiving
Row decoding and identification, and recall the Simulated hand matching with the sign language attitude of instructor and Word message, shown by display device
Illustrate.
Further, the Quick Response Code at each position on described glove is compiled using the simulation drawing of the corresponding site of handss
Code.
Further, described dimensional code scanner is worn on the front of instructor, or be arranged at one can for instructor wearing
Medicated clothing front cloth.
Further, each Quick Response Code in described glove front each Quick Response Code corresponding with its back side is using reversion coding；
The Quick Response Code of the arm segment both sides of described glove is using reversion coding.
Further, described dimensional code scanner passes through data wire or communication by the 2 D code information getting
It is transferred to described processor.
Further, described display device is projecting apparatus screen.
A kind of sign language teaching method based on Quick Response Code identification, comprises the steps:
(1) sign language simulation software is installed within a processor in advance, this sign language simulation software has sign language code database and word
Data base, the sign language code database many that is stored with makes the Simulated hands of sign language attitude, and lteral data stock contains and various sign languages
The Word message that implication matches；Open this sign language simulation software；
(2) instructor wears teaching glove, each fingerstall of this glove, palm part, the front at arm position, anti-
Face, side are respectively equipped with Quick Response Code, for referring to front, reverse side and the side of each finger, palm and the arm of instructor；Religion
Scholar carries out sign language action in the sweep limitss of dimensional code scanner, and dimensional code scanner is by the two dimension on the glove scanning
Code is transferred to processor；
(3) processor enters row decoding and identification to the Quick Response Code receiving, and recalls relative with the sign language attitude of instructor
The Simulated hand answered and Word message, are shown by display device.
Further, in described step (2), the Quick Response Code at each position on described glove adopts the corresponding site of handss
Simulation drawing is encoded.
Further, in described step (2), described dimensional code scanner is worn on the front of instructor, or is arranged at one
Can be for the front cloth of the medicated clothing of instructor's wearing.
Further, in described step (3), described Word message is one or more groups of, if multigroup, then true by instructor
Make one group of Word message representing correct implication.
The method have the advantages that
The present invention coordinates dimensional code scanner to gather the sign language attitude of instructor by being provided with the glove of Quick Response Code, passes
It is defeated by and the processor of sign language simulation software is installed enters row decoding and identification, and recall and match with the sign language attitude of instructor
Simulated hand and Word message, are shown by display device, and not only simple to operate, recognition speed is fast additionally it is possible to help learns
The real meaning of person's fast understanding teacher's sign language, make learner learn more quickly and effectively rate it is ensured that learning quality.
Below in conjunction with drawings and Examples, the present invention is described in further detail；But one kind of the present invention is based on Quick Response Code
The sign language teaching system of identification and method are not limited to embodiment.
Brief description
Fig. 1 is the structural representation of the glove of the present invention；
Fig. 2 is the set location schematic diagram of the dimensional code scanner of the present invention.
Specific embodiment
Embodiment, refers to shown in accompanying drawing, a kind of sign language teaching system based on Quick Response Code identification of the present invention, comprising:
Teaching glove 1, each fingerstall of this glove 1, palm part, the front at arm position, reverse side, side set respectively
There is Quick Response Code 2, for referring to front, reverse side and the side of each finger, palm and the arm of instructor；Here, each two dimension
On the corresponding site that code 2 can be arranged at glove 1 in the way of using printing, it would however also be possible to employ the mode of stickup is arranged at glove 1
Corresponding site on, for example, first on multiple pasters, print corresponding Quick Response Code, more each paster is torn and corresponded to be pasted on handss
The corresponding site of set outer surface；
Dimensional code scanner 3, should be spliced by multiple probes to dimensional code scanner 3, in instructor's sign language
2 D code information on the front side of attitude or rear side scanning and acquisition glove 1；
Processor, this processor can be main frame, and it is provided with sign language simulation software, and this sign language simulation software has
There are sign language code database and lteral data storehouse, sign language code database is stored with and makes the Simulated hand of sign language attitude in a large number, lteral data storehouse
Be stored with a large amount of Word messages matching with various sign languages implications；
Display device, for showing the Simulated hand corresponding with the sign language action of instructor and Word message；Specifically, this shows
Showing device can be projecting apparatus screen.
Dimensional code scanner 3 passes through data wire or communication (for example passing through bluetooth, wifi etc.) by get
To processor, processor enters row decoding and identification to the Quick Response Code 2 receiving to Quick Response Code 2 information transfer, and recalls and instructor
The Simulated hand that matches of sign language attitude and Word message, shown by display device.
As one kind preferably, the Quick Response Code at each position on described glove 1 can adopt the simulation of the corresponding site of handss
Figure is encoded.As shown in Fig. 2 described dimensional code scanner 3 is arranged at the front cloth of a medicated clothing 4 that can dress for instructor.
Or it is also possible to dimensional code scanner 3 is worn on the front of instructor.
Due to during class-teaching of teacher the hand-type of Student oriented and scanning device towards hand-type contrary, thus, described glove 1 front
Each Quick Response Code 2 each Quick Response Code 2 corresponding with its back side using reversion coding；The two of the arm segment both sides of described glove 1
Dimension code 2 is using reversion coding.That is, each Quick Response Code 2 representing staff front is respectively arranged at the relevant position of glove 1 reverse side,
The each Quick Response Code 2 representing staff reverse side is respectively arranged at the relevant position in the front of glove 1, the arm both sides of staff will be represented
Quick Response Code 2 exchange the both sides of the arm segment being arranged at glove 1.For example, dimensional code scanner 3 surface sweeping centre of the palm position, right
The Simulated hand that should show is palm back.Because the side of palm part and each finger is narrower, thus can not be to its phase
The Quick Response Code 2 answered carries out reversion coding, and palm part and the positive and negative of each finger side can be sentenced by the positive and negative of arm side
Break and obtain.
A kind of sign language teaching method based on Quick Response Code identification of the present invention, comprises the steps:
(1) described sign language simulation software is installed within a processor in advance, and opens this sign language simulation software；
(2) instructor wears described teaching glove 1, and puts on the medicated clothing 4 that front is laid with described dimensional code scanner 3
(or dimensional code scanner 3 is worn on front)；Instructor makes a sign language in the sweep limitss of dimensional code scanner 3 and moves
Make, and keep couple of seconds, dimensional code scanner is scanned to each Quick Response Code 2 on the glove 1 towards it, and will scan
Quick Response Code 2 be transferred to processor；
(3) processor enters row decoding and identification to the Quick Response Code receiving, and recalls relative with the sign language attitude of instructor
The Simulated hand answered and Word message, are shown by projecting apparatus screen.Now, if shown word letter on projecting apparatus screen
Cease for multigroup, represent that the sign language attitude of this Simulated hand has multiple implications, then select by the oral determination of instructor or by mouse point
Represent one group of Word message of correct implication；
(4) instructor continues to make another sign language action, repeats above-mentioned teaching process.
A kind of sign language teaching system based on Quick Response Code identification of the present invention and method, can be by its dimensional code scanner
Each probe is designed to rotary type structure, then, during its scanning, can be scanned by rotation, the Quick Response Code making to scan
Three view finding figures are in tram, and by the anglec of rotation of the Quick Response Code scanning and probe (by this anglec of rotation
The azimuth information of palm, arm and each finger of instructor can be obtained) it is transferred to processor.In addition it is also possible to by two dimension
Code scanning device each probe be designed to fixed, and to be completed by processor rotate and obtain the anglec of rotation process, specifically
For: when processor enters row decoding and identification to the Quick Response Code receiving, according to the principle of two-dimensional code scanning, find image in 2 D code
Three view finding figures particular location, and return its position coordinates, then the position according to three view finding figures is judging figure
As the need of rotation, being carried out image rotation when picture deflection, make three view finding figures be located at correct position, and lead to
Cross obtain image rotation angle be worth to instructor palm, arm and each finger orientation (position), and with palm
Preferential with arm.
A kind of sign language teaching system based on Quick Response Code identification of the present invention and method, it can be used for deaf mute is carried out
Teaching, instructor's (or claiming teacher) carries out interaction by the language " sign language " communicating with deaf mute, and religion deaf mute's study is various to be known
Know.Or, it is contemplated that the present invention may be use with the non-deaf mute scholar of religion learns sign language, instructor passes through standardized sign language action of ratio, and joins
It is combined in the Simulated hand of display and Word message on projecting apparatus screen, make sign language learner not only learn to gesticulate sign language, additionally aid
Learner keeps the real meaning of sign language firmly in mind.
Above-described embodiment only be used for further illustrate the present invention a kind of sign language teaching system based on Quick Response Code identification and
Method, but the invention is not limited in embodiment, it is any that every technical spirit according to the present invention is made to above example
Simple modification, equivalent variations and modification, each fall within the protection domain of technical solution of the present invention.
Claims (10)
1. a kind of sign language teaching system based on Quick Response Code identification is it is characterised in that include:
Teaching glove, the front of each fingerstall of this glove, reverse side, side are respectively equipped with Quick Response Code, are used for referring to instructor
The front of each finger, reverse side and side；The front of the palm part of glove, reverse side and side are respectively equipped with Quick Response Code, use
In the front of the palm referring to instructor, reverse side and side；The front at arm position of glove, reverse side, side are respectively equipped with two
Dimension code, for referring to front, reverse side and the side of the arm of instructor；
Dimensional code scanner, for the Quick Response Code letter on the front side of instructor's sign language attitude or rear side scanning and acquisition glove
Breath；
Processor, is provided with sign language simulation software, and it has sign language code database and lteral data storehouse, and sign language code database is stored with perhaps
Make the Simulated hand of sign language attitude, lteral data stock contains the Word message matching with the implication of various sign languages more；
Display device, for showing the Simulated hand corresponding with the sign language action of instructor and Word message；
The 2 D code information getting is transferred to processor by dimensional code scanner, and processor is translated to the Quick Response Code receiving
Code and identification, and recall the Simulated hand matching with the sign language attitude of instructor and Word message, shown by display device
Come.
2. the sign language teaching system based on Quick Response Code identification according to claim 1 it is characterised in that: on described glove
The Quick Response Code at each position is encoded using the simulation drawing of the corresponding site of handss.
3. the sign language teaching system based on Quick Response Code identification according to claim 1 it is characterised in that: described Quick Response Code is swept
Retouch the front that device is worn on instructor, or the front cloth being arranged at a medicated clothing that can dress for instructor.
4. the sign language teaching system based on Quick Response Code identification according to claim 3 it is characterised in that: described glove front
Each Quick Response Code each Quick Response Code corresponding with its back side using reversion coding；The Quick Response Code of the arm segment both sides of described glove
Using reversion coding.
5. the sign language teaching system based on Quick Response Code identification according to claim 1 it is characterised in that: described Quick Response Code is swept
Retouch device and the 2 D code information getting is transferred to by described processor by data wire or communication.
6. the sign language teaching system based on Quick Response Code identification according to claim 1 it is characterised in that: described display device
For projecting apparatus screen.
7. a kind of sign language teaching method based on Quick Response Code identification it is characterised in that: comprise the steps:
(1) sign language simulation software is installed within a processor in advance, this sign language simulation software has sign language code database and lteral data
Storehouse, the sign language code database many that is stored with makes the Simulated hands of sign language attitude, and lteral data stock contains the implication with various sign languages
The Word message matching；Open this sign language simulation software；
(2) instructor wears teaching glove, and the front of each fingerstall of this glove, reverse side, side are respectively equipped with Quick Response Code, uses
In the front of each finger referring to instructor, reverse side and side；The front of the palm part of glove, reverse side and side set respectively
There is Quick Response Code, for referring to front, reverse side and the side of the palm of instructor；The front at arm position of glove, reverse side, side
It is respectively equipped with Quick Response Code, for referring to front, reverse side and the side of the arm of instructor；Instructor's sweeping in dimensional code scanner
Carry out sign language action, the Quick Response Code on the glove scanning is transferred to processor by dimensional code scanner in the range of retouching；
(3) processor enters row decoding and identification to the Quick Response Code receiving, and recalls corresponding with the sign language attitude of instructor
Simulated hand and Word message, are shown by display device.
8. the sign language teaching method based on Quick Response Code identification according to claim 7 it is characterised in that: described step (2)
In, the Quick Response Code at each position on described glove is encoded using the simulation drawing of the corresponding site of handss.
9. Quick Response Code according to claim 7 identification sign language teaching method it is characterised in that: in described step (2), institute
State the front that dimensional code scanner is worn on instructor, or the front cloth being arranged at a medicated clothing that can dress for instructor.
10. the sign language teaching method based on Quick Response Code identification according to claim 7 it is characterised in that: described step (3)
In, described Word message is one or more groups of, if multigroup, is then determined one group of word letter representing correct implication by instructor
Breath.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410834753.2A CN104599554B (en) | 2014-12-29 | 2014-12-29 | Two-dimensional code recognition-based sign language teaching system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410834753.2A CN104599554B (en) | 2014-12-29 | 2014-12-29 | Two-dimensional code recognition-based sign language teaching system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104599554A CN104599554A (en) | 2015-05-06 |
| CN104599554B true CN104599554B (en) | 2017-01-25 |
Family
ID=53125297
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410834753.2A Expired - Fee Related CN104599554B (en) | 2014-12-29 | 2014-12-29 | Two-dimensional code recognition-based sign language teaching system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104599554B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5990878A (en) * | 1995-05-18 | 1999-11-23 | Hitachi, Ltd. | Sign language editing apparatus |
| JP3823604B2 (en) * | 1999-05-18 | 2006-09-20 | 株式会社日立製作所 | Sign language education apparatus, sign language education method, and recording medium on which sign language education method is recorded |
| CN101504832A (en) * | 2009-03-24 | 2009-08-12 | 北京理工大学 | Virtual performance system based on hand motion sensing |
| CN101609618A (en) * | 2008-12-23 | 2009-12-23 | 浙江工业大学 | Real-time hand language AC system based on space encoding |
| BE1018773A5 (en) * | 2009-06-09 | 2011-08-02 | Mchichi El Khatir | FLEXIBLE KEYBOARD FOR MALVOYANTS. |
| ES2386992A1 (en) * | 2011-02-14 | 2012-09-10 | Juan Álvarez Álvarez | System and procedure for interpretation of the language of signs. (Machine-translation by Google Translate, not legally binding) |
| CN102723019A (en) * | 2012-05-23 | 2012-10-10 | 苏州奇可思信息科技有限公司 | Sign language teaching system |
| CN103279734A (en) * | 2013-03-26 | 2013-09-04 | 上海交通大学 | Novel intelligent sign language translation and man-machine interaction system and use method thereof |
| CN103632588A (en) * | 2013-11-28 | 2014-03-12 | 苏州罗马冯环保科技有限公司 | Commodity reader special for blind person |
-
2014
- 2014-12-29 CN CN201410834753.2A patent/CN104599554B/en not_active Expired - Fee Related
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5990878A (en) * | 1995-05-18 | 1999-11-23 | Hitachi, Ltd. | Sign language editing apparatus |
| JP3823604B2 (en) * | 1999-05-18 | 2006-09-20 | 株式会社日立製作所 | Sign language education apparatus, sign language education method, and recording medium on which sign language education method is recorded |
| CN101609618A (en) * | 2008-12-23 | 2009-12-23 | 浙江工业大学 | Real-time hand language AC system based on space encoding |
| CN101504832A (en) * | 2009-03-24 | 2009-08-12 | 北京理工大学 | Virtual performance system based on hand motion sensing |
| BE1018773A5 (en) * | 2009-06-09 | 2011-08-02 | Mchichi El Khatir | FLEXIBLE KEYBOARD FOR MALVOYANTS. |
| ES2386992A1 (en) * | 2011-02-14 | 2012-09-10 | Juan Álvarez Álvarez | System and procedure for interpretation of the language of signs. (Machine-translation by Google Translate, not legally binding) |
| CN102723019A (en) * | 2012-05-23 | 2012-10-10 | 苏州奇可思信息科技有限公司 | Sign language teaching system |
| CN103279734A (en) * | 2013-03-26 | 2013-09-04 | 上海交通大学 | Novel intelligent sign language translation and man-machine interaction system and use method thereof |
| CN103632588A (en) * | 2013-11-28 | 2014-03-12 | 苏州罗马冯环保科技有限公司 | Commodity reader special for blind person |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104599554A (en) | 2015-05-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Yang et al. | Computer-assisted culture learning in an online augmented reality environment based on free-hand gesture interaction | |
| CN114327060B (en) | Working method of virtual teaching system based on AI assistant | |
| CN106409063A (en) | Robot painting teaching method and device and robot | |
| CN102411854B (en) | Classroom teaching mixing technology application system based on enhanced reality and method thereof | |
| Cheng et al. | Construction of Interactive Teaching System for Course of Mechanical Drawing Based on Mobile Augmented Reality Technology. | |
| CN105549725B (en) | A kind of three-dimensional scenic interaction display device and method | |
| CN109614849A (en) | Remote teaching method, apparatus, equipment and storage medium based on bio-identification | |
| CN103713737A (en) | Virtual keyboard system used for Google glasses | |
| CN107281710A (en) | A kind of method of remedial action error | |
| Shao et al. | Teaching american sign language in mixed reality | |
| CN102509484A (en) | Learning system based on augmented reality technology and learning method thereof | |
| CN103745423B (en) | A kind of shape of the mouth as one speaks teaching system and teaching method | |
| CN108010400A (en) | A kind of intelligence dancing paces learning device and method | |
| CN106125928A (en) | PPT based on Kinect demonstrates aid system | |
| CN202331859U (en) | Learning system based on augment reality technology | |
| CN107818709A (en) | Interactive and game clearance theory exploitation automotive practical-training equipment method is touched based on point | |
| Hettiarachchi et al. | FingerDraw: more than a digital paintbrush | |
| CN108646922B (en) | Interactive digital globe and interaction method | |
| CN104599554B (en) | Two-dimensional code recognition-based sign language teaching system and method | |
| Ouali et al. | Real-time application for recognition and visualization of arabic words with vowels based dl and ar | |
| CN109272778B (en) | Intelligent teaching system with AR function | |
| CN106484118A (en) | A kind of augmented reality exchange method based on fixing trigger source and system | |
| CN104599553B (en) | Barcode recognition-based sign language teaching system and method | |
| Hou et al. | Mobile augmented reality system for preschool education | |
| Križnar et al. | Use of Computer Vision Based Hand Tracking in Educational Environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Wang Xiaoqun Inventor after: Chen Meifen Inventor after: Xu Ling Inventor after: Zhang Lingcong Inventor after: Huang Jinbiao Inventor before: Xu Ling Inventor before: Chen Meifen Inventor before: Wang Xiaoqun Inventor before: Zhang Lingcong Inventor before: Huang Jinbiao |
|
| COR | Change of bibliographic data | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170125 Termination date: 20171229 |