CN104599553A - Barcode recognition-based sign language teaching system and method - Google Patents
Barcode recognition-based sign language teaching system and method Download PDFInfo
- Publication number
- CN104599553A CN104599553A CN201410834425.2A CN201410834425A CN104599553A CN 104599553 A CN104599553 A CN 104599553A CN 201410834425 A CN201410834425 A CN 201410834425A CN 104599553 A CN104599553 A CN 104599553A
- Authority
- CN
- China
- Prior art keywords
- sign language
- bar code
- instructor
- finger
- gloves
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses a barcode recognition-based sign language teaching system and method. The system comprises teaching gloves, a barcode scanner, a processor and a display device, wherein the front face, the back face and the side face of each fingerstall, palm part and arm part of each glove are provided with barcodes respectively for referring to the front face, the back face and the side face of each finger, palm and arm of a teacher; the barcode scanner is used for scanning on the front side or back side of a sign language gesture of the teacher and acquiring barcode information on the gloves; the processor is installed with sign language simulation software and is provided with a sign language code library and a character database; many simulating hands for making sign language gestures are stored in the sign language code library; character information matched with the meanings of various sign languages are stored in the character database; the display device is used for displaying the simulating hand and the character information corresponding to the sign language action of the teacher. The system and the method have the advantages of easiness in operation, high recognition speed and capability of helping learners to quickly understand the real meanings of the sign languages of the teacher to guarantee quicker learning and higher efficiency of the learner and guarantee the learning quality.
Description
Technical field
The present invention relates to a kind of sign language tutoring system, particularly relate to a kind of sign language tutoring system based on bar code recognition and method.
Background technology
Sign language is the effective communication approach of requisite one in deaf and dumb personage life, is the special language that deaf-mute uses.Sign language is a very important ingredient of Body Languages, and it comprises the maximum a kind of Body Languages of quantity of information, and vividly, image, directly perceived, there is very strong visual effect.But, because many sign languages often include multiple implication, cause deaf-mute to be undertaken by sign language in the process learnt, or other non-deaf-mute scholars are in the process of study sign language, often there will be understanding relatively so more tired, the problem that results of learning are not good.To this, there are some Sign Language Recognition products for this respect in prior art, comparative maturity mainly contain two large classes:
1, based on camera technique, comprising: common shooting, infrared photography etc.Object is by hand-type and background separation, obtains form in one's hands, then judges its connotation according to the form of hand.This technology requires very high to the resolution of shooting, the configuration of computing machine and light etc., and recognition speed is slower.
2, with the data glove that sensor technology is formed, this gloves operation is very complicated, is not suitable for common classroom instruction.
Summary of the invention
The invention provides a kind of sign language tutoring system based on bar code recognition and method, which overcome the weak point described in background technology.
The technical solution adopted for the present invention to solve the technical problems is: a kind of sign language tutoring system based on bar code recognition, comprising:
Teaching gloves, each fingerstall of these gloves, palm part, the front at arm position, reverse side, side are respectively equipped with bar code, are used in reference to the front of each finger, palm and the arm of instructor, reverse side and side;
Bar code scanner, for the bar code information on the front side of instructor's sign language attitude or rear side scanning and acquisition gloves;
Processor, is provided with sign language simulation software, and it has sign language code database and lteral data storehouse, and sign language code database stores many Simulated hands of making sign language attitude, and lteral data stock contains the Word message matched with the implication of various sign language;
Display device, for showing the Simulated hand corresponding with the sign language action of instructor and Word message;
The bar code information got is transferred to processor by bar code scanner, and processor carries out decoding and identification to the bar code received, and recalls the Simulated hand and Word message that match with the sign language attitude of instructor, is shown by display device.
Further, the coding rule of the bar code on described gloves is: comprise five-digit number, and first is start bit, and last position is stop bit, and second comprises three different numerals, represents front, reverse side and side respectively; 3rd and the 4th forms double figures, comprise 14 different natural numbers, be respectively used to represent left little finger of toe, the left third finger, left finger, left forefinger, left thumb, right little finger of toe, the right third finger, right middle finger, RIF, the left hand palm, the right hand palm, left arm and right arm.
Further, described bar code scanner is worn on the front of instructor, or is arranged at the front cloth of the clothing that can dress for instructor.
Further, each bar code in described gloves front corresponding with its back side each bar code adopt to reverse and encode; The bar code of the arm segment both sides of described gloves adopts reversion coding.
Further, the bar code information got is transferred to described processor by data line or communication by described bar code scanner.
Further, described display device is projecting apparatus screen.
Based on a sign language teaching method for bar code recognition, comprise the steps:
(1) in advance sign language simulation software is installed within a processor, this sign language simulation software has sign language code database and lteral data storehouse, sign language code database stores many Simulated hands of making sign language attitude, and lteral data stock contains the Word message matched with the implication of various sign language; Open this sign language simulation software;
(2) instructor wears teaching gloves, and each fingerstall of these gloves, palm part, the front at arm position, reverse side, side are respectively equipped with bar code, is used in reference to the front of each finger, palm and the arm of instructor, reverse side and side; Instructor carries out sign language action in the sweep limit of bar code scanner, and the bar code on the gloves scanned is transferred to processor by bar code scanner;
(3) processor carries out decoding and identification to the bar code received, and recalls the Simulated hand corresponding with the sign language attitude of instructor and Word message, is shown by display device.
Further, in described step (2), the coding rule of the bar code on described gloves is: comprise five-digit number, and first is start bit, and last position is stop bit, and second comprises three different numerals, represents front, reverse side and side respectively; 3rd and the 4th forms double figures, comprise 14 different natural numbers, be respectively used to represent left little finger of toe, the left third finger, left finger, left forefinger, left thumb, right little finger of toe, the right third finger, right middle finger, RIF, the left hand palm, the right hand palm, left arm and right arm.
Further, in described step (2), described bar code scanner is worn on the front of instructor, or is arranged at the front cloth of the clothing that can dress for instructor.
Further, in described step (3), described Word message is one or more groups, if many groups, is then determined the one group of Word message representing correct implication by instructor.
The present invention has following beneficial effect:
The present invention is by being provided with the sign language attitude of the gloves setting strip code scanner collection instructor of bar code, be transferred to the processor being provided with sign language simulation software and carry out decoding and identification, and recall the Simulated hand and Word message that match with the sign language attitude of instructor, shown by display device, not only simple to operate, recognition speed is fast, the real meaning of learner's fast understanding teacher sign language can also be helped, learner is learnt rate more quickly and effectively, ensure learning quality.
Below in conjunction with drawings and Examples, the present invention is described in further detail; But a kind of sign language tutoring system based on bar code recognition of the present invention and method are not limited to embodiment.
Accompanying drawing explanation
Fig. 1 is the structural representation of gloves of the present invention;
Fig. 2 is the setting position schematic diagram of bar code scanner of the present invention.
Embodiment
Embodiment, refers to shown in accompanying drawing, and a kind of sign language tutoring system based on bar code recognition of the present invention, comprising:
Teaching gloves 1, each fingerstall of these gloves 1, palm part, the front at arm position, reverse side, side are respectively equipped with bar code 2, are used in reference to the front of each finger, palm and the arm of instructor, reverse side and side; Here, each bar code 2 can adopt the mode of printing to be arranged on the corresponding site of gloves 1, also can adopt on the corresponding site being arranged at gloves 1 in the method for paste, such as, first on multiple pasters, print corresponding bar code, more each paster is torn and the corresponding corresponding site being pasted on outer surface of glove;
Bar code scanner 3, for the bar code information on the front side of instructor's sign language attitude or rear side scanning and acquisition gloves 1;
Processor, this processor can be main frame, it is provided with sign language simulation software, this sign language simulation software has sign language code database and lteral data storehouse, sign language code database stores the Simulated hand of making sign language attitude in a large number, and lteral data stock contains a large amount of Word message matched with the implication of various sign language;
Display device, for showing the Simulated hand corresponding with the sign language action of instructor and Word message; Specifically, this display device can be projecting apparatus screen.
Bar code scanner 3 by data line or communication (such as by bluetooth, wifi etc.) by bar code 2 information transmission that gets to processor, processor carries out decoding and identification to the bar code 2 received, and recall the Simulated hand and Word message that match with the sign language attitude of instructor, shown by display device.
Preferred as one, the coding rule of the bar code 2 on described gloves 1 is: comprise five-digit number, and first is start bit, and last position is stop bit, and second comprises three different numerals, represents front, reverse side and side respectively; 3rd and the 4th forms double figures, comprise 14 different natural numbers, be respectively used to represent left little finger of toe, the left third finger, left finger, left forefinger, left thumb, right little finger of toe, the right third finger, right middle finger, RIF, the left hand palm, the right hand palm, left arm and right arm.Below, the coding rule of the bar code 2 on described gloves 1 is illustrated in a tabular form.
Table 1 five bar code information coding keys
Table 2 five bar code information codings
Such as: the left little finger of toe in 01119---front; 03419---side left arm; 01459---front right arm
Preferred as one, as shown in Figure 2, described bar code scanner 3 is arranged at the front cloth of the clothing 4 that can dress for instructor.Or, also bar code scanner 3 can be worn on the front of instructor.
Due to Student oriented during class-teaching of teacher hand-type and scanner towards hand-type contrary, thus, each bar code 2 in described gloves 1 front corresponding with its back side each bar code 2 adopt to reverse and encode; The bar code 2 of the arm segment both sides of described gloves 1 adopts reversion coding.Namely, the each bar code 2 representing staff front is arranged at respectively the relevant position of gloves 1 reverse side, the each bar code 2 representing staff reverse side is arranged at respectively the relevant position in the front of gloves 1, the bar code 2 of the arm both sides representing staff is exchanged the both sides of the arm segment being arranged at gloves 1.Such as, bar code scanner 3 surface sweeping centre of the palm position, the Simulated hand of corresponding display is palm back.Because the side of palm part and each finger is narrower, thus do not carry out reversion coding to its corresponding bar code 2, palm part and each finger the positive and negative of side can be obtained by the positive and negative judgement of arm side.
A kind of sign language teaching method based on bar code recognition of the present invention, comprises the steps:
(1) described sign language simulation software is installed within a processor in advance, and opens this sign language simulation software;
(2) instructor wears described teaching gloves 1, and puts on the clothing 4 (or bar code scanner 3 is worn on front) that front is laid with described bar code scanner 3; Instructor makes a sign language action in the sweep limit of bar code scanner 3, and keeps couple of seconds, and bar code scanner scans each bar code 2 on the gloves 1 towards it, and the bar code 2 scanned is transferred to processor;
(3) processor carries out decoding and identification to the bar code 2 received, and recalls the Simulated hand corresponding with the sign language attitude of instructor and Word message, is shown by projecting apparatus screen.Now, if Word message shown on projecting apparatus screen is many groups, represent that the sign language attitude of this Simulated hand has multiple implication, then determine by instructor is oral or is selected the one group of Word message representing correct implication by mouse point;
(4) instructor continues to make another sign language action, repeats above-mentioned teaching process.
A kind of sign language tutoring system based on bar code recognition of the present invention and method, each scanner head of its bar code scanner can be designed to rotary type structure, then during its scanning, scan by rotating, make the start bit of the bar code scanned and stop bit be in tram, and the anglec of rotation of the bar code scanned and scanner head (can be obtained the azimuth information of the palm of instructor, arm and each finger by this anglec of rotation) is transferred to processor.In addition, also can each scanner head of bar code scanner be designed to fixed, and rotated and obtained the process of the anglec of rotation by processor, be specially: when processor carries out decoding to the bar code received and identifies, first judge that (bar code is the datum line that pre-sets as reference line the need of rotating to each bar code the need of rotating, this datum line can be the X-axis in three-dimensional system of coordinate), when needs rotate, it is rotated, be located at correct position, thus find start bit and the stop bit of bar code, the angle value simultaneously rotated by obtaining Quick Response Code obtains the palm of instructor, the orientation (position) of arm and each finger, and with palm and arm preferential.
A kind of sign language tutoring system based on bar code recognition of the present invention and method, it may be used for imparting knowledge to students to deaf-mute, instructor's (or claiming teacher) carries out interaction by the language " sign language " communicated with deaf-mute, and religion deaf-mute learns various knowledge.Or, the present invention also may be used for teaching non-deaf-mute scholar to learn sign language, and instructor passes through than standardized sign language action, and is engaged in Simulated hand and Word message that projecting apparatus screen shows, make sign language learner not only learn to gesticulate sign language, also contribute to the real meaning that learner keeps sign language firmly in mind.
Above-described embodiment is only used for further illustrating a kind of sign language tutoring system based on bar code recognition of the present invention and method; but the present invention is not limited to embodiment; every above embodiment is done according to technical spirit of the present invention any simple modification, equivalent variations and modification, all fall in the protection domain of technical solution of the present invention.
Claims (10)
1., based on a sign language tutoring system for bar code recognition, it is characterized in that, comprising:
Teaching gloves, each fingerstall of these gloves, palm part, the front at arm position, reverse side, side are respectively equipped with bar code, are used in reference to the front of each finger, palm and the arm of instructor, reverse side and side;
Bar code scanner, for the bar code information on the front side of instructor's sign language attitude or rear side scanning and acquisition gloves;
Processor, is provided with sign language simulation software, and it has sign language code database and lteral data storehouse, and sign language code database stores many Simulated hands of making sign language attitude, and lteral data stock contains the Word message matched with the implication of various sign language;
Display device, for showing the Simulated hand corresponding with the sign language action of instructor and Word message;
The bar code information got is transferred to processor by bar code scanner, and processor carries out decoding and identification to the bar code received, and recalls the Simulated hand and Word message that match with the sign language attitude of instructor, is shown by display device.
2. the sign language tutoring system based on bar code recognition according to claim 1, it is characterized in that: the coding rule of the bar code on described gloves is: comprise five-digit number, first is start bit, last position is stop bit, second comprises three different numerals, represents front, reverse side and side respectively; 3rd and the 4th forms double figures, comprise 14 different natural numbers, be respectively used to represent left little finger of toe, the left third finger, left finger, left forefinger, left thumb, right little finger of toe, the right third finger, right middle finger, RIF, the left hand palm, the right hand palm, left arm and right arm.
3. the sign language tutoring system based on bar code recognition according to claim 1, is characterized in that: described bar code scanner is worn on the front of instructor, or is arranged at the front cloth of the clothing that can dress for instructor.
4. the sign language tutoring system based on bar code recognition according to claim 3, is characterized in that: each bar code in described gloves front corresponding with its back side each bar code adopt to reverse and encode; The bar code of the arm segment both sides of described gloves adopts reversion coding.
5. the sign language tutoring system based on bar code recognition according to claim 1, is characterized in that: the bar code information got is transferred to described processor by data line or communication by described bar code scanner.
6. the sign language tutoring system based on bar code recognition according to claim 1, is characterized in that: described display device is projecting apparatus screen.
7., based on a sign language teaching method for bar code recognition, it is characterized in that: comprise the steps:
(1) in advance sign language simulation software is installed within a processor, this sign language simulation software has sign language code database and lteral data storehouse, sign language code database stores many Simulated hands of making sign language attitude, and lteral data stock contains the Word message matched with the implication of various sign language; Open this sign language simulation software;
(2) instructor wears teaching gloves, and each fingerstall of these gloves, palm part, the front at arm position, reverse side, side are respectively equipped with bar code, is used in reference to the front of each finger, palm and the arm of instructor, reverse side and side; Instructor carries out sign language action in the sweep limit of bar code scanner, and the bar code on the gloves scanned is transferred to processor by bar code scanner;
(3) processor carries out decoding and identification to the bar code received, and recalls the Simulated hand corresponding with the sign language attitude of instructor and Word message, is shown by display device.
8. the sign language teaching method based on bar code recognition according to claim 7, it is characterized in that: in described step (2), the coding rule of the bar code on described gloves is: comprise five-digit number, first is start bit, last position is stop bit, second comprises three different numerals, represents front, reverse side and side respectively; 3rd and the 4th forms double figures, comprise 14 different natural numbers, be respectively used to represent left little finger of toe, the left third finger, left finger, left forefinger, left thumb, right little finger of toe, the right third finger, right middle finger, RIF, the left hand palm, the right hand palm, left arm and right arm.
9. the sign language teaching method of bar code recognition according to claim 7, is characterized in that: in described step (2), described bar code scanner is worn on the front of instructor, or is arranged at the front cloth of the clothing that can dress for instructor.
10. the sign language teaching method based on bar code recognition according to claim 7, it is characterized in that: in described step (3), described Word message is one or more groups, if many groups, is then determined the one group of Word message representing correct implication by instructor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410834425.2A CN104599553B (en) | 2014-12-29 | 2014-12-29 | Barcode recognition-based sign language teaching system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410834425.2A CN104599553B (en) | 2014-12-29 | 2014-12-29 | Barcode recognition-based sign language teaching system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104599553A true CN104599553A (en) | 2015-05-06 |
| CN104599553B CN104599553B (en) | 2017-01-25 |
Family
ID=53125296
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410834425.2A Expired - Fee Related CN104599553B (en) | 2014-12-29 | 2014-12-29 | Barcode recognition-based sign language teaching system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104599553B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5990878A (en) * | 1995-05-18 | 1999-11-23 | Hitachi, Ltd. | Sign language editing apparatus |
| JP3823604B2 (en) * | 1999-05-18 | 2006-09-20 | 株式会社日立製作所 | Sign language education apparatus, sign language education method, and recording medium on which sign language education method is recorded |
| CN101504832A (en) * | 2009-03-24 | 2009-08-12 | 北京理工大学 | Virtual performance system based on hand motion sensing |
| CN101609618A (en) * | 2008-12-23 | 2009-12-23 | 浙江工业大学 | Real-time hand language AC system based on space encoding |
| BE1018773A5 (en) * | 2009-06-09 | 2011-08-02 | Mchichi El Khatir | FLEXIBLE KEYBOARD FOR MALVOYANTS. |
| ES2386992A1 (en) * | 2011-02-14 | 2012-09-10 | Juan Álvarez Álvarez | System and procedure for interpretation of the language of signs. (Machine-translation by Google Translate, not legally binding) |
| CN102723019A (en) * | 2012-05-23 | 2012-10-10 | 苏州奇可思信息科技有限公司 | Sign language teaching system |
| CN103279734A (en) * | 2013-03-26 | 2013-09-04 | 上海交通大学 | Novel intelligent sign language translation and man-machine interaction system and use method thereof |
| CN103632588A (en) * | 2013-11-28 | 2014-03-12 | 苏州罗马冯环保科技有限公司 | Commodity reader special for blind person |
-
2014
- 2014-12-29 CN CN201410834425.2A patent/CN104599553B/en not_active Expired - Fee Related
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5990878A (en) * | 1995-05-18 | 1999-11-23 | Hitachi, Ltd. | Sign language editing apparatus |
| JP3823604B2 (en) * | 1999-05-18 | 2006-09-20 | 株式会社日立製作所 | Sign language education apparatus, sign language education method, and recording medium on which sign language education method is recorded |
| CN101609618A (en) * | 2008-12-23 | 2009-12-23 | 浙江工业大学 | Real-time hand language AC system based on space encoding |
| CN101504832A (en) * | 2009-03-24 | 2009-08-12 | 北京理工大学 | Virtual performance system based on hand motion sensing |
| BE1018773A5 (en) * | 2009-06-09 | 2011-08-02 | Mchichi El Khatir | FLEXIBLE KEYBOARD FOR MALVOYANTS. |
| ES2386992A1 (en) * | 2011-02-14 | 2012-09-10 | Juan Álvarez Álvarez | System and procedure for interpretation of the language of signs. (Machine-translation by Google Translate, not legally binding) |
| CN102723019A (en) * | 2012-05-23 | 2012-10-10 | 苏州奇可思信息科技有限公司 | Sign language teaching system |
| CN103279734A (en) * | 2013-03-26 | 2013-09-04 | 上海交通大学 | Novel intelligent sign language translation and man-machine interaction system and use method thereof |
| CN103632588A (en) * | 2013-11-28 | 2014-03-12 | 苏州罗马冯环保科技有限公司 | Commodity reader special for blind person |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104599553B (en) | 2017-01-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106128212B (en) | Learning calligraphy system and method based on augmented reality | |
| CN106409063A (en) | Robot painting teaching method and device and robot | |
| WO1994015272A1 (en) | Pen-based electronic teaching system | |
| CN103745423B (en) | A kind of shape of the mouth as one speaks teaching system and teaching method | |
| CN111833669B (en) | Chinese calligraphy pen teaching system and teaching method | |
| Lee et al. | Annotation vs. virtual tutor: Comparative analysis on the effectiveness of visual instructions in immersive virtual reality | |
| CN108010400A (en) | A kind of intelligence dancing paces learning device and method | |
| CN202331859U (en) | Learning system based on augment reality technology | |
| CN108389439A (en) | A kind of intelligence barcode scanning video explanation formula copybook for calligraphy | |
| Nanaware et al. | Fingerspelling-Indian sign language training tool | |
| CN105185176A (en) | Wireless handheld device for information-based teaching | |
| CN107657865A (en) | Digitize calligraphy experience device and method | |
| CN107657839A (en) | Digitlization calligraphy experience device and method with true sense of touch | |
| CN107818709A (en) | Interactive and game clearance theory exploitation automotive practical-training equipment method is touched based on point | |
| CN104599553B (en) | Barcode recognition-based sign language teaching system and method | |
| Nijhawan et al. | A study of awareness and perception of augmented reality in education sector | |
| CN110766997A (en) | Copy display method, device and storage medium | |
| CN105975200A (en) | Sequence drawing method and device | |
| CN104599554B (en) | Two-dimensional code recognition-based sign language teaching system and method | |
| Karaibryamov et al. | Educational Software for Interactive Training of Students on the Theme" Mutual Intersecting of Pyramids and Prisms in Axonometry". | |
| Correa et al. | AR musical app for children's musical education | |
| JP6608243B2 (en) | Text learning materials | |
| CN208367959U (en) | It digitizes calligraphy and experiences equipment | |
| CN104464004A (en) | Electronic signing device | |
| CN215219934U (en) | Teaching system based on AR recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Wang Xiaoqun Inventor after: Chen Meifen Inventor after: Xu Ling Inventor after: Zhang Lingcong Inventor after: Huang Jinbiao Inventor before: Xu Ling Inventor before: Chen Meifen Inventor before: Wang Xiaoqun Inventor before: Zhang Lingcong Inventor before: Huang Jinbiao |
|
| COR | Change of bibliographic data | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170125 Termination date: 20171229 |