CN105489088A - Voice bionic sign language bidirectional translation system - Google Patents

Voice bionic sign language bidirectional translation system Download PDF

Info

Publication number
CN105489088A
CN105489088A CN201610020192.1A CN201610020192A CN105489088A CN 105489088 A CN105489088 A CN 105489088A CN 201610020192 A CN201610020192 A CN 201610020192A CN 105489088 A CN105489088 A CN 105489088A
Authority
CN
China
Prior art keywords
sign language
motor
bionical
word
arm segments
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610020192.1A
Other languages
Chinese (zh)
Inventor
宋纪元
李浩亮
孙宇
卞甘甜
陈本海
房兆琦
宋静静
王石磊
徐科飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201610020192.1A priority Critical patent/CN105489088A/en
Publication of CN105489088A publication Critical patent/CN105489088A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/04Devices for conversing with the deaf-blind

Abstract

The invention provides a voice bionic sign language bidirectional translation system. The voice bionic sign language bidirectional translation system includes a sign language action recognition device which is configured to recognize gestures of a sign language issuer, a text or voice output device which is configured to output texts or voices corresponding to the gestures recognized by the sign language action recognition device, a receiving device which is configured to receive texts or voices issued by a text or voice issuer, a bionic sign language output device with mechanical hands which is configured to perform gestures of sign language corresponding to the texts or voices received by the receiving device, and a control device. The voice bionic sign language bidirectional translation system can convert the gestures of the deaf-mute into texts or voices and convert voices or texts into sign language, and therefore, with the voice bionic sign language bidirectional translation system adopted, communication obstacles between normal people and the deaf-mute can be eliminated; and the mechanical hands are utilized to perform three-dimensional expression of the gestures of the sign language, which enables high directness and strong three-dimensional sense, and meanings that the normal people want to express can be accurately expressed.

Description

The bionical sign language bidirectional translation system of a kind of voice
Technical field
The present invention relates to sign language interpreter technical field, particularly relate to the bionical sign language bidirectional translation system of a kind of voice.
Background technology
In actual life, normal person both can obtain visual information also can obtain auditory information, and deaf-mute then can only utilize visual information.Normal person exchanges using sign language as medium usually with deaf-mute, but most normal person knows little about it to sign language, cannot conversate with deaf-mute at all, makes to there is the communication disorder being difficult to overcome between normal person and deaf-mute.
Summary of the invention
Object of the present invention is intended to the communication disorder overcoming normal person and deaf-mute, provides a kind of voice bionical sign language bidirectional translation system.
Especially, the invention provides the bionical sign language bidirectional translation system of a kind of voice, it comprises:
Sign language action recognition device, is configured to the gesture motion identifying the sign language person of sending;
Word or language output unit, be configured to export the word corresponding with the gesture motion that the identification of described sign language action recognition device obtains or voice;
Receiving trap, is configured to receive word or voice that word or the language person of sending send;
There is the bionical sign language output unit of mechanical arm, be configured to the gesture motion making the sign language corresponding with the word that described receiving trap receives or voice; And
Control device, all communicates to connect with described sign language action recognition device, described word or language output unit, described receiving trap and described bionical sign language output unit, is configured to:
The gesture motion that the identification of described sign language action recognition device obtains is translated into corresponding word or language, exports to make described word or language output unit; With
The word receive described receiving trap or Language Translation become the gesture motion of corresponding sign language, make to make described bionical sign language output unit.
Alternatively, described mechanical arm is two, and each described mechanical arm comprises:
Palm;
First finger, its third knuckle that there is the first knuckle being articulated in described palm, the second knuckle being articulated in described first knuckle and be articulated in described second knuckle;
First motor, is configured to drive described first knuckle to rotate relative to described palm, swings to make described first-hand fingering row;
First curls up stretches driving mechanism, its second motor having the first bracing wire, the first resetting means and be installed on described palm, is configured to drive described first-hand fingering row to curl up and stretches motion;
Multiple second finger, each described second finger has the contiguous block being articulated in described palm, the 4th dactylus being articulated in described contiguous block, is articulated in the wuzhijie point of described 4th dactylus and is articulated in the 6th dactylus of described wuzhijie point;
Multiple 3rd motor, each described 3rd motor is configured to driving described contiguous block and rotates relative to described palm, swings to make each described second finger;
Multiple second curls up stretches driving mechanism, and each described second curls up stretches the 4th motor that driving mechanism has the second bracing wire, the second resetting means and be installed on described palm, is configured to driving described second finger and carries out curling up stretching motion.
Alternatively, described first resetting means comprises two torsion springs, and a torsion spring is installed on described first knuckle and described second knuckle, and another torsion spring is installed on described second knuckle and described third knuckle;
Each described second resetting means comprises three torsion springs, and a torsion spring is installed on described contiguous block and described 4th dactylus, and another torsion spring is installed on described 4th dactylus and described wuzhijie point, and the 3rd torsion spring is installed on described wuzhijie point and described 6th dactylus;
Described first curls up stretches driving mechanism and each described second and curls up and stretch driving mechanism and all also comprise stay wire tube.
Alternatively, described bionical sign language output unit also comprises fuselage and is installed on two mechanical arms of described fuselage, and each described mechanical arm comprises:
Web member, is rotatably installed on described fuselage;
5th motor, is installed on described fuselage, is configured to described web member and rotates relative to described fuselage;
First arm segments, is rotatably installed on described web member;
6th motor, is installed on described fuselage, is configured to drive described first arm segments to rotate relative to described web member;
Second arm segments, is rotatably installed on described first arm segments;
7th motor, is installed on described first arm segments, is configured to drive described second arm segments to rotate relative to described first arm segments;
3rd arm segments, is rotatably installed on described second arm segments;
8th motor, is installed on described second arm segments, is configured to drive described 3rd arm segments to rotate relative to described second arm segments;
4th arm segments, is rotatably installed on described 3rd arm segments, and the palm of each described mechanical arm is rotatably installed on the 4th arm segments of a described mechanical arm;
9th motor, is installed on described 3rd arm segments, is configured to drive described 4th arm segments to rotate relative to described 3rd arm segments;
Tenth motor, is installed on described 4th arm segments, is configured to drive described mechanical arm to rotate relative to described 4th arm segments.
Alternatively, described first motor, described second motor, each described 3rd motor, each described 4th motor, the 5th motor, the 6th motor, the 7th motor, the 8th motor, the 9th motor and the tenth motor are steering wheel.
Alternatively, described fuselage is also provided with display device, to show the Word message of described receiving trap reception or the Word message corresponding with the voice that described receiving trap receives.
Alternatively, described receiving trap comprises microphone, is arranged at described fuselage;
Described word or language output unit comprise loudspeaker, are arranged at described fuselage.
Alternatively, sign language action recognition device comprises sign language gloves and is arranged at the sensor on sign language gloves, to detect the gesture motion of the sign language person of sending.
Alternatively, described sign language action recognition device and described control device include wireless transport module.
Alternatively, described control device comprises:
Be arranged at the first control device on described sign language action recognition device, translate into corresponding word or language with the gesture motion identification of described sign language action recognition device obtained, export to make described word or language output unit; With
Be arranged at the second control device on described bionical sign language output unit, become the gesture motion of corresponding sign language with the word received by described receiving trap or Language Translation, make to make described bionical sign language output unit; And
Described word or language output unit are arranged on described sign language action recognition device;
Described receiving trap is arranged on described bionical sign language output unit.
Voice of the present invention bionical sign language bidirectional translation system is because have sign language action recognition device, word or language output unit, receiving trap, bionical sign language output unit and control device, can the gesture motion of deaf-mute be converted to word or voice, receive the information of deaf-mute for normal person; Simultaneously also voice or text conversion can be become sign language, with the information making deaf-mute receive normal person, overcome the communication disorder between normal person and deaf-mute, can the public sphere such as widespread use bank, be convenient to the normal transacting business of deaf-mute.Mechanical arm is used to carry out the three-dimensional expression of sign language action, more directly, stereoscopic sensation is strong, accurately can give expression to normal person's meaning to be expressed, to prevent the gesture motion of the sign language due to the display such as plane, two animations clear not, make deaf-mute accurately can not understand the meaning of normal person.
Further, the bionical sign language bidirectional translation system of voice of the present invention, because adopt sign language gloves, accurately can detect the gesture motion of the sign language person of sending, thus can translate more accurately gesture motion, to make the hint expression of deaf-mute more accurate.
Further, because bionical sign language output unit can be 32 degree of freedom bionic mechanical arms (comprising mechanical arm and mechanical arm) in voice of the present invention bionical sign language bidirectional translation system, the gesture motion making corresponding sign language more accurately, specification, the information that deaf-mute can be made accurately to understand normal person transmit out.
According to hereafter by reference to the accompanying drawings to the detailed description of the specific embodiment of the invention, those skilled in the art will understand above-mentioned and other objects, advantage and feature of the present invention more.
Accompanying drawing explanation
Hereinafter describe specific embodiments more of the present invention with reference to the accompanying drawings by way of example, and not by way of limitation in detail.Reference numeral identical in accompanying drawing denotes same or similar parts or part.It should be appreciated by those skilled in the art that these accompanying drawings may not be drawn in proportion.In accompanying drawing:
Fig. 1 is the schematic diagram of the bionical sign language bidirectional translation system of voice according to an embodiment of the invention;
Fig. 2 is the schematic diagram of mechanical arm in the bionical sign language bidirectional translation system of voice according to an embodiment of the invention;
Fig. 3 is the schematic local structural graph of mechanical arm shown in Fig. 2;
Fig. 4 is the schematic diagram according to an embodiment of the invention in the bionical sign language bidirectional translation system of voice after mechanical arm and mechanical arm combination.
Embodiment
Fig. 1 is the schematic diagram of the bionical sign language bidirectional translation system of voice according to an embodiment of the invention.As shown in Figure 1, embodiments provide the bionical sign language bidirectional translation system of a kind of voice, it can comprise sign language action recognition device 20, word or language output unit, receiving trap 40, bionical sign language output unit 60 and control device.Sign language action recognition device 20 can be configured to the gesture motion identifying the sign language person of sending.Word or language output unit can be configured to export and identify the word that the gesture motion that obtains is corresponding or voice with sign language action recognition device 20.Receiving trap 40 can be configured to receive the word or voice that word or the language person of sending send.Bionical sign language output unit 60 can have mechanical arm 63, and bionical sign language output unit 60 can be configured to the gesture motion making the sign language corresponding with the word that receiving trap 40 receives or voice.Control device, all communicate to connect with sign language action recognition device 20, word or language output unit, receiving trap 40 and bionical sign language output unit 60, be configured to: sign language action recognition device 20 is identified that the gesture motion obtained translates into corresponding word or language, export to make word or language output unit; Become the gesture motion of corresponding sign language with the word received by receiving trap 40 or Language Translation, make to make bionical sign language output unit 60.
Voice in the embodiment of the present invention bionical sign language bidirectional translation system is because have sign language action recognition device 20, word or language output unit, receiving trap 40, bionical sign language output unit 60 and control device, can the gesture motion of deaf-mute be converted to word or voice, receive the information of deaf-mute for normal person; Simultaneously also voice or text conversion can be become sign language, with the information making deaf-mute receive normal person, overcome the communication disorder between normal person and deaf-mute, can the public sphere such as widespread use bank, be convenient to the normal transacting business of deaf-mute.Mechanical arm 63 is used to carry out the three-dimensional expression of sign language action, more directly, stereoscopic sensation is strong, accurately can give expression to normal person's meaning to be expressed, to prevent the gesture motion of the sign language due to the display such as plane, two animations clear not, make deaf-mute accurately can not understand the meaning of normal person.
In some embodiments of the invention, the sensor 22 that sign language action recognition device 20 comprises sign language gloves 21 and is arranged on sign language gloves 21, to detect the gesture motion of the sign language person of sending.Particularly, sensor 22 can be five sensitive bend sensors, is positioned at the finger back of the body position of five fingers.Control device can comprise the first control device be arranged on sign language action recognition device 20, so that sign language action recognition device 20 is identified that the gesture motion obtained translates into corresponding word or language, exports to make word or language output unit.Particularly, first control device can comprise control treatment system, WiFi module MPU-6050 module and voice module.Word or language output unit can comprise loudspeaker and OLED display, are arranged on sign language action recognition device 20.Further, sign language gloves 21 also can be provided with lithium battery, switch and function button.When deaf-mute brings sign language gloves 21 to make gesture motion, five bend sensors being positioned at finger back read out state residing for each finger respectively.MPU-6050 module can read the acceleration of the XYZ coordinate in space of selling, in a procedure, this acceleration is carried out integration by processor can obtain speed in one's hands, by speed again integration can obtain distance of moving in space in one's hands and space tracking, thus calculate the motion state of deaf-mute's arm.The motion state of the finger of reading, palm 631 and arm carries out mating or being mated with internet database by WIFI with the local memory database finished writing by processor, obtain corresponding phrase and phrase text data, high-resolution OLED display demonstrates the Chinese sentence translated, simultaneously, by voice module, text message is converted to voice, is played back by loudspeaker.In this embodiment, control device also comprises the second control device be arranged on bionical sign language output unit 60, becomes the gesture motion of corresponding sign language with the word received by receiving trap 40 or Language Translation, makes to make bionical sign language output unit 60; And receiving trap 40 is arranged on bionical sign language output unit 60.
In other embodiments of the present invention, sign language action recognition device 20 and control device include wireless transport module.Wireless transport module can be bluetooth module or wifi module.Control device, word or language output unit and receiving trap 40 all can be arranged on bionical sign language output unit 60.When deaf-mute brings sign language gloves 21 to make gesture motion, five bend sensors 22 being positioned at finger back read out state residing for each finger respectively, and by wireless transport module, information is passed to control device, sign language action recognition device 20 is controlled to identify that the gesture motion obtained translates into corresponding word or language, and by being arranged at display device 64 on bionical sign language output unit 60 and/or loudspeaker gives expression to.In alternate embodiment more of the present invention, sign language action recognition device 20 also can be camera, is installed on bionical sign language output unit 60.
In alternate embodiment more of the present invention, bionical sign language output unit 60 can be robot, its above-mentioned mechanical arm 63 that can comprise fuselage 61, be installed on two mechanical arms 62 of fuselage 61 and be installed on two mechanical arms 62 respectively.
As shown in Figures 2 and 3, each mechanical arm 63 comprise palm 631, first point the 632, first motor 633, first curl up stretch driving mechanism, multiple second finger 636, multiple 3rd motor 637 and multiple second curl up and stretch driving mechanism.
First finger 632 can be thumb, its have be articulated in palm 631 first knuckle, be articulated in the second knuckle of first knuckle and be articulated in the third knuckle of second knuckle.First motor 633 can be configured to drive first knuckle to rotate relative to palm 631, carries out twisting motion to make the first finger 632.First curls up stretches the second motor 635 that driving mechanism can have the first bracing wire 634, stay wire tube 639, first resetting means and be installed on palm 631, is configured to driving first and points 632 and carry out curling up stretching motion.First bracing wire can be wire, and stay wire tube 639 can be soft spring pipe.First resetting means comprises two torsion springs, and a torsion spring is installed on first knuckle and second knuckle, and another torsion spring is installed on second knuckle and third knuckle.
Multiple second finger 636 can be four, is respectively forefinger, middle finger, the third finger and little finger of toe; Also can be part wherein, such as three, be respectively forefinger, middle finger and the third finger.Each second finger 636 has the contiguous block being articulated in palm 631, the 4th dactylus being articulated in contiguous block, is articulated in the wuzhijie point of the 4th dactylus and is articulated in the 6th dactylus of wuzhijie point.Each 3rd motor 637 is configured to driving contiguous block and rotates relative to palm 631, swings to make each second finger 636.Each second curls up stretches the 4th motor 638 that driving mechanism has the second bracing wire, stay wire tube 639, second resetting means and be installed on palm 631, is configured to driving second finger 636 and carries out curling up stretching motion.Each second resetting means comprises three torsion springs, and a torsion spring is installed on contiguous block and the 4th dactylus, and another torsion spring is installed on the 4th dactylus and wuzhijie point, and the 3rd torsion spring is installed on wuzhijie point and the 6th dactylus.
As shown in Figure 4, each mechanical arm 62 comprises web member 621, the 5th motor, the first arm segments 622, the 6th motor, the second arm segments 623, the 7th motor, the 3rd arm segments 624, the 8th motor, the 4th arm segments 625, the 9th motor and the tenth motor.Web member 621 is rotatably installed on fuselage 61; 5th motor, is installed on fuselage 61, is configured to web member 621 and rotates relative to fuselage 61.First arm segments 622 is rotatably installed on web member 621; 6th motor is installed on fuselage 61, is configured to drive first arm segments 622 and rotates relative to web member 621.Second arm segments 623 is rotatably installed on the first arm segments 622; 7th motor is installed on the first arm segments 622, is configured to drive second arm segments 623 and rotates relative to the first arm segments 622.3rd arm segments 624 is rotatably installed on the second arm segments 623; 8th motor is installed on the second arm segments 623, is configured to drive the 3rd arm segments 624 and rotates relative to the second arm segments 623.4th arm segments 625 is rotatably installed on the 3rd arm segments 624; 9th motor is installed on the 3rd arm segments 624, is configured to drive the 4th arm segments 625 and rotates relative to the 3rd arm segments 624.The palm 631 of each mechanical arm 63 is rotatably installed on the 4th arm segments 625 of a mechanical arm 62; Tenth motor is installed on the 4th arm segments 625, is configured to driving mechanical hand 63 and rotates relative to the 4th arm segments 625.
Preferably, the first motor 633, second motor 635, each 3rd motor 637, each 4th motor 638, the 5th motor, the 6th motor, the 7th motor, the 8th motor, the 9th motor and the tenth motor are steering wheel.
The subassembly of each mechanical arm 63 and mechanical arm 62 also can be called as bionic mechanical arm, it has 16 Electric Machine Control, the bionical flexible manipulator arm of 32 degree of freedom can be formed, the gesture motion making corresponding sign language more accurately, specification, the information that deaf-mute can be made accurately to understand normal person transmit out.
In this embodiment, receiving trap 40 comprises microphone, is arranged on fuselage 61.Fuselage 61 is also provided with display device 64, to show the Word message of receiving trap 40 reception or the Word message corresponding with the voice that receiving trap 40 receives.Word or language output unit comprise loudspeaker, are arranged at fuselage 61.When normal person says voice, microphone receives audio, the data processor of robot interior is decoded, carry out contrasting with local memory database or by WIFI connecting Internet, carry out mating in internet database and find corresponding text message, text message is presented in robot display device 64, and process matches mechanical arm motion control parameter corresponding to corresponding phrase phrase in database, make corresponding sign language by 32 degree of freedom bionic mechanical arms, make deaf-mute understand normal person's meaning to be expressed.
So far, those skilled in the art will recognize that, although multiple exemplary embodiment of the present invention is illustrate and described herein detailed, but, without departing from the spirit and scope of the present invention, still can directly determine or derive other modification many or amendment of meeting the principle of the invention according to content disclosed by the invention.Therefore, scope of the present invention should be understood and regard as and cover all these other modification or amendments.

Claims (10)

1. the bionical sign language bidirectional translation system of voice, is characterized in that, comprising:
Sign language action recognition device, is configured to the gesture motion identifying the sign language person of sending;
Word or language output unit, be configured to export the word corresponding with the gesture motion that the identification of described sign language action recognition device obtains or voice;
Receiving trap, is configured to receive word or voice that word or the language person of sending send;
There is the bionical sign language output unit of mechanical arm, be configured to the gesture motion making the sign language corresponding with the word that described receiving trap receives or voice; And
Control device, all communicates to connect with described sign language action recognition device, described word or language output unit, described receiving trap and described bionical sign language output unit, is configured to:
The gesture motion that the identification of described sign language action recognition device obtains is translated into corresponding word or language, exports to make described word or language output unit; With
The word receive described receiving trap or Language Translation become the gesture motion of corresponding sign language, make to make described bionical sign language output unit.
2. the bionical sign language bidirectional translation system of voice according to claim 1, is characterized in that,
Described mechanical arm is two, and each described mechanical arm comprises:
Palm;
First finger, its third knuckle that there is the first knuckle being articulated in described palm, the second knuckle being articulated in described first knuckle and be articulated in described second knuckle;
First motor, is configured to drive described first knuckle to rotate relative to described palm, to make the twisting motion of described first-hand fingering row;
First curls up stretches driving mechanism, its second motor having the first bracing wire, the first resetting means and be installed on described palm, is configured to drive described first-hand fingering row to curl up and stretches motion;
Multiple second finger, each described second finger has the contiguous block being articulated in described palm, the 4th dactylus being articulated in described contiguous block, is articulated in the wuzhijie point of described 4th dactylus and is articulated in the 6th dactylus of described wuzhijie point;
Multiple 3rd motor, each described 3rd motor is configured to driving described contiguous block and rotates relative to described palm, swings to make each described second finger;
Multiple second curls up stretches driving mechanism, and each described second curls up stretches the 4th motor that driving mechanism has the second bracing wire, the second resetting means and be installed on described palm, is configured to driving described second finger and carries out curling up stretching motion.
3. the bionical sign language bidirectional translation system of voice according to claim 2, is characterized in that,
Described first resetting means comprises two torsion springs, and a torsion spring is installed on described first knuckle and described second knuckle, and another torsion spring is installed on described second knuckle and described third knuckle;
Each described second resetting means comprises three torsion springs, and a torsion spring is installed on described contiguous block and described 4th dactylus, and another torsion spring is installed on described 4th dactylus and described wuzhijie point, and the 3rd torsion spring is installed on described wuzhijie point and described 6th dactylus;
Described first curls up stretches driving mechanism and each described second and curls up and stretch driving mechanism and all also comprise stay wire tube.
4. the bionical sign language bidirectional translation system of voice according to claim 2, is characterized in that, described bionical sign language output unit also comprises fuselage and is installed on two mechanical arms of described fuselage, and each described mechanical arm comprises:
Web member, is rotatably installed on described fuselage;
5th motor, is installed on described fuselage, is configured to described web member and rotates relative to described fuselage;
First arm segments, is rotatably installed on described web member;
6th motor, is installed on described fuselage, is configured to drive described first arm segments to rotate relative to described web member;
Second arm segments, is rotatably installed on described first arm segments;
7th motor, is installed on described first arm segments, is configured to drive described second arm segments to rotate relative to described first arm segments;
3rd arm segments, is rotatably installed on described second arm segments;
8th motor, is installed on described second arm segments, is configured to drive described 3rd arm segments to rotate relative to described second arm segments;
4th arm segments, is rotatably installed on described 3rd arm segments, and the palm of each described mechanical arm is rotatably installed on the 4th arm segments of a described mechanical arm;
9th motor, is installed on described 3rd arm segments, is configured to drive described 4th arm segments to rotate relative to described 3rd arm segments;
Tenth motor, is installed on described 4th arm segments, is configured to drive described mechanical arm to rotate relative to described 4th arm segments.
5. the bionical sign language bidirectional translation system of voice according to claim 4, is characterized in that,
Described first motor, described second motor, each described 3rd motor, each described 4th motor, the 5th motor, the 6th motor, the 7th motor, the 8th motor, the 9th motor and the tenth motor are steering wheel.
6. the bionical sign language bidirectional translation system of voice according to claim 4, it is characterized in that, described fuselage is also provided with display device, to show the Word message of described receiving trap reception or the Word message corresponding with the voice that described receiving trap receives.
7. the bionical sign language bidirectional translation system of voice according to claim 4, is characterized in that,
Described receiving trap comprises microphone, is arranged at described fuselage;
Described word or language output unit comprise loudspeaker, are arranged at described fuselage.
8. the bionical sign language bidirectional translation system of voice according to claim 1, is characterized in that,
Sign language action recognition device comprises sign language gloves and is arranged at the sensor on sign language gloves, to detect the gesture motion of the sign language person of sending.
9. the bionical sign language bidirectional translation system of voice according to claim 1, is characterized in that,
Described sign language action recognition device and described control device include wireless transport module.
10. the bionical sign language bidirectional translation system of voice according to claim 1, is characterized in that,
Described control device comprises:
Be arranged at the first control device on described sign language action recognition device, translate into corresponding word or language with the gesture motion identification of described sign language action recognition device obtained, export to make described word or language output unit; With
Be arranged at the second control device on described bionical sign language output unit, become the gesture motion of corresponding sign language with the word received by described receiving trap or Language Translation, make to make described bionical sign language output unit; And
Described word or language output unit are arranged on described sign language action recognition device;
Described receiving trap is arranged on described bionical sign language output unit.
CN201610020192.1A 2016-01-13 2016-01-13 Voice bionic sign language bidirectional translation system Pending CN105489088A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610020192.1A CN105489088A (en) 2016-01-13 2016-01-13 Voice bionic sign language bidirectional translation system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610020192.1A CN105489088A (en) 2016-01-13 2016-01-13 Voice bionic sign language bidirectional translation system

Publications (1)

Publication Number Publication Date
CN105489088A true CN105489088A (en) 2016-04-13

Family

ID=55676049

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610020192.1A Pending CN105489088A (en) 2016-01-13 2016-01-13 Voice bionic sign language bidirectional translation system

Country Status (1)

Country Link
CN (1) CN105489088A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105741624A (en) * 2016-05-16 2016-07-06 苏州金建达智能科技有限公司 Domestic intelligent children teaching robot
CN106295603A (en) * 2016-08-18 2017-01-04 广东技术师范学院 Chinese sign language bidirectional translation system, method and apparatus
CN106372626A (en) * 2016-11-07 2017-02-01 包洋萱 Communication device and method based on gesture recognition
CN106570473A (en) * 2016-11-03 2017-04-19 深圳量旌科技有限公司 Deaf-mute sign language identification interaction system based on robot
CN107765850A (en) * 2017-09-22 2018-03-06 上海交通大学 A kind of sign Language Recognition based on electronic skin and multi-sensor fusion
CN108549490A (en) * 2018-05-03 2018-09-18 林潼 A kind of gesture identification interactive approach based on Leap Motion equipment
CN109448696A (en) * 2018-12-27 2019-03-08 韩思清 A kind of sounding gloves apparatus with deaf-mute's two-way exchange
CN110202592A (en) * 2019-07-02 2019-09-06 江苏博子岛智能产业技术研究院有限公司 A kind of AI mobile medical service robot
CN110390239A (en) * 2018-04-17 2019-10-29 现代自动车株式会社 The control method of vehicle and communication system including the communication system for disabled person

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05241496A (en) * 1992-02-27 1993-09-21 Toshiba Corp Finger language interpretation device
CN101577062A (en) * 2008-12-30 2009-11-11 浙江工业大学 Space encoding-based method for realizing interconversion between sign language motion information and text message
CN104049753A (en) * 2014-06-09 2014-09-17 百度在线网络技术(北京)有限公司 Method and device for realizing mutual conversion between sign language information and text information
CN104382674A (en) * 2014-10-20 2015-03-04 华中科技大学 Under-actuated prosthetic hand capable of reproducing hand grasping function
CN204893945U (en) * 2015-09-11 2015-12-23 哈尔滨理工大学 Imitative articular housekeeping robot of human arm

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05241496A (en) * 1992-02-27 1993-09-21 Toshiba Corp Finger language interpretation device
CN101577062A (en) * 2008-12-30 2009-11-11 浙江工业大学 Space encoding-based method for realizing interconversion between sign language motion information and text message
CN104049753A (en) * 2014-06-09 2014-09-17 百度在线网络技术(北京)有限公司 Method and device for realizing mutual conversion between sign language information and text information
CN104382674A (en) * 2014-10-20 2015-03-04 华中科技大学 Under-actuated prosthetic hand capable of reproducing hand grasping function
CN204893945U (en) * 2015-09-11 2015-12-23 哈尔滨理工大学 Imitative articular housekeeping robot of human arm

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105741624A (en) * 2016-05-16 2016-07-06 苏州金建达智能科技有限公司 Domestic intelligent children teaching robot
CN106295603A (en) * 2016-08-18 2017-01-04 广东技术师范学院 Chinese sign language bidirectional translation system, method and apparatus
CN106570473A (en) * 2016-11-03 2017-04-19 深圳量旌科技有限公司 Deaf-mute sign language identification interaction system based on robot
CN106372626A (en) * 2016-11-07 2017-02-01 包洋萱 Communication device and method based on gesture recognition
CN107765850A (en) * 2017-09-22 2018-03-06 上海交通大学 A kind of sign Language Recognition based on electronic skin and multi-sensor fusion
CN110390239A (en) * 2018-04-17 2019-10-29 现代自动车株式会社 The control method of vehicle and communication system including the communication system for disabled person
CN108549490A (en) * 2018-05-03 2018-09-18 林潼 A kind of gesture identification interactive approach based on Leap Motion equipment
CN109448696A (en) * 2018-12-27 2019-03-08 韩思清 A kind of sounding gloves apparatus with deaf-mute's two-way exchange
CN110202592A (en) * 2019-07-02 2019-09-06 江苏博子岛智能产业技术研究院有限公司 A kind of AI mobile medical service robot

Similar Documents

Publication Publication Date Title
CN105489088A (en) Voice bionic sign language bidirectional translation system
CN102789313B (en) User interaction system and method
KR101777807B1 (en) Sign language translator, system and method
CN107690651B (en) System and method for automated sign language recognition
Pan et al. GeeAir: a universal multimodal remote control device for home appliances
US20130218339A1 (en) "humanoid robot equipped with a natural dialogue interface, method for controlling the robot and corresponding program"
CN107993651B (en) Voice recognition method and device, electronic equipment and storage medium
Heera et al. Talking hands—An Indian sign language to speech translating gloves
Liu et al. Multi-HMM classification for hand gesture recognition using two differing modality sensors
JP2015043209A (en) Display method through head mounted device
CN113763532B (en) Man-machine interaction method, device, equipment and medium based on three-dimensional virtual object
US11468247B2 (en) Artificial intelligence apparatus for learning natural language understanding models
KR20200090355A (en) Multi-Channel-Network broadcasting System with translating speech on moving picture and Method thererof
CN110370290A (en) Robot and its control method
KR101793607B1 (en) System, method and program for educating sign language
CN112488157A (en) Dialog state tracking method and device, electronic equipment and storage medium
CN205318692U (en) Pronunciation bionic hand two -way translation system of speaking
KR102009150B1 (en) Automatic Apparatus and Method for Converting Sign language or Finger Language
CN108960191B (en) Multi-mode fusion emotion calculation method and system for robot
JP5163202B2 (en) Article estimation system
US11817097B2 (en) Electronic apparatus and assistant service providing method thereof
Fraiwan et al. A Kinect-based system for Arabic sign language to speech translation
CN116312613A (en) Digital human expression mouth shape driving method, system, electronic equipment and storage medium
TWM546589U (en) Sign language recognition system
TW201830198A (en) Sign language recognition method and system for converting user's sign language and gestures into sensed finger bending angle, hand posture and acceleration through data capturing gloves

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20160413

WD01 Invention patent application deemed withdrawn after publication