CN104966433A - Intelligent glasses assisting deaf-mute conversation - Google Patents
Intelligent glasses assisting deaf-mute conversation Download PDFInfo
- Publication number
- CN104966433A CN104966433A CN201510419346.XA CN201510419346A CN104966433A CN 104966433 A CN104966433 A CN 104966433A CN 201510419346 A CN201510419346 A CN 201510419346A CN 104966433 A CN104966433 A CN 104966433A
- Authority
- CN
- China
- Prior art keywords
- intelligent glasses
- voice
- mute
- signal
- deaf
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Rehabilitation Tools (AREA)
Abstract
The invention discloses intelligent glasses assisting a deaf-mute conversation and relates to the intelligent engineering field. By using the intelligent glasses assisting the deaf-mute conversation, sign language and gesture images are adopted; sign language identification is converted into a voice; and the voice can be changed into the sign language and gesture through processing and then the sign language and gesture is projected to the glasses. Through the glasses, a barrier-free communication among a deaf-mute, a blind person and an able-bodied person can be realized. A barrier-free communication between the deaf-mute and the able-bodied person who does not understand a sign language can be realized. A barrier-free communication between the blind person and the deaf-mute can be realized through a voice function. Through the glasses of the invention, spirit lives of a disabled person can be increased; the disabled person can realize the barrier-free communication with any one, just like the able-bodied person.
Description
Technical field
The present invention relates to intelligence engineering field, the intelligent glasses of particularly a kind of auxiliary deaf-mute's dialogue.
Background technology
Intelligent glasses was obtaining development at full speed in recent years, comprised the research institutions such as the enterprise such as Google, association and the Chinese Academy of Sciences and had all applied for very many patents, and have developed many moneys product.Such as, but current most of intelligent glasses products are all based on amusement and life application, game, map search, check weather etc.And from current applied for patent, the function that major part intelligent glasses realizes also is all Orientation on map identification, speech recognition, use the functions such as intelligent glasses viewing video, also some people has applied for talking with glasses based on the blind person of speech recognition, and fresh rare people goes to pay close attention to deaf-mute, exchanging between blind person with normal person.
Along with the development of intelligent identification technology, various countries' speech recognition, gesture identification also become possibility, and current intelligent glasses can not solve the problem that deaf-mute exchanges with normal person perfectly.
Summary of the invention
Technical matters to be solved by this invention is to provide a kind of intelligent glasses of auxiliary deaf-mute's dialogue, a kind of intelligent glasses with dialogue function is proposed, this intelligent glasses has the function of speech recognition and Sign Language Recognition, can realize the interchange between deaf-mute, blind person, normal person.
For achieving the above object, the invention provides following technical scheme: the intelligent glasses of this auxiliary deaf-mute's dialogue can take sign language images of gestures by glasses, and convert voice to by Sign Language Recognition, and voice can be become sign language gesture by process and project to glasses.
A kind of intelligent glasses of auxiliary deaf-mute's dialogue, it is characterized in that: the intelligent glasses of described auxiliary deaf-mute's dialogue is obtained by voice, Image Acquisition, voice broadcast, image projection, wireless communication module and server composition, voice acquisition module is then pass through speech transducer, gather the voice signal of interlocutor, the voice signal collected and picture signal process by server, the semantic conversion extracted in voice signal becomes sign language image, and be transferred to intelligent glasses, be projected to glasses display, the signal pattern signal receiving receipts is processed, extract sign language signal, and convert the voice signal of identical semanteme to, by being wirelessly transmitted to intelligent glasses and playing by voice broadcast module, the intelligent glasses course of work of this auxiliary deaf-mute's dialogue is:
(1) image collection module obtains realtime graphic, and by wireless module real-time Transmission to server;
(2) server processes the image obtained, if recognize sign language signal, then this signal is changed into voice signal, transfers to intelligent glasses end by wireless module;
(3) intelligent glasses receives the voice signal that server sends in real time, uses voice broadcast module to these voice letter and reports.
Preferably, described picture signal is then obtain the image in visual range.
Preferably, described wireless communication module is then voice signal and picture signal are transmitted at intelligent glasses and server by the mode of radio communication.
Preferably, described voice reporting is broadcast, and is to use voice broadcast to play the picture signal converting voice signal to.
Preferably, described image projection is that the voice signal of converting sign language image is projected to intelligent glasses.
The beneficial effect of above technical scheme is adopted to be: the intelligent glasses of this auxiliary deaf-mute's dialogue takes sign language images of gestures by glasses, and converts voice to by Sign Language Recognition, voice can be become sign language gesture by process and project to glasses.Deaf-mute can be realized by these glasses to exchange with the accessible of friendship of blind person, normal person, deaf-mute can be made to exchange with accessible between the normal person being ignorant of sign language, and can make to carry out accessible interchange by phonetic function between blind person with deaf-mute, the cultural life of disabled person can be improved by this invention, the same with normal person, accessible interchange can be realized with anyone.
Accompanying drawing explanation
Below in conjunction with accompanying drawing, the specific embodiment of the present invention is described in further detail.
Fig. 1 is the schematic diagram of the intelligent glasses of a kind of auxiliary deaf-mute's dialogue of the present invention.
Embodiment
The preferred implementation of the intelligent glasses of a kind of auxiliary deaf-mute's dialogue of the present invention is described in detail below in conjunction with accompanying drawing.
Composition graphs 1 shows the embodiment of the intelligent glasses of a kind of auxiliary deaf-mute's dialogue of the present invention: the intelligent glasses of this auxiliary deaf-mute's dialogue is obtained by voice, Image Acquisition, voice broadcast, image projection, wireless communication module and server composition, voice acquisition module is then pass through speech transducer, gather the voice signal of interlocutor, picture signal is then obtain the image in visual range, wireless communication module is then voice signal and picture signal are transmitted at intelligent glasses and server by the mode of radio communication, voice reporting is broadcast, and is to use voice broadcast to play the picture signal converting voice signal to, image projection is that the voice signal of converting sign language image is projected to intelligent glasses, the voice signal collected and picture signal process by server, the semantic conversion extracted in voice signal becomes sign language image, and be transferred to intelligent glasses, be projected to glasses display, the signal pattern signal receiving receipts is processed, extract sign language signal, and convert the voice signal of identical semanteme to, by being wirelessly transmitted to intelligent glasses and playing by voice broadcast module, the intelligent glasses course of work of this auxiliary deaf-mute's dialogue is:
(1) image collection module obtains realtime graphic, and by wireless module real-time Transmission to server;
(2) server processes the image obtained, if recognize sign language signal, then this signal is changed into voice signal, transfers to intelligent glasses end by wireless module;
(3) intelligent glasses receives the voice signal that server sends in real time, uses voice broadcast module to these voice letter and reports.
The intelligent glasses of this auxiliary deaf-mute's dialogue takes sign language images of gestures by glasses, and converts voice to by Sign Language Recognition, voice can be become sign language gesture by process and project to glasses.Deaf-mute can be realized by these glasses to exchange with the accessible of friendship of blind person, normal person, deaf-mute can be made to exchange with accessible between the normal person being ignorant of sign language, and can make to carry out accessible interchange by phonetic function between blind person with deaf-mute, the cultural life of disabled person can be improved by this invention, the same with normal person, accessible interchange can be realized with anyone.
Above is only the preferred embodiment of the present invention, and it should be pointed out that for the person of ordinary skill of the art, without departing from the concept of the premise of the invention, can also make some distortion and improvement, these all belong to protection scope of the present invention.
Claims (5)
1. the intelligent glasses of auxiliary deaf-mute's dialogue, it is characterized in that: the intelligent glasses of described auxiliary deaf-mute's dialogue is obtained by voice, Image Acquisition, voice broadcast, image projection, wireless communication module and server composition, voice acquisition module is then pass through speech transducer, gather the voice signal of interlocutor, the voice signal collected and picture signal process by server, the semantic conversion extracted in voice signal becomes sign language image, and be transferred to intelligent glasses, be projected to glasses display, the signal pattern signal receiving receipts is processed, extract sign language signal, and convert the voice signal of identical semanteme to, by being wirelessly transmitted to intelligent glasses and playing by voice broadcast module, the intelligent glasses course of work of this auxiliary deaf-mute's dialogue is:
(1) image collection module obtains realtime graphic, and by wireless module real-time Transmission to server;
(2) server processes the image obtained, if recognize sign language signal, then this signal is changed into voice signal, transfers to intelligent glasses end by wireless module;
(3) intelligent glasses receives the voice signal that server sends in real time, uses voice broadcast module to these voice letter and reports.
2. the intelligent glasses of auxiliary deaf-mute's dialogue according to claim 1, is characterized in that: described picture signal is then obtain the image in visual range.
3. the intelligent glasses of auxiliary deaf-mute's dialogue according to claim 1, is characterized in that: described wireless communication module is then voice signal and picture signal are transmitted at intelligent glasses and server by the mode of radio communication.
4. the intelligent glasses of auxiliary deaf-mute's dialogue according to claim 1, is characterized in that: described voice reporting is broadcast, and is use voice broadcast to play the picture signal converting voice signal to.
5. the intelligent glasses of auxiliary deaf-mute's dialogue according to claim 1, is characterized in that: described image projection is that the voice signal of converting sign language image is projected to intelligent glasses.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510419346.XA CN104966433A (en) | 2015-07-17 | 2015-07-17 | Intelligent glasses assisting deaf-mute conversation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510419346.XA CN104966433A (en) | 2015-07-17 | 2015-07-17 | Intelligent glasses assisting deaf-mute conversation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104966433A true CN104966433A (en) | 2015-10-07 |
Family
ID=54220464
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510419346.XA Pending CN104966433A (en) | 2015-07-17 | 2015-07-17 | Intelligent glasses assisting deaf-mute conversation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104966433A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106205293A (en) * | 2016-09-30 | 2016-12-07 | 广州音书科技有限公司 | For speech recognition and the intelligent glasses of Sign Language Recognition |
| CN106896529A (en) * | 2017-03-26 | 2017-06-27 | 王金锁 | Deaf-mute's synchronous translation glasses |
| CN107223277A (en) * | 2016-12-16 | 2017-09-29 | 深圳前海达闼云端智能科技有限公司 | A kind of deaf-mute's householder method, device and electronic equipment |
| CN108831472A (en) * | 2018-06-27 | 2018-11-16 | 中山大学肿瘤防治中心 | A kind of artificial intelligence sonification system and vocal technique based on lip reading identification |
| CN108877410A (en) * | 2018-08-07 | 2018-11-23 | 深圳市漫牛医疗有限公司 | A kind of deaf-mute's sign language exchange method and deaf-mute's sign language interactive device |
| CN108877409A (en) * | 2018-07-24 | 2018-11-23 | 王钦 | The deaf-mute's auxiliary tool and its implementation shown based on gesture identification and VR |
| CN110138961A (en) * | 2019-04-15 | 2019-08-16 | 平安普惠企业管理有限公司 | Control method, device, medium and the equipment of intelligent sound assistant |
| CN111081120A (en) * | 2019-12-27 | 2020-04-28 | 南京芯视元电子有限公司 | Intelligent wearable device assisting person with hearing and speaking obstacles to communicate |
| WO2020228059A1 (en) * | 2019-05-15 | 2020-11-19 | 东北大学 | Head-mounted augmented reality glass system and implementation method therefor |
| CN113194299A (en) * | 2021-07-01 | 2021-07-30 | 深圳市修远文化创意有限公司 | Oral treatment real-time picture sharing method under intelligent medical scene |
| CN114267323A (en) * | 2021-12-27 | 2022-04-01 | 深圳市研强物联技术有限公司 | Voice hearing aid AR glasses for deaf-mutes and communication method thereof |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5029216A (en) * | 1989-06-09 | 1991-07-02 | The United States Of America As Represented By The Administrator Of The National Aeronautics & Space Administration | Visual aid for the hearing impaired |
| JP2006251596A (en) * | 2005-03-14 | 2006-09-21 | Kyoto Institute Of Technology | Support device for visually handicapped person |
| WO2009156145A1 (en) * | 2008-06-26 | 2009-12-30 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Hearing aid apparatus, and hearing aid method |
| CN103310683A (en) * | 2013-05-06 | 2013-09-18 | 深圳先进技术研究院 | Intelligent glasses and voice communication system and method basing on intelligent glasses |
| CN203311665U (en) * | 2013-06-25 | 2013-11-27 | 安徽省科普产品工程研究中心有限责任公司 | Sign-language and voice translation auxiliary device |
| CN103646587A (en) * | 2013-12-05 | 2014-03-19 | 北京京东方光电科技有限公司 | deaf-mute people |
| CN103714732A (en) * | 2013-12-21 | 2014-04-09 | 杜婉璐 | Glasses capable of sign language translation |
| AU2013101597A4 (en) * | 2013-10-30 | 2015-02-26 | Cardamone, Frank MR | VISSION ASSIST - “Real Time VissionAssist for the Blind & Visually Impaired” - as the name implies, is the invention which allows the blind, the visually impaired and those experiencing diminishing visual capabilities, to dramatically change that around |
-
2015
- 2015-07-17 CN CN201510419346.XA patent/CN104966433A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5029216A (en) * | 1989-06-09 | 1991-07-02 | The United States Of America As Represented By The Administrator Of The National Aeronautics & Space Administration | Visual aid for the hearing impaired |
| JP2006251596A (en) * | 2005-03-14 | 2006-09-21 | Kyoto Institute Of Technology | Support device for visually handicapped person |
| WO2009156145A1 (en) * | 2008-06-26 | 2009-12-30 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Hearing aid apparatus, and hearing aid method |
| CN103310683A (en) * | 2013-05-06 | 2013-09-18 | 深圳先进技术研究院 | Intelligent glasses and voice communication system and method basing on intelligent glasses |
| CN203311665U (en) * | 2013-06-25 | 2013-11-27 | 安徽省科普产品工程研究中心有限责任公司 | Sign-language and voice translation auxiliary device |
| AU2013101597A4 (en) * | 2013-10-30 | 2015-02-26 | Cardamone, Frank MR | VISSION ASSIST - “Real Time VissionAssist for the Blind & Visually Impaired” - as the name implies, is the invention which allows the blind, the visually impaired and those experiencing diminishing visual capabilities, to dramatically change that around |
| CN103646587A (en) * | 2013-12-05 | 2014-03-19 | 北京京东方光电科技有限公司 | deaf-mute people |
| CN103714732A (en) * | 2013-12-21 | 2014-04-09 | 杜婉璐 | Glasses capable of sign language translation |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106205293A (en) * | 2016-09-30 | 2016-12-07 | 广州音书科技有限公司 | For speech recognition and the intelligent glasses of Sign Language Recognition |
| CN107223277A (en) * | 2016-12-16 | 2017-09-29 | 深圳前海达闼云端智能科技有限公司 | A kind of deaf-mute's householder method, device and electronic equipment |
| WO2018107489A1 (en) * | 2016-12-16 | 2018-06-21 | 深圳前海达闼云端智能科技有限公司 | Method and apparatus for assisting people who have hearing and speech impairments and electronic device |
| CN106896529A (en) * | 2017-03-26 | 2017-06-27 | 王金锁 | Deaf-mute's synchronous translation glasses |
| CN108831472A (en) * | 2018-06-27 | 2018-11-16 | 中山大学肿瘤防治中心 | A kind of artificial intelligence sonification system and vocal technique based on lip reading identification |
| CN108831472B (en) * | 2018-06-27 | 2022-03-11 | 中山大学肿瘤防治中心 | Artificial intelligent sounding system and sounding method based on lip language recognition |
| CN108877409A (en) * | 2018-07-24 | 2018-11-23 | 王钦 | The deaf-mute's auxiliary tool and its implementation shown based on gesture identification and VR |
| CN108877410A (en) * | 2018-08-07 | 2018-11-23 | 深圳市漫牛医疗有限公司 | A kind of deaf-mute's sign language exchange method and deaf-mute's sign language interactive device |
| CN110138961A (en) * | 2019-04-15 | 2019-08-16 | 平安普惠企业管理有限公司 | Control method, device, medium and the equipment of intelligent sound assistant |
| WO2020228059A1 (en) * | 2019-05-15 | 2020-11-19 | 东北大学 | Head-mounted augmented reality glass system and implementation method therefor |
| CN111081120A (en) * | 2019-12-27 | 2020-04-28 | 南京芯视元电子有限公司 | Intelligent wearable device assisting person with hearing and speaking obstacles to communicate |
| CN113194299A (en) * | 2021-07-01 | 2021-07-30 | 深圳市修远文化创意有限公司 | Oral treatment real-time picture sharing method under intelligent medical scene |
| CN113194299B (en) * | 2021-07-01 | 2021-08-31 | 深圳市修远文化创意有限公司 | Oral treatment real-time picture sharing method under intelligent medical scene |
| CN114267323A (en) * | 2021-12-27 | 2022-04-01 | 深圳市研强物联技术有限公司 | Voice hearing aid AR glasses for deaf-mutes and communication method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104966433A (en) | Intelligent glasses assisting deaf-mute conversation | |
| CN105957514B (en) | A kind of portable deaf-mute's alternating current equipment | |
| USRE41002E1 (en) | Telephone for the deaf and method of using same | |
| CN103941870B (en) | Head-mounted display device | |
| US8503731B2 (en) | Sign language recognition system and method | |
| US11703941B2 (en) | Information processing system, information processing method, and program | |
| CN210392308U (en) | Intelligent recognition garbage classification device | |
| CN205490994U (en) | Multi -functional intelligent sound box | |
| CN104036270B (en) | A kind of instant automatic translation device and method | |
| CN105007557A (en) | Intelligent hearing aid with voice identification and subtitle display functions | |
| CN107248091A (en) | A kind of recognition of face interactive marketing system | |
| CN104361787A (en) | System and method for converting signals | |
| CN113438300A (en) | Network-based accessible communication online communication system and method for hearing-impaired people and normal people | |
| CN106943740A (en) | A kind of gesture language-voice game interactive system | |
| CN202424921U (en) | Building talk-back visual system with third-generation (3G) module | |
| CN202331716U (en) | Tour prompting device | |
| CN110146988A (en) | A kind of wear-type augmented reality glasses system and its implementation | |
| CN205080563U (en) | Railway station intelligent mobile terminal | |
| CN207946826U (en) | A kind of system of registering based on dynamic human face identification | |
| CN111128180A (en) | Auxiliary dialogue system for hearing-impaired people | |
| CN111723671A (en) | Intelligent lamp pole distress system and method | |
| CN107786840A (en) | The supervisory systems and its method of long-range child old man based on smart home | |
| CN204102304U (en) | A kind of Household security system based on SMS | |
| CN207337339U (en) | Transparence display interaction systems | |
| CN105955462A (en) | Holographic image display system for long-distance lovers |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20151007 |
|
| RJ01 | Rejection of invention patent application after publication |