CN113438300A - Network-based accessible communication online communication system and method for hearing-impaired people and normal people - Google Patents
Network-based accessible communication online communication system and method for hearing-impaired people and normal people Download PDFInfo
- Publication number
- CN113438300A CN113438300A CN202110694216.2A CN202110694216A CN113438300A CN 113438300 A CN113438300 A CN 113438300A CN 202110694216 A CN202110694216 A CN 202110694216A CN 113438300 A CN113438300 A CN 113438300A
- Authority
- CN
- China
- Prior art keywords
- hearing
- impaired
- sign language
- people
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 208000032041 Hearing impaired Diseases 0.000 title claims abstract description 154
- 238000004891 communication Methods 0.000 title claims abstract description 74
- 238000000034 method Methods 0.000 title claims abstract description 17
- 208000016354 hearing loss disease Diseases 0.000 claims abstract description 13
- 206010011878 Deafness Diseases 0.000 claims description 16
- 230000009471 action Effects 0.000 claims description 6
- 238000006243 chemical reaction Methods 0.000 claims description 5
- 230000004888 barrier function Effects 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims 1
- 238000007726 management method Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 4
- 230000007547 defect Effects 0.000 description 4
- 238000013519 translation Methods 0.000 description 4
- 230000001965 increasing effect Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 238000013523 data management Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000003912 environmental pollution Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/046—Interoperability with other network applications or services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a network-based accessible communication online communication system and method for hearing-impaired people and normal people, which comprises a hearing-impaired terminal, a hearing-impaired terminal and a cloud server, wherein the network-based accessible communication online communication system comprises: the hearing-impaired terminal and the hearing-impaired terminal convert one or more received data of voice, characters and video of the hearing-impaired terminal and the hearing-impaired terminal through the hearing-impaired terminal or the cloud server, the data received by the hearing-impaired terminal is sign language video, the received and converted data are respectively transmitted to hearing-impaired people and people without the hearing-impaired terminal through a network, online chatting conversation between normal people without hearing impairment and hearing-impaired people is achieved, online communication and conversation between the hearing-impaired people and the hearing-impaired people are achieved, and great contribution is provided for the hearing-impaired people to blend into life, study and work of the society.
Description
Technical Field
The invention relates to the technical field of barrier-free normal communication between hearing-impaired people and normal people, in particular to an online communication system and method for realizing barrier-free communication between the hearing-impaired people and the normal people.
Background
The deaf people communicate with the blind people, and the information obstruction is the biggest obstacle, which is also the subject of active research and study. The deaf and the blind have the common point that the feeling is sensitive, the simple problem can be solved by writing on the palm with fingers, but the problems of difference between men and women, difference between the old and the young, difference between cultural levels and the like are not easy, and the complex problem is not feasible.
China is a country with the largest number of hearing disabilities in the world, 2780 thousands of hearing disabilities exist, wherein about 13.7 thousands of hearing disabilities exist in children aged 0-6 years, 2-3 thousands of new born hearing disabilities exist in the world, 36,000 thousands of people exist in the world according to the latest data released in 2016 by world health organization, and the number of people exceeds the total number of American population; with adults up to 32,800 ten thousand and children 3,000 thousand. The latest data in China shows that the number of people with hearing impairment in China is up to 2780 ten thousands, the people with hearing impairment live at the first of five disabilities and account for 1.67 percent of the total number of people in China, and 2-3 thousands of new children with hearing impairment exist every year. After the comprehensive policy of two children is released, the number is more huge as the birth rate of the newborn is increased, and the number of old puerperae is increased, the environmental pollution and other factors influence. The second national disabled people sampling survey shows that the number of disabled hearing impaired people in China reaches 2780 thousands, 13.7 thousands of disabled hearing impaired people in 0-6 years old, at least about 2 thousands of new hearing impaired children are born each year, the total number of hearing impaired children exceeds 460 thousands, and in recent years, the hearing impaired situations of teenagers show an increasing trend, so that the people are the countries with the largest number of hearing impaired people in the whole world.
At present, the main measures taken by the state to solve the communication problem between the hearing-impaired people and the normal people are to help the hearing-impaired people to communicate with the normal people by training hearing aid fitters and by training sign language translation.
However, with the remarkable increase of the number of the hearing-impaired people, the human cost, the financial cost and the time cost required by the mode of promoting the communication between the hearing-impaired people and normal people are improved by training the sign language translation and the hearing aid fitter, the assistance to the life of the hearing-impaired people cannot be timely solved, and meanwhile, the problem that the employment of the hearing-impaired people is influenced due to the fact that the hearing-impaired people cannot be engaged in partial industry work due to the fact that the communication with the normal people is not smooth is also difficult to solve.
Other auxiliary devices are available, but there are some problems:
firstly, some wearable equipment need wear on the body of hearing impaired personage, carry inconveniently, influence hearing impaired personage's life work.
Secondly, the auxiliary devices need some independent servers to collect and process information, but the cloud server is adopted in the invention, data are uploaded through a 5G network, and the system has the advantages of high transmission speed, convenience in storage, higher response speed and convenience in use and subsequent upgrading.
Chinese patent CN201810078192.6 discloses a communication tool for hearing-impaired people, CN201620785518.5, which discloses life auxiliary devices for hearing-impaired people, which need to be worn on the body of the hearing-impaired people, and thus, inconvenience is brought to the movement and life of the hearing-impaired people. The terminal equipment comprises the hearing-impaired terminal and the non-hearing-impaired terminal, can use a mobile phone, and is convenient to carry.
Chinese patent CN201610791300.5 discloses an intelligent multifunctional electronic watch for hearing-impaired people, which has an integrated main processor therein for processing received sound signals, and the processor is not as convenient as a cloud server for storage, and once the hardware has problems, the data is easily lost and the upgrading is inconvenient.
In summary, the technical problems existed now are: the existing barrier-free communication method for the hearing-impaired people and the public has the defects of high manpower cost, financial cost and time cost, and incapability of timely assisting the life of the hearing-impaired people, and also has the defects of difficult employment of the hearing-impaired people due to difficulty in communication with normal people and influence on the employment of the hearing-impaired people due to difficulty in working in partial industries, and the existing method has the defect of difficulty in realizing barrier-free communication between deaf people and blind people.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention provides an obstacle-free communication system for the people with hearing impairment and the people without hearing impairment, so that the on-line obstacle-free communication system is used for the people with hearing impairment and other network-based people including but not limited to deaf people, other disabled people and most main healthy people.
The technical scheme adopted by the invention is as follows: the barrier-free communication online communication system for the hearing-impaired people and the normal people based on the network is characterized in that: including no hearing barrier terminal, hearing barrier terminal and high in the clouds server, wherein:
the hearing-impaired terminal is used for uploading one or more data of voice, characters and videos of normal hearing-impaired people to the cloud server through the network, and receiving any one or more data of characters, voice and videos converted from sign language video data of hearing-impaired people processed by the cloud server through the network so as to realize online chatting conversation between the normal hearing-impaired people and the hearing-impaired people, thereby solving the remote communication and conversation between the hearing-impaired people and the hearing-impaired people, not requiring the hearing-impaired people to recognize characters, and realizing online accessible communication with other normal hearing-impaired people only by understanding the basic sign language video;
the hearing-impaired terminal is used for shooting sign language of hearing-impaired people and uploading video data to the cloud server, and receiving any one or more converted sign language videos of voice, characters and video data of normal people processed by the cloud server through a network so as to realize online chat conversation between the hearing-impaired people and the normal people;
the cloud server is used for storing and managing sign language related characters, pictures and video data, converting voice received from a network into characters, and generating sign language videos corresponding to the characters or the received characters;
the hearing-impaired terminal or the cloud server is provided with an action recognition system, a sign language animation generation system, a voice recognition system, a sign language database management system and a sign language database, and the method comprises the following steps:
the sign language database is used for storing characters, pictures and video data of sign languages;
the sign language database management system is used for performing management operations of adding, deleting, modifying and inquiring sign language characters, pictures and video data in a sign language database;
the action recognition system is used for converting sign language videos received by the hearing-impaired terminal or the cloud server into characters and transmitting the characters to the hearing-impaired-free terminal through a network;
the voice recognition system is used for converting voice into characters and transmitting the converted characters to a local sign language animation generation system;
and the sign language animation generation system is used for generating a sign language video corresponding to the sign language animation from the characters and transmitting the sign language video to the hearing-impaired people through a network.
The method for achieving barrier-free communication of the hearing-impaired person and the normal person on line based on the network is executed on the on-line communication system, and the barrier-free terminal and the hearing-impaired terminal conduct on-line face-to-face barrier-free communication through the network module and the cloud server.
Compared with the prior art, the invention has the beneficial effects that: through the use of this system:
1. the system can timely, efficiently and accurately transmit the information to be expressed of the hearing-impaired people and the deaf people, other disabled people and the most main healthy people, and timely input, convert and transmit the information by means of the hearing-impaired terminal and the hearing-impaired terminal network module.
2. For the people with hearing impairment and the people without hearing impairment, the online communication system and the online communication method can be used for communication anytime and anywhere no matter in a local area or in a remote area, and the use is convenient.
3. A large amount of sign language translation does not need to be trained, too many human resources are not needed, and the use cost is low.
4. The barrier-free communication between the hearing-impaired people and other non-hearing-impaired people, especially normal people, is realized through the online communication system method, and the method has important economic significance for popularization and employment and life of the hearing-impaired people.
In summary, the online communication system of the present invention includes an audio-barrier-free terminal, and a cloud server, wherein: the hearing-impaired terminal and the hearing-impaired terminal convert one or more received data of voice, characters and video of the hearing-impaired terminal and the hearing-impaired terminal through the hearing-impaired terminal or the cloud server, the data received by the hearing-impaired terminal is sign language video, the received and converted data are respectively transmitted to hearing-impaired people and people without the hearing-impaired terminal through a network, online chatting conversation between normal people without hearing impairment and hearing-impaired people is achieved, online communication and conversation between the hearing-impaired people and the hearing-impaired people are achieved, and great contribution is provided for the hearing-impaired people to blend into life, study and work of the society.
Drawings
FIG. 1 is a functional block diagram of an embodiment of an on-line communication system for barrier-free communication between a hearing impaired person and a normal person using a 5G network;
FIG. 2 is a data architecture level diagram of an on-line communication system for barrier-free communication between hearing impaired people and normal people based on network implementation;
wherein: 1-no hearing-impaired terminal, 2-hearing-impaired terminal, 3-cloud server, 31-sign language database, 32-sign language database management system, 33-action recognition system, 34-voice recognition system and 35-sign language animation generation system;
100-device layer, 200-network transport layer, 300-data translation layer, 400-data storage layer, 500-data management layer.
Detailed Description
For the purpose of enhancing the understanding of the present invention, the present invention will be further explained with reference to the accompanying drawings and examples, which are only for the purpose of explaining the present invention and do not limit the scope of the present invention.
In the description of the present invention, it is to be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience in describing the present invention and simplifying the description, but do not indicate or imply that the combination or element referred to must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, are not to be construed as limiting the present invention. In addition, in the description process of the embodiment of the present invention, the positional relationships of the devices such as "upper", "lower", "front", "rear", "left", "right", and the like in all the drawings are based on fig. 1.
Example 1
As shown in fig. 1, the barrier-free communication online communication system for the hearing-impaired people and the normal people based on the network includes a barrier-free terminal 1, a barrier-free terminal 2 and a cloud server 3, wherein:
the hearing-impaired terminal is used for uploading one or more data of voice, characters and videos of normal hearing-impaired people to the cloud server through the network, and receiving any one or more data of characters, voice and videos converted from sign language video data of hearing-impaired people processed by the cloud server through the network so as to realize online chatting conversation between the normal hearing-impaired people and the hearing-impaired people, thereby solving the remote communication and conversation between the hearing-impaired people and the hearing-impaired people, not requiring the hearing-impaired people to recognize characters, and realizing online accessible communication with other normal hearing-impaired people only by understanding the basic sign language video;
the hearing-impaired terminal is used for shooting sign language of hearing-impaired people and uploading video data to the cloud server, and receiving any one or more converted sign language videos of voice, characters and video data of normal people processed by the cloud server through a network so as to realize online chat conversation between the hearing-impaired people and the normal people;
the cloud server is used for storing and managing sign language related characters, pictures and video data, converting voice received from a network into characters, and generating sign language videos corresponding to the characters or the received characters;
the hearing-impaired terminal or the cloud server has a motion recognition system 34, a sign language animation generation system 35, a voice recognition system 34, a sign language database management system 32, and a sign language database 31, and further:
the sign language database 31 is used for storing characters, pictures and video data of sign languages;
the sign language database management system 32 is used for performing management operations of adding, deleting, modifying and inquiring sign language characters, pictures and video data in a sign language database;
the action recognition system 33 is configured to convert the sign language video received by the hearing-impaired terminal or the cloud server into characters, and transmit the characters to the hearing-impaired terminal through a network;
the voice recognition system 34 is used for converting the voice into characters and transmitting the converted characters to a local sign language animation generation system;
and the sign language animation generating system 35 is used for generating a sign language video corresponding to the sign language animation from the characters and transmitting the sign language video to the hearing impaired people through a network.
Example 2
What is different from embodiment 1 is that the hearing-impaired terminal of the online communication system may further include:
the sign language camera module is used for acquiring a sign language video of the hearing-impaired person in a camera mode and preparing for the expression of the hearing-impaired person;
the sign language video network module is used for transmitting the recorded sign language video to the cloud server for conversion;
the sign language animation video playing module is used for playing the sign language video received by the network, so that the sign language video is displayed and watched by hearing-impaired people or people who can understand the sign language video;
and the hearing-impaired end chatting module is used for displaying the information to the hearing-impaired people through the chatting interface so that the hearing-impaired people can perform online communication conversation with the hearing-impaired people through the chatting interface.
Example 3
Different from embodiment 2, the hearing-barrier-free terminal of the online communication system includes the following modules:
the normal end data input module is used for inputting the voice, character and video information input by normal people into the no-hearing-failure terminal to form voice, character and video data, and particularly mainly comprises a voice module, a character module and a video module, wherein the voice module is used for recording and playing the audio generated by speaking of the normal people, and the character uploading module is used for inputting the character edited by the people without the no-hearing-failure terminal and transmitting the character edited to the no-hearing-failure terminal and the no-hearing-failure terminal so as to input the meaning transmission and expression of the terminal;
the normal end network module is used for transmitting the voice, character and video data input by the normal end data input module to the cloud server through a network and receiving the voice, character and video data which are uploaded by the hearing-impaired terminal and are converted by the cloud server;
and the normal end display module is used for displaying the voice, text and video data received from the hearing-impaired terminal through the network, and providing the voice, text and video data for normal people and hearing-impaired people to communicate and use so as to enable the normal people and the hearing-impaired people to know, feel and see, thereby achieving the purposes of meaning expression and transmission.
In another embodiment, the normal-end network module and the sign language video network module of the online communication system are both one or a combination of several of a 5G module, a 4G module, a WIFI module and a bluetooth module, and no matter which network module can be implemented, but the online communication and communication which is truly smooth needs the 5G module and the WIFI, and even 6G, 7G and other high-traffic network technologies which are not developed in the later stage are implemented.
The hearing-impaired terminal of the online communication system is also provided with a character input module for directly performing online communication with a normal terminal through a cloud server, and is suitable for hearing-impaired people capable of learning characters.
In a preferred embodiment, the hearing-impaired terminal of the online communication system further comprises a voice input module for temporary and emergency input by people around the hearing-impaired person, so that the hearing-impaired terminal is wide in application range.
In another embodiment, the number of the no-hearing-impairment terminals and the number of the no-hearing-impairment terminals of the online communication system can be respectively one or more, so as to realize one-to-one, one-to-many and many-to-one network online communication, and in a specific implementation process, one or more, one-to-one, one-to-many no-hearing-impairment terminals and one-to-many hearing-impairment terminals can be arranged in a certain local area for use, and the no-hearing-impairment terminals and the hearing-impairment terminal equipment can be used remotely. Specific implementation scenarios are such as: the system is used in hotels, restaurants, shopping malls, tourist attractions and other workplaces, thereby providing more convenient life and outgoing scenes for hearing-impaired people and better integrating the work.
Example 4
Taking a normal end network module and a hearing-impaired end network module as 5G modules for example, when constructing the data of the online communication system, as shown in fig. 2, the data is constructed as follows:
the device layer 100 includes an inaudible terminal and an inaudible terminal.
The system comprises a wireless terminal, a 5G network module, a recording module, a voice uploading module, a text uploading module, a voice broadcasting module, a text presenting module and a chatting module, wherein the wireless terminal is used for uploading voice and text data of normal crowds to a cloud server through a 5G network, receiving the text data through the 5G network, presenting the text data to the normal crowds in a text and voice broadcasting mode, and realizing online chatting conversation with the hearing-impaired crowds;
the hearing-impaired people communication system comprises a hearing-impaired terminal, a cloud server and a communication module, wherein the hearing-impaired terminal is used for shooting sign language of hearing-impaired people and uploading a video to the cloud server, receiving video data through a 5G network and playing and presenting the video data to the hearing-impaired people, and enabling the hearing-impaired people to realize online chat conversation with normal people, and the hearing-impaired terminal comprises a 5G network module, a sign language camera module, a sign language video uploading module, a sign language animation video playing module and a chat module;
the network transmission layer 200 is used for transmitting data sent to the network by the hearing-failure-free terminal and the hearing-failure-free terminal device to a specified cloud server device;
the data conversion layer 300 is configured to convert a voice received from a network into a text, generate a sign language video corresponding to the text from the text, or generate a sign language video corresponding to the received text from the text, transmit the generated sign language video to a terminal of a hearing impaired person through a 5G network, convert a sign language video received from the network into a text, and transmit the text to a terminal of a normal person through the 5G network, and includes an action recognition system, a sign language animation generation system, and a voice recognition system.
The data storage layer 400 is mainly used for storing text, pictures and video data of sign language.
The data management layer 500 is used for managing and displaying the stored characters corresponding to the sign language, conversion logic and conversion relation between the sign language and the characters, pictures, video data and the like.
Example 5
The method for achieving barrier-free communication of the hearing-impaired person and the normal person on line based on the network is executed on the on-line communication system, and the barrier-free terminal and the hearing-impaired terminal conduct on-line face-to-face barrier-free communication through the network module and the cloud server.
The embodiments of the present invention are disclosed as the preferred embodiments, but not limited thereto, and those skilled in the art can easily understand the spirit of the present invention and make various extensions and changes without departing from the spirit of the present invention.
Claims (8)
1. The barrier-free communication online communication system for the hearing-impaired people and the normal people based on the network is characterized in that: including no hearing barrier terminal, hearing barrier terminal and high in the clouds server, wherein:
the hearing-impaired people monitoring system comprises a cloud server, a hearing-impaired terminal and a communication server, wherein the hearing-impaired terminal is used for uploading one or more data of voice, characters and videos of normal people without hearing impairment to the cloud server through a network, and receiving any one or more data of characters, voice and videos converted from sign language video data of hearing-impaired people processed by the cloud server through the network;
the hearing-impaired terminal is used for shooting sign language of hearing-impaired people and uploading video data to the cloud server, and receiving any one or more converted sign language videos of voice, characters and video data of normal people processed by the cloud server through a network;
the cloud server is used for storing and managing sign language related characters, pictures and video data, converting voice received from a network into characters, and generating sign language videos corresponding to the characters or the received characters;
the hearing-impaired terminal or the cloud server is provided with an action recognition system, a sign language animation generation system, a voice recognition system, a sign language database management system and a sign language database, and the method comprises the following steps:
the sign language database is used for storing characters, pictures and video data of sign languages;
the sign language database management system is used for performing management operations of adding, deleting, modifying and inquiring sign language characters, pictures and video data in a sign language database;
the action recognition system is used for converting sign language videos received by the hearing-impaired terminal or the cloud server into characters and transmitting the characters to the hearing-impaired-free terminal through a network;
the voice recognition system is used for converting voice into characters and transmitting the converted characters to a local sign language animation generation system;
and the sign language animation generation system is used for generating a sign language video corresponding to the sign language animation from the characters and transmitting the sign language video to the hearing-impaired people through a network.
2. The on-line communication system according to claim 1, wherein: the hearing-impaired terminal comprises:
the sign language camera module is used for acquiring a sign language video of a hearing-impaired person in a camera mode;
the sign language video network module is used for transmitting the recorded sign language video to the cloud server for conversion;
the sign language animation video playing module is used for playing the sign language video received by the network;
and the hearing-impaired end chatting module is used for displaying the information to hearing-impaired people through a chatting interface.
3. The online communication system of claim 2, wherein: the hearing-failure-free terminal comprises the following modules:
the normal end data input module is used for inputting the voice, character and video information input by normal people into the non-hearing-impaired terminal;
the normal end network module is used for transmitting the voice, character and video data input by the normal end data input module to the cloud server through a network and receiving the voice, character and video data which are uploaded by the hearing-impaired terminal and are converted by the cloud server;
and the normal end display module is used for displaying the voice, the text and the video data received from the hearing-impaired terminal through the network.
4. The on-line communication system according to claim 3, wherein: the normal end network module and the sign language video network module are all one or combination of 5G module, 4G module, WIFI module and Bluetooth module.
5. The online communication system of claim 2, wherein: and the hearing-impaired terminal is also provided with a text input module for directly carrying out online communication with the normal terminal through the cloud server.
6. The on-line communication system according to claim 5, wherein: the hearing-impaired terminal is also provided with a voice input module for inputting and using by people around the hearing-impaired person in temporary and emergency situations.
7. The on-line communication system according to claim 5, wherein: the number of the non-hearing-failure terminals and the number of the hearing-failure terminals can be one or more.
8. The barrier-free communication online communication method for the hearing-impaired people and the normal people based on the network is characterized by comprising the following steps: the on-line communication system of any one of claims 1 to 7, wherein the barrier-free terminal and the barrier-free terminal perform on-line face-to-face barrier-free communication with the cloud server through the network module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110694216.2A CN113438300A (en) | 2021-06-22 | 2021-06-22 | Network-based accessible communication online communication system and method for hearing-impaired people and normal people |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110694216.2A CN113438300A (en) | 2021-06-22 | 2021-06-22 | Network-based accessible communication online communication system and method for hearing-impaired people and normal people |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113438300A true CN113438300A (en) | 2021-09-24 |
Family
ID=77757190
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110694216.2A Pending CN113438300A (en) | 2021-06-22 | 2021-06-22 | Network-based accessible communication online communication system and method for hearing-impaired people and normal people |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113438300A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114333513A (en) * | 2021-12-27 | 2022-04-12 | 深圳市研强物联技术有限公司 | Voice hearing aid AR glasses for deaf-mutes and communication method thereof |
| CN115239855A (en) * | 2022-06-23 | 2022-10-25 | 安徽福斯特信息技术有限公司 | Virtual sign language anchor generation method, device and system based on mobile terminal |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102708866A (en) * | 2012-06-01 | 2012-10-03 | 武汉大学 | Semantic-computing-based interaction system and method for person with hearing or language disorder |
| CN108091335A (en) * | 2017-12-06 | 2018-05-29 | 安徽省科普产品工程研究中心有限责任公司 | A kind of real-time voice translation system based on speech recognition |
| CN108960126A (en) * | 2018-06-29 | 2018-12-07 | 北京百度网讯科技有限公司 | Method, apparatus, equipment and the system of sign language interpreter |
-
2021
- 2021-06-22 CN CN202110694216.2A patent/CN113438300A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102708866A (en) * | 2012-06-01 | 2012-10-03 | 武汉大学 | Semantic-computing-based interaction system and method for person with hearing or language disorder |
| CN108091335A (en) * | 2017-12-06 | 2018-05-29 | 安徽省科普产品工程研究中心有限责任公司 | A kind of real-time voice translation system based on speech recognition |
| CN108960126A (en) * | 2018-06-29 | 2018-12-07 | 北京百度网讯科技有限公司 | Method, apparatus, equipment and the system of sign language interpreter |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114333513A (en) * | 2021-12-27 | 2022-04-12 | 深圳市研强物联技术有限公司 | Voice hearing aid AR glasses for deaf-mutes and communication method thereof |
| CN115239855A (en) * | 2022-06-23 | 2022-10-25 | 安徽福斯特信息技术有限公司 | Virtual sign language anchor generation method, device and system based on mobile terminal |
| CN115239855B (en) * | 2022-06-23 | 2023-05-30 | 安徽福斯特信息技术有限公司 | Virtual sign language anchor generation method, device and system based on mobile terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9111545B2 (en) | Hand-held communication aid for individuals with auditory, speech and visual impairments | |
| CN108427910B (en) | Deep neural network AR sign language translation learning method, client and server | |
| US9843678B2 (en) | Visual assistance systems and related methods | |
| CN113438300A (en) | Network-based accessible communication online communication system and method for hearing-impaired people and normal people | |
| US20090012788A1 (en) | Sign language translation system | |
| CN105824807A (en) | Translation terminal and translation method | |
| CN104115182A (en) | Foreign language acquisition and learning service providing method based on context-aware using smart device | |
| CN101605158A (en) | Mobile phone dedicated for deaf-mutes | |
| WO2007124109A2 (en) | Interactive conversational speech communicator method and system | |
| Ramirez-Garibay et al. | MyVox—Device for the communication between people: blind, deaf, deaf-blind and unimpaired | |
| KR102212298B1 (en) | Platform system for providing video communication between non disabled and hearing impaired based on artificial intelligence | |
| CN105007557A (en) | Intelligent hearing aid with voice identification and subtitle display functions | |
| CN108510988A (en) | A kind of speech recognition system and method for deaf-mute | |
| CN110717344A (en) | Auxiliary communication system based on intelligent wearable equipment | |
| CN110457717B (en) | Remote translation system and method | |
| CN106377401A (en) | Blind guiding front-end equipment, blind guiding rear-end equipment and blind guiding system | |
| US11398224B2 (en) | Communication system and method for providing advice to improve a speaking style | |
| Goggin | Disability, mobiles, and social policy: New modes of communication and governance | |
| CN111611812B (en) | Translation to Braille | |
| CN109977427A (en) | A kind of miniature wearable real time translator | |
| KR20200049404A (en) | System and Method for Providing Simultaneous Interpretation Service for Disabled Person | |
| KR102408941B1 (en) | Two-way conversation system that provides sign language interpretation | |
| CN213634995U (en) | Bidirectional sign language translator based on augmented reality and artificial intelligence | |
| CN211742645U (en) | Interaction device based on 5G communication technology | |
| CN210072245U (en) | Translation glasses |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210924 |
|
| RJ01 | Rejection of invention patent application after publication |