TR201812392A2 - REMOTE COMMUNICATION SYSTEM AND METHOD FOR THE Hearing Impaired - Google Patents

Abstract

SUMMARY OF THE INVENTION It is related to the remote communication system and method for hearing impaired individuals, which enables the hearing impaired individuals to communicate remotely with the people who do not speak sign language in their social lives. a server pool (5) consisting of servers between the hearing impaired individual (E1) and the person who does not speak the sign language (E2); , the hand gesture image of the hearing impaired person (E1) in front of the webcam PC (K1) or smart mobile phone (K2) camera is transmitted to the server pool (5), the images transmitted to the server pool (5) are converted to text and text to audio, transmitting the files to the non-sign language individual (E2) by the server pool (5); ), converting the sound of the individual who does not speak sign language (E2) to text and from text to avatar or video, and hearing the resulting avatar or video images. e is the transmission of images to the disabled individual (E1).

Description

DESCRIPTION REMOTE COMMUNICATION SYSTEM AND METHOD FOR THE HEAT DISABLED Technological Field: This invention; social life of hearing-impaired individuals with those who do not know sign language. remote communication system for the hearing impaired that enables them to communicate remotely and its method.

State of the Art: Today, sign language is a communication tool that is frequently used by hearing-impaired individuals. it has taken shape. Hearing impaired individuals in daily life in banks, hospitals, municipalities etc. While receiving services in institutions, without a sign language translator or in these institutions cannot communicate without sign language staff. For this reason, heating various software and software that enable people with disabilities to communicate with others. applications have been developed.

The main logic operator is the use of existing applications in existing systems. Disabled The individual connects to an operator via video, the operator understands the disabled individual and speaks aloud. transfers to the person to be contacted, In this case, the communication depends on the operator. people with disabilities can talk to other people without an intermediary. cannot be opened. Disabled individuals try to communicate because of these reasons. in case of loss of time and want to call the hospital and the police, various communication they are subject to disconnection. This can cause serious problems.

In applications that are used today and developed for hearing-impaired individuals, the individual Various apparatus are used, such as gloves designed to detect movements.

This makes people dependent on such devices. Therefore, both costs increases and prevents the application from being used in all situations.

In the patent application with publication number GB2422449 “PCs and Embedded Platforms (Mobile Text to Sign Language Translation Software” for telephones and ATMs etc.) is described.

Invention, X86 PC and embedded devices (mobile phones, ATM machines, etc.) Describes a program for converting written text to sign language.

A System That Translates Its Language into Sign Language” has been described. Sign language of spoken language meeting with the aim of automating the translation and enabling communication without an interpreter. It contains a system that communicates with its database.

Sign language translation applications are discussed in the patent applications mentioned above.

Inventions that are generally included in a certain system in the mentioned applications has been explained. Such systems allow users to use these applications under normal conditions. does not allow them to be used.

As a result, sign language can overcome the above-mentioned disadvantages. communication between people who do not know and those who are hearing impaired from a distance (by phone) the sign language image as sound and the sound as image. communication, facilitating the life of hearing-impaired individuals in daily life, There is a need for a new technology that is practical and low in cost.

Description of the Invention: This invention is for the hearing impaired who can overcome the above mentioned disadvantages. It is a remote communication system and method, and its feature is; individuals who do not know sign language It enables hearing-impaired individuals to communicate from a distance (by phone), In daily life, which can transmit sign language image as sound and sound as image, It is a new, practical and cost-effective new device that facilitates the life of hearing-impaired individuals. becomes a technology.

All the purposes mentioned above and which will emerge from the detailed description below. invention to realize; The environment of hearing impaired individuals is one-to-one or synchronous. providing communication opportunities and facilitating communication between individuals who do not know sign language. As it is known, sign language learning requires a certain education. Disabled individual and facilitates communication between individuals who do not know sign language. And also The voice and text information transmitted to the other party helps the communication become more rapid. it provides. Individuals who do not know sign language with the design that is the subject of the invention Establishing remote (by phone) communication between hearing impaired individuals and is provided. In the product subject of the invention, the image of the sign language has various transformations and special It is transmitted as a sound to an individual who does not know sign language with techniques. not knowing sign language The voice of the individual is transformed into an image for the hearing impaired individual with various transformations and special techniques. is transmitted. The product subject of the invention affects the life of hearing impaired individuals in daily life. makes it easier. The product subject of the invention is practical to use with its structure and design. is happening. The subject of the invention is advantageous in terms of cost with its design. available.

Thanks to the easy fixing of the parts that make up the invention, it is easy It is installed and costs are low thanks to the short assembly time.

Moreover, the invention has a solid structure.

Explanation of Figures: The invention will be described with reference to the accompanying figures so that the features of the invention will be more clearly understood and appreciated, but the purpose of this It's not about limiting yourself with regulations. On the contrary, the invention is satisfied by the appended claims. all alternatives, changes and It is intended to cover the equivalences. Details shown are available only. shown for illustration of preferred embodiments and both methods formulation, as well as the rules and conceptual features of the invention. and it should be understood that they are presented to provide an easy-to-understand definition. This in drawings; Figure 1 is the schematic view of the operation of the system.

Figure 2 is the schematic view of the operation of the system.

Figures to assist in understanding this invention are as indicated in the attached picture. are numbered and given below with their names.

Explanation of References: l. NLP server 2. DB server 3. Web server 4. Voip server . server pool That. PC with webcam K2. smart cell phone Q 1. Fixed phone SZ. voip phone Q3. GSM Hand. Hearing impaired individual Description of the Invention: The invention will be between a hearing impaired individual (El) and an individual who does not know sign language (E2). Thus, a server pool (5) consisting of servers, the hearing impaired individual (El) to call the desired number, that the caller is a hearing impaired individual (El). signal indicating that the hearing impaired individual (El), PC with webcam (K1) or The presenter of the hand gestures made in front of the smart mobile phone (K2) camera repository (5) means that images transmitted to the server repository (5) are text-to-text and text-to-text converting the audio files to the server pool (5) and sign language to an individual who does not know (E2), an individual who does not know sign language (E2), a fixed telephone (Sl) or As audio file of the speech detected by voip phone (S2) or GSM (83) server pool (5), the voice of the individual who does not know sign language (E2) is transmitted to and from the text. conversion to avatar or video and the resulting avatar or video footage It is transmitted to the hearing impaired individual (El) as an image (Figure-1, Figure-2).

The inventive system can be used by a hearing impaired individual (Hand), a PC with a webcam (K1) or a smart mobile phone. The image containing the hand-arm movements obtained on the phone (K2) is converted to sound. to the web server and/or NLP server (1) and/or DB server that enables the conversion (2) has. Fixed telephone (Sl) or voip telephone (SZ) in the subject system of the invention or a three-dimensional avatar of an individual (E2) who does not know sign language over GSM (S3) or web server and/or NLP server (1) and/or DB that enables the conversion to video server (2) exists. The system that is the subject of the invention uses the sign language in accordance with the grammatical structure. It consists of a server pool (5) containing an algorithm that organizes subject of the invention The system contains a database where each word is associated with a sign language animation. has a server pool (5) (Figure-1, Figure-2).

Visual equivalents of the words in the sign language dictionaries in the system that is the subject of the invention There is a DB server (2) where avatar and video images are saved. Meet web server that provides data flow from NLP server (1) and DB server (2) in the system in question. server (3) is used. The subject of the invention is the system image to sound or sound to image. voip server (4) and/or ip A server provided by the switchboard and/or analog switchboard and/or GSM operator It has a pool (5). The server pool (5) in the system that is the subject of the invention; NLP server (1) and/or DB server (2) and/or web server (3) and/or voip consists of servers (4). The server pool (5) in the system that is the subject of the invention is the most contains at least one server (Figure-1, Figure-2).

Detailed Description of the Invention: The invention is basically; NLP server (1), web server (3), DB server (2), voip server (4) and the server pool (5) (Figure-1, Figure-2).

There is a server pool (5) in the system that is the subject of the invention. Server pool; NLP server, It includes web server (3), DB server (2) and voip server (4). subject of the invention There is NLP server (1) in the system. NLP server (1), audio to text conversion and by making morphological analysis of these texts, the words in the sentence and those The machine determines which root the words are in that sentence and the word types. learning is realized with the code. DB server (2) in the subject system of the invention are available. DB server (2) visualization of words in sign language dictionaries database server where corresponding avatar and video images are saved is happening. There is a web server (3) in the system that is the subject of the invention. Web server (3); converting the voice to text, transforming the text into a three-dimensional avatar, NLP server (1) and DB for text-to-text and text-to-speech conversion provides the data flow with the server (2). Voip server (4) in the subject system of the invention are available. Voip server (4) provides the transmission of voice over the internet. The operation of the inventive system is as follows; Deaf person (El) wants to call calls the number. Stating to the other party that the caller is a hearing impaired individual (El) signal is sent. Hearing impaired individual (Hand), PC with webcam (K1) or smart the image of the movements made in front of the mobile phone (K2) is in the server pool (5) It is transmitted to the NLP server (1) and DB server (2) with the web server (3) located in the web server. Meet In the product in question, it is also possible for a hearing impaired individual (El), a PC with a web camera (K1) or The image of the movements made in front of the smart mobile phone (K2) is sent to the server for processing. is sent to the pool (5). Messages images are converted to audio. Obtained audio files are transmitted to the other party via voip server (4). sign language of the opposite party the person (E2) who does not know, with a fixed phone (Sl) or voip phone (SZ) or GSM (83). via the web server (3) in the server pool (5) as a speech sound file. It is transmitted to NLP server (1) and DB server (2). An individual who does not know sign language The (E2) voice is converted to an avatar or video, and the image is displayed to the hearing impaired individual (El). is transmitted as

Claims (1)

REQUESTS 1- The invention is related to the remote communication system and method for the hearing impaired, and its feature is; A server pool (5) consisting of servers (5), between the hearing impaired individual (El) and the individual who does not know sign language (E2), the hearing impaired individual (El) calling the number they want to call, sending a signal to the other party indicating that the caller is a hearing impaired individual (El) , transmitting the hand movements image of a hearing impaired individual (Hand) in front of a PC with a webcam (Kl) or a smart mobile phone (K2) camera to the server pool (5), converting the images transmitted to the server pool (5) into text and from text to audio, the resulting sound transmitting the files of the server pool (5) to the person who does not know sign language (E2), the speech of the individual who does not know sign language (E2), which is detected by fixed phone (SL) or voip phone (82) or GSM (83), is sent to the server pool (5 ) is characterized by the conversion of the voice of the individual who does not know sign language (E2) to text and from text to avatar or Video, and transmitting the obtained avatar images to the hearing impaired individual (El) as images. inherited. 2- It is the remote communication system and method for the hearing impaired as mentioned in Claim 1, and its feature is; Web server and/or NLP server (1) and/or DB server (2), which enables the image containing hand-arm movements obtained from a hearing impaired individual (El), a PC with a webcam (K1) or a smart mobile phone (K2) to be converted into sound. characterized by its possession. 3- It is the remote communication system and method for the hearing impaired as mentioned in Claim 1, and its feature is; It has a web server and/or NLP server (1) and/or DB server (2) that enables the individual (E2) who does not know sign language to be transformed into a three-dimensional avatar or video via fixed phone (Sl) or voip phone (S2) or GSM (S3) being characterized by. 4- It is the remote communication system and method for the hearing impaired as mentioned in Claim 1, and its feature is; It is characterized by having a server pool (5) containing algorithms that organize the sign language in accordance with the grammatical structure. 5- It is the remote communication system and method for the hearing impaired as mentioned in Claim 1, and its feature is; It is characterized by having a server pool (5) containing a database where each word is associated with sign language animation or video. 6- It is the remote communication system and method for the hearing impaired as mentioned in Claim 1, and its feature is; It is characterized by the fact that it has a DB server (2) where the avatar and video images, which are the visual equivalents of the words in sign language dictionaries, are saved. 8- It is the remote communication system and method for the hearing impaired as mentioned in claim 1, and its feature is; It is characterized by the use of web server (3), which provides data flow from NLP server (1) and DB server (2). 9- It is the server pool (5) mentioned in claim 17, and its feature is; It is characterized by the fact that it has a server pool (5), which is provided by the voip server (4) and/or the ip switchboard and/or the analog switchboard and/or the GSM operator, which enables the image to be transmitted to voice or the voice to the other party after it is converted into an image. 10- It is the server pool (5) mentioned in Claim 1, and its feature is; It is characterized by NLP server (1) and/or DB server (2) and/or web server (3) and/or voip servers (4). ll- It is the server pool (5) mentioned in Claim 1, and its feature is; characterized by at least one server.