TWM495597U - Mouth/hand language identifying system - Google Patents

Abstract

The present invention is related to a mouth/hand language identifying system having a body having a monitor, a keyboard, a handwriting board, a microphone, a speaker, and a data input processing module. The data input processing module receives the voice signal coming from the microphone and then outputs one electronically letter information. The data input processing module receives the letter image signal coming from the handwriting board and then outputs the electronically letter information. The data input processing module receives the letter input signal coming from the keyboard and then output the electronically letter information. The electronically letter information input to a sign language signal processing module, a lip reading signal processing module and a voice signal processing module and then output a sigh language video to the monitor, a lip reading video to the monitor, a voice video to the speaker and a letter image to the monitor.

Description

Lip language and sign language auxiliary identification system

An identification system is a lip language and sign language auxiliary recognition system.

Talking communication is the ability of ordinary people to take it for granted. However, for deaf and dumb people, it is necessary to spend more effort and effort than the average person to communicate smoothly with others. At present, the most convenient way for deaf-mute people to communicate is through lip language or sign language. However, due to the difficulty of learning, sign language or lip language cannot be quickly popularized. In addition, the general public has the opportunity to contact deaf people in daily life. Otherwise, there is little need to learn sign language or lip language, and thus it is more difficult to promote sign language or lip language in the general public. Therefore, there is a need for a device that can effectively provide communication between deaf and dumb people.

The general public does not have the need to learn sign language or lip language unless they have the opportunity to contact deaf people in their daily lives. Therefore, it is more difficult to promote sign language or lip language in the general public. Therefore, it is necessary to provide a deaf person. The device for communicating with others, the present invention provides a lip language and sign language auxiliary identification system, comprising a body, the body comprising a screen, a keyboard, a tablet, a microphone, a speaker and a processing module, the screen, The keyboard, the tablet, the microphone and the speaker are respectively electrically connected to the processing module. The processing module comprises an input processing module, a sign language processing module, a lip processing module and a voice processing module. The input processing module is connected to a first database, wherein: the first database includes voice/text conversion data, a tablet recognition data, and an input method data; the input data processing module receives The voice information input by the microphone is compared with the voice/text conversion data in the first database, and then input. a text electronic information; or the input data processing module receives the text graphic information input by the tablet, and compares the text graphic information with the graphic/text conversion data in the first database, and outputs the text electronic Information; or the input data processing module receives the text input method information input by the keyboard, and compares the text input method information with the input method conversion data in the first database, and outputs the text electronic information; The input data processing module inputs the text electronic signal to the sign language processing module, the lip language processing module and the voice processing module; the sign language processing module, the lip language processing module and the voice processing module Each of the two databases is linked to a second database comprising a sign language video material, a lip language video material and a text/speech data; the sign language processing module compares the text electronic signal with the sign language video data. After the operation, output a sign language movie to the screen; or the lip processing module inputs the text electronic signal and the lip language video data into the screen After the comparison operation, outputting a lip language movie to the screen; or the voice processing module compares the text electronic signal with the text/speech conversion data, and outputs a speaker of the conversation voice; or the text signal A text screen is displayed directly on the screen. Further, the first database and the second database are a cloud database.

From the above description, the present invention has the following advantages:

1. Provide a variety of input methods, and convert the input information into sign language or lip language screen, so that users who do not dilute lip language or sign language can communicate smoothly with deaf people.

2. Deaf-mute people can input sentences by keyboard input or handwriting, and communicate with people who do not have dark sign language or lip language through a speaker or text screen.

Referring to FIG. 1 , the present invention provides a lip language and sign language auxiliary identification system, which includes a body 10 , which can be a notebook computer, a personal computer or a smart phone. The body 10 includes a screen 11 and a keyboard. 12, a tablet 13, a microphone 14, a speaker 15 and a processing module 16, the screen 11, the keyboard 12, the tablet, the microphone 14 and the speaker 15 are electrically connected to the processing module 16, respectively The user can input text through the keyboard 12, input text through the tablet 12, or speak a sentence through the microphone 14. The processing module 16 can convert the input text into a lip language screen and a hand. The speech screen is output to the speaker 15 or a voice, and the sentence input by the voice is converted into text to be displayed on the screen 11.

Referring to FIG. 2, the processing module 16 includes an input processing module and a translation processing module. The translation processing module includes: a sign language processing module, a lip processing module, and a voice processing module. The input processing module is connected to a first database, and the first database includes voice/text conversion data, a tablet identification data and an input method data, wherein the input data processing module receives an external input signal. The operation processing outputs a text electronic signal, wherein the external input signal receives the voice information input by the microphone 14 for the input data processing module, and compares the voice information with the voice/text conversion data in the first database. And outputting the text electronic information after the operation; or the external input signal is the input data processing module receiving the text graphic information input by the tablet 13, and the text graphic information and the graphic/text in the first database Converting the data to the textual electronic information output after the comparison operation; or, the external input signal is received by the input data processing module The text input method information input by the keyboard 12, the translated electronic signal is the text electronic information outputted by comparing the text input method information with the input method conversion data in the first database.

The input data processing module inputs the text electronic signal to the translation processing module, and the translation processing module processes the text electronic signal to output a translation information, the sign language processing module, the lip language processing module, and The voice processing module is coupled to a second database, the second database includes a sign language video material, a lip language video material, and a text/speech conversion data, wherein the translation information is the sign language processing module. After the electronic signal is compared with the sign language video data, the output of the sign language film is displayed on the screen 11; or the translation information is the lip language processing module, the text electronic signal and the lip language film After the data is compared, a lip language film is outputted, and the lip language film is displayed on the screen 11; or the translation information is used by the voice processing module to compare the text electronic signal with the text/voice conversion data. After the operation, a dialogue voice is output, and the conversation voice is output to the speaker 15; or the text electronic signal can also be displayed directly on the screen 11. Text screen.

Further, the first database and the second database may be a cloud database, so that the first database and the second database may have greater flexibility of use.

The user who does not have a dark lip or a sign language can select a sentence to be spoken by means of a mouth recording, a tablet input or a keyboard typing, and output the sign language, the lip language dialogue voice or the text screen via the processing module 16 respectively. Users who do not have sign language or lip language can also communicate with deaf and dumb people through this new type; deaf and dumb people can input sentences by keyboard input or handwriting, through speakers or text screens and people who do not have dark sign language or lip language Communicate.

From the above description, the present invention has the following advantages:

1. Provide a variety of input methods, and convert the input information into sign language or lip language screen, so that users who do not dilute lip language or sign language can communicate smoothly with deaf people.

2. Deaf-mute people can input sentences by keyboard input or handwriting, and communicate with people who do not have dark sign language or lip language through a speaker or text screen.

10‧‧‧ Ontology
11‧‧‧ screen
12‧‧‧ keyboard
13‧‧‧written tablet
14‧‧‧ microphone
15‧‧‧ Horn
16‧‧‧Processing module

Figure 1 is a perspective view of a preferred embodiment of the present invention. 2 is a block diagram showing the function of the system in accordance with a preferred embodiment of the present invention.

10‧‧‧ Ontology

11‧‧‧ screen

12‧‧‧ keyboard

13‧‧‧written tablet

14‧‧‧ microphone

15‧‧‧ Horn

16‧‧‧Processing module

Claims (9)

A lip language and sign language auxiliary recognition system, comprising a body, the body comprises a screen, a keyboard, a tablet, a microphone, a speaker and a processing module, the screen, the keyboard, the tablet, the microphone The processing module is electrically connected to the processing module. The processing module includes an input processing module and a translation processing module. The input processing module is connected to a first database and a second database. After receiving the external input signal, the input data processing module outputs a text electronic signal through the operation processing, and the translation processing module processes the text electronic signal to output a translation information, and the translation information is displayed on the screen or output to the speaker. According to the lip language and sign language auxiliary identification system of claim 1, the external input signal is the input data processing module receiving the voice information input by the microphone. According to the lip language and sign language auxiliary identification system of claim 1, the external input signal is that the input data processing module receives the text graphic information input by the tablet. According to the lip language and sign language auxiliary identification system of claim 1, the external input signal is the input data processing module receiving the text input method information input by the keyboard. According to the lip language and sign language auxiliary identification system of claim 2, 3 or 4, the translation processing module is a sign language processing module, and the translation information is the sign language processing module and the sign language video and the sign language film. After the data is compared, the output of the sign language film is displayed on the screen. According to the lip language and sign language auxiliary identification system of claim 2, 3 or 4, the translation processing module is a lip processing module, and the translation information is the lip language processing module and the text electronic signal After the lip language video data is compared, a lip language film is outputted, and the lip language film is displayed on the screen. According to the lip language and sign language auxiliary identification system of claim 2, 3 or 4, the translation processing module is a voice processing module, and the translation information is the voice processing module and the text electronic signal and the text/ After the speech conversion data is compared, a dialogue voice is output, and the conversation voice is output to the speaker. According to the lip language and sign language auxiliary identification system of claim 2, 3 or 4, the text electronic signal displays a text screen on the screen. For example, in the lip language and sign language auxiliary identification system of claim 1, the first database and the second database are a cloud database.