KR20010107877A - Voice Recognized 3D Animation Sign Language Display System - Google Patents

Abstract

A system that expresses the contents of a speaker in sign language on a display device through a specific device for the communication of the hearing impaired. The basic concept is to make a word (sound) into a text and use the 3D animation as the basis for the movement of the character. It is a system expressed in (Sign Language). It will serve as an aid to hearing and speech impaired people in normal conversation with the public.

Description

Voice Recognized 3D Animation Sign Language Display System

(1) Technology Development

At present, several related companies have developed related technologies. Caption, as well as the text Avatar (Avatar) has appeared a technique to show the action. However, the technology of converting speech into text is inferior in terms of speech recognition rate and function. Other 3D, LCD moving picture realization and surrounding technology can be applied by simple application or simple application.

(2) Market Status

Currently, Closed Caption Broadcasting (MBC) is being conducted by the Broadcasting Station (MBC) for the deaf and speech impaired in Korea, and foreign countries are implementing different types and forms of systems, such as NTSC systems in North America and PAL systems in Europe. is. In Korea, Caption devices are widely used, but currently 33% of the hearing impaired people have no receivers, and the demand for interpretation of sign language is increasing because subtitles pass too fast or sentences are difficult. In addition, in the hospitals and public institutions, devices with this technology can be distributed for the hearing and speech impaired, and when applied to mobile phones, the market will be large and it can be applied to PDAs that are being deployed in earnest these days. The PDA can be a communication tool for the hearing and speech impaired with the general public if only technology is applied and utilized and developed well. From this point of view, the market size can be expanded at home and abroad.

Development of technology for text to speech will be the key. This is because the technology of Dictation is developed by domestic companies, but the recognition rate is low, and the training of the speaker is required, and at the same time, the recognition rate is relatively high only for the specific person. You need a voice recognition system that integrates intonation, dialect, and many other cases.

1 is a specific content of an engine according to the present invention.

2 is a target according to the applicable output method of the present invention.

3 is a system flowchart of PCs equipped with an engine according to the present invention.

4 is an example of applying the system according to the present invention to a broadcasting station.

5 is an example of applying the system according to the present invention to a mobile phone.

6 is an example of applying the system according to the present invention to a general telephone and an interphone.

7 is an example of applying the system according to the present invention to a vehicle GIS.

(1) Basic configuration

The present invention is an engine system that converts an input voice signal into a caption, codes the caption, and displays it in 3D animation by interworking with each sign language operation D / B. This system is composed of voice recognition unit, text recognition unit, and sign language display unit as shown in the diagram. The voice recognition unit is a part corresponding to Engine I of FIG. 1 and is a step of capturing the input voice signal by processing the dictation. The character recognition unit and sign language display unit corresponds to Engine II of FIG. 1, and the caption is coded to link the 3D character's arm, hand movement, and facial expression D / B. In this way, the sign language will appear in 3D Animation.

(2) Detailed Description

1) Figure 2 shows an example of the system application and output target according to the present invention.

① Basically, this system is equipped with engine on PC and shows voice signal input by microphone in sign language.

② PDA can be applied as it is.

-It is possible to apply the same concept as in PC by interworking with wireless LAN.

-It can be used as a mobile phone concept when interworking with wireless internet.

③ In the case of a mobile phone, it can be implemented as one of the mobile phone supplementary services by configuring a system in conjunction with a mobile telephone exchange. This engine is mounted on the exchanger to convert the sender's voice signal and display it on the receiver's LCD monitor in sign language.

④ First of all, the application to TV can be applied to internet broadcasting stations most easily. It is the easiest to implement with VOD. In other words, if you click the produced VOD file, the video screen and sign language screen will be executed at the same time. In the case of TV and CATV, caption caption and sign language screen are sent along with the video screen. Later, you can add caption and sign language translation function to the TV itself, or you can make and attach a single unit of equivalent function.

⑤ The same concept system can be applied to home video telephones, receivers for vehicle GIS, and displays capable of specially designed displays. In other words, in the case of a home video telephone, it can be applied to the telephone itself, in the case of a vehicle, such as a cellular phone and a PDA, and other dedicated terminals can be applied as a single product.

2) Figure 3 is a system flow diagram of the PC-type equipped with the engine according to the present invention. It is an illustration showing the outline of running the engine according to the present invention on a Notebook PC, Desktop PC, PDA body.

3) Figure 4 is an example of applying the system according to the present invention to a broadcasting station.

4) Figure 5 is an example of applying the system according to the present invention to a cellular phone and IMT-2000.

5) Figure 6 is an example of applying the system according to the present invention to a general telephone and intercom. In the case of a regular phone, the flow is similar to that of a mobile phone, except that it uses a wire, not a wireless one. In the case of an interphone, the engine is attached to the interphone as in a single unit.

6) Figure 7 is an example of applying the system according to the present invention to the vehicle GIS. The line will use the Internet (even in the case of satellites), and if you use a mobile phone and a GIS receiver to request geographic or other information from a company that performs GIS services, that company will reinstate the information over the Internet. System.

This is a technology that displays the contents of the speaker in 3D Animation using sign language when watching TV and Internet broadcasts of the hearing impaired, at public offices, hospitals, companies, or through mobile phones and other devices. It is a system that converts text and expresses it based on the text (3D). This system includes 3D character's text interlocking motion technology that assumes voice recognition and caption technology. Based on this, it is required to develop and manufacture a single device similar to a caption subtitle. It will serve as a communication aid between hearing and speech impaired people and the general public.

One of the important indicators of developed countries is the welfare of the disabled. There are many tasks to be pursued, such as improving the perspective and treatment of the disabled, but in practice, prioritizing proper legal and institutional arrangements for people with disabilities is the technology to solve or reduce their discomfort and enjoy an equal cultural life. In addition, this is one of the technologies that can advance the welfare state as a common human-oriented technology in the world, and also play a role in establishing the status as an IT country, and because it is based on text, it can be used in other countries as well. It is easy to form. The system also uses characters that can give intimacy, so it can replace humans.

(1) Application

① Access to mass media of all deaf and hearing-impaired people who need sign language

② Mobile Phone and IMT-2000 Field

③ Public service device for the welfare of the disabled in public institutions and government offices

④ Emergency rescue and disaster reporting organization

⑤ Communication apparatus for hearing and speech impaired people

(2) expected effect

① Contribute to improving the quality of life of the people

② Entry into developed countries by improving national welfare

③ Nationalization of technology-driven technology by establishing a leading IT country

④ Pioneering import substitution and export market

Claims (8)

In the engine system that converts the input voice signal into a caption and codes the caption and displays it in 3D animation by interlocking with each sign language operation D / B. -First step of captioning by processing Dictation of input voice signal -The second step in which the sign language is displayed in 3D animation while the caption is displayed A third step in the field and method of applying the engine system; -Fourth step of the idea and method of manufacturing and applying the applied system to a single device In paragraph 1 -The first step above Capturing the Dictation Text -Step of composing D / B by coding the caption -Integrated management method including In paragraph 1 -The second step above -2nd stage that constitutes 3D character's arm, hand gesture and facial expression D / B Step 2 of interlocking the D / B with each other -Caption is displayed 2. 2. Step 2. 4 in which the movement of the character is represented by 3D animation according to the linkage Integrated operating method, including In paragraph 3 -In step 2.3 above -Idea and method to display caption In paragraph 3 -In step 2.4 above -Ideas and methods of using 3D characters in sign language -Ideas and methods to represent sign language with 3D animation of characters In paragraph 1 -The third step above -How to mount the engine system on the Desk Top and Notebook PC -How to install engine system on PDA -How to use the engine system for mobile phones and IMT-2000 -Plan to use engine system for landline and intercom -How to link engine system with vehicle GIS -How to use engine system for internet broadcasting station and general TV and CATV system -Ideas and methods involving them In paragraph 6 -How to interoperate with the mobile communication company's switch and the system for use in mobile phones and IMT-2000 -Plan to use as one of additional service items of mobile communication company -Plan to include sign language marking service in vehicle GIS system -Ideas and methods involving them In paragraph 1 -The fourth step above -Ideas and methods to make separate dedicated devices and use them as communication aids for the hearing impaired -Integrated management method including