KR101151865B1 - Portable communication device for auditory disabled - Google Patents

Abstract

PURPOSE: A portable conversation device for the hearing disabled person is provided to implement accurate conversation of the hearing disabled person. CONSTITUTION: A widget function module registers a frequently used sentence to a widget. A recent list search module searches for frequently used sentences. A sentence which a communication module desires is directly generated through word search. A conversation help module outputs the sentence which is generated by combination as voice. A blackboard function module performs a direct handwriting function.

Description

Portable Communication Device for Auditory Disabled

The present invention relates to a communication terminal (Augmentatice-Alternatice Communication (AAC)), which is a portable communication device for the disabled, and in particular, a main screen unit, a touch screen unit, a power and function switch unit for selecting the main functions of the portable communication device, In the portable communication device having a speaker unit for outputting the voice to the outside, a communication unit unit, a memory unit storing the function of each module, and an application processor for performing a specified procedure, in the case of sentences that are frequently used as a widget A widget function module that registers to be found immediately when desired; A recent list search module to check recently used sentences; A communication board module which allows a user to directly create a desired sentence through a word search and quickly finds a desired sentence through a related word search or an initial search without having to enter all the necessary sentences for a conversation; A dialog helper module for linking a plurality of sentence lists frequently used in a work life in a list of category icons for each topic to output a sentence generated by a search or a combination by voice; A blackboard function module capable of handwriting; A speaker function module capable of directly inputting a sentence and outputting the voice; And an add-on module including a broadcast view, a multimedia, a schedule manager, a text viewer, a world time, and a calculator function. It is about.

As is well known, good communication is an essential requirement for human beings to live social life. However, in the case of hearing impaired people with speech disorders, they may not be able to communicate properly with the other party due to physical disorders such as vocal cords or facial muscles. Accordingly, in order to enable people with disabilities to be truly integrated into schools or communities, communication aids that effectively express their thoughts, feelings, and needs are urgently needed, but conventionally, people with disabilities are able to sign language or take notes through writing instruments. It was mostly to convey their opinions to the other party.

Korean sentence input method mainly used in the prior art has the following difficult aspects for the hearing impaired. First, in the case of the keyboard input method, there is a technical aspect that is difficult to implement in a portable device due to a problem of space arrangement. In addition, there is a great difficulty in utilizing the hearing impaired people who do not have enough ability to operate the device.

Second, in the handwriting input method, it takes a long time to recognize the inputted content due to a technical problem, and it is difficult for the hearing impaired to write the letters correctly.

There is a problem in communicating with the visually impaired because it does not read the sentences entered in handwritten form.

Third, in the case of the speech recognition method, the speaker isolation model is mainly used, the recognition rate is not good, and the hearing impaired cannot produce accurate pronunciation.

In order to solve this problem, it is urgently needed to develop an input method that can satisfy both the exact Jamo input and the ease of use of the hearing impaired.

The present invention has been made in order to solve the above-mentioned conventional problems, by registering the frequently used sentences in daily life or work as a widget widget function that can easily find the desired sentence without a separate input and output by voice In the case of communication boards that search for the sentence you want from the database, you can search for the sentence you want without typing the whole sentence by providing the related word search and the initial search, and provide the recent list function. Check the list of voices so that they can be output again. The mobile terminal displays a list of category icons for each communication topic on the screen of the portable terminal, and provides a dialog helper function that displays and selects a list of frequently used sentences in the category icon list for each topic and outputs it by voice. For quick conversations with general users who are not familiar with it, it provides a blackboard function and a speech function that can directly input sentences and output voice without searching. By constructing an alternative communication terminal system that combines the components of these modules, communication between the hearing-impaired person with speech impairment and the other party can be performed in real time regardless of the place. The aim is to provide a portable communication device for the hearing impaired, which can be effectively expressed to third parties and integrated into the members of society.

The present invention displays a list of categories of images on the screen of a portable terminal for each communication subject, and shows a plurality of sentences used by the deaf in the category icon list of each subject in the workplace and, if selected, turns the selected sentence into a voice. By constructing an alternative Communication Conversation Assistant module, the communication between the handicapped person with speech impairment and the other party can be performed in real time regardless of the place, so that the disabled can effectively communicate their thoughts, feelings, and needs to third parties. To provide a portable communication device for the hearing impaired that can be expressed and integrated into the general community.

In addition, in the present invention, when a deaf person inputs a word, the sentence corresponding to the word is searched and displayed on the dialogue DB list, and the icon dialogue in the limited dialogue assistant is selected by selecting the most similar sentence to be expressed by the disabled person in the output sentence. It supports faster communication of various sentences than the helper module.

In addition, in the present invention, in the case of a simple conversation, it is effective for short communication with a general person as a function that can be written by hand directly on a device, which can be effectively used for communication through a pen by a person who is not familiar with device operation.

In addition, the present invention provides additional functions such as schedule management, multimedia module, so that people with disabilities can also enjoy the benefits of electronic devices such as the general public.

The present invention is a functional device that can complement or replace communication for people with disabilities that are difficult to communicate in spoken language due to various causes such as severe hearing loss, language delay, or speech loss in farmers (less than 90DB). Hearing impaired people have difficulty in adapting to the workplace due to increased productivity and avoidance due to disconnection from the employer and difficulty in communication at work. In this situation, efficient design and easy operation method by iconizing each sentence enhance user convenience, enable accurate communication of the disabled, improve job security of the hearing impaired, adapt to work life and bond with colleagues. Enhance your company's productivity.

The present invention can be applied first to the field of computer information processing related to the information education curriculum specialized for the hearing impaired and the development of wireless Internet contents and services in the limelight in the multimedia age, and to focus on various manufacturing industries that the disabled can take priority work 1 It can also be used in the tea and tertiary industries. By focusing on the communication between the hearing impaired and the general public, the display function is enhanced to be used in offices and noisy external working environments.

As described above, the present invention configures the screen of the portable terminal into modules for each subject and function of communication, so that the communication between the disabled person with speech impairment and the conversation partner is performed in real time regardless of the place. They are also effective in expressing their thoughts, feelings, and demands to third parties and integrating them into members of the general society. They also support communication for the hearing-impaired in the workplace, increasing the employer's employment promotion effect. .

In addition, the current SMS method using a mobile phone has a considerable inconvenience in communicating with the general public because the device itself is small and there is a limitation in inputting text using the keypad. However, the present invention can be used as a portable multimedia device (PMP). Very convenient.

In addition, the present invention contributes to the maintenance of the occupation of the disabled by improving the localization and high quality of the assistive technology through the development of new assistive technology devices, to improve the accessibility and convenience of the information related to the performance of the disabled, and It has the effect of promoting communication between the disabled and non-disabled or between disabled and non-disabled.

1 is a view showing an example of the appearance of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention,
2 is a view showing the main screen portion displayed on the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention,
3 is a view showing a widget view of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention,
4 is a view showing a widget addition function of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention,
5 is a view showing the recent list function of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention,
6 is a view showing a communication board function of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention,
7 is a view showing a conversation helper function of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention;
8 is a view showing a blackboard function of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention,
9 is a view showing a speech function of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention,
10 is a view showing an example of operation of the volume control method and voice selection of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention,
11 is a view showing the display of other functions of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention.

Hereinafter, a portable communication device for the hearing impaired according to the present invention will be described.

1 is a view showing an example of the appearance of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention, Figures 1a to 1f respectively show a plan view, rear view, left and right side views, front view, etc. 3 is a view showing a main screen displayed on the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention, Figure 3 shows a widget view of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention 4 is a diagram illustrating a widget addition function of a supplemental alternative communication terminal for the hearing impaired according to an embodiment of the present invention, and FIG. 5 is a supplemental alternative communication terminal for the hearing impaired according to an embodiment of the present invention. Figure 6 is a diagram showing the function of the, Figure 6 is a pseudo alternative communication terminal for the hearing impaired according to an embodiment of the present invention 7 is a view showing a mail order function, Figure 7 is a view showing the conversation helper function of the complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention, Figure 8 is a supplement for the hearing impaired according to an embodiment of the present invention FIG. 9 is a diagram illustrating a blackboard function of an alternative communication terminal, FIG. 9 is a diagram illustrating a speech function of a complementary alternative communication terminal for the hearing impaired according to an embodiment of the present invention, and FIG. 10 is an embodiment of the present invention. FIG. 11 is a view illustrating an example of a volume control method and an operation of voice selection of a supplemental alternative communication terminal for a hearing impaired person, and FIG. 11 is a view illustrating display of other functions of a supplemental alternative communication terminal for a hearing impaired person according to an embodiment of the present invention. to be.

Referring to the drawings, the portable dialog device for the hearing impaired according to the present invention includes a main screen unit, a touch screen unit, a power and function switch unit, and a speaker unit capable of outputting voice to an external device to select main functions of the portable conversation device. It basically includes a communication device unit, a memory unit for storing the functions of each module and an application processor for performing a specified procedure. The detailed description of the functions and techniques will be omitted.

In addition to the conventional technology, the dialog device of the present invention includes, in particular, a widget function module that registers as a widget in the case of a sentence which is frequently used to help communication of the hearing impaired and immediately finds it when desired;

A recent list search module to check recently used sentences;

A communication board module which allows a user to directly create a desired sentence through a word search and quickly finds a desired sentence through a related word search or an initial search without having to enter all the necessary sentences for a conversation;

A dialog helper module for linking a plurality of sentence lists frequently used in a work life in a list of category icons for each topic to output a sentence generated by a search or a combination by voice;

A blackboard function module capable of handwriting;

A speaker function module capable of directly inputting a sentence and outputting the voice; And

It is characterized in that it comprises a; add-on module beneficial to the hearing impaired.

Referring to Figure 2, the main menu of the portable dialog device can be provided in the form of a 5x2 widget (Widget), maximizing the efficiency of the portable dialog device by building your own DB with sentences used a lot during daily life or work can do. The number of widgets that can be created on one page is 10, but if more than 10, you can add a page. It provides Exit, Help, Add Widget, Delete Widget buttons on the right side, and Launcher at the bottom that can directly execute the functions of the portable communication device.

Referring to FIG. 3, when a desired widget is clicked on the main menu (widget), the communication board is connected. You can see the list of sentences that correspond to the selected widget in the connected communication board. After selecting the desired sentences, click the speaker button to output voice. If you do not have the sentence you want, you can click the New sentence button to enter the sentence you want, and you can include the sentence by clicking the speaker button or by clicking the widget button. For example, if you select a widget called 'farming', you can see a list of sentences related to farming, and after the user selects a desired sentence, click the speaker button in the upper right corner to output a voice. If you don't have the sentence you want, go to Speech by clicking the New Sentence button in the upper right button. After entering the desired sentence using the keyboard, press the speaker button to output the voice or press the save button to add a new sentence to the widget.

버튼을 클릭하면 위젯 추가 화면으로 넘어 간다. 그리고 위젯명을 입력하고 아이콘을 선택한 후 저장 버튼을 클릭한다.

버튼을 클릭하면 위젯을 삭제할 수 있는 상태로 변환되고, 삭제할 위젯을 클릭하면 위젯이 삭제된다. 구체적으로 동작 방법을 설명하면, 위젯 추가 화면에서 위젯명의 텍스트 입력 박스를 터치하면 키보드가 나오고 키보드로 위젯명을 입력한 후에 아래에 있는 아이콘 중에서 하나를 선택하고 우측 상단의 저장 버튼을 누른다. 그러면 위젯명을 연관어로 하는 문장들을 DB에서 검색하여 위젯에 해당 문장들을 포함하게 된다. 기존 DB의 문장을 활용하는 것을 원하지 않는다면 문장이 없는 빈 위젯을 만들고 사용자가 직접 문장들을 입력할 수도 있다. 위젯을 삭제하기 위해

버튼을 누르면 이미 만들어진 위젯 아이콘의 우측 상단에 X 표시가 생겨 삭제할 수 있는 상태임을 알려준다.(예를 들어,

와

같이 아이콘이 변경된다.) 그러면 삭제할 위젯을 클릭하면 해당 위젯이 화면에 사라지고 선택이 모두 끝나면 우측에 있는 확인(

) 버튼을 클릭하면 위젯 삭제 작업이 완료된다.Referring to Figure 4,

Clicking the button will take you to the add widget screen. Enter a widget name, select an icon, and click the Save button.

Clicking the button converts the widget into a state that can be deleted, and clicking the widget to delete deletes the widget. In detail, the operation method may include touching a widget input text input box on the widget add screen, and then entering a widget name using the keyboard, selecting one of the icons below, and pressing the save button in the upper right corner. Then, the sentences that are related to the widget name are searched in the DB to include the sentences in the widget. If you don't want to use the existing DB sentences, you can create an empty widget without a sentence and enter the sentences yourself. To delete a widget

When you press the button, an X appears in the upper right corner of the widget icon that has already been created, indicating that you can delete it (e.g.,

Wow

Icon will change.) Then click the widget you want to delete and the widget will disappear on the screen.

Click the) button to finish deleting the widget.

Referring to FIG. 5, since a sentence which is used recently or frequently used is often searched again, a recent list function is provided to increase the efficiency of the conversation. Clicking on the recent list in the main menu displays up to 50 recently used sentences. By sorting by selecting time order and frequency order by combo box in sorting, it supports the function to find the recent sentence or the sentence which is used frequently. And by providing a fixed pin function that can always place a specific sentence on the list, you can edit the priority of the sentence yourself.

Referring to FIG. 6, the communication board may be selected from the main menu. With communication boards, you can quickly find and output voice messages from the database through association searches and initial searches without having to enter all the sentences needed for the conversation. When you select the input box, a keyboard appears and you can enter the desired keyword (phrase) through the keyboard. For example, if you search for the word "farming," you will search for not only sentences that contain the word farming, but also sentences related to farming. And instead of entering 'farming', if you enter 'ㄴㅅ', you will search for a sentence that includes the keyword farming. If the sentence you want is not in the list, click the new sentence icon to enter a new sentence. The input sentence can be outputted through the speaker function, and can be saved in the database by clicking the widget button. In this case, the keyword is specified.

Referring to FIG. 7, the chat assistant may be selected from the main menu. The conversation assistant displays a list of category videos by topic of communication, shows a number of sentences used by the deaf in the category icon list for each topic in the workplace, and outputs the selected sentences by voice when a desired sentence is selected.

Referring to FIG. 8, the blackboard function may be selected from the main menu. In the case of a simple conversation, it is effective for short communication with the general person as a function of handwriting on the device, which can be effectively used for communication through a pen by a person unfamiliar with the operation of the device. Handwriting recognition enables voice output.

Referring to FIG. 9, when a speech icon is clicked in the main menu, a sentence may be directly input and a voice may be output.

Referring to FIG. 10, volume, pitch, and speed may be adjusted during voice output. By adding a variety of voice DB, you can choose the voice you want.

Referring to FIG. 11, other functions such as broadcast viewing (DMB), multimedia, schedule management, and additional functions are provided. The multimedia features include music listening, movie viewing and image viewing, while the add-ons provide a text viewer, world time, and calculator. In addition to supporting functions that can help work in the workplace and to read files such as e-books, it can be used as a device for improving self-development in addition to functions for conversation. And through the multimedia functions, as well as the general public enjoys the benefits of electronic devices.

Sign language analysis database for communication in the workplace for the hearing impaired: DB of sentences frequently used by the hearing impaired by analyzing the words related to job counseling, occupation and job, working life and workplace, consultation, evaluation, family, housing, disability Click on the situation, such as word and sentence DB, education, vocational training, occupation, job, job title, occupational life, wages, working conditions, safety, amenities, commute, traffic, law, etc. Hearing impaired people with poor vocabulary can express their will quickly beyond the text.

As described above, the present invention configures the screen of the portable terminal into modules for each subject and function of communication, so that the communication between the disabled person with speech impairment and the conversation partner is performed in real time regardless of the place. They are also effective in expressing their thoughts, feelings, and demands to third parties and integrating them into members of the general society. They also support communication for the hearing-impaired in the workplace, increasing the employer's employment promotion effect. .

In addition, the present invention provides a function of easily writing a communication sentence with a click using an emoticon or a pictogram, and recognizes the handwriting written as an output writing by voice and text in a text form, and reads it by voice, children who do not know the writing, It can be used as an effective means of communication for the blind. In addition, the current SMS method using a mobile phone has a considerable inconvenience in communicating with the general public because the device itself is small and there is a limitation in inputting text using the keypad. However, the present invention can be used as a portable multimedia device (PMP). Very convenient.

In addition, the present invention contributes to the maintenance of the occupation of the disabled by promoting the localization and high quality of the assistive technology through the development of a new assistive technology device, to improve the accessibility and convenience of the information related to the performance of the disabled, It has the effect of promoting communication between people with disabilities and non-disabled persons or persons with disabilities and persons with disabilities.

Claims (1)

Main screen unit, touch screen unit, power and function switch unit for selecting the main functions of the portable communication device, speaker unit for outputting voice to the outside, broadcasting communication unit unit, memory unit storing the functions of each module And an application processor for performing a designated procedure, comprising:
In case of frequently used sentences, the widget function module registers as a widget so that it can be found immediately when desired;
A recent list search module to check recently used sentences;
A communication board module which allows a user to directly create a desired sentence through a word search and quickly finds a desired sentence through a related word search or an initial search without having to enter all the necessary sentences for a conversation;
A dialog helper module for linking a plurality of sentence lists frequently used in a work life in a list of category icons for each topic to output a sentence generated by a search or a combination by voice;
A blackboard function module capable of handwriting;
A speaker function module capable of directly inputting a sentence and outputting the voice; And
An add-on module including a broadcasting view, a multimedia, a schedule management, a text viewer, a world time, and a calculator function. Device.

Images