KR102456526B1 - Method for providing communication assistance service for people with disabilities - Google Patents

Abstract

An embodiment of the present invention provides a method for providing communication assistance service for people with disabilities. The method for providing communication assistance service for people with disabilities includes the steps of: obtaining a user's voice input from a user terminal, to store the same; obtaining, from the user terminal, a selection input for a first sentence and a second sentence to be matched with the voice input; providing a voice file corresponding to the first sentence to the user terminal; obtaining, from the user terminal, an input for selecting a second category and an input different from the voice input; obtaining, from the user terminal, an input for selecting one sentence from among a plurality of sentences related to the second category; providing a voice file corresponding to the one sentence to the user terminal; providing first custom language set information to a consumer terminal; obtaining, from the consumer terminal, a replacement voice input to replace the voice input in the first custom language set information, to store the same; and generating second custom language set information based on the replacement voice input.

Description

METHOD FOR PROVIDING COMMUNICATION ASSISTANCE SERVICE FOR PEOPLE WITH DISABILITIES

Embodiments of the present invention relate to a method of providing a communication assistance service for the disabled.

Existing communication assistive devices have a technology for expressing text into voice. Existing software supports text-to-speech and voice-to-text, but most of them are for translation, so it is inconvenient to use with Koreans.

There are many ways in which people with disabilities who have difficulty in basic communication interact with people. However, people with disabilities who need an alternative communication method because non-disabled people have difficulties in recognizing it, or those who lack the ability to speak and acquire a language, need help from an accompanying assistant or use a cell phone memo pad to deliver sentences, etc. is using the method of In this case, since the disabled must be accompanied by a guardian when going out, there are difficulties such as hindering independent living and delaying communication time. However, there is still no independent language system for people with language or intellectual disabilities.

AAC (augmentative and alternative communication), that is, complementary/alternative communication, has emerged to overcome these limitations. Although there is no separate language system or form, it refers to various methods of communication that people with speech movement disorders, cerebral palsy, or intellectual disabilities can use instead of words to communicate their intentions to others.

Smartphone applications that support AAC currently exist. The function provided by most applications is the ability to create sentences by drawing pictures on words or predicates frequently used in restaurants and hospitals, and combining the pictures. Also, when you input a sentence, the machine converts it into speech. However, these functions are very limited, and it takes a long time to select a picture when speaking a desired sentence, and it is difficult to convey exactly what you want. Therefore, there is a need for a more improved and convenient AAC method.

Embodiments of the present invention may provide a service providing server for communication between the disabled and the non-disabled and an operating method thereof.

The technical problems to be achieved in the embodiments are not limited to those mentioned above, and other technical problems not mentioned may be considered by those of ordinary skill in the art from various embodiments to be described below. can

According to embodiments, there is provided a service providing method for communication between the disabled and the non-disabled performed by at least one server, the method comprising: acquiring and storing a user's voice input from a user terminal; obtaining, from the user terminal, selection inputs for a first sentence and a second sentence to be matched with the voice input, wherein the first sentence relates to a first category, and the second sentence relates to a second category; step; obtaining, from the user terminal, an input for selecting the first category and the voice input; and providing, to the user terminal, a voice file corresponding to the first sentence based on an input for selecting the first category and the voice input.

Here, the step of obtaining, by the server, an image input for a gesture to be matched with the first sentence from the user terminal and storing; and obtaining the image input from the user terminal, wherein the step of providing the audio file corresponding to the first sentence includes, by the server, an input for selecting the first category to the user terminal , providing an audio file corresponding to the first sentence based on the audio input and the image input.

Here, obtaining, by the server, an input for selecting the second category and an input different from the voice input from the user terminal; obtaining, from the user terminal, an input for selecting one sentence from among a plurality of sentences related to the second category; and providing, to the user terminal, a voice file corresponding to the one sentence selected from among a plurality of sentences related to the second category.

Here, the first sentence and the second sentence may be sentences having different meanings.

Here, the server sends, to the consumer terminal, first custom language set information related to the matching relationship between the voice input, the video input, the first sentence, the second sentence, the first category, and the second category. It may further include the step of providing.

An embodiment of the present invention provides a server for providing a service for communication between the disabled and the non-disabled, comprising: a processor; transceiver; and memory; wherein the processor is configured to: obtain and store, from the user terminal, the user's voice input; obtain, from the user terminal, a selection input for a first sentence and a second sentence to be matched with the voice input, wherein the first sentence relates to a first category, and the second sentence relates to a second category; obtaining, from the user terminal, an input for selecting the first category and the voice input; In addition, the user terminal may be configured to provide an input for selecting the first category and a voice file corresponding to the first sentence based on the voice input.

Here, the processor obtains and stores, from the user terminal, an image input for a gesture to be matched with the first sentence; and obtaining the image input from the user terminal, wherein the server provides the user terminal with the first category based on the input for selecting the first category, the audio input, and the image input. It may be set to provide a voice file corresponding to a sentence.

Here, the processor obtains, from the user terminal, an input for selecting the second category and an input different from the voice input; obtaining, from the user terminal, an input for selecting one sentence from among a plurality of sentences related to the second category; And it may be further configured to provide a voice file corresponding to the one sentence selected from among a plurality of sentences related to the second category to the user terminal.

Here, the first sentence and the second sentence may be sentences having different meanings.

Here, the processor provides, to the consumer terminal, first custom language set information related to the matching relationship between the voice input, the video input, the first sentence, the second sentence, the first category, and the second category. It may be further set to provide.

According to embodiments, the user can clearly convey the content he/she wants to non-disabled people even if there are not many words or sentences that can actually be used. In addition, it is easy to acquire a language system because you can create your own language system. Even people who can hardly speak a voice can communicate effectively because a single voice can convey multiple meanings.

Effects obtainable from the embodiments are not limited to the effects mentioned above, and other effects not mentioned are clearly derived and understood by those of ordinary skill in the art based on the following detailed description. can be

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included as part of the detailed description to aid understanding of the embodiments, provide various embodiments and, together with the detailed description, explain technical features of the various embodiments.
1 is a system diagram including a service providing server for communication between the disabled and non-disabled people according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a server that provides a service for communication between the disabled and the non-disabled according to an embodiment of the present invention.
3 is a diagram illustrating an embodiment of a method of operating a service providing server for communication between the disabled and the non-disabled.
4 is a diagram illustrating a first custom language set according to an embodiment of a service method for communication between disabled and non-disabled people.
5 is a diagram illustrating a second custom language set according to an embodiment of a service method for communication between the disabled and the non-disabled.

The following embodiments combine elements and features of the embodiments in a predetermined form. Each component or feature may be considered optional unless explicitly stated otherwise. Each component or feature may be implemented in a form that is not combined with other components or features. In addition, various embodiments may be configured by combining some components and/or features. The order of operations described in various embodiments may be changed. Some features or features of one embodiment may be included in another embodiment, or may be replaced with corresponding features or features of another embodiment.

In the description of the drawings, procedures or steps that may obscure the gist of various embodiments are not described, and procedures or steps that can be understood at the level of those of ordinary skill in the art are also not described. did.

Throughout the specification, when a part is said to "comprising or including" a certain component, it does not exclude other components unless otherwise stated, meaning that other components may be further included. do. In addition, terms such as "... unit", "... group", and "module" described in the specification mean a unit that processes at least one function or operation, which is hardware or software or a combination of hardware and software. can be implemented as Also, "a or an", "one", "the" and like related terms are used herein in the context of describing various embodiments (especially in the context of the claims that follow). Unless otherwise indicated or clearly contradicted by context, it may be used in a sense including both the singular and the plural.

Hereinafter, embodiments according to various embodiments will be described in detail with reference to the accompanying drawings. DETAILED DESCRIPTION The detailed description set forth below in conjunction with the appended drawings is intended to describe exemplary embodiments of various embodiments, and is not intended to represent the only embodiments.

In addition, specific terms used in various embodiments are provided to help the understanding of various embodiments, and the use of these specific terms may be changed to other forms without departing from the technical spirit of various embodiments. .

Referring to FIG. 1 , the method of providing a service for communication between the disabled and the non-disabled according to an embodiment of the present invention is a computing device that has a storage space such as a personal computer (PC), can be connected to the Internet, and is not easy to carry. It may be performed in a portable terminal such as a smart phone or the like. At this time, the method of providing a service for communication between the disabled and the non-disabled is that the application implementing the method is downloaded from the App Store and installed on the portable terminal. can be executed later.

And the method of providing a service for communication between the disabled and the non-disabled is inserted into a computing device such as a PC while being recorded in a recording medium such as a CD (Compact Disc) or USB (Universal Serial Bus) memory to access the computing device. It may be performed through an operation or may be performed through an access operation of the computing device after being stored in the storage space of the computing device from the recording medium.

On the other hand, when the computing device or the portable terminal can access a server connected to the Internet, the method of providing a service for communication between the disabled and non-disabled can also be executed on the server at the request of the computing device or the portable terminal.

Hereinafter, the computing device, portable terminal, or server on which the above method of providing a service for communication between the disabled and non-disabled is executed may be collectively referred to as a service providing device for communication between the disabled and non-disabled.

The above 　 service providing device for communication between the disabled and non-disabled people may have the same configuration as the 　 service providing device for communication between the disabled and non-disabled illustrated in FIG. 2, and the above 　 service for communication between the disabled and non-disabled people The provision 　 device may not be limited to the 　 service provision device for communication between the disabled and non-disabled people shown in FIG. 1 .

The system according to an embodiment may include user terminals 100 and 110, consumer terminals 120 and 130, and a service providing server 200 (hereinafter, server 200) for communication between the disabled and non-disabled people. can The network may include an Internet portal site server, an SNS server, a server operating a blog, and the like.

The user terminals 100 and 110 and the consumer terminals 120 and 130 are a smart phone, a tablet PC, a PC, a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a micro server, and a global positioning system (GPS). ) devices, e-book terminals, digital broadcast terminals, navigation devices, kiosks, MP3 players, digital cameras, home appliances, camera-equipped devices, and other mobile or non-mobile computing devices, but is not limited thereto. In addition, the user terminals 100 and 110 and the consumer terminals 120 and 130 may be wearable devices having a communication function and a data processing function. However, it is not limited thereto.

The server 200 is implemented as a computer device or a plurality of computer devices that communicate with the user terminals 100 and 110 and the consumer terminals 120 and 130 through a network to provide commands, codes, files, contents, services, etc. can be

For example, the server 200 may provide a file for installing an application to the user terminals 100 and 110 and the consumer terminals 120 and 130 connected through a network. In this case, the user terminals 100 and 110 and the consumer terminals 120 and 130 may install an application using a file provided from the server 200 .

In addition, the user terminals 100, 110, and the consumer terminals 120 and 130 access the server 200 under the control of an operating system (OS) and at least one program (eg, a browser or an installed application), A service or content provided by the server 200 may be provided.

As another example, the server 200 may establish a communication session for data transmission/reception, and route data transmission/reception between the user terminals 100 and 110 and the consumer terminals 120 and 130 through the established communication session.

The user terminals 100 and 110, the consumer terminals 120 and 130, and the service providing server 200 for communication between the disabled and the non-disabled may perform communication using a network. For example, a network includes a local area network (LAN), a wide area network (WAN), a value added network (VAN), a mobile radio communication network, a satellite communication network, and their It is a data communication network in a comprehensive sense that includes mutual combinations and enables each network constituent entity shown in FIG. 1 to communicate smoothly with each other, and may include a wired Internet, a wireless Internet, and a mobile wireless communication network. In addition, wireless communication is, for example, wireless LAN (Wi-Fi), Bluetooth, Bluetooth low energy, Zigbee, WFD (Wi-Fi Direct), UWB (ultra wideband), infrared communication (IrDA, infrared) Data Association), NFC (Near Field Communication), etc. may be there, but is not limited thereto.

2 is a block diagram showing the configuration of a server that provides a service for communication between the disabled and the non-disabled according to an embodiment of the present invention.

Referring to FIG. 2 , the server 200 (hereinafter, the server 200 ) that provides a service for communication between the disabled and the non-disabled may include a communication unit 210 , a processor 220 , and a DB 230 . have. In the server 200 of FIG. 2, only the components related to the embodiment are shown. Accordingly, it can be understood by those skilled in the art that other general-purpose components may be further included in addition to the components shown in FIG. 2 .

The communication unit 210 may include one or more components that enable wired/wireless communication between terminals. For example, the communication unit 210 may include at least one of a short-range communication unit (not shown), a mobile communication unit (not shown), and a broadcast receiving unit (not shown).

For example, a request generated according to a program code stored in a recording device such as the DB 230 may be transmitted to the terminal through a network under the control of the communication unit 210 . Conversely, a control signal, command, content, file, etc. provided under the control of the processor of the terminal may be received by the server 200 through the communication unit 210 through the network. For example, a control signal, command, content, file, etc. of the server 200 received through the communication unit 210 may be transmitted to the processor 220 or transmitted to the DB 230 and stored.

The DB 230 is hardware for storing various data processed in the server 200 , and may store a program for processing and controlling the processor 220 .

DB 230 is a random access memory (RAM), such as dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), CD- It may include ROM, Blu-ray or other optical disk storage, a hard disk drive (HDD), a solid state drive (SSD), or flash memory. The DB 230 may also be referred to as a memory.

The processor 220 controls the overall operation of the server 200 . For example, the processor 220 may generally control the input unit (not shown), the display (not shown), the communication unit 210 , the DB 230 , and the like by executing programs stored in the DB 230 . The processor 220 may control the operation of the external server 200 by executing programs stored in the DB 230 .

The communication unit 210 may include one or more components that allow the server 200 to communicate with another device (not shown) and a server (not shown). The other device (not shown) may be a computing device such as the server 200 or a sensing device, but is not limited thereto. The communication unit 210 may receive a user input from another electronic device or data stored in an external device from an external device through a network.

The DB 230 may store a program for processing and controlling the processor 220 . For example, the DB 230 may store an instruction for providing a service. Also, the DB 230 may store data generated by the processor 220 . For example, the DB 230 may store information related to a service for communication between the disabled and the non-disabled provided by the processor 220 . The DB 230 may store information input to or output from the server 200 .

The processor 220 includes application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, and microcontrollers. It may be implemented using at least one of (micro-controllers), microprocessors, and other electrical units for performing functions.

The DB 230 may store at least one instruction executed through the processor 220 . The at least one command is to obtain and store, from the user terminal, the user's voice input; obtain, from the user terminal, a selection input for a first sentence and a second sentence to be matched with the voice input, wherein the first sentence relates to a first category, and the second sentence relates to a second category; obtaining, from the user terminal, an input for selecting the first category and the voice input; In addition, the user terminal may be configured to provide an input for selecting the first category and a voice file corresponding to the first sentence based on the voice input.

Here, the at least one command may include: acquiring and storing an image input for a gesture to be matched with the first sentence from the user terminal; and obtaining the image input from the user terminal, wherein the server provides the user terminal with the first category based on the input for selecting the first category, the audio input, and the image input. It may be set to provide a voice file corresponding to a sentence.

Here, the at least one command may include: obtaining, from the user terminal, an input for selecting the second category and an input different from the voice input; obtaining, from the user terminal, an input for selecting one sentence from among a plurality of sentences related to the second category; And it may be further configured to provide a voice file corresponding to the one sentence selected from among a plurality of sentences related to the second category to the user terminal.

Here, the first sentence and the second sentence may be sentences having different meanings.

Here, the at least one command is, to the consumer terminal, a first custom language related to a matching relationship between the voice input, the video input, the first sentence, the second sentence, the first category, and the second category. It may be further configured to provide set information.

3 is a diagram illustrating an embodiment of a method of operating a service providing server for communication between the disabled and the non-disabled.

Referring to FIG. 3 , the service providing server (hereinafter, the server) for communication between the disabled and the non-disabled may acquire and store the user's voice input (S300). For example, the server may obtain and store the user's voice input from the user terminal.

The server may obtain the user's voice input, which will be a trigger for providing a service for communication between the disabled and the non-disabled, from the user terminal. For example, the server may repeatedly obtain a specific voice input from the user terminal. The server may perform better recognition of the voice input by repeatedly acquiring the voice input from the user terminal. For example, the server can improve the recognition rate of voice input through deep learning technology. The server may store the voice input obtained from the user terminal, and may distinguish the stored voice input and the voice input that can be recognized as being the same or similar.

The server may obtain sentence information to be matched with the voice input (S310). For example, the server may obtain, from the user terminal, a selection input for a first sentence and a second sentence to be matched with the voice input. The first sentence may relate to a first category, and the second sentence may relate to a second category.

That is, two or more sentences may be matched to the voice input. When two or more sentences are matched to the voice input, each sentence may be related to a different category. The first sentence and the second sentence may have different meanings.

The first sentence may be a sentence related to a first category (eg, a sentence used in a restaurant). For example, the first sentence is a sentence used in a restaurant, and may be sentences such as "Is this spicy?", "Give me some water", and "I'll add one serving".

The second sentence may be a sentence related to the second category (eg, a sentence used in a clothing store). For example, the second sentence is a sentence used in a clothing store, such as “Can I try on?”, “Where do I pay?”, “Do you have other sizes?” It may be a sentence such as

The server may obtain an image input to be matched with the sentence (S320). For example, the server may obtain and store, from the user terminal, an image input for a gesture to be matched with the first sentence.

That is, the server may acquire, from the user terminal, an image input (ie, a gesture) that will be a trigger for providing a service for communication between the disabled and the non-disabled along with the voice input. For example, the server may repeatedly obtain a specific image input from the user terminal. The server may better recognize the image input by repeatedly acquiring the image input from the user terminal. For example, the server may improve the recognition rate of image input through deep learning technology. The server may store an image input obtained from the user terminal, and may distinguish an image input that can be recognized as being identical to or similar to the stored image input.

The server may provide a voice file corresponding to the sentence (S330). For example, the server may obtain an input for selecting the first category and the voice input from the user terminal. Also, the server may obtain the image input from the user terminal.

That is, the sentence may be matched only with the voice input or may be matched with the voice input and the image input.

For example, when a sentence matches only a voice input, the server may provide a voice file corresponding to the sentence to the user terminal when an input for selecting a category and a voice input are obtained from the user terminal.

For example, when the sentence matches the voice input and the image input, the server may provide the voice file corresponding to the sentence to the user terminal when the input for selecting a category, the voice input, and the image input are obtained from the user terminal. That is, the server may provide, to the user terminal, an audio file corresponding to the first sentence based on the input for selecting the first category, the audio input, and the image input.

The server may provide options for a plurality of sentences related to the category (S340). For example, the server may obtain, from the user terminal, an input for selecting the second category and an input different from the voice input.

That is, the server may obtain an input for selecting a category from the user terminal, but may fail to obtain a voice input. In this case, the server may provide the user terminal with options for a plurality of sentences related to the category. The server may obtain, from the user terminal, an input for selecting one sentence from among a plurality of sentences related to the second category.

The server may provide a voice file corresponding to the selected sentence (S350). For example, the server may provide a voice file corresponding to the one sentence selected from among a plurality of sentences related to the second category to the user terminal.

That is, the server that has failed to obtain the voice input may provide the user terminal with options for sentences frequently used in the second category. A voice file for a sentence may be provided to the user terminal.

The server may provide the custom language set information to another user (S360). For example, the server sends, to the consumer terminal, first custom language set information related to the matching relationship between the voice input, the video input, the first sentence, the second sentence, the first category, and the second category. can provide

For example, the user may register the custom language set information created by the user in the server, and sell the custom language set information registered by the user to other users through the server. That is, a user who uses the service for communication between the disabled and the non-disabled can purchase and use custom language set information created by other users.

Here, the consumer terminal may refer to a terminal of a user who purchases and uses custom language set information made by other users among users using a service for communication between the disabled and the non-disabled.

That is, the custom language set information may be information including a matching relationship for voice input, image input, sentences, and categories. Hereinafter, custom language set information will be described.

4 is a diagram illustrating a first custom language set according to an embodiment of a service method for communication between disabled and non-disabled people.

Referring to FIG. 4 , the first custom language set may include a first voice, a second voice, and a third voice.

For example, a first sentence of a first category and a second sentence of a second category may be matched to the first voice. When the server acquires the first category selection input and the first voice, the server may provide a voice file corresponding to the first sentence. When the server acquires the second category selection input and the first voice, the server may provide a voice file corresponding to the second text.

For example, third, fourth, and fifth sentences of the second category may be matched to the second voice. Here, the first gesture (ie, the first image) may be matched to the third sentence, the second gesture may be matched to the fourth sentence, and the third gesture may be matched to the fifth sentence. When the server acquires the second category selection input, the second voice, and the first gesture, the server may provide a voice file corresponding to the third sentence. In this case, when only the second category selection input and the second voice are obtained, the server does not provide the voice file corresponding to the third sentence. When the server acquires the second category selection input, the second voice, and the second gesture, the server may provide a voice file corresponding to the fourth sentence. When the server acquires the second category selection input, the second voice, and the third gesture, the server may provide a voice file corresponding to the fifth sentence.

For example, the sixth sentence of the first category may be matched to the third voice. That is, it is also possible to match only one sentence to one voice. When the server acquires the first category selection input and the third voice, the server may provide a voice file corresponding to the sixth sentence.

Referring back to FIG. 3 , the server may obtain an alternative voice and an alternative video input ( S370 ). For example, the server may obtain and store, from the consumer terminal, an alternative voice input to replace the voice input in the custom language set information.

The server may obtain and store, from the consumer terminal, an alternative image input to replace the image input in the custom language set information.

The server may create a new custom language set (S380). For example, the server may generate second custom language set information based on the alternative voice input and the alternative video input. Hereinafter, a method of generating new custom language set information through an alternative voice and an alternative image (ie, an alternative gesture) will be described.

5 is a diagram illustrating a second custom language set according to an embodiment of a service method for communication between the disabled and the non-disabled.

Referring to FIG. 5 , first to third voices may be replaced with first to third alternate voices. In the case of voice, it is preferable to use one's own voice because the tone, volume, pitch, and the like may be different if another person's voice is registered. Accordingly, a user who has purchased a custom language set can replace the voice part in the custom language set with his or her own voice.

For example, the user may transmit substitute voice information to the server, and when the server obtains the substitute voice information from the user terminal, the voice of the existing custom language set may be replaced with the substitute voice.

Also, even in the case of a gesture, since a case in which it is difficult to perform the same gesture due to a disability may occur, an existing gesture may be replaced with an alternative gesture.

For example, the user may transmit the replacement image information to the server, and when the server obtains the replacement image information from the user terminal, the image (ie, gesture) of the existing custom language set may be replaced with the replacement image.

When the server obtains the first category selection input and the first replacement voice, the server may provide a voice file corresponding to the first sentence. When the server obtains the second category selection input and the first replacement voice, the server may provide a voice file corresponding to the second text.

When the server acquires the second category selection input, the second alternative voice, and the first alternative gesture, the server may provide a voice file corresponding to the third sentence. When the server acquires the second category selection input, the second alternative voice, and the second alternative gesture, the server may provide a voice file corresponding to the fourth sentence. When the server acquires the second category selection input, the second alternative voice and the third alternative gesture, the server may provide a voice file corresponding to the fifth sentence.

When the server obtains the first category selection input and the third alternative voice, the server may provide a voice file corresponding to the sixth sentence.

Some of the detailed steps shown in the example of FIG. 3 may not be essential steps and may be omitted. In addition to the steps shown in FIG. 3 , other steps may be added, and the order of the steps may vary. Some of the above steps may have their own technical meaning.

A method of providing a service for communication between the disabled and the non-disabled performed by at least one server, the method comprising: acquiring and storing a user's voice input from a user terminal; obtaining, from the user terminal, selection inputs for a first sentence and a second sentence to be matched with the voice input, wherein the first sentence relates to a first category, and the second sentence relates to a second category; step; obtaining, from the user terminal, an input for selecting the first category and the voice input; and providing, to the user terminal, a voice file corresponding to the first sentence based on an input for selecting the first category and the voice input.

Here, the step of obtaining, by the server, an image input for a gesture to be matched with the first sentence from the user terminal and storing; and obtaining the image input from the user terminal, wherein the step of providing the audio file corresponding to the first sentence includes, by the server, an input for selecting the first category to the user terminal , an audio file corresponding to the first sentence based on the audio input and the image input may be provided.

Here, obtaining, by the server, an input for selecting the second category and an input different from the voice input from the user terminal; obtaining, from the user terminal, an input for selecting one sentence from among a plurality of sentences related to the second category; and providing, to the user terminal, a voice file corresponding to the one sentence selected from among a plurality of sentences related to the second category.

Here, the first sentence and the second sentence may be sentences having different meanings.

Here, the server sends, to the consumer terminal, first custom language set information related to the matching relationship between the voice input, the video input, the first sentence, the second sentence, the first category, and the second category. It may further include the step of providing.

Here, the server acquiring and storing, from the consumer terminal, an alternative voice input to replace the voice input in the custom language set information; obtaining and storing, from the consumer terminal, an alternative image input to replace the image input in the custom language set information; and generating second custom language set information based on the alternative voice input and the alternative video input.

The operation according to the embodiment of the present specification may be implemented as a computer-readable program or code on a computer-readable recording medium. The computer-readable recording medium includes all types of recording devices in which data readable by a computer system is stored. In addition, the computer-readable recording medium may be distributed in a network-connected computer system to store and execute computer-readable programs or codes in a distributed manner.

When the embodiment is implemented in software, the above-described technique may be implemented as a module (process, function, etc.) that performs the above-described function. A module may be stored in a memory and executed by a processor. The memory may be internal or external to the processor, and may be coupled to the processor by various well-known means.

In addition, the computer-readable recording medium may include a hardware device specially configured to store and execute program instructions, such as ROM, RAM, and flash memory. The program instructions may include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

Although some aspects of the invention have been described in the context of an apparatus, it may also represent a description according to a corresponding method, wherein a block or apparatus corresponds to a method step or feature of a method step. Similarly, aspects described in the context of a method may also represent a corresponding block or item or a corresponding device feature. Some or all of the method steps may be performed by (or using) a hardware device such as, for example, a microprocessor, a programmable computer, or an electronic circuit. In some embodiments, one or more of the most important method steps may be performed by such an apparatus.

In embodiments, a programmable logic device (eg, a field programmable gate array) may be used to perform some or all of the functions of the methods described herein. In embodiments, the field programmable gate array may operate in conjunction with a microprocessor to perform one of the methods described herein. In general, the methods are preferably performed by some hardware device.

The various embodiments described above may be embodied in other specific forms without departing from the technical idea and essential characteristics thereof. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the various embodiments should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the various embodiments are included in the scope of the various embodiments. In addition, claims that are not explicitly cited in the claims may be combined to form an embodiment or may be included as a new claim by amendment after filing.

Claims (1)

In the method of providing a communication assistance service for the disabled performed by at least one server,
obtaining and storing the user's voice input from the user terminal;
obtaining, from the user terminal, selection inputs for a first sentence and a second sentence to be matched with the voice input, wherein the first sentence relates to a first category, and the second sentence relates to a second category; step;
providing, to the user terminal, an input for selecting the first category and a voice file corresponding to the first sentence based on the voice input;
obtaining, from the user terminal, an input for selecting the second category and an input different from the voice input;
obtaining, from the user terminal, an input for selecting one sentence from among a plurality of sentences related to the second category;
providing, to the user terminal, a voice file corresponding to the one sentence selected from among a plurality of sentences related to the second category;
providing, to a consumer terminal, first custom language set information related to a matching relationship between the voice input, the first sentence, the second sentence, the first category, and the second category;
obtaining and storing, from the consumer terminal, a substitute voice input to replace the voice input in the first custom language set information;
generating second custom language set information based on the alternative speech input;
The first sentence and the second sentence are sentences having different meanings,
How to provide communication assistance services for people with disabilities.

Images