KR102024221B1 - Method and device for training auditory function - Google Patents

Abstract

An electronic device for providing auditory rehabilitation training according to an embodiment of the present invention may include a storage unit for storing training result information and auditory rehabilitation content of a user, and executing a training problem to be provided to a user based on the auditory rehabilitation content of the user. A rehabilitation content execution unit; a display unit for providing a visual element of the auditory rehabilitation content to a user, an audio module for providing a sound of the auditory rehabilitation content, and input response information of the user according to the provision of the auditory rehabilitation content; It may include a receiving input unit.

Description

METHOOD AND DEVICE FOR TRAINING AUDITORY FUNCTION}

The present invention relates to a method and apparatus for training the hearing function of a hearing impaired person. More specifically, the present invention relates to a method and apparatus for providing various types of sounds to improve the hearing function of a hearing impaired person and gradually changing the difficulty so that they can rehabilitate at a training stage suitable for an individual.

Due to the rapid aging of the population, the elderly population is rapidly increasing, and the elderly hearing loss, one of the three chronic diseases of the elderly, is increasing the number of people with hearing impairment. As a result, hearing experts predict that the population of deaf people will increase further as the society enters an aging society.

Recently, the purchase rate of hearing aids is increasing due to government subsidy support, but hearing rehabilitation services, which are a post-care program after hearing aid fitting, have not yet been efficiently and sufficiently performed, leading to inadequate or dissatisfaction with hearing aid wearing of hearing aids. Hearing rehabilitation of hearing-impaired elderly is difficult due to the economic burden of long-term hearing rehabilitation and difficulty in accessing the rehabilitation center due to inconvenience. As a result, the elderly who are deaf are urgently required for 'remote hearing rehabilitation services', which allow them to receive long-term rehabilitation services systematically at low cost even if they live remotely from rehabilitation centers.

In addition, in the case of senile deafness, compared with general hearing loss, the hearing loss of the peripheral hearing organ is not primarily heard, and the second hearing loss is caused by the loss of central hearing organ. It is difficult to understand the speech of the other party, and when the other party talks quickly due to the degradation of the time processing function, there is a characteristic that is difficult to understand the speech. In addition, due to the aging of cognitive functions such as working memory, it is difficult to understand long sentences or to follow the conversation flow of the talkers smoothly. Therefore, the development of rehabilitation contents considering the characteristics of senile hearing loss mentioned above is also required.

 On the other hand, there is a prior art related to this Patent Publication No. 10-2005-0012890 (sound processing method and hearing training device for auditory training).

The present invention has been devised for the purpose of determining hearing loss in a simple manner, and to provide training for hearing function rehabilitation of hearing loss people. In particular, the present invention is designed to provide long-term hearing rehabilitation services at a low cost even if the elderly deaf people in areas with poor mobility or poor access to rehabilitation centers do not visit the rehabilitation centers.

In addition, the present invention was designed to provide a personalized rehabilitation service by analyzing the characteristics of the individual with hearing loss, and to be able to easily adjust the set value of the hearing aid in response to the hearing ability status of the hearing loss periodically.

An electronic device for providing auditory rehabilitation training according to an embodiment of the present invention may include a storage unit for storing training result information and auditory rehabilitation content of a user, and executing a training problem to be provided to a user based on the auditory rehabilitation content of the user. A rehabilitation content execution unit; a display unit for providing a visual element of the auditory rehabilitation content to a user, an audio module for providing a sound of the auditory rehabilitation content, and input response information of the user according to the provision of the auditory rehabilitation content; It may include a receiving input unit.

In the hearing function training method according to an embodiment of the present invention, the step of executing an application that provides a problem for training the hearing function, requesting user personal information input, and presenting a self-diagnostic question and a hearing function test question, Determining whether the user is deaf based on the response to the personal information, self-diagnostic question and auditory function test question, if it is determined that the user is deaf, provide a rehabilitation training problem, the user's answer score and wrong answer type The method may include changing the difficulty and problem type of the problem to be additionally provided, and providing result information about the examination question and the rehabilitation problem according to a user's request.

Various embodiments of the present invention have the effect of enabling the analysis of results for hearing loss self-diagnosis, hearing rehabilitation and hearing aid control in one program.

In addition, various embodiments of the present invention has the effect of allowing hearing loss people to receive hearing rehabilitation at a low cost even without a continuous visit to the rehabilitation center.

In addition, various embodiments of the present invention have different effects of training intensity and type according to the hearing ability of the patient, thereby having the effect of receiving personalized training.

In addition, various embodiments of the present invention has the effect of precisely adjusting the set value of the hearing aid based on the hearing rehabilitation results.

1 is a block diagram showing the components of the auditory function training apparatus according to an embodiment of the present invention.
2 is a diagram illustrating a configuration of a rehabilitation content execution unit 162 according to an embodiment of the present invention.
Figure 3 is a flow chart showing the sequence of the overall operation of the auditory function training apparatus according to an embodiment of the present invention.
4 is a diagram illustrating a procedure of providing a user personalized problem in an auditory training apparatus according to an embodiment of the present invention.
5A to 5C are diagrams illustrating an operation of an application for hearing function rehabilitation according to an embodiment of the present invention.
6A to 6B illustrate screens on which information on an inspection and training result is displayed according to an exemplary embodiment of the present invention.
7 is an exemplary diagram of a screen for managing a user's rehabilitation organ and hearing aid information in an application according to an embodiment of the present invention.
8 is a diagram illustrating a new content generation operation according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. The detailed description, which will be given below with reference to the accompanying drawings, is intended to explain exemplary embodiments of the present invention and is not intended to represent the only embodiments in which the present invention may be practiced.

The present embodiments are merely provided to complete the disclosure of the present invention and to fully inform the scope of the invention to those skilled in the art, and the present invention is defined by the scope of the claims. It is only.

In some instances, well-known structures and devices may be omitted or shown in block diagram form centering on the core functions of the structures and devices in order to avoid obscuring the concepts of the present invention. In addition, the same components will be described with the same reference numerals throughout the present specification.

Throughout the specification, when a part is said to "comprising" (or including) a component, this means that it may further include other components, except to exclude other components unless specifically stated otherwise. do.

In addition, the term "… unit" described in the specification means a unit for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software. Furthermore, "a" or "an", "one", and the like shall be, in the context of describing the present invention, both singular and plural unless the context clearly dictates otherwise or is clearly contradicted by the context. It can be used as a meaning including.

In addition, specific terms used in the embodiments of the present invention are provided to aid the understanding of the present invention, and unless otherwise defined, all terms used herein, including technical or scientific terms, are used to describe the present invention. It has the same meaning as commonly understood by one of ordinary skill in the art. Use of this specific terminology may be modified in other forms without departing from the spirit of the invention.

An electronic device according to various embodiments of the present disclosure may include, for example, a smartphone, a tablet personal computer, a mobile phone, a video phone, and an e-book reader. , Desktop personal computer, laptop personal computer, netbook computer, workstation, server, personal digital assistant, portable multimedia player, MP3 player, mobile It may include at least one of a medical device, a camera, or a wearable device. According to various embodiments, wearable devices may be accessory (eg, watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted-devices (HMDs)), textiles, or clothing one-pieces ( For example, it may include at least one of an electronic garment, a body attachment type (eg, a skin pad or a tattoo), or a living body implantable type (eg, an implantable circuit).

In some embodiments, the electronic device may be a home appliance. Home appliances are, for example, televisions, digital video disk (DVD) players, audio, refrigerators, air conditioners, vacuum cleaners, ovens, microwaves, washing machines, air purifiers, set-top boxes, home automation controls The panel may include at least one of a home automation control panel, a security control panel, a TV box, a game console, an electronic dictionary, an electronic key, and a camcorder.

In another embodiment, the electronic device may include a variety of medical devices (e.g., various portable medical measuring devices such as blood glucose meters, heart rate monitors, blood pressure meters, or body temperature meters), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), Such as computed tomography (CT), imaging or ultrasound), navigation devices, global navigation satellite system (GNSS), event data recorder (EDR), flight data recorder (FDR), automotive infotainment ) Devices, marine electronic equipment (e.g. marine navigation systems, gyro compasses, etc.), avionics, security devices, vehicle head units, industrial or household robots, and automated teller's machines (financial institutions). , Point of sales, or Internet of things (e.g., light bulbs, sensors, electricity or gas meters, sprinkler devices, fire alarms, thermostats, street lights, Of the requester (toaster), exercise equipment, hot water tank, a heater, boiler, etc.) may include at least one.

According to some embodiments, an electronic device may be a piece of furniture or a building / structure, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, Water, electricity, gas, or radio wave measuring instrument). In various embodiments, the electronic device may be a combination of one or more of the aforementioned various devices. An electronic device according to an embodiment may be a flexible electronic device. In addition, the electronic device according to an embodiment of the present disclosure is not limited to the above-described devices, and may include a new electronic device according to technology development.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. In this document, the term user may refer to a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) that uses an electronic device.

Hereinafter, a terminal according to various embodiments of the present disclosure will be described with reference to the accompanying drawings. As used herein, the term user may refer to a person who uses a terminal or a device (eg, an artificial intelligence electronic device) that uses a terminal.

1 is a block diagram showing the components of the auditory function training apparatus according to an embodiment of the present invention.

One or more programs or applications may be installed in the auditory function training apparatus according to the embodiment of the present invention shown in FIG. 1, and in particular, whether or not hearing loss is performed through the auditory rehabilitation training program, which is an embodiment of the present invention. An application may be installed that includes an application program interface (API) or embedded software (Embaded Software) related to providing test content and auditory rehabilitation training content.

The auditory function training device may transmit or receive data or a signal to a server by itself or through the installed one or more programs or applications, wherein the transmitted or received data or signal is an auditory rehabilitation training content according to an embodiment of the present invention. And may be related thereto.

Examples of the hearing function training device include a personal computer (PC), a notebook computer, a tablet personal computer (PC), a terminal device, a terminal, a mobile station (MS), a mobile subscriber station (MSS), and a subscriber (SS). Station, Advanced Mobile Station (AMS), Wireless terminal (WT), Machine-Type Communication (MTC) device, Machine-to-Machine (M2M) device, Device-to-Device (D2D device) device .

Of course, this is only an example, and the auditory function training apparatus in the present invention should be interpreted as a concept including all devices capable of transmitting data or signals that are currently developed and commercialized or will be developed in addition to the above examples.

Although not shown in the figure, the auditory function training device may communicate with a server. The server refers to an object capable of transmitting and receiving data with at least one other device through a wired or wireless communication environment. The server may further include a relay server, an intermediate server, and / or a client server.

In addition, as an example of the server, a cloud server, an IP multimedia subsystem (IMS) server, a telephony application server, an instant messaging server, a media gateway control function server, a messaging gateway (MSG) It may include a server, a Call Session Control Function (CSCF) server, the server may be implemented as a device that refers to an object capable of transmitting and receiving data, such as a personal computer (PC), notebook computer, tablet PC (Tablet Personal Computer) It may be.

On the other hand, the auditory function training device and the communication network of the server of the present invention means a data communication network for data transmission and reception between the auditory function training device server, the type is not particularly limited.

For example, it may be an IP (Internet Protocol) network that provides a transmission / reception service of a large amount of data through the Internet Protocol (IP) or an All IP network integrating different IP networks.

The network may include a wired network, a wireless broadband network, a mobile communication network including WCDMA, a high speed downlink packet access (HSDPA) network, and a long term evolution (LTE) network, LTE advanced (LTE-A). ), Or one of a mobile communication network including 5G (Five Generation), a satellite communication network, and a Wi-Fi network, or a combination of at least one of them.

The auditory function training apparatus according to an embodiment of the present invention may include a communication unit 110, a storage unit 120, an input unit 130, a display unit 140, an audio module 150, and a controller 160. The storage unit 120 may store the result related information 121, the auditory rehabilitation content 122, and the rehabilitation history information 123. The control unit 160 may include a training step setting unit 161, a rehabilitation content execution unit 162, a result analysis unit 163, and a new content generation unit 164.

The communication unit 110 may include, for example, a cellular module, a WiFi module, a Bluetooth module, a GPS module (eg, a GPS module, a Glonass module, a Beidou module, or a Galileo module), an NFC module, and a radio frequency (RF) module.

The cellular module may provide, for example, a voice call, a video call, a text service, or an internet service through a communication network. According to an embodiment of the present disclosure, the cellular module may perform identification and authentication of an electronic device in a communication network using a subscriber identification module (eg, a SIM card). According to an embodiment of the present disclosure, the cellular module may perform at least some of the functions that the processor may provide. According to an embodiment, the cellular module may include a communication processor (CP).

Each of the WiFi module, the Bluetooth module, the GPS module, or the NFC module may include, for example, a processor for processing data transmitted and received through the corresponding module. According to some embodiments, at least some (eg, two or more) of the cellular module, WiFi module, Bluetooth module, GPS module, or NFC module may be included in one integrated chip (IC) or IC package.

The RF module may transmit / receive, for example, a communication signal (eg, an RF signal). The RF module may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), an antenna, or the like. According to another embodiment, at least one of the cellular module, the WiFi module, the Bluetooth module, the GPS module, or the NFC module may transmit and receive an RF signal through a separate RF module.

The communication unit 110 according to an embodiment of the present invention may perform communication with an external server (not shown). In this case, the external server may be, for example, a server for hearing loss rehabilitation clinic or a central server managing an auditory function training application. In addition, the communication unit 110 may communicate with other electronic devices. For example, the communication unit 110 may communicate with peripheral devices such as a Bluetooth speaker, a Bluetooth earphone, and a hearing aid.

In addition, the communication unit 110 according to an embodiment of the present invention may collect information from an external search server or the like using the Internet, and may receive update related data.

The storage unit 120 may include, for example, an internal memory or an external memory. The internal memory may be, for example, volatile memory (for example, dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM), etc.), non-volatile memory (for example, OTPROM (one). time programmable ROM (PROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (such as NAND flash or NOR flash), hard drives, Or it may include at least one of a solid state drive (SSD).

The external memory may be a flash drive such as compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (XD), It may further include a multi-media card (MMC) or a memory stick. The external memory may be functionally and / or physically connected to the electronic device through various interfaces.

The storage unit 120 according to an embodiment of the present invention may store the result related information 121 such as scores, graphs, statistics, etc. of the results of the auditory function test and the rehabilitation training. In this case, the result related information 121 may be classified and stored by ID and problem type. In addition, the storage unit 120 may store the auditory rehabilitation content 122. The auditory rehabilitation content 122 may be test content of various types (eg, multiple choice, multiple choice, etc.) for auditory rehabilitation. The auditory rehabilitation content 122 may include a problem of a method of testing or training a user's hearing ability by presenting items of a mixture of the same sound and different sounds and selecting different items among them. In addition, the auditory rehabilitation content 122 may include not only syllables and words but also sentences. The auditory rehabilitation content 122 may include a program related to a text to sound (TTS) function. According to various embodiments of the present disclosure, the auditory rehabilitation content 122 may include programs and data related to converting a voice input from a user into a text form.

The rehabilitation history information 123 may be stored by date and month. The rehabilitation history information 123 may also record and store time information on which the user performed rehabilitation training. Based on the stored information, the rehabilitation history information 123 may provide a rehabilitation training log so that the user can continuously perform the rehabilitation training that the user intended.

The information stored in the storage unit 120 may be transmitted to the server managing the application with the user's consent, and the server may provide the collected information to be viewed by a specialist in charge. That is, the hearing loss person and the rehabilitation expert may perform a conversation and counseling on an application for performing auditory function training according to an embodiment of the present invention installed in their mobile terminal.

The input unit 130 may include a key input unit, a touch panel, a sensor, and the like. The input unit 130 may receive a user's input and transfer the input information to the control unit 160 for processing. According to an embodiment of the present disclosure, the input unit 130 may receive an input signal when a user inputs a response to a subjective question and a multiple choice question for rehabilitation training. The input unit 130 may receive an input signal for input and change of user information and hearing aid setting information.

The display unit 140 may include a panel, a hologram device, or a projector. The panel may, for example, be implemented to be flexible, transparent, or wearable. The panel may be composed of a touch panel and one module. The hologram device may show a stereoscopic image in the air by using interference of light. The projector may display an image by projecting light onto a screen. The screen may be located, for example, inside or outside the electronic device. According to an embodiment, the display unit 140 may further include a control circuit for controlling a panel, a hologram device, or a projector. In addition, the display unit 140 may be integrally formed with the touch panel to be implemented in the form of a touch screen.

The display unit 140 according to an embodiment of the present invention may display a test problem and a training problem for auditory training. In addition, the display unit 140 may display information about a result of performing the test and auditory training and a result trend.

The audio module 150 may bidirectionally convert a sound and an electrical signal. The audio module 150 may process sound information input or output through a speaker, a receiver, earphones, or a microphone.

The audio module 150 according to an embodiment of the present invention may output sound information provided from the auditory function training device 100. Specifically, the audio module 150 according to an embodiment of the present invention may output the sound of auditory rehabilitation content through a speaker, and receive a user's voice through a microphone.

The controller 160 may also be referred to as a processor, a controller, a microcontroller, a microprocessor, a microcomputer, or the like. The controller 160 may be implemented by hardware or firmware, software, or a combination thereof.

In the case of implementation by firmware or software, an embodiment of the present invention may be implemented in the form of a module, procedure, function, etc. that performs the functions or operations described above. The software code may be stored in the storage 120 and driven by the controller 160.

The controller 160 may include a training step setting unit 161, a rehabilitation content execution unit 162, a result analysis unit 163, and a new content generation unit 164.

The training step setting unit 161 may set a training step in response to a difficulty setting selected by a user. In addition, the training step setting unit 161 may change the difficulty setting in response to the result after solving the problem for rehabilitation training for rehabilitation training. For example, as a result of the user solving the problem for rehabilitation training, the training step setting unit 161 may change to a training step in which a problem with high difficulty is provided when a score higher than a predetermined reference value is obtained. In addition, the training step setting unit 161 may control not to change to a lower training level or to change the difficulty level when the user acquires a score below a predetermined reference value as a result of solving the problem for rehabilitation training.

The rehabilitation content execution unit 162 may execute rehabilitation content based on the auditory rehabilitation content 122 stored in the storage unit. The rehabilitation content execution unit 162 may be configured to include an auditory competence test unit 1621, a speech training unit 1622, and a sentence training unit 1623. The rehabilitation content execution unit 162 may check the user's personal information and set an option corresponding to the user's personal information when the initial problem is presented, and may reflect the level of the question to be asked. For example, the rehabilitation content execution unit 162 may collect user personal information about a user's age group and interests, and correspondingly extract and execute a problem including a word or sentence of a subject of interest to the user. In addition, the rehabilitation content execution unit 162 may adjust the speed of the provided sound, and change the setting so as to slow down the speed of the sound as the age is higher in response to the age identified from the user personal information.

The result analyzer 163 may determine the score of the user acquired in response to the auditory ability test or the training problem provided by the rehabilitation content execution unit 162. The result analyzer 163 may analyze the incorrect information input by the user more than a predetermined number of times. For example, the result analyzer 163 may calculate a consonant of a wrong type with a frequent probability by the user. In addition, the result analyzer 163 may calculate information on a syllable relationship (eg, 'confidence of' I-Eui ',' confidence of 'A-Eh', etc.) that the user has a frequent probability.

The new content generator 164 may generate a new training problem and a hearing problem test problem.

The new content generation unit 164 may generate a problem including a syllable composed of a consonant having an incorrect probability of a predetermined error or higher when the training step is reset by the training step setting unit. For example, if it is determined that the probability of incorrect answers of '' 'and' '' is high, a word containing the consonant (eg, an apple, a platform, a towel, etc.) may be extracted and generated as a problem.

 The new content generation unit 164 may generate new content based on data such as a user's wrong answer type and a frequently used word calculated by the result analyzer 163. In addition, the new content generation unit 164 collects information such as words frequently used by the user based on the user's incorrect content, search box input word, text message input word, etc. calculated by the result analysis unit 163 and based on the new problem. Can be generated.

In addition, the new content generator 164 may determine a user's interest and generate a new problem based on the interest. At this time, the user's interest may be determined by combining the user's call contents, message contents, search terms, and the like. For example, if a search word frequently input by a user is words in a culinary field such as 'recipe', 'side dish', 'kind of vegetable side dish', the new content generation unit 164 may determine the user's interest as 'cooking'. . The new content generator 164 may generate a problem based on a theme, a word, or the like related to cooking. The types of interests classified by the new content generation unit 164 may be 'cooking', 'sports', 'politics', 'movie', 'travel', 'common sense', 'drama', 'book' and the like. According to various embodiments of the present disclosure, when the user's interest is a drama or a book, the new content generator 164 may generate a problem based on a dialogue of some scenes or sentences of a book content of some pages. have.

As such, the new content generation unit 164 may generate a problem based on the user's interest, improve the listening ability of the sentence that can be heard in real life, and induce the interest of the user in rehabilitation.

2 is a diagram illustrating a configuration of a rehabilitation content execution unit 162 according to an embodiment of the present invention.

The rehabilitation content execution unit 162 may include an auditory competence test unit 1621, a speech training unit 1622, and a sentence training unit 1623.

First, the hearing ability tester 1621 may control an operation for checking the hearing condition of the user before entering the rehabilitation training. First, the hearing ability tester 1621 may request the user for personal information such as age and gender of the user to be used for determining whether the deafness is aged. Also, the hearing ability checking unit 1621 may provide a user survey question to the user in order to obtain survey information to be used as data for determining whether the user is deaf or hard of hearing. In addition, the hearing ability checker 1621 may collect information about whether the user wears the hearing aid or the hearing aid setting value. The hearing ability inspection unit 1621 may also perform a simple test to determine whether or not hearing loss. The hearing ability tester 1621 may provide a result, such as a test, a questionnaire, etc., to the result analyzer 163 to determine whether hearing loss. Thereafter, the result analyzer 163 may determine whether the user is hard of hearing based on a result of the test performed by the hearing ability tester 1621.

The speech training unit 1622 and the sentence training unit 1623 may provide a problem for training a hearing function by a user determined to be deaf. First, the speech training unit 1622 may provide a syllable unit sound and a word unit sound. In this way, the speech training unit 1622 may improve the ability to distinguish between the syllable and the word unit.

The sentence training unit 1623 may provide a sentence unit sound. Through this, the sentence training unit 1623 may train the user to improve not only the sound component capturing ability but also the meaning inference of the whole sentence.

 In addition, the rehabilitation content execution unit 162 may support more various methods (providing problems with drama screens and sounds, providing problems by language (English, Japanese, etc.), providing problems with proverbs and idioms, etc.).

 Also, the rehabilitation content execution unit 162 may provide a matching / unmatching problem according to various embodiments. This may be a problem of the way of presenting a plurality of items and asking whether the sounds of the items presented are identical or inconsistent. In addition, the rehabilitation content execution unit 162 may provide a problem of a method of selecting a mismatched item among three or more viewing items.

In addition, the rehabilitation content execution unit 162 may present a subjective problem in a manner of providing a user with a sound of a specific word or sentence as a problem and requesting a dictation thereof. In this case, the user may perform typing, but since the elderly are not familiar with text typing, the rehabilitation content execution unit 162 may request to speak the words as they are heard. At this time, the user's voice received by the microphone is converted into text, and it is determined whether or not it matches the text provided as a problem.

Figure 3 is a flow chart showing the sequence of the overall operation of the auditory function training apparatus according to an embodiment of the present invention.

The controller 160 of the auditory function training apparatus according to an embodiment of the present invention may perform operation 301 for executing an application at the user's request. At this time, the application may perform a series of operations described in the present invention, such as providing rehabilitation content of the auditory function. When the application is executed, the controller 160 may perform operation 305 of providing a self-diagnostic question through the application. The self-diagnosis question may be provided as text, for example, 'are you having difficulty hearing the tap water?' And may be a question for obtaining information on hearing loss by the judgment of the user.

Thereafter, the controller 160 may perform operation 311 of executing a test (hearing test for hearing loss) for the hearing function. The operation 311 may be an operation of presenting an audible sound as well as a sound in the form of a sentence or a word. In operation 311, the controller 160 may determine whether the user is hard of hearing. When the operation 311 is performed, the user may adjust the volume of the provided sound to suit the user. The operations 305 and 311 are operations for determining whether the user is hearing loss, and may be executed in a different order.

Thereafter, the controller 160 may perform operation 315 for collecting results for operations 305 and 311. Thereafter, the controller 160 may perform operation 321 for executing a personalized rehabilitation problem in response to the individual test result extracted at 315. In this case, the difficulty level of the rehabilitation problem that is initially executed in operation 321 is selected based on at least one of user's selection information (selection of the user's difficulty), user's personal information (age, gender, etc.), self-diagnosis test, and auditory test result. Can be.

Thereafter, the controller 160 may perform operation 325 providing a result and a result trend on the rehabilitation problem.

4 is a diagram illustrating a procedure of providing a user personalized problem in an auditory training apparatus according to an embodiment of the present invention. FIG. 4 may illustrate the processes from operations 311 to 321 of FIG. 3 in detail.

Referring to FIG. 4, the controller 160 may perform operation 401 for executing an auditory examination. Thereafter, the controller 160 may perform operation 405 to determine whether a score equal to or greater than a predetermined reference result is obtained. Accordingly, the controller 160 may determine whether the user's hearing ability is normal. If the test score of the user acquired by the controller 160 is greater than or equal to a preset criterion, the controller 410 may determine that the hearing ability is normal, and the process may be terminated.

On the other hand, if the user's test score is less than or equal to a preset criterion, the controller 160 may perform operation 411 for determining the user as hearing loss. Thereafter, the controller 160 may provide a user with information on hearing loss determination on a screen or automatically display a rehabilitation treatment screen. In addition, according to various embodiments of the present disclosure, operations 401 and 415 for determining whether a hearing loss is performed from operation 401 for executing the auditory examination may be omitted later for the same user.

The controller 160 may check a request event for rehabilitation treatment from a user and start providing a problem for rehabilitation treatment. At this time, if the request for rehabilitation treatment is not received from the user, the controller 160 may end the operation. On the other hand, when the controller 160 is requested to execute the rehabilitation treatment from the user, the control unit 160 may perform operation 425 providing a problem for rehabilitation training. The problem for rehabilitation training, when initially provided, may be provided at a difficulty level set based on at least one of a user's hearing test test result, a self-test test result, and a user's personal information (eg, age).

Thereafter, the controller 160 may perform operation 431 for providing a user-specific rehabilitation problem of performing at least one of adjusting the difficulty level and changing the problem type based on the score and the wrong answer type for the rehabilitation training problem. For example, if the score for the user's rehabilitation training problem is more than a predetermined value (or if a score higher than a predetermined percentage higher than the average of the previous score of the user), the control unit 160 increases the difficulty to solve the more difficult problem Can present On the other hand, if the score for the user's rehabilitation training problem is less than a predetermined value, the controller 160 can present an easier problem by lowering the difficulty.

The controller 160 may perform operation 435 to confirm a request for terminating the rehabilitation process after operation 431. If the request for terminating the rehabilitation process is confirmed, the controller 160 may terminate the corresponding process. On the other hand, when the end of the rehabilitation process is not received, the controller 160 may continue to present a new training problem for which the training stage and difficulty level are changed based on the score and the wrong answer type of the user's training problem.

5A to 5C are diagrams illustrating an operation of an application for hearing function rehabilitation according to an embodiment of the present invention.

5A illustrates a screen for inputting member information into an application for rehabilitation of auditory function.

520 illustrates a self-diagnostic test question for hearing test and an answer view thereof according to an embodiment of the present invention. The user can select and submit an answer corresponding to the user while viewing the answer.

530 is a diagram illustrating a result of a self-diagnostic test according to an embodiment of the present invention.

540 of FIG. 5B illustrates a screen requesting that the volume be adjusted according to the hearing ability of the user. As shown on the screen 540, the auditory function training apparatus according to the embodiment of the present invention may enable the user to set a volume suitable for the hearing level before entering the rehabilitation training.

550 is a screen showing problem types by type to allow a user to select a type of training problem. As shown in 550, the user may select one of the various types of problems presented on the screen to enter rehabilitation training.

560 is a screen for allowing the application to select a difficulty level for rehabilitation training problems. The user can select a difficulty level suitable for his level on the screen as presented at 560.

570 of FIG. 5C shows a screen on which multiple-choice type training questions are presented. In the 570, three sound items are provided, and the first sound item is currently being played. In addition, the type of problem presented at 570 may be to select a check mark when all three items match, and to select 'X' when any of the three sound items do not match. The multiple choice type is not limited thereto. If the difficulty is increased, the sound item may be increased, and when a different kind of sound is presented, a method of asking which item is a different kind of sound may be added.

580 presents the behavior in which the short answer type problem is executed. Looking at the screen presented in step 580, the user may be induced to check the sound provided by the application and write it down as text. When the user inputs the content heard in the content input box, the controller 160 may determine whether the received answer text corresponds to the content spoken by the user and check whether the correct answer is received.

590 is a result providing screen for checking information about a user's test and training results. On the screen provided with 590, the user can select and check a hearing test result, a rehabilitation training result, and an error pattern result. The hearing test result is data that can be displayed, for example, whether or not hearing loss, the state of hearing function, and the like, and the rehabilitation training result may relate to a score for a user's rehabilitation training problem and a graph of a change in score. The error pattern result may include information about frequently incorrect syllable relationships, incorrect answer words, and the like.

6A to 6B illustrate screens on which information on a test and training result is displayed according to an exemplary embodiment of the present invention.

First, 6a shows a screen of a hearing test result. 6A of 610 of FIG. 6A provides a screen for uploading a photograph of a photographed data of an offline rehabilitation clinic in addition to an inspection using an application.

620 illustrates a screen for displaying data of a result of the hearing test using the application and a result trend. As the number of inspections increases, the number of data on the graph shown on the screen 620 may increase.

630 of FIG. 6B shows the results of the rehabilitation training. The information displayed in the rehabilitation training result may be, for example, training period, problem type, score, and performance change trend by problem type.

640 and 650 are screens related to displaying data on error pattern analysis. First, 640 is a screen for allowing a user to select a problem type to view. The user can select the type of problem he wishes to view.

650 is a screen displaying information on an error pattern corresponding to a specific problem type selected by the user. For example, the error pattern information may provide information about a consonant that a user frequently misses, as shown at 650.

7 is an exemplary diagram of a screen for managing a user's rehabilitation organ and hearing aid information in an application according to an embodiment of the present invention.

710 illustrates that an application according to an embodiment of the present disclosure enables a user to input rehabilitation related information, and the rehabilitation related information may include 'institution information' and 'hearing aid information' items.

720 may input information about a rehabilitation institution that the user is attending. Information on the rehabilitation institution input to the 720 is to be automatically transmitted later to the rehabilitation records and inquiries of the user and can provide feedback of the rehabilitation agency side through the application according to an embodiment of the present invention.

730 illustrates a screen for inputting hearing aid information used by a user. On the screen shown in 730, the presence and absence of hearing aid wearing, when wearing the hearing aid, the manufacturer and model name of the hearing aid is being input. However, the present invention is not limited thereto, and according to various embodiments of the present disclosure, an item (eg, information for wireless communication with a hearing aid and a hearing aid) may be used in the 730 to automatically change a setting value of the hearing aid through interworking with an application. Setting value information, etc.) may be further added.

8 is a diagram illustrating a new content generation operation according to an embodiment of the present invention.

The new content generating unit 164 according to an embodiment of the present invention may include a matching unit 800. The matching unit 800 may generate a new problem according to a result of self matching the information stored in the storage unit 120 (result related information 121 and user interest information, etc.).

For example, the matching unit 800 may perform stepwise matching (eg, step 1 matching and step 2 matching). In this case, the first stage matching may be an operation for generating a problem having a higher difficulty level than the second stage matching. Or the first stage matching is a problem generation operation for the user of the early stage of rehabilitation training (eg, the user within 10 days of training), and the second stage matching is for the user of the middle stage of the rehabilitation training (eg, after 10 days of training) It may be a problem generation operation.

The first step matching operation may be an operation of matching a first priority wrong item that is most frequently incorrect among a first priority interest item and an incorrect answer type determined to have the highest interest among user interest areas. For example, if the user's first priority item is 'cooking' and the user's first priority type is 'B', 'B', the new content generation unit 164 according to the first level matching performed by the matching unit 800, Words related to cooking that contain both "a" and "b" (e.g. scale, military, etc.) or words containing at least one of "a" and "b" (e.g., scissors, ladle, pesticide) Etc.) as a problem.

The problem generated by the first stage matching operation is trained around words that are likely to be used by the user in real life, thereby improving the communication ability in the user's real life.

Meanwhile, the second stage matching operation may be a problem generation in a more upgraded manner than the first stage matching operation, and the second stage matching operation may include a lower priority (eg, 10 rank) item and incorrect answer types among user interest items. It may be an operation of matching the first priority wrong answer type of the user most frequently wrong type. For example, if the user's tenth priority item is 'machine' and the user's first priority type is 'ㄱ, ㄴ', the new content generating unit 164 may select ㄱ, ㄴ among words related to the machine. You can create words that contain all of them (e.g., functionality, containment, scale, likelihood, durability, etc.) or words that contain at least one of 'a' and 'b' (e.g. mobility, orbit, screw, etc.) have.

The problem generated by the second-stage matching operation may prevent a user from correcting a correct answer only by analogy ability, without relying on auditory ability, as a term of a field in which the user is not interested as a problem. Accordingly, the problem generated by the second step matching operation allows the user to be trained to correctly recognize the word based on his / her hearing ability even if the word is unknown.

The user's interest item information (including ranking information of interest) and incorrect answer type information (including ranking information of wrong answer type) used in generating a problem in the new content generation unit 164 may be information loaded from the storage unit 120. The interest item information and the incorrect answer type information may be information calculated by a result analysis operation of the result analyzer 163, according to an exemplary embodiment. However, the present invention is not limited thereto and according to various embodiments of the present disclosure, information previously stored in the storage unit 120 utilized by the new content generation unit 164 may be data input by a user or may be data previously stored by an operator. .

In addition, the embodiments of the present invention disclosed in the specification and the drawings merely present specific examples to easily explain the technical contents according to the embodiments of the present invention and to help the understanding of the embodiments of the present invention. It is not intended to be limiting. Therefore, the scope of various embodiments of the present invention should be construed that all changes or modifications derived based on the technical spirit of the various embodiments of the present invention in addition to the embodiments disclosed herein are included in the scope of the various embodiments of the present invention. .

100: auditory function training device
110: communication unit
120: storage unit
130: input unit
140: display unit
150: audio module
160: control unit
161: training step setting unit
162: rehabilitation content execution unit
163: result analysis unit
164: new content generation unit

Claims (10)

An electronic device for providing auditory rehabilitation training,
A storage unit for storing training result information and auditory rehabilitation content of the user;
A controller for executing a training problem to be provided to a user based on the auditory rehabilitation content of the user;
A display unit for providing a visual element of the auditory rehabilitation content to a user;
An audio module for providing sound of the auditory rehabilitation content; And
And an input unit configured to receive response information of a user according to the provision of the auditory rehabilitation content.
The control unit
A result analysis unit for calculating a user's score and an incorrect type of answer based on a user's answer to a training problem, and calculating a consonant that shows a probability of incorrectly answering a user's preset threshold; and
Creates a new problem for a word containing a syllable consisting of consonants that show a probability of incorrect answer above a preset threshold, a word that the user incorrectly answers more than a preset number of times, a word that the user enters into the search box, and a text message by the user And a new content generation unit for extracting a region of interest from a word set composed of words frequently input in the and generating a new problem with a word related to the region of interest.
The new content generation unit
And a matching unit generating a new problem by matching the interest area of the user with the wrong answer type step by step.
The step matching
A first matching operation that matches the highest priority wrong answer type among the highest priority interest areas and wrong answer types among the user's interest areas, and the most frequently incorrect wrong among the subordinate interest areas and wrong answer types among the user's interest areas. Auditory function training device comprising a second matching operation to match the type of ranking incorrect. The method of claim 1,
The control unit
Includes a rehabilitation content execution unit for classifying and executing the auditory rehabilitation content according to a problem type,
The rehabilitation content execution unit
An auditory competence tester which extracts and executes a problem for determining whether an auditory ability is abnormal;
A speech training unit for presenting a syllable or word sound including at least one syllable, and executing a type of problem of selecting whether the presented sounds match or are inconsistent among the sounds; And
And a sentence training unit for executing a type of problem of presenting a sound in a sentence and inputting the sentence. delete The method of claim 1,
The control unit
And a training step setting unit for resetting a training step by changing a difficulty level and a type of a problem to be executed based on the user score and an incorrect answer type when the user score calculated by the result analyzer is outside a preset range. Auditory function training device. The method of claim 1,
The new content generation unit
Auditory function training device, characterized in that when creating a new problem by changing the difficulty of the training phase up, add a view item, and generates a new problem to include a word based on the syllable relationship existing in the incorrect answer history. delete The method of claim 1,
The new content generation unit
Collecting the call voice of the user, extracting frequently used words and sentences from the call voice, determining the user's interests based on the words and sentences,
Auditory function training device, characterized in that for generating a problem comprising a sentence and a word based on the user's interests in response to a user request. delete In the auditory function training method,
Executing an application that provides a problem for training auditory function;
Requesting user personal information input and presenting a self-diagnostic question and an auditory function test question;
Determining whether the user has a hearing loss based on a response to the personal information, the self-diagnostic question, and the hearing function test question;
If it is determined that the user is deaf, providing a problem for rehabilitation training;
Analyzing a user's answer score and a wrong answer type for the rehabilitation training problem;
Adjusting the difficulty level of the question to be answered based on the answer score, and adjusting the difficulty level if the answer score is equal to or greater than a preset reference value;
Creating a new problem of adjusted difficulty;
Providing the new problem; And
Providing the result information on the examination questions and rehabilitation problems in accordance with the user request;
The step of creating a new problem
Calculating a user's score and an incorrect type of answer based on the user's answer to the training problem, and calculating a consonant that shows a probability of incorrectly answering a user's preset reference value or more;
Extracting a region of interest from a word set including a word inputted incorrectly by a user more than a preset number of times, a word input by a user in a search box, and a word frequently input by a user in a text message;
A concern-based problem generation step of generating a new problem with a word related to the region of interest;
The interest-based problem generation step,
And a matching-based generation step of generating a new problem by matching the interest area of the user with the wrong answer type step by step.
The step matching
A first matching operation that matches the highest priority wrong answer type among the highest priority interest areas and wrong answer types among the user's interest areas, and the most frequently incorrect wrong among the subordinate interest areas and wrong answer types among the user's interest areas. Auditory function training method comprising a second matching operation to match a ranking incorrect answer type. A system comprising an auditory function training device and a server,
The auditory function training device
A storage unit for storing training result information and auditory rehabilitation content of the user;
A control unit which executes an application for performing auditory function training, and executes an auditory function training problem based on the auditory rehabilitation content of a user using the application;
A display unit for providing a visual element of the auditory rehabilitation content to a user;
An audio module for providing sound of the auditory rehabilitation content; And
And an input unit configured to receive response information of a user according to the provision of the auditory rehabilitation content.
The control unit
A result analysis unit for calculating a user's score and an incorrect type of answer based on a user's answer to a training problem, and calculating a consonant that shows a probability of incorrectly answering a user's preset threshold; and
Creates a new problem for a word containing a syllable consisting of consonants that show a probability of incorrect answer above a preset threshold, a word that the user incorrectly answers more than a preset number of times, a word that the user enters into the search box, and a text message by the user And a new content generation unit for extracting a region of interest from a word set composed of words frequently input in the and generating a new problem with a word related to the region of interest.
The new content generation unit
And a matching unit generating a new problem by matching the interest area of the user with the wrong answer type step by step.
The step matching
A first matching operation that matches the highest priority wrong answer type among the highest priority interest areas and wrong answer types among the user's interest areas, and the most frequently incorrect wrong among the subordinate interest areas and wrong answer types among the user's interest areas. A second matching operation that matches the rank incorrect type;
The server is
The auditory function training system, which provides data required for driving and updating an application installed in the auditory function training device, collects the result related information of the user and transmits the result related information to a specialist in charge.

Images