KR102520761B1 - System for training of listening ability for hard of hearing patient - Google Patents

Abstract

Provided is an auditory training system that provides customized auditory training to a patient wearing a hearing aid so that the patient can perform a hearing rehabilitation program through auditory training without visiting a hospital. The auditory training system can increase the efficiency of training by providing customized auditory training to the patient according to the contents of previous auditory training and areas of interest of the patient.

Description

Hearing ability training system for hard of hearing patients {System for training of listening ability for hard of hearing patient}

The present invention relates to an auditory training system for a hearing-impaired patient, and more particularly, to a hearing-impaired patient wearing a hearing aid such as a cochlear implant.

The most important purpose of auditory rehabilitation for patients with hearing loss is to compensate for the perception of distorted sound through damaged auditory organs and to improve communication skills in daily life by minimizing the difficulties that may arise from hearing impairment.

For successful hearing training, an accurate evaluation of the degree, type, and form of hearing loss must first be made. Auditory training should follow. In particular, in order to make the most of the residual hearing of patients with hearing loss, it is necessary to systematically improve the hearing ability through appropriately amplified and precisely controlled hearing aids.

Conventionally, a hearing rehabilitation program in which a patient wearing a hearing aid periodically visits a hospital and performs hearing training for a long time has been in progress.

However, there is a problem in that it is difficult for an elderly person or a hearing-impaired patient who is difficult to move or a hearing-impaired patient who is far from the hospital to visit the hospital directly, so hearing rehabilitation through hearing training is not smooth.

In addition, since the existing auditory training is performed according to pre-determined training contents, the patient's rehabilitation concentration is reduced, and the progress or result of the patient's auditory training is recorded and stored by hand, resulting in data loss and management. It was difficult.

KR Registration Patent Publication No. 10-1984991 (May 27, 2019)

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and an object of the present invention is to provide an auditory training system in which a patient can perform customized auditory skills training without visiting a hospital.

The auditory training system of the present invention can provide customized auditory training to a user wearing a cochlear implant.

This auditory training system includes a control unit that generates training problems for auditory training of a user from a plurality of training data and evaluates auditory training results from answers fed back from the user; a conversion unit that converts the training problems into audio signals and video signals and outputs them, and converts the user's feedbacked answers into electrical signals and transmits them to the control unit; and an input/output unit that outputs the converted audio signal and video signal to the user and receives the feedback response from the user. A recording and analysis unit for extracting, a user information storage unit storing user authentication information, user device authentication information, and user interest field information, a training information storage unit storing the plurality of training data and user training result data, and the conversion unit and a training evaluation unit that evaluates a user's auditory ability training result by comparing similarity between the converted feedback data and training data corresponding to the training problem among the plurality of training data. It can be achieved by generating the training problem using at least one of words and sentences, and generating the training problem from the plurality of training data based on at least one of the user interest field information and the user training result data. there is.

According to the auditory training system according to the present invention, even if a patient does not visit a hospital, he or she can perform a hearing rehabilitation program through auditory training.

In addition, the present invention provides auditory ability training through training problems with an adjusted level of difficulty to the patient, repeatedly provides auditory training according to the patient's training results, or provides auditory training through training problems related to the patient's field of interest. , the efficiency of training can be increased by increasing the concentration and immersion of the patient's auditory training.

In addition, the present invention can provide auditory training, cognitive training, and vocalization training to infants or congenital hearing loss patients in addition to patients with acquired hearing loss so that a rehabilitation program can be performed.

1A to 1C are diagrams illustrating an example of a hearing aid worn by a hearing impaired patient.
2 is a diagram showing the configuration of an auditory training system according to an embodiment of the present invention.
3 is a diagram showing a hearing ability training method according to an embodiment of the present invention.
FIG. 4 is a diagram specifically illustrating a step of generating problems for auditory ability training in FIG. 3 .
FIG. 5 is a diagram specifically illustrating a step of evaluating auditory ability training according to the user's answer in FIG. 3 .
6 is a diagram showing an implementation example of the auditory ability training apparatus of the present invention.

Hereinafter, the configuration and operation of embodiments of the present invention will be described with reference to the accompanying drawings.

It should be noted that the same reference numerals and symbols refer to the same components in the drawings as much as possible, even if they are displayed on different drawings. In the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. In addition, when a part "includes" a certain component, it means that it may further include other components without excluding other components unless otherwise stated.

In addition, the terms or words used in this specification and claims should not be interpreted in a conventional and dictionary sense, and the inventors can properly define the concept of the term in order to explain their invention in the best way. Based on the principle, it should be interpreted as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in this specification and the configurations shown in the drawings are only preferred embodiments of the present invention, and do not represent all of the technical spirit of the present invention, so various equivalents that can replace them at the time of the present application. And there may be variations, and the scope of the present invention is not limited to the embodiments described below.

1A to 1C are diagrams illustrating an example of a hearing aid worn by a hearing impaired patient.

Referring to the drawings, a hearing aid device, for example, a cochlear implant 10, is attached to the user's body and converts externally collected sounds, for example, voice, into an electrical stimulation signal to generate an acoustic nerve of the cochlea (cochlea, 5). can be forwarded to The cochlear implant device 10 may include a body 20 , an external coil 30 , an internal coil 40 , a conversion unit 50 and an electrode unit 60 .

The body 20 and the external coil 30 may be disposed outside the user's body. The internal coil 40, the conversion unit 50, and the electrode unit 60 may be disposed inside the user's body. Here, the outer coil 30 and the inner coil 40 may be disposed adjacent to each other.

The main body 20 may be coupled in a form surrounding a part of the user's ear through the ear guide 21 formed at the upper end. The main body 20 may include a receiver 23 that receives external sound, a voice processor 25 that converts the received sound into an electrical signal, and a control unit 27 that adjusts the volume of the received sound. .

The external coil 30 may be connected to the body 20 and transmit electrical signals provided from the body 20 to the inside of the body, for example, the internal coil 40 .

The external coil 30 may be formed in a structure that closely adheres to or is attached to the skin 1 between the user's ear and head. The outer coil 30 may be formed in a shape surrounding the ear to increase attachment stability.

The outer coil 30 includes a metal coil inside, and an outer shell of a polymer material having elasticity and flexibility may be formed to surround the coil in order to prevent the coil from contacting the skin.

The internal coil 40, the conversion unit 50, and the electrode unit 60 may be implanted inside the skin 1 and disposed inside the body.

Here, the internal coil 40 is preferably implanted inside the skin 1 adjacent to the external coil 30 for smooth electrical signal transmission from the external coil 30 . In addition, the conversion unit 50 may be implanted and placed in a part of the bone tissue 3 cut between the muscle 2 and the bone tissue 3 on the inside of the skin 1. The electrode unit 60 may be disposed to penetrate the bone tissue 3 from the conversion unit 50 and be inserted into the cochlea 5 of the inner ear.

The inner coil 40 may transfer the electric signal transmitted from the outer coil 30 to the conversion unit 50 . The internal coil 40 may be combined with the conversion unit 50 or may be separated. When the internal coil 40 and the conversion unit 50 are separated, the internal coil 40 and the conversion unit 50 may be electrically connected by a conductive wire (not shown).

The conversion unit 50 may convert the electrical signal transmitted from the internal coil 40 into an electrical stimulation signal. The converted electrical stimulation signal may be output through the electrode unit 60 to stimulate the auditory nerve of the cochlea 5 .

Meanwhile, although not shown in the drawings, the cochlear implant device 10 may further include a communication unit (not shown) capable of communicating with an auditory training system (100 in FIG. 2) or an external server (200 in FIG. 2) to be described later. can Accordingly, the cochlear implant device 10 may transmit/receive data with the auditory training system 100 or the external server 200 through wireless communication.

As described above, the cochlear implant 10 may operate as a hearing aid device that converts external sound into an electrical stimulation signal and stimulates the auditory nerve so that the user's brain can recognize external sound.

However, the sound perceived by the cerebrum by the cochlear implant device 10 is generally different from the sound perceived through the air conduction method. For this reason, a user wearing the cochlear implant 10 may not accurately recognize the meaning of sound according to the stimulus transmitted from the cochlear implant 10 to the brain. Therefore, auditory training is required to allow the user to accurately recognize the meaning of sound according to the stimulus provided through the cochlear implant 10 .

2 is a diagram showing the configuration of an auditory training system according to an embodiment of the present invention.

Referring to FIG. 2 , the auditory training system 100 of the present embodiment is designed to accurately distinguish external sounds recognized through the cochlear implant 10 by a user wearing a hearing assisting device, for example, a cochlear implant 10 . Hearing training can be provided for this purpose. The hearing training system 100 may be implemented in a user's electronic device, such as a computer, laptop, smart phone, tablet PC, and the like.

The auditory training system 100 may include a control unit 110, a conversion unit 120, an input/output unit 130, and a storage unit 140.

The control unit 110 may control auditory ability training of the user. For example, the control unit 110 may perform user authentication, provision of questions for auditory ability training, and evaluation of auditory training results. To this end, the control unit 110 may include a training control unit 111, a problem generator 112, an environmental noise generator 113, a training evaluation unit 114, and a communication unit 115.

The training control unit 111 may authenticate the user and the cochlear implant 10 of the user who desires auditory training. In addition, the training control unit 111 may control the operation of the problem generation unit 112 and the environmental noise generation unit 113 to be described later so that customized hearing training problems are provided to the user. In addition, the training control unit 111 may receive training problems from the external server 200 and provide them to the user or transmit auditory training results of the user while communicating with the external server 200 through the communication unit 115 .

The problem generation unit 112 may generate training problems for the user's hearing ability training and provide them to the user's cochlear implant 10 through the input/output unit 130 . The problem generator 112 extracts and provides a training problem reflecting the level of interest or training difficulty of the user from the storage unit 140 under the control of the training control unit 111, or from the external server 200 through the communication unit 115. Provided training problems can be provided.

In addition, the problem generating unit 112 may generate training problems using words or sentences that the user mainly uses in daily life for a certain period of time, for example, a day. To this end, the auditory ability training system 100 of this embodiment may further include a recording and analysis unit (not shown). The recording and analysis unit may record the user's voice, and analyze and extract words or sentences that the user mainly uses among the recorded voices for a predetermined period of time. The words or sentences extracted in this way are provided to the problem generating unit 112 and can be generated as training problems for the user's hearing ability training.

The environmental noise generation unit 113 may generate various environmental noises in the living environment according to the control of the training control unit 111 and provide them to the problem generation unit 112 . Accordingly, the problem generating unit 112 may provide a training problem including environmental noise to the user.

The training evaluation unit 114 may evaluate training performance by analyzing feedback answers of training problems provided from the user and deriving auditory training results according to the analysis results. The training evaluation unit 114 compares and analyzes the training problems provided by the problem generating unit 112 and the user's feedback answers to determine the sameness, thereby deriving a training result.

The communication unit 115 may transmit/receive data by communicating with the external server 200 or the cochlear implant device 10 of the user. The communication unit 115 may transmit and receive data through a wireless communication method such as wireless Internet, Bluetooth, or ZigBee.

The conversion unit 120 may include a voice conversion unit 121 and an image conversion unit 122.

The voice conversion unit 121 can convert signals and voices in both directions. The voice conversion unit 121 may convert the training problem generated by the problem generation unit 112 of the control unit 110 into a sound, that is, a voice signal, and transmit it to the input/output unit 130 . In addition, the voice conversion unit 121 may convert the user's voice transmitted from the input/output unit 130, that is, a feedback answer into an electrical signal and transmit it to the training evaluation unit 114 of the control unit 110.

That is, the voice conversion unit 121 converts the training problem in the form of an electrical signal into voice and provides it to the user, and converts the user's voice into data in the form of an electrical signal and provides it to the control unit 110. there is.

When the training problem generated by the problem generator 112 includes an image or an image, the image conversion unit 122 may convert it into an image signal and transmit it to the input/output unit 130 . At this time, the video conversion unit 122 may convert the video signal so that the synchronization of the audio and video of the training problem coincides. In addition, the image conversion unit 122 may convert a training problem image or image into a 3D image and provide it to the user through the input/output unit 130 .

The input/output unit 130 may provide audio and video provided by the conversion unit 120 to the user, and provide audio provided from the user to the conversion unit 120 . The input/output unit 130 may include an audio output unit 131, an image output unit 132, and a feedback input unit 133.

The voice output unit 131 may output the training problem in the form of a voice signal provided by the voice conversion unit 121 to the user. Accordingly, the user may receive the audio signal of the training problem through the cochlear implant device 10 . The audio output unit 131 may be composed of a speaker or the like.

The video output unit 132 may output training problems in the form of video signals provided by the video conversion unit 122 to the user. Accordingly, the user can recognize the image signal of the training problem through the eyes. The image output unit 132 may be configured as a display unit (not shown) provided in the hearing training system 100 .

Here, since the audio signal and the video signal of the training problem are synchronized, the user receives the image of the training problem through the eyes at the same time as the auditory nerve stimulation of the training problem through the cochlear implant device 10 .

The feedback input unit 133 may collect and provide to the conversion unit 120 when the user gives an answer to the training problem. The feedback input unit 133 may be composed of a microphone or the like.

The storage unit 140 may include a user information storage unit 141 and a training information storage unit 142 . The previously described control unit 110 may extract user information or training information from the storage unit 140 to authenticate the user or create training problems.

The user information storage unit 141 may store user personal authentication information and device authentication information of the user cochlear implant 10 . In addition, the user information storage unit 141 may store interest field information for each user.

A plurality of training data for auditory ability training of the user may be stored in the training information storage unit 142 . Training data may be classified and stored according to training difficulty. For example, the training data may include basic difficulty training data composed of single words such as "a", "b", and "c", and the highest difficulty training data composed of a plurality of sentences. there is.

In addition, training result data for each user may be stored in the training information storage unit 142 . The training result data for each user may include a difficulty level of auditory training, a training result, an evaluation score, and the like. Training result data for each user may be recorded and stored for each number of auditory training sessions.

As described above, the hearing training system 100 of the present embodiment provides training problems for hearing training to the user wearing the cochlear implant 10, and accordingly analyzes the user's hearing ability from the answers fed back from the user. can be judged by

The auditory training system 100 may be installed and configured in the form of a program or application in an electronic device possessed by a user. Therefore, the user can perform auditory training without visiting a distant hospital, thereby increasing training efficiency.

3 is a diagram showing a hearing ability training method according to an embodiment of the present invention.

Referring to FIG. 3 , first, the auditory training system 100 can authenticate a user who wants to do auditory training and a hearing aid device, that is, a cochlear implant 10 that the user is wearing (S10).

Specifically, the training control unit 111 of the auditory training system 100 authenticates the user by determining whether personal information such as ID and password input from the user matches the user's personal authentication information stored in the user information storage unit 141. can do.

In addition, the training control unit 111 determines whether the information transmitted from the cochlear implant 10 through the communication unit 115 matches the user device authentication information stored in the user information storage unit 141, so that the user's cochlear implant 10 ) can be verified.

In this way, the hearing training system 100 authenticates the user and the user's cochlear implant 10 through the training controller 111, so that customized auditory training can be provided to the authorized user. Here, user authentication and user device authentication may be performed simultaneously.

Subsequently, after authentication of the user and the user device is completed, the training control unit 111 may set the cochlear implant 10 of the authenticated user to training set values, for example, values for auditory ability training (S20).

Here, since the purpose of the hearing training system 100 is to improve the user's hearing ability, the training control unit 111 increases or decreases the volume of the voice received by the cochlear implant device 10 by 5 to 10% compared to usual. The cochlear implant device 10 may be set up so as to be suitable.

The training control unit 111 transmits control data through the communication unit 115 so that the setup automatically proceeds, or guides the user to proceed with the volume control through the display unit of the auditory training system 100 so that the setup proceeds. can

Subsequently, the control unit 110 of the auditory ability training system 100 may generate training problems for the user's auditory ability training and output them to the user (S30).

The problem generating unit 112 of the control unit 110 generates a training problem by extracting at least one data suitable for the level of the user from among a plurality of training data stored in the storage unit 140 under the control of the training control unit 111. can do.

In addition, the problem generator 112 generates training problems from training data provided from the external server 200 through the communication unit 115, or uses words or sentences that are mainly used by the user for a certain period of time. can create

FIG. 4 is a diagram specifically illustrating a step of generating problems for auditory ability training in FIG. 3 .

Referring to FIGS. 3 and 4 , the training control unit 111 may check previous auditory training contents of the user stored in the training information storage unit 142 of the storage unit 140, such as training difficulty, training results, evaluation scores, and the like. Yes (S31).

Subsequently, the problem generator 112 may extract at least one training data suitable for the user from among a plurality of training data stored in the training information storage unit 142 of the storage unit 140 (S32).

Subsequently, the training control unit 111 may determine the suitability of the training data extracted from the problem generating unit 112 (S33).

At this time, the training control unit 111 may determine suitability according to the difficulty level of the extracted training data based on the user's previously confirmed training results, whether or not the user's field of interest, and the like.

Here, the level of difficulty of the training data may be determined based on previously confirmed user's auditory ability training contents. In addition, whether or not the user's field of interest may be determined by checking user interest information stored in the user information storage unit 141 of the storage unit 140 .

If it is determined that the extracted training data is inappropriate (N), the training control unit 111 may cause the problem generating unit 112 to re-extract the training data (S32). Subsequently, suitability determination of the re-extracted training data may be performed again (S33).

On the other hand, if it is determined that the extracted training data is suitable (Y), the problem generator 112 may generate a training problem from the training data (S34).

In this case, the training control unit 111 may allow the environmental noise generation unit 113 to generate various environmental noises, sounds from TV or telephone, noises from people around, noises from cars or construction sites, and the like. In addition, the generated environmental noise may be provided to the problem generator 112 so that the environmental noise is included in the training problem.

In this way, generating environmental noise and including it in the training problem may be performed according to a pre-determined difficulty level of auditory ability training or under the control of the training control unit 111 at the user's request.

Next, the problem generator 112 transmits the generated training problem to the conversion unit 120, and the conversion unit 120 converts it into audio and video signals and outputs it (S35).

The voice conversion unit 121 of the conversion unit 120 may convert the voice data of the training problem into a voice signal of a predetermined level. Subsequently, the audio output unit 131 of the input/output unit 130 outputs the converted audio signal to the outside so that the user's cochlear implant 10 can receive it.

In addition, the image conversion unit 122 of the conversion unit 120 may convert the image data of the training problem into a 2D or 3D image signal. Subsequently, the video output unit 132 of the input/output unit 130 may output the converted video signal so that the user can recognize it.

Referring back to FIG. 3 , after training problems for auditory ability training are provided to the user in the auditory training system 100, the user can perform auditory training through the training problem and provide feedback based on the answer.

For example, when a voice signal of “apple” is provided to the user as a training problem, the user may receive and recognize the voice signal through the cochlear implant 10 and then utter it again. The auditory training system 100 may receive a voice signal from the user as a feedback answer through the feedback input unit 133 of the input/output unit 130 .

Subsequently, the auditory training system 100 may evaluate whether the user correctly recognizes the training problem by analyzing the received user's feedback answer (S40).

FIG. 5 is a diagram specifically illustrating a step of evaluating auditory ability training according to the user's answer in FIG. 3 .

Referring to FIGS. 3 and 5 , the input/output unit 130 of the auditory training system 100 may receive a user's feedback answer and provide it to the conversion unit 120 . Subsequently, the voice conversion unit 121 of the conversion unit 120 may convert the user's feedback answer into a data signal in the form of an electrical signal (S41).

The voice conversion unit 121 provides the converted data to the training evaluation unit 114, and the training evaluation unit 114 compares the converted data with the corresponding training data and evaluates them (S42).

Here, the training evaluation unit 114 may analyze the extent to which the amplitude and frequency of the converted data match the amplitude and frequency of the training data, and evaluate the user's cognitive accuracy of the training problem accordingly.

As a result of the evaluation, if the conversion data and the training data match within the error range (Y), the training evaluation unit 114 may evaluate that the user correctly recognized the training problem. Accordingly, the problem generating unit 112 outputs the next training problem through the conversion unit 120 and the input/output unit 130 so that the user can proceed with auditory training through the new training problem (S43).

And, as shown in FIG. 3 , the user's auditory ability training results for the previously provided training problems may be stored in the storage unit 140 (S50).

On the other hand, if the conversion data and the training data as a result of the evaluation do not coincide beyond the error range (N), the training evaluation unit 114 may evaluate that the user did not accurately recognize the training problem.

Accordingly, the problem generating unit 112 outputs the previously output training problem again through the conversion unit 120 and the input/output unit 130 so that the user can repeat auditory training with the same training problem (S44).

Also, the training evaluation unit 114 may re-evaluate the cognitive accuracy of the user's training problem based on the user's feedback answer to the same training problem.

As described above, the auditory training method according to the present embodiment may provide a user with a training problem for auditory ability training, receive a feedback answer from the user, and evaluate the accuracy of the user's perception of the training problem. In addition, the efficiency of the user's auditory training can be increased by conducting auditory training through a new training problem or repeating an existing training problem according to the evaluation result.

In addition, the auditory training method according to the present embodiment can adjust the level of difficulty of the auditory training currently in progress by grasping the user's previous auditory training, or generate training problems according to the user's field of interest so that the auditory training can proceed. Accordingly, by providing customized auditory training problems to the user, it is possible to increase the concentration and interest in auditory training, thereby increasing training efficiency.

On the other hand, in the present embodiment, when a user who is a patient with acquired hearing loss who can understand words or sentences output as voice is equipped with the cochlear implant device 10, a voice signal is output to the user to perform hearing training. explained with an example. However, the present invention is not limited thereto, and even when a user who is an infant or a congenital hearing loss patient who does not understand words or sentences output as voice is equipped with the cochlear implant device 10, auditory ability training can be provided to the user.

In other words, the auditory training system 100 of the present invention provides the user with the sound of words or sentences through the voice conversion unit 121 and the audio output unit 131, and at the same time, the video conversion unit 122 and the video output unit ( 132) may provide an image corresponding to the corresponding word or sentence.

For example, the auditory training system 100 outputs the word "apple" as a voice through the audio output unit 131 and simultaneously outputs an image or video corresponding to "apple" through the video output unit 132. . Accordingly, the user is able to understand the meaning of the word output as a voice, and later, among the sounds collected through the cochlear implant 10, the same sound can be recognized based on the trained content.

That is, the auditory ability training system 100 of the present invention can provide auditory training to patients with acquired hearing loss, and furthermore, it can provide auditory training, word recognition training, and vocalization training to infants or patients with congenital hearing loss so that a rehabilitation program can be performed. there is.

6 is a diagram showing an implementation example of the auditory ability training apparatus of the present invention.

As shown in FIG. 6, the auditory training system 100 of the present invention is loaded in the form of an application on a user's smartphone 300, and the smartphone 300 is a head-mounted display device worn on the user's head. (1000).

Accordingly, while wearing the head mounted display device 1000, the user may perform hearing training according to training problems of audio and video provided from the hearing training system 100 mounted on the smart phone 300.

In addition, the smart phone 300 stored in the head mounted display device 1000 provides the user with training problems converted into 3D images and voices by the conversion unit 120 of the auditory training system 100, thereby improving the hearing ability of the user. The efficiency of training can be improved by increasing the immersion of training.

In addition, real-time interactive hearing training may be provided to the user by linking artificial intelligence apps such as Bixby, GiGA Genie, NUGU, Siri, etc. mounted in the smartphone 300 with the auditory training system 100 . Since these artificial intelligence apps include a voice recognition function, it is possible to improve the efficiency of training by increasing the user's interest and concentration in auditory training by interactively conducting auditory training with the user.

10: cochlear implant 100: auditory training system
110: control unit 111: training control unit
112: problem generating unit 113: environmental noise generating unit
114: training evaluation department 115: communication department
120: conversion unit 121: voice conversion unit
122: image conversion unit 130: input/output unit
131: audio output unit 132: video output unit
133: feedback input unit 140: storage unit
141: user information storage unit 142: training information storage unit
200: external server 300: smartphone
1000: head mounted display device

Claims (5)

In the auditory training system capable of providing customized auditory training to a user wearing a cochlear implant,
a control unit generating training problems for auditory training of a user from a plurality of training data and evaluating auditory training results from answers fed back from the user;
A voice conversion unit that converts audio data from the training problem into audio signals and converts the feedbacked answer into an electrical signal and outputs it, and converts the video data from the training problem into at least one of a 2D video signal and a 3D video signal. a conversion unit configured to include an image conversion unit for outputting and converting the user's feedbacked answer into an electrical signal and transmitting the converted electrical signal to the control unit;
an input/output unit outputting the converted audio signal and video signal to a user and receiving the user's feedback answer;
a recording and analysis unit that records a user's voice for a certain period of time and extracts words and sentences mainly used by the user from the recorded voice;
a user information storage unit in which user authentication information, user device authentication information, and user interest information are stored;
A training information storage unit in which the plurality of training data and user training result data are stored; and
a training evaluation unit comparing similarity between the feedback data converted by the conversion unit and training data corresponding to the training problem among the plurality of training data to evaluate a user's auditory ability training result;
including,
The control unit,
a problem generating unit extracting at least one training data from among the plurality of training data;
a training control unit that determines the suitability of the extracted training data; and
Including; an environmental noise generating unit that generates various environmental noises,
The training control unit authenticates the user and the user's cochlear implant 10 based on the user authentication information and the user device authentication information for auditory training, and controls the operation of the problem generator and the environmental noise generator to provide information to the user. Provides customized auditory training problems,
The problem generating unit generates the training problem to which the environmental noise is added from the extracted training data according to the determination result of the training control unit,
The training problem is generated using at least one of words and sentences extracted from the recording and analysis unit, and the training problem is obtained from the plurality of training data based on at least one of the user interest field information and the user training result data. Auditory training system, characterized in that for generating. delete delete According to claim 1,
Further comprising a communication unit for transmitting and receiving data to and from an external server and the cochlear implant device;
The auditory training system, characterized in that the control unit generates the training problem from training data provided from the external server through the communication unit.
A smartphone characterized in that the auditory training system of any one of claims 1 or 4 is loaded in the form of an application.

Images