KR20210110550A - System for training of listening ability for hard of hearing patient - Google Patents

Abstract

Provided is a hearing training system that provides customized hearing training to a patient wearing a hearing aid, so that the patient can perform a hearing rehabilitation program through hearing training by him/herself without visiting a hospital. The hearing training system can increase the effectiveness of training by providing customized hearing training to the patient according to patient's previous hearing training contents and areas of interest.

Description

System for training of listening ability for hard of hearing patient

The present invention relates to a hearing training system for a hearing loss patient, and more particularly, to an auditory training system capable of providing effective hearing training to a hearing loss patient wearing a hearing aid device such as a cochlear implant.

The most important purpose of hearing rehabilitation for hearing loss patients is to compensate for the perception of distorted sounds through damaged hearing organs and to improve communication skills in daily life by minimizing difficulties that may arise from hearing impairment.

For successful hearing training, an accurate assessment of the degree, type, and type of hearing loss must be made first, and based on the results, selection and fitting of an appropriate hearing aid, such as a hearing aid or cochlear implant, and adequate hearing aid Auditory training should follow. In particular, in order to make the most of the residual hearing of the hearing loss patient, it is necessary to systematically improve the hearing ability through an appropriately amplified and precisely controlled hearing aid.

In the past, a hearing rehabilitation program in which patients wearing hearing aids periodically visit the hospital to perform long-term hearing training was in progress.

However, there is a problem in that it is difficult for the elderly, hearing loss patients, or patients with hearing loss who are far from the hospital to visit the hospital, so hearing rehabilitation through hearing ability training is not smooth.

In addition, since the existing auditory training is performed according to the predetermined training contents, the rehabilitation concentration of the patient is reduced. In addition, the progress and results of the patient's hearing training are manually recorded and stored, so data is lost and managed. was difficult

KR Registered Patent Publication No. 10-1984991 (2019.05.27)

An object of the present invention is to solve the above problems, and it is an object of the present invention to provide a hearing training system in which a patient can perform customized hearing training without visiting a hospital.

The auditory training system of the present invention may provide customized hearing training to a user wearing a cochlear implant.

The auditory training system includes: a control unit for generating a training problem for the user's auditory training from a plurality of training data, and evaluating the result of the auditory training from the answers fed back from the user; a conversion unit that converts the training problem into an audio signal and a video signal, outputs the converted answer, and converts the user's feedback into an electrical signal and transmits it to the control unit; and an input/output unit that outputs the converted voice signal and video signal to the user, receives the user's feedback answer, records the user's voice for a certain period of time, and records the words and sentences mainly used by the user in the recorded voice By the recording and analysis unit to extract, user authentication information, user device authentication information and user information storage unit storing user interest information, a training information storage unit storing the plurality of training data and user training result data, and the conversion unit and a training evaluation unit for evaluating a user's auditory training result by comparing the similarity between the converted feedback data and the training data corresponding to the training problem among the plurality of training data, and the control unit is the generating the training question using at least one of a word and a sentence, and configuring the training question to be generated from the plurality of training data based on at least one of the user interest information and the user training result data have.

Hearing ability training system according to the present invention, even if the patient does not visit the hospital, it is possible to proceed with the hearing rehabilitation program through hearing training by itself.

In addition, the present invention provides a patient with auditory training through a training problem of which the difficulty is adjusted, or by providing auditory training repeatedly according to the patient's training result, or by providing auditory training through a training problem for the patient's field of interest. , it is possible to increase the efficiency of training by increasing the concentration and immersion of the patient's hearing training.

In addition, according to the present invention, hearing ability training, cognitive training, and vocalization training are provided to infants and children with congenital hearing loss in addition to acquired hearing loss patients so that the rehabilitation program can proceed.

1A to 1C are diagrams illustrating an example of a hearing aid device worn by a hearing loss patient.
2 is a diagram showing the configuration of an auditory training system according to an embodiment of the present invention.
3 is a diagram illustrating a hearing ability training method according to an embodiment of the present invention.
FIG. 4 is a diagram specifically illustrating a step of generating a problem for auditory training of FIG. 3 .
FIG. 5 is a diagram specifically illustrating a step of evaluating auditory training according to the user's answer of FIG. 3 .
6 is a view showing an implementation example of the auditory training apparatus of the present invention.

Hereinafter, the configuration and operation of the embodiment of the present invention will be described with reference to the accompanying drawings.

It should be noted that the same components in the drawings are indicated by the same reference numbers and symbols as much as possible even though they are indicated in different drawings. In the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated.

In addition, the terms or words used in the present specification and claims should not be construed in the ordinary and dictionary meaning, and the inventors can properly define the concept of the term to describe their invention in the best way. Based on the principle, it should be interpreted as meaning and concept consistent with the technical idea of the present invention. Accordingly, the embodiments described in this specification and the configurations shown in the drawings are only preferred embodiments of the present invention, and do not represent all of the technical spirit of the present invention, so various equivalents that can be substituted for them at the time of the present application and modifications, and the scope of the present invention is not limited to the embodiments described below.

1A to 1C are diagrams illustrating an example of a hearing aid device worn by a hearing loss patient.

Referring to the drawings, the hearing aid device, for example, the cochlear implant 10 is attached to the user's body and converts externally collected sounds, for example, voices, into electrical stimulation signals to the cochlear (cochlear, 5) auditory nerve (acoustic nerve) can be forwarded to The cochlear implant device 10 may include a main body 20 , an external coil 30 , an internal coil 40 , a converter 50 , and an electrode part 60 .

The main body 20 and the external coil 30 may be disposed outside the user's body. The inner coil 40 , the conversion unit 50 , and the electrode unit 60 may be disposed inside the user's body. Here, the outer coil 30 and the inner coil 40 may be disposed adjacent to each other.

The body 20 may be coupled to a portion of the user's ear through the ear guide 21 formed at the upper end thereof. The main body 20 may include a receiving unit 23 for receiving external sound, a voice processing unit 25 for converting the received sound into an electric signal, and an adjusting unit 27 for adjusting the volume of the received sound. .

The external coil 30 may be connected to the body 20 to transmit an electrical signal provided from the body 20 to the inside of the body, for example, the internal coil 40 .

The outer coil 30 may be formed in a structure that is closely adhered to or adhered to the skin 1 between the user's ear and the head. The outer coil 30 may be formed in a shape that surrounds the ear in order to increase attachment stability.

The outer coil 30 has a coil of a metal material therein, and in order to prevent the coil from coming into contact with the skin, an outer skin made of a stretchable and flexible polymer material may be formed to surround the coil.

The inner coil 40 , the conversion unit 50 , and the electrode unit 60 may be implanted inside the skin 1 and disposed inside the body.

Here, the inner coil 40 is preferably implanted inside the skin 1 adjacent to the outer coil 30 for smooth electrical signal transmission from the outer coil 30 . In addition, the conversion unit 50 may be implanted and placed in a portion of the bone tissue (3) cut between the muscle (2) and the bone tissue (3) on the inside of the skin (1). The electrode unit 60 may be disposed to penetrate the bone tissue 3 from the conversion unit 50 and be inserted into the cochlea 5 of the inner ear.

The inner coil 40 may transmit the electrical signal transmitted from the outer coil 30 to the converter 50 . The inner coil 40 may be in a form coupled to the conversion unit 50 or in a separate form. When the inner coil 40 and the conversion unit 50 are separated, the inner coil 40 and the conversion unit 50 may be electrically connected by a conductive wire (not shown).

The conversion unit 50 may convert the electrical signal transmitted from the internal coil 40 into an electrical stimulation signal. The converted electrical stimulation signal may be output through the electrode unit 60 to stimulate the auditory nerve of the cochlea 5 .

On the other hand, although not shown in the figure, the cochlear implant device 10 may further include a communication unit (not shown) capable of communicating with an auditory training system ( 100 in FIG. 2 ) or an external server ( 200 in FIG. 2 ) to be described later. can Accordingly, the cochlear implant device 10 may transmit and receive data through wireless communication with the auditory training system 100 or the external server 200 .

As described above, the cochlear implant device 10 may operate as a hearing aid device that converts external sounds into electrical stimulation signals to stimulate the auditory nerve, thereby recognizing external sounds in the user's brain.

However, the sound recognized by the cerebrum by the cochlear implant device 10 is different from the sound perceived through the air conduction method in general. As a result, a user wearing the cochlear implant device 10 may not accurately recognize the meaning of a sound according to a stimulus transmitted from the cochlear implant device 10 to the brain. Therefore, auditory training is required so that the user can accurately recognize the meaning of the sound according to the stimulus provided through the cochlear implant 10 .

2 is a diagram showing the configuration of an auditory training system according to an embodiment of the present invention.

Referring to FIG. 2 , the auditory training system 100 of the present embodiment is designed so that a user wearing a hearing aid, for example, the cochlear implant device 10 can accurately distinguish an external sound recognized through the cochlear implant device 10 . Auditory training can be provided for Hearing ability training system 100 may be implemented as a user's electronic device, for example, a computer, a laptop computer, a smart phone, a tablet PC, and the like.

The auditory training system 100 may be configured to include a control unit 110 , a conversion unit 120 , an input/output unit 130 , and a storage unit 140 .

The control unit 110 may control the user's hearing training. For example, the control unit 110 may perform authentication of the user, provision of problems for auditory training, evaluation of results of auditory training, and the like. To this end, the control unit 110 may include a training control unit 111 , a problem generation unit 112 , an environmental noise generation unit 113 , a training evaluation unit 114 , and a communication unit 115 .

The training control unit 111 may authenticate a user who wants to perform auditory training and the user's cochlear implant 10 . In addition, the training control unit 111 may control the operation of the problem generating unit 112 and the environmental noise generating unit 113 to be described later so that a customized hearing training problem is provided to the user. In addition, the training control unit 111 may receive a training problem from the external server 200 while communicating with the external server 200 through the communication unit 115 and provide it to the user or transmit the user's auditory training result.

The problem generating unit 112 may generate a training problem for the user's hearing training and provide it to the user's cochlear implant device 10 through the input/output unit 130 . The problem generating unit 112 extracts and provides a training problem in which the user's interest or training difficulty is reflected from the storage unit 140 under the control of the training control unit 111, or in the external server 200 through the communication unit 115. Provided training problems can be provided.

In addition, the problem generating unit 112 may generate a training problem using words or sentences that the user mainly uses in daily life for a certain period of time, for example, one day. To this end, the auditory training system 100 of the present embodiment may further include a recording and analysis unit (not shown). The recording and analysis unit may record the user's voice and analyze and extract words or sentences mainly used by the user from among the voices recorded for a preset period of time. The words or sentences extracted in this way are provided to the problem generating unit 112 to be generated as a training problem for the user's hearing training.

The environmental noise generating unit 113 may generate various environmental noises in the living environment under the control of the training control unit 111 , and provide them to the problem generating unit 112 . Accordingly, the problem generating unit 112 may provide the user with a training problem including environmental noise.

The training evaluation unit 114 may evaluate the training performance by analyzing the feedback answer of the training problem provided by the user, and deriving the result of the auditory training according to the analysis result. The training evaluation unit 114 may derive a training result by comparing and analyzing the training problem provided by the problem generating unit 112 and the user's feedback answer to determine the sameness.

The communication unit 115 may communicate with the external server 200 or the user's cochlear implant 10 to transmit and receive data. The communication unit 115 may transmit/receive data through a wireless communication method such as wireless Internet, Bluetooth, or Zigbee.

The conversion unit 120 may include a voice conversion unit 121 and an image conversion unit 122 .

The voice conversion unit 121 may convert signals and voices in both directions. The voice conversion unit 121 may convert the training problem generated by the problem generation unit 112 of the control unit 110 into sound, that is, a voice signal, and transmit it to the input/output unit 130 . In addition, the voice conversion unit 121 may convert the user's voice transmitted from the input/output unit 130 , that is, a feedback answer into an electrical signal and transmit it to the training evaluation unit 114 of the control unit 110 .

That is, the voice conversion unit 121 converts the training problem having the form of an electrical signal into a voice and provides it to the user, converts the user's voice into data having the form of an electrical signal and provides it to the control unit 110 . have.

When an image or an image is included in the training problem generated by the problem generating unit 112 , the image conversion unit 122 may convert it into an image signal and transmit it to the input/output unit 130 . In this case, the image conversion unit 122 may convert the video signal so that the synchronization between the audio and the video of the training problem is consistent. In addition, the image conversion unit 122 may convert the image or image of the training problem into a 3D image and provide it to the user through the input/output unit 130 .

The input/output unit 130 may provide the audio and image provided by the conversion unit 120 to the user, and may provide the audio provided from the user to the conversion unit 120 . The input/output unit 130 may include an audio output unit 131 , an image output unit 132 , and a feedback input unit 133 .

The voice output unit 131 may output a training problem in the form of a voice signal provided by the voice conversion unit 121 to the user. Accordingly, the user may receive the voice signal of the training problem through the cochlear implant 10 . The audio output unit 131 may be configured as a speaker or the like.

The image output unit 132 may output a training problem in the form of an image signal provided by the image conversion unit 122 to the user. Accordingly, the user can recognize the image signal of the training problem through the eyes. The image output unit 132 may be configured as a display unit (not shown) provided in the auditory training system 100 .

Here, since the audio signal and the video signal of the training problem are synchronized, the user receives the image of the training problem through the eyes at the same time as the auditory nerve stimulation of the training problem through the cochlear implant 10 .

The feedback input unit 133 may collect and provide to the conversion unit 120 when the user answers the training question. The feedback input unit 133 may be configured as a microphone or the like.

The storage unit 140 may include a user information storage unit 141 and a training information storage unit 142 . The previously described control unit 110 may extract user information or training information from the storage unit 140 to perform user authentication or training problem generation.

The user information storage unit 141 may store personal authentication information of the user and device authentication information of the user cochlear implant device 10 . In addition, the user information storage unit 141 may store the user's individual interest area information.

A plurality of training data for the user's hearing training may be stored in the training information storage unit 142 . Training data may be stored separately according to training difficulty. For example, the training data may include basic difficulty training data consisting of a single word such as "A", "I", "C", etc. have.

In addition, the training information storage unit 142 may store training result data for each user. The training result data for each user may include a difficulty level of auditory training, a training result, an evaluation score, and the like. The training result data for each user may be recorded and stored for every number of auditory training sessions.

As described above, the hearing ability training system 100 of this embodiment provides a training problem for hearing training to a user wearing the cochlear implant 10, and thus analyzes the user's hearing ability from answers fed back from the user. can be judged by

The hearing ability training system 100 may be configured to be mounted in the form of a program or application in an electronic device possessed by the user. Accordingly, the user can perform hearing training without visiting a remote hospital, thereby increasing training efficiency.

3 is a diagram illustrating a hearing ability training method according to an embodiment of the present invention.

Referring to FIG. 3 , first, the auditory training system 100 may authenticate a user who wants to perform auditory training and a hearing aid device mounted by the user, that is, the cochlear implant 10 ( S10 ).

Specifically, the training control unit 111 of the auditory training system 100 authenticates the user by determining whether personal information such as ID and password input from the user matches the user personal authentication information stored in the user information storage unit 141 can do.

In addition, the training control unit 111 determines whether the information transmitted from the cochlear implant device 10 through the communication unit 115 matches the user device authentication information stored in the user information storage unit 141 to determine whether the user's cochlear implant 10 ) can be verified.

In this way, the auditory training system 100 authenticates the user and the user's cochlear implant 10 through the training control unit 111, so that customized auditory training is provided to the authorized user. Here, user authentication and user device authentication may be performed simultaneously.

Then, after authentication of the user and the user device is completed, the training control unit 111 may set the authenticated user's cochlear implant 10 as a training set value, for example, a value for auditory training (S20).

Here, since the auditory training system 100 aims to improve the user's hearing ability, the training control unit 111 increases or decreases the volume of the voice received by the cochlear implant 10 by 5 to 10% than usual. The cochlear implant device 10 may be set up as much as possible.

The training control unit 111 transmits control data through the communication unit 115 so that the setup proceeds automatically, or the setup proceeds by guiding the user to proceed with volume control through the display unit of the auditory training system 100. can

Subsequently, the control unit 110 of the auditory training system 100 may generate a training problem for the user's hearing training and output it to the user (S30).

The problem generating unit 112 of the control unit 110 generates a training problem by extracting at least one data suitable for the level of the user from among the plurality of training data stored in the storage unit 140 under the control of the training control unit 111 . can do.

In addition, the problem generating unit 112 generates a training problem from the training data provided from the external server 200 through the communication unit 115, or by using a word or sentence mainly used by the user for a certain period of time. can create

FIG. 4 is a diagram specifically illustrating a step of generating a problem for auditory training of FIG. 3 .

3 and 4, the training control unit 111 may check the user's previous auditory training contents stored in the training information storage unit 142 of the storage unit 140, for example, training difficulty, training results, evaluation scores, etc. There is (S31).

Then, the problem generating unit 112 may extract at least one training data suitable for the user from among the plurality of training data stored in the training information storage unit 142 of the storage unit 140 (S32).

Subsequently, the training control unit 111 may determine the suitability of the training data extracted from the problem generation unit 112 (S33).

In this case, the training control unit 111 may determine suitability according to the difficulty of the extracted training data based on the previously confirmed user's previous training result, whether the user is interested in the field, and the like.

Here, the difficulty of the training data may be determined from the previously confirmed user's previous hearing training content. In addition, whether the user's interest area may be determined by checking the user's interest information stored in the user information storage unit 141 of the storage unit 140 .

If it is determined that the extracted training data is inappropriate (N), the training control unit 111 may cause the problem generation unit 112 to re-extract the training data (S32). Then, it is possible to proceed again to determine the suitability of the re-extracted training data (S33).

On the other hand, if it is determined that the extracted training data is suitable (Y), the problem generating unit 112 may generate a training problem from the training data (S34).

In this case, the training control unit 111 may generate various environmental noises, sounds such as TVs or telephones, noises of nearby people, noises from automobiles or construction sites, and the like, from the environmental noise generation unit 113 . And, by providing the generated environmental noise to the problem generating unit 112, it is possible to include the environmental noise in the training problem.

In this way, generating environmental noise and including it in the training problem may proceed according to the previously determined difficulty level of auditory training or may be performed under the control of the training control unit 111 at the request of the user.

Next, the problem generating unit 112 may transmit the generated training problem to the transformation unit 120, and the transformation unit 120 may convert it into the form of an audio and video signal and output it (S35).

The voice conversion unit 121 of the conversion unit 120 may convert the voice data of the training problem into a voice signal of a predetermined level. Then, the voice output unit 131 of the input/output unit 130 may output the converted voice signal to the outside so that the user's cochlear implant device 10 may receive it.

Also, the image conversion unit 122 of the conversion unit 120 may convert the image data of the training problem into a two-dimensional or three-dimensional image signal. Next, the image output unit 132 of the input/output unit 130 may output the converted image signal so that the user can recognize it.

Referring back to FIG. 3 , after a training problem for auditory training is provided to the user in the auditory training system 100 , the user may perform auditory training through this, and feedback an answer accordingly.

For example, when a voice signal “apple” is provided to the user as a training problem, the user may receive and recognize it through the cochlear implant 10 and then re-voice it. The auditory training system 100 may receive a voice signal from the user as a feedback answer through the feedback input unit 133 of the input/output unit 130 .

Next, the auditory training system 100 may analyze the received user's feedback answer to evaluate whether the user properly recognized the training problem (S40).

FIG. 5 is a diagram specifically illustrating a step of evaluating auditory training according to the user's answer of FIG. 3 .

3 and 5 , the input/output unit 130 of the auditory training system 100 may receive the user's feedback answer and provide it to the conversion unit 120 . Then, the voice conversion unit 121 of the conversion unit 120 may convert the user's feedback answer into a data signal having the form of an electrical signal (S41).

The voice conversion unit 121 may provide the converted data to the training evaluation unit 114, and the training evaluation unit 114 may evaluate the converted data by comparing it with the corresponding training data (S42).

Here, the training evaluation unit 114 may analyze the degree to which the amplitude and frequency of the converted data coincide with the amplitude and frequency of the training data, and thus evaluate the recognition accuracy of the user's training problem.

As a result of the evaluation, if the transformation data and the training data match within the error range (Y), the training evaluation unit 114 may evaluate that the user has correctly recognized the training problem. Accordingly, the problem generating unit 112 may output the following training problem through the conversion unit 120 and the input/output unit 130 so that the user can proceed with auditory training through the new training problem (S43).

And, as shown in FIG. 3 , the user's hearing ability training result for the provided training problem may be stored in the storage unit 140 ( S50 ).

On the other hand, if the evaluation result does not match the converted data and the training data out of the error range (N), the training evaluation unit 114 may evaluate that the user did not correctly recognize the training problem.

Accordingly, the problem generating unit 112 may re-output the previously output training problem through the conversion unit 120 and the input/output unit 130 so that the user repeats the auditory training with the same training problem (S44).

Then, the training evaluation unit 114 may re-evaluate the cognitive accuracy of the user's training problem from the user's feedback answer to the same training problem.

As described above, the auditory training method according to the present embodiment provides a training problem for auditory training to the user, and receives a feedback answer from the user to evaluate the recognition accuracy of the user's training problem. And, by performing auditory training through a new training problem or repeating an existing training problem to perform auditory training according to the evaluation result, it is possible to increase the effectiveness of the user's auditory training.

In addition, the auditory training method of the present embodiment can control the difficulty of the currently ongoing auditory training by grasping the user's past auditory training content, or generate a training problem according to the user's field of interest so that the auditory training can proceed. Accordingly, by providing a customized hearing training problem to the user, it is possible to increase the concentration and interest in hearing training, thereby increasing training efficiency.

On the other hand, in the present embodiment, when a user who is a patient with acquired hearing loss to the extent that he or she can understand a word or sentence output as a voice is equipped with the cochlear implant device 10, it is possible to perform hearing training by outputting a voice signal to the user. It has been described as an example. However, the present invention is not limited thereto, and hearing training can be provided to the user even when a user who is an infant or a congenital hearing loss patient who does not understand the words or sentences outputted by voice is equipped with the cochlear implant 10 .

In other words, the auditory training system 100 of the present invention provides the user with the voice of words or sentences through the voice conversion unit 121 and the audio output unit 131, and at the same time, the image conversion unit 122 and the image output unit ( 132) may provide an image corresponding to the corresponding word or sentence.

For example, the auditory training system 100 may output the word "apple" as a voice through the audio output unit 131 and simultaneously output an image or image corresponding to "apple" through the image output unit 132. . Accordingly, the user can understand the meaning of the word output by voice, and can recognize the same sound from among the sounds collected through the cochlear implant 10 based on the training content.

That is, the hearing ability training system 100 of the present invention can provide auditory training to patients with acquired hearing loss, and furthermore, to provide hearing training, word recognition training, and vocal training to infants or children with congenital hearing loss so that the rehabilitation program can proceed. have.

6 is a view showing an implementation example of the auditory training apparatus of the present invention.

As shown in Figure 6, the auditory training system 100 of the present invention is mounted in the form of an application on the user's smartphone 300, such a smartphone 300 is a head mounted display device that is worn on the user's head. It may be housed in (1000).

Accordingly, the user can perform hearing training according to the training problem of voice and image provided from the hearing training system 100 mounted on the smartphone 300 while wearing the head mounted display device 1000 .

In addition, the smartphone 300 accommodated in the head mounted display device 1000 provides the user with a training problem converted into a three-dimensional image and voice by the conversion unit 120 of the auditory training system 100 to improve the user's hearing ability. By increasing the immersion in training, it is possible to improve training efficiency.

In addition, it is possible to provide real-time interactive auditory training to the user by linking an artificial intelligence app, such as Bixby, GiGA Genie, NUGU, Siri, etc., mounted on the smartphone 300 with the auditory training system 100 . Since this AI app includes a voice recognition function, it is possible to improve the effectiveness of training by increasing the user's interest in and concentration in hearing training by using it to conduct hearing training interactively with the user.

10: cochlear implant device 100: auditory training system
110: control unit 111: training control unit
112: problem generating unit 113: environmental noise generating unit
114: training evaluation department 115: communication department
120: conversion unit 121: voice conversion unit
122: image conversion unit 130: input/output unit
131: audio output unit 132: image output unit
133: feedback input 140: storage unit
141: user information storage unit 142: training information storage unit
200: external server 300: smartphone
1000: head mounted indicator

Claims (5)

In the hearing training system capable of providing customized hearing training to a user wearing a cochlear implant,
a control unit generating a training problem for the user's auditory training from a plurality of training data and evaluating the result of the auditory training from the answers fed back from the user;
A voice conversion unit that converts voice data among the training problems into voice signals, converts the feedback answers into electrical signals and outputs them, and converts the image data of the training problems into at least one of a two-dimensional image signal and a three-dimensional image signal, a conversion unit configured to include an image conversion unit for outputting, converting the user's feedback into an electric signal and transmitting it to the control unit;
an input/output unit for outputting the converted audio and video signals to a user and receiving the user's feedback answer;
a recording and analysis unit that records the user's voice for a predetermined time and extracts words and sentences mainly used by the user from the recorded voice;
a user information storage unit storing user authentication information, user device authentication information and user interest information;
A training information storage unit in which the plurality of training data and user training result data are stored; And
a training evaluation unit for evaluating the user's auditory training result by comparing the similarity between the feedback data converted by the transformation unit and the training data corresponding to the training problem among the plurality of training data;
including,
the control unit
generating the training problem using at least one of the words and sentences extracted from the recording and analysis unit;
Auditory training system, characterized in that generating the training question from the plurality of training data based on at least one of the user interest information and the user training result data.
According to claim 1,
The control unit is
a problem generator for extracting at least one training data from among the plurality of training data;
a training control unit that determines the suitability of the extracted training data; and
It includes an environmental noise generator that generates various environmental noises,
The problem generating unit,
Auditory training system, characterized in that generating the training problem to which the environmental noise is added from the extracted training data according to the determination result of the training control unit. According to claim 1,
The control unit is
Hearing ability training system, characterized in that for authenticating the user and the cochlear implant device of the user based on the user authentication information and the user device authentication information.
According to claim 1,
Further comprising a communication unit for transmitting and receiving data with an external server and the cochlear implant device,
The control unit is an auditory training system, characterized in that for generating the training question from the training data provided through the communication unit from the external server.
A smartphone, characterized in that the hearing training system of any one of claims 1 to 4 is mounted in the form of an application.

Images