KR101600429B1 - An Auxiliary Aid Device for Adaptation of Environmental Circumstance and A method for Linking An Auxiliary Aid Device to A multimedia Device - Google Patents

Abstract

The present invention relates to a hearing aid device of an environmental circumstance adaptation scheme and a control method of a hearing aid device for the connection with a multimedia device and, more specifically, to a hearing aid device of an environmental circumstance adaptation scheme, which detects the surrounding environmental circumstances to enable a response according to the circumstances while automatically providing information on the circumstances, and a control method of a hearing aid device for the connection with a multimedia device. The hearing aid device of an environmental circumstance adaptation scheme comprises: a control unit (P12) receiving information transmitted to a multimedia unit (P111) and an environmental circumstance unit (P112); a classification unit (P14) classifying the information transmitted to the environmental circumstance unit (P112); an output determination unit (P15) determining a processing method of the information classified according to the classification of the classification unit (P14); an environment output unit (P171) outputting the information processed by the output determination unit (P15); and an adaptation unit (P16) determining the level and an output method of a danger signal outputted to the environment output unit (P171).

Description

[0001] The present invention relates to a method of controlling a hearing aid device and a hearing aid device for connecting a multimedia device,

The present invention relates to a hearing aid device and a control method of a hearing aid device for linking a multimedia device with an environmental situation adaptation method and more specifically to a method for detecting a surrounding environment condition and automatically providing information on a situation, And a control method of a hearing assistive device for linking a multimedia device and a hearing aid device in an adaptive manner.

With the development of various types of portable multimedia devices, the use of multimedia such as listening to music while walking or driving is gradually increasing. The use of a portable multimedia device entails the use of an earphone or a headset, thereby reducing the attention to sound generated in the surrounding environment. In addition, the use of such multimedia is a cause to distract attention to the surrounding environment. This problem also occurs during the use of a hearing aid. Hearing aids are for hearing aids, but they are combined with various multimedia devices with the development of hearing aid technology. For example, a hearing aid function may be added to a headset or earphone, and the operation of the hearing aid may be associated with a multimedia device such as a smart phone. Various methods have been proposed for solving the problems caused by the use of such a hearing aid and the reduction in attention to the surrounding situation.

Patent Document No. 0753481 'Portable sound source reproducing apparatus for safety during walking and its control method' relates to a portable sound source reproducing apparatus for a user's walking safety and a reproducing method thereof, And controlling the output of the portable sound source reproducing device to secure the safety of the user's walking, and a control method thereof. The prior art includes a vibration sensor part for sensing vibrations caused by a user's walking; A setting section for setting an output control drive condition for identifying that the user is exposed to a dangerous situation; A data comparing unit comparing the vibration data detected by the vibration sensor with the data set by the setting unit to determine whether the output control driving condition is satisfied; An output control section for controlling the sound reproduction output so that the pedestrian can detect an external dangerous element according to a result of the data comparison section; And a sound source reproduction section for reproducing the sound source in accordance with the output controlled by the output control section.

Another prior art for securing the user's safety in using the portable multimedia device during walking is disclosed in Korean Patent Application Publication No. 2013-0039267 'mobile terminal and its operation control method'. The prior art relates to a mobile terminal for recognizing a surrounding situation through frequency analysis of ambient noise and informing a user of the situation, and a method of operating the same. The method includes storing frequency characteristics of sound generated in a plurality of peripheral situations; Collecting surrounding sounds when a call or multimedia is played back; Analyzing a frequency spectrum of the sound and calculating a frequency characteristic of the sound; Comparing the calculated frequency characteristic with a plurality of pre-stored frequency characteristics to recognize a surrounding situation where the collected sound is generated; And controlling an operation of the predetermined mobile terminal according to the recognized peripheral condition.

The prior art or known technique controls the output of the sound source generating device based on vibrations generated from the user or sounds collected from the surroundings. However, controlling the output of the sound source generating device on the basis of the vibration or sound thus generated may be difficult to cope with the situation, and on the other hand, controlling the output of the sound source generating device itself may reduce the efficiency of the control method I have a problem. In addition, the prior art does not provide a method of controlling a warning signal according to a change in the surrounding environment or a user's perception level. In addition, the prior art does not disclose a method for enabling control of environmental sounds as required.

The present invention has been made to solve the problems of the prior art and has the following purpose.

Prior Art Document 1: Patent Registration No. 0753481 (published by Ionobizu Co., Ltd., August 31, 2007) Portable sound source reproducing apparatus for safety during walking and its control method Prior Art 2: Patent Publication No. 2013-0039267 (published by LG Electronics Co., Ltd. on Apr. 19, 2013) Mobile terminal and control method of its operation

An object of the present invention is to provide an environment condition adaptation method for collecting external environment information in various ways and allowing the user to respond to external environment conditions during use of the portable multimedia device according to the situation, And to provide a method of controlling a hearing aid device for connecting a hearing aid device and a multimedia device.

Yet another object of the present invention is to provide a hearing aid device of an environmental situation adaptive type and a hearing aid device for connecting a multimedia device, which can reduce distraction of the user by periodically stimulating the user in the course of using the portable multimedia device Method.

It is still another object of the present invention to provide a hearing aid device of an environmental condition adaptation type and a control method of a hearing aid device for linking a multimedia device to enable external sound to be input to the user in the process of using the hearing aid device .

According to a preferred embodiment of the present invention, the hearing aid comprises a control unit for receiving information transmitted to the multimedia unit and the environmental situation unit; A classification unit that classifies the information sent to the environmental situation unit; An output determining unit that determines a method of processing the information classified according to the classification of the classification unit; An environment output unit outputting information processed in the adaptation unit; And an adaptive unit for determining a level and an output mode of the hazard signal output to the environment output unit.

According to another preferred embodiment of the present invention, the adaptive unit includes a function of determining the danger level, changing the size of the output signal with the lapse of time, or periodically outputting the output signal.

According to another preferred embodiment of the present invention, the adaptation unit has a function of controlling a relative size of information transmitted to the multimedia unit and the environment situation unit.

According to another preferred embodiment of the present invention, the hearing aid comprises a communication unit capable of communicating with a multimedia device; A signal processing processor for processing a situation signal transmitted from the multimedia device or from a microphone; An output control module for controlling an output of a signal transmitted from the signal processor; And an output unit for outputting each signal under the control of the output control module, and the signal processing processor classifies the status signal into a normal signal, a predetermined signal, and an exception condition signal.

According to still another aspect of the present invention, there is provided a method of controlling an operation of a hearing aid, the method comprising: setting an interface between a hearing aid and a multimedia device; A step in which an external environmental situation is introduced; Analyzing and comparing the incoming external environment situation; Determining whether a warning condition is met according to the analysis result and the comparison result; Determining a recognition method according to the determination result; And the output of the hearing assistive device is controlled, wherein the external environment condition is introduced from the multimedia device or from the hearing aid device, Is determined to be out of a predetermined range and continuing beyond a predetermined time range.

According to another preferred embodiment of the present invention, the external environment situation includes location information obtained from the multimedia device, image information, or operation time of the multimedia device.

According to another preferred embodiment of the present invention, the step of determining the recognition method further includes a step of converting to a specific frequency band or a conversion into a matching message.

According to another preferred embodiment of the present invention, the step of controlling the output of the hearing aid comprises controlling the relative size of the information input from the multimedia and the information input from the external environment situation.

The hearing aid according to the present invention has an advantage that the user can appropriately respond to the external environment by generating a signal corresponding to the external environment according to the use environment. The hearing aid according to the present invention has an advantage of enabling the hearing assistive device itself to be miniaturized and function expandable by being linked with the function of the multimedia device. In addition, the hearing aid according to the present invention has an advantage that it can be used irrespective of the multimedia device connected by controlling the output of the auxiliary device itself. Further, the hearing aid according to the present invention may cause a difference in perception of the surrounding environment and the surrounding environment according to the degree of hearing, and may cause problems due to poor external environment or situations that may be caused by the use of multimedia It can be solved.

FIG. 1A shows an embodiment of an operating structure of a hearing aid according to the present invention.
1B illustrates an operating structure of a hearing aid device system according to an operating structure of a hearing aid according to the present invention.
1C illustrates an example of a structure in which output is controlled in a hearing aid according to the present invention.
FIGS. 2A, 2B and 2C illustrate various embodiments in which a hearing aid according to the present invention is connected to a multimedia device.
FIG. 3 shows an embodiment of a method for controlling the operation of a hearing aid according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the embodiments shown in the accompanying drawings, but the present invention is not limited thereto. In the following description, components having the same reference numerals in different drawings have similar functions, so that they will not be described repeatedly unless necessary for an understanding of the invention, and the known components will be briefly described or omitted. However, It should not be understood as being excluded from the embodiment of Fig.

The hearing assistive device according to the present invention includes any device that enables the sound to be introduced or controlled by being worn on the ear, such as a hearing aid, earphone, headphone, earset, or headset. The hearing aid may have its own volume control and may include its own control unit, such as a microprocessor, as required, as described below. The hearing aid may also be connected to the multimedia device in a wireless or wired manner.

Multimedia devices include cell phones, smart phones, tablet devices, or any portable electronic device capable of reproducing various types of multimedia. The multimedia device may also include any device for generating multimedia related signals such as TV, radio or MP3 or multimedia. Sounds coming into or out of the multimedia device can be selectively transmitted to the hearing aid via wired or wireless.

A hearing aid may have the ability to complement the volume or volume of the sound signal or to convert the sound signal. Adjustment of size or volume means amplification of sound signal, and conversion means compression of sound signal, amplification by frequency band or frequency shift. The conversion of the sound signal can be made according to the hearing ability of the individual and can be based on the same or similar process as the fitting process of the hearing aid, for example. The hearing aid according to the present invention may be operated on the basis of the characteristics according to the hearing of the individual. The characteristics of the individual's hearing ability can be stored in a multimedia device in the form of software or stored in a hearing aid. And the hearing aid can be operated based on the stored software during the operation.

Control of the operation of the hearing aid may be done on its own or through a multimedia device. For example, the hearing aid may have input means for on / off, volume control or setting of operating conditions. Alternatively, the operation or program operation of the hearing aid function may be performed by the multimedia device. For example, a program associated with the occurrence of a beeping condition of the hearing aid and the resulting alert signal may be stored in the multimedia device and activated as needed. Or the hearing characteristics of the individual may be stored in the multimedia device.

An environmental status signal or a status signal refers to a signal related to an external environment or an external situation. The environmental condition signal includes the call sound of the multimedia device itself, for example, a car horn sound, a warning sound, a ringing sound, a sudden environmental noise or a relatively large sound. Also, the situation signal includes a sound or voice signal, a video signal, or a signal in which a generation condition is determined in the multimedia device itself. For example, the video signal may be a video signal obtained through a multimedia device or another camera. Also, the signal for which the occurrence condition is determined may be a signal set to be generated based on the position information of the multimedia device, or a signal set to be generated at a certain time. As described above, the situation signal includes external audio, audio, and video signals as well as signals generated in the multimedia device and signals in which the generation conditions are set.

Hereinafter, a hearing assistive device in an environment adaptive manner in which the operation is controlled in association with a multimedia device will be described in detail.

FIG. 1A shows an embodiment of an operating structure of a hearing aid according to the present invention.

Referring to FIG. 1A, a hearing aid according to an embodiment of the present invention includes a control unit P12 for receiving information transmitted to a multimedia unit P111 and an environment status unit P112; A classification unit P14 for classifying the information transmitted to the environmental situation unit P12; An output determining unit (P15) for determining a method of processing the information classified according to the classification of the classification unit (P14); An environment output unit (P171) for outputting information processed in the output determination unit (P15); And an adaptation unit P16 for determining the level and the output mode of the hazard signal outputted to the environment output unit P171.

The multimedia unit P111 and the environmental situation unit P112 may respectively transmit a sound signal to the control unit P12 and the control unit P12 may transmit the transmitted sound signal or information to the classification unit P14. The multimedia unit P111 may transmit, for example, a playback sound signal or a sound signal transmitted through wireless communication to the control unit. Also, the multimedia unit P111 can transmit to the control unit P12, such as an external environment sound inputted through the mounted microphone or an external environment image transmitted through the camera. In addition, if a distance detection unit such as an ultrasonic detection unit is mounted, information related thereto can be transmitted to the control unit P12. The various pieces of information can be transmitted to the control unit P111 through the multimedia unit P111. Then, the control unit P12 may transmit to the classification unit P14 or to the output determination unit P15 according to the type of the transmitted information. On the other hand, the signal transmitted to the environmental condition unit P112 may mainly be an environmental condition signal or an environmental condition sound signal. For example, a microphone may be separately installed in the hearing aid and an environmental condition sound signal may be transmitted to the control unit P12 through the microphone.

The signal from the multimedia unit P111 or the environmental status unit P112 to the control unit P12 may be transmitted wirelessly or by wire through an appropriate communication unit. The control unit P12 may transmit the transmitted signal to the output determination unit P15 or to the classification unit P14 and may transmit the processed signal to the output determination unit P15 in the classification unit P14. The control unit P12 may transmit the signal transmitted to the classification unit P14 or the output decision unit P15 based on the processing standard such as the signal type, the input device or the size of the signal. For example, a signal reproduced from the multimedia unit P111 may be transmitted to the output determination unit P15, and a signal input to the environment situation unit P112 may be transmitted to the classification unit P14. On the other hand, a negligible level of signal or a signal that has already been transmitted and does not need to be processed separately can be eliminated.

The signal transmitted to the classification unit P14 can be classified according to the type, generation form or characteristic of the signal and the information stored in the characteristic database P13 in the classification process can be used. The classification unit P14 can extract the characteristic from the transmitted signal and the information or signal conveyed based on the extracted characteristic can be classified. The information or signal can be classified by referring to the data stored in the characteristic database P13. The signal or information input in the classification process of information or signal can be divided into a predetermined time interval and the information inputted in the immediately preceding time band is compared with the information inputted in the current time band so that the newly generated event becomes the main comparison factor . The comparison unit P14 can display the classification result in an appropriate manner. For example, the classification unit (P14) can be classified as a risk level, a proximity level, or a risk type, and a corresponding indication can be made.

The signal classified in the classification unit P14 can be transmitted to the output determination unit P15 via the control unit P12. The output determination unit P15 can determine the output mode of the information or signal according to the result classified by the classification unit P14. The output determination unit P15 can determine the signal output format such as, for example, the output direction, the signal output method, or the output time, and can determine, for example, the frequency band to be amplified or the number of output repetitions. The signal whose output type is determined in the output determination unit P15 can be transmitted to the user through the environmental signal output unit P171. At the same time as the output of the environmental signal, a signal transmitted from the multimedia device can be transmitted by the multimedia output signal unit P172, and the signal transmitted by the multimedia device can be appropriately controlled as needed.

The output determination unit P15 can appropriately adjust the signal transmitted from the multimedia output unit P172 in the process of transmitting the signal classified as the danger through the environment output unit P171 to the user. The environment output unit P171 and the multimedia output unit P172 physically become one output unit and can be logically divided. For example, an environment output unit P171 when processing an environment signal and a multimedia output unit P172 when outputting a multimedia signal. The environment signal and the multimedia signal may be output together or one of them may be output. When a danger signal is output from the output determination unit P15, the danger signal may be transmitted to the adaptation unit P16.

The adaptation unit P16 may store the signal transmitted from the output determination unit P15 according to the risk level and the signal type and determine how to recognize the user according to a predetermined method. In addition, the adaptation unit P16 may have a function of determining whether the current danger signal is continuously transmitted and whether the risk is increased or not, and informing the user of the increase. For example, as the risk for the same or similar signal increases, the gain for the hazard signal is amplified and delivered to the user. At the same time, the gain of the signal transmitted from the multimedia device is reduced and transmitted to the user. Thus, the adaptation unit P16 may have a function of allowing the user to perceive whether the risk level is maintained, whether the risk level is increased, and whether the risk level is approached. Further, the adaptive unit P16 can judge whether or not the danger is itself. For example, if the value of the current signal transmitted from the output determination unit P15 is B, the value of the immediately preceding signal is C, and the risk index is R, R = B * P + C * And the coefficient is a value between 0 and 1). For example, if P = 0.2 and Q = 0.8, the risk R ≤ the previous signal value is +15 dB. At the same time, if the duration is more than 0.1 second, for example, it can be judged as a dangerous situation. Such a function of the adaptation unit P16 may be applied to the risk level classification process in the classification unit P14. For example, the classification unit P14 calculates R to determine whether it is dangerous and transmits it to the adaptation unit P16. The adaptation unit P16 determines whether the signal transmission is continued or not, It can be delivered in signal form. Or the size of a signal transmitted from the multimedia device can be gradually reduced.

Another function of the adaptation unit P16 is to allow ambient sound to be introduced into the wearer's hearing aid. In the course of using the hearing aid, for example, it is necessary to sufficiently suppress or erase the signal transmitted from the multimedia for conversation with the other party. In this case, all the environmental signals including the danger signal can be transmitted to the hearing assistive device while suppressing the multimedia signal by the appropriate control switch. The control switch may be installed, for example, in a multimedia device or a hearing aid, and the adaptive unit P16 may remove the multimedia signal using a suitable filter unit or using a selection of signaling paths. For example, only the conversation sound of the other party can be inputted. Alternatively, only the multimedia signal may be input.

The adaptation unit P16 can control environmental signals, danger signals and multimedia signals in various ways, and the present invention is not limited to the embodiments shown.

An apparatus or system to which the operating structure of the hearing aid according to the present invention is applied will be described below.

1B shows an embodiment of the operating structure of the hearing aid system 100 according to the present invention and FIG. 1C shows an embodiment of the structure in which the output is controlled in the hearing aid 20 according to the present invention Respectively.

1B and 1C, a hearing aid 20 for external environment response includes a communication unit 16 capable of communicating with the multimedia device 10; A signal processing processor (21) for processing the status signal transmitted from the multimedia device (10) or from the microphone (24b); An output control module (212) for controlling the output of the signal transmitted from the signal processing processor (21); And an output unit (22a, 19) for outputting each signal under the control of the output control module (212).

The status signal may be transmitted via the imaging device S1 or via the microphone device S2. On the other hand, the status signal can be generated and transmitted through the program of the multimedia device 10. [ The imaging device S1 may be, but not limited to, a camera of the multimedia device 10 and the microphone device S2 may be a microphone installed in the multimedia device 10 or the hearing aid 20. The signal obtained from the microphone device S2 attached to the hearing assistant device 20 itself can be directly transmitted to the signal processor 21 of the hearing aid device 20. [ A signal obtained from the multimedia device 10 may be transmitted to the signal processing processor 21 via an output device provided inside the multimedia device 10. [ A signal input to the signal processing processor 21 as needed can be transmitted to the multimedia device 10 via the communication means 16 and analyzed by the analysis unit 11. [

A situation signal inputted into the multimedia device 10 or a situation signal inputted through the hearing aid device 20 can be analyzed by the analysis unit 11. [ The analysis unit 11 may include a filter unit 111a and a classification unit 111b. The filter unit 111a has a function of extracting a sound signal of a specific size or a specific frequency band and the classification unit 111b has a function of classifying a voice signal, an acoustic signal, a signal outside the audible frequency band, have. The signal thus extracted by the filter unit 111a and classified by the classification unit 111b is transmitted to the comparison unit 12 so that the matching signal can be searched. The comparison unit 12 may have a database in which situation-related data according to various categories related to external conditions are stored. Then, the transmitted status signal is compared with the situation-related data to find the data with the highest matching level. The comparison unit 12 may store the context-related data as a sound signal in a specific frequency band. The sound signal form of a specific frequency band may be, for example, a short beep sound, a message form or a specific melody form. The retrieved data may then be transmitted to the control unit 13 incorporated in the multimedia device 10. [

1A can correspond to, for example, the analysis unit 11 and the comparison unit 12, and the status signal can be transmitted first to the analysis unit 11 or first to the control unit 13 . In practice, the control unit 13, the analysis unit 11 and the comparison unit 12 can form one integrated unit. The adaptive unit described above can be included in the comparison unit 12 or can be installed separately.

According to the present invention, the external situation signal and the multimedia generation signal can be distinguished through energy size, source detection, frequency analysis, or waveform analysis. On the other hand, the external situation signal can be distinguished according to the type of noise included. The external situation signal and the multimedia generation signal can be distinguished in various ways. And the external situation signal can be appropriately converted in a suitable way such as frequency conversion, conversion to a corresponding signal such as a message, or conversion of energy, and can be delivered to the user when necessary.

Not all situation signals need to be searched in the comparison unit 12. The analysis unit 11 may store predetermined signal data. And may transmit directly to the hearing aid 20 via the communication unit 16 if one of the predetermined signal data is generated. For example, a ringing sound generated in the multimedia device 20 itself or a car horn sound of a relatively constant size or more coming from a specific direction may be transmitted directly to the hearing aid 20 through the communication unit 16. [

The fitting data 14 may be stored in the multimedia device 10 or the hearing aid 20. The fitting data 14 means hearing data of the user. Generally, a hearing aid user does not recognize a sound signal of a specific frequency band in an audible frequency band. On the other hand, even if it is not a hearing aid user, there may be a frequency band or tone having a high recognition level. The control unit 13 can directly convert the situation signal transmitted from the analysis unit 12 based on the fitting data 14 and transmit it to the communication unit 16. [ Here, the fitting data 14 is used in a broad sense including data relating to a user's preferred sound signal, including fittings applied in the hearing aid field.

The control unit 13 can transmit the status signal to the hearing aid 20 and output it via the status output means 15 itself. For example, a status signal may be displayed on a display window of the multimedia device 10 or a status signal may be transmitted to the user through means such as vibration. And the signal transmitted to the hearing assistant device 20 may be output in a controlled manner.

1B, a situation signal may be transmitted directly to the hearing aid 20 via the communication unit 16 or via the microphone device S2. As described above, a sound-like status signal installed in the hearing aid device 20 itself may be transmitted to the multimedia device 10 or to the output control module 212 of the hearing aid device 10. [

According to the present specification, the communication unit 16 means a communication means or a wired communication means capable of short-range wireless communication between the multimedia device 20 and the hearing aid device 10. [ For example, Bluetooth communication.

The signal transmitted to the hearing aid device 10 may be divided into a normal signal 211a, a predetermined signal 211b and an exceptional situation signal E. [ The normal signal 211a may be the same as a multimedia signal in the multimedia device 10, such as a multimedia signal. And the predetermined signal 211b may be, for example, a signal set by a user stored in the multimedia device 10 or the hearing aid 20. For example, location information searched by the multimedia device 10, a signal set to be generated at a predetermined time, or a call reception signal of the multimedia device 10. [ The form of the signal may be predetermined or may be detected by the detection unit 18. The detection unit 18 can detect the signal form and the detection can be performed by a method of converting the signal into the separated form and transmitting the signal in the multimedia device 10, for example. In addition, detection can be detected by the device into which the signal is being received. For example, if a sound signal is input through the microphone device S2 provided separately to the hearing aid device 20, the signal corresponds to the exception signal 211c.

The normal signal 211a and the predetermined signal 211b may be transmitted to the direct output control module 212. [ On the other hand, the exception condition signal 211c may be transmitted to the output control module 212 via the exception analysis unit 212d. The exception analysis unit 212d is for determining the output type according to the characteristics such as the type or size of the exception state signal 211c, for example, whether it corresponds to an urgent exception signal or a general exception state signal Can be determined. The output form may be changed according to the characteristics of the exception condition signal 211c. For example, if the exception signal 211c is urgent, the normal signal 211a may be output to the null output 211b and the exception signal 211c may be output through the speaker 22a. The output determination unit described above may include the output control module 212 and the exception analysis module 212d may be included in the adaptation unit.

The output method is determined by the output control module 212 and at the same time the status signal can be converted into a specific frequency band signal by the signal conversion unit 212a. Also, a status signal may be delivered in the form of a message by the matching message unit 212b. The output control module 212 determines the output format of the status signal. The output form of the output control module 212 may reduce the size of the normal signal 211a, for example, to delay the status signal appropriately 221a, or to output the null output 221b. The normal signal 211a can be erased or the null output 221b can be generated as needed. On the other hand, the output control module 212 may generate a stimulus signal through the stimulus signal unit 19. [ For example, by applying a stimulus signal at a predetermined period, the user's attention can be raised in the process of listening to music. The stimulus signal may be, for example, an electrical signal or a vibration signal. Such a stimulus signal can be applied in the user's walking process or in the long-term use of the transportation means. On the other hand, the user can set such a stimulus signal to be generated when a predetermined situation signal is input. For example, such a stimulation signal may be set to be generated when reaching a crossing during a walk, reaching a predetermined destination, or when a specific sound is introduced in the process of using public transportation.

In various manners, the output control module 212 may control the output of the normal signal 211a, the predetermined signal 211b, and the exception status signal 211c, and the present invention is not limited to the embodiments shown.

An embodiment of the structure in which the multimedia device 10 and the hearing aid 20 are connected is described below.

FIGS. 2A, 2B and 2C illustrate various embodiments in which a hearing aid according to the present invention is connected to a multimedia device.

Referring to FIG. 2A, a hearing aid 20 such as a hearing aid can be controlled by the multimedia device 10. The multimedia device 10 may have a control application 17 for controlling the hearing aid 20 and the control application 17 may include a function control unit 171 and a fitting control unit 172 . In addition, the hearing aid 20 may be, for example, an ear-set or a headset, and a hearing aid installed in the earphone may be installed if necessary. The hearing assistant device 20 may have a first microphone 24a for receiving a sound signal transmitted from the multimedia device 10 and a second microphone 24b for directly receiving a situation signal generated from the outside. The multimedia device 10 and the hearing aid device 20 may communicate via a communication unit 16, such as a near field communication means or a Bluetooth communication. Alternatively, the multimedia device 10 and the hearing aid 20 may be connected by wire.

As described above, a multimedia sound signal reproduced on the multimedia device 10 by the hearing assistant device 20, a generated call signal, or an incoming situation signal may be transmitted through the communication unit 16. And each signal can be appropriately processed by the hearing aid 20 depending on the situation.

FIG. 2B illustrates an embodiment in which the hearing aid 20 is a wireless hearing aid, and FIG. 2C illustrates an embodiment in which the hearing aid 20 is a headset having a hearing aid function.

2B and 2C, the multimedia device 10 may be provided with a connector 18 that can be connected to an external device, and a communication dongle such as a wireless dongle may be installed. A signal of the multimedia device 10 may be transmitted (TR) to the hearing aid 20 through a wireless dongle. The hearing assistant device 20 may have an interface 27 capable of inputting the necessary operating commands on its own and may have the communication unit 16. [ If desired, the hearing aid 20 may have an independent power supply or be supplied with necessary power from the multimedia device 10. [

A signal that has been transmitted (TR) through the communication unit 16 or a normal signal, a predetermined signal, or a situation signal transmitted through the second microphone 24b may be transmitted to the digital signal processor 21. The digital signal processing processor 21 may include an output control module as described above.

The signal transmitted through the second microphone 24b may be converted by the A / D converter 211 and transmitted to the digital signal processor 21.

According to the present invention, the memory 215 can be installed in the hearing aid 20. The memory 215 may store voice data related to the status signal. The voice data stored in the memory 215 can be called based on the information transmitted from the multimedia device 10 or the signal input through the microphone 24b. The invocation of the data stored in the memory 215 may be accomplished through a process similar to the invocation of data stored in the comparison unit described above. If necessary, the data stored in the memory 215 can be stored in voice data set by the user or audio data suitable for the hearing of the user.

The signal processed by the digital signal processing processor 21 can be transmitted to the user via the speaker 22a via the D / A converter 213 in a controlled form. As shown in FIG. 2C, the signal may be amplified by, for example, frequency band by the adaptive conversion unit 214 and output to the speaker 22a. The adaptive transform unit 214 may have a function of performing linear amplification or non-linear amplification of the transmitted signal. The adaptive transformation unit 214 may have a frequency shift function or a positive control function. The amount of control includes, for example, imparting a delay effect to the sound delivered to both ears according to the location of the source.

The multimedia device 10 and the hearing aid device 20 may be connected in various ways and the present invention is not limited to the embodiments shown.

Hereinafter, an operation example of the hearing aid according to the present invention will be described. FIG. 3 shows an embodiment of a method for controlling the operation of a hearing aid according to the present invention. Referring to FIG. 3, a method of controlling the operation of a hearing aid in a multimedia device-linked manner includes setting an interface between a hearing aid and a multimedia device (S31); A step (S32) in which an external environmental condition is introduced; A step S33 of analyzing and comparing the influxed external environmental conditions; A step (S34) of judging whether or not a warning condition is satisfied according to the analysis result and the comparison result; Determining a recognition method according to the determination result (S35); And controlling the output of the hearing assistive device, wherein the external environment condition is introduced from the multimedia device or from the hearing aid device, and the control of the output is performed by the hearing aid device, .

The setting (S31) of the interface between the multimedia device and the hearing aid includes such things as communication means, a method of controlling a hearing aid, or driving an application related to a hearing aid in a multimedia device. The operating conditions of the hearing aid itself must be set together with the interface settings of the multimedia device. For example, if a user of a hearing aid does not recognize the sound of a particular frequency band, it is necessary to convert the sound signal coming from the microphone of the multimedia device or the hearing aid device into the user's audible frequency band. In addition, a method of processing an urgent signal or an occurrence period of a stimulus signal among the exception signal described above can be set in advance. In addition, a setting may be made to convert the status signal to a frequency band most suitable for the user. However, such a setting may be predetermined and automatically performed by the multimedia device or the hearing aid itself.

When the hearing assistant device is activated (S31), a normal signal or a status signal may be input through the microphone of the multimedia device or the hearing aid device (S32). The incoming situation signal can be extracted, analyzed, and compared (S33), and it can be determined whether it corresponds to the progress status according to the analysis and comparison result (S34). If the warning condition is not satisfied (NO), the environmental condition influx process S32 may be continuously performed (S32). On the other hand, if it is the case that the warning is generated (YES), the method of recognition can be determined (S35). The determination of the recognition method determines the method of transferring the incoming sound source as it is, the method of transferring by frequency conversion, the method of transferring to be converted into a message, the method of transferring to predetermined warning sound, . Or the method of completely destroying the normal signal, the method of reducing the volume of the normal signal, the method of delivering by time delay, or the method of repeatedly transmitting. As described above, the determination of such a method can be done by the output control module.

If the recognition method is determined (S35). Conversion or matching may be performed (S36). The conversion means that the user is converted into an audible frequency band, converted into a beep sound, or converted into a predetermined message form. Means searching for the same or similar voice message stored in the storage medium with respect to the incoming context signal.

The converted or matched signal may be transmitted to the user through the multimedia device control S371 or the hearing aid device control S372 at step S38. The alarm generation (S38) may include, for example, a text message popup in the multimedia device, a voice signal transmission in a hearing assistive device in a specific frequency band, a voice message transmission in a hearing assistance device, or a stimulation signal generation.

As described above, the occurrence of a warning can be judged by measuring a change in sound energy or sound value. If the energy or power value of the same kind of signal continues to exceed the predetermined time range while the change value with time increases beyond the predetermined range, it can be judged that the alarm occurrence situation exists. In addition, the warning signal of the amplified type can be transmitted to the user depending on whether the warning situation continues or increases. In addition, the output control of the hearing aid may include controlling the relative size of the information coming from the external environment and the information coming from the multimedia. Control of the output includes control of a signal transmitted from the multimedia device according to occurrence of an elapsed situation and control of a signal transmitted from the multimedia device according to the user's need.

Whether or not an elapsed state occurs can be judged by various methods, and the output control can be performed in various ways, and the present invention is not limited to the embodiments shown.

In various ways, the hearing aid according to the present invention can be operated in conjunction with a multimedia device, and the present invention is not limited to the embodiments shown.

The hearing aid according to the present invention has an advantage that the user can appropriately respond to the external environment by generating a signal regarding the external environment depending on the use environment. The hearing aid according to the present invention is advantageous in that the hearing aid can be miniaturized and its function can be expanded by linking with the function of the multimedia device. In addition, the hearing aid according to the present invention has an advantage that it can be used irrespective of the multimedia device connected by controlling the output of the auxiliary device itself. In addition, the hearing aid according to the present invention may cause a difference in the degree of perception of the surrounding environment and the surrounding environment depending on the degree of hearing, and may cause a problem due to an unsatisfactory response to the external environment or situation that may occur according to the use of multimedia Can be solved.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention . The invention is not limited by these variations and modifications, but is limited only by the claims appended hereto.

P12: Control unit P13: Characteristic DB
P14: Classification unit P15: Output determination unit
P16: Adaptive unit P111: Multimedia
P112: Environmental situation
P171: Environment output unit P172: Multimedia output unit
100: Hearing aid system
10: Multimedia device 11: Analysis unit
12: comparison unit 13: control unit
14: Fitting data 15: Output means
16: communication unit 17: control application
18: Detection unit 20: Hearing aid device
21: Signal processing processor 19, 22a: Output unit
24a, 24b: microphone 27: interface
212: output control module 214: adaptive conversion unit
215: Memory

Claims (8)

delete delete delete delete Setting an interface between the hearing aid and the multimedia device;
A step in which an external environmental situation is introduced;
Analyzing and comparing the incoming external environment situation;
Determining whether a warning condition is met according to the analysis result and the comparison result;
Determining a recognition method according to the determination result; And
Wherein the output of the hearing aid is controlled,
Wherein the external environment condition is input from the multimedia device or from the hearing aid device, and the warning condition is that the energy or power value of the same or similar type of signal exceeds a predetermined range with a change in the time, The method comprising the steps of: determining whether the hearing assistant device is in a state of continuing beyond a predetermined range; The method according to claim 5, wherein the external environment condition includes position information, image information, or operation time of the multimedia device obtained from the multimedia device. The method according to claim 5, wherein the step of determining the recognition method further comprises a step of converting to a specific frequency band or converting into a matching message. The method of claim 5, wherein the step of controlling the output of the hearing aid comprises controlling the relative size of the information input from the multimedia environment to the information from the external environment context .

Images