KR20170025495A

KR20170025495A - Hearing aid of communicating with mobile terminal

Info

Publication number: KR20170025495A
Application number: KR1020150121995A
Authority: KR
Inventors: 문석민
Original assignee: 문석민
Priority date: 2015-08-28
Filing date: 2015-08-28
Publication date: 2017-03-08

Abstract

Disclosed is a system which includes a hearing aid which selectively removes at least one among a microphone, a preamplifier, an ANTI aliasing filter, an A/D converter, a digital filter, a microprocessor, and a D/A converter, and has a wireless communication means; and a mobile terminal which performs a function in place of the removed function and provides a processed signal to the hearing aid by using the wireless communication means. So, it is possible to miniaturize the hearing aid, and reduce the manufacturing cost of the hearing aid.

Description

[0001] HEARING AID OF COMMUNICATION WITH MOBILE TERMINAL [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a hearing aid communicating with a mobile terminal, and more particularly, to a technology for downsizing a hearing aid to a low cost by utilizing the hardware processing capability of the mobile terminal.

Various mobile terminals such as a smart phone, a portable electronic device, and a tablet PC are used, and various applications are installed in a mobile terminal. In particular, recent mobile terminals have considerably better hardware processing performance, and users can utilize the functions of various applications by using such mobile terminals.

The hearing aid electrically amplifies the external sound using a microphone, converts the amplified signal into sound, and outputs it through the earphone. Such hearing aids include amplifiers, filters, A / D converters, microprocessors, D / A converters, and the like.

In addition, hearing instrument manufacturers want to reduce their hearing aids to lower cost by implementing amplifiers, filters, A / D converters, microprocessors, and D / A converters through integrated circuits.

However, there are limitations in lowering the manufacturing cost of a hearing aid, which essentially includes an amplifier, a filter, an A / D converter, a microprocessor, a D / A converter, and the like, or miniaturizing a hearing aid.

The present invention omits at least some of the components included in the hearing aid, while allowing the mobile terminal to perform the function of the omnidirectional hearing aid in place of the hearing aid, thereby downsizing the hearing aid and reducing the manufacturing cost of the hearing aid.

The present invention omits at least a part of the configurations included in the hearing aid, while allowing the mobile terminal to perform the function of the configuration omitted from the hearing aid in place of the hearing aid. Here, the hearing aid and the mobile terminal communicate using various wireless communication means such as short-distance communication, infrared communication, and WI-FI.

1 is a block diagram showing a conventional hearing aid.
2 is a block diagram illustrating a hearing aid according to an embodiment of the present invention.
FIG. 3 illustrates operations of a hearing aid and a mobile terminal according to an embodiment of the present invention.

1 is a block diagram showing a conventional hearing aid.

Referring to FIG. 1, a conventional hearing aid receives sound through a microphone, and amplifies the received sound through a preamplifier by a user or by a basic setting of a hearing aid. The amplified signal passes through the ANTI aliasing filter and is then converted to digital values by the A / D converter.

At this time, the digital filter performs filtering based on various parameters preset by the user or by default setting of the hearing aid. The digital filter performs filtering in conjunction with the microprocessor, and the output of the digital filter is converted into an analog signal by the D / A converter. The analog signal is output via the speaker / earphone via the ANTI imaging filter.

The integration of these components into a hearing aid not only increases the cost of manufacturing the hearing aid, but also makes miniaturization of the hearing aid difficult.

2 is a block diagram illustrating a hearing aid according to an embodiment of the present invention.

Referring to FIG. 2, the hearing aid may include only a minimum number of components. However, those skilled in the art can add the various components described with reference to FIG. 1 to the hearing aid. For example, those skilled in the art will appreciate that, depending on the embodiment (depending on the required manufacturing cost or the size of the hearing aid), at least one of a microphone, a preamplifier, an ANTI aliasing filter, an A / D converter, a digital filter, May be selectively included in the hearing aid.

However, the hearing aid according to the embodiment of the present invention may include various wireless communication means such as short-range communication, infrared communication, WI-FI, and the like. For example, as shown in FIG. 2, the hearing aid may include a Bluetooth module and may include an audio codec.

2 is an embodiment of the present invention, and a person skilled in the art can substitute various functions of a hearing aid using a mobile terminal, so that a hearing aid can be manufactured at a small price with low cost.

In addition, the mobile terminal performs functions of a microphone, a preamplifier, an ANTI aliasing filter, an A / D converter, a digital filter, a microprocessor, and a D / A converter included in a conventional hearing aid, To the hearing aid.

As a result, since the mobile terminal and the hearing aid cooperate with each other and some functions of the hearing aid are implemented through the hardware resources of the mobile terminal, the hearing aid can be manufactured at a lower price and in a smaller size.

FIG. 3 illustrates operations of a hearing aid and a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 3, after wearing a hearing aid, a user executes an application installed in a mobile terminal (smart phone). At this time, the application installed in the mobile terminal recognizes the hearing aid and the user, and brings up the settings for the hearing aid and the user. Of course, if there is no such setting, the hearing aid and the user are subjected to the hearing loss analysis and the appropriate parameters are set.

Thereafter, the hearing aid senses the sound and transmits it to the mobile terminal, and the mobile terminal processes the transmitted signal and transmits the signal processed by the hearing aid.

The hearing aid structure is connected to the hearing aid module 11 and the hearing aid module 11 having at least one microphone 112a, 112b, 113a and 113b and at least one receiver 111a and 111b by wire or wireless, A control module 12 having a signal processing processor 121 and an input and output socket 122 capable of transmitting and receiving signals to and from the hearing aid module 11 through a communication connector 124, And a connection connector 123 for enabling the module 12 to transmit and receive signals to and from the mobile phone 13.

In this specification, the hearing aid module 11 comprises a microphone 112a, 112b, 113a, 113b and receivers 111a, 111b or a pre-amplifier for input gain control, And may include at least one of a variety of devices known in the art, such as power amplifiers, receivers, switches, batteries, and ear hooks for obtaining output gain control. However, the function of such a component can be realized in hardware or software form in the control module 12 or the mobile phone 13 described below, and in such a case, the hearing aid module 11 does not have an associated device or program . In the following description, devices known in this field are not described in detail. In the case where the component has a functional or structural characteristic, the description thereof is specifically disclosed. In this specification, the hearing aid module 11 means one hearing aid or two hearing aids that can be worn on different ears.

The receivers 111a and 111b may be two so that they can be mounted on different ears. For example, hearing aids may be used for both ears if bilateral hearing loss is present. Signals having different amplification ratios can be received in the pair of receivers 111a and 111b and signals received in the pair of receivers 111a and 111b can be independently transmitted or transmitted with relevance .

The microphones 112a, 112b, 113a and 113b correspond to the respective receivers 111a and 111b and may be one or more. Although two microphones 112a, 112b and 113a and 113b are shown for each of the receivers 111a and 111b in the illustrated embodiment, one or three microphones may be provided for each of the receivers 111a and 111b . Each of the microphones 112a, 112b, 113a, and 113b may be omni-directional or directional. When a pair of microphones 112a, 112b, 113a, and 113b are installed in the receivers 111a and 111b, the directivity and the signal-to-noise ratio can be improved.

The communication connector 124 may be a connection jack for wired communication or a Bluetooth chip for enabling short-range wireless communication, for example. The communication connector 124 enables wired or wireless communication between the hearing aid module 11 and the control module 12. [ When the communication connector 124 becomes a connection jack, two hearing aids that can be worn on different ears can be connected. Further, when the communication connector 124 is a short distance communication chip, two hearing aids can communicate with the control module 12 via the communication connector 124, respectively. The communication connector 124 may be included in the hearing aid module 11 or the control module 12 although the communication connector 124 is disclosed in the embodiment as a separate device separate from the respective hearing aid or control module 12. [ The communication connector 124 may be any wired / wireless device connection means known in the art and the present invention is not limited to the embodiments shown.

The control module 12 is functionally connected to the mobile phone 13 so that the control module 12 can transmit and receive signals or data with the mobile phone 13. [ The mobile phone 13 herein includes a cellular phone, a communicatable personal digital assistant or a smart phone.

The control module 12 may include, for example, a fitting function, a signal to noise ratio (S / R) enhancement function, a beam forming function, a binaural hearing processing function, Function and may have an apparatus or a program-type algorithm for performing such a function. The control module 12 may also have a re-fitting alarm at the point in time when re-fitting is required, allowing for individual fitting. The above functions of the control module 12 can be processed in the hearing aid module 11 or the mobile phone 13. [ In order to perform such functions, the control module 12 may have a signal processing processor 121 in which an algorithm or a program having a predetermined function is stored, and an input / output socket 122 for input / output of a signal.

The signal processor 121 processes the signal received from the hearing aid module 11 and can transmit the signal to the mobile phone 13 through the input / output socket 122 as necessary. Also, it is possible to receive an instruction or data transmitted from the mobile phone 13 through the input / output socket 122 and transmit it to the hearing aid module 11 or to control the operation of the hearing aid module 11. [ In addition, the signal processing processor 121 may cause a specific function to be executed in the mobile phone or the smartphone 13, and a signal having such a function may be transmitted to the hearing aid module 11. [ For example, the signal processing processor may cause a program for control to be applied to the respective hearing aid module 11 in the mobile phone or the smartphone 13 to be driven and store an execution program related to the control accordingly. When an external voice is inputted through the microphones 112a, 112b, 113a, and 113b, the execution program can be operated and output through the receivers 111a and 111b.

The input / output socket 122 may receive a signal transmitted from the mobile phone 13 and convert the received signal into a signal that can be processed by the control module 12 as needed, or may remove noise. The input / output socket 12 may take various forms according to the type or structure of the signal processor 121.

The connection connector 123 may be a jack or gender with a plurality of communication pins that allow it to be connected to the mobile phone 13, The connector can be a connector in the form of a connector. When the connection connector 123 is connected to the mobile phone 13, the control module 12 is ready to communicate with the mobile phone 13, A command or instruction for operation may be input. In other words, the control module 12 can be controlled by the mobile phone 13 and the functions required in the hearing aid module 11 can be executed.

The hearing aid structure according to the present invention is configured such that the hearing aid module 11 is extended by the control module 12 connecting the hearing aid module 11 and the mobile phone 13, So that it can be controlled.

The control module 12 will be described in detail below.

The control module 12 may include a communication connector 124, a signal processing processor 121, an input / output socket 122 and a connection connector 123 as described above, Or an antenna for reception.

On the other hand, the control module 12 comprises a pre-processor 14 for converting the input signal SIG into a signal which can be processed by the control module 12 or for determining the input direction of the signal, A microprocessor (not shown) in which the predetermined sound or voice information is stored and which is stored in the mobile phone 13 or the control module 12, or a microprocessor (not shown) in the hearing aid module 11, A signal input from a comparator 151, a mobile phone 13 or a microphone (not shown) for comparison with the input sound, voice or a signal input from the mobile phone 13 from the central processing unit C A converter 152 for converting the processed signal or converting the processed signal in the control module 11 into a signal that can be processed in the mobile phone 13 or the hearing aid module 11 and a processed signal V 13) or a hearing aid An output unit 153 for outputting to the module 11 may comprise.

The pre-processor 14 functions to convert, for example, a signal input from the mobile phone 13 into a signal that can be processed by the control module 12 or vice versa. This function of the pre-processor 14 may be provided by the transducer 152. The pre-processor 14 may also determine the direction in which the signal is input. The input direction of the signal can be determined depending on whether or not a signal is received from the mobile phone 13 or the control module 12. [ On the other hand, the pre-processor 14 can directly convey the received signal to the comparator 151. [ The pre-processor 14 is not necessarily installed and may be used by the converter 152, the central processing unit C or the comparator 151 to take charge of some or all of the functions of the pre-processor 14 have. Such a function may be performed by an application program stored in advance in the mobile phone 13 as needed.

The comparator 151 may store various types of pre-stored sound, voice, or information associated with the signal. For example, a bell sound of a porch, a TV sound, a fire alarm sound, a telephone call sound, a specific signal that the user has stored in advance to recognize a specific object or person, sound or voice may be stored. If such a signal, sound or sound is input through the mobile phone 13 or the microphones (not shown) installed in the control module 12, the comparator 151 can compare the signal with the pre-stored signal, The related information can be converted into a voice signal and transmitted to the hearing aid module 11. If necessary, the comparator 152 may be set to operate only when a sound of a predetermined decibel (dB) or more is input.

The control module 12 can be set to have various functions, and the embodiments are illustrative, and the present invention is not limited to the embodiments shown. On the other hand, a certain function of the comparator 12 can be executed in the mobile phone or smartphone 13. For example, if the mobile phone or the smartphone 13 is connected, the function of the comparator 151 may be set to be executed in the mobile phone or the smartphone 13.

The result processed by the control module 12 becomes an output signal V and can be transmitted to the hearing aid module 11 or the smartphone 13 through the output unit 153. [ The output direction may be determined in advance by the central processing unit C or may be determined in the output unit 153 itself according to the signal form.

The control module 12 controls the hearing aid module 11 so that the function of the hearing aid module 11 can be expanded by itself or by using the mobile phone 13 while connecting the hearing aid module 11 with the mobile phone or the smartphone 13. [ do. Thus, the hearing aid module 11 can be miniaturized and reduced in power consumption, and the hearing aid module 11 can have a function that can not be obtained due to structural limitations.

An embodiment in which the functions of the control module are executed will be described below.

Although a description of the smartphone 23 is provided below as a mobile phone, various types of portable electronic devices capable of communication in place of the smartphone 23 can be used in place of the smartphone 23.

Left microphone (212a, 212b) or right microphone (212a, 212b) provided in the hearing aid module (21) allows the ambient acoustic signal to be input through the hearing aid module (21). The input signal via the hearing aid module 21 can be processed in the signal processing processor of the control module 22 described above (MR1, MR2). For the input signals MR1 and MR2, the signal processing processor can drive an algorithm for forming a beam based on the right microphone signal, for example, using a signal input from the left microphones 212a and 212b as an underlying signal . Further, a beam forming filter may be applied to the input signals MR1 and MR2 to have directivity. Further, a finite impulse response (FIR) filter may be applied to remove feedback signals input through the microphones 212a and 212b. If necessary, the input signals MR1 and MR2 can be transmitted to the comparator. When the input signals MR1 and MR2 are substantially transmitted from the left side and the signal transmitted from the right side is only noise, the signals transmitted through the right microphones 212a and 212b can be processed as noise. The input signals MR1 and MR2 may be signal processed and transmitted to the receivers 211a and 211b. The input signals MR1 and MR2 may be independently processed or processed to have correlation. A signal processed by an independent signal is input to one of the microphones 212a and 212b and a signal input to the other microphones 212a and 212b removes sound input from the remaining microphones 212a and 212b when the signal corresponds to noise . Or when a signal input from one of the microphones 212a and 212b and a signal input to the remaining microphones 212a and 212b correspond to separate sound sources, respectively. On the other hand, in order to be correlated, the sound generated from one sound source is input to the left and right microphones 212a and 212a at the same time or with a time difference, and the difference is shown in both receivers 211a and 211b Which means that a signal should be sent. For example, the sound energy can be adjusted according to the time difference according to the input sound, and the sound energy can be transmitted to both hearing aids at different amplification ratios. As described above, the control module 22 according to the present invention can process signals input from both microphones 212a and 212b of both hearing aids simultaneously or with a time difference independently or with correlation. As a result, the processed signals can be received by the receivers 211a and 211b, respectively, independently or with a correlation.

The above functions of the control module 22 can be processed in the smartphone 23. [ Specifically, the signal MR1 input from one of the microphones 212a and 212b may be transmitted to the smartphone 23 without being processed by the control module 22 (R1). The signal MR2 input from the remaining microphones 212a and 212b may also be transmitted to the smartphone 23 via the control module 22 (R2). The signal M processed by the smartphone 23 is transmitted to the control module 22 again. The input signals MR1 and MR2 may be transmitted to the receivers 211a and 211b both independently or with correlation after being processed in the control module 22 or processed in the smartphone 23. [ As described above, the control module 22 according to the present invention controls the receivers 211a and 211b in the form of a beam forming function or a quantity controlled by the control module 22 itself or through the smartphone 23 with respect to the input signals MR1 and MR2 To be delivered.

The control module 22 according to the present invention allows individual fitting to the hearing aid module 21. [ The individual fittings 22 may be implemented in the control module 22 or may be implemented in the smartphone 23 as described above. However, in order to reduce the load of the control module 22, fitting can be performed by driving the relevant application program in the smartphone 23 preferably. Or only the timing of, for example, re-fitting, from the control module 22 to inform the user.

When a hearing aid is used in connection with the smartphone 23 or from another device such as a TV or a sound device connected to the smartphone 23 or music from the smartphone 23 via the smartphone 23, The beam forming or binaural hearing processing may be performed through the control module 22 in the hearing aid structure according to the present invention. On the other hand, if the smartphone 23 and the control module 22 are capable of wireless communication such as Bluetooth communication, beam formation or amount control is performed in the same manner as described above to hear the surrounding sound, Can be transmitted to the hearing aid module 21 via the control module 22.

The hearing aid structure according to the present invention enables some or all of the beam forming function, fitting function, or amount control function to be processed in the smartphone 23, as described above. For example, if a fitting-related application program can be executed in the smartphone 23, the result can be stored and applied to the hearing aid module at a later time. As described above, the control module applied to the hearing aid structure according to the present invention makes it possible to share functions with the smartphone 23.

The operation of the hearing aid structure having such functions will be described below.

For the operation of the hearing aid structure, the hearing aid module can be connected to the mobile phone either wired or wirelessly through the control module (P31). Functions such as a fitting function of a hearing aid or listening to an external electronic device can be selected by the user (P32). On the other hand, the beam forming function or the amount controlling function of the control module or the mobile phone can be set to be performed automatically in conjunction with the connection in either one.

It should be determined whether the selected function will be executed in the control module or mobile phone. For example, it is advantageous for the beam forming function to be executed in the control module and the fitting function to be performed in a function sharing manner in which the control module and the mobile phone bear a certain area.

If the corresponding function is executed in the control module (NO), the process of setting the function key for operating the corresponding function in the mobile phone may proceed (P342). Thereafter, the function selected by operating the function key is executed (P352) and then the selected function can be terminated (P37).

On the other hand, if the selected function is executed in the mobile phone or the function is executed together with the control module (P341), the related application program may be activated in the mobile phone (P341). After that, the function key is set in the mobile phone (P351), the selected function can be executed by the operation of the function key (P361), and the operation of the mobile phone may be terminated when the function is completely executed (P37).

The hearing aid structure according to the present invention can functionally be linked with a mobile phone through a control module so that the function of the hearing aid can be expanded.

The hearing aid structure according to the present invention enables relevant information to be transmitted to the hearing aid module by voice when a specific external sound is input.

The external sound may be input through the hearing aid module, the control module or the mobile phone (P41). The incoming sound may be transmitted to a comparator of the control module or to a comparator installed in the mobile phone, and the comparator determines whether the incoming sound corresponds to a preset condition (P42). For example, the comparator can determine whether the incoming sound is above a certain decibel level. If it is not within the permissible range (NO), the operation of the control module due to the negative influx is terminated (P47).

On the other hand, if the incoming sound meets a predetermined condition such as, for example, a predetermined decibel level or more (YES), the incoming sound is converted into a signal that can be processed by the control module, (P43). &Lt; / RTI > If the signal stored in the comparator is found (P43) and a signal matching the input signal is found, it is determined whether or not the signal matches the previously stored information (P44). The search process P43 and the matching function P44 may be performed in one process. However, the retrieval process P43 is a process for determining whether or not the matching process P44 is an exact match, for example, only an approximate match such as a pattern or a height of an incoming sound. Such a process is intended to reduce errors when an external person or external organization, such as a fire alarm, needs to act. When the matching is not possible (NO), the situation due to the inflow of the external sound is terminated (P47). On the other hand, if there is pre-stored information that matches the incoming external sound (YES), the previously stored information can be converted into a signal that can be processed by the control module (P45) and transmitted to the receiver as voice information (P46). Operation of the mobile phone or the control module may then be terminated (P47). The external tone may be, for example, a doorbell, a call incoming tone or an alert tone, and a voice signal associated with the incoming tone may be a voice that conveys the situation. The comparator may be installed in the control module or installed in the mobile and may be included in hardware or software form.

The illustrated embodiment is illustrative and various functions that are operable in a mobile phone and beneficial to the operation of a hearing aid can be implemented using the control module.

The hearing aid structure according to the present invention allows a hearing aid module having a simple structure to be connected to a mobile phone such as a smart phone through a control module having various functions so that the function of the hearing aid can be expanded. The control module is connected to a hearing aid module and is connected to a mobile phone such as a smart phone as needed to realize various functions required for a hearing aid.

The hearing aid structure according to the present invention has an advantage that a function of a mobile phone or a smart phone is utilized for operation or control of a hearing aid, so that the hearing aid can be miniaturized and a low-power structure can be expanded. Further, the hearing aid structure according to the present invention has a merit that the functions available in a high-performance smartphone can be realized in a hearing aid, thereby simplifying the structure of the hearing aid and at the same time enabling the necessary functions to be exercised without being limited to the hearing aid structure. In addition, the hearing aid structure according to the present invention has an advantage in that the manufacturing cost of a high-performance hearing aid can be reduced by utilizing a smart phone, and generalization of the use of a hearing aid capable of beam forming function or amount control is enabled. In addition, the hearing aid structure according to the present invention has an advantage that a user of the hearing aid can set and execute an individual function suitable for the hearing aid user.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, . The invention is not limited by these variations and modifications, but is limited only by the claims appended hereto.

Claims

A hearing aid selectively removing at least one of a microphone, a preamplifier, an ANTI aliasing filter, an A / D converter, a digital filter, a microprocessor, and a D / A converter; And a mobile terminal that processes the removed function in place of the removed function and provides the processed signal to a hearing aid using wireless communication means.