JP3482465B2 - Mobile fitting system - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mobile information communication device such as a mobile phone such as a mobile phone and a PHS, and a personal computer (in the present specification, these are collectively referred to as "mobile device"). A mobile fitting system that is connected to a hearing diagnosis device via a network and is capable of performing optimum sound quality characteristic fitting (referred to as "sound quality fitting" in this specification) in consideration of hearing characteristics of a mobile device user. Regarding

[0002]

2. Description of the Related Art A conventional hearing compensator is shown in FIG. 7 (for example, Japanese Patent Laid-Open No. 10-1741).
95). In this hearing compensator, the hearing aid 10
At 0, the hearing characteristics of the user and the normal hearing person are stored in the storage means 107 and the sound pressure range most easily heard by the user is stored in the gain calculation storage means 111 from the fitting device 109 in advance. The hearing data stored in the storage unit 107 is the minimum audible value of a hearing-impaired person and a hearing-impaired person, and the data stored in the storage unit 111 for gain calculation is the sound pressure level that is most easily heard by the user.

At the time of fitting, the sound pressure level that is most audible to the user for each frequency required for setting is checked. The input sound captured by the microphone 101 is converted into digital data by the input means 102. The input data is buffered by the input means 102 as necessary and sent from the analysis means 103 to the hearing compensation means 104. The analysis means 103 analyzes the input data by a fast Fourier transform or the like, calculates the power for each frequency band, and sends the analysis result to the control means 105. The control means 105 determines the amplification factor for each frequency band required by the hearing compensating means 104 from the user's hearing data as a result of analysis of the input data, and the hearing compensating means 10
4. Send the amplification rate data to 4. The hearing compensating means 104, which has obtained the input data and the amplification factor data, performs the hearing compensating process on the input data and sends the processed input data to the output means 106. The output means 106 converts the processed data into analog data and outputs it as sound from the earphone 108.

[0004]

The number of subscribers of mobile phones (mobile phones + PHS) has surpassed that of fixed-line phones and is now in a state of surprising widespread use. Behind the explosive spread, in addition to the conventional role as a voice communication device, the role as a data communication information terminal such as mail and the Internet plays a role. Young people are driving the explosive spread of mobile phones at this stage, but considering their convenience, it is inevitable that they will penetrate deeply into the lives of the elderly and the disabled. For example, as a communication tool such as a media converter that compensates for hearing loss and reads electronic text mail as voice. In addition, it can be said that it is a tool suitable for elderly people and people with disabilities who have deteriorated physical functions as terminals for mobile banking systems that eliminate the need to visit banks and remote controls for network information appliances. Unlike fixed-line phones, mobile phones basically belong to individuals. Therefore, it is suitable for adapting to individual characteristics such as the elderly and the disabled.

[0005] The sound quality of the current mobile phone as a communication tool sacrifices the sound quality such as unclear and interrupted conversation because the number of communication channels has been given priority as the number of subscribers has increased and the amount of transmitted data has been kept low. Is the current situation. In particular, it is very difficult to hear in a noisy environment such as an environment where the mobile phone is used, and it is difficult to say that sufficient intelligibility is secured for a person whose hearing loss is noticeable. On the other hand, IMT-2000, the global standard for next-generation mobile communication systems, is expected to achieve communication qualities that are equal to or better than those of current fixed-line telephone services.

Considering the promotion of mobile phones to the elderly, the current situation is that the research and development of mobile phones considering the hearing characteristics of the elderly have not progressed. Hearing ability declines with age, and since there are large individual differences, it is necessary to fit the sound quality of mobile phone users according to their own hearing characteristics. In utterance, the second formant frequency of vowels of women and children reaches 3kHz, and the consonant component ([n]: 2
Energy is concentrated in high frequencies (~ 3kHz). A high frequency component of 2kHz or more is necessary for clear listening,
After the age of 50, the decline in pure tone hearing with aging becomes noticeable above 2 kHz. Therefore, it becomes difficult to hear the voice of the telephone.

[0007] Senile deafness due to aging is a sensorineural deafness that has no cause other than age, and it is considered that hearing loss due to deafness is large among physiological age changes. Also,
Not only the pure-tone hearing loss but also the distorted rhyme intelligibility is deteriorated. Generally, after 20 years of age, it worsens, but even after 60 years of age, normal hearing may be exhibited, and there are large individual differences.
The hearing image shows a gradual type of treble disorder, and hearing loss begins at high frequencies such as 8000 Hz, and gradually deteriorates in the low range with age. In addition to the physiological function deterioration due to aging, extrinsic effects due to environmental noise are also considered.

Hearing a cell phone over a hearing aid does not improve listening satisfactorily. At present, it has been reported that the radio waves of mobile phones interfere with hearing aids, and the measures are taken by inputting the output of the mobile phone to the hearing aid by line and keeping the mobile phone itself close to the hearing aid, but improvement is desired. That is the point. If you feel any inconvenience in listening, you should consider applying a hearing aid, and for that purpose, a hearing tester that is easy and easy to measure is required. On the contrary,
Current hearing tests and hearing aid fittings require a soundproof test room and hearing test equipment, which raises the threshold, but it is desirable to be able to check easily with your own device such as a thermometer. Hearing loss is gradual and progressive, and the person does not want to see hearing loss. For those who have already lost their hearing, a regular examination confirms that there is no change in hearing, which has a psychological remedy to remove anxiety about hearing deterioration. In addition, periodic inspections and hearing aid fitting operations require fine adjustments over a period of several days. Ideally, you should use several types of hearing aids depending on environmental noise and usage scenes (multi-person meetings, use in theaters and hospitals).

Current hearing aid fittings require a visit to the vendor for hearing aid adjustments and a visit to the hospital for inspection. Regular inspection is required even after the wear is confirmed. Finding the best fitting is not easy and many tweaks are needed to make a fitting fit. Several kinds of hearing aids for each usage environment and purpose,
Fitting is required. Thus, fitting takes time and effort. As a mobile phone for the elderly, a mobile phone with a large button or a large liquid crystal display or a simplified function is available for the elderly to use. In addition, by widening the range of the ring tone or emphasizing the high range of the other party's voice, listening in a noisy place is improved. (NTTDoCoMo Digital Mover P601es, P601ev). As another sound quality improvement, a noise suppressor is being built in the mobile phone and the exchange to significantly cut the noise part (Tucer Cellular Clear Voice System). Also,
With Clear Voice Plus, which is used in some models, 300
In addition to the normal frequency of ~ 3400Hz, by adding a high frequency range up to about 6000Hz, the quality of the real voice is made closer (Tucer Cellular Clear Voice Plus).

Mobile phones are "anytime, anywhere with anyone"
This facilitates communication between people who are far away, as represented by the copy. On the other hand, the current state of communication is that the public's manners are neglected, such as speaking loudly to the surroundings, and the situation and facial expression of the other party cannot be seen, and the other party's situation and ease of hearing are not taken into consideration. is not it. As communication over the telephone increases, the lack of multi-modal direct communication using modes other than hearing, on the contrary, makes it impossible to obtain background knowledge about the other party and check consistency with multi-modal information. For this reason, misunderstandings and beliefs may not be removed and the other person may not be able to understand correctly. In the future, it is expected that there will be scenes where people will be in contact with each other by mobile phone and have a meeting while in the same building or office. In such a situation, if communication with the sense of "anytime, anywhere, with anyone" develops, problems such as misunderstandings and misunderstandings may increase. It is necessary to use a mobile phone that cares for the person you are talking to and the people around you.

The present invention has been proposed to solve the problems of the prior art, and considers the hearing characteristics of the mobile device user in cooperation with the mobile hearing diagnosis system using the mobile device. It is an object of the present invention to provide a mobile fitting system capable of obtaining optimum sound quality characteristics. In addition, the present invention uses a mobile device as a hearing aid diagnostic terminal, estimates voice correction characteristics from a diagnosis result by a hearing aid diagnostic system installed on the Internet, and downloads to the mobile device to automatically perform sound quality fitting of the mobile device. The objective is to provide a system for performing the same. Another object of the present invention is to utilize a hearing characteristic database diagnosed by a mobile hearing diagnosis system.

[0012]

In order to achieve this object, a mobile fitting system according to the present invention connects a mobile device to a server computer and an audio chart database via a network, and operates the mobile device to operate the mobile device. Characterized by enabling sound quality fitting. Also, the mobile fitting system according to the present invention connects the speaker side mobile device and the receiver side mobile device to the server computer and the audio chart database via the network, and operates the receiver side mobile device by operating the receiver side mobile device. It is characterized by enabling sound quality fitting of. Further, the mobile fitting system according to the present invention is characterized in that at least the mobile device on the receiver side is provided with a digital signal processor and a fitting unit for sound quality fitting.

Further, the mobile fitting system according to the present invention is characterized in that the use scene of the mobile device on the receiver side can be selected and inputted. Also,
The mobile fitting system according to the present invention is characterized in that noise is measured by a noise monitor microphone of the receiver-side mobile phone, and a use scene is automatically set. Further, the mobile fitting system according to the present invention monitors the noise in the usage environment through the noise monitoring microphones of the mobile devices on the speaker side and the receiver side, and the noise level is monitored by the mobile device on the speaker side and the receiver side. It is characterized in that the location is less likely to be affected by the noise source and the direction of the user's body is sought by displaying on.

Further, the mobile fitting system according to the present invention estimates the optimum sound quality fitting parameter from the selected usage scene, the acoustic characteristic data of the mobile device, the voice characteristic of the speaker, the hearing characteristic of the listener and the environmental noise. The sound quality fitting parameter can be downloaded to a digital signal processor in a mobile device. In addition, the mobile fitting system according to the present invention is a "speaking list" for the speaker based on the speaker voice characteristics and the listener hearing characteristics registered in the hearing chart database.
It is characterized by creating the following database and automatically giving advice to the speaker side from the list using the voice / character guide for the best way to speak according to the situation. In addition, the mobile fitting system according to the present invention temporarily operates the information home appliance in the low noise mode by exchanging information on the start-up / operating state of the information home appliance between the mobile device and the nearby information home appliance. It is characterized by being able to do so.

Further, the mobile fitting system according to the present invention grasps a change in noise during a call by the noise monitors of the mobile devices on the speaker side and the receiver side, and updates the optimum parameters according to the noise change. It is characterized by having done. In addition, the mobile fitting system according to the present invention is characterized in that the mobile device on the speaker side performs sampling by increasing the gain in the frequency band in which the hearing ability of the receiver is lowered, and transmits based on the result. Further, the mobile fitting system according to the present invention is characterized in that the mobile device on the receiver side controls the gain for each frequency band in accordance with the hearing characteristics of the receiver. In addition, the mobile fitting system according to the present invention is characterized in that the voice of the speaker is multiplied by the hearing characteristic of the listener, converted into a sound quality that the listener actually hears, and fed back to the speaker.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS (Embodiment 1) FIG. 1 shows Embodiment 1 of a mobile fitting system of the present invention, in which this system comprises two mobile phones as call terminals and a sound quality fitting controller. It is composed of a server computer on the Internet network and an audiological chart database (hereinafter referred to as “audiometrical DB”) in which the audiometric characteristic fitting parameters are stored. In FIG. 1, reference numeral 1 denotes a user (patient) side mobile phone that is subjected to sound quality fitting (in the present specification, simply referred to as “listener side mobile phone”), and 2 denotes a speaker side mobile phone (in the present specification). Is simply referred to as a "speaker side mobile phone".) 3 is a server computer and 4 is a hearing chart database. Also, C
01 to C02, the condition selection in step 0 is A01
~ A19 is the sound quality fitting in step 1,
Further, B01 to B18 indicate the voice call in step 2.

Compared with the conventional mobile phone, the receiver-side mobile phone 1 and the talker-side mobile phone 2 are digital for sound quality fitting between the wireless access method processing section and the A / D converter or the D / A converter. The signal processor (hereinafter referred to as "DSP") 5 and 5'is provided, and the DSP is provided with fitting units 6 and 6'for inputting sound quality fitting parameters. Other configurations are the same as those of the conventional mobile phone.

The sound quality fitting procedure of the mobile phone is as follows.
It is composed of pre-processing, call pre-processing, and a call, and a series of these processes is performed without the mobile phone user recognizing the difference from a call on a normal mobile phone. First,
As a pre-processing, (1) analysis of the voice band as the speaker and the hearing chart database
In order to register in 4, the speaker and the listener input the voices on their mobile phones 1 and 2 to register the voice bands of the speaker and the listener. This is performed by comparing the voice component of the speaker with the hearing characteristic of the listener and reflecting the characteristic of the voice component of the speaker on the sound quality fitting characteristic of the speaker-side mobile phone 2 and the listener-side mobile phone 1. The aim is to improve. (2) Register the mobile phones 1 and 2 of the user in order to register the model, performance and characteristics of the mobile phone. The sound quality characteristics of mobile phones differ depending on the model of each mobile phone. Therefore, if the model, characteristics, and performance are registered in the hearing chart database or the mobile phone database created by the manufacturer, it is possible to perform sound quality fitting by absorbing variations in sound quality characteristics between mobile phones by referring to this database. (3) User ID and hearing characteristics of mobile phones 1 and 2,
In order to obtain user information such as sound quality fitting parameters, the user ID is sent to the server computer 3 to confirm the user.

Next, as preprocessing, (1) a scene in which the receiver-side mobile phone 1 is used, for example,
Select the operation scene such as indoor, outdoor, hall, etc. from the menu of the receiver-side mobile phone 1 with the operation key 7 and input,
Microphone 8 for noise monitoring of the receiver-side mobile phone 1
The acoustic characteristics of the usage environment are automatically estimated by measuring and analyzing noise with. (2) Microphones 8-A19 and 8'for noise monitoring of the cellular phones 1 and 2 on the speaker side and the receiver side respectively
-Monitor the noise in the usage environment through A10. Then, the noise level is set to A20-DSP.
5-A21 and A11-DSP5'-A12 are displayed on the displays 9 and 9'of the speaker-side and receiver-side mobile phones 1 and 2. At the same time, server computer 3
Let's analyze the noise frequency. Based on the noise gauge, you can move to a place with low noise or find the direction of the user's body that is less susceptible to noise sources. In addition, considering that the hearing ability of the listener over the mobile phone is deteriorated, the speaker's noise environment is appropriate for listening because the speaker can fully hear the other party's voice under a certain noise. Not necessarily. By using a noise gauge that takes into account the hearing characteristics of the listener, it is possible to find the location of the speaker that is easy for the listener to hear and the orientation of the body with respect to the noise source.

(3) User ID registered in the mobile phone
From A01 to A01
4. At the same time, the optimum sound quality fitting parameter is estimated from the selected use scene, mobile phone type data, speaker's voice characteristic, listener's hearing characteristic (user's loudness curve, etc.) and environmental noise. . The estimated sound collecting condition fitting parameter and the estimated sound quality fitting parameter are respectively A02-A03 to A0.
8, A02-A13 ~ A18 through the sound collecting side DSP5 '
And download to the DSP5 on the playback side. (4) When the listener is a hearing-impaired person, the listening rate may be improved by devising a way of speaking. For example, in the case of age-related hearing loss, the hearing ability for high-frequency sounds is particularly low, so whispering will increase the amount of low-frequency sounds, making it easier to hear. On the other hand, making a loud voice just because you cannot hear sounds high. It becomes hard to hear because it shifts to the range. Therefore, the server computer 3 creates a database called a “speaking list” based on the speaker voice characteristics and the listener's hearing characteristics registered in the audio chart DB4, and a voice / character guide is provided from the list to find the optimal speaking method according to the situation. It is an effective means to automatically give advice to the speaker side by using.

(5) In the DSP units 5 and 5 ', the sound source is localized by convoluting the head related transfer function in consideration of the hearing loss and performing binaural reproduction to improve the listening performance in noise. Human beings analyze the sound pressure difference and phase of the sound stimulus to the left and right ears to cancel unnecessary noise and perform sound source localization. In the case of people with hearing loss, there is a difference in left and right hearing,
Even if there is no left / right difference, if the function of the rear maze system is impaired, sound source localization cannot be performed, and it is difficult for noise to be canceled out. (6) When the listener has sensorineural hearing loss, loss of hair cells and degeneration of the auditory conduction path reduce frequency discrimination ability and time discrimination ability. Listening is improved by sound quality processing such as formant frequency conversion to the frequency band in which the hearing ability of the listener remains and speech speed conversion. (7) By exchanging information on start-up and operating conditions with nearby mobile phones and home information appliances, for example, by temporarily stopping home appliances such as a washing machine or a personal computer, or operating in a low noise mode, Temporarily improve the conversation environment.

Next, during a call, (1) the noise monitor microphones 8 and 8'of the cellular phones 1 and 2 on the speaker side and the receiver side to A19 and A10, respectively.
The noise component is canceled by adding the antiphase waveform of the noise measured through the output waveform of the microphone 10 for utterance. That is, it is possible to cancel the noise component in the opposite phase or reduce the noise by using the utterance microphone 10 having a strong directivity and the environmental noise monitoring microphones 8 and 8 ′. (2) The change in noise during a call is grasped by the noise monitors of the cellular phones 1 and 2 on the speaker side and the receiver side, and the optimum sound quality fitting parameter is updated according to the change in noise. The environmental noise changes every moment, and it is important to update the fitting parameters according to the change.

(3) The portable telephone 2 on the speaker side performs sampling by increasing the gain in the band where the hearing ability of the listener is lowered, and transmits based on the result. What is important here is that not only the amplification gain on the receiver side is adjusted, but also the sound pickup condition of the speaker side mobile phone 2 is optimally set through B01-B02 to obtain sufficient sound quality. Is. For example, a sufficient quantization resolution can be obtained by sampling the hearing loss of the listener in the speaker side mobile phone 2 for each frequency band after gain amplification by a preamplifier (not shown).

(4) The speaker side mobile telephone 2 corrects the gain control for each frequency band in accordance with the hearing characteristics of the listener. That is, human hearing characteristics generally deteriorate in a high frequency band. Now, a general voice without correction has a distribution as indicated by reference numeral 11 in FIG. Therefore, when the hearing ability of the listener is deteriorated in the high frequency band as shown in FIG. 4, a voice that cannot be heard by the listener appears in the voice in the high frequency band as it is. Therefore, as shown in FIG. 5, the voice 11 is corrected in the speaker-side mobile phone 2 in consideration of the hearing characteristics of the listener. Then, the listener-side mobile phone 1 outputs the corrected voice 11 as shown in FIG. The corrected speech 11 is actually perceived by the listener as the downward-sloping distribution 11 shown in FIG. 7, but the inaudible state is eliminated. In general, when the gain is increased with a hearing aid, the dynamic range is compressed so that the result of gain correction is within the maximum output sound pressure level (about 100 dB) because the target is a living environment sound. However, since the mobile phone uses a directional microphone, the input on the speaker's mobile phone is mainly limited to voice. In general, the voice has a frequency band distribution as shown by reference numeral 11 in FIG.
As shown in, the corrected voice band does not exceed the level of the low frequency band, and the fitting system does not need to compress the dynamic range.

FIG. 8 shows a code-excited linear prediction (Code Excited Lin) which is an example of a speech / audio signal coding technique.
An example of application to coding in a mobile phone using ear prediction is shown. In this code-excited linear prediction, the A-B-S (Analysis-by-Analysis-by-Analysis-by-A) is performed by a search based on distortion minimization of a signal synthesized from each code pattern of an adaptive codebook, a noise codebook, and a gain codebook and input speech.
Synthesis, analysis by synthesis) method is used. Then, before the actual coding, the hearing loss of the listener is corrected through the hearing correction filter 13 in consideration of the hearing ability of the listener, and in distortion minimization, the quantum is passed through the filter 14 having a weighting function of the hearing characteristic of the listener. Quantization noise is shaped so that humanized distortion is hard to hear. In the present invention, a hearing correction filter for correcting the hearing ability of the listener is added in the coding, and the hearing weight of the listener is replaced by the conventional filter having the standard human hearing weighting function for minimizing distortion. The feature is that a filter having a function is used. Therefore, the speaker-side mobile phone 2 can be corrected according to the hearing characteristics of the listener.

In the loudness compensation, the replenishment phenomenon (recr
unit phenomenon), that is,
Non-linear input / output gain control is adaptively performed for each band in consideration of "a phenomenon in which the change in sound volume (sensory quantity) accompanying a change in sound intensity (physical quantity) is abnormally large compared to normal ear". (Adaptive Gain Control) (see FIG. 9).
Further, as shown in FIG. 10, when noise interfering with voice conversation is mixed, that is, when the frequency band shown by the arrow in FIG. 10 is contaminated with noise, the band shown by the arrow with the noise is mixed. Improves overall listening by lowering the gain of to match the level of contamination. (5) In the receiver side mobile phone 1, the speaker side compensates for an insufficient gain. That is, when the gain is not sufficiently obtained on the speaker side, the gain is further increased on the receiver side to compensate the loudness. When the cellular phone 2 on the speaker side is not a compatible device of the present system, the above-mentioned loudness compensation is performed only by the DSP unit 5 of the cellular phone 1 on the speaker side.

(6) The voice of the speaker by B01-B02 of FIG. 1 is multiplied by the hearing characteristic of the listener through A08, and converted by B03-B04 into the sound quality that the listener actually hears, and the speaker is given The feedback allows the speaker to automatically speak in a voice that is easy for the listener to hear. When using a mobile phone in a noisy environment such as in a train car, it sometimes becomes loud and annoy people around. This is because one's voice cannot be heard due to noise and feedback for adjusting the volume of the utterance is not given. Therefore, if the voice of the speaker picked up by the microphone is sent to the speaker of the speaker, the volume can be adjusted to an appropriate level. This is also in karaoke
This is a phenomenon that occurs even at concerts, and it is very difficult to pick a pitch if you cannot hear your voice. On the other hand, placing a speaker in front of a singer and listening to the person's singing voice makes it easier to sing.

Note that FIG. 3 shows the A / D section and the DS of the speaker-side mobile phone 2 in order to enhance the sound quality fitting effect.
FIG. 6 is a block diagram showing a state in which a P section performs channel division corresponding to a frequency and performs non-linear fitting for each channel.

(Second Embodiment) FIG. 2 shows a second embodiment of the mobile fitting system of the present invention.
The difference from the first embodiment is that only one of the mobile phones, for example, the receiver-side mobile phone 1 is a model compatible with the system of the present invention. Therefore, in the sound quality fitting, since the sound quality fitting work cannot be performed by the speaker side mobile phone 2, all the compensation is performed by the receiver side mobile phone 1.

The present invention is not limited to the one described in the above embodiment, and various modifications can be made. For example,
Cellular phones are becoming personal notebooks such as address books, schedule management, and task management. These were stored in the internal memory of the phone, but will be stored in a server etc. in the future, so that they can be viewed and edited from other than the mobile phone without worrying about the memory capacity. From these facts, the hearing characteristic in the hearing chart DB of the present invention can be accessed from any place other than the mobile phone including the mobile phone as long as the data is connected to the Internet. Therefore, it can be used for information appliances other than mobile phones such as hearing aids and AV systems. In music distribution, it is possible to search and download music sources that match your hearing characteristics. In addition, it is possible to easily reproduce the acoustic environment of being at home even at a stay such as a hotel. As easily associated with network computers, there are no AV home appliances at home,
It is conceivable that a network audio system with only a simple player will appear at home. By doing so, regardless of fixed audio or mobile audio, it is possible to enjoy an audio environment fitted to an individual at any time and in any place.

Also, in my private room at home, my favorite B
It's natural to enjoy a long phone while playing GM, but it's your favorite BGM as if you were at home.
There is also a request to enjoy long calls while listening to on a mobile phone. The DSP of the present invention also provides a service of adjusting the sound quality of the BGM so that the favorite BGM does not interfere with the conversation and playing the conversation on the mobile phone.
It becomes possible by using the fitting function by. BGM
It is also possible to have the feeling that they are sharing the same space by enjoying the same music delivered as, while synchronizing with the other party. The above-mentioned way of enjoying is also possible by using the operation on the server and the operation on the DSP of the downloaded program.

[0032]

As described above, the present invention has the following effects. (1) It is possible for a user (patient) to receive a sound quality fitting from a mobile device such as a mobile phone when he / she wants it, without hesitating to visit a hospital or the like equipped with a sound quality fitting device. (2) It is possible to prevent oversight of regular checkups by regularly announceing the checkup dates. (3) It enables sound quality fitting considering not only the hearing characteristics of the user but also the characteristics of the selected usage scene and the model of the mobile phone.

(4) It is not necessary for the user to judge the use environment and select the characteristic, and the optimum sound quality characteristic can be automatically fitted to the noise in the use environment. At this time, the speaker side can search for and instruct the user (patient) who is the listener in a place where the user (patient) can easily hear the noise or the noise source. (5) It is possible to speak in an optimal way of speaking by selecting the optimal way of speaking from the registered voice characteristics of the speaker and the hearing ability of the listener and advising the speaker using a voice / character guide. it can. (6) The sound quality is improved because it is not necessary to make a call using a mobile phone or the like through the hearing aid. (7) Since the mobile phone also has a function as a substitute for the hearing aid, it is not necessary to carry both the hearing aid and the mobile phone.

(8) Unlike listening to a mobile phone through a hearing aid, not only the amplification gain on the listener side is adjusted for each band, but also sound collection conditions such as the microphone sensitivity of the talking mobile phone for each band. Sound quality and
Can improve listening. (9) By collectively managing the hearing characteristics, the voice band of the speaker, and the acoustic characteristics of the used mobile phone in the database, even if you want to buy a new mobile phone or use multiple mobile phones depending on your life scene, you can start from scratch. There is no need to perform sound quality fitting work. (10) An ordinary next-generation mobile phone can be used without the need for incorporating a special function. A person who needs this function can perform sound quality fitting simply by downloading the program from a server computer on the Internet.

(11) The speaker individual identification priority mode and the listening priority mode are provided, and by selecting the speaker individual identification priority mode according to the purpose of use, an appropriate loudness compensation can be performed to obtain the voice / sound quality. It is possible to prevent a decrease in speaker identification. (12) Not only the loudness is compensated for the hearing loss, but also personal customization such as reflecting the user's personal preference and preference regarding the sound quality is possible. (13) A hearing tester and a sound quality fitting device (hearing aid function) are integrated, and the final adjustment in the hearing test and sound quality fitting is performed by using the circuit and speaker of the same mobile phone. When used, calibration of acoustic characteristics, which is indispensable, becomes unnecessary. (14) It is easy for the speaker to automatically hear the speaker by multiplying the speaker's voice by the hearing ability of the speaker and converting it to a sound quality that is actually heard by the speaker and feeding it back to the speaker. You will be able to speak by voice.

[Brief description of drawings]

FIG. 1 is an explanatory diagram showing a first embodiment of a mobile fitting system according to the present invention.

FIG. 2 is an explanatory diagram showing a second embodiment of the mobile fitting system according to the present invention.

FIG. 3 is a block diagram showing a state in which channel division corresponding to frequency is performed and nonlinear fitting is performed for each channel.

FIG. 4 is a diagram for explaining a state in which gain control is performed for each band on the speaker-side mobile phone in accordance with the hearing ability of the listener, and is a diagram showing a state before correction.

FIG. 5 is a diagram for explaining a state in which gain control is performed for each band in the speaker-side mobile phone according to the hearing ability of the listener, and is a diagram showing a corrected state.

FIG. 6 is a diagram for explaining a state in which gain control is performed for each band in the speaker-side mobile phone according to the hearing characteristics of the receiver, and is a diagram showing a reproduction state in the corrected receiver-side mobile phone.

FIG. 7 is a diagram illustrating a state in which gain control is performed for each band in the speaker-side mobile phone in accordance with the hearing characteristics of the listener, and is a diagram showing a corrected perception state of the listener.

FIG. 8 is a block diagram showing an application example to coding in a mobile phone using code-excited linear prediction, which is an example of a voice / audio signal coding technique.

FIG. 9 is a diagram showing a non-linear gain control considering a replenishment phenomenon.

FIG. 10 is a diagram showing a gain down process of a band contaminated by noise.

FIG. 11 is a diagram showing a conventional digital hearing aid.

[Explanation of symbols]

1 Recipient side mobile phone 2 Mobile phone of speaker 3 server computers 4 Hearing chart database 5, 5'digital signal processor 6,6 'fitting section 7,7 'operation key 8,8 'Noise monitoring microphone 9,9 'display 10 Microphone for utterance 11 voice 12 Hearing characteristics 13 Hearing correction filter 14 Auditory weighting filter

Claims (13)

(57) [Claims] 1. A mobile fitting system, characterized in that a mobile device is connected to a server computer and a hearing chart database via a network to enable sound quality fitting of the mobile device by operating the mobile device. 2. The speaker side mobile device and the receiver side mobile device are connected to a server computer and an audio chart database via a network, and the sound quality fitting of the receiver side mobile device is performed by operating the receiver side mobile device. The mobile fitting system according to claim 1, wherein the mobile fitting system is enabled. 3. The mobile fitting system according to claim 1, wherein at least the mobile device on the receiver side is provided with a digital signal processor and a fitting unit for sound quality fitting. 4. The mobile fitting system according to claim 1, wherein a usage scene of the mobile device on the listener side can be selected and input. 5. The noise measuring microphone of the mobile device on the receiver side measures the noise and automatically sets the usage scene, according to any one of claims 1 to 3. Mobile fitting system as described. 6. By monitoring the noise in the use environment through the noise monitoring microphones of the mobile devices on the speaker side and the receiver side, and displaying the noise level on the mobile devices on the speaker side and the receiver side. ,
The mobile fitting system according to any one of claims 2 to 5, wherein a location which is less likely to be affected by a noise source and a direction of a user's body are searched. 7. An optimum sound quality fitting parameter is estimated from the selected usage scene, acoustic characteristic data of a mobile model, voice characteristic of a speaker, hearing characteristic of a listener and environmental noise, and the sound quality fitting parameter is used as a mobile device. 7. The mobile fitting system according to claim 1, wherein the mobile fitting system can be downloaded to a digital signal processor. 8. A database, which is a “speaking list” for speakers, is created from the speaker voice characteristics and the listener hearing characteristics registered in the hearing chart database, and the optimum speaking method according to the situation is created from the list. The mobile fitting system according to any one of claims 1 to 7, characterized in that the speaker can be automatically advised using a voice / character guide. 9. An information home appliance can be temporarily stopped or operated in a low noise mode by exchanging information on the start-up / operating state of the information home appliance between a mobile device and a nearby information home appliance. The mobile fitting system according to any one of claims 1 to 8, characterized in that. 10. The change of noise during a call is grasped by a noise monitor of a mobile device of a speaker side and a mobile device of a listener side, and the optimum parameter is updated according to the change of noise. The mobile fitting system according to any one of claims 1 to 9. 11. The mobile device on the speaker side increases sampling in a frequency band in which the hearing ability of the receiver is lowered, and performs sampling, and transmits based on the result. The mobile fitting system according to any one of claims. 12. The mobile fitting system according to any one of claims 1 to 11, wherein gain control is performed for each frequency band in the mobile device on the listener side in accordance with the hearing characteristics of the listener. . 13. The voice of the speaker is multiplied by the hearing characteristic of the listener, converted into a sound quality that is actually heard by the listener and fed back to the speaker.
The mobile fitting system according to any one of claims 1 to 12.