CN103247294A - Signal processing apparatus, signal processing method, signal processing system, and communication terminal - Google Patents

Signal processing apparatus, signal processing method, signal processing system, and communication terminal Download PDF

Info

Publication number
CN103247294A
CN103247294A CN2013100311896A CN201310031189A CN103247294A CN 103247294 A CN103247294 A CN 103247294A CN 2013100311896 A CN2013100311896 A CN 2013100311896A CN 201310031189 A CN201310031189 A CN 201310031189A CN 103247294 A CN103247294 A CN 103247294A
Authority
CN
China
Prior art keywords
signal
unit
parameter
osophone
sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013100311896A
Other languages
Chinese (zh)
Other versions
CN103247294B (en
Inventor
剑持千智
东山恵祐
井上晃
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN103247294A publication Critical patent/CN103247294A/en
Application granted granted Critical
Publication of CN103247294B publication Critical patent/CN103247294B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03GCONTROL OF AMPLIFICATION
    • H03G3/00Gain control in amplifiers or frequency changers without distortion of the input signal
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03GCONTROL OF AMPLIFICATION
    • H03G5/00Tone control or bandwidth control in amplifiers
    • H03G5/005Tone control or bandwidth control in amplifiers of digital signals
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03GCONTROL OF AMPLIFICATION
    • H03G5/00Tone control or bandwidth control in amplifiers
    • H03G5/16Automatic control
    • H03G5/165Equalizers; Volume or gain control in limited frequency bands
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03GCONTROL OF AMPLIFICATION
    • H03G9/00Combinations of two or more types of control, e.g. gain control and tone control
    • H03G9/005Combinations of two or more types of control, e.g. gain control and tone control of digital or coded signals
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03GCONTROL OF AMPLIFICATION
    • H03G9/00Combinations of two or more types of control, e.g. gain control and tone control
    • H03G9/02Combinations of two or more types of control, e.g. gain control and tone control in untuned amplifiers
    • H03G9/025Combinations of two or more types of control, e.g. gain control and tone control in untuned amplifiers frequency-dependent volume compression or expansion, e.g. multiple-band systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/558Remote control, e.g. of amplification, frequency
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50Customised settings for obtaining desired overall acoustical characteristics
    • H04R25/505Customised settings for obtaining desired overall acoustical characteristics using digital signal processing

Abstract

There is provided a signal processing apparatus including a provision control unit that provides choices expressed subjectively and associated with control for an acoustic signal, and an output unit that outputs a predetermined choice selected from the provided choices.

Description

Signal handling equipment, method, system and communication terminal
Technical field
Present disclosure relates to a kind of signal handling equipment, signal processing method, program, signal processing system and communication terminal.Specifically, present disclosure relates to the tonequality of acoustical signal of acoustical signal that a kind of adjustment picked up by microphone or reproduction and the signal handling equipment of volume.
Background technology
In correlation technique, the mechanism of user's preference sound is handled and exported to sound and the volume implementation effect of reproduction at the equipment of reproduction sound is provided, and described effect process is tonequality adjustment processing (such as tone adjustment or equalization parameter device) and reverberation interpolation processing for example.This method of adjustment is to be the method for many frequency bands and the gain of adjusting each frequency band in the equalization parameter device with frequency partition or to present option and read the method for the parameter of default effect process according to the effect process title that the user selects from storage unit according to default effect process title (for example, recording studio or scene).
To a certain extent sound being understood a lot of users can determine sound is become the necessary operation of desired audio, for example, under the situation of equalization parameter device, the parameter of how to operate which frequency band becomes desired audio with sound, and when operating parameter is segmented, enable fine setting.Yet when the user did not have the knowledge of adjusting sound, the user may be difficult to determine that how adjusting sound becomes desired audio with sound.
For this reason, in the equipment or the program that are used for reproducing sound, according to the title (hereinafter referred to as the effect title) of the several types of the impression of effect (for example formerly prepared in the effect process group of Tiao Zhenging, auditorium and stadium), one of these effect titles are selected, and the power of this effect is adjusted in some cases, so that sound is easy to be adjusted to desired audio.
Yet, because the effect title is not necessarily corresponding to user's subjective feeling, so after the user heard sound, the user should determine the effect title selected according to user's impression.At this moment, when the user had some knowledge and experiences, for example, when because cacophonize, when sound was not ear-piercing so the user expects to adjust sound, the user should be according to determining that ear-piercing reason is and so on to understand and experience is in the past selected optimum efficiency.
In correlation technique, the method for using interactive evolutionary computation and genetic algorithm to carry out the tonequality adjustment according to subjective feeling was examined or check.For example, at " Verification of Evaluation Value Reasoning Method corresponding to Change of Evaluation Standard in Hearing Aid Fitting using Interactive Evolutionary Computing ", 22nd Fuzzy System Symposium (Sapporo, Sept.6-8,2006) in, reported by experiment to have constant return.In the method, predetermined sound is presented to the user, obtain the evaluation of sound from the user, and calculate and adjust parameter.Yet the subjective feeling that always is difficult to the sound this user heard by the user is adjusted sound.
Summary of the invention
The acoustical signal of wishing that the user can subjectively be adjusted and being picked up by microphone or the acoustical signal of reproduction.
According to the embodiment of present disclosure, a kind of signal handling equipment is provided, this signal handling equipment comprises: present (provision) control module, it presents the option of being expressed by subjectivity and be associated with control to acoustical signal; And output unit, the preset selective item that its output is selected from the option that presents.
In this disclosure, present control module and present the option that is associated with control to acoustical signal.Described option can be from visually or from acoustically presenting.For example, the option that presents can be subjective sensation and/or the subjective request that will solve.The preset selective item that output unit output is selected from the option that presents.In this case, in signal handling equipment or external unit, use the preset selective item of output.
Like this, in this disclosure, the user can select and the preset selective item corresponding to the subjective feeling of hearing sound, and exports this preset selective item.That is to say that the user can be by means of the subjective sensation of sound is adjusted sound (volume and tonequality).
In this disclosure, present the demonstration form that control module can change the option that presents according to selected option or the characteristic quantity of handling the acoustical signal of object.Thereby the user can be suitably, carry out the sound adjustment based on the selection of option expeditiously.
In this disclosure, signal processing apparatus also can comprise computing unit, and described computing unit calculates the adjustment parameter of adjusting the acoustical signal of handling object based on the characteristic quantity of the acoustical signal of each parameter of measuring in advance, selected preset selective item and processing object.For example, described each parameter can be the parameter of expression auditory properties.Described each parameter can be the parameter of the characteristic of expression microphone and/or loudspeaker.In this case, when external unit carry out to be used for adjust is handled the processing of acoustical signal of object, be used for calculating adjust parameter processing externally equipment become unnecessary, and can alleviate the processing load of external unit.
Another embodiment according to present disclosure, a kind of signal handling equipment is provided, this signal handling equipment comprises: acquiring unit, it obtains the adjustment parameter, described adjustment parameter based on each parameter of measuring in advance, from by subjective that express and with option that control to the acoustical signal that presents is associated the preset selective item selected and the characteristic quantity of handling the acoustical signal of object calculate; And signal processing unit, it adjusts the acoustical signal of described processing object based on the adjustment parameter of obtaining.
In this disclosure, adjusting parameter is calculated by acquiring unit.Adjust parameter based on each parameter of measuring in advance, from by subjective that express and with option that control to the acoustical signal that presents is associated the preset selective item selected and the characteristic quantity of handling the acoustical signal of object calculate.Signal processing unit is adjusted the acoustical signal of handling object based on the adjustment parameter of obtaining.
Like this, in this disclosure, adjust acoustical signal based on the adjustment parameter of the preset selective item that has reflected the subjectivity expression that the user selects.Therefore, the user can be by means of the subjective sensation of sound is adjusted sound (volume and tonequality).
In this disclosure, signal processing unit can have first buffer zone and second buffer zone that parameter is adjusted in accumulation.Under acquiring unit is accumulating on the use state of an adjustment parameter in the buffer zone, obtain when adjusting parameter, signal processing unit can be accumulated in the adjustment parameter of obtaining in another buffer zone, and described use state is switched to the use state that accumulates on the adjustment parameter in this another buffer zone.In this case, the adjustment that can avoid stopping acoustical signal is handled, and can prevent interrupting of sound.
In this disclosure, signal processing unit can have the buffer zone that parameter is adjusted in accumulation.Obtain under acquiring unit is accumulating on the use state of the adjustment parameter in the buffer zone when adjusting parameter, signal processing unit can make through the output of the acoustical signal of adjusting quiet, the adjustment parameter of obtaining is accumulated in the buffer zone, and removes quiet.In this case, can prevent from when switching the adjustment parameter, producing extraordinary noise, and the user can be by the switching that interrupts to identify the adjustment parameter of sound.
In this disclosure, signal handling equipment also can comprise analytic unit, the acoustical signal of described analytic unit analyzing and processing object, and the characteristic quantity of calculating acoustical signal.In this disclosure, signal handling equipment also can comprise calculating adjustment CALCULATION OF PARAMETERS unit.
Another embodiment according to present disclosure provides a kind of signal handling equipment, and this signal handling equipment comprises: the sound input block; Acquiring unit, it obtains the order of being expressed by subjectivity and be associated with control to acoustical signal from the sound by sound input block input; Computing unit, its characteristic quantity based on the acoustical signal of each parameter of measuring in advance, the order of obtaining and processing object calculates the adjustment parameter of adjusting the acoustical signal of handling object; And signal processing unit, it adjusts the acoustical signal of handling object based on the adjustment parameter that calculates.
In this disclosure, comprise the sound input block.For example, the sound input block can use microphone to construct, to obtain to handle the acoustical signal of object.Acquiring unit obtains the order of being expressed by subjectivity and be associated with control to acoustical signal from the sound by sound input block input.
Computing unit calculates the adjustment parameter of adjusting the acoustical signal of handling object based on the characteristic quantity of the acoustical signal of each parameter of measuring in advance, the order of obtaining and processing object.Signal processing unit is adjusted the acoustical signal of handling object based on the adjustment parameter that calculates.
Like this, in this disclosure, the user can be by the subjective order of sound input.Adjust acoustical signal based on the adjustment parameter that has reflected subjective order.Therefore, the user can be by means of the subjective sensation of sound is adjusted sound (volume and tonequality).
At present disclosure, signal handling equipment also can comprise first signal processing system and secondary signal disposal system, and first signal processing system and secondary signal disposal system include sound input block, acquiring unit, computing unit and signal processing unit.A signal processing system can send to the sound that is input to the sound input block another signal processing system, and receives order from this another signal processing system.In this case, can avoid two signal processing systems to obtain order in overlapping mode, and can reduce and handle load and consumed power.
Another embodiment according to present disclosure provides a kind of communication terminal, and this communication terminal comprises: present control module, it presents the option of being expressed by subjectivity and be associated with control to acoustical signal; The order output unit, the order that its output is corresponding with the preset selective item of selecting from the option that presents; And transmitting element, its order that will export sends to communication counterpart.
In this disclosure, present control module and present the option that is associated with control to acoustical signal.Described option can be from visually or from acoustically presenting.For example, the option that presents can be subjective sensation to be processed and/or subjective request.The order output unit output order corresponding with the preset selective item of from the option that presents, selecting.This order is sent out the unit and sends to communication counterpart.
Like this, in this disclosure, the user of communication terminal can select and the preset selective item corresponding to the subjective feeling of the sound that receives from communication counterpart, and the order corresponding with this preset selective item sent to communication counterpart.The user can rely on the adjustment (volume and tonequality) of the subjective sensation of the sound that sends from communication counterpart being indicated this sound.In this case, because communication counterpart analysis order, so even the user does not know device characteristics or the signal processing of communication counterpart, the user also can send sound adjustment order.Because communication counterpart is adjusted sound, handle so can before coding, carry out squelch expeditiously.
Present disclosure also can comprise: receiving element, and it receives acoustical signal from communication counterpart; Parameter calculation unit, it is at least based on calculating the adjustment parameter from the order of order output unit output; And signal processing unit, it adjusts the acoustical signal of reception based on the adjustment parameter of calculating.For example, when calculate adjusting parameter, can or handle the characteristic quantity of the acoustical signal of object with reference to each parameter of measuring in advance (parameter of the parameter of expression auditory properties and the characteristic of expression microphone or loudspeaker).
Another embodiment according to present disclosure provides a kind of communication terminal, and this communication terminal comprises: receiving element, its from communication counterpart receive with by order subjective expression and that preset selective item that be associated with control to acoustical signal is corresponding; The acoustical signal input block, it imports acoustical signal; Adjust parameter calculation unit, it calculates the adjustment parameter based on the order that receives at least; Signal processing unit, it adjusts the acoustical signal of input based on the adjustment parameter of calculating; And transmitting element, it will send to communication counterpart through the acoustical signal of adjusting.
According to the embodiment of above-described present disclosure, the user can subjectively adjust acoustical signal that microphone picks up or the acoustical signal of reproduction.
Description of drawings
Fig. 1 is the diagram according to the structure example of the hearing aid device system of first embodiment;
Fig. 2 (a) and Fig. 2 (b) are the block diagrams that the structure example of the structure example of osophone and remote controllers is shown respectively;
Fig. 3 is the process flow diagram that the treatment scheme of remote controllers is shown;
Fig. 4 is the process flow diagram that the treatment scheme of osophone is shown;
Fig. 5 is the diagram that another structure example of hearing aid device system is shown;
Fig. 6 illustrates to be presented the diagram that (demonstration) gives the example of the situation that the size of character of option of the display unit of remote controllers changes according to the audio signal characteristics amount of the processing object in the osophone;
Fig. 7 illustrates to be presented the diagram that (demonstration) gives the example of the situation that the Show Color of option of the display unit of remote controllers changes according to the audio signal characteristics amount of the processing object in the osophone;
Fig. 8 illustrates to be presented the diagram that (demonstration) gives the example of the situation that the option of the display unit of remote controllers changes according to the option of selecting;
Fig. 9 illustrates to be presented the diagram that (demonstration) gives the example of the situation that the option of the display unit of remote controllers changes according to the option of selecting;
Figure 10 illustrates to be presented (demonstration) expresses the example that is subjective situation of asking to the subjectivity of the option of the display unit of remote controllers diagram;
Figure 11 is the diagram that the example that the subjectivity of sound is expressed is shown, the described subjective expression that can be changed into subjective sensation and subjective request of expressing;
Figure 12 (a) and Figure 12 (b) are respectively the block diagrams of another structure example that another structure example and remote controllers of osophone are shown;
Figure 13 is the process flow diagram that the treatment scheme of remote controllers is shown;
Figure 14 is the process flow diagram that the treatment scheme of osophone is shown;
Figure 15 is the diagram that illustrates according to the structure example of the TV system of second embodiment;
Figure 16 (a) and Figure 16 (b) are respectively the block diagrams that the structure example of the structure example of television receiver and remote controllers is shown;
Figure 17 is the diagram that the situation of the loudspeaker performance in the loudspeaker performance record cell that uses in the server unit that is stored on the cloud is shown;
Figure 18 is the diagram that illustrates according to the osophone of the 3rd embodiment;
Figure 19 is the block diagram that the structure example of osophone is shown;
Figure 20 is the process flow diagram that the treatment scheme of osophone is shown;
Figure 21 is the diagram that illustrates according to the osophone of the 4th embodiment;
Figure 22 (a) and Figure 22 (b) are the block diagrams that the structure example of osophone is shown;
Figure 23 is the process flow diagram that the treatment scheme of osophone is shown;
Figure 24 is the diagram that illustrates according to the structure example of the communication system of the 5th embodiment; With
Figure 25 is the block diagram that the structure example of mobile phone is shown.
Embodiment
Below, describe the preferred embodiment of present disclosure with reference to the accompanying drawings in detail.Point out that in this instructions and accompanying drawing, the structural detail that has identical function and structure is basically represented with identical label, and omitted the repetition of explanation of these structural details.
Below will be described according to following order.
1. first embodiment
2. second embodiment
3. the 3rd embodiment
4. the 4th embodiment
5. the 5th embodiment
6. modification
<1. first embodiment 〉
[structure of hearing aid device system]
Fig. 1 shows the structure example according to the hearing aid device system 10 of first embodiment.Hearing aid device system 10 comprises the remote controllers 150 of a pair of osophone 110L and 110R and control osophone 110L and 110R.
Osophone 110L can use radio communication to carry out intercommunication mutually with 110R and remote controllers 150. Osophone 110L and 110R and remote controllers 150 can use another kind of method (for example, based on the communication in the communication of magnetic or the scope that can't hear) to carry out intercommunication mutually.Remote controllers 150 can be the push button remote controllers, as will be described below, the touch panel formula remote controllers of button dynamic change therein or therein communication mechanism be used as another equipment (such as portable terminal or dull and stereotyped terminal) that program is installed.
Put on the user under the state of osophone 110L and 110R, osophone 110L and 110R are by remote controllers 150 controls.When the user selects worried project according to the impression of the ambient sound of hearing, for example, when the user heard ear-piercing sound and selects " ear-piercing " button when enjoying drama, the information of selected project was sent to osophone 110L and 110R, and sound is adjusted.
Fig. 2 (b) shows the structure example of remote controllers 150.Remote controllers 150 comprise control module 151, user operation unit 152, display unit 153, input receiving element 154, command conversion unit 155, remote controllers transmitting element 156 and antenna 157.
Control module 151 comprises CPU, and the operation of each unit of control remote controllers 150.User operation unit 152 and display unit 153 form user interface.User operation unit 152 is that the user passes through the unit that it carries out various operations.For example, user operation unit 152 uses button or touch panel to construct.Display unit 153 uses LCD to construct.On display unit 153, the display operation state.In addition, when the sound of osophone 110 is adjusted, the option (being provided for " too loud ", " too quiet " and " ear-piercing " of the remote controllers 150 of Fig. 1) that presents at display unit 153 that (demonstration) subjectively expressed and be associated with control to acoustical signal.
Input receiving element 154 receives the information (for example, the ID of the option of selection) of the option of user's selection from control module 151.Input receiving element 154 can be integrated with control module 151.The order of information translation for being associated with this information that receiving element 154 receives will be imported in command conversion unit 155.For example, when the ID of option " ear-piercing " was sent out, command conversion unit 155 was converted to this ID the order that means " ear-piercing ".156 pairs of remote controllers transmitting elements are sent by the command execution of command conversion unit 155 conversions and handle, and produce the transmission information that comprises this order, and should transmission information send to osophone 110(110L and 110R from antenna 157).
Fig. 2 (a) shows osophone 110(110L and 110R) the structure example.Osophone 110 comprises microphone 111-1 and 111-2, A/D converter (ADC) 112-1 and 112-2, signal processing unit 113, D/A converter (DAC) 114, volume adjustment unit 115 and loudspeaker 116.Osophone 110 also comprises phonetic analysis unit 117, blotter unit 118, auditory properties record cell 119, adjusts parameter calculation unit 120, antenna 121 and osophone receiving element 122.
Microphone 111-1 and 111-2 pick up ambient sound, and obtain voice signal.In order to simplify explanation, use term " voice signal ".Yet strictly speaking, voice signal means the acoustical signal that comprises voice signal.Two microphone 111-1 and 111-2 are included to make it possible to carry out the processing for the controlling party tropism.The quantity of microphone can be one, perhaps can be three or more.A/D converter 112-1 and 112-2 are digital signal with the voice signal of microphone 111-1 and 111-2 acquisition from analog signal conversion.
Digital processing element 113 is carried out various processing by A/D converter 112-1 and the voice signal of 112-2 (handling the voice signal of object).Signal processing unit 113 is carried out the general following processing of being carried out by nearest digital deaf-aid, and based on the adjustment parameter of adjusting parameter calculation unit 120 calculating the voice signal execution of handling object is adjusted.
As the processing of generally being carried out by digital deaf-aid, below handle being performed.For example, carry out to be used for making the level of output sound remain on automatic gain control (AGC) in the preset range handle, when the level of digital signal be amplified to constant level or more the amplitude limiting processing during high level, be used for listening the frequency spectrum compression of the voice signal boil down to sub-audible sound frequency band of frequency band to handle, the spectrum envelope adjustment is handled, be used for from a plurality of input signal controlling party tropisms processing, for reducing the noise reduction process of unnecessary noise, the sound that is used for strengthening sound is strengthened handling and the volume adjustment is handled.
D/A converter 114 will be converted to simulating signal from digital signal from the voice signal of signal processing unit 113 outputs.Volume adjustment unit 115 usefulness values of setting are adjusted the volume of the voice signal of D/A converter 114 acquisitions, and this voice signal is outputed to loudspeaker 116.
The 117 pairs of digital audio signals from signal processing unit 113 outputs in phonetic analysis unit are carried out phonetic analysis and are handled, and obtain characteristic quantity.Characteristic quantity is the power of each frequency band after for example the frequency band division of included fundamental tone (pitch) information, third-octave and critical band is handled in the digital audio signal, the spectrum position (frequency) of the peak power by carrying out the power spectrum that time-frequency conversion (such as DFT) obtains or the cepstral coefficients of power spectrum.Phonetic analysis unit 117 is carried out the computing of characteristic quantity continuously or off and on.
The characteristic quantity that 118 blotter phonetic analysis unit 117, blotter unit obtain that is to say, preserves characteristic quantity during the Preset Time section.As formation, when recording areas was filled, blotter unit 118 began to abandon data and adds new data from the data of initial record, and preserves characteristic quantity during the constant time period always.
Auditory properties record cell 119 is recorded as single parameter with user's auditory properties.User's auditory properties is measured in advance, and is recorded in the auditory properties record cell 119.The information that osophone receiving element 122 receives from antenna 121 is obtained the order corresponding with subjective sensation that sends from remote controllers 150.Adjust order that parameter calculation unit 120 obtains based on osophone receiving element 122, be recorded in the audio signal characteristics amount of the processing object in the blotter unit 118 and be recorded in auditory properties in the auditory properties record cell 119 and calculate the parameter of in signal processing unit 113, adjusting voice signal (below, be called " adjustment parameter ").
Adjust parameter calculation unit 120 following calculating and adjust parameter.For example, when the order corresponding with " ear-piercing " is sent out, adjust the peak power that parameter calculation unit 120 reference time sequential recording characteristic quantities obtain each the frequency range division signals in the recording interval, obtain poor with auditory properties information, from (for example giving great volume according to the standardized equal loudness contour of ISO226:2003 thereon, the correction of calculating is carried out in 80phone) position, and calculates the adjustment parameter of the gain of the frequency band that reduces to have ceiling capacity.
For example, when the order corresponding with " sound is not heard " is sent out, adjust parameter calculation unit 120 according to the frequency band of the Pitch Information prediction sound of record, and calculating reduces the gain of other frequency bands clearly to hear the adjustment parameter of session.When the order corresponding with " strongly " is sent out, adjusting parameter calculation unit 120 can suppress by howling under the situation of the frequency that handle to suppress processing from the spectrum position checking howling of the peak power of the power spectrum of record at it, and under the situation of its frequency that can not handle by the howling inhibition, reduce the gain of corresponding frequency band, and calculating makes the inaudible adjustment parameter of sound.
Next, will the normal running of osophone 110 be described.Ambient sound is picked up by microphone 111-1 and 111-2, and obtains from microphone 111-1 and 111-2 with the sound corresponding simulating voice signal that picks up.A/D converter 112-1 and 112-2 are digital signal with analoging sound signal from analog signal conversion, and this digital audio signal is offered signal processing unit 113.
In signal processing unit 113, digital audio signal is carried out default sound signal processing.D/A converter 114 will be converted to simulating signal from digital signal from the treated digital audio signal of signal processing unit 113 outputs, and this analoging sound signal is supplied with volume adjustment unit 115.In volume adjustment unit 115, adjust the volume of analoging sound signal with the value of setting.Voice signal through the volume adjustment is supplied to loudspeaker 116, and exports from loudspeaker 116 based on the sound of this voice signal.
Be supplied to phonetic analysis unit 117 from the treated digital audio signal of signal processing unit 113 outputs.In phonetic analysis unit 117, digital audio signal is carried out phonetic analysis handle, obtain the characteristic quantity of digital audio signal, and the characteristic quantity that obtains is supplied with blotter unit 118, and during the default time period, preserve this characteristic quantity.
By this way, carry out the normal running of osophone 110.In the above description, work in phonetic analysis unit 117 and blotter unit 118 always.Yet phonetic analysis unit 117 and blotter unit 118 can be constructed to make their operations by the operation of remote controllers, to reduce power consumption.In this case, by not shown system, the signal of the operation after osophone receiving element 122 send/stops phonetic analysis unit 117.For example, when remote controllers (such as touch panel) display-operation picture, phonetic analysis unit 117 and blotter unit 118 can send signal to osophone 110, and osophone 110 can receive this signal, and carries out aforesaid operation for checking phonetic analysis unit 117 and blotter unit 118.
Next, with the operation of describing under the situation that the user operates remote controllers 150.In this case, in order to simplify explanation, suppose that phonetic analysis unit 117 and blotter unit 118 work always.
When the user expected that adjustment is listened to, the user selected subjective sensation according to sensation that will be worried from be presented (demonstration) option to the display unit 153 of remote controllers 150.In remote controllers 150, the information (for example, the ID of selected option) of the option that the user selects is transfused to receiving element 154 and receives, and is sent to command conversion unit 155.
In command conversion unit 155, the information of transmission is converted into the order that is associated with this information.For example, when the ID of option " ear-piercing " was sent out, this ID was converted into the order that means " ear-piercing ".The order that command conversion unit 155 obtains is supplied to remote controllers transmitting element 156.In remote controllers transmitting element 156, command execution is sent processing, and will comprise that the information of this order sends to osophone 110 from antenna 157.
In osophone 110, the information that sends from remote controllers 150 is received by antenna 21, and is provided for osophone receiving element 122.In osophone receiving element 122, from the information that receives, obtain the order corresponding with subjective sensation, and provide it to adjustment parameter calculation unit 120.
In adjusting parameter calculation unit 120, if supply with order from remote controllers receiving element 122, then calculate and adjust parameter.In this case, signal processing unit 113 calculates the adjustment parameter of adjusting voice signal (handling the voice signal of object) based on being recorded in characteristic quantity in the blotter unit 118 (below, be called " time series recording feature amount ") and the auditory properties information that is recorded in the auditory properties record cell 119.Adjust parameter and be supplied to signal processing unit 113.
In signal processing unit 113, when sending the adjustment parameters from adjustment parameter calculation unit 120, adjust various signals according to this adjustment parameter and handle.As a result, voice signal is adjusted.At this moment, because hearing aid signal is also processed, so adjust so that corresponding processing does not stop.
For example, when existing filtering to handle (such as finite impulse response (FIR) (FIR)), preferably, the coefficient district is constructed to double buffering, and new coefficient is written into untapped surface, and buffer zone only is replaced in the moment that processing continues to enter next processing.Yet, according to handling structure, may preferably remain the mechanism that does not cause extraordinary noise.
For example, signal processing unit 113 is constructed to have first buffer zone and second buffer zone that parameter is adjusted in storage.Under acquiring unit is being stored in the use state of an adjustment parameter in the buffer zone, obtain when adjusting parameter, after the adjustment parameter of obtaining was stored in another buffer zone, the use state was switched to the use state that is stored in the adjustment parameter in this another buffer zone.In this case, the adjustment that can avoid stopping voice signal is handled, and can prevent interrupting of sound.
Signal processing unit 113 is constructed to have the buffer zone that parameter is adjusted in storage.Under acquiring unit is being stored in the use state of the adjustment parameter in the buffer zone, obtain when adjusting parameter, make the output of the acoustical signal after the adjustment quiet, and after the adjustment parameter of obtaining is stored in the buffer zone, remove quiet.In this case, can prevent from when switching the adjustment parameter, producing extraordinary noise, and the user can be by the switching that interrupts to identify the adjustment parameter of sound.
The process flow diagram of Fig. 3 shows the treatment scheme of remote controllers 150.Remote controllers 150 periodically or according to carrying out from user's clearly instruction are handled.In step ST1, remote controllers 150 begin to handle.In step ST2, remote controllers 150 etc. are to be entered.If there is input, then remote controllers make and handle the input processing that continues to enter step ST3.In input was handled, remote controllers 150 determined that according to enter key end process still is the transmission parameter.When determining to send parameter, remote controllers 150 produce parameter, and the processing that makes processing enter step ST4.
In step ST4, remote controllers 150 are carried out and are finished to judge.In finish judging, when existing when showing the input that finishes, remote controllers 150 make to handle and enter step ST6, turn-off the power supply of remote controllers, and end process immediately.When having the parameter that will send, remote controllers 150 make handles the processing that enters step ST5.In step ST5, remote controllers 150 are carried out the transmission processing that is used for sending parameter.Then, remote controllers 150 make to handle and turn back to step ST2, and etc. to be entered.
The process flow diagram of Fig. 4 shows the treatment scheme of osophone 110.Osophone 110 periodically or according to carrying out from user's clearly instruction is handled.In step ST11, osophone 110 begins to handle.In step ST12, the input of osophone 110 fill orders is judged.If there is no order input, then osophone 110 makes and handles the sound signal processing that enters step ST13.In sound signal processing, osophone 110 is carried out for improvement of the sound signal processing of listening to, and by not shown system voice signal is outputed to loudspeaker.
Then, osophone 110 makes and handles the voice signal analyzing and processing that enters step ST14.In the voice signal analyzing and processing, osophone 110 is carried out the voice signal analyzing and processing and is adjusted employed characteristic quantity in the calculation of parameter processing to calculate.After the processing of execution in step ST14, osophone 110 makes handles the blotter renewal processing that enters step ST15.Upgrade in the processing at blotter, when in blotter unit 118, not having Free Region, osophone 110 forms buffer circle and records the characteristic quantity of calculating, the characteristic quantity that calculates is rewritten to the zone of wherein having recorded the oldest characteristic quantity, and carries out and handle so that the characteristic quantity of constant time period is recorded.After the processing of step ST15, osophone 150 makes to handle and turns back to step ST12, and the fill order input is judged.
When determining to have the order input in step ST12, the adjustment calculation of parameter that osophone 110 makes processing enter step ST16 is handled.In adjusting the calculation of parameter processing, the characteristic quantity of the constant time period of osophone 110 reference records and auditory properties information according to the command execution analysis that sends, and are calculated the parameter of handling adjustment for signal.
Osophone 110 makes handles the adjustment parameter reflection processing that enters step ST17.Adjusting during the parameter reflection handles, osophone 110 is adjusted and is necessary that the signal of adjusting handles coefficient or the AGC of (for example, filtering is handled) and arrange, and removes the characteristic quantity of the constant time period of record fully.After the processing of step ST17, osophone 110 makes handles the sound signal processing that enters step ST13.
In the above description, in the adjustment parameter reflection of step ST17 was handled, osophone 110 was removed the characteristic quantity that is recorded in the constant time period in the blotter unit 118 fully.Yet osophone 110 can not exclusively be removed characteristic quantity.For example, when the memory capacity of blotter unit 118 was big, osophone 110 can be carried out new record continuously under situation about not removing.
As mentioned above, in the hearing aid device system 10 shown in Fig. 1, the user can from the display unit that is presented to remote controllers 150 and selected the subjective option of expressing and the preset selective item corresponding to the subjective feeling of hearing sound.The information of selected preset selective item is sent to osophone 110.In osophone 110, carry out the processing that is used for adjusting based on described preset selective item volume and the tonequality of voice signal.Therefore, the user can be according to the sound of the subjective sensation of sound being adjusted in the osophone 110 (volume and tonequality).Even the user does not have detail knowledge to sound, but the also adjustment of carry out desired of user.
In the above description, osophone 110L and 110R and remote controllers 150 are carried out radio communication.As shown in Figure 5, osophone 110L and 110R and remote controllers 150 can be carried out wire communication.In this case, shown in the dotted line among Fig. 2 (a) and Fig. 2 (b), order directly is provided for the adjustment parameter calculation unit 120 of osophone 110 from the command conversion unit 155 of remote controllers 150.At this moment, the antenna 121 of the remote controllers transmitting element 156 of remote controllers 150 and antenna 157 and osophone 110 and osophone receiving element 122 become unnecessary.
Although more than do not describe in detail, be presented (demonstrations) and give the demonstration form of option of the display unit 152 of remote controllers 150 can be according to the audio signal characteristics amount of selected option or processing object and dynamically change.By showing the dynamic change of form, the user can be suitably, carry out the sound adjustment based on the selection of option expeditiously.Below, will the example of the dynamic change that shows form be described.
Fig. 6 shows and is presented the example that (demonstration) gives the situation that the size of character of option of the display unit 153 of remote controllers 150 changes according to the audio signal characteristics amount of the processing object in the osophone 110.In this case, be necessary to offer remote controllers 150 by the wired or wireless characteristic quantity that phonetic analysis unit 117 is obtained from osophone 110.In this example, in the demonstration form of " A ", when detecting the characteristic quantity of loud sound, as the demonstration form of " B ", " too loud " highlighted and shown widely, and " loud and clear " that is associated highlighted and shown a little bigly.In this example, do not change the size of other options.Yet, the size of other options can be diminished.For example, even be not detected or the selection of option when finishing (that is to say that the order input is finished) when the characteristic quantity of loud sound, show that form also turns back to the demonstration form of " A " from the demonstration form of " B ".
Fig. 7 shows and is presented the example that (demonstration) gives the situation that the Show Color of option of the display unit 153 of remote controllers 150 changes according to the audio signal characteristics amount of the processing object in the osophone 110.In this example, in the demonstration form of " A ", when the feature of loud sound is detected, demonstration form as " B ", Show Color that will " too loud " becomes the color of the color that is different from other options, and the Show Color of " loud and clear " that will be associated becomes the color of the color that is different from other options.In this example, do not change the color of other options.Yet, the Show Color of other options is brightened and change the color of other options.For example, when (that is to say that the order input is finished) finished in the selection of the characteristic quantity that is not detected loud sound or option, show that form turns back to the demonstration form of " A " from the demonstration form of " B ".
As mentioned above, the size of display items display or color change according to the audio signal characteristics amount of the processing object in the osophone 110.In addition, under normal condition, can show " loud ", " noisy ", " ear-piercing " and " loud and clear ".When the level of sound import reduces, can make display items display become " being difficult to differentiate ", " peace and quiet " and " unclear ".
Fig. 8 shows and is presented the example that (demonstration) gives the situation that the option of the display unit 153 of remote controllers 150 changes according to the option of selecting.In this example, in the demonstration form of " A ", when " ear-piercing " is selected, as the demonstration form of " B ", show the option (for example, " further inhibition " and " being suppressed a bit too much ") that can be used for the new adjustment for the adjustment of " ear-piercing "." returning " is the last button of adjusting of cancellation, and " stopping " is to fully phase out the button of this time adjusting." it how " can present with the form of sound.For example, when " determining " button or " stopping " button are operated, show that form returns the demonstration form of " A " from the demonstration form of " B ".
Fig. 9 shows and is presented the example that (demonstration) gives the situation that the option of the display unit 153 of remote controllers 150 changes according to the option of selecting.In this example, in the demonstration form of " A ", when " noisy " is selected, as the demonstration form of " B ", show with the subjectivity of lower level structure for the adjustment of " noisy " and express corresponding option (for example, " ear-piercing " and " noise ")." returning " is the last button of adjusting of cancellation, and " stopping " is to fully phase out the button of this time adjusting." it how " can present with the form of sound.For example, when " determining " button or " stopping " button are operated, show that form returns the demonstration form of " A " from the demonstration form of " B ".
In the above description, being presented (demonstration), to express for the subjectivity of option of the display unit 153 of remote controllers 150 are the expression (such as " too loud " and " noise ") that show subjective sensation.Yet as shown in figure 10, the expression of option can be the expression (such as " expectation is listened to the music " and " expectation is seen a film ") that shows subjective request.
Figure 11 shows the example of expressing for the subjectivity of sound, and these expression can be changed into the expression of subjective sensation and subjective request.
In the above description, in the adjustment parameter calculation unit 120 of osophone 110, add the auditory properties that is recorded in the user in the auditory properties record cell 119 as single parameter, and calculate the adjustment parameter corresponding with this order.Yet described single parameter is not limited to auditory properties.For example, the characteristic of the characteristic of microphone 111-1 and 111-2 and loudspeaker 116 can be added, and perhaps can be used independently.In this case, shown in the dotted line among Fig. 2 (a) and Fig. 2 (b), the characteristic of microphone and loudspeaker is measured in advance, and is recorded in the record cell.
In the above description, in remote controllers 150, Show Options on display unit 152 so that option is presented to the user, that is to say, from visually option being presented to the user.Yet option can present with the form from the sound of loudspeaker (not shown) output, that is to say, can be from acoustically presenting.
In the above description, osophone 110 is carried out the analyzing and processing of the voice signal of handling object and is adjusted CALCULATION OF PARAMETERS and handle.Yet, but remote controllers 150 execution analysis processing or computings, perhaps execution analysis processing and computing these two, with the processing load that reduces osophone 110 with reduce consumed power.
Figure 12 (a) and Figure 12 (b) show and adjust the CALCULATION OF PARAMETERS processing by the osophone 110 under the situation of remote controllers 150 execution and the structure example of remote controllers 150.In Figure 12 (a) and Figure 12 (b), represent with identical label with the structural detail that the structural detail of Fig. 2 (a) and Fig. 2 (b) is corresponding, and suitably omit the detailed explanation of these structural details.
Figure 12 (b) shows the structure example of remote controllers 150.Remote controllers 150 comprise control module 151, user operation unit 152, display unit 153, input receiving element 154, command conversion unit 155, remote controllers transmitting element 156 and antenna 157.Remote controllers 150 also comprise antenna 161, remote controllers receiving element 162, blotter unit 163, auditory properties record cell 164 and adjust parameter calculation unit 165.
From the information of the audio signal characteristics amount that comprises processing object that antenna 161 receives and that send from osophone 110, remote controllers receiving element 162 obtains characteristic quantity.Be similar to the blotter unit shown in Fig. 2 (a), the characteristic quantity that 163 blotter phonetic analysis unit 117, blotter unit obtain that is to say, preserves characteristic quantity during the Preset Time section.When existing as the osophone 110L of osophone 110 and 110R, blotter unit 163 is recorded in each characteristic quantity not in the same district.Be similar to the auditory properties record cell 119 shown in Fig. 2 (a), auditory properties record cell 164 is recorded as single parameter with user's auditory properties.
Be similar to the adjustment parameter calculation unit 120 shown in Fig. 2 (a), adjust order that parameter calculation unit 165 obtains based on command conversion unit 155, be recorded in the audio signal characteristics amount of the processing object in the blotter unit 163 and the auditory properties that is recorded in the auditory properties record cell 164 calculates the adjustment parameter.When existing as two osophone 110L of osophone 110 and 110R, adjust parameter calculation unit 165 and use each characteristic quantity that each osophone is calculated the adjustment parameter individually.
156 pairs of remote controllers transmitting elements are adjusted the adjustment parameter execution transmission processing that parameter calculation unit 165 is calculated, and produce to comprise the transmission information of adjusting parameter, and the information that will send send to osophone 110 from antenna 157.When existing as two osophone 110L of osophone 110 and 110R, remote controllers transmitting element 156 will send to each osophone for the adjustment parameter of each osophone respectively.Other structures of remote controllers 150 are identical with other structures of the remote controllers 150 shown in Fig. 2 (b).
Figure 12 (a) shows osophone 110(110L and 110R) the structure example.Osophone 110 comprises microphone 111-1 and 111-2, A/D converter (ADC) 112-1 and 112-2, signal processing unit 113, D/A converter (DAC) 114, volume adjustment unit 115 and loudspeaker 116.Osophone 110 also comprises phonetic analysis unit 117, osophone transmitting element 123, antenna 124, antenna 121, osophone receiving element 122 and adjusts parameter updating block 125.
The characteristic quantity that 123 pairs of phonetic analysis unit 117 of osophone transmitting element obtain is carried out to send and is handled, and produces to comprise the transmission information of this characteristic quantity, and should transmission information send to remote controllers 150 from antenna 124.The information that osophone receiving element 122 receives from antenna 121 is obtained the adjustment parameter that sends from remote controllers 150.Adjusting parameter updating block 125 arranges the adjustment parameter that osophone receiving element 122 obtains to signal processing unit 113.Other structures of osophone 110 are identical with other structures of the osophone 110 shown in Fig. 2 (a).
Next, will the normal running of osophone 110 be described.Ambient sound is picked up by microphone 111-1 and 111-2, and obtains from microphone 111-1 and 111-2 with the sound corresponding simulating voice signal that picks up.A/D converter 112-1 and 112-2 are digital signal with analoging sound signal from analog signal conversion, and this digital audio signal is offered signal processing unit 113.
In signal processing unit 113, digital audio signal is carried out default sound signal processing.D/A converter 114 will be converted to simulating signal from digital signal from the treated digital audio signal of signal processing unit 113 outputs, and this analoging sound signal is supplied with volume adjustment unit 115.In volume adjustment unit 115, adjust the volume of analoging sound signal with the value of setting.Voice signal through the volume adjustment is provided for loudspeaker 116, and exports from loudspeaker 116 based on the sound of this voice signal.
Be provided for phonetic analysis unit 117 from the treated digital audio signal of signal processing unit 113 outputs.In phonetic analysis unit 117, digital audio signal is carried out phonetic analysis handle, and obtain the characteristic quantity of this digital audio signal.This characteristic quantity is provided for osophone transmitting element 123.In osophone transmitting element 123, characteristic quantity is carried out transmission handle, and will comprise that the information of this characteristic quantity sends to remote controllers 150 from antenna 124.
In remote controllers 150, the information that sends from osophone 110 is received by antenna 161, and is provided for remote controllers receiving element 162.In remote controllers receiving element 162, the audio signal characteristics amount of the processing object in the osophone 110 is obtained from the information that receives, and is supplied to blotter unit 118, and is saved during the Preset Time section.
Next, with the operation of describing under the situation that the user operates remote controllers 150.When the user expected that adjustment is listened to, the user selected subjective sensation according to worried sensation from present (demonstration) option to the display unit 153 of remote controllers 150.In remote controllers 150, the information (for example, the ID of selected option) of the option that the user selects is transfused to receiving element 154 and receives, and is sent to command conversion unit 155.
In command conversion unit 155, the information of transmission is converted into the order that is associated with this information, and is provided for adjustment parameter calculation unit 165.In adjusting parameter calculation unit 165, if supply with order from order converting unit 155, then calculate and adjust parameter.In this case, calculate the adjustment parameter based on the auditory properties information that is recorded in the characteristic quantity in the blotter unit 163 and be recorded in the auditory properties record cell 164.Adjust parameter and be provided for remote controllers transmitting element 156.In remote controllers transmitting element 156, carry out the transmission processing to adjusting parameter, and will comprise that the information of this adjustment parameter sends to osophone 110 from antenna 157.
In osophone 110, the information that sends from remote controllers 150 is received by antenna 21, and is supplied to osophone receiving element 122.In osophone receiving element 122, adjust parameter and from the information that receives, obtained, and be provided for adjustment parameter updating block 125, and the adjustment parameter in the signal processing unit 113 is updated.In signal processing unit 113, adjust various signals processing according to adjusting parameter.As a result, voice signal is adjusted effectively.
The process flow diagram of Figure 13 shows the treatment scheme of remote controllers 150.Remote controllers 150 periodically or according to carrying out from user's clearly instruction are handled.In step ST21, remote controllers 150 begin to handle.In step ST22, remote controllers 150 judge whether to receive characteristic quantity from osophone 110.When receiving characteristic quantity, in step ST23, remote controllers 150 are carried out blotter and are upgraded processing.Upgrade in the processing at blotter, remote controllers 150 are kept at the characteristic quantity that receives in the blotter unit 163.
Then, remote controllers 150 make and handle the order input judgment processing that enters step ST24.When judgement did not receive characteristic quantity in step ST22, remote controllers 150 make immediately handled the processing that enters step ST24.In order input judgment processing, remote controllers 150 judge whether to exist the order from the user, that is to say, to adjusting the request of sound (volume and tonequality).When having this request, remote controllers 150 make handles the adjustment calculation of parameter processing that enters step ST25.In adjusting the calculation of parameter processing, the characteristic quantity of the constant time period of remote controllers 150 reference records and auditory properties information according to the command execution analysis, and are calculated for signal and are handled the parameter of adjusting.
Then, remote controllers 150 make and handle the adjustment parameter transmission processing that enters step ST26.In adjusting parameter transmission processing, the adjustment parameter that remote controllers 150 will calculate in step ST25 sends to osophone 110.In this case, adjusting argument sequence can be sent out same as before.Yet, can carry out the Information Compression based on predetermined communication method, and can send information.After the processing of step ST26, in step ST27, remote controllers 150 end process.
The process flow diagram of Figure 14 shows the treatment scheme of osophone 110.Osophone 110 periodically or according to carrying out from user's clearly instruction is handled.In step ST31, osophone 110 begins to handle.In step ST32, osophone 110 judges whether to receive the adjustment parameter.When receiving the adjustment parameter, osophone 110 makes handles the adjustment parameter reflection processing that enters step ST33.Adjusting during the parameter reflection handles, osophone 110 is carried out the setting (for example, the coefficient setting handled of filtering or to the setting of the AGC of signal processing unit 113) of the adjustment parameter that receives.
Then, osophone 110 makes and handles the sound signal processing that enters step ST34.When judgement in step ST32 did not receive the adjustment parameter, osophone 110 makes immediately handled the processing that enters step ST34.In sound signal processing, osophone 110 is carried out sound signal processing and is listened to improvement, and by not shown system voice signal is outputed to loudspeaker.
Then, osophone makes and handles the voice signal analyzing and processing that enters step ST35.In the voice signal analyzing and processing, osophone 110 is carried out the voice signal analyzing and processing to calculate employed characteristic quantity in adjusting the calculation of parameter processing.After the processing of execution in step ST35, osophone 110 makes handles the characteristic quantity transmission processing that enters step ST36.Send in the processing at characteristic quantity, the characteristic quantity that osophone 110 will calculate in step ST35 sends to remote controllers 150.In this case, characteristic sequence can be sent out same as before.Yet, can carry out the Information Compression based on predetermined communication method, and can send information.After the processing of step ST36, in step ST37, osophone 110 end process.
In the above description, osophone 110L and 110R and remote controllers 150 are carried out radio communication.Yet osophone 110 and 110R and remote controllers 150 can be carried out wire communication.In this case, shown in the dotted line among Figure 12 (a) and Figure 12 (b), characteristic quantity directly is delivered to the blotter unit 163 of remote controllers 150 from the phonetic analysis unit 117 of osophone 110, and adjusts parameter directly is delivered to osophone 110 from the adjustment parameter calculation unit 165 of remote controllers 150 adjustment parameter updating block 125.In this case, in remote controllers 150, antenna 161, remote controllers receiving element 162, remote controllers transmitting element 156 and antenna 157 become unnecessary.In osophone 110, antenna 121, osophone receiving element 122, osophone transmitting element 123 and antenna 124 become unnecessary.
In the structure shown in Figure 12 (a) and Figure 12 (b), phonetic analysis is handled by osophone 110 and is carried out.Yet as mentioned above, phonetic analysis is handled and can be carried out by remote controllers 150.In this case, although not shown, the voice signal of exporting from signal processing unit 113 is sent to remote controllers 150 from osophone 110, and remote controllers 150 are analyzed voice signals and obtained characteristic quantity.At this moment, in osophone 110, phonetic analysis unit 117 becomes unnecessary, and circuit scale reduces, and has saved consumed power.
<2. second embodiment 〉
[structure of TV system]
Figure 15 shows the structure example according to the TV system 20 of second embodiment.TV system 20 comprises the remote controllers 250 of television receiver (TV receiver) 210 and control television receiver 210.
Television receiver 210 can use radio communication to carry out intercommunication mutually with remote controllers 250.Television receiver 210 and remote controllers 250 can use another kind of method (for example, based on the communication in the communication of magnetic or the scope that can't hear) to carry out intercommunication mutually.The touch panel formula remote controllers (being similar to the remote controllers 150 in the above-mentioned hearing aid device system 10) that the button that remote controllers 250 can be the push button remote controllers, wherein be provided with dynamically changes or therein communication mechanism be used as the another kind of equipment (such as portable terminal or dull and stereotyped terminal) that program is installed.
Watch the user under the state of TV, osophone 110L and 110R are by remote controllers 250 controls.When the user selected worried project according to the impression of sound of television, for example, when the user heard ear-piercing sound and selects " ear-piercing " button, the information of selected project was sent to television receiver 210, and sound is adjusted.
Figure 16 (b) shows the structure example of remote controllers 250.Remote controllers 250 comprise control module 251, user operation unit 252, display unit 253, input receiving element 254, command conversion unit 255, remote controllers transmitting element 256 and antenna 257.
Control module 251 comprises CPU, and the operation of each unit of control remote controllers 250.User operation unit 252 and display unit 253 form user interface.User operation unit 252 is that the user passes through the unit that it carries out various operations.For example, user operation unit 252 uses button or touch panel to construct.Display unit 253 uses LCD to construct.
On display unit 253, the display operation state.In addition, when the sound of television receiver 210 is adjusted, the option (being provided for " too loud ", " too quiet " and " ear-piercing " of the remote controllers 250 of Figure 15) that presents at display unit 253 that (demonstration) express by subjectivity and be associated with control to voice signal.When the sound of television receiver 210 is adjusted, in the time identical with Show Options on the display unit 253 at remote controllers 250, can carry out identical demonstration at the screen of television receiver 210.In this case, demonstration information is sent to television receiver 210 from remote controllers 250.
Input receiving element 254 receives the information (for example, the ID of selected option) of the option of user's selection from control module 251.Input receiving element 254 can be integrated with control module 251.The order of information translation for being associated with this information that receiving element 254 receives will be imported in command conversion unit 255.For example, when the ID of option " ear-piercing " was sent out, command conversion unit 255 was converted to this ID the order that means " ear-piercing ".256 pairs of command execution by 255 conversions of command conversion unit of remote controllers transmitting element send to be handled, and produces to comprise the transmission information of this order, and should transmission information send to television receiver 210 from antenna 257.
Figure 16 (a) shows the structure example of the sound system of television receiver 210.Television receiver 210 comprises digital audio signal input block 211, signal processing unit 212, D/A converter (DAC) 213, volume adjustment unit 214 and loudspeaker 215.Television receiver 210 also comprises phonetic analysis unit 216, blotter unit 217, loudspeaker performance record cell 218, adjusts parameter calculation unit 219, antenna 220 and TV receiving element 221.
Digital audio signal input block 211 obtains the digital audio signal that the digital tuner (not shown) obtains.Signal processing unit 212 is carried out default effect process (for example, being used for adding the processing of virtual sound field and the processing that is used for amplifying low frequency).D/A converter 213 will be converted to simulating signal from digital signal from the voice signal of signal processing unit 212 outputs.Volume adjustment unit 214 usefulness values of setting are adjusted the volume of the voice signal of D/A converter 213 acquisitions, and this voice signal is outputed to loudspeaker 215.In order to simplify explanation, the voice output unit is illustrated as a system.Yet the voice output unit can be constructed to two or more systems.
Be similar to the phonetic analysis unit 117 shown in Fig. 2 (a), the 216 pairs of digital audio signals from signal processing unit 212 outputs in phonetic analysis unit are carried out phonetic analysis and are handled, and obtain characteristic quantity.Characteristic quantity is the power of each frequency band after for example the frequency band division of included Pitch Information, third-octave and critical band is handled in the digital audio signal, the spectrum position (frequency) of the peak power by carrying out the power spectrum that time-frequency conversion (such as DFT) obtains or the cepstral coefficients of power spectrum.
Be similar to the blotter unit 118 shown in Fig. 2 (a), the characteristic quantity that 217 blotter phonetic analysis unit 216, blotter unit obtain that is to say, preserves characteristic quantity during the Preset Time section.Loudspeaker performance record cell 218 is single parameter with the characteristic records of loudspeaker 215.Loudspeaker performance is measured in advance, and is recorded in the loudspeaker performance record cell 218.The information that TV receiving element 221 receives from antenna 220 is obtained the order corresponding with subjective sensation that sends from remote controllers 250.Adjust order that parameter calculation unit 219 obtains based on TV receiving element 221, be recorded in the audio signal characteristics amount of the processing object in the blotter unit 217 and the loudspeaker performance that is recorded in the loudspeaker performance record cell 218 calculates the adjustment parameter of adjusting voice signal in signal processing unit 212.
Adjust parameter calculation unit 219 following calculating and adjust parameter.For example, when the order corresponding with " being difficult to hear sound " is sent out, the frequency of the loudspeaker of adjustment parameter calculation unit 219 from voiceband (for example, the frequency band of 500Hz to 4kHz) and the Pitch Information that is recorded in the time series recording feature amount are calculated the adjustment parameter that the reinforcement of execution resonance peak is handled and the consonant reinforcement is handled.When having the Pitch Information of bass in the Pitch Information in being recorded in time series recording feature amount, adjust parameter calculation unit 219 and calculate the strong adjustment parameter of adjusting low-frequency band.
For example, adjust parameter calculation unit 219 and calculate such adjustment parameter, this adjustment parameter makes that the frequency band with good loudspeaker performance is actively used, and the frequency band with the inferior loudspeaker performance that causes audio distortions is not carried out and strengthened handling.Adjust parameter calculation unit 219 and calculate the adjustment parameter, the feasible envelope of composing according to the cepstral coefficients rated output of time series recording feature amount, judge whether to exist background sound, when the signal in the existence frequency band higher than voiceband, judge and have background sound, and when there is background sound in judgement, adjust the intensity of the compression processing of effect sound according to the high frequency characteristics of loudspeaker.
Next, will the normal running of the sound system of television receiver 210 be described.The digital audio signal that is input to digital audio signal input block 211 is provided for signal processing unit 212.In signal processing unit 212, digital audio signal is carried out sound signal processing (amplifying processing such as default effect process and low frequency).D/A converter 213 will be converted to simulating signal from digital signal from the treated digital audio signal of signal processing unit 212 outputs, and this analoging sound signal is offered volume adjustment unit 214.In volume adjustment unit 214, adjust the volume of analoging sound signal with the value of setting.Voice signal through the volume adjustment is provided for loudspeaker 215, and exports from loudspeaker 215 based on the sound of this voice signal.
Be provided for phonetic analysis unit 216 from the treated digital audio signal of signal processing unit 212 outputs.In phonetic analysis unit 216, digital audio signal is carried out phonetic analysis handle, obtain the characteristic quantity of digital audio signal, and the characteristic quantity that obtains is offered blotter unit 217, and during the Preset Time section, preserve this characteristic quantity.
By this way, carry out the normal running of the sound system of television receiver 210.In the above description, work in phonetic analysis unit 217 and blotter unit 217 always.Yet phonetic analysis unit 216 and blotter unit 217 can be constructed to make their work by the operation of remote controllers, to reduce power consumption.In this case, by not shown system, the signal of the operation after remote controllers receiving element 221 send/stops phonetic analysis unit 216.For example, when remote controllers (such as touch panel) display-operation picture, phonetic analysis unit 117 and blotter unit 217 can send signal to television receiver 210, and television receiver 210 can receive this signal, and carries out aforesaid operation for checking phonetic analysis unit 216 and blotter unit 217 according to the signal that receives.
Next, with the operation of describing under the situation that the user operates remote controllers 250.In this case, in order to simplify explanation, suppose to make phonetic analysis unit 216 and blotter unit 217 to work always.
When the user expected that adjustment is listened to, the user selected subjective sensation according to worried sensation from be presented (demonstration) option to the display unit 253 of remote controllers 250.In remote controllers 250, the information (for example, the ID of selected option) of the option that the user selects is transfused to receiving element 254 and receives, and is sent to command conversion unit 255.
In command conversion unit 255, the information of transmission is converted into the order that is associated with this information.For example, when the ID of option " ear-piercing " was sent out, this ID was converted into the order that means " ear-piercing ".The order that command conversion unit 255 obtains is supplied to remote controllers transmitting element 256.In remote controllers transmitting element 256, this command execution is sent processing, and will comprise that the information of this order sends to television receiver 210 from antenna 257.
In television receiver 210, the information that sends from remote controllers 250 is received by antenna 220, and is supplied to TV receiver 221.In TV receiver 2210, the order corresponding with subjective sensation obtained from the information that receives, and is provided for adjustment parameter calculation unit 219.In adjusting parameter calculation unit 219, if supply with order from TV receiving element 221, then calculate the adjustment parameter corresponding with this order.In this case, signal processing unit 212 calculates the adjustment parameter of adjusting voice signal (handling the voice signal of object) based on the loudspeaker performance information that will be recorded in the time series recording feature amount in the blotter unit 217 and be recorded in the loudspeaker performance record cell 218.
As method that calculate to adjust parameter, also consider to calculate the method for adjusting parameter by the loudspeaker performance information of reference record in loudspeaker performance record cell 218 only.Calculate the method for adjusting parameters as adjusting parameter calculation unit 219, also consider by the time series recording feature amount of reference record in blotter unit 217 and be recorded in the loudspeaker performance record cell 218 loudspeaker performance information these two calculate the method for adjusting parameter.In the method, from a plurality of default adjustment parameters, select the adjustment parameter corresponding with order, and use this adjustment parameter.
The adjustment parameter that adjustment parameter calculation unit 219 is calculated as mentioned above like that is provided for signal processing unit 212.In signal processing unit 212, when sending the adjustment parameters from adjustment parameter calculation unit 219, adjust various signals according to this adjustment parameter and handle.As a result, voice signal is adjusted.
As mentioned above, in the TV system 20 shown in Figure 15, the user can select from display unit and the option that subjectively expressed that is presented to remote controllers 250 and the preset selective item corresponding to the subjective feeling of hearing sound.The information (order) of the preset selective item of selecting is sent to television receiver 210.In television receiver 210, carry out the processing of adjusting volume and the tonequality of voice signal based on described preset selective item.Therefore, the user can be to adjust sound (volume and tonequality) in television receiver 210 to the subjective sensation of sound.Even the user does not have detail knowledge to sound, but the also adjustment of carry out desired of user.
In the above description, transcriber is television receiver.Yet, even when transcriber be another kind of equipment (for example, such as the equipment of the PC of audio reproducing device, portable music reconstructor or output sound), this reproducer also can be adjusted identical sound (volume and tonequality).
In the above description, television receiver 210 and remote controllers 250 are carried out radio communication.Yet television receiver 210 and remote controllers 250 can be constructed to carry out wire communication.In this case, shown in the dotted line among Figure 16 (a) and Figure 16 (b), order directly is provided for the adjustment parameter calculation unit 219 of television receiver 210 from the command conversion unit 255 of remote controllers 250.At this moment, the antenna 220 of the remote controllers transmitting element 256 of remote controllers 250 and antenna 257 and television receiver 210 and TV receiving element 221 become unnecessary.
In the above description, TV system 20 comprises television receiver 210 and remote controllers 250.Yet subjective option of expressing can be presented on the screen of television receiver 210, and the user can use action button set in the shell of television receiver 210 to carry out the selection operation.
In the above description, television receiver 210 has loudspeaker performance record cell 218.Yet as shown in figure 17, television receiver 210 can use the loudspeaker performance in the loudspeaker performance record cell in the server unit 280 that is kept on the cloud.In this case, though when external loudspeaker when the loudspeaker 215, the loudspeaker performance of external loudspeaker also can obtain from the server unit 280 on the cloud, and can be provided for and adjust parameter calculation unit 219.For this reason, in adjusting parameter calculation unit 219, can suitably calculate the adjustment parameter according to the external loudspeaker characteristic.
In the above description, the user uses the button of remote controllers to come the directive command input.Yet microphone can be arranged in television receiver 210 and the remote controllers 250, so that use sound to come the fill order input.When the layout of television receiver 210 is local wide, can arrange a plurality of microphones, and can be from sound Probability Detection user's direction, and can directivity turn to the detection side to state under carry out the order input of using sound.Can arrange camera, the user can make certain gestures, and can turn in the directivity of microphone under user's the state of direction and carry out the order input of using sound, perhaps can only use camera to carry out order input based on a plurality of gestures.
In remote controllers 250, can arrange the multiaxis accelerator sensor, and can come input command by the swinging method of remote controllers 250.Can use for the mechanism of constructing following user interface and adjusting with the subjective sensation execution, described user interface is used for (for example working as specific display items display, ear-piercing) carry out slide block control or multistage adjustment (such as the adjustment of the power by Show Color/temperature) when being selected, rather than press the button repeatedly and adjust.This interface can be by multiaxis to showing (for example, with ear-piercing and clear), and the project on the space can be selected, and can carry out adjustment.
<3. the 3rd embodiment 〉
[structure of osophone]
Figure 18 shows the osophone 310 according to the 3rd embodiment.In first embodiment, use the operation of remote controllers 150 to adjust osophone 110(110L and 110R by the user) sound (volume and tonequality).But osophone 310 sound imports.
Figure 19 shows the structure example of osophone 310.In Figure 19, represent with identical Reference numeral with the structural detail that the structural detail of Fig. 2 (a) and Fig. 2 (b) is corresponding, and suitably omit the detailed explanation of these structural details.Osophone 310 comprises microphone 111-1 and 111-2, A/D converter (ADC) 112-1 and 112-2, signal processing unit 113, D/A converter (DAC) 114, volume adjustment unit 115 and loudspeaker 116.
Osophone 310 also comprises phonetic analysis unit 117, blotter unit 118, auditory properties record cell 119, adjusts parameter calculation unit 120a and adjusts parameter updating block 120b.Osophone 310 also comprises order commencing signal receiving element 130, switch unit 131, many sound signal processing unit 132, pre-converted sound signal processing unit 133, voice command converting unit 134 and sound command process unit 135.
Microphone 111-1 and 111-2 pick up ambient sound, and obtain voice signal.Two microphone 111-1 and 111-2 are included to make it possible to carry out the processing for the controlling party tropism.The quantity of microphone can be one, perhaps can be three or more.A/D converter 112-1 and 112-2 are digital signal with the voice signal of microphone 111-1 and 111-2 acquisition from analog signal conversion.
The voice signal that 113 couples of A/D converter 112-1 of signal processing unit and 112-2 obtain (handling the voice signal of object) is carried out various processing.D/A converter 114 will be converted to simulating signal from digital signal from the voice signal of signal processing unit 113 outputs.Volume adjustment unit 115 usefulness values of setting are adjusted the volume of the voice signal of D/A converter 114 acquisitions, and this voice signal is outputed to loudspeaker 116.
The 117 pairs of digital audio signals from signal processing unit 113 outputs in phonetic analysis unit are carried out phonetic analysis and are handled, and obtain characteristic quantity.The characteristic quantity that 118 blotter phonetic analysis unit 117, blotter unit obtain that is to say, preserves characteristic quantity during the Preset Time section.Adjust parameter calculation unit 120a based on the sound input command, be recorded in the characteristic quantity of the processing object in the blotter unit 118 and the auditory properties that is recorded in the auditory properties record cell 119 calculates the adjustment parameter of adjusting voice signal in signal processing unit 113.The adjustment parameter that adjustment parameter updating block 120b will calculate is set to signal processing unit 113.Adjustment parameter calculation unit 120 shown in Fig. 2 (a) is corresponding to adjusting parameter calculation unit 120a and adjusting parameter updating block 120b.
Switch unit 131 optionally will offer signal processing unit 113 or many sound signal processing unit 132 from the digital audio signal of A/D converter 112-1 and 112-2 output.When order commencing signal receiving element 130 received the control signal of indication beginning voice command input, order commencing signal receiving element 130 began to prepare the voice command input.When the regulation button of osophone 310 was operated by the user, order commencing signal receiving element 130 received the control signal of sign on.
When order commencing signal receiving element 130 received the control signal of sign on, order commencing signal receiving element 130 offered switch unit 131 with switching signal.Thereby, carry out the state that is provided for signal processing unit 113 from the digital audio signal from A/D converter 112-1 and 112-2 output is provided for the state of many sound signal processing unit 132 to digital audio signal switching.
Many sound signal processing unit 132 synthetic a plurality of digital audio signals (in the present embodiment, two digital audio signals), the position relation of a plurality of microphones of determining during from design is considered phase differential, and directivity is turned to user's front.The processing that pre-converted sound signal processing unit 133 is carried out for generation of the voice signal that will be sent to voice command converting unit 134.For example, frequency band definite when being used for suppressing design (is for example carried out in pre-converted sound signal processing unit 133, the processing of the outside frequency band (200Hz to 3kHz) of sound), the sample frequency that frequency inverted was determined for when design, and specify good voice signal part from the oscillator intensity of voice signal.
Voice command converting unit 134 is carried out the processing of handling such as voice recognition, and voice signal is converted to voice command.Voice command processing unit 135 is carried out processing according to the transformation result of the voice command in the voice command converting unit 134.That is to say that when voice signal can be converted into voice command, voice command processing unit 135 sent to voice command and adjusts parameter calculation unit 120a.Simultaneously, when voice signal can not be converted into voice command, voice command processing unit 135 will send to switch unit 131 for the control signal that switches to signal processing unit 113.
Next, will the normal running of osophone 310 be described.Ambient sound is picked up by microphone 111-1 and 111-2, and obtains and the sound corresponding simulating voice signal that picks up from microphone 111-1 and 111-2.A/D converter 112-1 and 112-2 are digital signal with analoging sound signal from analog signal conversion.
In normal running, switch unit 131 is switched to signal processing unit 113 sides.For this reason, the digital audio signal from A/D converter 112-1 and 112-2 output is provided for signal processing unit 113.In signal processing unit 113, digital audio signal is carried out default sound signal processing.D/A converter 114 will be converted to simulating signal from digital signal from the treated digital audio signal of signal processing unit 113 outputs, and this analoging sound signal is supplied with volume adjustment unit 115.In volume adjustment unit 115, adjust the volume of analoging sound signal with the value of setting.Voice signal through the volume adjustment is provided for loudspeaker 116, and from the sound of loudspeaker 116 outputs based on this voice signal.
Be provided for phonetic analysis unit 117 from the treated digital audio signal of signal processing unit 113 outputs.In phonetic analysis unit 117, digital audio signal is carried out phonetic analysis handle, obtain the characteristic quantity of digital audio signal, and the characteristic quantity that obtains is provided for blotter unit 118, and during the Preset Time section, is saved.
Next, operate the regulation button of osophone 310 and indicate operation under the situation of osophone 310 beginning voice commands inputs describing the user.In this case, ordered commencing signal receiving element 130 to receive from the order commencing signal of control module (not shown).Carry switching signal from order commencing signal receiving element 130 to switch unit 131, and switch unit 131 is switched to the state that is provided for many sound signal processing unit 132 from the digital audio signal of A/D converter 112-1 and 112-2.
In many sound signal processing unit 132, synthetic described two voice signals, so that the position relation of a plurality of microphones of determining during from design is considered phase differential, and directivity is diverted user's front.The voice signal of being handled by many sound signal processing unit 132 is provided for pre-converted sound signal processing unit 133.
In pre-converted sound signal processing unit 133, to from many sound signal processing unit 132 voice signals of supplying with carry out processing for generation of the voice signal that will be supplied to voice command converting unit 134.For example, in pre-converted sound signal processing unit 133, (for example carry out frequency band definite when being used for suppressing design, the processing of the outside frequency band (200Hz to 3kHz) of sound), the sample frequency that frequency inverted was determined for when design, and specify good voice signal part from the oscillator intensity of voice signal.
The voice signal of being handled by pre-converted sound signal processing unit 133 is supplied to voice command converting unit 134.In voice command converting unit 134, carry out the processing of handling such as voice recognition, and voice signal is converted to voice command.The transformation result of voice command converting unit 134 is sent to voice command processing unit 135.In voice command processing unit 135, when voice signal can be converted into voice command, voice command is sent to adjusted parameter calculation unit 120a.Simultaneously, when voice signal can not be converted into voice command, be sent to switch unit 131 for the control signal that switches to signal processing unit 113 sides.
In adjusting parameter calculation unit 120a, if send voice command from voice command processing unit 135, then calculate and adjust parameter.In this case, signal processing unit 113 based on voice command, be recorded in the time series recording feature amount in the blotter unit 118 and the auditory properties information in the auditory properties record cell 119 of being recorded in is calculated the adjustment parameter of adjusting voice signal (handling the voice signal of object).The adjustment parameter is adjusted parameter updating block 120b and is set to signal processing unit 113.
Like this, be adjusted after parameter updating block 120b is set to signal processing unit 113 adjusting parameter, send the control signal that is used for switching to signal processing unit 113 sides from adjusting parameter updating block 120b to switch unit 131.Thereby osophone 310 enters aforesaid normal operating state, and signal processing unit 113 is carried out the signal processing based on the adjustment parameter that arranges recently.
As mentioned above, after voice command input beginning, switch unit 131 is switched to many sound signal processing unit 132 sides, till command process is finished.Therefore, stopping osophone handling.Yet voice signal can be supplied to signal processing unit 113 always, and can carry out osophone and handle during the voice command input.In this case, preferably, stop phonetic analysis unit 117 and blotter unit 118.
The process flow diagram of Figure 20 shows the treatment scheme of osophone 310.Osophone 310 periodically or according to carrying out from user's clearly instruction is handled.In step ST41, osophone 310 begins to handle.In step ST42, osophone 310 judges whether the user has indicated the input of voice command to begin.When order commencing signal receiving element 130 received the control signal that the input of indication voice command begins, osophone 310 had determined to indicate the input of voice command to begin.When the input of having indicated voice command began, osophone 310 makes handled the voice command input preparation processing that enters step ST43.
In the voice command input prepared to handle, osophone 310 was carried out the input of voice command and is prepared (for example, the control of switch unit 113).In step ST44,310 pairs of voice signals of osophone are carried out the pre-converted sound signal processing, that is to say the processing in many sound signal processing unit 132 and the pre-converted sound signal processing unit 133.
Then, in step ST45,310 pairs of treated voice signal fill order conversion process in step S44 of osophone.In command conversion was handled, osophone 310 was carried out voice recognition and is handled, and voice signal is converted to voice command.When voice signal can not be converted into voice command, osophone 310 was carried out and is used for the processing that notice does not obtain voice command.
Then, in step ST46, osophone 310 determines whether voice command can be identified.When voice command can be identified, in step ST47, osophone 310 was carried out and is adjusted the calculation of parameter processing.In step ST48, osophone 310 is carried out and is adjusted parameter reflection processing.After step ST48, osophone 310 makes handles the voice command end process that enters step ST49.In the voice command end process, osophone 310 is carried out the voice command end process, for example, is used for making switch unit 131 turn back to the processing of signal processing unit 131 sides.
Then, osophone 310 makes and handles the sound signal processing that enters step ST50.When determining not indicate the input instruction of voice command in step ST42, osophone 310 makes immediately handles the sound signal processing that enters step ST50.In sound signal processing, osophone 310 is carried out sound signal processing and is listened to improvement, and by not shown system voice signal is outputed to loudspeaker.
Then, osophone 310 makes and handles the voice signal analyzing and processing that enters step ST51.In the voice signal analyzing and processing, osophone 310 is carried out the voice signal analyzing and processing and is adjusted employed characteristic quantity in the calculation of parameter processing to calculate.After the processing of execution in step ST51, osophone 310 makes handles the blotter renewal processing that enters step ST52.After the processing of step ST52, in step ST53, osophone 310 end process.
As mentioned above, in the osophone 310 shown in Figure 18 and Figure 19, the user can be by means of the sound of the subjective sensation of sound being adjusted in the osophone 310 (volume and tonequality).Even the user does not have detail knowledge to sound, but the also adjustment of carry out desired of user.In this case, the user can carry out the sound input of the subjective order of expressing, and can improve availability.
The sound of input can be command name.Yet the sound of input can be the abbreviation that is distributed arbitrarily by the user.In this case, the sound of input can be set in advance by the user, can be recorded in the not shown recording areas, and can be referenced in the voice command conversion process.
<4. the 4th embodiment 〉
[structure of osophone]
Figure 21 shows a pair of osophone 410L and the 410R according to the 4th embodiment.Osophone 410L is connected by lead with 410R, and can communicate with one another.Be similar to the osophone 310 according to above-mentioned the 3rd embodiment, osophone 410L and 410R make it possible to the sound import order.In the 4th embodiment, a microphone is attached to each osophone, and is similar to above-mentioned the 3rd embodiment, and the input of voice command begins to be indicated by the user.
These two osophones are respectively master hearing aid and secondary osophone.If the input of voice command begins, then the sound input for secondary osophone is sent to master hearing aid, and master hearing aid is carried out the voice command conversion, and the order of identification turns back to secondary osophone.In the present embodiment, the user becomes master hearing aid by the osophone of the input of its indication voice command.
In the present embodiment, the communication between two osophones is undertaken by wire communication.Yet if use proper method, the communication between two osophones can be undertaken by radio communication.Two osophones can be carried out main operation jointly.In this case, two osophones send to voice signal each other, and need not return the order of identification.
Figure 22 (a) and Figure 22 (b) show the structure example of osophone 410L and 410R respectively.In Figure 22 (a) and Figure 22 (b), represent with identical Reference numeral with the structural detail that structural detail among Fig. 1 and Figure 19 is corresponding, and suitably omit the detailed explanation of these structural details.Figure 22 (a) shows the structure example of the osophone 410a of osophone 410L and 410R.Figure 22 (b) shows the structure example of another osophone 410b of osophone 410L and 410R.
Osophone 410a comprises a microphone 111, A/D converter (ADC) 112, signal processing unit 113, D/A converter (DAC) 114, volume adjustment unit 115 and loudspeaker 116.Osophone 410a also comprises phonetic analysis unit 117, blotter unit 118, auditory properties record cell 119, adjusts parameter calculation unit 120a and adjusts parameter updating block 120b.Osophone 310a also comprises many sound signal processing unit 132, pre-converted sound signal processing unit 133, voice command converting unit 134, voice command processing unit 135, switch unit 136, secondary voice signal sending/receiving unit 137, order commencing signal sending/receiving unit 138 and voice command sending/receiving unit 139.
Switch unit 136 optionally will flow to many sound signal processing unit 132 or secondary voice signal sending/receiving unit 137 from the digital audio signal of A/D converter 112 outputs.When order commencing signal sending/receiving unit 138 received the control signal that the input of the operation indication voice command by the user begins, order commencing signal sending/receiving unit 138 began to prepare the voice command input.The regulation button of user-operable osophone 410a, and the input of indication voice command begins.
When order commencing signal sending/receiving unit 138 receives the control signal that begins to indicate, order commencing signal sending/receiving unit 138 osophone 410a are set to " master hearing aid ", and will indicate the control signal of voice command input beginning to send to another osophone 410b that becomes " secondary osophone ".At this moment, switch unit 136 is supplied with switching signal in order commencing signal sending/receiving unit 138, so that the connection of carrying out from the c side to a side is switched.That is to say that digital audio signal is provided for many sound signal processing unit 132 from A/D converter 112.At this moment, order commencing signal sending/receiving unit 138 will indicate the control signal that receives to send to secondary voice signal sending/receiving unit 137.In addition, order commencing signal sending/receiving unit 138 will indicate the control signal of voice command transmission to send to voice command processing unit 135 and voice command sending/receiving unit 139.
When order commencing signal sending/receiving unit 138 received the control signal that the input of indication voice command begins from another osophone 410b, order commencing signal sending/receiving unit 138 began to prepare the voice command input.When order commencing signal sending/receiving unit 138 received the control signal that begins to indicate, order commencing signal sending/receiving unit 138 osophone 410a were set to " secondary osophone ".At this moment, switch unit 136 is supplied with switching signal in order commencing signal sending/receiving unit 138, so that the connection of carrying out from the c side to the b side is switched.That is to say that digital audio signal is provided for secondary voice signal sending/receiving unit 137 from A/D converter 112.Order commencing signal sending/receiving unit 138 will indicate the control signal that sends to send to secondary voice signal sending/receiving unit 137.In addition, order commencing signal sending/receiving unit 138 will indicate the control signal that receives voice command to send to voice command processing unit 135 and voice command sending/receiving unit 139.
Secondary voice signal sending/receiving unit 137 receives voice signal from another osophone 410b, perhaps voice signal is sent to another osophone 410b.That is to say, when sending the control signal of indication reception from order commencing signal sending/receiving unit 138, secondary voice signal sending/receiving unit 137 receives voice signal from another osophone 410b, and the voice signal that receives is sent to many sound signal processing unit 132.When sending the control signal of indication transmission from order commencing signal sending/receiving unit 138, secondary voice signal sending/receiving unit 137 sends to another osophone 410b with voice signal, and will send to another osophone 410b from the voice signal that switch unit 136 provides.
Voice command sending/receiving unit 139 sends to another osophone 410b with voice command, perhaps receives voice command from another osophone 410b.That is to say, when sending the control signal of indication transmission from order commencing signal sending/receiving unit 138, voice command sending/receiving unit 139 sends to another osophone 410b with voice command, and will send to another osophone 410b from voice command or the disabled order of expression conversion of voice command processing unit 135.When sending the control signal of indication reception from order commencing signal sending/receiving unit 138, voice command sending/receiving unit 139 receives voice signal from another osophone 410b.In addition, voice command sending/receiving unit 139 receives voice command from another osophone 410b, and this voice command is sent to voice command processing unit 135.
Voice command processing unit 135 flows to voice command and adjusts parameter calculation unit 120a, and handles the sending/receiving for the voice command of another osophone 410b.When sending the control signal of indication transmission from order commencing signal sending/receiving unit 138, voice command processing unit 135 is carried out processing according to the transformation result of the voice command in the voice command converting unit 134.That is to say that when command conversion was activated, voice command processing unit 135 sent to voice command and adjusts parameter calculation unit 120a and voice command sending/receiving unit 139.Simultaneously, when command conversion is disabled, voice command processing unit 135 will represent that the disabled order of command conversion sends to adjustment parameter calculation unit 120a and voice command sending/receiving unit 139, and will send to switch unit 136 be used to the control signal that switches to the c side.When sending the control signal of indication reception from order commencing signal sending/receiving unit 138, the voice command that voice command processing unit 135 receives voice command sending/receiving unit 139 sends to adjusts parameter calculation unit 120a.
Other structures of osophone 410a shown in Figure 22 (a) are identical with other structures of the osophone 310 shown in Figure 19.Because the osophone 410b shown in Figure 22 (a) has the structure identical construction with above-mentioned osophone 410a, omit its explanation.
Next, will the normal running of osophone 410a and 410b be described.Ambient sound is picked up by microphone 111, and obtains and the sound corresponding simulating voice signal that picks up from microphone 111.A/D converter 112 is digital signal with analoging sound signal from analog signal conversion, and this digital audio signal is offered signal processing unit 113.
In signal processing unit 113, digital audio signal is carried out default sound signal processing.D/A converter 114 will be converted to simulating signal from the treated digital audio signal of signal processing unit 113 outputs, and this analoging sound signal is offered volume adjustment unit 115.In volume adjustment unit 115, adjust the volume of analoging sound signal with the value of setting.Voice signal through the volume adjustment is fed to loudspeaker 116, and exports from loudspeaker 116 based on the sound of this voice signal.
Be provided for phonetic analysis unit 117 from the treated digital audio signal of signal processing unit 113 outputs.In phonetic analysis unit 117, digital audio signal is carried out phonetic analysis handle, obtain the characteristic quantity of digital audio signal, and the characteristic quantity that obtains is provided in the blotter unit 118, and during the Preset Time section, is saved.
Next, will describe user's operating provision button and indicate osophone 410a or 410b to begin operation under the situation of voice command input.Provide the situation of importing the instruction of beginning from user's voice command among the osophone 410a with being described in herein.
At first, will the operation of osophone 410a be described.In this case, order commencing signal sending/receiving unit 138 receives the control signal of indicating the input of voice command to begin by user's operation, and begins the preparation to the voice command input.At this moment, order commencing signal sending/receiving unit 138 osophone 410a are set to " master hearing aid ", and will indicate the control signal of voice command input beginning to send to another osophone 410b that becomes " secondary osophone ".
In this case, carry switching signal from order commencing signal sending/receiving unit 138 to switch unit 136, the connection that switch unit 136 is carried out from the c side to a side is switched, and digital audio signal (main sound signal) is fed to many sound signal processing unit 132 from A/D converter 112.In addition, from order commencing signal sending/receiving unit 138 control signal that 137 transmission indications receive to secondary voice signal sending/receiving unit, and receive the voice signal that sends from osophone 410b.In addition, send the control signal that the indication voice command sends from order commencing signal sending/receiving unit 138 to voice command processing unit 135 and voice command sending/receiving unit 139, and voice command is sent to osophone 410b.
The voice signal from osophone 410b (secondary voice signal) that secondary voice signal sending/receiving unit 137 receives is provided for many sound signal processing unit 132.In many sound signal processing unit 132, synthesize the voice signal (main sound signal and secondary voice signal) from two microphones 111 of osophone 410a and 410b, so that the position of two microphones determining during according to design concerns to consider phase differential, and makes directivity turn to user's front.The voice signal of being handled by many sound signal processing unit 132 is provided for pre-converted sound signal processing unit 133.
In pre-converted sound signal processing unit 133, to from many sound signal processing unit 132 voice signals of supplying with carry out processing for generation of the voice signal that will be provided for voice command converting unit 134.In pre-converted sound signal processing unit 133, (for example carry out frequency band definite when being used for suppressing design, the processing of the outside frequency band (200Hz to 3kHz) of sound), the sample frequency that frequency inverted was determined for when design, and specify good voice signal part from the oscillator intensity of voice signal.
The voice signal of being handled by pre-converted sound signal processing unit 133 is provided for voice command converting unit 134.In voice command converting unit 134, carry out the processing of handling such as voice recognition, and voice signal is converted to voice command.The transformation result of voice command converting unit 134 is sent to voice command processing unit 135.In voice command processing unit 135, when voice signal can be converted into voice command, voice command is sent to adjusted parameter calculation unit 120a.In this case, voice command also is sent to voice command sending/receiving unit 139, and voice command is sent to osophone 410b.Simultaneously, in voice command processing unit 135, when voice signal can not be converted into voice command, the order that the expression voice signal can not be converted into voice command was sent to adjustment parameter calculation unit 120a and voice command sending/receiving unit 139.In this case, in voice command processing unit 135, the control signal that is used for switching to the c side is sent to switch unit 131, and switch unit 136 is switched to the c side, and enters normal condition.
In adjusting parameter calculation unit 120a, if send voice command from voice command processing unit 135, then calculate and adjust parameter.In this case, signal processing unit 113 based on voice command, be recorded in the time series recording feature amount in the blotter unit 118 and the auditory properties information in the auditory properties record cell 119 of being recorded in is calculated the adjustment parameter of adjusting voice signal (handling the voice signal of object).The adjustment parameter is adjusted parameter updating block 120b and is set to signal processing unit 113.
Like this, be adjusted after parameter updating block 120b is set to signal processing unit 113 adjusting parameter, send the control signal that is used for switching to the c side from adjusting parameter updating block 120b to switch unit 136.Thereby osophone 410a enters above-mentioned normal operating state, and signal processing unit 113 is carried out the signal processing based on the adjustment parameter that arranges recently.
Next, will the operation of osophone 410b be described.In this case, order commencing signal sending/receiving unit 138 receives the control signal that begins from input osophone 410a, the indication voice command, and begins the preparation to the voice command input.At this moment, order commencing signal sending/receiving unit 138 osophone 410b are set to " secondary osophone ".
In this case, switching signal is provided for switch unit 136 from order commencing signal sending/receiving unit 138, the connection that switch unit 136 is carried out from the c side to the b side is switched, and digital audio signal (main sound signal) is provided for secondary voice signal sending/receiving unit 137 from A/D converter 112.In addition, the control signal that sends is indicated in 137 transmissions to secondary voice signal sending/receiving unit from order commencing signal sending/receiving unit 138, and is sent to osophone 410a from the voice signal that switch unit 136 provides.
In this case, send the control signal that the indication voice command receives from order commencing signal sending/receiving unit 138 to voice command processing unit 135 and voice command sending/receiving unit 139, and receive voice command from osophone 410a.At this moment, do not work in many sound signal processing unit 132, pre-converted sound signal processing unit 133 and sound command conversion unit 134.
In voice command sending/receiving unit 139, receive the voice command or the disabled order of expression conversion that send from osophone 410a.Voice command is sent to by voice command processing unit 135 and adjusts parameter calculation unit 120a.Simultaneously, the disabled order of expression conversion is sent to voice command processing unit 135.In voice command processing unit 135, the disabled order of expression conversion becomes triggering, and the control signal that is used for switching to the c side is sent to switch unit 136, and switch unit 136 is switched to the c side, and enters normal condition.
In adjusting parameter calculation unit 120a, if send voice command from voice command processing unit 135, then calculate and adjust parameter.In this case, signal processing unit 113 based on voice command, be recorded in the time series recording feature amount in the blotter unit 118 and the auditory properties information in the auditory properties record cell 119 of being recorded in is calculated the adjustment parameter of adjusting voice signal (handling the voice signal of object).The adjustment parameter is adjusted parameter updating block 120b and is set to signal processing unit 113.
Like this, be adjusted after parameter updating block 120b is set to signal processing unit 113 adjusting parameter, send the control signal that is used for switching to the c side from adjusting parameter updating block 120b to switch unit 136.Thereby osophone 410b enters above-mentioned normal operating state, and signal processing unit 113 is carried out the signal processing based on the adjustment parameter that arranges recently.
The process flow diagram of Figure 23 shows osophone 410(410a and 410b) treatment scheme.Osophone 410 periodically or according to the clearly indication from the user is carried out processing.In step ST61, osophone 410 begins to handle.In step ST62, osophone 410 judges whether the user has indicated the input of voice command to begin.During control signal that the input that receives the indication voice command when order commencing signal sending/receiving unit 138 begins, osophone 410 is determined to have indicated the input of voice command to begin.When the input of having indicated voice command began, osophone 410 makes handled the voice command input preparation processing that enters step ST63.
In voice command input prepared to handle, osophone 410 was carried out the input of voice commands and is prepared (for example, the control of switch unit 113), and setting " master " or " pair ".When receiving the user who carries out by osophone when operating the control signal that the input of indication voice command begins, osophone 410 arranges " master ", when control signal that the input that receives the indication voice command from another osophone begins, osophone 410 arranges " pair ".
Then, in step ST64, osophone 410 determines that osophone is " master " osophone or " pair " osophone.When osophone was " master " osophone, osophone 410 makes handled the processing that enters step ST65.In step ST65, osophone 410 receives voice signal (secondary voice signal) from another osophone.In step ST66,410 pairs of voice signals of osophone are carried out the pre-converted sound signal processing, that is to say the processing in many sound signal processing unit 132 and the pre-converted sound signal processing unit 133.
Then, in step ST67,410 pairs of treated voice signal fill order conversion process in step ST66 of osophone.In command conversion was handled, osophone 410 was carried out voice recognition and is handled, and voice signal is converted to voice command.When voice signal can not be converted into voice command, osophone 410 was carried out and is used for the processing that notice does not obtain voice command.In step ST68, osophone 410 sends to another osophone with the voice command of conversion.After the processing of step ST68, osophone 410 makes handles the processing that enters step ST71.
When determining that osophone is " pair " osophone in step ST64, osophone 410 makes handles the processing that enters step ST69.In step ST69, osophone 41 sends to another osophone with voice signal (secondary voice signal).In step ST70, osophone 410 receives voice command from another osophone.After the processing of step ST70, osophone 410 makes handles the processing that enters step ST71.
In step ST71, osophone 410 judges whether voice command can be identified.When voice command can be identified, in step ST72, osophone 410 was carried out and is adjusted the calculation of parameter processing.In step ST73, osophone 410 is carried out and is adjusted parameter reflection processing.After step ST73, osophone 410 makes handles the voice command end process that enters step ST74.When determining that in step ST71 voice command can not be identified, osophone 410 is the voice command end process among the execution in step ST74 immediately.In the voice command end process, osophone 410 is carried out the voice command end process, for example is used for making switch unit 136 turn back to the processing of c side.
Then, osophone 410 makes and handles the sound signal processing that enters step ST75.When the input of determining not indicate voice command in step ST62 began, osophone 410 makes immediately handled the sound signal processing that enters step ST75.In sound signal processing, osophone 410 is carried out sound signal processing and is listened to improvement, and by not shown system voice signal is outputed to loudspeaker.
Then, osophone 410 makes and handles the voice signal analyzing and processing that enters step ST76.In the voice signal analyzing and processing, osophone 410 is carried out the voice signal analyzing and processing and is adjusted employed characteristic quantity in the calculation of parameter processing to calculate.After the processing of execution in step ST76, osophone 410 makes handles the blotter renewal processing that enters step ST77.After the processing of step ST77, in step ST78, osophone 410 end process.
As mentioned above, at the osophone 410L shown in Figure 21 to Figure 22 B and 410R(410a and 410b) in, the user can be by means of the sound of the subjective sensation of sound being adjusted among osophone 410L and the 410R (volume and tonequality).Even the user does not have detail knowledge to sound, but the also adjustment of carry out desired of user.In this case, the user can carry out the sound input of the subjective order of expressing, and can improve availability.In addition, only carried out by one of osophone 410L and 410R because be used for to obtain the processing of voice command, so can reduce processing load and consumed power in another osophone.
In the above description, osophone 410L is connected by lead with 410R, and can communicate with one another.Yet osophone 410L and 410R can carry out radio communication.In this case, preferably, by reducing sampling rate, even in narrow communication band, transmit and be sent out/received secondary voice signal.The voice signal that relevant processing can be designed to reduce with sampling rate is carried out.
In the above description, adjust parameter and calculated by each osophone, and individually arranged.Yet, can be calculating the executive communication afterwards of adjustment parameter, to become identical setting.
In the above description, after the adjustment parameter is set, do not preserve the adjustment parameter.Yet, adjusting that parameter and the audio signal characteristics amount when obtaining to adjust parameter can be saved is a set, and the adjustment parameter that the characteristic quantity that has high correlation among the audio signal characteristics amount of importing constitutes set can automatically be arranged.Adjusting parameter can preserve with the positional information of GPS, and when the position of approximated position, position information, constituting the adjustment parameter of gathering can automatically be arranged.
In the above description, come to indicate the voice command input to the user by the push-botton operation that is associated with osophone.Yet described in Japanese Patent Application Publication (JP-A) No.2011-123751, the body that can impact osophone by the pattern with regulation is indicated the input beginning, but and input command.
<5. the 5th embodiment 〉
[structure of communication system]
When the user uses channel (such as phone) to carry out conversion, be easy to hear sound method as making, optimally the sound that reduces of information be treated to adapt to and communication facilities (such as the other side's phone) between the communication band of channel.Yet under the situation of present disclosure, the user sends to call peer with subjective sensation with inaudible situation.At the equipment side of call peer, suitably determine the subjective sensation send, and adjust.Thereby, can before information reduces, carry out processing to sound, and can carry out according to the improvement of demand to listening to of listening to side.
Figure 24 shows the structure example according to the communication system 50 of the 5th embodiment.Communication system 50 comprises mobile phone 510A and mobile phone 510B.In this example, when the talker of the talker of mobile phone 510A and mobile phone 510B had session, the talker of mobile phone 510A showed at the screen of mobile phone 510A and is used for the menu adjusted, listens to adjustment.
When the talker of mobile phone 510A selects " being difficult to differentiate " to adjust to listen to, even also carry out adjustment in mobile phone 510A side.Yet " being difficult to differentiate " order is sent to mobile phone 510B.Receive the mobile phone 510B of order and adjust transmission sound according to the feature (for example, transmitting the bandwidth of sound, the microphone characteristics that is used for calling and the order of reception) of mobile phone 510B.
Figure 25 shows mobile phone 510(510A and 510B) the structure example.In the structure example, combine at the example described in first embodiment and the block diagram shown in the described example in a second embodiment, and send the adjustment order from call peer, wherein, in first embodiment, sound is picked up by microphone and is processed, and in a second embodiment, television receiver (reproducer) is adjusted by subjectivity ground.
Mobile phone 510 comprises microphone 511, A/D converter 512, input audio signal processing unit 513, coding processing unit 514, acoustic information/command sending unit 514 and antenna 516.Mobile phone 510 also comprises sound import analytic unit 517, sound import characteristic quantity blotter unit 518, sound import adjustment parameter calculation unit 519 and device characteristics record cell 520.
Mobile phone 510 also comprises antenna 531, acoustic information/order receiving element 532, codec processing unit 533, output sound signal processing unit 534, D/A converter 535, volume adjustment unit 536 and loudspeaker 537.Mobile phone 510 comprises that also output sound analytic unit 538, output sound characteristic quantity blotter unit 539, output sound are adjusted parameter calculation unit 540 and receiving element 541 is imported in order.
Microphone 511 picks up ambient sound, and obtains voice signal.A/D converter 512 is digital signal with the voice signal that microphone 511 obtains from analog signal conversion.The voice signal that 513 pairs of A/D converters of sound import processing unit 512 obtain (handling the voice signal of object) is carried out various processing, and for example, AGC handles, noise reduction process harmony tone strength reason.514 pairs of treated voice signals of coding processing unit are carried out coding and are handled for communication.Acoustic information/command sending unit 515 sends to channel with the voice signal of coding from antenna 516.
Be similar to the phonetic analysis unit 117 shown in Fig. 2 (a), 517 pairs of digital audio signals from 513 outputs of input audio signal processing unit of sound import analytic unit are carried out phonetic analysis and are handled, and obtain characteristic quantity.Be similar to the blotter unit 118 shown in Fig. 2 (a), the characteristic quantity that sound import characteristic quantity blotter unit 518 blotter sound import analytic units 517 obtain that is to say, preserves this characteristic quantity during the Preset Time section.
Device characteristics record cell 520 is single parameter with the characteristic of microphone 511 and the characteristic records of loudspeaker 537.These characteristics are measured in advance, and are recorded in the device characteristics record cell 520.Sound import adjust parameter calculation unit 519 based on order that acoustic information/order receiving element 532 obtains, be recorded in the audio signal characteristics amount of the processing object in the sound import characteristic quantity blotter unit 518 and be recorded in the parameter (sound import adjustment parameter) that microphone characteristics in the device characteristics record cell 520 is calculated adjustment voice signal in input audio signal processing unit 513.
The reception information of acoustic information/532 pairs of antennas 531 of order receiving element is decoded, and obtains voice signal or the order (adjusting order) of coding.The codec processing unit coded sound signal that 533 pairs of acoustic informations/order receiving element 532 obtains is decoded, and obtains to receive voice signal.The reception voice signal that 534 pairs of codec processing units of output sound signal processing unit 533 obtain is carried out various processing, and for example, band spread processing, speech speed conversion process and squelch are handled.D/A converter 535 will be converted to simulating signal from digital signal from the voice signal of output sound signal processing unit 534 outputs.Volume adjustment unit 536 usefulness values of setting are adjusted the volume of the voice signal of D/A converter 535 acquisitions, and this voice signal is outputed to loudspeaker 537.
Be similar to the phonetic analysis unit 117 shown in Fig. 2 (a), 538 pairs of digital audio signals from 534 outputs of output sound signal processing unit of output sound analytic unit are carried out phonetic analysis and are handled, and obtain characteristic quantity.Be similar to the blotter unit 118 shown in Fig. 2 (a), the characteristic quantity that output sound characteristic quantity blotter unit 539 blotter output sound analytic units 538 obtain that is to say, preserves this characteristic quantity during the Preset Time section.Output sound adjusts order that parameter calculation unit 540 obtains based on order input receiving element 541, be recorded in the audio signal characteristics amount of the processing object in the sound import characteristic quantity blotter unit 539 and the loudspeaker performance that is recorded in the device characteristics record cell 520 calculates the adjustment parameter (output sound adjustment parameter) of adjusting voice signal in output sound signal processing unit 534.
The basic operation of mobile phone 510 when next, description being sent.The analoging sound signal that microphone 511 obtains is converted to digital audio signal by A/D converter 512, and is sent to input audio signal processing unit 513.In input audio signal processing unit 513, the acoustic processing that the digital audio signal that sends is put rules into practice, for example, squelch is handled or resonance peak is strengthened handling, and digital audio signal is sent to coding processing unit 514 and sound import analytic unit 517.
In coding processing unit 514, the digital audio signal that sends is carried out coding handle for communication, and digital audio signal is sent to acoustic information/command sending unit 515.In acoustic information/command sending unit 515, the coded sound signal of transmission is sent to channel from antenna 516.Simultaneously, in sound import analytic unit 517, the digital audio signal execution analysis that sends is handled, and the calculated characteristics amount.Characteristic quantity is provided for sound import characteristic quantity blotter unit 518, and is saved during the Preset Time section.
The basic operation of microphone 510 when then, description being received.The information that antenna 531 receives is sent to acoustic information/order receiving element 532.In acoustic information/order receiving element 532, the information that sends is decoded.Voice signal is sent to codec processing unit 533, and is sent to sound import adjustment parameter calculation unit 519 from the adjustment order that the other side's side sends.
In codec processing unit 533, the coded sound signal of transmission is decoded, and is sent to output sound signal processing unit 534.In output sound signal processing unit 534, the digital audio signal that sends is carried out band spread processing, speech speed conversion process or squelch handle, and voice signal is sent to D/A converter 535 and output sound analytic unit 538.
In D/A converter 535, the digital audio signal of transmission is converted into analoging sound signal, and volume is adjusted by volume adjustment unit 536, and sound is from loudspeaker 537 outputs.Simultaneously, in output sound analytic unit 538, the digital audio signal execution analysis that sends is handled, and the calculated characteristics amount.Characteristic quantity is provided for output sound characteristic quantity blotter unit 539, and is saved during the Preset Time section.
In the above description, in order to simplify explanation, phonetic analysis unit 517 and 538 and blotter unit 518 and 538 work always.Yet, as described in the first embodiment, phonetic analysis unit 517 and 538 and blotter unit 518 and 538 be not limited to above structure.
Next, will the operation of carrying out under the situation about adjusting be described.Order input receiving element 541 touches order that the button that is presented at the subjective sensation on the display unit receives by the user and is sent to output sound and adjusts parameter calculation unit 540.Adjust in the parameter calculation unit 540 at output sound, obtain and analyze the order that sends, be recorded in the time series recording feature amount in the output sound characteristic quantity blotter unit 539 and be recorded in loudspeaker performance in the device characteristics record cell 520, and calculate the adjustment parameter of adjusting output sound signal processing unit 534.
Adjust in the parameter calculation unit 540 at output sound, when ordering " sound be can not hear clearly " when being sent out, calculate the following parameter of adjusting.For example, judge whether to exist noise from time series recording feature amount or its cepstral coefficients that differs from the information that is recorded in calculating, when having noise, calculate the adjustment parameter that strengthens the squelch processing.When signal concentrated on the frequency band that is higher than voiceband, deletion was higher than the frequency band of voiceband, and calculated and might handle substituted adjustment parameter by band spread.In the time can determining sound from Pitch Information, calculate and to pass through the reproduced adjustment parameter of speech speed conversion process later.
The adjustment parameter that calculates like that as mentioned above is set to output sound signal processing unit 534.For this reason, in output sound signal processing unit 534, adjust each signal according to the adjustment parameter that arranges and handle.That is to say, adjust the sound (volume and tonequality) that receives voice signal with the adjustment parameter.
The order that order input receiving element 541 receives is sent to acoustic information/command sending unit 515, and is sent to call peer by channel.In the call peer side, the order of transmission is received by antenna 531, and is sent to acoustic information/order receiving element 532.In acoustic information/order receiving element 532, extract order, and sound import is adjusted parameter send to sound import and adjust parameter calculation unit 519.
Adjust in the parameter calculation unit 519 at sound import, obtain and analyze transmission order, be recorded in the time series recording feature amount in the sound import characteristic quantity blotter unit 518 and be recorded in microphone characteristics in the device characteristics record cell 520, and calculate the adjustment parameter of adjusting input audio signal processing unit 513.
Adjust in the parameter calculation unit 519 at sound import, when ordering " sound be can not hear clearly " when being sent out, calculate the following parameter of adjusting.For example, be used for by the processing of encoding the signal of voiceband allocation bit being handled by also carrying out from the out-of-band-signal of Pitch Information sound-inhibiting signal, calculate the parameter of the frequency band setting of adjusting coding processing unit 514.Sensitivity of microphone reduces, and only the ambient sound of microphone is picked, and the adjustment parameter of voice emplifying frequency band is calculated by input audio signal processing unit 513.
As mentioned above, in the communication system 50 shown in Figure 24, because the order that the receiving terminal analysis sends, so even it is unknown that the device characteristics of call peer or signal are handled, also can send sound adjustment order.At receiver side, can carry out processing effectively, for example, before coding is handled, carry out squelch and handle.
<6. modification 〉
In the above-described embodiments, equipment can require to import user feedback.Regularization condition can use sound to inquire, for example, according to user's input, at first inquiry " it is how ", then, inquiry " more a little ".The user is input command at first, imports the order of expression degree then, for example " further ", " stronger " or " more weak ".In the equipment that comprises display unit (such as display or touch panel), can use sound to ask in reply input, and can return and add the reaction of expressing.For example, can pass through computer graphical (CG) and show face, and can link this face, perhaps can carry out the change condition and show.
In the above-described embodiments, add the characteristic quantity that obtains by the analysis voice signal, and calculated and used the adjustment parameter corresponding with this order.Yet, can be from the order expressed according to subjectivity and default adjustment parameter is optionally extracted the predetermined parameter of adjusting, and can use this predetermined parameter of adjusting.Even in this case, the user also can be to adjust sound (volume and tonequality) to the subjective sensation of sound.Even the user does not have detail knowledge to sound, but the also adjustment of carry out desired of user.
In the above-described embodiments, the sound (volume and tonequality) in the acoustic equipment is adjusted in the order of expressing with subjectivity.Yet present disclosure can be applicable to the adjustment in the equipment except acoustic equipment.For example, present disclosure can be applicable to the adjustment of the temperature and humidity in the air-conditioning.
In addition, given technology also can followingly be constructed.
(1) a kind of signal handling equipment comprises:
Present control module, it presents the option of being expressed by subjectivity and be associated with control to acoustical signal; With
Output unit, the preset selective item that its output is selected from the option that presents.
(2) according to 1 described signal handling equipment,
Wherein, present control module changes the option that presents according to the characteristic quantity of the acoustical signal of selected option or processing object demonstration form.
(3) according to (1) or (2) described signal handling equipment,
Wherein, the option that presents is subjective sensation and/or the subjective request that will solve.
(4) according to any one the described signal handling equipment in (1) to (3), also comprise:
Computing unit, its characteristic quantity based on the acoustical signal of each parameter of measuring in advance, selected preset selective item and processing object calculates the adjustment parameter of adjusting the acoustical signal of handling object.
(5) according to (4) described signal handling equipment,
Wherein, described each parameter is the parameter of expression auditory properties.
(6) according to (4) or (5) described signal handling equipment,
Wherein, described each parameter is the parameter of the characteristic of expression microphone and/or loudspeaker.
(7) a kind of signal processing method comprises:
Present the option of being expressed by subjectivity and be associated with control to acoustical signal; With
The preset selective item that output is selected from the option that presents.
(8) a kind of computing machine that makes is used as program with lower unit:
Present control module, it presents the option of being expressed by subjectivity and be associated with control to acoustical signal; With
Output unit, the preset selective item that its output is selected from the option that presents.
(9) a kind of signal handling equipment comprises:
Acquiring unit, it obtains the adjustment parameter, described adjustment parameter based on each parameter of measuring in advance, from by subjective that express and with option that control to the acoustical signal that presents is associated the preset selective item selected and the characteristic quantity of handling the acoustical signal of object calculate; With
Signal processing unit, it adjusts the acoustical signal of handling object based on the adjustment parameter of obtaining.
(10) according to (9) described signal handling equipment,
Wherein, signal processing unit has first buffer zone and second buffer zone that parameter is adjusted in accumulation, and
Wherein, under acquiring unit is accumulating on the use state of an adjustment parameter in the buffer zone, obtain when adjusting parameter, the adjustment parameter that signal processing unit will obtain is accumulated in another buffer zone, then the use state is switched to the use state that accumulates on the adjustment parameter in this another buffer zone.
(11) according to (10) described signal handling equipment,
Wherein, signal processing unit has the buffer zone that parameter is adjusted in accumulation, and
Wherein, obtain under acquiring unit is accumulating on the use state of the adjustment parameter in the buffer zone when adjusting parameter, signal processing unit makes through the output of the acoustical signal of adjusting quiet, and the adjustment parameter of obtaining is accumulated in the buffer zone, removes quiet then.
(12) according to any one the described signal handling equipment in (9) to (11), also comprise:
Analytic unit, the acoustical signal of its analyzing and processing object, and the characteristic quantity of calculating acoustical signal.
(13) according to any one the described signal handling equipment in (9) to (12), also comprise:
Computing unit, it calculates adjusts parameter.
(14) a kind of signal processing method comprises:
Obtain the adjustment parameter, described adjustment parameter based on each parameter of measuring in advance, from by subjective that express and with option that control to the acoustical signal that presents is associated the preset selective item selected and the characteristic quantity of handling the acoustical signal of object calculate; With
Adjust the acoustical signal of handling object based on the adjustment parameter of obtaining.
(15) a kind of signal handling equipment comprises:
Acquiring unit, its obtain with from by subjective that express and corresponding with the preset selective item selected the option that control to the acoustical signal that presents is associated adjustment parameter; With
Signal processing unit, it adjusts the acoustical signal of handling object based on the adjustment parameter of obtaining.
(16) a kind of signal processing system comprises:
Present control module, it presents the option of being expressed by subjectivity and be associated with control to acoustical signal;
Computing unit, its characteristic quantity based on the acoustical signal of each parameter of measuring in advance, the preset selective item of selecting from the option that presents and processing object calculates the adjustment parameter of adjusting the acoustical signal of handling object;
Signal processing unit, it adjusts the acoustical signal of handling object based on the adjustment parameter of calculating; With
Output unit, the acoustical signal of its output through adjusting.
(17) a kind of signal handling equipment comprises:
The sound input block;
Acquiring unit, it obtains the order of being expressed by subjectivity and be associated with control to acoustical signal from the sound by sound input block input;
Computing unit, its characteristic quantity based on the acoustical signal of each parameter of measuring in advance, the order of obtaining and processing object calculates the adjustment parameter of adjusting the acoustical signal of handling object; With
Signal processing unit, it adjusts the acoustical signal of handling object based on the adjustment parameter of calculating.
(18) according to (17) described signal processing system, also comprise:
First signal processing system and secondary signal disposal system, first signal processing system and secondary signal disposal system include the sound input block, obtain acquiring unit, computing unit and the signal processing unit of order,
Wherein, the sound that signal processing system will be input to the sound input block sends to another signal processing system, and receives order from described another signal processing system.
(19) a kind of communication terminal comprises:
Present control module, it presents the option of being expressed by subjectivity and be associated with control to acoustical signal;
The order output unit, the order that its output is corresponding with the preset selective item of selecting from the option that presents; With
Transmitting element, its order that will export sends to communication counterpart.
(20) a kind of communication terminal comprises:
Receiving element, its from communication counterpart receive with from by subjective expression and corresponding with the preset selective item selected the option that control to acoustical signal is associated order;
The acoustical signal input block, it imports acoustical signal;
Adjust parameter calculation unit, it calculates the adjustment parameter based on the order that receives at least;
Signal processing unit, it adjusts the acoustical signal of input based on the adjustment parameter of calculating; With
Transmitting element, it will send to communication counterpart through the acoustical signal of adjusting.
It should be appreciated by those skilled in the art that various modifications, combination, sub-portfolio and change can be expected according to designing requirement and other factors, as long as they are in the scope of claims or its equivalents.
The theme that present disclosure comprises with disclosed theme was relevant in the Japanese priority patent application JP2012-022536 that Jap.P. office submits on February 3rd, 2012, the full content of this patented claim is incorporated into hereby by reference.

Claims (20)

1. signal handling equipment comprises:
Present control module, it presents the option of being expressed by subjectivity and be associated with control to acoustical signal; With
Output unit, the preset selective item that its output is selected from the option that presents.
2. signal handling equipment according to claim 1,
Wherein, describedly present control module changes the option that presents according to the option of selecting or the characteristic quantity of handling the acoustical signal of object demonstration form.
3. signal handling equipment according to claim 1,
Wherein, the described option that presents is subjective sensation to be processed and/or subjective request.
4. signal handling equipment according to claim 1 also comprises:
Computing unit, it calculates the adjustment parameter of the acoustical signal of adjusting described processing object based on the preset selective item of each parameter that records in advance, selection and the characteristic quantity of handling the acoustical signal of object.
5. signal handling equipment according to claim 4,
Wherein, described each parameter is the parameter of expression auditory properties.
6. signal handling equipment according to claim 4,
Wherein, described each parameter is the parameter of the characteristic of expression microphone and/or loudspeaker.
7. signal processing method comprises:
Present the option of being expressed by subjectivity and be associated with control to acoustical signal; With
The preset selective item that output is selected from the option that presents.
8. one kind makes computing machine be used as program with lower unit:
Present control module, it presents the option of being expressed by subjectivity and be associated with control to acoustical signal; With
Output unit, the preset selective item that its output is selected from the option that presents.
9. signal handling equipment comprises:
Acquiring unit, it obtains the adjustment parameter, described adjustment parameter based on each parameter that records in advance, from by subjective that express and with option that control to the acoustical signal that presents is associated the preset selective item selected and the characteristic quantity of handling the acoustical signal of object calculate; With
Signal processing unit, it adjusts the acoustical signal of described processing object based on the adjustment parameter of obtaining.
10. signal handling equipment according to claim 9,
Wherein, described signal processing unit has first buffer zone and second buffer zone that parameter is adjusted in accumulation, and
Wherein, under acquiring unit is accumulating on the use state of an adjustment parameter in the buffer zone, obtain when adjusting parameter, the adjustment parameter that signal processing unit will obtain is accumulated in another buffer zone, then described use state is switched to the use state that accumulates on the adjustment parameter in described another buffer zone.
11. signal handling equipment according to claim 9,
Wherein, described signal processing unit has the buffer zone that parameter is adjusted in accumulation, and
Wherein, obtain under acquiring unit is accumulating on the use state of the adjustment parameter in the buffer zone when adjusting parameter, signal processing unit makes through the output of the acoustical signal of adjusting quiet, and the adjustment parameter of obtaining is accumulated in the buffer zone, removes quiet then.
12. signal handling equipment according to claim 9 also comprises:
Analytic unit, it analyzes the acoustical signal of described processing object, and calculates the characteristic quantity of described acoustical signal.
13. signal handling equipment according to claim 9 also comprises:
Computing unit, it calculates described adjustment parameter.
14. a signal processing method comprises:
Obtain the adjustment parameter, described adjustment parameter based on each parameter that records in advance, from by subjective that express and with option that control to the acoustical signal that presents is associated the preset selective item selected and the characteristic quantity of handling the acoustical signal of object calculate; With
Adjust the acoustical signal of described processing object based on the adjustment parameter of obtaining.
15. a signal handling equipment comprises:
Acquiring unit, its obtain with from by subjective that express and corresponding with the preset selective item selected the option that control to the acoustical signal that presents is associated adjustment parameter; With
Signal processing unit, it adjusts the acoustical signal of described processing object based on the adjustment parameter of obtaining.
16. a signal processing system comprises:
Present control module, it presents the option of being expressed by subjectivity and be associated with control to acoustical signal;
Computing unit, its characteristic quantity based on the acoustical signal of each parameter that records in advance, the preset selective item of selecting from the option that presents and processing object calculates the adjustment parameter of the acoustical signal of adjusting described processing object;
Signal processing unit, it adjusts the acoustical signal of described processing object based on the adjustment parameter that calculates; With
Output unit, the acoustical signal of its output through adjusting.
17. a signal handling equipment comprises:
The sound input block;
Acquiring unit, it obtains the order of being expressed by subjectivity and be associated with control to acoustical signal from the sound by sound input block input;
Computing unit, its characteristic quantity based on the acoustical signal of each parameter that records in advance, the order of obtaining and processing object calculates the adjustment parameter of the acoustical signal of adjusting described processing object; With
Signal processing unit, it adjusts the acoustical signal of described processing object based on the adjustment parameter that calculates.
18. signal handling equipment according to claim 17 also comprises:
First signal processing system and secondary signal disposal system, described first signal processing system and secondary signal disposal system include the sound input block, obtain acquiring unit, computing unit and the signal processing unit of order,
Wherein, the sound that signal processing system will be input to the sound input block sends to another signal processing system, and receives order from described another signal processing system.
19. a communication terminal comprises:
Present control module, it presents the option of being expressed by subjectivity and be associated with control to acoustical signal;
The order output unit, the order that its output is corresponding with the preset selective item of selecting from the option that presents; With
Transmitting element, its order that will export sends to communication counterpart.
20. a communication terminal comprises:
Receiving element, its from communication counterpart receive with from by subjective expression and corresponding with the preset selective item selected the option that control to acoustical signal is associated order;
The acoustical signal input block, it imports acoustical signal;
Adjust parameter calculation unit, it calculates the adjustment parameter based on the order that receives at least;
Signal processing unit, it adjusts the acoustical signal of input based on the adjustment parameter that calculates; With
Transmitting element, it will send to communication counterpart through the acoustical signal of adjusting.
CN201310031189.6A 2012-02-03 2013-01-28 Signal handling equipment, method, system and communication terminal Expired - Fee Related CN103247294B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012-022536 2012-02-03
JP2012022536A JP5962038B2 (en) 2012-02-03 2012-02-03 Signal processing apparatus, signal processing method, program, signal processing system, and communication terminal

Publications (2)

Publication Number Publication Date
CN103247294A true CN103247294A (en) 2013-08-14
CN103247294B CN103247294B (en) 2017-11-07

Family

ID=48902904

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310031189.6A Expired - Fee Related CN103247294B (en) 2012-02-03 2013-01-28 Signal handling equipment, method, system and communication terminal

Country Status (3)

Country Link
US (1) US9531338B2 (en)
JP (1) JP5962038B2 (en)
CN (1) CN103247294B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106098071A (en) * 2016-08-03 2016-11-09 国网江西省电力公司检修分公司 Intelligent Mobile Robot audio frequency processing system and method
CN106664503A (en) * 2015-06-17 2017-05-10 索尼公司 Transmission device, transmission method, reception device and reception method
CN106663447A (en) * 2014-09-24 2017-05-10 英特尔公司 Audio system with noise interference mitigation
CN108182948A (en) * 2017-11-20 2018-06-19 北京云知声信息技术有限公司 The voice collecting processing method and processing device of phonetic recognization rate can be improved

Families Citing this family (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8326951B1 (en) 2004-06-05 2012-12-04 Sonos, Inc. Establishing a secure wireless network with minimum human intervention
US9084058B2 (en) 2011-12-29 2015-07-14 Sonos, Inc. Sound field calibration using listener localization
US9344292B2 (en) 2011-12-30 2016-05-17 Sonos, Inc. Systems and methods for player setup room names
US9524098B2 (en) 2012-05-08 2016-12-20 Sonos, Inc. Methods and systems for subwoofer calibration
US9706323B2 (en) 2014-09-09 2017-07-11 Sonos, Inc. Playback device calibration
US9668049B2 (en) 2012-06-28 2017-05-30 Sonos, Inc. Playback device calibration user interfaces
US9219460B2 (en) 2014-03-17 2015-12-22 Sonos, Inc. Audio settings based on environment
US9106192B2 (en) 2012-06-28 2015-08-11 Sonos, Inc. System and method for device playback calibration
US9690539B2 (en) 2012-06-28 2017-06-27 Sonos, Inc. Speaker calibration user interface
US9690271B2 (en) 2012-06-28 2017-06-27 Sonos, Inc. Speaker calibration
US9031244B2 (en) 2012-06-29 2015-05-12 Sonos, Inc. Smart audio settings
US8995687B2 (en) 2012-08-01 2015-03-31 Sonos, Inc. Volume interactions for connected playback devices
US8930005B2 (en) 2012-08-07 2015-01-06 Sonos, Inc. Acoustic signatures in a playback system
US9952576B2 (en) 2012-10-16 2018-04-24 Sonos, Inc. Methods and apparatus to learn and share remote commands
US9237384B2 (en) 2013-02-14 2016-01-12 Sonos, Inc. Automatic configuration of household playback devices
US9319409B2 (en) 2013-02-14 2016-04-19 Sonos, Inc. Automatic configuration of household playback devices
US9609423B2 (en) * 2013-09-27 2017-03-28 Volt Analytics, Llc Noise abatement system for dental procedures
US9391575B1 (en) * 2013-12-13 2016-07-12 Amazon Technologies, Inc. Adaptive loudness control
US9300647B2 (en) 2014-01-15 2016-03-29 Sonos, Inc. Software application and zones
US9264839B2 (en) 2014-03-17 2016-02-16 Sonos, Inc. Playback device configuration based on proximity detection
US9910634B2 (en) 2014-09-09 2018-03-06 Sonos, Inc. Microphone calibration
US9891881B2 (en) 2014-09-09 2018-02-13 Sonos, Inc. Audio processing algorithm database
US10127006B2 (en) 2014-09-09 2018-11-13 Sonos, Inc. Facilitating calibration of an audio playback device
US9952825B2 (en) 2014-09-09 2018-04-24 Sonos, Inc. Audio processing algorithms
JP2016126022A (en) * 2014-12-26 2016-07-11 アイシン精機株式会社 Speech processing unit
WO2016172593A1 (en) 2015-04-24 2016-10-27 Sonos, Inc. Playback device calibration user interfaces
US10664224B2 (en) 2015-04-24 2020-05-26 Sonos, Inc. Speaker calibration user interface
US9538305B2 (en) 2015-07-28 2017-01-03 Sonos, Inc. Calibration error conditions
US9693165B2 (en) 2015-09-17 2017-06-27 Sonos, Inc. Validation of audio calibration using multi-dimensional motion check
EP3531714B1 (en) 2015-09-17 2022-02-23 Sonos Inc. Facilitating calibration of an audio playback device
US9940928B2 (en) * 2015-09-24 2018-04-10 Starkey Laboratories, Inc. Method and apparatus for using hearing assistance device as voice controller
WO2017118477A1 (en) * 2016-01-06 2017-07-13 Sonova Ag Method and system for adjusting a hearing device to personal preferences and needs of a user
US9743207B1 (en) 2016-01-18 2017-08-22 Sonos, Inc. Calibration using multiple recording devices
US11106423B2 (en) 2016-01-25 2021-08-31 Sonos, Inc. Evaluating calibration of a playback device
US10003899B2 (en) 2016-01-25 2018-06-19 Sonos, Inc. Calibration with particular locations
US10631108B2 (en) 2016-02-08 2020-04-21 K/S Himpp Hearing augmentation systems and methods
US10750293B2 (en) 2016-02-08 2020-08-18 Hearing Instrument Manufacture Patent Partnership Hearing augmentation systems and methods
US10390155B2 (en) 2016-02-08 2019-08-20 K/S Himpp Hearing augmentation systems and methods
US10284998B2 (en) 2016-02-08 2019-05-07 K/S Himpp Hearing augmentation systems and methods
US10341791B2 (en) 2016-02-08 2019-07-02 K/S Himpp Hearing augmentation systems and methods
US10433074B2 (en) * 2016-02-08 2019-10-01 K/S Himpp Hearing augmentation systems and methods
US9860662B2 (en) 2016-04-01 2018-01-02 Sonos, Inc. Updating playback device configuration information based on calibration data
US9864574B2 (en) 2016-04-01 2018-01-09 Sonos, Inc. Playback device calibration based on representation spectral characteristics
US9763018B1 (en) 2016-04-12 2017-09-12 Sonos, Inc. Calibration of audio playback devices
US9860670B1 (en) 2016-07-15 2018-01-02 Sonos, Inc. Spectral correction using spatial calibration
US9794710B1 (en) 2016-07-15 2017-10-17 Sonos, Inc. Spatial audio correction
US10372406B2 (en) 2016-07-22 2019-08-06 Sonos, Inc. Calibration interface
US10459684B2 (en) 2016-08-05 2019-10-29 Sonos, Inc. Calibration of a playback device based on an estimated frequency response
US10133544B2 (en) * 2017-03-02 2018-11-20 Starkey Hearing Technologies Hearing device incorporating user interactive auditory display
EP3468227B1 (en) * 2017-10-03 2023-05-03 GN Hearing A/S A system with a computing program and a server for hearing device service requests
US11206484B2 (en) 2018-08-28 2021-12-21 Sonos, Inc. Passive speaker authentication
US10299061B1 (en) 2018-08-28 2019-05-21 Sonos, Inc. Playback device calibration
US10734965B1 (en) 2019-08-12 2020-08-04 Sonos, Inc. Audio calibration of a portable playback device
CN117678243A (en) * 2021-07-12 2024-03-08 索尼集团公司 Sound processing device, sound processing method, and hearing aid device
WO2024075434A1 (en) * 2022-10-07 2024-04-11 ソニーグループ株式会社 Information processing system, device, information processing method, and program

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06242794A (en) * 1993-02-16 1994-09-02 Hitachi Ltd Speech processor
US20050080500A1 (en) * 2003-09-10 2005-04-14 Masaru Kimura Audio device and playback method in audio device
JP2006345025A (en) * 2005-06-07 2006-12-21 Matsushita Electric Ind Co Ltd Telephone set and voice processing method thereof
US20090307594A1 (en) * 2006-05-12 2009-12-10 Timo Kosonen Adaptive User Interface
JP2010177961A (en) * 2009-01-28 2010-08-12 Kyocera Corp Communication equipment and communication system
US20100290654A1 (en) * 2009-04-14 2010-11-18 Dan Wiggins Heuristic hearing aid tuning system and method
US8073160B1 (en) * 2008-07-18 2011-12-06 Adobe Systems Incorporated Adjusting audio properties and controls of an audio mixer

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06242794A (en) * 1993-02-16 1994-09-02 Hitachi Ltd Speech processor
US20050080500A1 (en) * 2003-09-10 2005-04-14 Masaru Kimura Audio device and playback method in audio device
JP2006345025A (en) * 2005-06-07 2006-12-21 Matsushita Electric Ind Co Ltd Telephone set and voice processing method thereof
US20090307594A1 (en) * 2006-05-12 2009-12-10 Timo Kosonen Adaptive User Interface
US8073160B1 (en) * 2008-07-18 2011-12-06 Adobe Systems Incorporated Adjusting audio properties and controls of an audio mixer
JP2010177961A (en) * 2009-01-28 2010-08-12 Kyocera Corp Communication equipment and communication system
US20100290654A1 (en) * 2009-04-14 2010-11-18 Dan Wiggins Heuristic hearing aid tuning system and method

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106663447A (en) * 2014-09-24 2017-05-10 英特尔公司 Audio system with noise interference mitigation
CN106664503A (en) * 2015-06-17 2017-05-10 索尼公司 Transmission device, transmission method, reception device and reception method
CN106664503B (en) * 2015-06-17 2018-10-12 索尼公司 Sending device, sending method, reception device and method of reseptance
CN106098071A (en) * 2016-08-03 2016-11-09 国网江西省电力公司检修分公司 Intelligent Mobile Robot audio frequency processing system and method
CN108182948A (en) * 2017-11-20 2018-06-19 北京云知声信息技术有限公司 The voice collecting processing method and processing device of phonetic recognization rate can be improved
CN108182948B (en) * 2017-11-20 2021-08-20 云知声智能科技股份有限公司 Voice acquisition processing method and device capable of improving voice recognition rate

Also Published As

Publication number Publication date
US20130202131A1 (en) 2013-08-08
CN103247294B (en) 2017-11-07
US9531338B2 (en) 2016-12-27
JP5962038B2 (en) 2016-08-03
JP2013162325A (en) 2013-08-19

Similar Documents

Publication Publication Date Title
CN103247294A (en) Signal processing apparatus, signal processing method, signal processing system, and communication terminal
CN105872253B (en) Live broadcast sound processing method and mobile terminal
US8903721B1 (en) Smart auto mute
CN101625868B (en) Volume adjusting apparatus and volume adjusting method
US20120128164A1 (en) Binaural noise reduction
JP2005504470A (en) Improve sound quality for mobile phones and other products that produce personal audio for users
JPH0774709A (en) Voice signal transmitter-receiver
CN101911723A (en) By between from the signal of a plurality of microphones, selecting to improve sound quality intelligently
EP1692799A2 (en) Automatic extraction of musical portions of an audio stream
US20160142538A1 (en) Method for compensating for hearing loss in a telephone system and in a mobile telephone apparatus
DE112004002550T5 (en) Digital mobile phone with applications related to hearing aid functionality
CN104272599A (en) Apparatus and method for outputting audio
CN101268677B (en) Switchable audio circuits for mobile terminals and methods for operating the same
CN108449502A (en) Voice communication data processing method, device, storage medium and mobile terminal
CN108449506A (en) Voice communication data processing method, device, storage medium and mobile terminal
CN100380444C (en) Apparatus and method for controlling noise in mobile communication terminal
JP2007053748A (en) Acoustic input/output expansion method and system
US20020150219A1 (en) Distributed audio system for the capture, conditioning and delivery of sound
WO2020017518A1 (en) Audio signal processing device
CN103297896B (en) A kind of audio-frequency inputting method and electronic equipment
JP2002223500A (en) Mobile fitting system
CN113270082A (en) Vehicle-mounted KTV control method and device and vehicle-mounted intelligent networking terminal
US20100246803A1 (en) Bandwidth extension apparatus for automatically adjusting the bandwidth of inputted signal and a method therefor
CN111739496B (en) Audio processing method, device and storage medium
JP3302119B2 (en) Wireless communication device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20171107