Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04S—STEREOPHONIC SYSTEMS 
  • H04S3/00—Systems employing more than two channels, e.g. quadraphonic

Definitions

• the present invention relates to a sound image localization apparatus that localizes a sound image at an arbitrary position in a three-dimensional space.
• the acoustic transfer characteristics include space transfer functions representing transfer characteristics by reflection, diffraction, scattering, etc. on a wall, etc., and transfer characteristics by reflection, diffraction, scattering, etc. from the head or torso of a listener. It can be divided into head transfer functions etc.
• the conventional sound image localization apparatus using this head related transfer function accurately measures the head related transfer function of the listener and reproduces it faithfully to perform sound image localization, or a standard sound source localization apparatus.
• FIG. 14 is a block diagram showing a conventional sound image localization apparatus.
• the conventional sound image localization apparatus stores a head related transfer function created for each direction in which the sound image is to be localized as a coefficient of an FIR (Finite Impulse Response) filter.
• a head-related transfer function selection unit 62 for selecting a head-related transfer function based on target position information for localizing a sound image, and sound image localization for performing filter processing based on the selected head-related transfer function
• a processing unit 63 for processing a head related transfer function created for each direction in which the sound image is to be localized as a coefficient of an FIR (Finite Impulse Response) filter.
• FIR Finite Impulse Response
• the head related transfer functions stored in the head related transfer function storage unit 61 are those of the listener However, it may be a standard commonly used for all listeners.
• the input sound source signal is sound image localized by convoluting the selected head related transfer function based on the input target position information.
• the sound image localization signal which is a signal, is output to an audio reproduction device such as a headphone or a speaker.
• sound image localization can be performed using the listener's own or a standard head transfer function.
• Patent Document 1 Japanese Patent Application Laid-Open No. 2000-23299
• Patent Document 2 Japanese Patent Application Laid-Open No. 2001-16697
• Non-patent literature 1 Jens Brauert, Masayuki Morimoto, Toshiyuki Goto "Spatial Acoustics” Kajima Publishing Co., July 10, 1981
• the peak transfer function is included in the amplitude frequency characteristic of the head transfer function because the head transfer function is simulated with only a single IIR filter. There is a problem that only one of the mountain and the dip (valley) can be reproduced, and sound image localization can not be performed correctly! If the amplitude frequency characteristic of the head related transfer function is faithfully simulated, a large number of IIR filters are required, and there is a problem that the required amount of data and the amount of calculation increase as in the conventional example described above.
• the present invention has been made to solve the conventional problems, and it is possible to reduce the amount of data required and the amount of calculation, and to easily and correctly localize the sound image for many listeners. It is an object of the present invention to provide a sound image localization apparatus that can
• the sound image localization apparatus of the present invention has a configuration for processing the sound source signal so as to reproduce the structural feature of the head related transfer function corresponding to the input target position!
• parameter setting means for setting parameters for reproducing structural features of the head related transfer function, sound image localization processing for the sound source signal according to the parameters and sound image localization signal for outputting a sound image localization signal And the processing means.
• the parameter setting means may be based on the input listener information !, the listener It is configured to set the above-mentioned parameters that are adapted to the information.
• a parameter adapted to the input listener information is set. Therefore, the sound image localization can be easily performed on more people.
• the listener information is configured to be physical feature information related to a physical feature of the listener.
• physical feature extraction means which extracts and outputs physical feature information of the listener from information including the input physical features of the listener.
• the physical feature information is extracted from the information including the input physical features of the listener, and a parameter adapted to the extracted physical feature information is set. Therefore, sound image localization can be easily performed on more people.
• the information including the physical characteristics of the listener is configured to be image information of the listener.
• the listener information is a head-related transfer function obtained by actual measurement or numerical calculation of a listener.
• the listener information is configured to be attribute information of a listener.
• the sound image can be localized correctly to more people easily.
• the listener information is configured to be information relating to auditory characteristics of the listener.
• the parameter setting means may be a function representing a relationship between a target position and the parameter. And the input target position force is also calculated by the function.
• the target position force can also be easily set as a parameter, and the necessary data amount and calculation amount can be reduced.
• the parameter setting means holds a parameter table for storing the parameter corresponding to the target position, and selects the parameter corresponding to the input target position from the parameter table.
• the target position force can also be easily set as a parameter, and the required data amount and calculation amount can be reduced.
• the parameter setting unit holds a function representing the relationship between the listener information, the target position, and the parameter, and calculates the parameter by the function from the input target position and the listener information. It was composition.
• the target position force can also be easily set as a parameter, and the required data amount and calculation amount can be reduced.
• the parameter setting means holds a parameter table storing the listener information and the parameter corresponding to the target position, and the input target position and the parameter corresponding to the listener information are the parameters.
• Parameter Table Force Selectable configuration is the parameter table storing the listener information and the parameter corresponding to the target position, and the input target position and the parameter corresponding to the listener information are the parameters.
• the target position force can also be easily set as a parameter, and the required data amount and calculation amount can be reduced.
• the parameter setting unit is configured to obtain the parameter of the target position by interpolation also for the parameter force at a position close to the target position.
• This configuration can reduce the amount of data required.
• the parameter setting means sets a parameter for reproducing only selected one of peak, dip, high band attenuation and low band attenuation included in the amplitude frequency characteristic of the head related transfer function.
• the parameter setting means is configured to set a parameter for reproducing at least one of the time difference and the level difference of the left and right ears of the head related transfer function.
• the sound image localization processing means includes a plurality of IIR filters, and the parameter setting means sets parameters for reproducing the peak, dip, high band attenuation and low band attenuation in the IIR filter. did.
• the sound image localization processing means includes at least one of a delay and a level adjuster, and the parameter setting means sets a parameter for reproducing the time difference between the left and right ears as the delay, and A parameter for reproducing the ear level difference is set in the level adjuster.
• the number of structural features of the head related transfer function to be reproduced is changed.
• the number of structural features of the head related transfer function to be reproduced is changed.
• the computer may be selected from among peak, dip, high band attenuation, and low band attenuation included in the amplitude frequency characteristic of the head transfer function corresponding to the input target position.
• Set at least one of the parameters parameters that reproduce only the parameters, parameters that reproduce the time difference between the left and right ears of the head related transfer function, and parameters that reproduce the level difference between the left and right ears of the head related transfer function It is configured to function as parameter setting means and sound image localization processing means for performing sound image localization processing on a sound source signal according to the parameters and outputting a sound image localization signal.
• the selected peak, dive, high band attenuation and low band attenuation included in the amplitude frequency characteristic of the head related transfer function, the time difference between the left and right ears of the head related transfer function, the head related transfer function By reproducing at least one of the level differences between the left and right ears, sound image localization can be easily performed correctly, and the amount of data and calculation required can be reduced.
• the present invention it is possible to reduce the amount of data required and the amount of calculation by reproducing only the structural features of the head related transfer function corresponding to the input target position. Sound localization can be easily performed correctly for many listeners.
• FIG. 1 is a block diagram of a sound image localization apparatus according to a first embodiment of the present invention.
• FIG. 2 is a diagram showing structural features in amplitude frequency characteristics of head related transfer functions.
• Fig. 3 is a diagram showing the interaural time difference and interaural level difference of the head related transfer function.
• FIG. 4 is a block diagram of a sound image localization processing unit of the sound image localization apparatus according to the first embodiment of the present invention.
• FIG. 5 is a view showing another method of reproducing peaks and dips in the amplitude frequency characteristics of the sound image localization apparatus in the first embodiment of the present invention.
• FIG. 6 is a block diagram showing an example using a parameter setting function of the parameter setting unit of the sound image localization apparatus according to the first embodiment of the present invention.
• FIG. 7 is a block diagram showing an example using a parameter table of a parameter setting unit of the sound image localization apparatus according to the first embodiment of the present invention.
• FIG. 8 is a block diagram of a sound image localization apparatus in a second embodiment of the present invention.
• FIG. 9 is a block diagram showing an example using a parameter setting function of the parameter setting unit of the sound image localization apparatus according to the second embodiment of the present invention.
• FIG. 10 is a block diagram showing an example using a parameter table of a parameter setting unit of the sound image localization apparatus according to the second embodiment of the present invention.
• FIG. 11 is a block diagram of a sound image localization apparatus in a third embodiment of the present invention.
• FIG. 12 is a block diagram of a physical feature extraction unit of the sound image localization apparatus in the third embodiment of the present invention.
• FIG. 13 is a diagram showing the left-right symmetry of head-related transfer functions.
• FIG. 14 is a block diagram of a conventional sound image localization apparatus.
• the hand for sound image localization has a strong head. It is considered to be contained in the transfer function.
• the cues related to the localization in the front and back and up and down directions are included in the amplitude frequency characteristics of the head related transfer function. It is considered to be included in structural features such as high frequency or low frequency attenuation.
• the clues related to the localization in the left and right direction are the time difference between the left and right (ITA (Interaural Time Difference)) and the level difference (interaural level difference: ILD (Interaural Level Difference) included in the head transfer function. And !, included in the glacial structural features! It is believed that
• the present inventors analyzed for each subject the structural features of the head related transfer function that is a clue for sound image localization in the front and back and up and down directions. As a result, to reproduce all structural features (peaks, dips, high-frequency or low-frequency attenuation) included in the head related transfer function, to reproduce some of them (for example, five or six). Revealed that the sound image can be localized correctly.
• the localization in the left-right direction of the sound image can be controlled independently of the localization in the front-rear and up-down directions by using ITD and ILD (see, for example, Japanese Patent No. 33 88235). Therefore, using the ITD and ILD as a signal that reproduces the structural features of the head-related transfer function as a clue for sound image localization in the longitudinal and vertical directions described above. Can control the left and right direction of
• FIG. 1 is a view showing a sound image localization apparatus according to a first embodiment of the present invention.
• the sound image localization apparatus of the present embodiment holds parameters for reproducing the structural features of the head related transfer function for performing sound image localization corresponding to the target position, and the input target
• a sound image localization process is performed based on the parameter set unit 11 which sets corresponding parameters in the sound image localization processing unit 12 based on the position information, and the sound source signal to be input based on the parameter set by the parameter setting unit 11.
• a sound image localization processing unit 12 for outputting a sound image localization signal subjected to the sound image localization processing to a sound reproduction device such as a headphone or a speaker (not shown).
• the knurl setting unit 11 For each target position to which the sound image is to be localized, as shown in FIG. 2, the knurl setting unit 11 has an amplitude frequency characteristic of a standard head related transfer function corresponding to the target position
• a standard head related transfer function (left ear: hl (t), right ear: hr (t)) corresponding to the target position for each target position where the sound image is to be localized.
• the parameters to reproduce the structural features of the ITD and ILD of the HQ, that is, the delay amount and level adjustment amount are set.
• the sound image localization processing unit 12 sets the peak of the head-related transfer function to the input signal based on the set center frequency fc, sharpness Q, and level L parameters for the left ear.
• a plurality of IIR filters 121L a to 12 lLz that perform filtering processing that reproduces D, D, high-pass attenuation or low-pass attenuation, and delay 122 L that delays the input signal based on the set delay amount
• Level adjuster 12 3 L that adjusts the level of the input signal based on the level adjustment amount that is set, and to the input signal based on the set center frequency fc, sharpness Q, and level L parameters for the right ear
• a plurality of IIR filters 121Ra to 121Rz that perform filter processing that reproduces the peak, dip, high band attenuation or low band attenuation of the head related transfer function, and the delay amount that is set
• the parameter setting unit 11 detects each of the left ear and the right ear corresponding to the input target position information.
• the parameters (center frequency, sharpness Q, level L) are read out and set, and the parameters for several minutes are set, and the parameters for the left ear are IIR filters for the left ear 12 lLa to 121 Lz, for the right ear
• the parameters are set such that one parameter corresponds to one IIR filter for each of the right ear IIR filters 121Ra to 121Rz.
• the delay amount for the left ear and the right ear corresponding to the input target position information is set to the delay amount for the left ear
• the delay amount for the left ear is set to the delay 122L
• the delay amount for the right ear is set to the right ear.
• the IIR filters 121La to 121Lz, 121Ra to 121Rz, the delay 122r and 122R, and the level adjusters 123L and 123R are respectively applied to the sound source signals divided into those for the left ear and for the right ear.
• the left and right ear signals are processed according to the parameters set in the parameter setting unit 11, and the left ear (Lch) sound image localization signal and the right ear (Rch) sound image localization signal whose sound image is localized are processed.
• Output the left ear (Lch) sound image localization signal and the right ear (Rch) sound image localization signal whose sound image is localized are processed.
• the present embodiment it is impossible to faithfully reproduce the head related transfer function.
• selection among peak, dip, high band attenuation, and low band attenuation Since only those that are reproduced can be used to reduce the amount of data and computation required, sound localization can be easily performed correctly for many listeners.
• one peak or dip is reproduced by one IIR filter, as shown in FIG. 5, one peak P1, and two dips Dl Three peaks and two dips can also be reproduced by combining ,, and D2. That is, five peaks and dips can be reproduced by three IIR filters reproducing Pl, Dl, D2, and the number of used IIR filters can be reduced. More than Thus, a plurality of peaks and dips included in head related transfer functions can be realized by a combination of a smaller number of IIR filters.
• the parameter setting unit 11 has a parameter calculation unit 111, holds in advance a function representing the relationship between the target position and the value of the parameter, and the parameter calculation unit 111.
• the parameter corresponding to the input target position information may be calculated by this function.
• the parameter setting unit 11 has a parameter selection unit 112, holds in advance a parameter table storing parameters corresponding to the target position, and the parameter selection unit 112
• the parameter corresponding to the input target position information may also be selected.
• parameters of the target position can also be obtained from interpolation parameters such as linear interpolation generally used from parameters of positions close to the target position.
• FIG. 8 is a view showing a sound image localization apparatus according to a second embodiment of the present invention. Since this embodiment is configured substantially the same as the above-described first embodiment, the same reference numerals are given to the same components and only the characteristic parts will be described.
• the parameter setting unit 21 adds physical feature information that affects sound image localization, such as the size or shape of the listener's head or ear, in addition to the target position information.
• parameters to be set in the sound image localization processing unit 12 are determined based on the physical feature information and the target position information. /.
• the parameter setting unit 21 includes physical characteristic information (for example, the size of the pinna or the size of the concha cavity) regarding the shape of the pinna etc.
• the parameter setting unit 21 sets a target position at which the sound image is to be localized for each value of physical feature information (for example, head size in which frontal force is also seen, etc.) regarding the size of the head and the like. Every The head related transfer function (left ear: hl (t), right ear: hr (t)) corresponding to the size of the head, etc. Parameters (delay amount and level adjustment amount) are set.
• the parameter setting unit 21 receives the input target position information and Read out the parameters (center frequency fc, sharpness Q, level L) for the left ear and right ear corresponding to the shape of the pinna, etc.
• the parameters for the set number of minutes are the parameters for the left ear.
• the parameters for the right ear are set to correspond to the IIR filters for the left ear 121La to 121Lz, and the parameters for the right ear to the IR filters 121Ra to 121Rz, respectively, so that one parameter corresponds to one IIR filter.
• the delay amount for the left ear and for the right ear corresponding to the input target position information and the size of the head, etc., and the delay amount for the left ear to the delay 122L for the left ear is set to the delay 122R for the right ear, and the level adjustment amount for the left ear and the right ear corresponding to the input target position information and the size of the head, etc.
• the IIR filters 121La to 121Lz, 121Ra to 121Rz, the delay 122r and 122R, and the level adjusters 123L and 123R are respectively applied to the sound source signals divided into those for the left ear and for the right ear.
• the left and right ear signals are processed according to the parameters set in the parameter setting unit 21, and the left ear (Lch) sound image localization signal and the right ear (Rch) sound image localization signal whose sound image is localized are processed. Output.
• the peak, dip, high band attenuation, and low band attenuation which are structural features of the head related transfer function corresponding to the physical feature information of the listener and the target position. Since only selected ones of these are reproduced, it is possible to reduce the amount of data required and the amount of calculation, and to easily localize the sound image correctly to many listeners.
• the parameter setting unit 21 has a parameter calculation unit 211 as shown in FIG. 9, and holds in advance a function representing the relationship between the value representing the physical feature and the target position and the value of the parameter.
• the parameter calculation unit 211 corresponds to the input target position information and physical feature information. Let's calculate the parameters by using this function.
• parameter setting unit 21 has parameter selecting unit 212, and for each value representing a physical feature, a parameter table for storing a parameter corresponding to the target position is provided.
• the parameter selection unit 212 may also select the parameter corresponding to the parameter corresponding to the input physical feature information and target position information.
• parameters of the target position can be obtained from parameters of positions close to the target position using interpolation processing such as linear interpolation generally used.
• the parameters are set based on the physical feature information.
• the parameters are set based on the head-related transfer function obtained by actual measurement or numerical calculation of the listener. You may do so.
• the peak and dip of the amplitude frequency characteristic, high frequency attenuation, low frequency attenuation, ITD and ILD may be extracted from the head-related transfer function of the listener, and the parameters may be set based on these.
• the parameters may be set based on attribute information such as the age and gender of the listener.
• the parameters may be set based on the information on the auditory characteristics of the listener such as the direction determination band and the hearing, which are described in detail in Non-Patent Document 1.
• FIG. 11 is a view showing a sound image localization apparatus according to a third embodiment of the present invention. Since this embodiment is configured substantially the same as the above-described second embodiment, the same reference numerals are given to the same components and only the characteristic parts will be described.
• the sound image localization apparatus of the present embodiment is a physical feature extraction unit 31 that extracts physical feature information and also outputs information characteristic information including the input physical features of the listener to the parameter setting unit 21. It is characterized in that the parameters to be set in the sound image localization processing unit 12 are determined based on the physical feature information extracted by the physical feature extraction unit 31 and the target position information.
• the parameter setting unit 21 includes physical feature information related to the shape of the pinna etc. (eg, the size of the pinna and the size of the concha cavity) The peak-to-peak dip included in the shape of the auricle shape etc. and the head transfer function corresponding to the target position for each target position where the sound image is to be localized, etc. High frequency attenuation and Among structural features such as low-pass attenuation, parameters (center frequency, sharpness Q, level L) corresponding to the selected plural are set.
• the parameter setting unit 21 sets a target position at which the sound image is to be localized for each value of physical feature information (for example, head size in which frontal force is also seen).
• physical feature information for example, head size in which frontal force is also seen.
• Parameters delay amount and level adjustment amount
• the physical feature extraction unit 31 receives image information of the ear captured by a camera or the like, image information of the entire head, and the like.
• the physical feature extraction unit 31 uses the image recognition unit 311 to perform feature extraction, pattern matching, and image recognition techniques, and the input image information also has the size of the auricle or head, or the auricle. Extract physical feature information such as the shape of the character and output it to the parameter setting unit 21
• the parameter setting unit 21 reads out and sets parameters (center frequency fc, sharpness Q, level L) for the left ear and the right ear corresponding to the input target position information and the shape of the pinna etc.
• Parameters for the left ear are for the left ear IIR filter 121 La to 121 Lz for the left ear, and for the right ear are the parameters for the right ear II R filter 121 Ra to 121 Rz, one parameter each. Is set to correspond to one IIR filter.
• the delay amount for the ear is set to the delay 122R for the right ear, and the level adjustment amount for the left ear and the right ear corresponding to the input target position information and the size of the head, etc.
• the IIR filters 121La to 121Lz, 121Ra to 121Rz, the delay 122r and 122R, and the level adjusters 123L and 123R are respectively applied to the sound source signals divided into those for the left ear and for the right ear.
• the left and right ear signals are processed according to the parameters set in the parameter setting unit 21, and the left ear (Lch) sound image localization signal and the right ear (Rch) sound image localization signal whose sound image is localized are processed.
• Output As described above, in the present embodiment, physical feature information is extracted from information including the physical features of the listener such as image information, and the extracted physical feature information corresponds to the target position.
• a center frequency representing peak, dip, high range attenuation, and low range attenuation in the nolameter setting unit can be performed only by the delay and the level adjuster, by setting the level and the sharpness and not providing the IIR filter in the sound image localization processing unit.
• the difference between the amplitude frequency characteristics of the left and right head transfer functions is small. Therefore, when localization should be performed only in the vicinity of the median surface, The same effect can be obtained even if the same processing is performed for the left and right ears by providing only one row without dividing them for the ear and the right ear.
• the sound image localization processing unit is an offset of the delay or level adjuster.
• the same effect can be obtained by setting the delay or level adjuster in the sound image localization processing unit to either ITD or ILD and performing sound image localization processing. Can.
• the head transfer function Hr (f; ⁇ ) of the right ear at a position from the normal surface to the angle ⁇ The structural features included in the left to right transfer function HI (f; ⁇ ⁇ ) at symmetrical positions should be regarded as substantially identical. Force S can.
• the structural functions included in the head transfer function HI (f; ⁇ ) of the left ear at the position of the angle ⁇ and the head transfer function Hr (f; ⁇ ⁇ ) for the right ear in the position of left-right symmetry The features can be regarded as almost identical.
• Hr (f; ⁇ ) are the structural features of Hl (f; ⁇ ⁇ ) in FIG. 13, and the structural features of Hl (f; ⁇ ) are Hr (f; — Even if it is used as a structural feature of ⁇ )), equivalent effects can be obtained. The same is true if only the information on the left half position is held.
• the number of structural features of the head related transfer function necessary to perform sound image localization needs to be constant at all times.
• the direction in which sound image localization is performed, the amount of processing assigned to the listener, or sound image localization It may be changed manually or automatically depending on the situation.
• the processing amount is limited as long as only structural elements that play an important role in sound image localization are reproduced. Degradation of the sound image localization effect in
• the above-described process may be performed using another means having the same function as the sound image localization process performed using an IIR filter, a delay, and a level adjuster.
• the above-described processing may be performed by a program using a DSP (Digital Signal Processor) or the like.
• each of the parameter setting unit and the physical feature extraction unit may be used as a sound image localization auxiliary device for setting parameters for sound image localization, and parameters for sound image localization are provided by communication or the like. It may be a sound image localization information server.
• the sound image localization processing unit may be a sound image localization processing device that performs sound image localization processing based on parameters for sound image localization.
• a known crosstalk cancellation device is connected to the sound image localization device of each of the above-described embodiments, and the speaker is subjected to crosstalk cancellation processing. It is obvious that it should be made to reproduce by etc.
• the sound image localization apparatus can reduce the amount of necessary data and the amount of calculation, and can easily and properly sound image localize to many listeners.
• sound image localization processing is performed on all devices that perform sound reproduction and the like, such as mobile phones, sound reproduction devices, sound recording devices, information terminal devices, game machines, conference devices, communication and broadcasting systems, etc. It is useful.

Landscapes

• Physics & Mathematics (AREA)
• Engineering & Computer Science (AREA)
• Acoustics & Sound (AREA)
• Signal Processing (AREA)
• Stereophonic System (AREA)

Priority Applications (3)

Applications Claiming Priority (4)

Publications (1)

Family

ID=36601504

Family Applications (1)

Country Status (4)

Families Citing this family (22)

Citations (9)

Family Cites Families (18)

• 2005
  • 2005-06-01 JP JP2005161602A patent/JP2006203850A/ja active Pending
  • 2005-08-30 WO PCT/JP2005/015724 patent/WO2006067893A1/ja not_active Ceased
  • 2005-08-30 US US11/722,586 patent/US20080219454A1/en not_active Abandoned
  • 2005-08-30 EP EP05781488A patent/EP1830604A1/en not_active Withdrawn

Patent Citations (9)

Also Published As

Similar Documents

Legal Events