JP3435141B2 - SOUND IMAGE LOCALIZATION DEVICE, CONFERENCE DEVICE USING SOUND IMAGE LOCALIZATION DEVICE, MOBILE PHONE, AUDIO REPRODUCTION DEVICE, AUDIO RECORDING DEVICE, INFORMATION TERMINAL DEVICE, GAME MACHINE, COMMUNICATION AND BROADCASTING SYSTEM - Google Patents

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to an arbitrary three set
The present invention relates to a sound image localization device that produces a sound image in a dimensional direction.

[0002]

2. Description of the Related Art When a human receives an audio signal (acoustic signal) such as a musical sound, he or she can perceptually recognize the position of the sound source. This is based on the difference in the characteristics of the signals reaching the left and right ears. That is, when the sound source is located at a position that is deviated from the front of the listener to the left and right, the time to reach the left and right ears is deviated. Further, there is a difference in acoustic characteristics (impulse response) between the case where the sound source is in front of the listener and the case where the sound source is behind it. This is due to the effects of the skull, ear lobes, and the like.

Conventionally, in order to perform localization control of a three-dimensional sound image, a path in which a sound wave from a sound source reaches both ears (eardrum) of a person is considered, and reflection of a wall called a spatial transfer function (spatial impulse response) is considered. It is necessary to consider transfer paths such as diffraction, scattering, and head-related transfer functions (head impulse response) such as reflection, diffraction, and resonance by the head and auricle. Research is actively carried out in various fields.

A number of documents have been published for a long time regarding the theory of using this head-related transfer function to localize a sound image out of the head. Brawellt, Morimoto, and Goto et al. There is "sound", and there is Japanese Patent No. 2873982 (particularly, the item of the prior art). The following facts are well known from these documents, and a conventional sound image localization technique will be described with reference to FIG.

Incidentally, FIG. 11 shows an example of the basic principle of a conventional sound image localization apparatus, which is shown in FIGS.
(B) is an example of perceiving a sound image in a real space field, FIG. 11 (c).
Is an example in which sound waves are radiated into a space from a speaker, which is a virtual sound source, instead of a sound source, and is inserted into the ear canal. Also, FIG. An example of processing via an unknown transfer function to localize to is shown.

[0006] Normally, a human is shown in FIG. 11 (a) and FIG.
As shown in (b), it is said that the position of the sound source is perceived by binaural listening. Where source signal Source
Sound waves are emitted from (s) through the space, and the spatial impulse response transfer function from the ear canal entrance to a small microphone mounted on the front of the eardrum or as a specific location on both ears is defined as Space.
(s), the transfer function of the speaker is Speaker (s), and
Let Earphone (s) be the ear canal impulse response transfer function from the earphone to the small microphone through the external ear canal, and let the sound pressure characteristic of the small microphone be Pressure (s). Pressure (s) the sound pressure characteristics of a small microphone via propagation and the ear canal
Is Pressure (s) = Space (s) × Source (s) = Space (s) × Speaker (s) × I (s) (Equation 1)

On the other hand, the sound pressure level of the earphone Pressure
As can be seen from FIG. 4D, (s) is expressed by an unknown transfer function Unknown (s) and an ear canal response response transfer function, so that Pressure (s) = Unknown (s) × Earphone (s) × I (s) (Equation 2) In order to make the auditory out-of-head sound image localization that can be heard from the sound source position, (Equation 1) and (Equation 2) can be made equal, and Space (S) × Speaker (s) = Unknown (s) × Earphone (s) (Equation 3) Therefore, the unknown transfer function Unknown (s) is Unknown (s) = Space (s) × Speaker (s) / Earphone (s) (Equation 4).

From this, the spatial impulse response transfer function approximating the actual sound field impulse response including the speaker transfer function and the external auditory meatus impulse response transfer function from the earphone to the small microphone set in the external auditory canal are measured in advance and the calculation processing is performed. For example, it is possible to obtain the unknown transfer function Unknown (s).

Further, this unknown transfer function Unknown (s)
By performing a real-time convolution operation on an arbitrary input sound signal, it is possible to perceptually localize the input sound source at an arbitrary place.

As described above, in the above sound image localization apparatus,
The spatial impulse response, that is, the head impulse response, and the inverse filter that flattens the impulse response at any one point in the ear canal are convoluted with the sound source signal, so that the signal characteristic for localizing the sound image can be set to any one in the ear canal. Can be reproduced in points.

[0011]

However, in the sound image localization apparatus as described above, the ear canal transfer function at any one point in the ear canal is flattened. The correction of is not done on the eardrum. Therefore, there is a problem that an accurate sound image localization using the earphone cannot be performed.

The present invention has been made in order to solve such a conventional problem, and obtains a change amount of the ear canal impulse response at the eardrum position due to the wearing of the earphone and corrects it. An object of the present invention is to provide a sound image localization device capable of accurate sound image localization.

[0013]

To achieve the above object, according to the Invention The sound image localization apparatus of the present invention, the sound image localization apparatus that performs sound image localization of the sound source signals to be output to the stereo earphone,
Setting means for setting the direction in which the sound image of the sound source signal is localized, and head transmission observed at the ear canal entrance corresponding to the direction in which the sound image is localized set by the setting means
Function and outside by wearing the stereo earphone
The change in the transfer function of the ear canal from the ear canal to the eardrum position
And a sound image localization means for performing sound image localization of the sound source signal to be output to the stereo earphone based on separate information from certain correction information .

With this configuration, since the sound image localization of the sound source signal output to the stereo earphone can be performed based on the correction information of the ear canal transfer function that changes when the stereo earphone is attached to the outer ear, the stereo earphone is attached. By doing so, sound image localization corresponding to the amount of change in the ear canal transfer function can be performed, and a sound source signal that is accurately sound image localized can be heard by the stereo earphone.

Further, the sound image localization apparatus of the present invention comprises the outer ear
The correction information of the road transfer function is from the sound source to the pseudo eardrum position.
Transfer function and head transmission from the sound source to the artificial ear canal entrance
Reaching function and when wearing stereo earphones on the simulated head
Transfer function from stereo earphone to pseudo eardrum position
It has a configuration to calculate using .

With this configuration, it is possible to easily calculate the change amount (correction amount) of the transfer function of the external auditory meatus that has changed due to the wearing of the stereo earphone.

In the sound image localization apparatus of the present invention, when the sound image localization means localizes the sound image of the sound source signal, the sound image localization means sets the sound image in any direction regardless of the direction in which the sound image is localized by the setting means. Even if there is a preset 1
It has a configuration that uses the type of the correction information.

With this configuration, when sound image localization is performed by the sound image localization means, regardless of the transfer function set by the setting means in the direction for localizing the sound image and the direction in which the sound image is localized, in either direction. Even if there is, it is possible to perform sound image localization based on one type of correction information set in advance, so that only one type of correction information needs to be stored, and the memory can be made small.

Further, in the sound image localization apparatus of the present invention, the sound image localization means is configured to perform the sound image localization by convoluting the head-related transfer function and the correction information with the sound source signal. .

With this configuration, sound image localization can be performed by convoluting the head related transfer function and the correction information with the sound source signal.

A conference apparatus using the sound image localization apparatus of the present invention comprises the sound image localization apparatus according to any one of claims 1 to 3, and the sound image localization apparatus is configured to perform sound image localization of a received acoustic signal. Have

With this configuration, since the sound image localization of the acoustic signal received by the sound image localization device can be controlled,
It is possible to listen to the sound whose sound image is accurately localized by the stereo earphone without using the speaker. Further, when reproducing an acoustic signal with a plurality of speakers, accurate sound image localization cannot be realized unless the sound is heard near the center position of the speakers, but when reproducing with stereo earphones, the listening position is not limited. Accurate sound image localization can be realized. Further, since the speaker is not used, the acoustic echo failure caused by the signal output from the speaker being input to the microphone does not occur, so that a comfortable conference can be held.

A mobile phone using the sound image localization device of the present invention comprises the sound image localization device according to any one of claims 1 to 3, and the sound image localization device is configured to perform sound image localization of a received acoustic signal. Have

With this configuration, even if the sound signal received by the sound image localization device is a multi-channel sound signal, it can be output to the stereo earphones as if the sound signal was received by the standard multi-speaker arrangement. You can enjoy listening with a sense of presence.

A sound reproducing device using the sound image localization device of the present invention is a sound image localization device according to any one of claims 1 to 3, and a signal for detecting at least an acoustic signal and a recording information signal recorded on a recording medium. A sound image localization device for detecting a sound image of the acoustic signal read from the recording medium based on the recording information signal detected by the signal detecting device.

With this configuration, it is possible to control the sound image localization of the sound image localization device based on the recording information signal detected by the signal detecting means, and therefore, when the signal detecting means detects that the sound signal is of a plurality of channels. Can output an acoustic signal to the stereo earphones as if the user were listening with an appropriate multi-speaker arrangement by the sound image localization device. Therefore, it is possible to enjoy realistic listening without limiting the listening position.

An audio recording apparatus using the sound image localization apparatus of the present invention comprises the sound image localization apparatus according to any one of claims 1 to 3 and recording means for recording on a recording medium having two channels. The sound image localization device is configured to perform sound image localization so that the sound image can be recorded on the recording medium in a state where the acoustic effect of the input sound signal is retained.

With this configuration, the sound-image-localized signal can be recorded on the recording medium having two channels while maintaining the sound effect of the input sound signal, so that no additional processing is required by the sound reproducing device. Can reproduce a signal subjected to accurate sound image localization. Also, 3
When processing acoustic signals of more than one channel, the sound image localization device can process signals of two channels, so that the recording capacity can be reduced.

An information terminal apparatus using the sound image localization apparatus of the present invention is a sound image localization apparatus according to any one of claims 1 to 3, and a reception device for receiving at least an acoustic signal and data including localization information of the acoustic signal. Means and signal detection means for detecting at least the acoustic signal recorded on the recording medium and the localization information of the acoustic signal, wherein the sound image localization device detects the acoustic information received by the reception means and the signal detection means. The sound image localization of the acoustic signal is controlled based on the localization information of any one of the acoustic signals.

With this configuration, the acoustic signal received by the sound image localization device and the acoustic signal recorded on the recording medium can be controlled to the optimal sound image localization and output to the stereo earphone, so that the listening position is not limited. You can enjoy listening with realism.

An information terminal device using the sound image localization device of the present invention has a structure provided with an operating means for operating the sound image localization device.

With this configuration, the user can control the acoustic signal input by the operating means to a desired sound image localization.

A game machine using the sound image localization apparatus of the present invention comprises the sound image localization apparatus according to any one of claims 1 to 3.
At least a signal detection means for detecting an acoustic signal and a recorded information signal recorded on a recording medium, and a controller, the sound image localization device, for the operation of the recording information signal and the controller detected by the signal detection means The sound image localization of the acoustic signal read from the recording medium is performed based on the sound image.

With this configuration, the sound image localization device can control the sound image localization of the acoustic signal based on the localization information on the recording medium in which the game software and the like are recorded and the information that the user operates the controller. The sound image localization can be accurately output to the stereo earphones, and you can enjoy a virtual sound space without limiting the listening position.

A communication and broadcasting system using the sound image localization apparatus of the present invention comprises the sound image localization apparatus according to any one of claims 1 to 3, and the sound image localization apparatus receives the sound input by the sound image localization apparatus. The sound image localization of the signal is performed, and the acoustic signal localized by the sound image localization device is transmitted in a predetermined signal format.

With this configuration, the sound-image-localized signal can be transmitted in a predetermined signal format, so that a signal subjected to accurate sound-image localization can be transmitted without any additional processing when the transmitted signal is received. Can be played. Also, when processing audio signals of three or more channels,
Since the sound image localization device can process the signals into two channels, the recording capacity can be reduced.

[0037]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

[First Embodiment] FIGS. 1 to 4 are a sound image localization apparatus according to the present invention, and a conference apparatus, a mobile phone, a voice reproducing apparatus, a voice recording apparatus, an information terminal apparatus, and a game using the sound image localization apparatus. It is a figure showing a 1st embodiment of a machine, a communication, and a broadcasting system, and this embodiment is an embodiment of a sound image localization device.

First, the structure will be described.

The sound image localization apparatus 100 shown in FIG. 1 includes a sound image direction setting unit 101 for setting a three-dimensional direction in which a sound image is desired to be localized (hereinafter referred to as a sound image localization direction) and a three-dimensional direction set by the sound image direction setting unit 101. A head impulse response storage unit 102 that stores a head impulse response that localizes a sound image in a direction;
A correction information storage unit 103 that stores correction information (hereinafter, simply referred to as correction information) for a change in the ear canal impulse response due to insertion of a stereo earphone corresponding to the three-dimensional direction set by the sound image direction setting unit 101, and a sound source signal are input. Along with this, the input sound source signal is provided with a convolution operation unit 104 that performs a convolution process of the head impulse response and the correction information, and the convolution operation unit 104 is a stereo including an earplug type or an inner type not shown. It is designed to output to earphones or stereo headphones.

The sound image direction setting unit 101 has an operation unit (not shown) so that the operator can set the sound image localization direction in three dimensions. Based on the set sound image localization direction, the head impulse response is set. The storage unit 102 and the correction information storage 103 are controlled.

The head impulse response storage unit 102 stores a plurality of head impulse responses measured in advance, and stores one of the head impulse responses based on the sound image localization direction set by the sound image direction setting unit 101. Convolution operation unit 104
It is designed to output to.

The correction information storage unit 103 stores the correction information of the change in the ear canal impulse response due to the earphone insertion, which is obtained for each direction in which the sound image is to be localized, specifically, the correction value corresponding to each sound image localization direction (hereinafter, simply It is called a correction value, the calculation method will be described later), or an average value between directions of this correction value (hereinafter, simply referred to as an average value between directions) or a representative value (hereinafter,
(Referred to simply as a representative value) is stored, and similarly to the head impulse response storage unit 102, any one of the correction value, the inter-direction average value, and the representative value based on the sound image localization direction set by the sound image direction setting unit 101 is stored. The value of is output to the convolution operation unit 104.

FIG. 2 shows a correction value (Hc) of the change in the ear canal impulse response due to earphone insertion, which is obtained for each direction in which the sound image is desired to be localized. In FIG. 2, as an example, the correction value of the ear canal impulse response change due to the earphone insertion when the direction in which the sound image is to be localized is taken in the horizontal plane is shown, but the same configuration can be applied to any three-dimensional direction. It goes without saying that it can be applied. Note that FIG. 2 shows a correction value (Hc) calculated by a pseudo head described later.

Here, the principle of calculating the above-mentioned correction value will be described. However, here, for convenience, description will be made in the frequency domain instead of the time domain.

The sound pressure P1 at the eardrum (Ear Drum) of the listener of the sound source signal s radiated in the space r is P1 = S × R × HRTF (ED) = S × R × HRTF (EEC) × H ( EC) (Equation 5) where S: sound source signal, R: room transfer function, HRTF
(ED): Head-related transfer function observed at the eardrum position, HRTF
(EEC): Head-related transfer function observed at the entrance of the ear canal, H
(EC): Indicates the ear canal transfer function.

The sound pressure P2 at the entrance of the listener's ear canal of the sound source signal s radiated in the space r is P2 = S × R × HRTF (EEC) (Equation 6) When this sound pressure P2 is reproduced by the stereo earphone, the sound pressure P3 at the eardrum of the listener is P3 = P2 × SIP × H (EC_SIP) (Equation 7) where SIP: the characteristic of the stereo earphone, H (EC_
SIP): Indicates the ear canal transfer function when the stereo earphone is worn.

Considering a correction value (correction filter) Hc at which the sound pressure at the eardrum of the listener, that is, the sound pressure P3 is equal to the sound pressure P1 when the sound pressure P2 is reproduced by the stereo earphone, )-(Equation 7) From S × R × HRTF (EEC) × H (EC) = S × R × HRTF (EEC) × SIP × H (EC_SIP) × Hc (Equation 8)

Therefore,         Hc = H (EC) / {SIP × H (EC_SIP)} (Equation 9)

As a result, if the sound pressure P2 is reproduced from the stereo earphone by performing the signal processing of the correction value Hc, the sound pressure P1 at the eardrum of the listener of the sound source signal s radiated in the space r can be reproduced. Become.

Next, a method of calculating the correction filter Hc using the pseudo head will be described below.

In the calculation of the correction value Hc as described above,
It is difficult to measure the ear canal transfer function H (EC) and the ear canal transfer function H (EC_SIP) with the stereo earphones attached. Therefore, in this embodiment, the pseudo head is used for measurement.

In this embodiment, it is desirable that the pseudo head for this measurement faithfully simulates the ear canal transfer function and that the shape of the auricle is similar to that of humans. KEM from Knowles
AR (MD Burkhard and RM Sachs, "Anthropometr
ic manikin for acousric research, "J. Acoust. Soc.
Am., Vol.58, No.1, July 1975). H (E
C) is the HRTF (ED) and HRTF using (Equation 10).
(EEC). H (EC) = HRTF (ED) / HRTF (EEC) (Equation 10)

The HRTF (ED) is designed to be measured by using a pseudo head microphone installed at the eardrum position, and the HRTF (EEC) is prepared by installing a microphone at the entrance of the pseudo head to the ear canal. Has become. Also,
H (EC_SIP) can be obtained by inserting a stereo earphone into the external auditory meatus entrance of the artificial head, radiating a measurement signal from the stereo earphone, and receiving the sound with a microphone installed at the eardrum position.

FIG. 2 shows an example of the correction value Hc calculated by such a method. Further, by converting the correction value Hc into the time domain by inverse Fourier transform or the like, it is possible to obtain the correction value of the change in the ear canal impulse response due to the earphone insertion.

As described above, the change in the ear canal impulse response at the eardrum position due to the wearing of the earphone can be easily obtained. It is possible to perform sound localization.

Further, it can be seen from FIG. 2 that the dependency of the correction value Hc on the incident direction is low. This is that the structure of the external auditory meatus is a cylindrical tube with a diameter of about 7 mm and a length of 23-27 mm (Reference "Hearing and Acoustic Psychology", Hisao Sakai, Takeshi Nakayama / 197.
8 / See Corona). Therefore, by averaging or representing in the incident directions, only one kind of correction value Hc can be used regardless of the sound image localization direction. The averaging is performed, for example, by (Equation 11). Note that FIG. 3 is an example of the correction value Hc averaged by (Equation 11). Hc = ΣHc (i) (Equation 11) where i: incident direction.

By converting the correction value Hc thus calculated or the representative value or average value of the correction values Hc into the time domain by inverse Fourier transform or the like, the correction values of the ear canal impulse response change in all directions can be obtained. The sound image can be localized without a measurement and with a small storage capacity.

In this embodiment, the earphones are stereo earphones, but it goes without saying that stereo headphones can be applied in the same manner.

Next, the operation of the sound image localization apparatus in this embodiment will be described. It is assumed that the sound source signal is input to the convolution operation unit 104.

First, when the sound image direction setting unit 101 sets a three-dimensional direction in which a sound image is to be localized by an instruction from an operator or a control unit, the sound image direction setting unit 101 corresponds to the set three-dimensional direction setting. The head impulse response is called from the head impulse response storage unit 102, and the convolution operation unit 1
Output to 04. Further, the sound image direction setting unit 101 calls the correction value, the inter-direction average value, or the representative value corresponding to the set three-dimensional direction setting from the correction information storage unit 103, and causes the convolution operation unit 104 to output it.

Next, the convolution operation unit 104 performs a convolution operation of the input sound source signal and the correction information of the head impulse response and the change of the external auditory meatus impulse response due to the earphone insertion to create a right ear signal and a left ear signal. To do.

Finally, the generated right ear signal and left ear signal are output to a stereo earphone (not shown).

As described above, according to this embodiment, the head impulse response stored in the head impulse response storage unit 102 and the stereo earphone stored in the correction information storage unit 103 are attached to the outer ear. The sound image localization of the input sound source signal can be performed based on the correction information of the change in the external auditory meatus impulse response, which changes the sound image localization corresponding to the amount of change in the external ear canal transfer function by mounting the stereo earphones. The sound source signal whose sound image is localized can be accurately output to the stereo earphone.

Further, in the present embodiment, since the correction value Hc can be calculated using the pseudo head, it is possible to easily calculate the change in the external auditory meatus impulse response that has changed due to the wearing of the stereo earphone.

In the present embodiment, the correction information storage unit 10
Since the correction information of the ear canal impulse response change stored in 3 can use the representative value or the average value of the calculated correction values Hc regardless of the direction in which the sound image localization is performed, the storage capacity of the correction information storage unit can be reduced. Can be made smaller.

[Second Embodiment] FIG. 4 shows a sound image localization device according to the present invention, and a conference device, a mobile phone, a voice reproducing device, a voice recording device, an information terminal device, a game machine, and communication using the sound image localization device. It is a figure which shows 2nd Embodiment of and a broadcasting system.

The present embodiment is applied to a conference system installed in a plurality of remote places and performing a video conference by communicating voice and video through a communication line such as a telephone public network line. It is an embodiment when a localization device is applied.

First, the structure will be described.

The conferencing system 200 shown in FIG. 4 is a conferencing device for transmitting / receiving and controlling output of video signals and audio signals.
201, a stereo earphone 202 that reproduces an acoustic signal, a microphone 203 that records sound such as a speaker's voice and venue sound,
The conference device 201 includes a camera 204 that captures an image of a speaker or a venue, and the conference device 201 includes a reception unit 205 that receives a reception signal including a video signal or an audio signal, and a video display unit 206 that displays the video signal received by the reception unit 205. And a sound image localization device 207 that controls the sound image localization of the acoustic signal received by the reception unit 205.
And a control unit 208 for controlling the position of image display on the image display unit 206 and setting the sound image localization direction of the sound image localization device 207.
And a transmission unit 209 that transmits the audio signal and the video signal input by the microphone 203 and the camera 204.

The receiving unit 205 is connected to the communication line, receives the received signal, and divides the received signal into a video signal and an audio signal. The divided video signal is displayed on the video display unit 206. Sound image localization device 2 for output and acoustic signals
It is designed to output to 07.

The video signal divided by the receiving unit 205 is input to the video display unit 206, and the video display unit 206 displays the input video signal on a display unit (not shown). It has become. In addition, the video display unit 20
In 6, the position of the image displayed on the display unit is controlled by the control unit 208.

The sound image localization device 207 is adapted to receive the acoustic signals divided by the reception unit 205, and this sound image localization device 207 determines whether or not the sound image localization direction is set by the control unit 208. The sound image localization of the input acoustic signal is controlled. In addition, the sound image localization device 20
The operation of 7 is the same as that of the first embodiment, and the controlled signal is transmitted to the stereo earphone 202.
It is designed to output to.

The control unit 208 is adapted to set the position of the image on the image display unit and the sound image localization direction based on the operation of the operator on the operation unit (not shown). The image display unit 206 and the sound image localization device 207 are controlled based on the sound image localization direction.

The transmitting unit 209 is adapted to receive the audio signal output from the microphone 203 and the video signal output from the camera 204. The transmitting unit 209 is connected to the communication line and input. Audio signals and video signals are converted into transmission signals and output.

Next, the receiving operation of this embodiment will be described.

In this operation, it is assumed that the display position of the image on the image display unit and the sound image localization direction in which the position of the image matches the sound image localization direction are set in advance.

First, when the receiving unit 205 receives a received signal, the receiving unit 205 divides the received signal into a video signal and an audio signal, and the divided video signal and audio signal are divided into the video display unit 206 and the sound image localization. Output to the device 207 respectively.

Next, the video signal output from the reception unit 205 is displayed on the video display unit 206, and the audio signal is input to the sound image localization device 207 and set to the set 3
The sound image is controlled to be localized in the direction of dimension.

Next, the acoustic signal controlled by the sound image localization device 207 is reproduced by the stereo earphone 202.

As described above, according to the present embodiment, the receiving operation is performed, and normally, the conference is performed while wearing the stereo earphone 202. Therefore, the voice of the other party is transmitted through the stereo earphone 202. You can listen to it.

As the transmitting operation, when the voice of the speaker is picked up by the microphone 203 and the image of the speaker is picked up by the camera 204, the voice signal and the video signal are input to the transmitting unit 209. It Then, the transmission unit 209
Transmits a video signal and an audio signal to the communication line.

As described above, according to this embodiment, the speaker direction of the image displayed on the image display unit 206 and the sound image localization direction of the sound reproduced by the sound image localization device 207 under the control of the control unit 208. Since they match, a natural meeting can be held.

Further, when reproducing an audio signal with a plurality of speakers, it is necessary to listen in the vicinity of the center position of the speakers.
Although accurate sound image localization cannot be realized, when reproducing with a stereo earphone, the listening position is not limited, and accurate sound image localization can be realized.

Further, when the sound is reproduced by the speaker, an acoustic echo is generated when the signal output from the speaker is input to the sound collecting microphone, but when the stereo earphone is used, the acoustic echo is not generated, which is comfortable. You can have a meeting.

[Third Embodiment] FIG. 5 shows a sound image localization apparatus according to the present invention, and a conference apparatus, a mobile phone, a voice reproducing apparatus, a voice recording apparatus, an information terminal apparatus, a game machine, and communication using the sound image localization apparatus. It is a figure which shows 3rd Embodiment of and a broadcasting system.

In the present embodiment, the case where the sound image localization apparatus of the first embodiment is applied to a mobile phone which receives voice through a communication line such as a telephone public network line or reproduces a voice signal received and accumulated. It is an embodiment of.

First, the structure will be described.

A stereo earphone 301 and a microphone 302 are connected to the mobile phone 300 shown in FIG. 5, so that the stereo earphone 301 can listen to the voice received by the mobile phone 300 and the microphone 302.
The voice of the operator who operates the mobile phone 300 is input by and can be transmitted to the communication line.

This mobile phone 300 includes a receiving unit 303 that receives a received signal including an acoustic signal, a memory 304 that stores the acoustic signal received by the receiving unit 303, and a sound image localization device 305 that controls the sound image localization of the acoustic signal. A control unit 306 that controls the output of the reception unit 303 and the memory 304 to the sound image localization device 305 and sets the sound image localization direction of the sound image localization device 305; and a transmission unit 307 that transmits the acoustic signal output from the microphone 302. I have it.

The receiving section 303 is connected to a communication line, receives a received signal, and outputs an acoustic signal from the received signal to the memory 304 and the sound image localization device 305. It should be noted that this output control is controlled by an instruction from the control unit 306.

The acoustic signal output from the receiving unit 303 is input to the memory 304.
The 4 is adapted to accumulate this input acoustic signal. Further, the memory 304 outputs the accumulated acoustic signal to the sound image localization device 305 based on an instruction from the control unit 306.

The sound image localization device 305 is adapted to receive the acoustic signal output from the reception unit 303 or the memory 304. This sound image localization device 305 is based on the sound image localization direction set by the control unit 306. Then, the sound image localization of the input acoustic signal is controlled. The operation of the sound image localization apparatus 305 is similar to that of the first embodiment, and a controlled signal is output to the stereo earphone 301.

For example, in the case of a 5.1 ch multi-channel acoustic signal, the stereo earphone 301 causes 5.1
Control is performed so that each acoustic signal can be heard from each direction of the ch standard multi-speaker arrangement.

In the case of a stereo sound signal, the stereo earphone 301 controls so that the L and R signals are received from the left and right speaker directions so that the stereo earphone 301 hears the sound at the center of the two speakers. It is like this.

Furthermore, in a conference application such as a three-party talk using the mobile phone 300, control is performed so that the direction of the speaker in the image acquired by the video communication and the direction of the sound output by the stereo earphone 301 match. It is supposed to do.

The control unit 306 controls the output destination of the receiving unit 303 and the memory 304 based on the operation of the operator on the operation unit (not shown).
The sound image localization device 305 is controlled based on the set sound image localization direction.

The transmitting unit 307 is adapted to receive the acoustic signal output from the microphone 302.
Is connected to a communication line and converts an input voice signal into a transmission signal and outputs the transmission signal.

Next, the receiving operation of this embodiment will be described.

In this operation, it is assumed that the image display position and the sound image localization direction have been set in advance.

First, a voice or stereo acoustic signal,
When a signal such as a 5.1-channel multi-channel acoustic signal is input as a reception signal to the reception unit 303, the reception unit 3
03 determines the output instruction of the control unit 306, converts the received signal into an acoustic signal and outputs it to the memory 304 or the sound image localization device 305.

When output to the memory 304, the acoustic signal input to the memory 304 is accumulated and the operation ends. When the sound image localization device 305 outputs the sound image, the following operation is performed. The same operation as described below is performed when the acoustic signal stored in the memory 304 is input.

First, when the acoustic signal output from the receiving unit 303 (or the memory 304) is input to the sound image localization device 305, the sound image localization device 305 outputs the input acoustic signal to the control unit 3.
The sound image is controlled to be localized in the three-dimensional direction set by 06.

Next, the sound image localization device 305 outputs a sound signal whose sound image localization is controlled to the stereo earphone 301, and the stereo earphone 301 reproduces the input sound signal.

As described above, the present embodiment is adapted to perform the receiving operation, and receives the received acoustic signal or the memory 30.
The acoustic signal stored in 4 or the voice of the other party can be heard via the stereo earphone 301.

As the transmission operation, when the voice of the speaker is picked up by the microphone 302, this voice signal is transmitted by the transmission unit 3
Entered in 07. Next, the transmission unit 307 transmits the video signal and the audio signal to the communication line.

As described above, according to the present embodiment, the multi-channel music signal received by the receiving unit 303 or stored in the memory 304 is output to the stereo earphone 301 as if the multi-speaker is listening. Therefore, it is possible to enjoy realistic music with the mobile phone 300.

[Fourth Embodiment] FIG. 6 shows a sound image localization device according to the present invention, and a conference device, a mobile phone, a voice reproducing device, a voice recording device, an information terminal device, a game machine and a broadcast using the sound image localization device. It is a figure which shows 4th Embodiment of a system.

The present embodiment is an embodiment in which the sound image localization device of the first embodiment is applied to a sound reproducing device (audio player) such as a CD player.

First, the structure will be described.

The audio reproducing device 400 shown in FIG. 6 is connected with a video display device 401 for displaying a video signal and a stereo earphone 402 for reproducing an audio signal, and a CD
Alternatively, a signal detection unit for detecting recording information such as audio signals and the number of channels from a recording medium (not shown) such as a DVD
403, a sound image localization device 404 that controls the sound image localization of the input acoustic signal, and a control unit 405 that controls the sound image localization device 404 based on the recording information detected by the signal detection unit 403.

The signal detecting unit 403 detects recording information such as a single channel or a plurality of channels of audio signals, a video signal, and the number of channels of audio signals recorded on the recording medium from a recording medium such as a CD or a DVD. It has become. Further, the signal detection unit 403 outputs the detected video signal to the video display unit 401, outputs information such as the number of channels of the acoustic signal to the control unit 405 as a recording information signal, and outputs the acoustic signal to the sound image localization device 404. It has become

The sound image localization device 404 is adapted to receive the acoustic signal output from the signal detection unit 403. This sound image localization device 404 is based on the sound image localization direction set by the control unit 405. The sound image localization of the input acoustic signal is controlled. The operation of the sound image localization device 404 is the same as that of the first embodiment, and a controlled signal is output to the stereo earphone 402.

For example, in the case of a 2-channel acoustic signal,
The sound image localization device 404 sets the sound image localization direction as when listening at the center of the speakers arranged on the left and right by the stereo earphone 402.

In the case of a 6-channel acoustic signal such as a 5-channel signal and a woofer signal, three speakers and a woofer speaker are arranged in the front by the stereo earphone 402, and two speakers are arranged in the rear, and in the center thereof. Set the sound image localization direction as you would when listening.

In the case of a 1-channel or 2-channel audio signal, the control unit 405 controls the pseudo stereo signal and the pseudo surround signal to be generated to reproduce a multi-channel signal and to output a stereo signal. Earphones 402 may allow for listening like the multi-channel and stereo described above.

The control section 405 determines the optimum sound source reproduction direction (sound image localization direction) based on the input recording information signal, and controls the sound image localization device 404 based on the determined sound image localization direction. It has become.

Next, the reproducing operation of this embodiment will be described.

First, when the operator inserts an arbitrary recording medium into a reproducing section (not shown) and starts reproducing the recording medium, the signal detecting section 403 detects an acoustic signal, a video signal and recording information.

Next, the video signal detected by the signal detection unit 403 is output to the video display unit 401 for display, and the detected recording information signal is input to the control unit 405. Further, the acoustic signal detected by the signal detection unit 403 is output to the sound image localization device 404.

Next, the control unit 405 determines the optimum sound image localization direction for the recorded acoustic signal from the input recording information signal, and sets the sound image localization direction in the sound image localization device 404.

Next, the sound image localization device 404 is provided with the signal detection unit 4
The sound signal detected by 03 is controlled so that the sound image is localized in the direction set by the control unit 405 for each channel signal.

Next, the sound image localization device 404 outputs a sound signal whose sound image localization is controlled to the stereo earphone 402, and the stereo earphone 402 reproduces the input sound signal.

As described above, according to this embodiment, the sound image localization direction of the control unit 405 can be set by the recording information signal detected by the signal detection unit 403, and the sound image localization direction can be set by this sound image localization direction. Device 40
Since the sound localization of 4 can be controlled, the signal detector 4
When it is detected by 03 that it is an audio signal of a plurality of channels, it can be output to the stereo earphone by the sound image localization device 404 as if listening with an appropriate multi-speaker arrangement. Therefore, it is possible to enjoy realistic listening without limiting the listening position. Further, even when listening to music or the like while carrying a small audio player, it is possible to reproduce with a sense of reality.

[Fifth Embodiment] FIG. 7 shows a sound image localization apparatus according to the present invention, and a conference apparatus, a mobile phone, a voice reproducing apparatus, a voice recording apparatus, an information terminal apparatus, a game machine, and communication using the sound image localization apparatus. It is a figure which shows 5th Embodiment of and a broadcasting system.

The present embodiment is an embodiment in which the sound image localization device of the first embodiment is applied to a voice recording device (audio recorder).

First, the structure will be described.

The sound image localization apparatus 500 shown in FIG. 7 includes a sound image localization apparatus 501 for controlling the sound image localization of the input acoustic signal,
A recording medium such as a CD, a DVD, or a hard disk that stores an acoustic signal whose sound image localization is controlled by the sound image localization device 501.
A recording unit 503 for recording in 502 and a control unit 504 for controlling the sound image localization direction of the sound image localization device 501 are provided.

Acoustic signals are input to the sound image localization device 501 from the outside.
Controls the sound image localization of the input acoustic signal based on the sound image localization direction set by the control unit 504. The operation of the sound image localization device 501 is similar to that of the first embodiment, and a controlled signal is output to the recording unit 503.

For example, when a multi-channel signal is input, the sound image localization direction is set so that the signal can be heard at the center of the optimum speaker arrangement for listening.

The sound image localization device 501 is adapted to generate a 2-channel signal and output the 2-channel signal to the recording section 503.

The control unit 504 controls the sound image localization device 501 based on an operator's instruction in an operation unit (not shown). In particular, the control unit 504 sets the sound image localization direction of the acoustic signal input to the sound image localization device 501. It is supposed to be set.

Next, the recording operation of this embodiment will be described.

In this operation, it is assumed that the sound image localization direction is set.

First, when an acoustic signal is input to the sound image localization device 501, the sound image localization device 501 controls the sound image localization direction of the input acoustic signal according to the sound image localization direction of each channel set by the control unit 504. To do.

Next, the sound image localization device 501 outputs the sound image localized sound signal to the recording unit 503, and then the recording unit 503.
Writes this acoustic signal in the recording medium 502.

As described above, according to the present embodiment, the sound signal input by the sound image localization device 501 can be sound image localized, and the sound image localized signal is recorded on the recording medium 502 in two channels. Because you can
It is possible to record on the recording medium 502 of two channels while maintaining the acoustic effect generated by multiple channels. Therefore, it is possible to reproduce a signal subjected to accurate sound image localization without any additional processing by a sound reproducing device (not shown).

Further, in the case of processing the acoustic signals of three or more channels, since the sound image localization device 501 can process the signals of two channels, the recording capacity can be reduced.

[Sixth Embodiment] FIG. 8 shows a sound image localization apparatus according to the present invention, and a conference apparatus, a mobile phone, a voice reproducing apparatus, a voice recording apparatus, an information terminal apparatus, a game machine, and a communication which use the sound image localization apparatus. It is a figure which shows 6th Embodiment of the sound image localization apparatus of a broadcasting system.

The present embodiment is an embodiment in which the sound image localization apparatus of the first embodiment is applied to an information terminal device such as a personal computer or a mobile terminal device.

First, the structure will be described.

The information terminal device 600 shown in FIG. 8 is connected to a communication line such as the Internet, and a receiving unit 601 for receiving a received signal including localization information such as a video signal, an audio signal and the number of channels of the audio signal, and a CD. , A DVD, a hard disk, a signal detection unit 603 that detects localization information such as the number of channels of an audio signal from a recording medium 602 such as a memory, and a video signal received by the reception unit 601 and an image detected by the signal detection unit 603. A video display unit 604 that displays a signal, a sound image localization device 605 that controls the sound image localization direction of the acoustic signal received by the reception unit 601, and the acoustic signal detected by the signal detection unit 603, and the localization information received by the reception unit 601 and Based on the localization information detected by the signal detection unit 603, or a control unit 607 that controls the sound image localization apparatus based on an instruction input by the keyboard 606. For example, the sound image localization is adapted to output a control signal to the stereo earphone 608 connected to the sound image localization apparatus 605.

The receiving unit 601 is connected to a communication line, receives a received signal, and splits the received signal into a video signal and an audio signal. The split video signal is displayed on the video display unit 604. Sound image localization device for output and acoustic signals 6
It is adapted to output to 05 and the localization information to the control unit 607.

The signal detecting section 603 is provided with localization information such as audio signals of a single channel or a plurality of channels from a recording medium 602 such as a CD, a DVD, a hard disk or a memory, and the number of channels of the audio signals recorded on the video signal recording medium. It is designed to detect Also, the signal detector
The 603 outputs the detected video signal to the video display unit 604, the acoustic signal to the sound image localization device 605, and the localization information to the control unit 607 as a recording information signal.

The video signal output from the receiving unit 601 is input to the video display unit 604, and the video display unit 604 displays the input video signal on a display unit (not shown). It has become.

The sound image localization device 605 is adapted to receive the acoustic signal output from the reception unit 601, and this sound image localization device 605 uses the sound image localization direction set by the control unit 607 to The sound image localization of the input acoustic signal is controlled. The operation of the sound image localization device 605 is similar to that of the first embodiment, and a controlled signal is output to the stereo earphone 608.

The control section 607 receives the localization information output from the reception section 601 and the localization information detected by the signal detection section 603.
Is configured to set the sound image localization direction of the sound image localization device 605 based on the input localization information.

Next, the receiving operation of this embodiment will be described.

First, when a reception signal including acoustic information, video information or other information is input to the reception unit 601 via the Internet or the like, the reception unit 601 converts the signal into an audio signal, a video signal and localization information. Divided into signals, each video display section
604, the sound image localization device 605 and the control unit 607.

Next, the video display unit 604 displays the input video signal, and the control unit 607 calculates the optimum sound image localization direction based on the input localization information to determine the sound image localization of the sound image localization device 605. Set the direction.

Next, the sound image localization device 605 controls the sound image localization of the input acoustic signal based on the sound image localization direction set by the control unit 607 and outputs it to the stereo earphone 608. The reproduced acoustic signal.

Next, the reproducing operation of the information recorded on the recording medium will be described.

First, when the signal detection section 603 detects the information recorded on the recording medium 602, the signal detection section 603 converts the information into an audio signal, a video signal, and a localization information signal, respectively in the video display sections 604, Sound image localization device 605 and control unit 60
Output to 7.

Next, the video display unit 604 displays the input video signal, and the control unit 607 calculates the optimum sound image localization direction based on the input localization information and determines the sound image localization of the sound image localization device 605. Set the direction.

Next, the sound image localization device 605 controls the sound image localization of the input acoustic signal based on the sound image localization direction set by the control unit 607, and outputs it to the stereo earphone 608. The reproduced acoustic signal.

The control unit 607 is connected to the keyboard 606, and the user can also set a desired sound image localization direction via the keyboard 606.

As described above, according to this embodiment, the sound image localization of the acoustic signal received by the receiving unit 601 by the sound image localization device 605 and the acoustic image localization of the acoustic signal recorded on the recording medium 602 is based on the respective localization information. Since it can be controlled, optimum listening can be performed by the stereo earphones 608 according to a signal obtained through the Internet or the like or a signal recorded in the recording medium 602, and realistic reproduction is performed regardless of the listening position. be able to. Also, the keyboard 606 allows the user to set the desired sound image localization.

[Seventh Embodiment] FIG. 9 shows a sound image localization apparatus according to the present invention, and a conference apparatus, a mobile phone, a voice reproducing apparatus, a voice recording apparatus, an information terminal apparatus, a game machine, and communication using the sound image localization apparatus. It is a figure which shows and 7th Embodiment of a broadcasting system.

The present embodiment is an embodiment in which the sound image localization device of the first embodiment is applied to the game device.

First, the structure will be described.

The game device 700 shown in FIG. 9 has a CD and a DV.
D, a signal detection unit 702 that detects localization information such as an audio signal and the number of channels from a recording medium 701 such as a memory or a hard disk, a video display unit 703 that displays the video signal detected by the signal detection unit 702, and a signal detection unit. Sound image localization device 704 for controlling the sound image localization direction of the acoustic signal detected by 702
And a control unit 7 for setting the sound image localization direction of the sound image localization device 704 based on the localization information detected by the signal detection unit 702 or based on the instruction input by the controller 705.
06, and outputs the acoustic signal whose sound image localization is controlled to the stereo earphone 707 connected to the sound image localization device.

The signal detecting section 702 is localization information such as a single channel or a plurality of channels of audio signals from the recording medium 701 such as a CD, a DVD, a hard disk or a memory, and the number of channels of the audio signals recorded on the video signal recording medium. It is designed to detect Also, the signal detector
702 outputs the detected video signal to the video display unit 703, the acoustic signal to the sound image localization device 704, and the localization information to the control unit 706 as localization information signal.

The video signal detected by the signal detection unit 702 is input to the video display unit 703.
The video display unit 702 is adapted to display the input video signal.

The sound image localization apparatus 704 is adapted to receive the acoustic signal detected by the signal detection unit 702,
The sound image localization device 704 controls the sound image localization of the input acoustic signal based on the sound image localization direction set by the control unit 706. The operation of the sound image localization device 704 is similar to that of the first embodiment, and the controlled signal is transmitted to the stereo earphone 707.
It is designed to output to.

The localization information detected by the signal detection unit 702 is input to the control unit 706. The control unit 706 controls the sound image localization of the sound image localization device 704 based on the input localization information. It is designed to set the direction.
A controller 705 having a plurality of buttons and keys is connected to the control unit 706. When the user presses the enter button or the direction key with the controller 705, a signal indicating the operation is sent to the control unit 706. 706 will be notified.

Next, the reproducing operation of this embodiment will be described.

First, when the signal detection unit 702 detects the information recorded on the recording medium 701, the signal detection unit 702 uses the information as an audio signal, a video signal, and a localization information signal for each video. It outputs to the display unit 703, the sound image localization device 704 and the control unit 706.

Next, the video display unit 703 displays the input video signal.

On the other hand, when the operator operates the button of the controller 705, this operation information is output to the control unit 706.

Next, the control section 706 calculates the optimum sound image localization direction based on the input localization information and the operation information from the controller 705, and sets the sound image localization direction of the sound image localization device 704.

Next, the sound image localization device 704 performs signal processing so as to perform sound image localization based on the sound image localization direction set by the control unit 706, and outputs it to the stereo earphone 707. Play the signal.

As described above, according to this embodiment, the sound image is localized in the three-dimensional direction based on the localization information on the recording medium on which the game software is recorded or the information on the operation of the controller by the user. In addition, it is possible to output the sound signal with this sound image localized to the stereo earphone 707, so that the sound image localization can be performed exactly as intended by the software developer, regardless of the listening position such as listening at the center of the speaker. The stereo earphone 707 allows you to enjoy a virtual sound space.

[Eighth Embodiment] FIG. 10 shows a sound image localization apparatus according to the present invention, and a conference apparatus, a mobile phone, a voice reproducing apparatus, a voice recording apparatus, an information terminal apparatus, a game machine, and communication using the sound image localization apparatus. It is a figure which shows and 8th Embodiment of a broadcasting system.

The present embodiment is an embodiment in which the sound image localization device of the first embodiment is applied to a broadcasting system for terrestrial TV broadcasting, satellite broadcasting, radio broadcasting, and music distribution using a network. is there.

First, the structure will be described.

The broadcasting system 800 shown in FIG. 10 receives the video signal and the audio signal, compresses the input signals and encodes them into a predetermined format.
A sound image localization device 803 that controls the sound image localization direction of the input acoustic signal, a control unit 804 that sets the sound image localization direction of the sound image localization device 803, and encoders 801 and 802 that are encoded in a predetermined format. It is equipped with a transmission unit 805 for transmitting data, and is adapted to perform terrestrial TV broadcasting, satellite broadcasting, radio broadcasting, and music distribution using a network.

A video signal is inputted from the outside to the video encoder 801.
Encodes the input video signal into a predetermined format and compresses the data amount. The video encoder 801 is also adapted to output the encoded data to the transmission unit 805.

The acoustic encoder 802 includes a sound image localization device 803.
A signal in which the sound image localization direction of the acoustic signal is controlled is input by the acoustic encoder 802. The acoustic encoder 802 encodes the input acoustic signal in a predetermined format and compresses the data amount. Has become. Further, the acoustic encoder 802 is adapted to output the encoded data to the transmitting unit 805.

The video encoder 801 and the audio encoder 802 need not compress the data amount.

The sound image localization device 803 is adapted to receive an acoustic signal from the outside.
Controls the sound image localization of the input acoustic signal based on the sound image localization direction set by the control unit 804. The operation of the sound image localization apparatus 803 is similar to that of the first embodiment, and a controlled signal is output to the acoustic encoder 802.

The control unit 804 is adapted to set the sound image localization direction based on the operation of the operator on the operation unit (not shown), and controls the sound image localization apparatus 803 based on the set sound image localization direction. It is like this.

For example, the control unit 804 is configured to set the sound image direction for a multi-channel signal as when listening to a sound at the center of the speaker arrangement that is optimal for listening to the signal. .

The transmission section 805 is adapted to receive the respective data encoded by the respective encoders 801 and 802, and the transmission section 805 may, for example, use a network such as the Internet, radio waves, a telephone line or the like. The video and audio data input via the above are transmitted to the outside.

As described above, according to the present embodiment, since the signal in which the sound image is localized by the transmitting unit 805 can be transmitted in a predetermined signal format, additional processing can be performed when the transmitted signal is received. It is possible to reproduce a signal subjected to accurate sound image localization without adding. Also, 3
When processing acoustic signals of more than one channel, the sound image localization device can process signals of two channels, so that the recording capacity can be reduced.

[0185]

Since the sound image localization apparatus of the present invention can perform sound image localization of the sound source signal output to the stereo earphone based on the correction information of the ear canal transfer function which changes when the stereo earphone is attached to the outer ear. By mounting the stereo earphone, it is possible to perform sound image localization corresponding to the amount of change in the transfer function of the external auditory canal, and it is possible to allow the stereo earphone to listen to the sound source signal whose sound image has been accurately localized.

[Brief description of drawings]

1 shows a first embodiment of a sound image localization apparatus according to the present invention, and a conference apparatus, a mobile phone, a voice reproducing apparatus, a voice recording apparatus, an information terminal apparatus, a game machine, a communication and broadcasting system using the sound image localization apparatus. The block diagram showing the configuration of such a sound image localization device

FIG. 2 is a diagram illustrating an example of a correction information storage unit of an ear canal impulse response change due to earphone insertion according to the first embodiment.

FIG. 3 is a diagram showing another example of the correction information storage unit of the ear canal impulse response change due to the earphone insertion according to the first embodiment.

FIG. 4 shows a second embodiment of a sound image localization device according to the present invention, and a conference device, a mobile phone, a voice reproduction device, a voice recording device, an information terminal device, a game machine, a communication and broadcasting system using the sound image localization device. FIG. 1 is a block diagram showing the configuration of such a conference device.

FIG. 5 shows a third embodiment of a sound image localization apparatus according to the present invention, and a conference apparatus, a mobile phone, a voice reproduction apparatus, a voice recording apparatus, an information terminal apparatus, a game machine, a communication and broadcasting system using the sound image localization apparatus. Shown is a block diagram showing the configuration of such a mobile phone

FIG. 6 illustrates a fourth embodiment of a sound image localization apparatus according to the present invention, and a conference apparatus, a mobile phone, a voice reproduction apparatus, a voice recording apparatus, an information terminal apparatus, a game machine, a communication and broadcasting system using the sound image localization apparatus. FIG. 1 is a block diagram showing the configuration of such an audio reproducing device.

FIG. 7 shows a sound image localization apparatus according to the present invention and a fifth embodiment of a conference apparatus, a mobile phone, an audio reproduction apparatus, an audio recording apparatus, an information terminal apparatus, a game machine, a communication and broadcasting system using the sound image localization apparatus. FIG. 1 is a block diagram showing the configuration of such a voice recording device.

FIG. 8 shows a sixth embodiment of a sound image localization apparatus according to the present invention, and a conference apparatus, a mobile phone, an audio reproduction apparatus, an audio recording apparatus, an information terminal apparatus, a game machine, a communication and broadcasting system using the sound image localization apparatus. FIG. 2 is a block diagram showing the configuration of such an information terminal device.

FIG. 9 shows a seventh embodiment of a sound image localization apparatus according to the present invention, and a conference apparatus, a mobile phone, a sound reproduction apparatus, a sound recording apparatus, an information terminal apparatus, a game machine, a communication and broadcasting system using the sound image localization apparatus. The block diagram showing the configuration of such a game machine

FIG. 10 illustrates an eighth embodiment of a sound image localization device according to the present invention, and a conference device, a mobile phone, a sound reproduction device, a sound recording device, an information terminal device, a game machine, a communication and broadcasting system using the sound image localization device. FIG. 1 is a block diagram showing the configuration of such a broadcasting system.

FIG. 11 is a diagram showing the principle of a conventional sound image localization device.

[Explanation of symbols]

100, 207, 305, 404, 501, 605 Sound image localization device 101 Sound image direction setting section (setting means) 403, 603 Signal detector (Signal detector) 502 Recording unit (recording means) 503, 602, 701, (recording media) 601 Receiver (Reception means) 606 keyboard (operation method) 705 controller

─────────────────────────────────────────────────── ─── Continuation of the front page (56) Reference JP-A-5-252597 (JP, A) JP-A-9-191500 (JP, A) JP-A-9-90963 (JP, A) JP-A-7- 21742 (JP, A) JP-A-6-233395 (JP, A) (58) Fields investigated (Int.Cl. ⁷ , DB name) H04S 1/00 H04R 5/033 H04S 7/00 A63F 13/00

Claims (12)

(57) [Claims] In the sound image localization apparatus that performs sound image localization according to claim 1 tone generator signal output to the stereo earphone, setting means for setting the direction of localizing the sound image of the sound source signal, the sound image set by said setting means localizing Head-related transfer function observed at the entrance of the ear canal corresponding to the moving direction
And the ear canal resulting from wearing the stereo earphones.
It is the change in the ear canal transfer function from the entrance to the eardrum position
A sound image localization device, comprising: sound image localization means for performing sound image localization of the sound source signal to be output to the stereo earphone based on separate information from correction information . 2. The correction information of the ear canal transfer function is a sound source.
To the pseudo-eardrum position, and from the sound source to the pseudo-head
The head-related transfer function to the ear canal entrance and the stereo head
From the stereo earphones when wearing the earphones,
The sound image localization apparatus according to claim 1, wherein the calculation is performed using a transfer function up to the film position . 3. When the sound image localization means localizes the sound image of the sound source signal, regardless of the direction in which the sound image is set by the setting means, the sound image localization means sets a preset value in any direction. The sound image localization apparatus according to claim 1, wherein a type of the correction information is used. 4. The sound image localization means performs the sound image localization by convolving the head-related transfer function and the correction information with the sound source signal. Sound image localization device. 5. A conference apparatus using a sound image localization device, comprising the sound image localization device according to claim 1, wherein the sound image localization device performs sound image localization of a received acoustic signal. . 6. A mobile phone using the sound image localization apparatus, comprising the sound image localization apparatus according to claim 1, wherein the sound image localization apparatus performs sound image localization of a received acoustic signal. . 7. The sound image localization apparatus according to claim 1, and a signal detection unit that detects at least an acoustic signal and a recording information signal recorded on a recording medium, the sound image localization apparatus comprising: A sound reproducing device using a sound image localization device, wherein sound image localization of the acoustic signal read from the recording medium is performed based on the recording information signal detected by the signal detection means. 8. The sound image localization apparatus according to claim 1, further comprising a recording unit that records on a recording medium having two channels, wherein the sound image localization apparatus outputs the sound of an input acoustic signal. A sound recording device using a sound image localization device, which performs sound image localization so that the sound medium can be recorded on the recording medium while maintaining the effect. 9. The sound image localization apparatus according to claim 1, a receiving means for receiving at least an acoustic signal and data including localization information of the acoustic signal, and at least an acoustic signal recorded on a recording medium. And a signal detection unit that detects localization information of the acoustic signal, the sound image localization apparatus, in the localization information of any one of the acoustic information received by the reception unit and the acoustic signal detected by the signal detection unit. An information terminal device using a sound image localization device, characterized in that the sound image localization of the acoustic signal is controlled based on the sound image localization device. 10. An information terminal device using a sound image localization device according to claim 9, further comprising operation means for operating the sound image localization device. 11. The sound image localization apparatus according to claim 1, comprising: a sound image localization device; signal detection means for detecting at least an acoustic signal and a recording information signal recorded on a recording medium; and a controller. A game machine using a sound image localization device, characterized in that the device performs sound image localization of the acoustic signal read from the recording medium based on the recording information signal detected by the signal detection means and the operation of the controller. . 12. The sound image localization apparatus according to claim 1, wherein the sound image localization apparatus performs sound image localization of an acoustic signal input by the sound image localization apparatus, and the sound image localization apparatus performs the sound image localization. A communication and broadcasting system using a sound image localization device, characterized in that the sound image-localized acoustic signal is transmitted in a predetermined signal format.