EP0744881A2 - Headphone reproducing apparatus - Google Patents
Headphone reproducing apparatus Download PDFInfo
- Publication number
- EP0744881A2 EP0744881A2 EP96303604A EP96303604A EP0744881A2 EP 0744881 A2 EP0744881 A2 EP 0744881A2 EP 96303604 A EP96303604 A EP 96303604A EP 96303604 A EP96303604 A EP 96303604A EP 0744881 A2 EP0744881 A2 EP 0744881A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- sound
- channel input
- signals
- listener
- changing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
- H04S7/304—For headphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
Definitions
- the sound transmitted from the speaker 40 to the listener 41 can be represented by two different transfer functions hl(n) (from the speaker 40 to a left ear 41L) and hr(n) (from the speaker 40 to a right ear 41R), respectively.
- these two transfer functions hl(n) and hr(n) are synthesized with input signals x(n) inputted through an input terminal 51. A sound image localized by the speaker 40 is thus reproduced through a headphone 52 in pseudo-speaker sound reproduction manner.
- the directional feeling (transfer characteristics) are not synthesized.
- the reflected sounds are added to the input signals as they are, without providing definite directional feeling for both the listener's left and right ears.
- the cross-talk signals formed on the basis of the reflected sounds are formed separately on the left and right sides on the basis of the same signals to which reflected sounds are added. In other words, a cross-talk signals is not formed for each of the reflected sounds, respectively.
- the first changing means may include a low-pass filter.
- the present invention further provides an apparatus for creating a virtual sound based on an input audio signal, a listener be feeling as if a sound came from a virtual sound source that imaginarily exists in a space apart from the listener, the apparatus comprising: delay means for delaying a first-channel input signal and a second-channel input signal, both being separated from the input audio signal, by predetermined delay times, changing frequency characteristics of the first- and second-channel input signals to predetermined frequency characteristics, and changing sound levels of the first- and second-channel input signals to predetermined sound levels; multi-stage delay means for delaying another signal separated from the input audio signal by a plurality of predetermined delay times to output multi-stage delayed signals; processing means for delaying a plurality of third-channel input signals and a plurality of fourth-channel input signals, the third- and fourth-channel input signals being separated from the multi-stage delayed signals, by a plurality of predetermined delay times, changing frequency characteristics of the third- and fourth-channel input signals to predetermined frequency characteristics, and changing sound levels of the third-
- Fig. 4 shows a first embodiment of a headphone reproducing apparatus according to the present invention.
- a headphone reproducing apparatus 10 has a direction filter 12 for transfer characteristic synthesizing.
- the direction filter 12 models acoustic components included in the transfer functions from a virtual sound source assumed to exist in a virtual space to the listener's left and right ears. And, the direction filter 12 synthesizes the directional feeling (transfer characteristics) with left- and right-channel signals divided from input signals applied through an input terminal 11.
- Time component (a difference in arrival time from the sound source to both the listener's ears)
- the headphone reproducing apparatus 10 includes delaying circuits for modeling the time component of the transfer characteristics, frequency characteristic changing circuits for modeling the frequency component, and sound pressure changing circuits for modeling the sound pressure component, on each side of the headphone.
- these circuits can be fabricated easily by use of a direction filter 12 having two delay circuits 13R and 13L, two low-pass filters (LPFs) 14R and 14L, and two multipliers 15R and 15L.
- LPFs low-pass filters
- multipliers 15R and 15L two multipliers
- IIR Infinite Impulse Response
- the delay circuit 13L, the LPF 14L and the multiplier 15L are connected in series for the left channel. Further, the delay circuit 13R, the LPF 14R, and the multiplier 15R are connected in series for the right channel.
- the transfer characteristics can be synthesized with the input signals by the direction filter 12 having the delay circuits 13L and 13R, the LPFs 14L and 14R, and the multipliers 15L and 15R. It is thus possible to synthesize the transfer characteristics (more approximate to the actual transfer functions) with the input signals in real time.
- the headphone reproducing apparatus according to the present invention can be constructed by use of small-scale hardware of simple construction elements, as compared the conventional apparatus for executing the convolution calculations of the impulse responses.
- a headphone reproducing apparatus 20 reproduces reflected sounds each having directional feeling from each virtual room wall to both the listener's ears, in addition to the direct sound having directional feeling from the virtual sound source to both the listener's ears.
- the other of the two divided signals is given to a delay circuit 22, and then outputted as multi-stage delayed signals (the delay times are t 1 to t N ).
- the multi-stage delayed signals are applied to direction filters 12(t 1 ) to 12(t N ) respectively, and then outputted as the reflected sounds each having directional feeling to both the left and right ears, respectively.
- each of the direction filters 12(t 0 ) to 12(t N ) corresponds to the direction filter 12 of Fig. 4. Further, each of the signal processing values (delay time, frequency characteristics, and sound volume level) of these direction filters is decided on the basis of each of the directions of the reflected sounds. Further, the direct sound and the reflected sound are added to each other by adders 24 1 to 24 N for each of the left and right channels, and then given to the left channel 16L and the right channel 16R of the headphone 16, respectively.
- the direction filter 12(t 0 ) synthesizes the transfer characteristics between the virtual sound source and the listener's left and right ears with the left- and right-channel signals obtained by dividing the input signals, respectively.
- the direction filters 12(t 1 ) to l2(t N ) synthesizes the respective transfer characteristics of the reflected sounds to the listener's left and right ears with the left- and right-channel signals each obtained by dividing each of the reflected sounds outputted by the delay circuit 22.
- the adder 24 1 adds the left- and right-channel signal outputs of the direction filter 12(t 0 ) to the left- and right-channel signal outputs of direction filter 12(t 1 ), respectively.
- the adder 24 2 adds the left- and right-channel signal outputs of the adder 24 1 to the left- and right-channel signal outputs of the direction filter 12(t 2 ), respectively.
- This addition goes on to the direction filter 12(t N ).
- the left- and right-channel signal outputs of the adder 24 N are given to the left channel 16L and the right channel 16R of the headphone 16, respectively.
- the directional feeling from a single virtual sound source to both the left and right ears can be synthesized, and additionally different directional feelings to both the left and right ears can be synthesized for each of the reflected sounds.
- the headphone reproducing apparatus as described above is constructed for each channel of the stereophonic input signals to execute the similar signal processing, respectively.
- both the direct sound and reflected sounds each having the directional feeling to both the listener's left and right ears can be synthesized for each channel, and the synthesized sound signals are transmitted to the headphone. It is thus possible to localize the two sound images outside the listener's head under excellent stereophonic feeling conditions.
- the sound image localization feeling implies the position of the virtual sound source, the room mode, or shape and size of a room where the virtual sound source is located, etc.
- the signal processing values to be changed are those of the direction filter 12t 0 to 12(t N ) and the delay circuit 22.
- the more the signal processing values (delay time, frequency characteristics, and sound volume level) are changed, the more the sound image localization feeling can be changed precisely.
- the less the number of the signal processing values are changed the more the apparatus construction can be simplified to that extent.
- the signal processing values are changed gradually, it is possible to obtain such an effect as if the sound image were moving.
- a headphone reproducing apparatus 30 has a head movement detector 31 and a controller 32.
- the head movement detector 31 detects the movement of the listener's head to which the headphone 16 is attached; that is, the head rotational direction, the head rotation angle, etc.
- the detected values are transmitted to the controller (e.g., CPU) 32. Further, the movement of the listener's head can be also calculated by the controller 32.
- the controller 32 changes the signal processing values of a delay circuit 22, and direction filter 12(t 0 ) to 12(t N ) in such a way that the sound image can be moved by the same movement rate in the direction opposite to the movement direction of the listener's head.
- the head movement detector 31 is provided as follows: Two ultrasonic sensors are disposed on both the left and right sides of the headphone 16, and a detection signal oscillator is disposed at a predetermined position away from the listener's head. The oscillator transmits detecting pulse signals to the two ultrasonic sensors at controlled timings. The oscillator further transmits a detecting pulse signal transmitting signal to the controller 32. Upon receiving the detecting pulse signals, the left and right ultrasonic sensors output detection time signals to the controller 32. Each detection time signal represents what time it is at which each sensor receives the detecting pulse signal.
- the controller 32 Upon receiving the detecting pulse signal transmitting signal from the oscillator and the detection time signals from the sensors, the controller 32 detects a time difference between the detecting pulse signal transmission and reception to detect two distances between the oscillator and the left and right sides of the headphone, respectively or a difference in distance between the oscillator and the left and right sides of the headphone. The controller then calculates the head rotation angle based on the detected distance or distance difference.
- the movement detector 31 it is also possible to use infrared sensors, gyroscope sensors, gravity sensors for detecting inclination angles relative to the vertical direction, etc.
- the controller 32 changes the signal processing values of the delay circuit 22, and the delay circuits, LFPs, and multipliers of the direction filters 12(t 0 ) to 12(t N ).
- the controller changes the signal processing values in accordance with the calculating expressions and the set values determined according to the rotational direction and the rotation angle both previously stored in a memory of the controller 32.
- the sound image thus can be moved by the same rotation angle of the head movement in the direction opposite to the head rotational direction on the basis of the calculated head rotation angle.
- Figs. 7A and 7B show the case where the listener's head is moved by an angle ⁇ in the horizontal direction.
- a virtual sound source is located at a point A relative to a listener 33 having the headphone 16.
- the localization point A of the virtual sound source is moved by the angle ⁇ from the point B in a direction opposite to the movement direction of the listener's head (i.e., the left horizontal direction from the point B).
- the localization point A of the virtual sound source is moved by the angle ⁇ from the point B in a direction opposite to the movement direction of the listener's head (i.e., the left horizontal direction from the point B).
- the position, direction and movement of the listener's body relative to the virtual sound source can be detected by use of position, direction and movement detectors.
- the sound image localization feeling can be changed according to the position, direction and movement of the listener, it is possible to obtain more realistic extra-head sound image localization feeling.
- three or more detecting signal oscillators are disposed within a space where the listener exists. Furthermore, when four or more oscillators are disposed on the mutually different planes, the three-dimensional position, direction and movement of the listener can be detected. In this case, two receivers are disposed on both the left and right side of the listener's head (or the headphone). And, the position, the direction and the movement of the listener's body relative to the virtual sound source can be detected by a processor.
- the processor calculates the respective receiver positions (i.e., the listener's position) on the basis of the positions (coordinates) of the detection signal oscillators, time at which each detection signal is transmitted by the corresponding detection signal oscillator, and time at which each detection signal is received by the corresponding receiver.
- the processor then obtains vectors among the receivers, vectors indicative of the listener's direction obtained by rotating the vectors among the receivers by 90 degrees, vectors from the listener (each midpoint between the respective receivers) to the virtual sound source.
- the processor obtains the angle between the listener and the virtual sound source on the basis of an inner product of the calculated vectors between the respective receivers or the direction vectors and the vector between the listener (each midpoint between the respective receivers) to the virtual sound source.
- the position, direction and movement of the listener relative to the virtual sound source can be all detected easily and accurately.
- the signal processing values of the delay circuit 22, the direction filters 12(t 0 ) to 12(t N ) can be changed by the controller 32 according to the detected position, direction and movement of the listener. It is therefor possible to change the sound image localization feeling more realistically according to the position, direction and movement of the listener relative to the virtual sound source.
- the transfer characteristics (directional feeling) from the virtual sound source to both the listener's left and right ears can be synthesized with the input signals. It is thus possible to achieve pseudo-speaker sound reproduction and further to localize the sound image outside the listener's head.
- the headphone reproducing apparatus can be so constructed that the reflected sounds synthesized with the transfer characteristics (directional feeling) are added to the input signals respectively. It is thus possible to achieve pseudo-speaker sound reproduction as if the sound were heard in a room having a reverberation effect and thereby to localize the sound image outside the listener's head more clearly.
- the transfer characteristics can be synthesized by use of the direction filter 12(t 0 ) (transfer characteristic synthesizing means) and the direction filters 12(t 1 ) to 12(t N ) (reflected sound transfer characteristic synthesizing means).
- Each direction filter has the delay circuits 13R and 13L, LFPs (frequency characteristic changing means) 14R and 14L, and multipliers (sound volume changing means) 15R and 15L, as shown in Fig. 4.
- the transfer characteristics thus can be synthesized more realistically in spite of small-scale hardware.
- the present invention can be provided with the detectors for detecting the position, direction and movement of the listener in order to, based on the detected values, change the processing values of the delay circuit 22, direction filters 12(t 0 ) to 12(t N ) as shown in Fig. 6.
- the detectors for detecting the position, direction and movement of the listener in order to, based on the detected values, change the processing values of the delay circuit 22, direction filters 12(t 0 ) to 12(t N ) as shown in Fig. 6.
- the extra-head virtual sound source localizing position can be kept unchanged even if the listener moves, it is possible to realize more realistic extra-head sound image localization feeling.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
Abstract
Description
- The present invention relates to a headphone reproducing apparatus, and more specifically to a headphone reproducing apparatus for localizing a sound image at a position away form a listener's head.
- A conventional headphone reproducing apparatus for processing sound signals to localize a sound image at a position away from a listener's head will be explained hereinbelow with reference to the attached drawings.
- Fig. 1 is a view showing transfer characteristics from a speaker to both the right and left ears of a listener, which can be obtained when sound signals are reproduced through a speaker. Further, Fig. 2 is a block diagram showing a conventional headphone reproducing apparatus, and Fig. 3 is a block diagram showing an FIR (Finite Impulse Response) type digital filter (a convolution calculator).
- As shown in Fig. 1, when sound reproduced through a
speaker 40 located at a position is heard by a listener, the sound transmitted from thespeaker 40 to thelistener 41 can be represented by two different transfer functions hl(n) (from thespeaker 40 to a left ear 41L) and hr(n) (from thespeaker 40 to a right ear 41R), respectively. Further, in the headphone reproducing apparatus as shown in Fig. 2, these two transfer functions hl(n) and hr(n) are synthesized with input signals x(n) inputted through aninput terminal 51. A sound image localized by thespeaker 40 is thus reproduced through aheadphone 52 in pseudo-speaker sound reproduction manner. - In the above-mentioned synthesis of the two transfer functions hl(n) and hr(n), impulse responses (i.e., the transfer functions) of both the left and right ears measured by use of a dummy head or by a listener are adopted, and the measured impulse responses are convolution-calculated with the input signals by use of a signal processing unit (e.g., digital signal processing unit).
- In more detail, the input signals inputted through an
input terminal 51 are divided into left channel signals and right channel signals. The divided signals are then applied to aleft convolution calculator 53L and aright convolution calculator 53R, separately for convolution calculations. Further, the signals outputted from the twoconvolution calculators left channel 52L and aright channel 52R of aheadphone 52, separately. -
- x(n): discrete signal series of input signals
- hl(n): impulse response from speaker to left ear
- hr(n): impulse response from speaker to right ear
- yl(n): headphone left-channel reproduced signal series
- yr(n): headphone right-channel reproduced signal series
- In order to execute the convolution calculations of the impulse responses (i.e., transfer functions), each of the two
calculators digital filter 60 as shown in Fig. 3. The multipoint FIRdigital filter 60 includes one-sample delay devices 61, multipliers 62 each for executing convolution of the impulse response (h(0) to h(N) denote a multiplication value), and adders 63 each for adding outputs of themultipliers 62. - The conventional headphone reproducing apparatus constructed as described above has the following drawbacks. When the impulse responses (transfer functions) are convolved with the input digital signals sampled at a sampling frequency 44100 Hz, for instance, it is necessary to repeat delays, multiplications and additions as many times as 44100 in order to convolve the impulse responses with the input signals for only one second.
- In addition, when reverberation characteristics are also required to be reproduced under consideration of reflected sounds in a room, since the time lengths of the transfer functions lengthens, the number of the FIR type
digital filters 60 must be further increased. - Thus, there exists a problem in that the scale of the hardware used for the digital signal processing unit is bulky, with the result that the realization of the pseudo-speaker sound reproduction by a headphone has been so far difficult.
- Further, Japanese Patent Laid Open No. 3(1991)-250899 discloses a headphone reproducing apparatus that enables extra-head sound image localization with simple construction. In this apparatus, reflected sounds having different delay times and different signal levels are formed on the basis of monaural input signals. Left and right cross-talk signals are then formed on the basis of signals obtained by adding the reflected sounds to the input signals. The reflected sounds and the formed cross-talk signals are both added to the input signals. And, the added signals are reproduced independently on the left and right sides of a headphone.
- In more detail, this conventional headphone reproducing apparatus has two reflected sound forming systems for right and left ears each having delay and multiplier. Two left and right signals are formed by adding two different reflected sounds (reflected sounds for the left ears and reflected sounds for the right ears) to the input signals, respectively. Further, the right cross-talk signals are formed on the basis of the left signals passed through a right filter, and the left cross-talk signals are formed on the basis of the right signals passed through a left filter, respectively. Further, the formed reflected sounds and the formed cross-talk signals are both added to the input signals, separately on the left and right sides. The two added signals thus can be reproduced independently on the left and right sides of a headphone.
- In addition, the Japanese Laid-open Patent discloses another headphone reproducing apparatus which has a single reflected sound forming system. In this case, the signals obtained by adding the reflected sounds to the input signals are divided into two signals by the single reflected sound forming system. In other words, the same reflected sounds are used for both the left and right ears. Further, the left and right cross-talk signals are formed on the basis of the signals obtained by adding the reflected sounds to the input signals through two different left and right filters. Further, the formed reflected sounds and the formed cross-talk signals are both added to the input signals, separately on the left and right sides. The two added signals thus can be reproduced independently on the left and right sides of a headphone.
- In other words, in the conventional headphone reproducing apparatus, in the case of the left ear, for instance, firstly, input signals are formed to which the left reflected sounds are added. The left cross-talk signals are then formed on the basis of the input signals to which the left reflected sounds are added. The input signals to which the left reflected sounds are added and the left cross-talk signals are added to monaural input signals before reproduction.
- In this conventional headphone apparatus construction as described above, however, since a plurality of the reflected sounds are formed by changing only the delay times and the signal levels of the input signals, the directional feeling (transfer characteristics) are not synthesized. In other words, the reflected sounds are added to the input signals as they are, without providing definite directional feeling for both the listener's left and right ears. In addition, the cross-talk signals formed on the basis of the reflected sounds are formed separately on the left and right sides on the basis of the same signals to which reflected sounds are added. In other words, a cross-talk signals is not formed for each of the reflected sounds, respectively.
- As a result, in the conventional headphone reproducing apparatus, although the sound can be somewhat spread out, each of the reflected sounds are not processed for each reflected sound. It is thus impossible to obtain a clear directional feeling to a sound source. In other words, there exists a problem in that a sound field different from an actual room is reproduced, with the result that a realistic extra-head sound image localization cannot be achieved.
- Further, a problem lies in the case where phase control is executed in such a way that the correlation between the left and right signals can be eliminated, in order to localize a sound image outside a listener's head. Since the sound image localization cannot be made definitely, there arises a problem in that the directional feeling of a sound source is also not clear.
- In addition, in the conventional headphone reproducing apparatus, whenever the listener moves his or her head, since the sound source localization position is also moved, the sound feeling is not natural. This results in the headphone sound reproduction lacking an actual feeling.
- With these problems in mind, therefore, it is the object of the present invention to provide a headphone reproducing apparatus which can localize a sound image outside a listener's head by synthesizing the directional feeling (transfer characteristics) of a sound source, in spite of small-scale hardware.
- To achieve the above-mentioned object, the present invention provides an apparatus for creating a virtual sound, a listener be feeling as if a sound came from a virtual sound source that imaginarily exists in a space apart from the listener, the apparatus comprising: delay means for delaying a first-channel input audio signal and a second-channel input audio signal by predetermined delay times; first changing means for changing frequency characteristics of the first- and second-channel input audio signals to predetermined frequency characteristics; second changing means for changing sound levels of the first- and second-channel input audio signals to predetermined sound levels, the delay means and the first and second means being connected in series to each other; and reproducing means for reproducing the first- and second-channel input signals processed by the delay means and the first and second means as the sound that comes from the virtual sound source.
- The first changing means may include a low-pass filter.
- The present invention further provides an apparatus for creating a virtual sound based on an input audio signal, a listener be feeling as if a sound came from a virtual sound source that imaginarily exists in a space apart from the listener, the apparatus comprising: delay means for delaying a first-channel input signal and a second-channel input signal, both being separated from the input audio signal, by predetermined delay times, changing frequency characteristics of the first- and second-channel input signals to predetermined frequency characteristics, and changing sound levels of the first- and second-channel input signals to predetermined sound levels; multi-stage delay means for delaying another signal separated from the input audio signal by a plurality of predetermined delay times to output multi-stage delayed signals; processing means for delaying a plurality of third-channel input signals and a plurality of fourth-channel input signals, the third- and fourth-channel input signals being separated from the multi-stage delayed signals, by a plurality of predetermined delay times, changing frequency characteristics of the third- and fourth-channel input signals to predetermined frequency characteristics, and changing sound levels of the third- and fourth-channel input signals to predetermined sound levels; adding means for adding the first-channel input signal and all the third-channel input signals to each other, and second-channel input signal and all the fourth-channel input signals to each other; and reproducing means for reproducing output signals of the fourth means as the sound that comes from the virtual sound source. The delay means and processing means may include a low-pass filter for changing the frequency characteristics.
- The apparatus may further include changing means for changing at least either of the delay times of the first means, the delay times of the second means, and the delay times, the frequency characteristics, and the sound levels of the third means.
- The apparatus may further include detecting means for detecting at least either of a position, a direction, and a movement of the listener. The changing means, in responsive to the detected position, direction or movement, changes at least either of the delay times of the first means, the delay times of the second means, and the delay times, the frequency characteristics, and the sound levels of the third means.
-
- Fig. 1 is transfer characteristics from a speaker to the left and right ears of a listener when sound signals are reproduced through the speaker;
- Fig. 2 is a block diagram showing a conventional headphone reproducing apparatus;
- Fig. 3 is a block diagram showing a general FIR type digital filter (convolution calculators);
- Fig. 4 is a block diagram showing a first embodiment of the headphone reproducing apparatus according to the present invention;
- Fig. 5 is a block diagram showing a second embodiment of the headphone reproducing apparatus according to the present invention;
- Fig. 6 is a block diagram showing a third embodiment of the headphone reproducing apparatus according to the present invention; and
- Figs. 7A and 7B are graphical representations showing the case where the listener moves his or her head through an angle θ in the horizontal direction.
- Preferred embodiments of the present invention will be described hereinbelow with reference to the attached drawings.
- Fig. 4 shows a first embodiment of a headphone reproducing apparatus according to the present invention. In Fig. 4, a
headphone reproducing apparatus 10 has adirection filter 12 for transfer characteristic synthesizing. Thedirection filter 12 models acoustic components included in the transfer functions from a virtual sound source assumed to exist in a virtual space to the listener's left and right ears. And, thedirection filter 12 synthesizes the directional feeling (transfer characteristics) with left- and right-channel signals divided from input signals applied through an input terminal 11. - The acoustic components such as time component, frequency component, and sound pressure component will be explained hereinbelow.
- The time component is an acoustic component of the transfer function, which is caused by a difference in sound arrival time between both the listener's ears, that is, caused by a difference in distance from the sound source to both the listener's ears. Therefore, an appropriate time delay is adopted according to the angle and distance of a virtual sound source relative to the listener. The adopted time component is synthesized with the input signals. For instance, with respect to both the listener's ears, the transfer characteristics from a virtual source to the remote ear are delayed by an appropriate time, as compared with the transfer characteristics from the same virtual source to the near ear.
- The frequency component is an acoustic component of the transfer function, which is caused by positional relationship among the sound source, the listener's head and ears. In general, there exists such a tendency that the high frequency band of sound is attenuated more at the ear remote from the sound source, as compared with the ear near to the sound source. Because the sound reaches the remote ear after having traveled around the head. Therefore, the high frequency band characteristics of the transfer function are attenuated according to the angle and distance of the virtual sound source relative to the listener. And, the attenuated frequency components are synthesized with the input signals. For instance, with respect to the left and right ears, the high frequency characteristics of the transfer function from the virtual source to the remote ear are attenuated more, as compared with the high frequency characteristics thereof from the same virtual source to the near ear.
- The sound pressure component is an acoustic component of the transfer function, which is caused by a difference in sound volume level, that is, caused by a difference in distance between the sound source and the ears. Therefore, the level of the transfer characteristics is increased or decreased according to the angle and distance of the virtual sound source relative to the listener. And, the adjusted sound pressure component is synthesized with the input signals. For instance, with respect to the left and right ears, the sound volume level of the transfer characteristics from the virtual source to the remote ear is reduced by an appropriate value, as compared with the sound volume level of the transfer characteristics from the same virtual source to the near ear.
- By use of the above-mentioned three acoustic components, the transfer characteristics from the virtual source to the left and right ears are synthesized with the input signals separately on the left and right sides of the headphone. Therefore, the
headphone reproducing apparatus 10 includes delaying circuits for modeling the time component of the transfer characteristics, frequency characteristic changing circuits for modeling the frequency component, and sound pressure changing circuits for modeling the sound pressure component, on each side of the headphone. - For instance, to fabricate these circuits by use of digital signal processing circuits, these circuits can be fabricated easily by use of a
direction filter 12 having twodelay circuits multipliers - In Fig. 4, single-channel input signals are applied to the
direction filter 12 through the input terminal 11, and then divided into left-channel signals and right-channel signals, respectively. Explanation of how the input signals are divided is omitted here. - In the
direction filter 12, thedelay circuit 13L, theLPF 14L and themultiplier 15L are connected in series for the left channel. Further, thedelay circuit 13R, theLPF 14R, and themultiplier 15R are connected in series for the right channel. - The left and right channel signals are delayed by the
delay circuits LPF multiplier left channel 16L and aright channel 16R of aheadphone 16, respectively. - In the circuit configuration, the order of the series-connected
delay circuit 13L, theLPF 14L, and themultiplier 15L, and also 13R, 14R, and 15R are not limited to only that as shown in Fig. 4 as long as the two series-connected circuities are separated in right and left channels. Further, the respective signal processing values (delay time, frequency characteristics, and sound volume level) are determined on the basis of the positional relationship between the virtual sound source and the listener, as already explained. Further, when IIR type digital filters are used as theLPFs - As described above, the signals can be reproduced through the
headphone 16 as sounds having directional feeling from the virtual sound source (located outside the listener's head) to the listener's left and right ears. - As a result, when the
headphone reproducing apparatus 10 according to the present invention is used, the listener can feel as if he or she could hear sound from a direction of a virtual sound source located outside the head. In other words, since a sound source (i.e., a sound image) can be located at a position away from the listener's head or since a pseudo-speaker sound reproduction can be achieved, the listener can enjoy the reproduced sound for many hours without being much fatigued. - Further, in the headphone reproducing apparatus according to the present invention, the transfer characteristics can be synthesized with the input signals by the
direction filter 12 having thedelay circuits LPFs multipliers - A second embodiment of the headphone reproducing apparatus according to the present invention will be described hereinbelow with reference to Fig. 5.
- In the actual perception of a sound image or a sound source, there exist some influences of the reflected sound and the reverberation within a room where the sound source is positioned, in addition to the influence by a difference in distance between the sound source and the two listener's ears. Further, it is also possible to recognize a sound source position by deciding the room size empirically on the basis of the room sound and the relative relationship between the room size and the room sound.
- In other words, the reflected sound in a room exerts a great influence upon the sound source recognition. Therefore, in the case of the extra-head sound image localization by a headphone, the reflected sound exerts a great influence upon the sound source recognition. Therefore, when some directional feeling is provided for the reflected sound, the sound source can be recognized more easily by the listener.
- Therefore, in the second embodiment, on assumption that a virtual sound source exists in a room having reverberation characteristics, a
headphone reproducing apparatus 20 reproduces reflected sounds each having directional feeling from each virtual room wall to both the listener's ears, in addition to the direct sound having directional feeling from the virtual sound source to both the listener's ears. - In Fig. 5, single-channel input signals applied through an
input terminal 21 are divided into two signals. One of the two divided signals is given to a direction filter 12(T0) of delay time T0 and then outputted as the direct sound having directional feeling to both the left and right ears in the same way as with the case of the first embodiment. - The other of the two divided signals is given to a
delay circuit 22, and then outputted as multi-stage delayed signals (the delay times are t1 to tN). The multi-stage delayed signals are applied to direction filters 12(t1) to 12(tN) respectively, and then outputted as the reflected sounds each having directional feeling to both the left and right ears, respectively. - Here, each of the direction filters 12(t0) to 12(tN) corresponds to the
direction filter 12 of Fig. 4. Further, each of the signal processing values (delay time, frequency characteristics, and sound volume level) of these direction filters is decided on the basis of each of the directions of the reflected sounds. Further, the direct sound and the reflected sound are added to each other byadders 241 to 24N for each of the left and right channels, and then given to theleft channel 16L and theright channel 16R of theheadphone 16, respectively. - Consequently, it is possible to reproduce the direct sound having directional feeling from the virtual sound source to both the left and right ears and the reflected sounds reflected from the room walls. In other words, a sound image can be located outside the listener's head (a sound image is not located inside the listener's head), with the result that the listener can hear the sound as if the sound were generated by a sound source positioned within a room having reverberation characteristics. Further, since the direction filters 12(t0) and 12(t1) to 12(tN) can be achieved by a simple element the same as the
direction filter 12 of Fig. 4, the apparatus can be constructed by use of small-scale hardware. - In comparison with the prior art headphone reproducing apparatus as disclosed in the afore-mentioned Patent Application No. 3(1991)-250899, the headphone reproducing apparatus of the second embodiment according to the present invention is provided with the following features:
- The direction filter 12(t0) synthesizes the transfer characteristics between the virtual sound source and the listener's left and right ears with the left- and right-channel signals obtained by dividing the input signals, respectively.
- On the other hand, the direction filters 12(t1) to l2(tN) synthesizes the respective transfer characteristics of the reflected sounds to the listener's left and right ears with the left- and right-channel signals each obtained by dividing each of the reflected sounds outputted by the
delay circuit 22. - The
adder 241 adds the left- and right-channel signal outputs of the direction filter 12(t0) to the left- and right-channel signal outputs of direction filter 12(t1), respectively. Next, theadder 242 adds the left- and right-channel signal outputs of theadder 241 to the left- and right-channel signal outputs of the direction filter 12(t2), respectively. This addition goes on to the direction filter 12(tN). And, the left- and right-channel signal outputs of theadder 24N are given to theleft channel 16L and theright channel 16R of theheadphone 16, respectively. - In other words, the directional feeling from a single virtual sound source to both the left and right ears can be synthesized, and additionally different directional feelings to both the left and right ears can be synthesized for each of the reflected sounds. As a result, it is possible to obtain a clear directional feeling of a virtual sound source and in addition to obtain a realistic extra-head sound image localization feeling as if the listener were hearing sound within a spacial sound field such as an actual room.
- Further, in the case where the input signals (i.e., the sound source) are stereophonic signals, the headphone reproducing apparatus as described above is constructed for each channel of the stereophonic input signals to execute the similar signal processing, respectively. In this case, both the direct sound and reflected sounds each having the directional feeling to both the listener's left and right ears can be synthesized for each channel, and the synthesized sound signals are transmitted to the headphone. It is thus possible to localize the two sound images outside the listener's head under excellent stereophonic feeling conditions.
- Further, in the case of a plurality (e.g., three or more) of different channels of input signals, it is possible to localize sound image per channel of the input signals outside the listener's head with the above-mentioned headphone reproducing apparatus provided for each of the channels of the input signals.
- Further, it is also possible to add the original signals (not yet processed) to the processed signals and to transmit the added signals to the headphone. In this method, it is possible to change the sound image localization feeling according to the difference in signal volume level between the non-processed signals and the process signals.
- Further, it is also possible to change the sound image localization feeling freely by changing the respective signal processing values appropriately. The sound image localization feeling implies the position of the virtual sound source, the room mode, or shape and size of a room where the virtual sound source is located, etc. And, the signal processing values to be changed are those of the direction filter 12t0 to 12(tN) and the
delay circuit 22. - In this case, the more the signal processing values (delay time, frequency characteristics, and sound volume level) are changed, the more the sound image localization feeling can be changed precisely. On the other hand, the less the number of the signal processing values are changed, the more the apparatus construction can be simplified to that extent. In addition, when the signal processing values are changed gradually, it is possible to obtain such an effect as if the sound image were moving.
- A third embodiment of the present invention will be described hereinbelow with reference to Fig. 6, in which the same reference numerals have been retained for similar elements having the similar functions as with the case of the
headphone reproducing apparatus 20 shown in Fig. 5. - A headphone reproducing apparatus 30 has a
head movement detector 31 and acontroller 32. Thehead movement detector 31 detects the movement of the listener's head to which theheadphone 16 is attached; that is, the head rotational direction, the head rotation angle, etc. The detected values are transmitted to the controller (e.g., CPU) 32. Further, the movement of the listener's head can be also calculated by thecontroller 32. - On the basis of the movement of the listener's head, the
controller 32 changes the signal processing values of adelay circuit 22, and direction filter 12(t0) to 12(tN) in such a way that the sound image can be moved by the same movement rate in the direction opposite to the movement direction of the listener's head. - The
head movement detector 31 is provided as follows: Two ultrasonic sensors are disposed on both the left and right sides of theheadphone 16, and a detection signal oscillator is disposed at a predetermined position away from the listener's head. The oscillator transmits detecting pulse signals to the two ultrasonic sensors at controlled timings. The oscillator further transmits a detecting pulse signal transmitting signal to thecontroller 32. Upon receiving the detecting pulse signals, the left and right ultrasonic sensors output detection time signals to thecontroller 32. Each detection time signal represents what time it is at which each sensor receives the detecting pulse signal. Upon receiving the detecting pulse signal transmitting signal from the oscillator and the detection time signals from the sensors, thecontroller 32 detects a time difference between the detecting pulse signal transmission and reception to detect two distances between the oscillator and the left and right sides of the headphone, respectively or a difference in distance between the oscillator and the left and right sides of the headphone. The controller then calculates the head rotation angle based on the detected distance or distance difference. - Further, it is possible to detect the three-dimensional movements and directions of the listener's head by disposing an additional sensor at another position (e.g., the top) of the
headphone 16. Further, as themovement detector 31, it is also possible to use infrared sensors, gyroscope sensors, gravity sensors for detecting inclination angles relative to the vertical direction, etc. - The
controller 32, on the basis of the calculated head rotation angle, changes the signal processing values of thedelay circuit 22, and the delay circuits, LFPs, and multipliers of the direction filters 12(t0) to 12(tN). In detail, the controller changes the signal processing values in accordance with the calculating expressions and the set values determined according to the rotational direction and the rotation angle both previously stored in a memory of thecontroller 32. The sound image thus can be moved by the same rotation angle of the head movement in the direction opposite to the head rotational direction on the basis of the calculated head rotation angle. - Figs. 7A and 7B show the case where the listener's head is moved by an angle θ in the horizontal direction. In Fig. 7A, a virtual sound source is located at a point A relative to a
listener 33 having theheadphone 16. - Here, when the listener's head is moved by the angle θ in the horizontal direction as shown by Fig. 7B, in the case of the conventional apparatus, the localization point A of the virtual sound source is moved to a point B according to the head movement.
- In the case of the apparatus 30 according to the present invention, however, the localization point A of the virtual sound source is moved by the angle θ from the point B in a direction opposite to the movement direction of the listener's head (i.e., the left horizontal direction from the point B). As a result, it is possible to keep the localization point A of the virtual sound source unchanged at the point A.
- In other words, even if the
listener 33 moves his or her head, the extra-head localization position of the virtual sound source is kept unchanged and thereby the realistic sound image localization feeling can be realized. It is thus possible to obtain a more realistic extra-head sound image localization feeling. - Further, in addition to the listener's head movement, the position, direction and movement of the listener's body relative to the virtual sound source can be detected by use of position, direction and movement detectors. In this case, since the sound image localization feeling can be changed according to the position, direction and movement of the listener, it is possible to obtain more realistic extra-head sound image localization feeling.
- As the position, direction and movement detectors, three or more detecting signal oscillators are disposed within a space where the listener exists. Furthermore, when four or more oscillators are disposed on the mutually different planes, the three-dimensional position, direction and movement of the listener can be detected. In this case, two receivers are disposed on both the left and right side of the listener's head (or the headphone). And, the position, the direction and the movement of the listener's body relative to the virtual sound source can be detected by a processor.
- The processor calculates the respective receiver positions (i.e., the listener's position) on the basis of the positions (coordinates) of the detection signal oscillators, time at which each detection signal is transmitted by the corresponding detection signal oscillator, and time at which each detection signal is received by the corresponding receiver. The processor then obtains vectors among the receivers, vectors indicative of the listener's direction obtained by rotating the vectors among the receivers by 90 degrees, vectors from the listener (each midpoint between the respective receivers) to the virtual sound source. And, the processor obtains the angle between the listener and the virtual sound source on the basis of an inner product of the calculated vectors between the respective receivers or the direction vectors and the vector between the listener (each midpoint between the respective receivers) to the virtual sound source.
- When the above-mentioned position, direction and movement detectors are used, the position, direction and movement of the listener relative to the virtual sound source can be all detected easily and accurately. Thus, the signal processing values of the
delay circuit 22, the direction filters 12(t0) to 12(tN) can be changed by thecontroller 32 according to the detected position, direction and movement of the listener. It is therefor possible to change the sound image localization feeling more realistically according to the position, direction and movement of the listener relative to the virtual sound source. - As described above, in the headphone reproducing apparatus according to the present invention, the transfer characteristics (directional feeling) from the virtual sound source to both the listener's left and right ears can be synthesized with the input signals. It is thus possible to achieve pseudo-speaker sound reproduction and further to localize the sound image outside the listener's head.
- Further, the headphone reproducing apparatus according to the present invention can be so constructed that the reflected sounds synthesized with the transfer characteristics (directional feeling) are added to the input signals respectively. It is thus possible to achieve pseudo-speaker sound reproduction as if the sound were heard in a room having a reverberation effect and thereby to localize the sound image outside the listener's head more clearly.
- Further, according to the present invention as shown in Fig. 6, the transfer characteristics can be synthesized by use of the direction filter 12(t0) (transfer characteristic synthesizing means) and the direction filters 12(t1) to 12(tN) (reflected sound transfer characteristic synthesizing means). Each direction filter has the
delay circuits - Further, when the signal processing values are changed in the
delay circuit 22, direction filters 12(t0) to 12(tN) as shown in Fig. 6, various sound filed can be achieved in spite of the simple apparatus construction. In addition, it is also possible to obtain such an effect as if the sound image is moving. - Further, the present invention can be provided with the detectors for detecting the position, direction and movement of the listener in order to, based on the detected values, change the processing values of the
delay circuit 22, direction filters 12(t0) to 12(tN) as shown in Fig. 6. In this case, since the extra-head virtual sound source localizing position can be kept unchanged even if the listener moves, it is possible to realize more realistic extra-head sound image localization feeling.
Claims (6)
- An apparatus for creating a virtual sound, a listener be feeling as if a sound came from a virtual sound source that imaginarily exists in a space apart from the listener, the apparatus comprising:delay means for delaying a first-channel input audio signal and a second-channel input audio signal by predetermined delay times;first changing means for changing frequency characteristics of the first- and second-channel input audio signals to predetermined frequency characteristics;second changing means for changing sound levels of the first- and second-channel input audio signals to predetermined sound levels, the delay means and the first and second means being connected in series to each other; andreproducing means for reproducing the first- and second-channel input signals processed by the delay means and the first and second means as the sound that comes from the virtual sound source.
- The apparatus according to claim 1, wherein the first changing means includes a low-pass filter.
- An apparatus for creating a virtual sound based on an input audio signal, a listener be feeling as if a sound came from a virtual sound source that imaginarily exists in a space apart from the listener, the apparatus comprising:delay means for delaying a first-channel input signal and a second-channel input signal, both being separated from the input audio signal, by predetermined delay times, changing frequency characteristics of the first- and second-channel input signals to predetermined frequency characteristics, and changing sound levels of the first-and second-channel input signals to predetermined sound levels;multi-stage delay means for delaying another signal separated from the input audio signal by a plurality of predetermined delay times to output multi-stage delayed signals;processing means for delaying a plurality of third-channel input signals and a plurality of fourth-channel input signals, the third- and fourth-channel input signals being separated from the multi-stage delayed signals, by a plurality of predetermined delay times, changing frequency characteristics of the third- and fourth-channel input signals to predetermined frequency characteristics, and changing sound levels of the third- and fourth-channel input signals to predetermined sound levels;adding means for adding the first-channel input signal and all the third-channel input signals to each other, and second-channel input signal and all the fourth-channel input signals to each other; andreproducing means for reproducing output signals of the fourth means as the sound that comes from the virtual sound source.
- The apparatus according to claim 3, wherein the delay means and processing means include a low-pass filter for changing the frequency characteristics.
- The apparatus according to claim 3, further comprising changing means for changing at least either of the delay times of the first means, the delay times of the second means, and the delay times, the frequency characteristics, and the sound levels of the third means.
- The apparatus according to claim 5, further comprising detecting means for detecting at least either of a position, a direction, and a movement of the listener, the changing means, responsive to the detected position, direction or movement, changing at least either of the delay times of the first means, the delay times of the second means, and the delay times, the frequency characteristics, and the sound levels of the third means.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP148323/95 | 1995-05-22 | ||
JP14832395 | 1995-05-22 | ||
JP7148323A JP2900985B2 (en) | 1994-05-31 | 1995-05-22 | Headphone playback device |
Publications (3)
Publication Number | Publication Date |
---|---|
EP0744881A2 true EP0744881A2 (en) | 1996-11-27 |
EP0744881A3 EP0744881A3 (en) | 1999-06-09 |
EP0744881B1 EP0744881B1 (en) | 2004-07-14 |
Family
ID=15450221
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP96303604A Expired - Lifetime EP0744881B1 (en) | 1995-05-22 | 1996-05-21 | Headphone reproducing apparatus |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP0744881B1 (en) |
CN (1) | CN1108083C (en) |
DE (1) | DE69632889T2 (en) |
MY (1) | MY124476A (en) |
SG (1) | SG89238A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1054574A1 (en) * | 1998-01-08 | 2000-11-22 | Sanyo Electric Co., Ltd. | Sound image localizing device |
US8023659B2 (en) | 2005-06-21 | 2011-09-20 | Japan Science And Technology Agency | Mixing system, method and program |
WO2013076534A1 (en) * | 2011-11-21 | 2013-05-30 | Sony Ericsson Mobile Communications Ab | Determining direction of a display associated with an earphone set |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI498014B (en) * | 2012-07-11 | 2015-08-21 | Univ Nat Cheng Kung | Method for generating optimal sound field using speakers |
CN106714017B (en) * | 2015-07-17 | 2019-08-23 | 中兴通讯股份有限公司 | A kind of method, apparatus, terminal and earphone adjusting earphone sound field |
CN105307086A (en) * | 2015-11-18 | 2016-02-03 | 王宋伟 | Method and system for simulating surround sound for two-channel headset |
CN105578355B (en) | 2015-12-23 | 2019-02-26 | 惠州Tcl移动通信有限公司 | A kind of method and system enhancing virtual reality glasses audio |
CN110740415B (en) * | 2018-07-20 | 2022-04-26 | 宏碁股份有限公司 | Sound effect output device, arithmetic device and sound effect control method thereof |
CN109640226A (en) * | 2018-11-10 | 2019-04-16 | 东莞市华睿电子科技有限公司 | A kind of earpiece audio is converted into the control method of Virtual Sound |
CN112437385A (en) * | 2020-11-19 | 2021-03-02 | 袁志钢 | Earphone set |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2296340A1 (en) * | 1974-12-25 | 1976-07-23 | Matsushita Electric Ind Co Ltd | HEADPHONE LISTENING SYSTEM |
JPS58198999A (en) * | 1982-05-17 | 1983-11-19 | Matsushita Electric Ind Co Ltd | Sound image controller |
GB2220818A (en) * | 1988-07-15 | 1990-01-17 | Gary Keith Henry | Stereo systems |
JPH02219400A (en) * | 1989-02-20 | 1990-08-31 | Sanyo Electric Co Ltd | Stereophonic sound reproducing device |
EP0464217A1 (en) * | 1990-01-19 | 1992-01-08 | Sony Corporation | Apparatus for reproducing acoustic signals |
JPH0682242A (en) * | 1992-08-31 | 1994-03-22 | Victor Co Of Japan Ltd | Three-dimensional position/attitude detection method |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB8900330D0 (en) * | 1989-01-07 | 1990-04-25 | British Aerospace | Binaural display apparatus |
WO1993026085A1 (en) * | 1992-06-05 | 1993-12-23 | Noise Cancellation Technologies | Active/passive headset with speech filter |
-
1996
- 1996-05-21 EP EP96303604A patent/EP0744881B1/en not_active Expired - Lifetime
- 1996-05-21 DE DE69632889T patent/DE69632889T2/en not_active Expired - Fee Related
- 1996-05-22 MY MYPI96001922A patent/MY124476A/en unknown
- 1996-05-22 SG SG9609852A patent/SG89238A1/en unknown
- 1996-05-22 CN CN96108997.0A patent/CN1108083C/en not_active Expired - Lifetime
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2296340A1 (en) * | 1974-12-25 | 1976-07-23 | Matsushita Electric Ind Co Ltd | HEADPHONE LISTENING SYSTEM |
JPS58198999A (en) * | 1982-05-17 | 1983-11-19 | Matsushita Electric Ind Co Ltd | Sound image controller |
GB2220818A (en) * | 1988-07-15 | 1990-01-17 | Gary Keith Henry | Stereo systems |
JPH02219400A (en) * | 1989-02-20 | 1990-08-31 | Sanyo Electric Co Ltd | Stereophonic sound reproducing device |
EP0464217A1 (en) * | 1990-01-19 | 1992-01-08 | Sony Corporation | Apparatus for reproducing acoustic signals |
JPH0682242A (en) * | 1992-08-31 | 1994-03-22 | Victor Co Of Japan Ltd | Three-dimensional position/attitude detection method |
Non-Patent Citations (3)
Title |
---|
PATENT ABSTRACTS OF JAPAN vol. 14, no. 520 (E-1002), 14 November 1990 & JP 02 219400 A (SANYO), 31 August 1990 * |
PATENT ABSTRACTS OF JAPAN vol. 18, no. 333 (P-1759), 23 June 1994 & JP 06 082242 A (VICTOR CO. OF JAPAN), 22 March 1994 * |
PATENT ABSTRACTS OF JAPAN vol. 8, no. 44 (E-229), 25 February 1984 & JP 58 198999 A (MATSUSHITA), 19 November 1983 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1054574A1 (en) * | 1998-01-08 | 2000-11-22 | Sanyo Electric Co., Ltd. | Sound image localizing device |
EP1054574A4 (en) * | 1998-01-08 | 2006-04-05 | Sanyo Electric Co | Sound image localizing device |
US8023659B2 (en) | 2005-06-21 | 2011-09-20 | Japan Science And Technology Agency | Mixing system, method and program |
WO2013076534A1 (en) * | 2011-11-21 | 2013-05-30 | Sony Ericsson Mobile Communications Ab | Determining direction of a display associated with an earphone set |
Also Published As
Publication number | Publication date |
---|---|
SG89238A1 (en) | 2002-06-18 |
DE69632889T2 (en) | 2005-07-21 |
MY124476A (en) | 2006-06-30 |
CN1108083C (en) | 2003-05-07 |
DE69632889D1 (en) | 2004-08-19 |
EP0744881A3 (en) | 1999-06-09 |
CN1140968A (en) | 1997-01-22 |
EP0744881B1 (en) | 2004-07-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP0788723B1 (en) | Method and apparatus for efficient presentation of high-quality three-dimensional audio | |
US6021205A (en) | Headphone device | |
JP2964514B2 (en) | Sound signal reproduction device | |
US6021206A (en) | Methods and apparatus for processing spatialised audio | |
JP3258195B2 (en) | Sound image localization control device | |
US5440639A (en) | Sound localization control apparatus | |
EP0938832B1 (en) | Method and device for projecting sound sources onto loudspeakers | |
WO2017064368A1 (en) | Distributed audio capture and mixing | |
EP0744881B1 (en) | Headphone reproducing apparatus | |
JPH08107600A (en) | Sound image localization device | |
WO2000045619A1 (en) | Virtual sound source device and acoustic device comprising the same | |
JPH0946800A (en) | Sound image controller | |
JP2900985B2 (en) | Headphone playback device | |
JP2910891B2 (en) | Sound signal processing device | |
JP3573797B2 (en) | Stereo audio playback device | |
JPH08297157A (en) | Position, direction, and movement detecting device and headphone reproducing device using it | |
JP2947456B2 (en) | Surround signal processing device and video / audio reproduction device | |
JP2751512B2 (en) | Sound signal reproduction device | |
WO2023106070A1 (en) | Acoustic processing apparatus, acoustic processing method, and program | |
JP3596202B2 (en) | Sound image localization device | |
US20240323636A1 (en) | Sound processing device, sound processing method, and recording medium | |
EP4325888A1 (en) | Information processing method, program, and information processing system | |
JPH10126898A (en) | Device and method for localizing sound image | |
JPH07203597A (en) | Headphone reproducing device | |
JP2893779B2 (en) | Headphone equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): DE FR GB |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): DE FR GB |
|
17P | Request for examination filed |
Effective date: 19991005 |
|
17Q | First examination report despatched |
Effective date: 20021010 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE FR GB |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REF | Corresponds to: |
Ref document number: 69632889 Country of ref document: DE Date of ref document: 20040819 Kind code of ref document: P |
|
ET | Fr: translation filed | ||
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20050415 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20090515 Year of fee payment: 14 Ref country code: DE Payment date: 20090514 Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20090520 Year of fee payment: 14 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20100521 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20110131 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20101201 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100531 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100521 |