EP2874412A1 - A signal processing circuit - Google Patents
A signal processing circuit Download PDFInfo
- Publication number
- EP2874412A1 EP2874412A1 EP20130193367 EP13193367A EP2874412A1 EP 2874412 A1 EP2874412 A1 EP 2874412A1 EP 20130193367 EP20130193367 EP 20130193367 EP 13193367 A EP13193367 A EP 13193367A EP 2874412 A1 EP2874412 A1 EP 2874412A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- distance
- received
- microphone
- acoustic transmitter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
- H04S7/304—For headphones
Definitions
- This disclosure relates to a signal processing circuit, in particular a signal processing circuit that can perform head tracking in order to provide output audio signalling representative of a sound field.
- a signal processing circuit comprising:
- the signal processing circuit can advantageously use the left acoustic transmitter and the right acoustic transmitter to perform head-tracking using the ultrasound signals, such that additional head-tracking components and sensors may not be required.
- the sound engine may be configured to:
- the signal processing circuit may further comprise an offset calculator configured to determine an offset value for the position signalling in accordance with the determined left distance and the determined right distance.
- the sound engine may be configured to add the offset value to the received position input signalling in order to provide offset position input signalling; and determine the output audio signalling in accordance with the audio input signalling and the offset position input signalling.
- the offset calculator may be an angle calculator that is configured to calculate an azimuth angle offset value.
- the output signalling may comprise a left audio signal for the left acoustic transmitter and a right audio signal for the right acoustic transmitter.
- the left acoustic transmitter and the right acoustic transmitter can be used for both head tracking and providing audio signals to a user.
- the left reference signal and the left received signal may be representative of a first continuous signal containing a first set of ultrasound frequency components.
- the right reference signal and the right received signal may be representative of a second continuous signal containing a second set of ultrasound frequency components.
- the first set of ultrasound components may be at different frequencies to the second set of frequency components.
- the distance calculator may be configured to:
- the left reference signal and the left received signal may comprise a first series of time multiplexed ultrasound pulses.
- the right reference signal and the right received signal may comprise a second series of time multiplexed ultrasound pulses.
- the distance calculator may be configured to determine the left distance by calculating a time-of-flight of the first series of time multiplexed ultrasound pulses between the left acoustic transmitter and the first microphone; and determine the right distance by calculating a time-of-flight of the second series of time multiplexed ultrasound pulses between the right acoustic transmitter and the first microphone.
- the distance calculator may be further configured to:
- the distance calculator may be configured to:
- the distance calculator may be configured to: apply an averaging method or triangulation method to the left received signal and the second left received signal in order to determine the left distance; and apply an averaging method or triangulation method to the right received signal and the second right received signal in order to determine the right distance.
- the left and right acoustic transmitters may comprise a pair of headphones or earphones.
- the first microphone may comprise a microphone assembly comprising one or more individual microphones.
- the second microphone may comprises a microphone assembly comprising one or more individual microphones.
- a surround sound system comprising:
- a method of signal processing comprising:
- a mobile computing device comprising any signal processing circuit disclosed herein.
- the computer program may be a software implementation, and the computer may be considered as any appropriate hardware, including a digital signal processor, a microcontroller, and an implementation in read only memory (ROM), erasable programmable read only memory (EPROM) or electronically erasable programmable read only memory (EEPROM), as non-limiting examples.
- the software may be an assembly program.
- the computer program may be provided on a computer readable medium, which may be a physical computer readable medium such as a disc or a memory device, or may be embodied as a transient signal.
- a transient signal may be a network download, including an internet download.
- One or more examples disclosed herein can enable the simultaneous playback of audio signals and ultrasound signals for head tracking or head localization, for example from speakers / transmitters associated with headphones. This can enable the modification of a sound field that is represented by the audio signals to accommodate the movements of a user's head. In this way, additional head tracking or head localization sensors may not be required as one or more speakers can be used to both provide the audio signals to the user and provide signalling for head tracking or head localization.
- Figure 1 illustrates the layout of a surround sound television 100 and associated loudspeakers 104 - 114.
- a user 102 is illustrated with his head directed towards the television 100.
- a sound field may be created by driving a plurality of physically separated loudspeakers that are remote from the user 102; for example there may be a left speaker 104, a central speaker 106, a right speaker 108, a left surround speaker 110, a central surround speaker 112 and a right surround speaker 114 distributed around the user 102 as shown in figure 1 .
- the sound field generated by the plurality of speakers may provide the user 102 with the perception that different components of an audio signal originate from different locations relative to the user 102.
- the different components could, for example, correspond to different musical instruments or different sound effects.
- other arrangements of a larger or smaller number of loudspeakers are possible and may comprise a surround sound system.
- other types of surround sound devices exist, for example, Hi-Fi systems, mobile telephones, personal computers and many other devices.
- the television 100 may also provide sound to the user via a pair of headphones 116.
- the headphones 116 may be configured to give the user 102 the same impression as a plurality of separately located loudspeakers by means of appropriate processing of the audio signals supplied to the left and right channels of the headphones 116.
- the processing of left and right audio signals is intended to ensure that the sound waves supplied to the user's 102 eardrums are essentially the same as those that would be provided by the plurality of remote speakers 104 - 114 shown in figure 1 .
- This provides the user 102 with the perception that a virtual array of loudspeakers exists.
- references herein to headphones may equivalently be to earphones or other suitable acoustic devices.
- Figure 2 shows how the surround sound field changes when a user 202 is listening to a pair of headphones 216 and turns his head away from a surround sound television 200.
- Figure 2 illustrates the configuration of six virtual loudspeakers 204 - 214. It will be appreciated that these virtual loudspeakers 104 - 144 do not exist, but are representative of the locations, relative to the user 202, of an array of loudspeakers capable of providing a surround sound field to the user 202, via the headphones 216, that corresponds to the surround sound field provided by the array of loudspeakers shown in figure 1 .
- the surround sound field corresponding to the virtual array of loudspeakers 204 - 214 appears to rotate with the user 202.
- This apparent rotation of the sound field can be undesirable because the spatial characteristics of the sound field are usually fixed relative to the position of the television 200.
- the sound field may simulate sounds coming from different locations depicted by the television screen.
- Figure 3 shows a surround sound television 300 that has a head-tracking capability.
- the system tracks the orientation of the user's head 302 in real time.
- Left and right audio signals supplied to headphones 316 are adapted to account for the movement of the user's head 302. In this way, it is possible to provide the user 302 with the impression that a virtual array of loudspeakers 304 - 314, and correspondingly a surround sound field, have not moved relative to the television 300 when he turns his head.
- FIG. 4 illustrates a system for tracking a user's 402 head orientation relative to a mobile telephone 400.
- the telephone 400 comprises a microphone 408, and in this example also a display screen 414.
- the system also comprises a left headphone 404 and a right headphone 406, both of which are moveable relative to the telephone 400.
- the telephone 400 provides a left audio signal to the left headphone 404 and a right audio signal to the right headphone 406.
- the telephone 400 also provides a left ultrasound signal to the left headphone 404 and a right ultrasound signal to the right headphone 406.
- the ultrasound signals will be used for head-tracking.
- the audio signals may comprise components with frequencies in the range of 20 Hz to 20,000 Hz,for example.
- Ultrasound signals may comprise components with frequencies greater than 20,000 Hz, or greater than 30,000 Hz, 40,000 Hz, 50,000 Hz or more.
- the microphone 408 is configured to detect the ultrasound signals transmitted by the left headphone 404 and the right headphone 406.
- a processor (not shown) associated with the microphone 408 can process the detected ultrasound signals in order to determine how the left headphone 404 and right headphone 406 have been moved relative to the microphone 408.
- the telephone 400 can calculate left distance data 410 representative of the distance between the left headphone 404 and the microphone 408 and can calculate right distance data 412 representative of the distance between the right headphone 406 and the microphone 408. This is described in more detail below with reference to figure 6 .
- the telephone 400 can perform a geometric analysis to determine the orientation of the user's 402 head relative to the telephone 400.
- the signals provided to the left headphone 404 and the right headphone 406 can be adapted accordingly to maintain a consistent configuration of the surround sound field relative to the telephone 400. This may be particularly valuable in cases where the telephone 400 comprises a display screen 414, such that the apparent points of origin of sounds can be maintained in the appropriate positions relative to events depicted by the display screen 414.
- the head-tracking system illustrated in figure 4 may be implemented in a surround sound device that does not comprise any display screen.
- maintaining the configuration of the sound field relative to a Hi-Fi audio system may be desirable such that the apparent position of origin of sounds produced by different instruments in an orchestra remains consistent, despite the user changing the orientation of his head.
- the head-tracking system illustrated in figure 4 may also be implemented in a surround sound device in which the microphone is not co-located with the display screen.
- a surround sound television may have a screen in one location and a unit comprising the microphone in a physically separate location. Such examples may utilise a known location of the microphone relative to the screen to accurately compensate for movements of the user's head.
- one or more of the head-tracking systems disclosed herein use existing sensors and apparatus in order to perform head-tracking, thereby reducing cost, complexity and size and weight of the systems concerned.
- This can be preferable to head-tracking systems that instead use additional sensors and associated hardware that is not otherwise present in a surround sound device.
- a head-tracking system that uses gyroscopes, accelerometers or magnetic sensors to measure a user's head orientation.
- Figure 5 illustrates operation of the system of figure 4 .
- the user has rotated his head 502 through an angle ⁇ 520 relative to the mobile telephone 500.
- the consequence of this rotation is that the left distance 510 between the left headphone 504 and the microphone 508 has become smaller, whereas the right distance 512 between the right headphone 506 and the microphone 508 has become greater.
- the surround sound device can calculate the new orientation from the updated left distance 510 and right distance 512 and then adapt the signals supplied to the left headphone 504 and the right headphone 506 accordingly, as discussed below.
- the angle of rotation ⁇ 520 of the user's 502 head may be expressed.
- the angle of rotation may be the angle of intersection of a headphone axis / line 530 that connects the left headphone 504 to the right headphone 506 with a reference axis / line 532 that extends from a fixed reference point associated with the telephone 500 at a predetermined orientation.
- the fixed reference point may correspond to the location of the microphone 508 and the predetermined orientation may be perpendicular to a longitudinal axis of the telephone 500.
- the headphone line 530 and the reference line 532 shown in figure 5 will intersect at an angle of 90 degrees plus the angle ⁇ 520 through which the user 502 has rotated his head when his head is rotated clockwise.
- one or more of the circuits described below can use the determined left distance 510 and the determined right distance 512, along with a known value for the diameter of the user's head 502, to calculate both the absolute position of the user's head and the angle of the user's head. Therefore, one or more of the circuits disclosed herein can provide a user localization system as well as, or instead of, head tracking. Alternatively, if the diameter of the user's head is not known, then one or more of the circuits described in this document may assume that the user's head does not change position during use; therefore any change in the determined left distance 510 and the determined right distance 512 is attributed to a rotation of the user's head 502. It will be appreciated that references to head tracking in this document can also be intended to refer to head localization.
- Figure 6 illustrates a block diagram of a signal processing circuit 600 for use in head-tracking with a surround sound system.
- the signal processing circuit 600 comprises a sound engine 602 and a distance calculator 604.
- the sound engine 602 receives an audio input signal 606 and a position input signal 608.
- the audio input signal 606 is an example of audio input signalling.
- the position input signal 608 is an example of associated position input signalling.
- the position input signal 608 comprises information that describes an apparent position of origin, within a sound field, of different components of the audio input signal 606. The position of origin of a particular sound relative to a user is customarily described by an azimuthal angle and an elevation angle relative to the user.
- the distance calculator 604 is configured to receive a left reference signal 610 and a right reference signal 612.
- the reference signals may also be referred to as driver signals.
- the left reference signal 610 and the right reference signal 612 are representative of ultrasound signals supplied to a left headphone and a right headphone, respectively (not shown).
- the left headphone and right headphone are examples of a left acoustic transmitter and a right acoustic transmitter, respectively.
- the distance calculator 604 is further configured to receive a left received signal 614 and a right received signal 616.
- the left received signal 614 and right received signal 616 are representative of ultrasound signals transmitted by the left and right headphones respectively and received at a microphone (not shown), which is an example of a first microphone.
- the distance calculator 604 can calculate left distance data 618 which represents the distance between the left headphone and the microphone, from analysis of the left reference signal 610 and the left received signal 614. For example, if the left reference signal 610 and the left received signal 614 represent a first continuous ultrasound signal then it is possible to track the position of the peak of the cross-correlation of the left reference signal 610 with the left received signal 614. The position of the peak provides the time delay between the left reference signal 610 and the left received signal 614 from which the left distance data 618 can be determined using the speed of sound in air, which is of course known.
- the left reference signal 610 comprises a first, optionally discrete, series of time multiplexed ultrasound pulses then it is possible to determine the time of flight of the pulses because each pulse in the left received signal 614 can be identified as relating to a corresponding pulse within the left reference signal 610.
- the left distance data 618 can be computed from the time difference between the corresponding pulses and using the known speed of sound in air.
- the right distance data 620 which represents the distance between the right headphone and the microphone, from the right reference signal 612 and the right received signal 616. That is, the right reference signal 612 and the right received signal 616 may be representative of a second continuous ultrasound signal. Alternatively, the right reference signal 612 and the right received signal 616 may comprise a second series of time multiplexed ultrasound pulses.
- both the left reference signal 610 and the right reference signal 612 are continuous ultrasound signals then it may be necessary for the distance calculator 604 to discriminate between them.
- the left reference signal 610 may contain a first set of ultrasound frequency components and the right reference signal 612 may contain a second set of ultrasound frequency components, wherein the first set of ultrasound components are at different frequencies to the second set of frequency components.
- Each set of frequency components may comprises a single frequency.
- the sets of frequency components may comprise different non-overlapping ultrasound frequency ranges.
- both the left reference signal 610 and the right reference signal 612 comprise a series of discrete ultrasound pulses then different pulses may be distinguished either by using different frequencies or by using different time multiplexing for the left reference signal 610 compared with the right reference signal 612.
- the distance calculator 604 can then supply the calculated left distance data 618 and the calculated right distance data 620 to the sound engine 602.
- the sound engine 602 is configured to process the audio input signal 606, the position input signal 608, the received left distance data 618 and right distance data 620 to provide a left audio output signal 622 and a right audio output signal 624.
- the left audio output signal 622 and the right audio output signal 624 are provided to a left headphone and a right headphone respectively, the sound signal created will provide the user with a surround sound field that adapts according to the orientation of the user's head relative to the surround sound device. Therefore, the left audio output signal 622 and the right audio output signal 624 can be considered as examples of output audio signalling representative of a sound field, that are determined in accordance with the determined left distance and the determined right distance.
- one adaptation is to rotate the sound field about the azimuth by an offset corresponding to the angle of rotation of the user's head.
- the adaptation may take into account both the absolute position of the user's head and the angle of the user's head. For example, the head rotation angle can be taken relative to the angle between the device (microphone) and the listener. In this case, if the user moves to the left and rotates his head to the right to keep looking at the screen, then no compensation would be applied.
- the amplitude of part of, or all of, the sound field may be increased or decreased as the distance values represented by the left distance data 618 and the right distance data 620 decrease or increase in order to account for a user moving further away from or closer to the microphone. Modifications to the elevation of components of the sound field are also possible.
- Figure 7 illustrates a block diagram comprising a surround sound system that includes a signal processing circuit 700 for head-tracking, a pair of headphones comprising a left acoustic transmitter / headphone 740 and a right acoustic transmitter / headphone 746, a first microphone 750 and a second microphone 752.
- the signal processing circuit 700 comprises a 3D sound engine 702, a distance calculator 704 and an angle calculator 706.
- the angle calculator 706 is one example of an offset calculator.
- the 3D sound engine 702 receives audio input signals 708. In this case a pair of audio input signals 708 corresponding to a stereo signal is illustrated. It will be appreciated that the audio input signals 708 could alternatively comprise a monaural signal or any other known form of multichannel audio signal.
- the 3D sound engine 702 also receives sound position information 710 which comprises information relating to the azimuth and elevation of each component of the audio input 708. Of course, the audio input signals 708 and sound position information 710 could be received at a common input terminal.
- the distance calculator 704 receives a left reference signal 712, a right reference signal 714, a left received signal 716 and a right received signal 718.
- the distance calculator 704 is configured to calculate distance information 720 comprising left distance data and right distance data as described above in relation to figure 6 .
- the distance calculator then provides this distance information 720 to the angle calculator 706.
- the angle calculator 706 is configured to determine the orientation angle of a user's head as described in relation to figures 4 and 5 .
- the angle calculator 706 then provides the orientation angle 722 to the 3D sound engine 702, which can use the orientation angle 722 as an offset value.
- the offset value is an azimuth angle offset value.
- the 3D sound engine 702 is configured to provide a left audio output signal 724 and a right audio output signal 726 suitable for providing a surround sound field to a pair of headphones 740, 746, adapted in accordance with the user's head orientation angle 722.
- the 3D sound engine 702 can add the orientation angle 722 to the received sound position information 710 in order to provide offset position input signalling.
- the 3D sound engine 702 can then determine the right audio output signal 726 and the left audio output signal 724 in accordance with the audio input signals 708 and the offset position input signalling.
- the offset calculator may be an angle calculator that is configured to calculate an azimuth angle offset value.
- a left mixer 727 mixes the left audio output signal 724 with a left ultrasound signal 728 received from a left ultrasound signal generator 730 in order to provide a combined left audio and ultrasound signal 736.
- the left ultrasound signal generator 730 also provides the left reference signal 712, which is representative of the left ultrasound signal 728, to the distance calculator 704.
- a right mixer 725 mixes the right audio output signal 726 with a right ultrasound signal 732 received from a right ultrasound signal generator 734 in order to provide a combined right audio and ultrasound signal 742.
- the right ultrasound signal generator 734 also provides the right reference signal 714, which is representative of the right ultrasound signal 732, to the distance calculator 704.
- the combined left audio and ultrasound signal 736 is provided to a left amplifier 738 which provides an amplified signal to the left headphone 740.
- the combined right audio and ultrasound signal 742 is provided to a right amplifier 744 which provides an amplified signal to the right headphone 746.
- the ultrasound signals transmitted by the left headphone 740 and the right headphone 746 are detected by a microphone assembly 748.
- the microphone assembly 748 comprises at least the first microphone 750 and the second microphone 752.
- the first microphone 750 provides the left received signal 716 and the right received signal 718 to the distance calculator 704.
- the left received signal 716 and the right received signal 718 may be provided to the distance calculator 704 as a combined signal, as illustrated in figure 7 .
- the distance calculator 704 will then process the combined signal in order to determine the left received signal 716 and right received signal 718, for example by distinguishing different frequency components or different time multiplexing as described above in relation to figure 6 .
- the second microphone 752 provides a second left received signal 717 and a second received right received signal 719 to the distance calculator 704.
- the microphone assembly 748 may comprise a processor (not shown) configured to separate the left received signal 716 and the right received signal 718 from the signal received at the first microphone 750, such that the microphone assembly 748 may provide the left received signal 716 and the right received signal 718, separately, to the distance calculator 704.
- the processor may be configured to separate the second left received signal 717 and the second received signal 719 from the signal received at the second microphone 752.
- the distance calculator 704 can then determine the left distance in accordance with the left reference signal 712, the left received signal 716 and the second left received signal 717.
- the distance calculator 704 can also determine the right distance in accordance with the right reference signal 714, the right received signal 718 and the second right received signal 719.
- the microphone assembly 748 may comprise a single microphone or an array / plurality of microphones. Where a plurality of microphones is present, the microphone assembly 748 may provide a plurality of left received signals and a plurality of right received signals to the distance calculator 704, wherein each such signal is associated with a particular microphone. The distance calculator 704 may then use the plurality of left received signals and right received signals in conjunction with the left reference signal 712 and the right reference signal 714 to determine the left distance and the right distance. The use of a plurality of left received signals and right received signals may advantageously enable a more accurate determination of the left distance and the right distance to be made.
- the distance calculator 704 may apply averaging methods or triangulation methods to the received plurality of left received signals and the plurality of right received signals, in cases where the plurality of microphones are located at positions remote from one another.
- an array of microphones may provide the advantage of improving the signal to noise ratio of the left received signals and the right received signals.
- the first microphone 750 may itself comprise a microphone assembly comprising one or more individual microphones. Also, the second microphone 752 may itself comprise a microphone assembly comprising one or more individual microphones.
- Figure 8 shows a block diagram of a sound engine 800.
- the sound engine 800 receives an audio input signal 802 and a position input signal 804.
- the position input signal 804 may comprise head-tracking information determined by systems such as those described in relation to figures 3 - 7 above.
- the sound engine 800 generates signals that enable the simulation of sounds originating from locations remote from a user's headphones. Therefore, it is desirable to adapt the audio input signal 802 to account for the changes to the sounds that would occur if those sounds had actually originated from those remote locations.
- the position input signal 804 is provided to an interaural gain and delay block 806.
- the interaural gain and delay block 806 determines the appropriate delay 807 required to form a left delayed audio signal 810 and a right delayed audio signal 814.
- the delay 807 corresponds to the time difference that a user would perceive in the arrival of a sound at the user's left ear compared to the arrival of the sound at the user's right ear if the sound had originated from a particular location remote from the user.
- An interaural delay block 808 processes the required delay 807 and the audio input signal 802 to provide the left delayed audio signal 810 and the right delayed audio signal 814.
- the interaural gain and delay block 806 also determines the appropriate left gain 812 and right gain 815 to apply to the left delayed audio signal 810 and to the right delayed audio signal 814 respectively.
- the respective left gain 812 and right gain 815 correspond to a difference in volume of the sound that the user would perceive in the sound arriving at the user's left ear compared to the sound arriving at the user's right ear, if the sound had originated from the particular location remote from the user.
- the left delayed audio signal 810 and the left gain 812 are provided to a left amplifier 811.
- the left amplifier 811 amplifies the left delayed audio signal 810 in accordance with the left gain 812 to provide a left amplified audio signal 813.
- the right delayed audio signal 814 and the right gain 815 are provided to a right amplifier 816.
- the right amplifier 816 amplifies the right delayed audio signal 814 in accordance with the right gain 815 to provide a right amplified audio signal 817.
- the sound engine 800 also comprises an HRTF library block 818.
- the HRTF library block 818 comprises a record of Head Related Transfer Functions (HRTFs). These enable the transformation of audio signals to adapt the signals to the form appropriate for supply to a user's ears. This adaptation is necessary because a sound supplied from a position remote from a user will be altered by interacting with the user's body before it arrives at the user's eardrum. For example, the sound will arrive directly at the user's left ear, but it will also arrive indirectly by reflecting from the user's left shoulder into the user's left ear. The sound will also be modified by, for example, interacting with the user's left pinna before it arrives at the user's left eardrum.
- HRTFs Head Related Transfer Functions
- the Head Related Transfer Functions comprise the information, in the form of filter coefficients, required to achieve these adaptations.
- the HRTF library block 818 selects a set of left filter coefficients 820 suitable to transform the left amplified audio signal 813.
- the left amplified audio signal 813 and the left filter coefficients are provided to a left finite impulse response filter 822.
- the left finite impulse response filter 822 filters the left amplified audio signal 813 in accordance with the left filter coefficients 820 to provide a left output signal 824.
- the HRTF library block 818 selects a set of right filter coefficients 826 suitable to transform the right amplified audio signal 817.
- the right amplified audio signal 817 and the right filter coefficients 826 are provided to a right finite impulse response filter 828.
- the right finite impulse response filter 828 filters the right amplified audio signal 817 in accordance with the right filter coefficients 826 to provide a right output signal 830.
- the left output signal 824 and the right output signal 830 will be suitable for supply, directly or indirectly, to respectively a left headphone and a right headphone (not shown). Thereby the headphones will provide an appropriate surround sound field to the user.
- Figure 9 illustrates a method of signal processing. The method comprises the following steps.
- the first step 902 comprises receiving a left reference signal representative of an ultrasound signal supplied to a left acoustic transmitter.
- the second step 904 comprises receiving, from a first microphone, a left received signal representative of an ultrasound signal transmitted by the left acoustic transmitter.
- the ultrasound signal will have travelled through the air between the left acoustic transmitter and the first microphone.
- the third step 906 comprises determining a left distance between the left acoustic transmitter and the first microphone in accordance with the received left reference signal and the received left received signal.
- the left distance can be determined by analysing the left reference signal and the left received signal as discussed above in relation to figure 6 .
- the fourth step 908 comprises receiving a right reference signal representative of an ultrasound signal supplied to a right acoustic transmitter.
- the fifth step 910 comprises receiving, from the first microphone, a right received signal representative of an ultrasound signal transmitted by the right acoustic transmitter.
- the ultrasound signal will have travelled through the air between the right acoustic transmitter and the first microphone.
- the sixth step 912 consists of determining a right distance between the right acoustic transmitter and the first microphone in accordance with the received right reference signal and the received right received signal.
- the right distance can be determined by analysing the right reference signal and the right received signal as discussed above in relation to figure 6 .
- the seventh step 914 consists of providing output audio signalling representative of a sound field in accordance with the determined left distance and the determined right distance.
- the sound field may be supplied to a user, such that the sound field remains consistent despite movements of the users head.
- the audio output signalling may be provided to the left acoustic transmitter and the right acoustic transmitter, thereby avoiding the need to have separate components to provide the audio output signalling to a user and to provide the ultrasound signals required for head-tracking.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
Abstract
A signal processing circuit (700) comprising a distance calculator (704) configured to receive a left reference signal (712) representative of an ultrasound signal supplied to a left acoustic transmitter (740); receive, from a first microphone (750), a left received signal (716) representative of an ultrasound signal transmitted by the left acoustic transmitter (740); determine a left distance between the left acoustic transmitter (740) and the first microphone (750) in accordance with the received left reference signal (712) and the received left received signal (716); receive a right reference signal (714) representative of an ultrasound signal supplied to a right acoustic transmitter (746); receive, from the first microphone (750), a right received signal (718) representative of an ultrasound signal transmitted by the right acoustic transmitter (746); and determine a right distance between the right acoustic transmitter (746) and the first microphone (750) in accordance with the received right reference signal (714) and the received right received signal (718). The signal processing circuit (700) also comprises a sound engine (702) configured to provide output audio signalling (724, 726) representative of a sound field in accordance with the determined left distance and the determined right distance.
Description
- This disclosure relates to a signal processing circuit, in particular a signal processing circuit that can perform head tracking in order to provide output audio signalling representative of a sound field.
- According to a first aspect of the invention there is provided a signal processing circuit comprising:
- a distance calculator configured to:
- receive a left reference signal representative of an ultrasound signal supplied to a left acoustic transmitter;
- receive, from a first microphone, a left received signal representative of an ultrasound signal transmitted by the left acoustic transmitter;
- determine a left distance between the left acoustic transmitter and the first microphone in accordance with the received left reference signal and the received left received signal;
- receive a right reference signal representative of an ultrasound signal supplied to a right acoustic transmitter;
- receive, from the first microphone, a right received signal representative of an ultrasound signal transmitted by the right acoustic transmitter; and
- determine a right distance between the right acoustic transmitter and the first microphone in accordance with the received right reference signal and the received right received signal; and
- a sound engine configured to provide output audio signalling representative of a sound field in accordance with the determined left distance and the determined right distance.
- The signal processing circuit can advantageously use the left acoustic transmitter and the right acoustic transmitter to perform head-tracking using the ultrasound signals, such that additional head-tracking components and sensors may not be required.
- The sound engine may be configured to:
- receive audio input signalling and associated position input signalling; and
- process the received audio input signalling and associated position input signalling in accordance with the determined left distance and the determined right distance in order to provide the output audio signalling.
- The signal processing circuit may further comprise an offset calculator configured to determine an offset value for the position signalling in accordance with the determined left distance and the determined right distance. The sound engine may be configured to add the offset value to the received position input signalling in order to provide offset position input signalling; and determine the output audio signalling in accordance with the audio input signalling and the offset position input signalling.
- The offset calculator may be an angle calculator that is configured to calculate an azimuth angle offset value.
- The output signalling may comprise a left audio signal for the left acoustic transmitter and a right audio signal for the right acoustic transmitter. In this way, the left acoustic transmitter and the right acoustic transmitter can be used for both head tracking and providing audio signals to a user.
- The left reference signal and the left received signal may be representative of a first continuous signal containing a first set of ultrasound frequency components. The right reference signal and the right received signal may be representative of a second continuous signal containing a second set of ultrasound frequency components. The first set of ultrasound components may be at different frequencies to the second set of frequency components.
- The distance calculator may be configured to:
- determine the left distance by tracking a position of a peak of a cross-correlation between the left reference signal and the left received signal; and
- determine the right distance by tracking a position of a peak of a cross-correlation between the right reference signal and the right received signal.
- The left reference signal and the left received signal may comprise a first series of time multiplexed ultrasound pulses. The right reference signal and the right received signal may comprise a second series of time multiplexed ultrasound pulses. The distance calculator may be configured to determine the left distance by calculating a time-of-flight of the first series of time multiplexed ultrasound pulses between the left acoustic transmitter and the first microphone; and determine the right distance by calculating a time-of-flight of the second series of time multiplexed ultrasound pulses between the right acoustic transmitter and the first microphone.
- The distance calculator may be further configured to:
- receive, from a second microphone, a second left received signal representative of the ultrasound signal transmitted by the left acoustic transmitter; and
- receive, from the second microphone, a second right received signal representative of the ultrasound signal transmitted by the right acoustic transmitter.
- The distance calculator may be configured to:
- determine the left distance in accordance with the left reference signal, the left received signal and the second left received signal; and
- determine the right distance in accordance with the right reference signal, the right received signal and the second right received signal.
- The distance calculator may be configured to: apply an averaging method or triangulation method to the left received signal and the second left received signal in order to determine the left distance; and apply an averaging method or triangulation method to the right received signal and the second right received signal in order to determine the right distance.
- The left and right acoustic transmitters may comprise a pair of headphones or earphones. The first microphone may comprise a microphone assembly comprising one or more individual microphones. The second microphone may comprises a microphone assembly comprising one or more individual microphones.
- There may be provided a surround sound system comprising:
- any signal processing circuit disclosed herein;
- a pair of headphones comprising the left acoustic transmitter and the right acoustic transmitter; and
- the first microphone.
- According to a further aspect, there is provided a method of signal processing, the method comprising:
- receiving a left reference signal representative of an ultrasound signal supplied to a left acoustic transmitter;
- receiving, from a first microphone, a left received signal representative of an ultrasound signal transmitted by the left acoustic transmitter;
- determining a left distance between the left acoustic transmitter and the first microphone in accordance with the received left reference signal and the received left received signal;
- receiving a right reference signal representative of an ultrasound signal supplied to a right acoustic transmitter;
- receiving, from the first microphone, a right received signal representative of an ultrasound signal transmitted by the right acoustic transmitter;
- determining a right distance between the right acoustic transmitter and the first microphone in accordance with the received right reference signal and the received right received signal; and
- providing output audio signalling representative of a sound field in accordance with the determined left distance and the determined right distance.
- There may be provided an integrated circuit comprising any signal processing circuit disclosed herein.
- There may be provided a mobile computing device comprising any signal processing circuit disclosed herein.
- There may be provided a computer program, which when run on a computer, causes the computer to configure any apparatus, including a circuit, signal processing circuit, integrated circuit, controller, device or mobile computing device disclosed herein or perform any method disclosed herein. The computer program may be a software implementation, and the computer may be considered as any appropriate hardware, including a digital signal processor, a microcontroller, and an implementation in read only memory (ROM), erasable programmable read only memory (EPROM) or electronically erasable programmable read only memory (EEPROM), as non-limiting examples. The software may be an assembly program.
- The computer program may be provided on a computer readable medium, which may be a physical computer readable medium such as a disc or a memory device, or may be embodied as a transient signal. Such a transient signal may be a network download, including an internet download.
- Embodiments of the present invention will now be described by way of example and with reference to the accompanying drawings in which:
-
figure 1 illustrates a sound field as perceived by a user of a surround sound television when the user's head is oriented towards the television screen; -
figure 2 illustrates a sound field as perceived by a user of a surround sound television wearing headphones when the user turns his head away from the television screen; -
figure 3 illustrates a sound field as perceived by a user of a surround sound television wearing headphones when the user turns his head away from the television screen and when the surround sound television comprises a head tracking system; -
figure 4 illustrates the acoustic path distances between left and right acoustic transmitters and a microphone included in a surround sound mobile device; -
figure 5 illustrates how the acoustic path distance between the left and right acoustic transmitters and the microphone offigure 4 changes as the user turns his head to one side relative to the screen of the surround sound mobile device; -
figure 6 shows a block diagram of a system for determining changes to the acoustic path distance from left and right acoustic transmitters to a microphone and adapting the sound field of an audio device accordingly; -
figure 7 shows the system offigure 6 incorporated into an audio device; -
figure 8 shows a block diagram of a sound engine for providing a stereo sound field from audio input data and position input data; and -
figure 9 illustrates a method of signal processing. - One or more examples disclosed herein can enable the simultaneous playback of audio signals and ultrasound signals for head tracking or head localization, for example from speakers / transmitters associated with headphones. This can enable the modification of a sound field that is represented by the audio signals to accommodate the movements of a user's head. In this way, additional head tracking or head localization sensors may not be required as one or more speakers can be used to both provide the audio signals to the user and provide signalling for head tracking or head localization.
-
Figure 1 illustrates the layout of asurround sound television 100 and associated loudspeakers 104 - 114. Auser 102 is illustrated with his head directed towards thetelevision 100. A sound field may be created by driving a plurality of physically separated loudspeakers that are remote from theuser 102; for example there may be aleft speaker 104, acentral speaker 106, aright speaker 108, aleft surround speaker 110, acentral surround speaker 112 and aright surround speaker 114 distributed around theuser 102 as shown infigure 1 . The sound field generated by the plurality of speakers may provide theuser 102 with the perception that different components of an audio signal originate from different locations relative to theuser 102. The different components could, for example, correspond to different musical instruments or different sound effects. It will be appreciated that other arrangements of a larger or smaller number of loudspeakers are possible and may comprise a surround sound system. It will be further appreciated that other types of surround sound devices exist, for example, Hi-Fi systems, mobile telephones, personal computers and many other devices. - The
television 100 may also provide sound to the user via a pair ofheadphones 116. Theheadphones 116 may be configured to give theuser 102 the same impression as a plurality of separately located loudspeakers by means of appropriate processing of the audio signals supplied to the left and right channels of theheadphones 116. In this case, the processing of left and right audio signals is intended to ensure that the sound waves supplied to the user's 102 eardrums are essentially the same as those that would be provided by the plurality of remote speakers 104 - 114 shown infigure 1 . This provides theuser 102 with the perception that a virtual array of loudspeakers exists. It will be appreciated that references herein to headphones may equivalently be to earphones or other suitable acoustic devices. -
Figure 2 shows how the surround sound field changes when auser 202 is listening to a pair ofheadphones 216 and turns his head away from asurround sound television 200.Figure 2 illustrates the configuration of six virtual loudspeakers 204 - 214. It will be appreciated that these virtual loudspeakers 104 - 144 do not exist, but are representative of the locations, relative to theuser 202, of an array of loudspeakers capable of providing a surround sound field to theuser 202, via theheadphones 216, that corresponds to the surround sound field provided by the array of loudspeakers shown infigure 1 . Since the signals supplied to the left and right channels of theheadphones 216 do not adapt to the changed orientation of the user's 202 head, the surround sound field corresponding to the virtual array of loudspeakers 204 - 214 appears to rotate with theuser 202. This apparent rotation of the sound field can be undesirable because the spatial characteristics of the sound field are usually fixed relative to the position of thetelevision 200. For example, the sound field may simulate sounds coming from different locations depicted by the television screen. -
Figure 3 shows asurround sound television 300 that has a head-tracking capability. In this case, the system tracks the orientation of the user'shead 302 in real time. Left and right audio signals supplied toheadphones 316 are adapted to account for the movement of the user'shead 302. In this way, it is possible to provide theuser 302 with the impression that a virtual array of loudspeakers 304 - 314, and correspondingly a surround sound field, have not moved relative to thetelevision 300 when he turns his head. -
Figure 4 illustrates a system for tracking a user's 402 head orientation relative to amobile telephone 400. Thetelephone 400 comprises amicrophone 408, and in this example also adisplay screen 414. The system also comprises aleft headphone 404 and aright headphone 406, both of which are moveable relative to thetelephone 400. Thetelephone 400 provides a left audio signal to theleft headphone 404 and a right audio signal to theright headphone 406. In addition to providing the audio signals to theheadphones telephone 400 also provides a left ultrasound signal to theleft headphone 404 and a right ultrasound signal to theright headphone 406. The ultrasound signals will be used for head-tracking. The audio signals may comprise components with frequencies in the range of 20 Hz to 20,000 Hz,for example. Ultrasound signals may comprise components with frequencies greater than 20,000 Hz, or greater than 30,000 Hz, 40,000 Hz, 50,000 Hz or more. - The
microphone 408 is configured to detect the ultrasound signals transmitted by theleft headphone 404 and theright headphone 406. A processor (not shown) associated with themicrophone 408 can process the detected ultrasound signals in order to determine how theleft headphone 404 andright headphone 406 have been moved relative to themicrophone 408. By comparing the signals received at themicrophone 408 with reference ultrasound signals, thetelephone 400 can calculateleft distance data 410 representative of the distance between theleft headphone 404 and themicrophone 408 and can calculateright distance data 412 representative of the distance between theright headphone 406 and themicrophone 408. This is described in more detail below with reference tofigure 6 . - Once the
left distance data 410 and theright distance data 412 are known, thetelephone 400 can perform a geometric analysis to determine the orientation of the user's 402 head relative to thetelephone 400. -
- Once the orientation information has been determined, the signals provided to the
left headphone 404 and theright headphone 406 can be adapted accordingly to maintain a consistent configuration of the surround sound field relative to thetelephone 400. This may be particularly valuable in cases where thetelephone 400 comprises adisplay screen 414, such that the apparent points of origin of sounds can be maintained in the appropriate positions relative to events depicted by thedisplay screen 414. - It will be appreciated that the head-tracking system illustrated in
figure 4 may be implemented in a surround sound device that does not comprise any display screen. For example, maintaining the configuration of the sound field relative to a Hi-Fi audio system may be desirable such that the apparent position of origin of sounds produced by different instruments in an orchestra remains consistent, despite the user changing the orientation of his head. - It will be further appreciated that the head-tracking system illustrated in
figure 4 may also be implemented in a surround sound device in which the microphone is not co-located with the display screen. For example, a surround sound television may have a screen in one location and a unit comprising the microphone in a physically separate location. Such examples may utilise a known location of the microphone relative to the screen to accurately compensate for movements of the user's head. - Advantageously, one or more of the head-tracking systems disclosed herein, including the example illustrated by
figure 4 , use existing sensors and apparatus in order to perform head-tracking, thereby reducing cost, complexity and size and weight of the systems concerned. This can be preferable to head-tracking systems that instead use additional sensors and associated hardware that is not otherwise present in a surround sound device. For example, a head-tracking system that uses gyroscopes, accelerometers or magnetic sensors to measure a user's head orientation. -
Figure 5 illustrates operation of the system offigure 4 . Infigure 5 , the user has rotated hishead 502 through anangle δ 520 relative to themobile telephone 500. The consequence of this rotation is that theleft distance 510 between theleft headphone 504 and themicrophone 508 has become smaller, whereas theright distance 512 between theright headphone 506 and themicrophone 508 has become greater. In response to this change, the surround sound device can calculate the new orientation from the updatedleft distance 510 andright distance 512 and then adapt the signals supplied to theleft headphone 504 and theright headphone 506 accordingly, as discussed below. - It will be appreciated that there are many different ways that the angle of rotation δ 520 of the user's 502 head may be expressed. For example, the angle of rotation may be the angle of intersection of a headphone axis /
line 530 that connects theleft headphone 504 to theright headphone 506 with a reference axis /line 532 that extends from a fixed reference point associated with thetelephone 500 at a predetermined orientation. In some instances the fixed reference point may correspond to the location of themicrophone 508 and the predetermined orientation may be perpendicular to a longitudinal axis of thetelephone 500. It will be appreciated that theheadphone line 530 and thereference line 532 shown infigure 5 will intersect at an angle of 90 degrees plus the angle δ 520 through which theuser 502 has rotated his head when his head is rotated clockwise. - In examples that use only one
microphone 508, one or more of the circuits described below can use the determinedleft distance 510 and the determinedright distance 512, along with a known value for the diameter of the user'shead 502, to calculate both the absolute position of the user's head and the angle of the user's head. Therefore, one or more of the circuits disclosed herein can provide a user localization system as well as, or instead of, head tracking. Alternatively, if the diameter of the user's head is not known, then one or more of the circuits described in this document may assume that the user's head does not change position during use; therefore any change in the determinedleft distance 510 and the determinedright distance 512 is attributed to a rotation of the user'shead 502. It will be appreciated that references to head tracking in this document can also be intended to refer to head localization. -
Figure 6 illustrates a block diagram of asignal processing circuit 600 for use in head-tracking with a surround sound system. Thesignal processing circuit 600 comprises asound engine 602 and adistance calculator 604. Thesound engine 602 receives anaudio input signal 606 and aposition input signal 608. Theaudio input signal 606 is an example of audio input signalling. Theposition input signal 608 is an example of associated position input signalling. Theposition input signal 608 comprises information that describes an apparent position of origin, within a sound field, of different components of theaudio input signal 606. The position of origin of a particular sound relative to a user is customarily described by an azimuthal angle and an elevation angle relative to the user. - The
distance calculator 604 is configured to receive aleft reference signal 610 and aright reference signal 612. The reference signals may also be referred to as driver signals. Theleft reference signal 610 and theright reference signal 612 are representative of ultrasound signals supplied to a left headphone and a right headphone, respectively (not shown). The left headphone and right headphone are examples of a left acoustic transmitter and a right acoustic transmitter, respectively. Thedistance calculator 604 is further configured to receive a left receivedsignal 614 and a right receivedsignal 616. The left receivedsignal 614 and right receivedsignal 616 are representative of ultrasound signals transmitted by the left and right headphones respectively and received at a microphone (not shown), which is an example of a first microphone. - The
distance calculator 604 can calculateleft distance data 618 which represents the distance between the left headphone and the microphone, from analysis of theleft reference signal 610 and the left receivedsignal 614. For example, if theleft reference signal 610 and the left receivedsignal 614 represent a first continuous ultrasound signal then it is possible to track the position of the peak of the cross-correlation of theleft reference signal 610 with the left receivedsignal 614. The position of the peak provides the time delay between theleft reference signal 610 and the left receivedsignal 614 from which theleft distance data 618 can be determined using the speed of sound in air, which is of course known. - It will be appreciated that other mechanisms can be used to determine the
left distance data 618. For example, if theleft reference signal 610 comprises a first, optionally discrete, series of time multiplexed ultrasound pulses then it is possible to determine the time of flight of the pulses because each pulse in the left receivedsignal 614 can be identified as relating to a corresponding pulse within theleft reference signal 610. Theleft distance data 618 can be computed from the time difference between the corresponding pulses and using the known speed of sound in air. - Similarly, it is possible to determine the
right distance data 620, which represents the distance between the right headphone and the microphone, from theright reference signal 612 and the right receivedsignal 616. That is, theright reference signal 612 and the right receivedsignal 616 may be representative of a second continuous ultrasound signal. Alternatively, theright reference signal 612 and the right receivedsignal 616 may comprise a second series of time multiplexed ultrasound pulses. - If both the
left reference signal 610 and theright reference signal 612 are continuous ultrasound signals then it may be necessary for thedistance calculator 604 to discriminate between them. Theleft reference signal 610 may contain a first set of ultrasound frequency components and theright reference signal 612 may contain a second set of ultrasound frequency components, wherein the first set of ultrasound components are at different frequencies to the second set of frequency components. Each set of frequency components may comprises a single frequency. The sets of frequency components may comprise different non-overlapping ultrasound frequency ranges. - If both the
left reference signal 610 and theright reference signal 612 comprise a series of discrete ultrasound pulses then different pulses may be distinguished either by using different frequencies or by using different time multiplexing for theleft reference signal 610 compared with theright reference signal 612. - The
distance calculator 604 can then supply the calculatedleft distance data 618 and the calculatedright distance data 620 to thesound engine 602. - The
sound engine 602 is configured to process theaudio input signal 606, theposition input signal 608, the receivedleft distance data 618 andright distance data 620 to provide a leftaudio output signal 622 and a rightaudio output signal 624. When the leftaudio output signal 622 and the rightaudio output signal 624 are provided to a left headphone and a right headphone respectively, the sound signal created will provide the user with a surround sound field that adapts according to the orientation of the user's head relative to the surround sound device. Therefore, the leftaudio output signal 622 and the rightaudio output signal 624 can be considered as examples of output audio signalling representative of a sound field, that are determined in accordance with the determined left distance and the determined right distance. - Various different adaptations of the surround sound field, in accordance with changes of the
left distance data 618 and theright distance data 620, are possible. In relation to the example offigures 3 - 5 , one adaptation is to rotate the sound field about the azimuth by an offset corresponding to the angle of rotation of the user's head. Alternatively, the adaptation may take into account both the absolute position of the user's head and the angle of the user's head. For example, the head rotation angle can be taken relative to the angle between the device (microphone) and the listener. In this case, if the user moves to the left and rotates his head to the right to keep looking at the screen, then no compensation would be applied. As a further alternative, the amplitude of part of, or all of, the sound field may be increased or decreased as the distance values represented by theleft distance data 618 and theright distance data 620 decrease or increase in order to account for a user moving further away from or closer to the microphone. Modifications to the elevation of components of the sound field are also possible. -
Figure 7 illustrates a block diagram comprising a surround sound system that includes asignal processing circuit 700 for head-tracking, a pair of headphones comprising a left acoustic transmitter /headphone 740 and a right acoustic transmitter /headphone 746, afirst microphone 750 and asecond microphone 752. Thesignal processing circuit 700 comprises a3D sound engine 702, adistance calculator 704 and anangle calculator 706. Theangle calculator 706 is one example of an offset calculator. - The
3D sound engine 702 receives audio input signals 708. In this case a pair of audio input signals 708 corresponding to a stereo signal is illustrated. It will be appreciated that the audio input signals 708 could alternatively comprise a monaural signal or any other known form of multichannel audio signal. The3D sound engine 702 also receivessound position information 710 which comprises information relating to the azimuth and elevation of each component of theaudio input 708. Of course, the audio input signals 708 andsound position information 710 could be received at a common input terminal. - The
distance calculator 704 receives aleft reference signal 712, aright reference signal 714, a left received signal 716 and a right received signal 718. Thedistance calculator 704 is configured to calculatedistance information 720 comprising left distance data and right distance data as described above in relation tofigure 6 . The distance calculator then provides thisdistance information 720 to theangle calculator 706. Theangle calculator 706 is configured to determine the orientation angle of a user's head as described in relation tofigures 4 and5 . Theangle calculator 706 then provides theorientation angle 722 to the3D sound engine 702, which can use theorientation angle 722 as an offset value. In this example, the offset value is an azimuth angle offset value. The3D sound engine 702 is configured to provide a leftaudio output signal 724 and a rightaudio output signal 726 suitable for providing a surround sound field to a pair ofheadphones head orientation angle 722. The3D sound engine 702 can add theorientation angle 722 to the receivedsound position information 710 in order to provide offset position input signalling. The3D sound engine 702 can then determine the rightaudio output signal 726 and the leftaudio output signal 724 in accordance with the audio input signals 708 and the offset position input signalling. - The offset calculator may be an angle calculator that is configured to calculate an azimuth angle offset value.
- A
left mixer 727 mixes the leftaudio output signal 724 with aleft ultrasound signal 728 received from a leftultrasound signal generator 730 in order to provide a combined left audio andultrasound signal 736. The leftultrasound signal generator 730 also provides theleft reference signal 712, which is representative of theleft ultrasound signal 728, to thedistance calculator 704. Aright mixer 725 mixes the rightaudio output signal 726 with aright ultrasound signal 732 received from a rightultrasound signal generator 734 in order to provide a combined right audio andultrasound signal 742. The rightultrasound signal generator 734 also provides theright reference signal 714, which is representative of theright ultrasound signal 732, to thedistance calculator 704. - The combined left audio and
ultrasound signal 736 is provided to aleft amplifier 738 which provides an amplified signal to theleft headphone 740. The combined right audio andultrasound signal 742 is provided to aright amplifier 744 which provides an amplified signal to theright headphone 746. - The ultrasound signals transmitted by the
left headphone 740 and theright headphone 746 are detected by amicrophone assembly 748. In this example, themicrophone assembly 748 comprises at least thefirst microphone 750 and thesecond microphone 752. Thefirst microphone 750 provides the left received signal 716 and the right received signal 718 to thedistance calculator 704. The left received signal 716 and the right received signal 718 may be provided to thedistance calculator 704 as a combined signal, as illustrated infigure 7 . Thedistance calculator 704 will then process the combined signal in order to determine the left received signal 716 and right received signal 718, for example by distinguishing different frequency components or different time multiplexing as described above in relation tofigure 6 . Similarly, thesecond microphone 752 provides a second left received signal 717 and a second received right received signal 719 to thedistance calculator 704. - In some examples, the
microphone assembly 748 may comprise a processor (not shown) configured to separate the left received signal 716 and the right received signal 718 from the signal received at thefirst microphone 750, such that themicrophone assembly 748 may provide the left received signal 716 and the right received signal 718, separately, to thedistance calculator 704. Similarly, the processor may be configured to separate the second left received signal 717 and the second received signal 719 from the signal received at thesecond microphone 752. - The
distance calculator 704 can then determine the left distance in accordance with theleft reference signal 712, the left received signal 716 and the second left received signal 717. Thedistance calculator 704 can also determine the right distance in accordance with theright reference signal 714, the right received signal 718 and the second right received signal 719. - It will be appreciated that the
microphone assembly 748 may comprise a single microphone or an array / plurality of microphones. Where a plurality of microphones is present, themicrophone assembly 748 may provide a plurality of left received signals and a plurality of right received signals to thedistance calculator 704, wherein each such signal is associated with a particular microphone. Thedistance calculator 704 may then use the plurality of left received signals and right received signals in conjunction with theleft reference signal 712 and theright reference signal 714 to determine the left distance and the right distance. The use of a plurality of left received signals and right received signals may advantageously enable a more accurate determination of the left distance and the right distance to be made. For example thedistance calculator 704 may apply averaging methods or triangulation methods to the received plurality of left received signals and the plurality of right received signals, in cases where the plurality of microphones are located at positions remote from one another. In addition, an array of microphones may provide the advantage of improving the signal to noise ratio of the left received signals and the right received signals. - The
first microphone 750 may itself comprise a microphone assembly comprising one or more individual microphones. Also, thesecond microphone 752 may itself comprise a microphone assembly comprising one or more individual microphones. -
Figure 8 shows a block diagram of asound engine 800. Thesound engine 800 receives anaudio input signal 802 and aposition input signal 804. Theposition input signal 804 may comprise head-tracking information determined by systems such as those described in relation tofigures 3 - 7 above. Thesound engine 800 generates signals that enable the simulation of sounds originating from locations remote from a user's headphones. Therefore, it is desirable to adapt theaudio input signal 802 to account for the changes to the sounds that would occur if those sounds had actually originated from those remote locations. - The
position input signal 804 is provided to an interaural gain anddelay block 806. The interaural gain anddelay block 806 determines theappropriate delay 807 required to form a left delayedaudio signal 810 and a right delayedaudio signal 814. Thedelay 807 corresponds to the time difference that a user would perceive in the arrival of a sound at the user's left ear compared to the arrival of the sound at the user's right ear if the sound had originated from a particular location remote from the user. An interaural delay block 808 processes the requireddelay 807 and theaudio input signal 802 to provide the left delayedaudio signal 810 and the right delayedaudio signal 814. - The interaural gain and delay block 806 also determines the appropriate
left gain 812 andright gain 815 to apply to the left delayedaudio signal 810 and to the right delayedaudio signal 814 respectively. The respectiveleft gain 812 andright gain 815 correspond to a difference in volume of the sound that the user would perceive in the sound arriving at the user's left ear compared to the sound arriving at the user's right ear, if the sound had originated from the particular location remote from the user. - The left delayed
audio signal 810 and theleft gain 812 are provided to aleft amplifier 811. Theleft amplifier 811 amplifies the left delayedaudio signal 810 in accordance with theleft gain 812 to provide a left amplifiedaudio signal 813. Similarly, the right delayedaudio signal 814 and theright gain 815 are provided to aright amplifier 816. Theright amplifier 816 amplifies the right delayedaudio signal 814 in accordance with theright gain 815 to provide a right amplifiedaudio signal 817. - The
sound engine 800 also comprises anHRTF library block 818. TheHRTF library block 818 comprises a record of Head Related Transfer Functions (HRTFs). These enable the transformation of audio signals to adapt the signals to the form appropriate for supply to a user's ears. This adaptation is necessary because a sound supplied from a position remote from a user will be altered by interacting with the user's body before it arrives at the user's eardrum. For example, the sound will arrive directly at the user's left ear, but it will also arrive indirectly by reflecting from the user's left shoulder into the user's left ear. The sound will also be modified by, for example, interacting with the user's left pinna before it arrives at the user's left eardrum. It will be appreciated that the interactions of the sound with the user's body will differ depending on the location from which a particular sound originates relative to the position of the user, and that the interactions will be different for the user's left ear compared to the user's right ear. The Head Related Transfer Functions comprise the information, in the form of filter coefficients, required to achieve these adaptations. In accordance with theposition input signal 804, theHRTF library block 818 selects a set ofleft filter coefficients 820 suitable to transform the left amplifiedaudio signal 813. The left amplifiedaudio signal 813 and the left filter coefficients are provided to a left finiteimpulse response filter 822. The left finiteimpulse response filter 822 filters the left amplifiedaudio signal 813 in accordance with theleft filter coefficients 820 to provide aleft output signal 824. - Similarly, in accordance with the
position input signal 804, theHRTF library block 818 selects a set ofright filter coefficients 826 suitable to transform the right amplifiedaudio signal 817. The right amplifiedaudio signal 817 and theright filter coefficients 826 are provided to a right finiteimpulse response filter 828. The right finiteimpulse response filter 828 filters the right amplifiedaudio signal 817 in accordance with theright filter coefficients 826 to provide aright output signal 830. - The
left output signal 824 and theright output signal 830 will be suitable for supply, directly or indirectly, to respectively a left headphone and a right headphone (not shown). Thereby the headphones will provide an appropriate surround sound field to the user. -
Figure 9 illustrates a method of signal processing. The method comprises the following steps. - The
first step 902 comprises receiving a left reference signal representative of an ultrasound signal supplied to a left acoustic transmitter. - The
second step 904 comprises receiving, from a first microphone, a left received signal representative of an ultrasound signal transmitted by the left acoustic transmitter. The ultrasound signal will have travelled through the air between the left acoustic transmitter and the first microphone. - The
third step 906 comprises determining a left distance between the left acoustic transmitter and the first microphone in accordance with the received left reference signal and the received left received signal. The left distance can be determined by analysing the left reference signal and the left received signal as discussed above in relation tofigure 6 . - The
fourth step 908 comprises receiving a right reference signal representative of an ultrasound signal supplied to a right acoustic transmitter. - The
fifth step 910 comprises receiving, from the first microphone, a right received signal representative of an ultrasound signal transmitted by the right acoustic transmitter. The ultrasound signal will have travelled through the air between the right acoustic transmitter and the first microphone. - The
sixth step 912 consists of determining a right distance between the right acoustic transmitter and the first microphone in accordance with the received right reference signal and the received right received signal. The right distance can be determined by analysing the right reference signal and the right received signal as discussed above in relation tofigure 6 . - The
seventh step 914 consists of providing output audio signalling representative of a sound field in accordance with the determined left distance and the determined right distance. The sound field may be supplied to a user, such that the sound field remains consistent despite movements of the users head. The audio output signalling may be provided to the left acoustic transmitter and the right acoustic transmitter, thereby avoiding the need to have separate components to provide the audio output signalling to a user and to provide the ultrasound signals required for head-tracking. - It will be appreciated that other systems capable of acting as sound engines exist. For example, one such system is disclosed in "A structural model for binaural sound synthesis" by C. Phillip Brown and Richard O. Duda (IEEE Transactions on speech and audio processing, vol. 6, no. 5, September 1998).
Claims (15)
- A signal processing circuit comprising:a distance calculator configured to:receive a left reference signal representative of an ultrasound signal supplied to a left acoustic transmitter;receive, from a first microphone, a left received signal representative of an ultrasound signal transmitted by the left acoustic transmitter;determine a left distance between the left acoustic transmitter and the first microphone in accordance with the received left reference signal and the received left received signal;receive a right reference signal representative of an ultrasound signal supplied to a right acoustic transmitter;receive, from the first microphone, a right received signal representative of an ultrasound signal transmitted by the right acoustic transmitter; anddetermine a right distance between the right acoustic transmitter and the first microphone in accordance with the received right reference signal and the received right received signal; anda sound engine configured to provide output audio signalling representative of a sound field in accordance with the determined left distance and the determined right distance.
- The signal processing circuit of claim 1, wherein the sound engine is configured to:receive audio input signalling and associated position input signalling; andprocess the received audio input signalling and associated position input signalling in accordance with the determined left distance and the determined right distance in order to provide the output audio signalling.
- The signal processing circuit of claim 2, further comprising:an offset calculator configured to determine an offset value for the position signalling in accordance with the determined left distance and the determined right distance; and
wherein the sound engine is configured to:add the offset value to the received position input signalling in order to provide offset position input signalling; anddetermine the output audio signalling in accordance with the audio input signalling and the offset position input signalling. - The signal processing circuit of claim 3, wherein the offset calculator is an angle calculator that is configured to calculate an azimuth angle offset value.
- The signal processing circuit of any preceding claim, wherein the output signalling comprises a left audio signal for the left acoustic transmitter and a right audio signal for the right acoustic transmitter.
- The signal processing circuit of any preceding claim, wherein:the left reference signal and the left received signal are representative of a first continuous signal containing a first set of ultrasound frequency components; andthe right reference signal and the right received signal are representative of a second continuous signal containing a second set of ultrasound frequency components, wherein the first set of ultrasound components are at different frequencies to the second set of frequency components.
- The signal processing circuit of claim 6, wherein the distance calculator is configured to:determine the left distance by tracking a position of a peak of a cross-correlation between the left reference signal and the left received signal; anddetermine the right distance by tracking a position of a peak of a cross-correlation between the right reference signal and the right received signal.
- The signal processing circuit of any one of claims 1 to 5, wherein:the left reference signal and the left received signal comprise a first series of time multiplexed ultrasound pulses;the right reference signal and the right received signal comprise a second series of time multiplexed ultrasound pulses; and
wherein the distance calculator is configured to:determine the left distance by calculating a time-of-flight of the first series of time multiplexed ultrasound pulses between the left acoustic transmitter and the first microphone; anddetermine the right distance by calculating a time-of-flight of the second series of time multiplexed ultrasound pulses between the right acoustic transmitter and the first microphone. - The signal processing circuit of any preceding claim, wherein:the distance calculator is further configured to:receive, from a second microphone, a second left received signal representative of the ultrasound signal transmitted by the left acoustic transmitter; andreceive, from the second microphone, a second right received signal representative of the ultrasound signal transmitted by the right acoustic transmitter; andwherein the distance calculator is configured to:determine the left distance in accordance with the left reference signal, the left received signal and the second left received signal; anddetermine the right distance in accordance with the right reference signal, the right received signal and the second right received signal.
- The signal processing circuit of claim 9, wherein the distance calculator is configured to:apply an averaging method or triangulation method to the left received signal and the second left received signal in order to determine the left distance; andapply an averaging method or triangulation method to the right received signal and the second right received signal in order to determine the right distance.
- The signal processing circuit of any preceding claim wherein the left and right acoustic transmitters comprise a pair of headphones or earphones.
- The signal processing circuit of any preceding claim, wherein the first microphone comprises a microphone assembly comprising one or more individual microphones.
- A surround sound system comprising:the signal processing circuit of any preceding claim;a pair of headphones comprising the left acoustic transmitter and the right acoustic transmitter; andthe first microphone.
- A method of signal processing, the method comprising:receiving a left reference signal representative of an ultrasound signal supplied to a left acoustic transmitter;receiving, from a first microphone, a left received signal representative of an ultrasound signal transmitted by the left acoustic transmitter;determining a left distance between the left acoustic transmitter and the first microphone in accordance with the received left reference signal and the received left received signal;receiving a right reference signal representative of an ultrasound signal supplied to a right acoustic transmitter;receiving, from the first microphone, a right received signal representative of an ultrasound signal transmitted by the right acoustic transmitter;determining a right distance between the right acoustic transmitter and the first microphone in accordance with the received right reference signal and the received right received signal; andproviding output audio signalling representative of a sound field in accordance with the determined left distance and the determined right distance.
- A computer program, which when run on a computer, causes the computer to perform the method of claim 14, configure the signal processing circuit of any one of claims 1 to 12, or configure the surround sound system of claim 13.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP20130193367 EP2874412A1 (en) | 2013-11-18 | 2013-11-18 | A signal processing circuit |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP20130193367 EP2874412A1 (en) | 2013-11-18 | 2013-11-18 | A signal processing circuit |
Publications (1)
Publication Number | Publication Date |
---|---|
EP2874412A1 true EP2874412A1 (en) | 2015-05-20 |
Family
ID=49626824
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP20130193367 Withdrawn EP2874412A1 (en) | 2013-11-18 | 2013-11-18 | A signal processing circuit |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP2874412A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116320880A (en) * | 2023-05-25 | 2023-06-23 | 荣耀终端有限公司 | Audio processing method and device |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0438281A2 (en) * | 1990-01-19 | 1991-07-24 | Sony Corporation | Acoustic signal reproducing apparatus |
US20050226437A1 (en) * | 2002-05-27 | 2005-10-13 | Sonicemotion Ag | Method and device for generating information relating to relative position of a set of at least three acoustic transducers (as amended) |
US20060045294A1 (en) * | 2004-09-01 | 2006-03-02 | Smyth Stephen M | Personalized headphone virtualization |
US20110293129A1 (en) * | 2009-02-13 | 2011-12-01 | Koninklijke Philips Electronics N.V. | Head tracking |
-
2013
- 2013-11-18 EP EP20130193367 patent/EP2874412A1/en not_active Withdrawn
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0438281A2 (en) * | 1990-01-19 | 1991-07-24 | Sony Corporation | Acoustic signal reproducing apparatus |
US20050226437A1 (en) * | 2002-05-27 | 2005-10-13 | Sonicemotion Ag | Method and device for generating information relating to relative position of a set of at least three acoustic transducers (as amended) |
US20060045294A1 (en) * | 2004-09-01 | 2006-03-02 | Smyth Stephen M | Personalized headphone virtualization |
US20110293129A1 (en) * | 2009-02-13 | 2011-12-01 | Koninklijke Philips Electronics N.V. | Head tracking |
Non-Patent Citations (1)
Title |
---|
C. PHILLIP BROWN; RICHARD O. DUDA: "A structural model for binaural sound synthesis", IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, vol. 6, no. 5, September 1998 (1998-09-01) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116320880A (en) * | 2023-05-25 | 2023-06-23 | 荣耀终端有限公司 | Audio processing method and device |
CN116320880B (en) * | 2023-05-25 | 2023-10-20 | 荣耀终端有限公司 | Audio processing method and device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20220116723A1 (en) | Filter selection for delivering spatial audio | |
CN106576203B (en) | Determining and using room-optimized transfer functions | |
EP3253078B1 (en) | Wearable electronic device and virtual reality system | |
EP2503800B1 (en) | Spatially constant surround sound | |
EP2953383B1 (en) | Signal processing circuit | |
US10341799B2 (en) | Impedance matching filters and equalization for headphone surround rendering | |
US10652686B2 (en) | Method of improving localization of surround sound | |
US9769585B1 (en) | Positioning surround sound for virtual acoustic presence | |
US11546703B2 (en) | Methods for obtaining and reproducing a binaural recording | |
EP3225039B1 (en) | System and method for producing head-externalized 3d audio through headphones | |
KR20140126788A (en) | Position estimation system using an audio-embedded time-synchronization signal and position estimation method using thereof | |
CN104853283A (en) | Audio signal processing method and apparatus | |
US11678111B1 (en) | Deep-learning based beam forming synthesis for spatial audio | |
US10659903B2 (en) | Apparatus and method for weighting stereo audio signals | |
EP1796427A1 (en) | Hearing device with virtual sound source | |
EP2874412A1 (en) | A signal processing circuit | |
KR20210077169A (en) | Multi-channel/multi-object sound source processing apparatus | |
US20070127750A1 (en) | Hearing device with virtual sound source | |
JP2011259299A (en) | Head-related transfer function generation device, head-related transfer function generation method, and audio signal processing device | |
KR101071895B1 (en) | Adaptive Sound Generator based on an Audience Position Tracking Technique | |
US20240163630A1 (en) | Systems and methods for a personalized audio system | |
US20240089687A1 (en) | Spatial audio adjustment for an audio device | |
EP4135349A1 (en) | Immersive sound reproduction using multiple transducers | |
CN112954579A (en) | Method and device for reproducing on-site listening effect | |
Teschl | Binaural sound reproduction via distributed loudspeaker systems |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20140327 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20151121 |