US11310621B2 - Signal processing device and signal processing method for performing sound localization processing - Google Patents
Signal processing device and signal processing method for performing sound localization processing Download PDFInfo
- Publication number
- US11310621B2 US11310621B2 US16/884,806 US202016884806A US11310621B2 US 11310621 B2 US11310621 B2 US 11310621B2 US 202016884806 A US202016884806 A US 202016884806A US 11310621 B2 US11310621 B2 US 11310621B2
- Authority
- US
- United States
- Prior art keywords
- output
- signal processing
- filter
- acoustic signal
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/307—Frequency adjustment, e.g. tone control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/04—Circuits for transducers, loudspeakers or microphones for correcting frequency response
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/12—Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
Definitions
- the present disclosure relates to a signal processing device and a signal processing method.
- a method of controlling a sound in view of the difference between both ear positions of a hearer is known as a technique of reproducing an acoustic signal output from a speaker to give a hearer realistic feeling (see e.g., PTL 1 and NPL 1).
- a sound control filter is used to calculate the transfer functions from right and left speakers to both ear positions, thereby controlling the sound.
- the use of the sound control filter allows localization of the sound indicated by the input acoustic signal to any place and causes the hearer to hear the sound with desired sound control effects.
- the transfer functions described above are calculated in advance in view of the distance from the right and left speakers to both the ears of the hearer.
- the transfer functions in the position after the movement are thus different from those calculated in advance. It is thus anticipated that no expected sound control effect is obtained, if the hearer moves at a long distance or the transfer functions from the reproducing speakers to both the ear positions of the hearer largely change under the influence of the reproduction environment.
- a signal processing device for controlling sound localization.
- the signal processing device includes: one or more filter processors that perform sound localization processing of an input acoustic signal and generate output signals; a coefficient setter that sets, for the one or more filter processors, a plurality of filter coefficients for use in the one or more filter processors; an output data selector that selects, out of the output signals subjected to the sound localization processing by the one or more filter processors, an output signal to be output to a speaker; a time measurer that monitors a time for switching the output signals; and a controller that causes the output data selector to select the output signal in accordance with the time for switching the output signals.
- the plurality of filter coefficients include filter coefficients generated under a plurality of hearing conditions.
- the sound control filters designed under different hearing conditions emit sounds. Accordingly, the device gives the hearer sound control effects, even if the hearing position of the hearer changes.
- the plurality of hearing conditions may include at least information on a hearing position to which a hearer is likely to move.
- the sound control filters designed in the hearing position, to which the hearer may move emit sounds. Accordingly, the device gives the hearer sound control effects, even if the hearing position changes.
- the output data selector may include one or more gain adjusters that adjust gains of the output signals subjected to the sound localization processing to select the output signal to be output to the speaker.
- the speaker may include a first speaker and a second speaker in positions different from each other.
- the output data selector may include: a first adder that adds, out of the output signals whose gains are adjusted, an output signal to be output through the first speaker; and a second adder that adds, out of the output signals whose gains are adjusted, an output signal to be output through the second speaker.
- the signal processing device may further include: an auxiliary information input that inputs auxiliary information on two ear positions or a seated position of the hearer for selecting a range of the plurality of filter coefficients set by the coefficient setter; an auxiliary information analyzer that analyzes the auxiliary information input; and a coefficient range selector that selects the range of the plurality of filter coefficients set by the coefficient setter based on a result of analysis by the auxiliary information analyzer.
- the input auxiliary information limits the filter processor to be set. Accordingly, the signal processing device more easily gives the hearer sound control effects.
- the auxiliary information input may input, as one of the plurality of filter coefficients, a position of a seat on which the hearer is seated.
- This configuration allows the use of the information on the position of the seat on which the hearer is seated, to select the range of the filter coefficients. Accordingly, the device easily gives the hearer sound control effects.
- the auxiliary information input may input, as the plurality of filter coefficients, image information including the auxiliary information on the two ear positions.
- This configuration allows the use of the image information to select the range of the filter coefficients. Accordingly, the device easily gives the hearer sound control effects.
- the signal processing device may further include: an acoustic signal analyzer that analyzes the input acoustic signal and inputs the time for switching to the output data selector.
- This configuration allows the analysis of the acoustic signal and the control of the timing for switching the output data.
- the device properly gives the hearer sound control effects when generating the acoustic signal to be recognized by the hearer.
- the acoustic signal analyzer may include: a power detector that detects a power of the input acoustic signal; and a determiner that determines whether the power of the input acoustic signal is greater than or equal to a threshold.
- a signal processing method controls sound localization.
- the signal processing method includes: filtering, by one or more filter processors, an input acoustic signal through sound localization and generating output signals; setting, by a coefficient setter, for the one or more filter processors, a plurality of filter coefficients for use in the one or more filter processors; selecting, by a data selection processor, out of the output signals subjected to the sound localization processing by the one or more filter processors, an output signal to be output to a speaker; monitoring, by a time measurer, a time for switching the output signals; and causing, by a controller, the data selection processor to select the output signal in accordance with the time for switching the output signals.
- the plurality of filter coefficients include filter coefficients generated under a plurality of hearing conditions.
- the sound control filters designed under different hearing conditions emits sounds. Accordingly, the device gives the hearer sound control effects, even if the hearing position of the hearer changes.
- the signal processing method may further include: obtaining auxiliary information; and analyzing, by an auxiliary information analyzer, the auxiliary information, and selecting a coefficient range of the plurality of filter coefficients.
- This configuration allows the selection of the filter coefficients based on the auxiliary information such as the position of the hearer supposed in advance. This reduces the use of the filter coefficients that provide less sound localization control effects and thus facilitates sound localization control.
- the signal processing method may further include: detecting, by the acoustic signal analyzer, a power of the input acoustic signal.
- the controller may cause the data selection processor to select the output signal based on the power detected of the input acoustic signal.
- This configuration gives the hearer sound control effects and causes the hearer to recognize the acoustic signal in the period when the auditory effective acoustic signal is generated or, if no auditory effective acoustic signal is generated, when the time for switching/selecting the output data has elapsed.
- the present invention provides a signal processing device and a signal processing method that give a hearer sound control effects, even if the hearing position of the hearer changes.
- FIG. 1 is a block diagram showing an example configuration of a signal processing device according to Embodiment 1, speakers, and a hearer.
- FIG. 2 shows example hearing positions in designing filter processors according to Embodiment 1.
- FIG. 3 is a block diagram showing a configuration of an output data selector according to Embodiment 1.
- FIG. 4 shows example output signals obtained by the output data selector according to Embodiment 1.
- FIG. 5 shows example gain settings by gain adjusters of the output data selector according to Embodiment 1.
- FIG. 6 shows superposition of two of the example gain settings by the gain adjusters shown in FIG. 5 .
- FIG. 7 is a flow chart showing an operation of the signal processing device according to Embodiment 1.
- FIG. 8 is a block diagram showing an example configuration of a signal processing device according to Embodiment 2, speakers, and a hearer.
- FIG. 9 shows an example of hearing positions and a group of hearing positions in designing filter processors according to Embodiment 2.
- FIG. 10 is a flow chart showing an operation of the signal processing device according to Embodiment 2.
- FIG. 11 is a block diagram showing an example configuration of a signal processing device according to Embodiment 3, speakers, and a hearer.
- FIG. 12 is a block diagram showing a configuration of an acoustic signal analyzer according to Embodiment 3.
- FIG. 13 shows example timing for switching reproduced sounds using an acoustic signal analyzer according to Embodiment 3.
- FIG. 14 is a flow chart showing an operation of the signal processing device according to Embodiment 3.
- FIG. 15A is a schematic diagram showing a positional relationship, between a hearer and a speaker, meeting desired hearing conditions in a sound control method according to the background art.
- FIG. 15B is a schematic diagram showing an actual positional relationship between the hearer and speakers in reproducing an acoustic signal in the sound control method according to the background art.
- FIG. 15A is a schematic diagram showing a positional relationship, between a hearer and a speaker, meeting desired hearing conditions in an acoustic control method according to the background art.
- FIG. 15B is a schematic diagram showing an actual positional relationship between the hearer and speakers in reproducing an acoustic signal in the acoustic control method according to the background art.
- the “positional relationship, between a hearer and a speaker, meeting desired hearing conditions” will be hereinafter referred to as a “desired system”
- the “actual positional relationship between the hearer and speakers in reproducing an acoustic signal” will be hereinafter referred to as a “reproduction system”.
- desired speaker 203 reproduces the acoustic signal, which reaches both the ear positions of hearer 101 .
- the “desired speaker” here is an imaginary speaker located in a position causing hearer 101 to recognize the generation of the acoustic signal regardless of the actual position of the speaker. That is, the speaker is an imaginary speaker located in any place to which the sound of the acoustic signal is localized.
- FIG. 15B shows a configuration of reproduction system including filter processor 350 that performs sound control processing of the acoustic signal. The signal is reproduced by left speaker 201 and right speaker 202 and reaches both the ear positions of hearer 100 .
- the acoustic signal obtained in both the ear positions of hearer 101 in the configuration of desired system 10 is identical with the acoustic signal obtained in both the ear positions of hearer 100 in the configuration of reproduction system 20 .
- hearer 100 recognizes the sound from the position of desired speaker 203 as viewed from hearer 101 in the configuration of reproduction system 20 , although the acoustic signal comes from left speaker 201 and right speaker 202 . That is, the acoustic signal obtained in both the ear positions of hearer 101 in the configuration of desired system 10 is controlled to be identical with the acoustic signal obtained in both the ear positions of hearer 100 in the configuration of reproduction system 20 . This allows the control causing hearer 101 to recognize the sound from the position of desired speaker 203 .
- Such a control method has been used as a method of reproducing a realistic feeling to be obtained in the configuration of desired system 10 , in the configuration of reproduction system 20 that is physically different from the configuration of desired system 10 .
- the transfer functions from left speaker 201 and right speaker 202 to both ears of hearer 100 in the configuration of reproduction system 20 are measured in advance.
- the measured transfer functions are subjected to predetermined convolution (calculation) to obtain the transfer functions from desired speaker 203 to both ears of hearer 101 in the configuration of desired system 10 .
- the configuration of reproduction system 20 includes filter processor 350 for convolving input acoustic signal S as shown in FIG. 15B .
- Filter processor 350 includes filter Xl and filter Xr as shown in FIG. 15B .
- Filter Xl and filter Xr have transfer functions Hll, Hlr, Hrl, and Hrr from left speaker 201 and right speaker 202 to both the ear positions of hearer 100 .
- Dl and Dr are the transfer functions from desired speaker 203 to both the ear positions of hearer 101 .
- Transfer functions Hll, Hlr, Hrl, and Hrr used in filter processor 350 will be hereinafter referred to as the values in the frequency domain.
- the suffixes w indicating the frequencies need to be added like Hll (co) but will be omitted for simplification.
- Transfer functions Hll, Hlr, Hrl, and Hrr set for filter Xl and filter Xr can be designed in accordance with Expression (1) (see, e.g., NPL 1).
- Filter processor 350 designed here in accordance with Expression (1) has transfer functions Hll, Hlr, Hrl, and Hrr from left speaker 201 and right speaker 202 to both ears of hearer 100 measured in advance. Assume that hearer 100 moves from the position in which transfer functions Hll, Hlr, Hrl, and Hrr were measured. In this case, the transfer functions from left speaker 201 and right speaker 202 to both ears of hearer 100 in the position after the movement become different from Hll, Hlr, Hrl, and Hrr. In reproduction system 20 , filter processor 350 designed in accordance with Expression (1) cannot generate the signal obtained in both the ear positions of hearer 101 in desired system 10 . That is, the effects of the sound localization control cannot be obtained.
- PTL 1 teaches the problem of obtaining the effects of the sound localization control in limited hearing positions.
- PTL 1 discloses a method of achieving more robust control not by reproducing the absolute sound pressures at both the ear positions of hearer 100 but by causing an interaural difference. It is however anticipated in the method disclosed in PTL 1 that expected sound localization control effects are not obtained, if the hearer moves at a long distance. It also applies if the hearer moves at a slight distance but the transfer functions from the reproducing speaker to both the ear positions of the hearer largely change under the influence of the reproduction environment.
- the present disclosure provides a signal processing device and a signal processing method that give a hearer sound control effects, even if the hearing position of the hearer changes.
- FIG. 1 is a block diagram showing an example configuration of the signal processing system according to Embodiment 1.
- the signal processing system includes signal processing device 1 , left speaker 201 , and right speaker 202 .
- Signal processing device 1 processes an input acoustic signal and outputs the processed signal to left speaker 201 and right speaker 202 .
- a configuration and an operation of signal processing device 1 will be described later in more detail.
- the constituent elements of signal processing device 1 may be dedicated hardware devices or may be achieved by executing software programs suitable for the constituent elements.
- the constituent elements may be achieved by a program executor, such as a CPU or a processor, reading and executing software programs stored in a storage medium such as a hard disk or a semiconductor memory.
- the constituent elements may be large-scale integrated (LSI) circuits, dedicated circuits, general-purpose processors, field-programmable gate arrays (FPGAs), or reconfigurable processors capable of reconfiguring connections and settings of circuit cells inside an LSI circuit.
- LSI large-scale integrated
- signal processing device 1 may include left speaker 201 and right speaker 202 .
- Left speaker 201 and right speaker 202 output the acoustic signal processed by signal processing device 1 .
- left speaker 201 is a first speaker
- right speaker 202 is a second speaker.
- Left speaker 201 and right speaker 202 intend to reproduce input signals over the full bandwidth, for example.
- Left speaker 201 and right speaker 202 are located in different positions. For example, as shown in FIG. 1 , left speaker 201 and right speaker 202 are symmetrical about hearer 100 . Left speaker 201 is located on the left of hearer 100 . Right speaker 202 is located on the right of hearer 100 .
- signal processing device 1 includes input 301 , a plurality of filter processors, storage device 304 , coefficient setter 305 , controller 401 , output data selector 402 , timer 403 , counter 404 , and output 405 .
- signal processing device 1 includes, as the plurality of filter processors, first filter processor 302 a , second filter processor 302 b , . . . , and n-th filter processor 302 n .
- first filter processor 302 a , second filter processor 302 b , . . . , and n-th filter processor 302 n may be collectively referred to as “first filter processor 302 a to n -th filter processor 302 n”.
- Input 301 receives acoustic signal S from the outside of signal processing device 1 . Input 301 outputs the acoustic signal received from the outside of signal processing device 1 to first filter processor 302 a to n -th filter processor 302 n.
- First filter processor 302 a to n -th filter processor 302 n perform sound control processing for sound localization of acoustic signal S input from input 301 .
- First filter processor 302 a to n -th filter processor 302 n are, for example, finite impulse response (FIR) filters.
- FIR finite impulse response
- first filter processor 302 a to n -th filter processor 302 n are not limited to the FIR filters and may be for example, infinite impulse response (IIR) filters or a combination of FIR filters and IIR filters.
- the transfer functions of the filter processors may be designed in the frequency domain or in the time domain employing the least-squares method.
- First filter processor 302 a to n -th filter processor 302 n may not have fixed filter coefficients and may be adaptive filters with filter coefficients variable over time in accordance with feedback, for example.
- Storage device 304 stores the filter coefficients for first filter processor 302 a to n -th filter processor 302 n to perform the sound control processing.
- the filter coefficients are generated under a plurality of hearing conditions.
- the hearing conditions are, for example, the conditions of a plurality of physically closer hearing positions or the size of the head of the hearer.
- the filter coefficients of first filter processor 302 a to n -th filter processor 302 n are stored in a coefficient table, which includes, for example, first filter processor 302 a to n -th filter processor 302 n in association with the filter coefficients.
- Coefficient setter 305 sets the filter coefficients for first filter processor 302 a to n -th filter processor 302 n .
- Coefficient setter 305 reads the filter coefficients from storage device 304 and sets the coefficients for the filter processors.
- Output data selector 402 selects, out of the output signals (i.e., the output data) subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n , those to be output through left speaker 201 and right speaker 202 .
- output data selector 402 includes a plurality of gain adjusters, adder 421 , and adder 422 .
- adder 421 is a first adder
- adder 422 is a second adder.
- Output data selector 402 outputs the selected output data to output 405 . Note that a configuration and an operation of output data selector 402 will be described later in more detail.
- Controller 401 causes output data selector 402 to select the output data to be output through left speaker 201 and right speaker 202 . Controller 401 adjusts the respective gains set for the gain adjusters. Specifically, controller 401 performs control for switching the respective gains set for the gain adjusters and multiplying the gains by the output data. Controller 401 causes output data selector 402 to switch the output data based on predetermined times for switching the output data.
- timer 403 the times for output data selector 402 to switch/select the output data are set in advance.
- Counter 404 counts elapsed times.
- timer 403 and counter 404 are time measurers that monitor the times for output data selector 402 switching the output data.
- counter 404 notifies controller 401 of the elapse of time. Note that timer 403 and counter 404 may be included inside controller 401 or may be attached outside controller 401 .
- Acoustic signal S is input through input 301 and subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n .
- coefficient setter 305 reads the filter coefficients of first filter processor 302 a to n -th filter processor 302 n from the coefficient table stored in storage device 304 , and sets the coefficients for first filter processor 302 a to n -th filter processor 302 n.
- first filter processor 302 a to n -th filter processor 302 n are designed based on Expression (1) under different conditions.
- the output signals, that is, the output data subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n are input to output data selector 402 .
- output data selector 402 selects the output data subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n to be output through left speaker 201 and right speaker 202 .
- the selector outputs then the selected output data to output 405 .
- the output data output to output 405 are as acoustic signals output through left speaker 201 and right speaker 202 .
- the expression “selects the output data” is also referred to as “switches the output data”.
- the expression “selects the output data” or “switches the output data” specifically means switching the gains of gain adjusters 412 a to 412 n located in output data selector 402 and multiplying, at gain adjusters 412 a to 412 n , the gains by the acoustic signal subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n.
- FIG. 2 shows here example hearing positions in designing first filter processor 302 a to n -th filter processor 302 n according to this embodiment.
- FIG. 2 shows example design conditions of the filter coefficient, under which the filter coefficients are designed while changing the hearing positions.
- FIG. 2 shows an example of hearer 100 and the hearing positions as viewed from the left ear of hearer 100 .
- Hearing positions 1001 , 1002 and 1003 are supposed positions in which the left ear of hearer 100 is supposed to be located.
- the filter coefficients are designed in the positions in which hearer 100 is supposed to hear the sound. That is, the hearing conditions for generating the filter coefficients include at least the information on the hearing positions to which the hearer is likely to move.
- the interval between the hearing positions shown in FIG. 2 is, for example, 5 cm.
- the filter coefficients are stored, in the coefficient table, in storage device 304 of FIG. 1 .
- the filter coefficients designed in this manner are set for first filter processor 302 a to n -th filter processor 302 n shown in FIG. 1 by coefficient setter 305 .
- FIG. 3 is a block diagram showing a configuration of output data selector 402 according to this embodiment.
- Output data selector 402 includes a plurality of gain adjusters, adder 421 , and adder 422 .
- the gain adjusters are provided, for example, in the same number as the filter processors in one to one correspondence.
- output data selector 402 includes, as the plurality of gain adjusters, gain adjusters 412 a , 412 b , . . . , and 412 n .
- Gain adjusters 412 a , 412 b , . . . , and 412 n correspond to first filter processor 302 a , second filter processor 302 b , . . . , and n-th filter processor 302 n , respectively.
- gain adjusters 412 a , 412 b , . . . , and 412 n may be collectively referred to as “gain adjusters 412 a to 412 n”.
- gain adjusters 412 a to 412 n multiply the gains by the acoustic signal subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n . More specifically, the acoustic signal output from left speaker 201 are multiplied by the gain independently from the acoustic signal output from right speaker 202 . In addition, the acoustic signal output from left speaker 201 and the acoustic signal output from right speaker 202 are multiplied by the same gain.
- controller 401 receives the information on the timing for switching the gains of gain adjusters 412 a to 412 n from timer 403 and counter 404 . Controller 401 changes then the values of gains g1, g2, . . . , and gn set for gain adjusters 412 a to 412 n of output data selector 402 at the obtained timing. Gain adjusters 412 a to 412 n multiply the gains by the output data processed by the filter processors. In this manner, output data selector 402 selects the output data to be output through left speaker 201 and right speaker 202 .
- the output data to be output through left speaker 201 is added by adder 421 .
- the output data to be output through right speaker 202 is added by adder 422 .
- the output data added by adders 421 and 422 is output as the acoustic signals through left speaker 201 and right speaker 202 .
- FIG. 4 shows example acoustic signals obtained by output data selector 402 according to this embodiment.
- the horizontal axis represents the time
- the vertical axis represents the amplitude levels of the output signals.
- the upper stage represents the output data for left speaker 201
- the lower stage represents the output data for right speaker 202 .
- the output data selected by output data selector 402 is output.
- signal processing device 1 performs control for switching the output data at times t( 0 ), t( 1 ), . . . , and t( 5 ).
- the transition periods between times t( 0 ), t( 1 ), . . . , and t( 5 ) are constant.
- the output data from first filter processor 302 a to n -th filter processor 302 n may be switched at certain times, selected sequentially, and output to output 405 .
- Each time interval (i.e., the time difference) ⁇ t for switching the output data is set to a value ranging, for example, from about 0.1 seconds to about 0.5 seconds, depending on the type and length of input acoustic signal S. If acoustic signal S indicates meaningful wording (e.g., “dangerous” or “there is an obstacle”), each time interval may be a continuous time causing the hearer to hear the wording at least once. If acoustic signal S serves as an intermittent alarm, the time interval may be shortened in accordance with the continuous time of the alarm for one period.
- FIG. 5 shows example gain settings for gain adjusters 412 a to 412 n of output data selector 402 according to Embodiment 1.
- FIG. 6 shows superposition of two of the gains of gain adjusters 412 a to 412 n shown in FIG. 5 .
- An example has been described in FIGS. 3 and 4 where the outputs of first filter processor 302 a to n -th filter processor 302 n are switched at the switch timing.
- out of the gains of gain adjusters 412 a to 412 n those set for two filter processors continuously output the signals are cross-faded. This reduces the noises generated at the switch timing.
- gains g1 and g2 are cross-faded as indicated by the straight lines in the transition period from time t( 1 ) to time t( 1 )′. Instead, gains g1 and g2 may be cross-faded as indicated by sine- or cosine-squared curves.
- the transition period (e.g. from time t( 1 ) to time t( 1 )′) shown in FIG. 6 is generally set to a value smaller than time difference ⁇ t, but is not limited thereto.
- FIG. 7 is a flow chart showing an operation of signal processing device 1 according to this embodiment.
- coefficient setter 305 reads the filter coefficients from storage device 304 (step S 10 ). The read filter coefficients are then set for first filter processor 302 a to n -th filter processor 302 n (coefficient setting processing) (step S 11 ).
- Acoustic signal S starts then to be input to first filter processor 302 a to n -th filter processor 302 n (step S 12 ).
- Input acoustic signal S is subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n (filter processing).
- controller 401 inputs control information to output data selector 402 and causes the selector to select the output signals (control processing) (step S 13 ).
- output data selector 402 sequentially selects, as the output data, the acoustic signal subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n (output data selecting processing) (step S 14 ).
- the selected output data is then output from output data selector 402 to output 405 .
- the output data output to output 405 is output as an acoustic signal through selected left speaker 201 or right speaker 202 (step S 15 ).
- Counter 404 counts the time while outputting the output data to detect whether the time for switching/selecting the output data set at timer 403 has elapsed (time measuring processing) (step S 16 ).
- controller 401 causes output data selector 402 to switch the output data and repeats steps S 13 , S 14 , and S 15 .
- step S 13 the control information is input to output data selector 402 .
- step S 14 output data selector 402 selects the output data.
- step S 15 the acoustic signal after the filter processing is output. If the time for switching/selecting the output data set at timer 403 has elapsed, signal processing device 1 may end the processing or may repeat the processing in step S 10 to step S 15 again without ending the processing.
- step S 16 If the time for switching/selecting the output data set at timer 403 has not elapsed (No in step S 16 ), the selected output data continues to be output (step S 15 ).
- the sound is sequentially localized to the hearing positions shown in FIG. 2 . That is, the sound sequentially moves among the hearing positions.
- hearer 100 recognizes the acoustic signal at any time in any one of the hearing positions.
- Signal processing device 1 processes acoustic signal S in the operation shown in the flow chart in FIG. 7 . This causes hearer 100 to hear the sounds output any time from left speaker 201 and right speaker 202 and suitable for the hearing position. Accordingly, signal processing device 1 gives hearer 100 desired sound control effects.
- signal processing device 2 according to Embodiment 2 will be described. Different from signal processing device 1 according to Embodiment 1, signal processing device 2 according to this embodiment sets the range of the filter coefficients for use.
- FIG. 8 is a block diagram showing an example configuration of the signal processing system according to this embodiment.
- the signal processing system according to this embodiment includes signal processing device 2 , left speaker 201 , and right speaker 202 .
- left speaker 201 and right speaker 202 have the configurations the same or similar to left speaker 201 and right speaker 202 shown in Embodiment 1 and the explanation thereof will thus be omitted.
- signal processing device 2 includes auxiliary information input 501 , auxiliary information analyzer 502 , and coefficient range selector 503 in addition to the configuration of signal processing device 1 shown in FIG. 1 .
- Auxiliary information input 501 receives auxiliary information for selecting the range of the filter coefficients set for first filter processor 302 a to n -th filter processor 302 n .
- the auxiliary information relates to the hearing position of hearer 100 for selecting the range of the filter coefficients set for first filter processor 302 a to n -th filter processor 302 n by coefficient setter 305 .
- the auxiliary information may include, for example, the information on both the ear positions of hearer 100 or the information on the seated position of hearer 100 .
- the auxiliary information may include the information on the position of the seat on which hearer 100 is seated.
- the auxiliary information may be controller area network (CAN) information including the information on the position of the seat for hearer 100 or image information obtained by a vehicle interior camera placed in a drive recorder, for example.
- CAN controller area network
- Auxiliary information analyzer 502 analyzes the input auxiliary information and extracts, out of the auxiliary information, the information useful for detecting the hearing position of hearer 100 .
- the input auxiliary information is the CAN information
- auxiliary information analyzer 502 analyzes the input CAN information and obtains the information on the position of the seat from the input CAN information.
- the input auxiliary information is the image information from the drive recorder.
- auxiliary information analyzer 502 analyzes the image information using a technique such as an image recognition technique to recognize the position of the face of the driver and extracts the information on the hearing position of the driver.
- coefficient range selector 503 selects one of the filter coefficients stored in storage device 304 for use and the range (i.e., the coefficient range) of the filter coefficient for use. Coefficient range selector 503 inputs the filter coefficient within the selected coefficient range to coefficient setter 305 .
- FIG. 9 shows an example of hearing positions and a group of hearing positions in designing first filter processor 302 a to n -th filter processor 302 n according to this embodiment. More specifically, FIG. 9 shows example settings of the range of the filter coefficients for use set by coefficient range selector 503 . Like the hearing positions shown in FIG. 2 , FIG. 9 shows an example of hearer 100 and expected hearing positions in designing first filter processor 302 a to n -th filter processor 302 n as viewed from the left ear of hearer 100 .
- storage device 304 stores a plurality of filter coefficients designed under a plurality of hearing conditions shown as the hearing positions in FIG. 9 .
- the filter coefficients stored in storage device 304 are classified into groups depending on the respective hearing positions. For example, assume that the hearer is located in position A as a result of analysis on the auxiliary information obtained by auxiliary information analyzer 502 .
- coefficient range selector 503 inputs, to coefficient setter 305 , as the coefficient range, the information indicating the use of the filter coefficients of the hearing positions included in first group 1101 to which A belongs.
- each group such as first group 1101 or second group 1102 , for setting the coefficient range may include the filter coefficients designed in physically closer hearing positions or the filter coefficients designed by changing the size of the head.
- the group for setting the coefficient range may be designed by combining the plurality of hearing conditions. For example, the hearing position may be classified as a first group, while the size of the head may be classified as the a-th group.
- coefficient setter 305 Upon receipt of the output result of coefficient range selector 503 , coefficient setter 305 reads the coefficients of the corresponding group from storage device 304 and sets the coefficients for first filter processor 302 a to n -th filter processor 302 n . For example, in the example group shown in FIG. 9 , the coefficients set under nine conditions (i.e., hearing positions) included in first group 1101 are set for first filter processor 302 a to n -th filter processor 302 n.
- Each of first filter processor 302 a to n -th filter processor 302 n performs the sound control processing of input acoustic signal S and input the processed signal to output data selector 402 .
- Operations (i.e., gain settings) of gain adjusters 412 a to 412 n of output data selector 402 are as shown in FIGS. 5 and 6 .
- FIG. 10 is a flow chart showing an operation of signal processing device 2 according to this embodiment.
- auxiliary information input 501 obtains the auxiliary information (obtainment of auxiliary information) (step S 20 ).
- auxiliary information analyzer 502 analyzes the input auxiliary information and extracts, out of the auxiliary information, the information useful for detecting the hearing position of hearer 100 (step S 21 ).
- coefficient range selector 503 selects one of the filter coefficients stored in storage device 304 for use and the coefficient range for use (selection of a coefficient range) (step S 22 ).
- coefficient setter 305 Based on the coefficient range selected by coefficient range selector 503 , coefficient setter 305 reads the filter coefficients from storage device 304 (step S 23 ). Subsequently, coefficient setter 305 sets the filter coefficients for first filter processor 302 a , second filter processor 302 b , . . . , and n-th filter processor 302 n (step S 24 ).
- acoustic signal S starts to be input to input 301 (step S 25 ).
- Input acoustic signal S is subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n .
- Controller 401 inputs then the control information to output data selector 402 (step S 26 ).
- output data selector 402 Based on the control information input from controller 401 , output data selector 402 sequentially selects, as the output data, the acoustic signal subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n (step S 27 ). The selected output data is then output from output data selector 402 to output 405 . The output data output to output 405 is output as an acoustic signal through left speaker 201 or right speaker 202 based on the selected output data (step S 28 ).
- counter 404 counts the time to detect whether the predetermined time for switching/selecting the output data set at timer 403 has elapsed (step S 29 ).
- controller 401 causes output data selector 402 to switch the output data and repeats step S 26 , step S 27 , and step S 28 .
- step S 26 the control information is input to output data selector 402 .
- step S 27 output data selector 402 selects the output data.
- step S 28 the acoustic signal after the filter processing is output. If the time for switching/selecting the output data set at timer 403 has not elapsed (No in step S 29 ), the selected output data continues to be output (step S 28 ).
- auxiliary information analyzer 502 detects a change in the auxiliary information (Yes in step S 30 ), auxiliary information analyzer 502 analyzes the auxiliary information again (step S 21 ) and repeats the operation in step S 22 to step S 30 . If auxiliary information analyzer 502 detects no change in the auxiliary information (No in step S 30 ), signal processing device 2 ends the processing. If auxiliary information analyzer 502 detects no change in the auxiliary information, signal processing device 2 may end the processing or repeat the processing in step S 20 to step S 30 again without ending the processing.
- the sound is sequentially localized to the hearing positions within in first group 1101 shown in FIG. 9 . That is, the sound sequentially moves among the hearing positions within first group 1101 .
- hearer 100 recognizes the acoustic signal at any time in any one of the hearing positions.
- Signal processing device 2 processes acoustic signal S in the operation shown in the flow chart in FIG. 10 . Accordingly signal processing device 2 selects and uses one of the filter coefficients within the group extracted from the filter coefficients stored in storage device 304 based on the auxiliary information input to auxiliary information input 501 . This causes signal processing device 2 to hinder the use of the filter coefficients that hardly provide the sound localization control effects. Accordingly, signal processing device 2 gives hearer 100 desired sound control effects.
- signal processing device 3 changes the switch timing of the acoustic signal output from left speaker 201 and right speaker 202 in accordance with the power of input acoustic signal S.
- FIG. 11 is a block diagram showing an example configuration of the signal processing system according to this embodiment.
- the signal processing system according to this embodiment includes signal processing device 3 , left speaker 201 , and right speaker 202 .
- left speaker 201 and right speaker 202 have the configurations the same or similar to left speaker 201 and right speaker 202 shown in Embodiment 1 and the explanation thereof will thus be omitted.
- signal processing device 3 includes acoustic signal analyzer 601 in addition to the configuration of signal processing device 1 shown in FIG. 1 .
- Acoustic signal analyzer 601 analyzes the power of input acoustic signal S. Acoustic signal analyzer 601 inputs the result of analysis to controller 401 . Based on the power of acoustic signal S analyzed by acoustic signal analyzer 601 , controller 401 sets the timing for switching the output data selected by output data selector 402 .
- the power of acoustic signal S is, for example, the amplitude of acoustic signal S expressed by a decibel. Specifically, the power is a parameter that may be expressed as 20 log 10
- FIG. 12 is a block diagram showing a configuration of acoustic signal analyzer 601 according to this embodiment. As shown in FIG. 12 , acoustic signal analyzer 601 includes power detector 611 and determiner 612 .
- Power detector 611 detects the power of acoustic signal S.
- Determiner 612 determines whether the power of acoustic signal S is higher than or equal to a threshold.
- the power of acoustic signal S input from input 301 to acoustic signal analyzer 601 is detected by power detector 611 of acoustic signal analyzer 601 . Based on the detection result, determiner 612 determines whether the power detected by power detector 611 is over a certain threshold, and outputs the determination result to controller 401 .
- the certain threshold is here, for example, the minimum power value for acoustic signal S to be recognized as an auditory effective acoustic signal.
- the environmental sound such as the sound of a fan is not regarded as the auditory effective acoustic signal but is background noise.
- the threshold of the power of the acoustic signal may be at a level that allows detection of the input of auditory effective signals, for example, at a level obtained by adding 6 dB to the level of the acoustic signal of the background noise.
- controller 401 that receives the result of determining the power of acoustic signal S from determiner 612 causes output data selector 402 to perform the output data selecting operation.
- This output data selecting operation is performed when the power of acoustic signal S is over the threshold and is not necessarily performed at a certain time interval unlike the selecting operation by signal processing device 1 shown in Embodiment 1. That is, the gains of gain adjusters 412 a to 412 n are switched not at a certain time interval but in accordance with the magnitude of the power of input acoustic signal S.
- FIG. 13 shows example acoustic signals obtained by output data selector 402 in using acoustic signal analyzer 601 according to this embodiment.
- the horizontal axis represents the time
- the vertical axis represents the amplitude levels of the output signals.
- the upper stage represents the output data for left speaker 201
- the lower stage represents the output data for right speaker 202 .
- FIG. 13 (a) to (c) show example timing for switching the reproduced sounds.
- the output data selected by output data selector 402 is output.
- the vertical arrows shown in FIG. 13 represent the times for controller 401 to perform the switching operation of the reproduced sound.
- signal processing device 3 performs control for switching the output data at times t( 10 ), t( 11 ), . . . , and t( 15 ).
- the transition periods between times t( 10 ), t( 11 ), . . . , and t( 15 ) are not constant but controlled by controller 401 .
- Controller 401 controls the timing for switching the output data based on the control information generated by acoustic signal analyzer 601 .
- acoustic signal analyzer 601 determines whether the power of input acoustic signal S changes from a value smaller than a threshold to reach and exceed the threshold. Based on the determination result, controller 401 generates the control information for controlling the timing at which output data selector 402 selects the output data. For example, assume that the power of input acoustic signal S changes from a value smaller than the threshold to a value greater than or equal to the threshold. In this case, acoustic signal analyzer 601 switches the gains of gain adjusters 412 a to 412 n of output data selector 402 .
- acoustic signal analyzer 601 generates the control information not to switch the gains of gain adjusters 412 a to 412 n of output data selector 402 .
- Controller 401 causes output data selector 402 using the control information. Accordingly, the outputs of first filter processor 302 a to the n-th filter processor are not switched in the period when the power of acoustic signal S does not exceed the threshold. On the other hand, the outputs of first filter processor 302 a to the n-th filter processor are switched in the period when the power of acoustic signal S has an auditory effective magnitude.
- the power of input acoustic signal S may change from a value smaller than the threshold to be a value greater than or equal to the threshold immediately after the start of the input and remain over the threshold.
- Counter 404 counts the time elapsed after switching the output data. In the case that the time period when the power of acoustic signal S is greater than or equal to the threshold continues for the time set in advance at timer 403 , controller 401 may perform the control for switching the output of first filter processor 302 a to n -th filter processor 302 n.
- acoustic signal analyzer 601 may use the following as conditions for determining acoustic signal S for setting the switch timing.
- the determination conditions are that the power of acoustic signal S is greater than or equal to the threshold and that the time when the filter processor is selected is over ⁇ t2.
- ⁇ t2 may be set to a time causing the hearer to recognize that acoustic signal S is an alarm, for example, ranging from 0.1 seconds to 0.5 seconds. Note that ⁇ t2 is not limited thereto and may change in accordance with the type of the acoustic signal.
- FIG. 14 is a flow chart showing an operation of signal processing device 3 according to this embodiment.
- coefficient setter 305 reads the filter coefficients from storage device 304 (step S 40 ). The read filter coefficients are then set for first filter processor 302 a to n -th filter processor 302 n (step S 41 ).
- acoustic signal S starts to be input to first filter processor 302 a to n -th filter processor 302 n (step S 42 ).
- Input acoustic signal S is subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n.
- Acoustic signal S is then analyzed by acoustic signal analyzer 601 whether the power of acoustic signal S is greater than the threshold set in advance (power detection) (step S 43 ). Based on the result of analysis by acoustic signal analyzer 601 , controller 401 generates the control information for causing output data selector 402 to switch the output data (step S 44 ). The control information generated by controller 401 is input from controller 401 to output data selector 402 (step S 45 ).
- output data selector 402 sequentially selects, as the output data, the acoustic signal subjected to the sound control processing by first filter processor 302 a to n -th filter processor 302 n (step S 46 ).
- the selected output data is then output from output data selector 402 to output 405 .
- the output data output to output 405 is output as an acoustic signal through left speaker 201 or right speaker 202 based on the selected output data (step S 47 ).
- Power detector 611 detects the power of acoustic signal S. Based on the detection result, determiner 612 detects whether the power of acoustic signal S changes from a value smaller than the threshold to a value greater than or equal to the threshold (step S 48 ). If the power of acoustic signal S changes from a value smaller than the threshold to a value greater than or equal to the threshold (Yes in step S 48 ), controller 401 generates the control information to switch the output data (step S 44 ). If the power of acoustic signal S does not change from a value smaller than the threshold to a value greater than or equal to the threshold (No in step S 48 ), counter 404 counts the time for outputting the output data. It is then detected whether the time for switching/selecting the output data set at timer 403 has elapsed (step S 49 ).
- controller 401 causes output data selector 402 to switch the output data and performs step S 43 , step S 44 , step S 45 , step S 46 , and step S 47 are performed.
- step S 43 the power of acoustic signal S is analyzed.
- step S 44 controller 401 generates the control signal.
- step S 45 from controller 401 , the control information is input.
- step S 46 output data selector 402 selects the output data.
- step S 47 the acoustic signal after the filter processing is output.
- step S 49 If the time for switching/selecting the output data set at timer 403 has not elapsed (No in step S 49 ), the selected output data continues to be output (step S 47 ). If the time for switching/selecting the output data set at timer 403 has not elapsed, signal processing device 3 may end the processing or repeat the processing in step S 40 to step S 49 again without ending the processing.
- signal processing device 3 performs control for switching the output data, if the power of input acoustic signal S changes from a value smaller than the threshold to a value greater than or equal to the threshold.
- the device performs control for maintaining the output data without switching the data, if the power of acoustic signal S does not change from a value smaller than the threshold to a value greater than or equal to the threshold. If the power of acoustic signal S does not change from a value smaller than the threshold to be a value greater than or equal to the threshold for a long time, the device performs control for switching the output data when the time for switching/selecting the output data has elapsed. As a result, hearer 100 recognizes the acoustic signal at any time in any one of the hearing positions.
- Signal processing device 3 processes acoustic signal S in the operation shown in the flow chart in FIG. 14 .
- acoustic signal analyzer 601 analyzes input acoustic signal S to control the timing for switching the output data. Accordingly, signal processing device 3 switches the output data, gives hearer 100 sound control effects and causes the hearer to recognize the acoustic signal in the period when the auditory effective acoustic signal is generated or, if no auditory effective acoustic signal is generated, when the time for switching/selecting the output data has elapsed.
- the signal processing device has been described above based on the embodiments.
- the present disclosure is however not limited to the embodiments.
- the constituent elements according to the present disclosure may be freely combined or some of the constituent elements may be excluded to form another embodiment of the present disclosure.
- the present disclosure includes variations obtained by variously modifying the embodiments as conceived by those skilled in the art without departing from the scope and spirit of the present disclosure, that is, the meaning of the wording in the claims.
- the filter processors may be FIR filters, IIR filters, or a combination of FIR filters and IIR filters. Having been described where the filter processors are designed in the frequency domain, the method is not limited thereto. The method of obtaining least squares in the time domain may be employed. In addition, the filters may not be fixed filters but adaptive filters.
- the configuration is not limited thereto.
- the device may include only one filter processor whose filter coefficient may be varied by the coefficient setter as appropriate for use. If the device includes IIR filters, the variation in the filter coefficient may cause oscillations. At least two or more filter processors are desired to be used in turn.
- the output data selector includes three or more gain adjusters
- the configuration is not limited thereto.
- the device may include only one gain adjuster whose gain may be varied by the controller as appropriate.
- FIG. 5 shows the example operation of the output data selector switching the outputs of the filter processors and outputting the selected output.
- FIGS. 5 and 6 show the example of cross-fading and smoothly switching the gains. These configurations are clearly also applicable to Embodiments 2 and 3.
- Left speaker 201 and right speaker 202 may be multi-way speakers including units such as a tweeter, a squawker, and a woofer associated with the frequencies of signals to be reproduced.
- the speakers may include the units in individual cases spaced apart from each other.
- the speakers may include a subwoofer capable of reproducing low-frequency effect (LFE) signals.
- LFE low-frequency effect
- Left speaker 201 and right speaker 202 may be included in each of the signal processing devices.
- the filter processors may include, at the input stage or the output stage, configurations that perform effect processing such as delays, reverbs, or echoes in addition to the processing described above in the embodiments.
- Examples may be an equalizer or a filter that adjusts frequency characteristics and a gain or an auto gain controller (AGC) that adjusts output amplitudes. At this time, the even characteristics are desired to be multiplied by the outputs of the right and left speakers.
- AGC auto gain controller
- the signal processing device has been described above based on the embodiments.
- the present disclosure is however not limited to the embodiments.
- the present disclosure includes other embodiments, such as those obtained by variously modifying the embodiments as conceived by those skilled in the art or those achieved by freely combining the constituent elements in the different embodiments without departing from the scope and spirit of the present disclosure.
- the constituent elements of the signal processing device may be dedicated hardware devices or may be achieved by executing software programs suitable for the constituent elements.
- the constituent elements may be achieved by a program executor, such as a CPU or a processor, reading and executing software programs stored in a storage medium such as a hard disk or a semiconductor memory.
- the constituent elements may be LSI circuits, dedicated circuits, general-purpose processors, FPGAs, or reconfigurable processors capable of reconfiguring connections and setting of circuit cells inside an LSI circuit.
- a D/A converter that converts digital signals into analog signals, an amplifier that amplifies the signals when outputting the signals through the speakers, and other elements have been omitted for simplification. Needless to mention, even if these elements may be software or hardware and output signals through the speakers, the effects of the present disclosure will not change.
- the signal processing device is applicable as a signal processing device that processes signals at acoustic equipment for generating alarms, or in-vehicle or in-room acoustic equipment, for example.
Abstract
Description
- [PTL 1] Japanese Patent No. 5944567
- [NPL 1] Spatial Hearing, Jens Blauert, Masayuki Morimoto, Toshiyuki Goto, Kajima Publishing
Claims (12)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2017/043369 WO2019106848A1 (en) | 2017-12-01 | 2017-12-01 | Signal processing device and signal processing method |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2017/043369 Continuation WO2019106848A1 (en) | 2017-12-01 | 2017-12-01 | Signal processing device and signal processing method |
Publications (2)
Publication Number | Publication Date |
---|---|
US20200288264A1 US20200288264A1 (en) | 2020-09-10 |
US11310621B2 true US11310621B2 (en) | 2022-04-19 |
Family
ID=66664809
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/884,806 Active US11310621B2 (en) | 2017-12-01 | 2020-05-27 | Signal processing device and signal processing method for performing sound localization processing |
Country Status (5)
Country | Link |
---|---|
US (1) | US11310621B2 (en) |
EP (1) | EP3720148A4 (en) |
JP (1) | JP6973501B2 (en) |
CN (1) | CN111406414B (en) |
WO (1) | WO2019106848A1 (en) |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0430700A (en) | 1990-05-24 | 1992-02-03 | Roland Corp | Sound image localization device and sound field reproducing device |
EP0762804A2 (en) | 1995-09-08 | 1997-03-12 | Fujitsu Limited | Three-dimensional acoustic processor which uses linear predictive coefficients |
US5844993A (en) * | 1995-01-25 | 1998-12-01 | Victor Company Of Japan, Ltd. | Surround signal processing apparatus |
US20010005824A1 (en) | 1999-12-24 | 2001-06-28 | Naoyuki Kato | Sound image localization apparatus |
US6804358B1 (en) * | 1998-01-08 | 2004-10-12 | Sanyo Electric Co., Ltd | Sound image localizing processor |
JP2008113118A (en) | 2006-10-05 | 2008-05-15 | Sony Corp | Sound reproduction system and method |
US20080219454A1 (en) * | 2004-12-24 | 2008-09-11 | Matsushita Electric Industrial Co., Ltd. | Sound Image Localization Apparatus |
US20090043411A1 (en) | 2007-08-06 | 2009-02-12 | Sony Corporation | Information processing device, information processing method, and program |
US20090141903A1 (en) * | 2004-11-24 | 2009-06-04 | Panasonic Corporation | Sound image localization apparatus |
US20120328108A1 (en) | 2011-06-24 | 2012-12-27 | Kabushiki Kaisha Toshiba | Acoustic control apparatus |
JP2016015759A (en) | 2011-06-24 | 2016-01-28 | 株式会社東芝 | Acoustic control device, filter device, and acoustic control method |
CN106303836A (en) | 2016-11-15 | 2017-01-04 | 广东小天才科技有限公司 | A kind of method and device regulating played in stereo |
CN106797525A (en) | 2014-08-13 | 2017-05-31 | 三星电子株式会社 | For generating the method and apparatus with playing back audio signal |
WO2017158338A1 (en) * | 2016-03-14 | 2017-09-21 | University Of Southampton | Sound reproduction system |
US20170359467A1 (en) * | 2016-06-10 | 2017-12-14 | Glen A. Norris | Methods and Apparatus to Assist Listeners in Distinguishing Between Electronically Generated Binaural Sound and Physical Environment Sound |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5944567B2 (en) | 1976-01-19 | 1984-10-30 | フセソユ−ズヌイ、ナウチノ、イスレドワ−チエレスキ−、イ、コンストルクトルスキ−、インスチツ−ト、〃ツベトメタフトマチカ〃 | Thickness measuring device for thin plate materials |
JPH09182200A (en) * | 1995-12-22 | 1997-07-11 | Kawai Musical Instr Mfg Co Ltd | Device and method for controlling sound image |
US6173061B1 (en) * | 1997-06-23 | 2001-01-09 | Harman International Industries, Inc. | Steering of monaural sources of sound using head related transfer functions |
EP3026936B1 (en) * | 2013-07-24 | 2020-04-29 | Sony Corporation | Information processing device and method, and program |
-
2017
- 2017-12-01 WO PCT/JP2017/043369 patent/WO2019106848A1/en unknown
- 2017-12-01 JP JP2019556530A patent/JP6973501B2/en active Active
- 2017-12-01 EP EP17933807.4A patent/EP3720148A4/en active Pending
- 2017-12-01 CN CN201780097230.6A patent/CN111406414B/en active Active
-
2020
- 2020-05-27 US US16/884,806 patent/US11310621B2/en active Active
Patent Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0430700A (en) | 1990-05-24 | 1992-02-03 | Roland Corp | Sound image localization device and sound field reproducing device |
JP3059191B2 (en) * | 1990-05-24 | 2000-07-04 | ローランド株式会社 | Sound image localization device |
US5844993A (en) * | 1995-01-25 | 1998-12-01 | Victor Company Of Japan, Ltd. | Surround signal processing apparatus |
EP0762804A2 (en) | 1995-09-08 | 1997-03-12 | Fujitsu Limited | Three-dimensional acoustic processor which uses linear predictive coefficients |
US6804358B1 (en) * | 1998-01-08 | 2004-10-12 | Sanyo Electric Co., Ltd | Sound image localizing processor |
US20010005824A1 (en) | 1999-12-24 | 2001-06-28 | Naoyuki Kato | Sound image localization apparatus |
JP2001186600A (en) | 1999-12-24 | 2001-07-06 | Matsushita Electric Ind Co Ltd | Sound image localization device |
US20090141903A1 (en) * | 2004-11-24 | 2009-06-04 | Panasonic Corporation | Sound image localization apparatus |
US20080219454A1 (en) * | 2004-12-24 | 2008-09-11 | Matsushita Electric Industrial Co., Ltd. | Sound Image Localization Apparatus |
JP2008113118A (en) | 2006-10-05 | 2008-05-15 | Sony Corp | Sound reproduction system and method |
US20090043411A1 (en) | 2007-08-06 | 2009-02-12 | Sony Corporation | Information processing device, information processing method, and program |
JP2009044263A (en) | 2007-08-06 | 2009-02-26 | Sony Corp | Information processor, information processing method, and program |
US20120328108A1 (en) | 2011-06-24 | 2012-12-27 | Kabushiki Kaisha Toshiba | Acoustic control apparatus |
JP2016015759A (en) | 2011-06-24 | 2016-01-28 | 株式会社東芝 | Acoustic control device, filter device, and acoustic control method |
CN106797525A (en) | 2014-08-13 | 2017-05-31 | 三星电子株式会社 | For generating the method and apparatus with playing back audio signal |
US20170251323A1 (en) | 2014-08-13 | 2017-08-31 | Samsung Electronics Co., Ltd. | Method and device for generating and playing back audio signal |
WO2017158338A1 (en) * | 2016-03-14 | 2017-09-21 | University Of Southampton | Sound reproduction system |
US20170359467A1 (en) * | 2016-06-10 | 2017-12-14 | Glen A. Norris | Methods and Apparatus to Assist Listeners in Distinguishing Between Electronically Generated Binaural Sound and Physical Environment Sound |
CN106303836A (en) | 2016-11-15 | 2017-01-04 | 广东小天才科技有限公司 | A kind of method and device regulating played in stereo |
Non-Patent Citations (4)
Title |
---|
Chinese Office Action dated Dec. 23, 2020, issued in Chinese Patent Application No. 201780097230.6; with partial English translation. |
English machine translation of JP3059191B2 (Year: 2000). * |
Extended European Search Report dated Jun. 14, 2021 issued in the corresponding European Patent Application No. 17933807.4. |
International Search Report and Written Opinion, dated Feb. 13, 2018 in International Application No. PCT/JP2017/043369; with partial English translation. |
Also Published As
Publication number | Publication date |
---|---|
CN111406414B (en) | 2022-10-04 |
US20200288264A1 (en) | 2020-09-10 |
WO2019106848A1 (en) | 2019-06-06 |
EP3720148A4 (en) | 2021-07-14 |
JPWO2019106848A1 (en) | 2020-11-19 |
EP3720148A1 (en) | 2020-10-07 |
CN111406414A (en) | 2020-07-10 |
JP6973501B2 (en) | 2021-12-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4361354B2 (en) | Automatic sound field correction apparatus and computer program therefor | |
JP4167286B2 (en) | Reverberation adjustment device, reverberation correction method, and sound reproduction system | |
JP6301453B2 (en) | Spatially selective audio playback apparatus and method | |
US7822496B2 (en) | Audio signal processing method and apparatus | |
JP2006005902A (en) | Amplifier and amplitude frequency characteristics adjusting method | |
JP4435232B2 (en) | Audio system | |
JP2007043295A (en) | Amplifier and method for regulating amplitude frequency characteristics | |
US20150208169A1 (en) | Sound field correction apparatus, control method thereof, and computer-readable storage medium | |
JP4184420B2 (en) | Characteristic measuring device and characteristic measuring program | |
CN108476372B (en) | Measuring device and measuring method | |
CN109076302B (en) | Signal processing device | |
US9219455B2 (en) | Peak detection when adapting a signal gain based on signal loudness | |
JP4376035B2 (en) | Acoustic characteristic measuring apparatus, automatic sound field correcting apparatus, acoustic characteristic measuring method, and automatic sound field correcting method | |
US20050053246A1 (en) | Automatic sound field correction apparatus and computer program therefor | |
US11310621B2 (en) | Signal processing device and signal processing method for performing sound localization processing | |
JP3451022B2 (en) | Method and apparatus for improving clarity of loud sound | |
JPWO2009008068A1 (en) | Automatic sound field correction device | |
US10395668B2 (en) | System and a method for determining an interference or distraction | |
JP4408909B2 (en) | Sound field correction method in audio system | |
JP2012100117A (en) | Acoustic processing apparatus and method | |
EP2530952B1 (en) | Sound processing apparatus and parameter setting method | |
JP2008209491A (en) | Sound processing apparatus and sound processing method | |
JPWO2006009139A1 (en) | Test signal generator and sound reproduction system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SOCIONEXT INC., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ABE, KAZUTAKA;MIYASAKA, SHUJI;KOBAYASHI, KATSUMI;AND OTHERS;REEL/FRAME:052764/0535 Effective date: 20200519 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |