WO2024070165A1 - 音響装置、再生方法及びプログラム - Google Patents

音響装置、再生方法及びプログラム Download PDF

Info

Publication number
WO2024070165A1
WO2024070165A1 PCT/JP2023/027068 JP2023027068W WO2024070165A1 WO 2024070165 A1 WO2024070165 A1 WO 2024070165A1 JP 2023027068 W JP2023027068 W JP 2023027068W WO 2024070165 A1 WO2024070165 A1 WO 2024070165A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound
signal
level
reproduction
speaker
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2023/027068
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
裕之 狩野
康太 中橋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Management Co Ltd
Original Assignee
Panasonic Intellectual Property Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Management Co Ltd filed Critical Panasonic Intellectual Property Management Co Ltd
Priority to JP2024549784A priority Critical patent/JPWO2024070165A1/ja
Priority to CN202380068563.1A priority patent/CN119923869A/zh
Priority to EP23871408.3A priority patent/EP4578739A4/en
Publication of WO2024070165A1 publication Critical patent/WO2024070165A1/ja
Priority to US19/088,024 priority patent/US20250227412A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/22—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired frequency characteristic only 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • H04R3/04—Circuits for transducers for correcting frequency response
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • B60R11/0217—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof for loud-speakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/02—Casings; Cabinets ; Supports therefor; Mountings therein
    • H04R1/025—Arrangements for fixing loudspeaker transducers, e.g. in a box, furniture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • H04R3/12—Circuits for transducers for distributing signals to two or more loudspeakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R2011/0001—Arrangements for holding or mounting articles, not otherwise provided for characterised by position
    • B60R2011/0003—Arrangements for holding or mounting articles, not otherwise provided for characterised by position inside the vehicle
    • B60R2011/0012—Seats or parts thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/403—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers loud-speakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2410/00—Microphones
    • H04R2410/05—Noise reduction with a separate noise microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/01—Aspects of volume control, not necessarily automatic, in sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/20—Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/13—Acoustic transducers and sound field adaptation in vehicles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/02—Spatial or constructional arrangements of loudspeakers
    • H04R5/023—Spatial or constructional arrangements of loudspeakers in a chair, pillow

Definitions

  • the present invention relates to a technology that reproduces audio only in the vicinity of the listener.
  • Directional speakers have come to be used as audio devices that play music, voices, etc. only in specific locations.
  • Directional speakers are composed of a speaker array in which multiple speakers are arranged in a line, as described in Patent Document 1, for example.
  • Directional speakers adjust the level of the signal played by each speaker for each frequency so that the played sound can be heard only in a preset playback area.
  • Patent Document 1 describes adjusting the width of the playback area to narrower when the sound pressure of the playback sound leaking into the non-playback area exceeds the surrounding noise level. As a result, it is described that the sound pressure of the playback sound leaking into the non-playback area is suppressed to be lower than the surrounding noise level.
  • Patent Document 1 when suppressing the sound pressure of the playback sound leaking outside the playback area, the width of the playback area is adjusted to be narrower, which raises the risk that people at the edge of the playback area before the adjustment will not be able to hear the playback sound properly.
  • This disclosure has been made to solve the above problems, and aims to provide technology that allows the playback sound to be heard normally in the playback area, while preventing the playback sound from leaking outside the playback area from being recognized.
  • An acoustic device is an acoustic device that adjusts a playback sound reproduced by a speaker so that the playback sound is heard in a predetermined playback area, and includes a first generation unit that generates a background noise signal that indicates the environmental sound around the microphone based on a playback signal output from a sound source of the playback sound, a detection sound signal that indicates a detection sound detected by a microphone installed close to the speaker, and a first characteristic that is a transmission characteristic of an audio signal from the speaker to the microphone, a second generation unit that generates a leakage sound signal that indicates the playback sound heard at the representative point based on the playback signal and a second characteristic that is a transmission characteristic of an audio signal from the speaker to a representative point located outside the playback area, and an adjustment unit that adjusts the level of the playback signal so that the level of the leakage sound signal is smaller than the level of the background noise signal.
  • FIG. 1 is a top view illustrating an example of a configuration of an audio system according to a first embodiment.
  • 1 is a front view showing an example of a configuration of an audio system according to a first embodiment.
  • FIG. 11 is a diagram showing an example of frequency characteristics of a reproduced sound and background noise in a non-reproduced area.
  • FIG. 11 is a diagram showing an example of frequency characteristics of a reproduced sound and background noise in a non-reproduced area.
  • FIG. 4 is a diagram showing an example of frequency characteristics of a reproduced sound and background noise in a reproduction area.
  • FIG. 4 is a diagram showing an example of frequency characteristics of a reproduced sound and background noise in a reproduction area.
  • FIG. 4 is a diagram showing an example of frequency characteristics of a reproduced sound and background noise in a reproduction area.
  • FIG. 2 is a diagram illustrating an example of a detailed configuration of the audio system according to the first embodiment.
  • 4 is a flowchart showing an example of signal processing performed in the audio device.
  • 11A and 11B are diagrams illustrating an example of the transfer characteristic from a speaker to a microphone and the transfer characteristic from the speaker to a representative point of a non-playback area.
  • 1A and 1B are diagrams illustrating an example of a difference characteristic between two transfer characteristics and an approximation characteristic thereof;
  • 1A and 1B are diagrams illustrating an example of a difference characteristic between two transfer characteristics and an approximation characteristic thereof;
  • FIG. 11 is a diagram illustrating an example of a configuration of an audio system according to a modified example of the first embodiment.
  • FIG. 13 is a diagram illustrating an example of a configuration of an audio system according to another modified example of the first embodiment.
  • FIG. 13 is a diagram illustrating an example of a detailed configuration of an audio system according to another modified example of the first embodiment.
  • FIG. 11 is a diagram illustrating an example of a configuration of an audio system according to a second embodiment.
  • 11 is a diagram showing an example of the installation positions of a plurality of speakers and a plurality of microphones included in an audio system according to a second embodiment.
  • FIG. 11 is a diagram showing an example of the installation positions of a plurality of speakers and a plurality of microphones included in an audio system according to a second embodiment.
  • FIG. 13 is a front view showing another example of the installation positions of a plurality of speakers and a plurality of microphones included in the audio system according to the second embodiment.
  • FIG. 13 is a top view showing another example of the installation positions of a plurality of speakers and a plurality of microphones provided in the audio system according to the second embodiment.
  • FIG. 11 is a diagram illustrating an example of a detailed configuration of an audio system according to a second embodiment.
  • FIG. 11 is a diagram showing an example in which the audio system according to the second embodiment is applied to three seats.
  • FIG. 1 is a diagram showing an example of the configuration of an area reproduction system according to a conventional technique.
  • a conventional directional speaker is configured with a speaker array in which a large number of speakers are arranged in a line, as described in, for example, Patent Document 1.
  • Conventional directional speakers adjust the level of a signal reproduced by each speaker for each frequency so that the reproduced sound is heard only in a preset reproduction area.
  • FIG. 18 shows an example of the configuration of an area reproduction system 1000 according to the prior art. Specifically, as shown in FIG. 18, in the area reproduction system 1000, a processing unit 300 performs predetermined signal processing on an audio signal input from a sound source 10, and outputs the processed audio signal to a speaker array 9.
  • a control filter is convolved with the audio signal input from the sound source 10 to realize area playback under playback conditions specified by the user.
  • the control filter is derived using a predetermined formula (formula (7) in Patent Document 1) according to the playback conditions.
  • the playback conditions include the length L of the speaker array 9, the arrangement interval ⁇ x of each speaker 2a to 2h, the number of speakers 2a to 2h in the speaker array 9, the distance yref from the speaker array 9 to the playback area 100, and the width lb of the playback area 100.
  • the speaker array 9 reproduces the audio signal after signal processing by the processing unit 300. This allows the playback sound indicated by the audio signal to be clearly heard in the playback area 100. However, in reality, the playback sound also leaks into the non-playback areas 200a, 200b located outside the playback area 100. For this reason, it is difficult to set the playback sound level to "0" in the non-playback areas 200a, 200b. However, if the playback sound that leaks into the non-playback areas 200a, 200b (hereinafter referred to as the leakage sound) is smaller than the surrounding noise level, the leakage sound will be buried in the surrounding noise and will not be heard.
  • the leakage sound the playback sound that leaks into the non-playback areas 200a, 200b
  • the ambient noise level decreases or the playback sound level is set high while the playback sound is being played there is a risk that the leakage sound may be heard in the non-playback areas 200a, 200b.
  • the levels of the ambient noise and the playback sound are constantly fluctuating, if the playback sound level becomes relatively higher than the ambient noise level, there is a risk that the leakage sound may be heard in the non-playback areas 200a, 200b.
  • the ambient noise level is detected by microphone 3, and when the level of the leaking sound in non-playback areas 200a, 200b exceeds the level of the ambient background noise, an adjustment is made to narrow the width lb of the playback area 100. This keeps the level of the leaking sound below the level of the background noise, so that the leaking sound cannot be heard in the non-playback areas 200a, 200b even if the level of the background noise or the playback sound fluctuates.
  • Patent Document 1 does not take into consideration the use of multiple sound sources and allowing the sounds from each sound source to be heard individually in multiple playback areas.
  • Patent Document 1 does not explain how to suppress such sound leakage. Even if the technology for suppressing sound leakage in Patent Document 1 is adopted, the width of the playback area is narrowed, narrowing the range in which the playback sound can be properly heard at each seat. As a result, there is a risk that seated occupants will not be able to properly hear the playback sound.
  • the speaker array 9 is composed of N speakers 2a to 2h arranged in a row, it is difficult to reduce the size of the speaker array 9. For this reason, it is difficult to install a speaker array 9 in each of multiple adjacent seats in trains, airplanes, automobiles, etc.
  • the inventors therefore conducted extensive research into technology that would enable playback sound to be received normally within the playback area while preventing playback sound from leaking outside the playback area from being recognized, and came up with the various aspects of the present disclosure described below.
  • An audio device that adjusts a playback sound reproduced by a speaker so that the playback sound is heard in a predetermined playback area, and includes a first generation unit that generates a background noise signal that indicates an environmental sound around the microphone based on a playback signal output from a sound source of the playback sound, a detection sound signal that indicates a detection sound detected by a microphone installed near the speaker, and a first characteristic that is a transmission characteristic of an audio signal from the speaker to the microphone, a second generation unit that generates a leakage sound signal that indicates the playback sound heard at the representative point based on the playback signal and a second characteristic that is a transmission characteristic of an audio signal from the speaker to a representative point located outside the playback area, and an adjustment unit that adjusts the level of the playback signal so that the level of the leakage sound signal is smaller than the level of the background noise signal.
  • a background noise signal indicating the environmental sound around the microphone and a leakage sound signal indicating the playback sound received at a representative point located outside the playback area are generated, and the level of the playback signal is adjusted so that the level of the leakage sound signal is smaller than the level of the background noise signal.
  • the level of the playback signal is adjusted by comparing the level of the leakage sound signal, which indicates the playback sound received at a representative point located outside the playback area, with the level of the background noise signal, rather than the high-level playback sound detected by the microphone.
  • This allows the playback signal level to be adjusted appropriately without being adjusted excessively. This allows the playback sound to be received normally in the playback area.
  • this configuration can prevent playback sound leaking outside the playback area from being recognized by making the level of the playback sound received at the representative point indicated by the leakage sound signal lower than the level of the environmental sound around the microphone indicated by the background noise signal.
  • the adjustment unit may calculate a difference level that is the difference between the level of a target frequency component in the leakage sound signal, which is a frequency component having a level greater than that of the background noise signal, and the level of a frequency component in the background noise signal that corresponds to the target frequency component, and attenuate the level of the frequency component in the playback signal that corresponds to the target frequency component by more than the difference level.
  • the first generation unit generates a playback sound signal indicating the playback sound received at the installation position of the microphone based on the playback signal and the first characteristic, and generates a signal obtained by subtracting the playback sound signal from the detection sound signal as the background noise signal
  • the second generation unit may generate the leakage sound signal based on the playback sound signal and an approximation characteristic that approximates a difference characteristic between the first characteristic and the second characteristic.
  • the leakage sound signal is generated based on the reproduced sound signal generated by the first generation unit and an approximation characteristic that approximates the difference characteristic between the first characteristic and the second characteristic. Therefore, this configuration can reduce the size of the configuration and the amount of calculation required to generate the leakage sound signal compared to when the leakage sound signal is generated based on the reproduced signal and the second characteristic.
  • the approximation characteristics may indicate that the levels of each of a plurality of frequency components in the audio signal are constant.
  • the approximation characteristics indicate that the levels of each of the multiple frequency components in the audio signal are constant, so a leak sound signal can be easily generated simply by uniformly changing the levels of all frequency components of the playback sound signal by a fixed amount.
  • the approximation characteristic may indicate that the level of a frequency component in the audio signal lower than a predetermined reference frequency component is a constant first level, and the level of a frequency component in the audio signal higher than the reference frequency component is a constant second level different from the first level.
  • the approximation characteristic indicates that the levels of frequency components lower than the reference frequency component in the audio signal and the levels of frequency components higher than the reference frequency component are different and constant. Therefore, with this configuration, a leakage sound signal can be easily generated simply by uniformly changing the levels of frequency components lower than the reference frequency component in the reproduced sound signal by a fixed amount and uniformly changing the levels of frequency components higher than the reference frequency component in the reproduced sound signal by a fixed amount.
  • An audio device is an audio device that adjusts the first and second playback sounds so that a first playback sound played by a first speaker is heard in a predetermined first playback area and a second playback sound played by a second speaker is heard in a predetermined second playback area, wherein the first speaker is installed in a first seat and the second speaker is installed in a second seat adjacent to the first seat, and generates a first background noise signal indicating the environmental sound around the first microphone based on a first playback signal output from a sound source of the first playback sound, a first detected sound signal indicating a detected sound detected by a first microphone installed adjacent to the first speaker, and a first transfer characteristic which is a transfer characteristic of an audio signal from the first speaker to the first microphone, and generates a second background noise signal indicating the environmental sound around the first microphone based on a second playback signal output from a sound source of the second playback sound, a second detected sound signal indicating a detected sound detected by a second microphone installed
  • a first generation unit that generates a second background noise signal indicating the environmental sound around the second microphone based on a second transfer characteristic that is the transfer characteristic of the audio signal at the first representative point; a second generation unit that generates a first leakage sound signal indicating the first reproduction sound heard at the first representative point based on the first reproduction signal and a third transfer characteristic that is the transfer characteristic of the audio signal from the first speaker to a first representative point located within the second reproduction area, and generates a second leakage sound signal indicating the second reproduction sound heard at the second representative point based on the second reproduction signal and a fourth transfer characteristic that is the transfer characteristic of the audio signal from the second speaker to a second representative point located within the first reproduction area; and an adjustment unit that adjusts the level of the first reproduction signal so that the level of the first leakage sound signal is lower than the level of the first background noise signal, and adjusts the level of the second reproduction signal so that the level of the second leakage sound signal is lower than the level of the second background noise signal.
  • a first background noise signal indicating the environmental sound around the first microphone and a first leakage sound signal indicating the first playback sound received at a first representative point located within the second playback area are generated, and the level of the first playback signal is adjusted so that the level of the first leakage sound signal is smaller than the level of the first background noise signal.
  • the level of the first reproduction signal is adjusted by comparing the level of the first leakage sound signal indicating the first reproduction sound received at a representative point located in the second reproduction area, rather than the first reproduction sound detected by the first microphone, which has a high level, with the level of the first background noise signal.
  • This allows the level of the first reproduction signal to be adjusted appropriately without being adjusted excessively.
  • this configuration allows the first reproduction sound reproduced by the first speaker installed in the first seat to be normally received in the first reproduction area.
  • this configuration can prevent the first reproduction sound reproduced in the first seat from being recognized in the second reproduction area by making the level of the first reproduction sound received at the representative point of the second reproduction area, indicated by the first leakage sound signal, lower than the level of the environmental sound around the first microphone, indicated by the first background noise signal.
  • this configuration allows the second playback sound played by the second speaker installed in the second seat to be properly heard in the second playback area.
  • This configuration also makes it possible to prevent the second playback sound played in the second seat from being recognized in the first playback area.
  • the adjustment unit may calculate a first difference level that is the difference between the level of a first frequency component in the first leakage sound signal that is a frequency component having a level greater than that of the first background noise signal and the level of a frequency component corresponding to the first frequency component in the first background noise signal, attenuate the level of the frequency component corresponding to the first frequency component in the first reproduction signal by the first difference level or more, calculate a second difference level that is the difference between the level of a second frequency component in the second leakage sound signal that is a frequency component having a level greater than that of the second background noise signal and the level of a frequency component corresponding to the second frequency component in the second background noise signal, and attenuate the level of the frequency component corresponding to the second frequency component in the second reproduction signal by the second difference level or more.
  • the first generation unit generates a first reproduction sound signal indicative of the first reproduction sound received at the installation position of the first microphone based on the first reproduction signal and the first transfer characteristic, generates a signal obtained by subtracting the first reproduction sound signal from the first detection sound signal as the first background noise signal, generates a second reproduction sound signal indicative of the second reproduction sound received at the installation position of the second microphone based on the second reproduction signal and the second transfer characteristic, and generates a signal obtained by subtracting the second reproduction sound signal from the second detection sound signal as the second background noise signal
  • the second generation unit may generate the first leakage sound signal based on the first reproduction sound signal and a first approximation characteristic that approximates a difference characteristic between the first transfer characteristic and the third transfer characteristic, and generates the second leakage sound signal based on the second reproduction sound signal and a second approximation characteristic that approximates a difference characteristic between the second transfer characteristic and the fourth transfer characteristic.
  • the first leakage sound signal is generated based on the first reproduction sound signal generated by the first generation unit and the first approximation characteristic that approximates the difference characteristic between the first transfer characteristic and the third transfer characteristic. Therefore, this configuration can reduce the scale of the configuration and the amount of calculation required to generate the first leakage sound signal compared to when the first leakage sound signal is generated based on the first reproduction signal and the third transfer characteristic. Similarly, according to this configuration, the scale of the configuration and the amount of calculation required to generate the second leakage sound signal can be reduced compared to when the second leakage sound signal is generated based on the second reproduction signal and the fourth transfer characteristic.
  • the first approximation characteristic and the second approximation characteristic may indicate that the levels of each of a plurality of frequency components in the audio signal are constant.
  • the first approximation characteristic and the second approximation characteristic indicate that the levels of each of the multiple frequency components in the audio signal are constant. Therefore, with this configuration, the first leakage sound signal can be easily generated simply by uniformly changing the levels of all frequency components of the first reproduction sound signal by a fixed amount. Similarly, with this configuration, the second leakage sound signal can be easily generated simply by uniformly changing the levels of all frequency components of the second reproduction sound signal by a fixed amount.
  • the first approximation characteristic and the second approximation characteristic may indicate that the level of a frequency component in the audio signal lower than a predetermined reference frequency component is a constant first level, and the level of a frequency component in the audio signal higher than the reference frequency component is a constant second level different from the first level.
  • the first approximation characteristic and the second approximation characteristic indicate that the levels of frequency components lower than the reference frequency component in the audio signal and the levels of frequency components higher than the reference frequency component are different and constant. Therefore, according to this configuration, the first leakage sound signal can be easily generated by simply uniformly changing the levels of frequency components lower than the reference frequency component in the first reproduced sound signal by a fixed amount and uniformly changing the levels of frequency components higher than the reference frequency component in the first reproduced sound signal by a fixed amount.
  • the second leakage sound signal can be easily generated by simply uniformly changing the levels of frequency components lower than the reference frequency component in the second reproduced sound signal by a fixed amount and uniformly changing the levels of frequency components higher than the reference frequency component in the second reproduced sound signal by a fixed amount.
  • the first representative point may be a position where the second microphone is installed, and the second representative point may be a position where the first microphone is installed.
  • the third transfer characteristic which is the transfer characteristic of the audio signal from the first speaker to the first representative point, can be derived using the second detected sound signal indicating the detected sound detected by the second microphone.
  • this configuration can reduce the cost and effort required to derive the third transfer characteristic compared to when a microphone other than the second microphone is installed in the second playback area and the transfer characteristic of the audio signal from the first speaker to the installation position of that microphone is derived as the third transfer characteristic.
  • this configuration can reduce the cost and effort required to derive the fourth transfer characteristic compared to when a microphone other than the first microphone is installed in the first playback area and the transfer characteristic of the audio signal from the second speaker to the installation position of that microphone is derived as the fourth transfer characteristic.
  • the speakers include a first speaker and a second speaker installed in the same seat
  • the playback area includes a common playback area for listening to a first playback sound played by the first speaker and a second playback sound played by the second speaker
  • the representative point includes a first representative point and a second representative point located outside the common playback area
  • the microphones include a first microphone installed close to the first speaker and a second microphone installed close to the second speaker
  • the first characteristic includes a first first characteristic which is a transfer characteristic of an audio signal from the first speaker to the first microphone and a second first characteristic which is a transfer characteristic of an audio signal from the second speaker to the second microphone
  • the second characteristic includes a first second characteristic which is a transfer characteristic of an audio signal from the first speaker to the first representative point and a second second characteristic which is a transfer characteristic of an audio signal from the second speaker to the second representative point
  • the first generation unit is a sound source of the first playback sound.
  • the second generation unit generates a first background noise signal indicating the environmental sound around the first microphone based on a first reproduction signal output from the first microphone, a first detection sound signal indicating the detection sound detected by the first microphone, and the first first characteristic, and generates a second background noise signal indicating the environmental sound around the second microphone based on a second reproduction signal output from the sound source of the second reproduction sound, a second detection sound signal indicating the detection sound detected by the second microphone, and the second first characteristic.
  • the second generation unit generates a first leakage sound signal indicating the first reproduction sound heard at the first representative point based on the first reproduction signal and the first second characteristic, and generates a second leakage sound signal indicating the second reproduction sound heard at the second representative point based on the second reproduction signal and the second second characteristic, and the adjustment unit adjusts the levels of the first reproduction signal and the second reproduction signal so that the level of the first leakage sound signal is lower than the level of the first background noise signal and the level of the second leakage sound signal is lower than the level of the second background noise signal.
  • a first background noise signal indicating the environmental sound around the first microphone and a first leakage sound signal indicating the first reproduced sound received at a first representative point located outside the common reproduction area are generated, and a second background noise signal indicating the environmental sound around the second microphone and a second leakage sound signal indicating the second reproduced sound received at a second representative point located outside the common reproduction area are generated.
  • the levels of the first reproduction signal and the second reproduction signal are then adjusted so that the level of the first leakage sound signal is smaller than the level of the first background noise signal and the level of the second leakage sound signal is smaller than the level of the second background noise signal.
  • this configuration can adjust the levels of the first and second reproduced signals appropriately without adjusting them excessively. As a result, this configuration can allow the first and second reproduced sounds to be normally heard in a common playback area for listening to the first and second reproduced sounds.
  • this configuration makes the level of the first reproduced sound received at the first representative point indicated by the first leaked sound signal lower than the level of the environmental sound around the first microphone indicated by the first background noise signal, and makes the level of the second reproduced sound received at the second representative point indicated by the second leaked sound signal lower than the level of the environmental sound around the second microphone indicated by the second background noise signal, thereby preventing the first reproduced sound and the second reproduced sound from being recognized outside the common reproduction area.
  • the adjustment unit may identify a first frequency component in the first leakage sound signal that is a frequency component having a level greater than that of the first background noise signal, identify a second frequency component in the second leakage sound signal that is a frequency component having a level greater than that of the second background noise signal, and attenuate the level of a third frequency component, which is a frequency component corresponding to the first frequency component or the second frequency component, in each of the first reproduction signal and the second reproduction signal, by at least the larger of the difference between the level of the third frequency component in the first leakage sound signal and the level of the third frequency component in the first background noise signal, and the difference between the level of the third frequency component in the second leakage sound signal and the level of the third frequency component in the second background noise signal.
  • the level of the third frequency component in each of the first and second reproduced sounds leaking outside the common playback area can be appropriately suppressed by using the larger of the difference between the level of the third frequency component in the first leaked sound signal and the level of the third frequency component in the first background noise signal, and the difference between the level of the third frequency component in the second leaked sound signal and the level of the third frequency component in the second background noise signal.
  • a playback method is a playback method in an acoustic device that adjusts a playback sound reproduced by a speaker so that the playback sound is heard in a predetermined playback area, and generates a background noise signal indicating the environmental sound around the microphone based on a playback signal output from a sound source of the playback sound, a detection sound signal indicating a detection sound detected by a microphone installed close to the speaker, and a first characteristic which is a transmission characteristic of an audio signal from the speaker to the microphone, generates a leakage sound signal indicating the playback sound heard at the representative point based on the playback signal and a second characteristic which is a transmission characteristic of an audio signal from the speaker to a representative point located outside the playback area, and adjusts the level of the playback signal so that the level of the leakage sound signal is smaller than the level of the background noise signal.
  • This configuration provides the same effects as the audio device described in (1) above.
  • a program according to another aspect of the present disclosure is a program for causing a computer of an audio device to execute processing for adjusting a playback sound reproduced by a speaker so that the playback sound is heard in a specified playback area, and causes the computer to execute processing for generating a background noise signal indicating the environmental sound around the microphone based on a playback signal output from a sound source of the playback sound, a detection sound signal indicating a detection sound detected by a microphone installed close to the speaker, and a first characteristic which is a transmission characteristic of an audio signal from the speaker to the microphone, generating a leakage sound signal indicating the playback sound heard at the representative point based on the playback signal and a second characteristic which is a transmission characteristic of an audio signal from the speaker to a representative point located outside the playback area, and adjusting the level of the playback signal so that the level of the leakage sound signal is smaller than the level of the background noise signal.
  • This configuration provides the same effects as the audio device described in (1) above.
  • a playback method is a playback method in an acoustic device that adjusts the first playback sound and the second playback sound so that a first playback sound played by a first speaker is heard in a predetermined first playback area and a second playback sound played by a second speaker is heard in a predetermined second playback area, wherein the first speaker is installed in a first seat and the second speaker is installed in a second seat adjacent to the first seat, and a first background noise signal indicating an environmental sound around the first microphone is generated based on a first playback signal output from a sound source of the first playback sound, a first detected sound signal indicating a detected sound detected by a first microphone installed adjacent to the first speaker, and a first transfer characteristic which is a transfer characteristic of an audio signal from the first speaker to the first microphone, and a second background noise signal indicating an environmental sound around the first microphone is generated based on a second playback signal output from a sound source of the second playback sound, a second detected
  • This configuration provides the same effect as the audio device described in (6) above.
  • a program according to another aspect of the present disclosure is a program for causing a computer of an audio device to execute processing to adjust the first playback sound and the second playback sound so that a first playback sound played by a first speaker is heard in a predetermined first playback area and a second playback sound played by a second speaker is heard in a predetermined second playback area, the first speaker being installed in a first seat and the second speaker being installed in a second seat adjacent to the first seat, and generating a first background noise signal indicating the environmental sound around the first microphone based on a first playback signal output from a sound source of the first playback sound, a first detected sound signal indicating a detected sound detected by a first microphone installed in proximity to the first speaker, and a first transfer characteristic which is a transfer characteristic of an audio signal from the first speaker to the first microphone, and generating a second background noise signal indicating the environmental sound around the first microphone based on a second playback signal output from a sound source of the second playback sound and a second detected sound
  • a second background noise signal indicating an environmental sound around the second microphone is generated based on a second transfer characteristic that is a transfer characteristic of an audio signal from the second speaker to the second microphone
  • a first leakage sound signal indicating the first reproduction sound heard at the first representative point is generated based on the first reproduction signal and a third transfer characteristic that is a transfer characteristic of an audio signal from the first speaker to a first representative point located within the second reproduction area
  • a second leakage sound signal indicating the second reproduction sound heard at the second representative point is generated based on the second reproduction signal and a fourth transfer characteristic that is a transfer characteristic of an audio signal from the second speaker to a second representative point located within the first reproduction area
  • a level of the first reproduction signal is adjusted so that the level of the first leakage sound signal is smaller than the level of the first background noise signal
  • a level of the second reproduction signal is adjusted so that the level of the second leakage sound signal is smaller than the level of the second background noise signal.
  • This configuration provides the same effect as the audio device described in (6) above.
  • the present disclosure can also be realized as a system that operates according to such a program. It goes without saying that such a computer program can be distributed on a non-transitory computer-readable recording medium such as a CD-ROM or via a communication network such as the Internet.
  • Fig. 1A is a top view showing an example of the configuration of the audio system 1 according to the first embodiment.
  • Fig. 1B is a front view showing an example of the configuration of the audio system 1 according to the first embodiment.
  • the audio system 1 includes a speaker 2, a microphone 3, a sound source 10, and an audio device 11.
  • an audio signal representing music and/or voice etc. output from a sound source 10 such as a CD player is processed by the sound device 11 and then reproduced by the speaker 2.
  • the reproduced sound reproduced by the speaker 2 is detected by a microphone 3 installed near the speaker 2.
  • a detected sound signal representing the detected sound detected by the microphone 3 is input to the sound device 11.
  • the sound system 1 allows the sound reproduced by the speaker 2 to be heard in a reproduction area 100 set in a position close to the speaker 2 directly in front of the speaker 2. On the other hand, the sound system 1 prevents the reproduced sound from being recognized in a non-reproduction area 200 located outside the reproduction area 100. For this reason, the sound device 11 adjusts the level of the audio signal output from the sound source 10 using the detection sound signal detected by the microphone 3.
  • the playback sound also leaks into the non-playback area 200, so it is difficult to set the playback sound level to "0" in the non-playback area 200.
  • the level of the playback sound that leaks into the non-playback area 200 (hereinafter, the leaked sound) is lower than the level of the environmental sound (hereinafter, the background noise) surrounding the non-playback area 200, the leaked sound will be buried in the background noise and will not be heard.
  • FIGS. 2 and 3 are diagrams showing an example of the frequency characteristics of the reproduced sound and background noise in the non-playback area 200.
  • the horizontal axis shows the frequency components of the reproduced sound and background noise in the non-playback area 200
  • the vertical axis shows the level of each frequency component of the reproduced sound and background noise.
  • a person at representative point 201 representing the non-playback area 200 will recognize the reproduced sound of frequency components equal to or greater than frequency f1.
  • the reproduced sound of frequency components equal to or less than frequency f1 will not be recognized by a person at representative point 201 representing the non-playback area 200, since it is masked by the background noise.
  • general background noise has the characteristic that its level decreases as the frequency increases.
  • this characteristic is found not only in the noise from vehicles such as trains, airplanes, and automobiles, but also in factory noise and office noise.
  • the audio device 11 performs signal processing to reduce the level of frequency components in the audio signal that are equal to or greater than frequency f1. As a result, the level of the reproduced sound at the representative point 201 does not exceed the level of background noise, and the reproduced sound is no longer recognized by a person at the representative point 201.
  • FIG. 4 and 5 are diagrams showing an example of the frequency characteristics of the reproduced sound and background noise in the reproduction area 100.
  • the horizontal axis shows the frequency components of the reproduced sound and background noise in the reproduction area 100
  • the vertical axis shows the levels of each frequency component of the reproduced sound and background noise.
  • FIG. 6 is a diagram showing an example of a detailed configuration of the audio system 1 according to the first embodiment.
  • a CPU Central Processing Unit
  • DSP Digital Signal Processor
  • FPGA Field Programmable Gate Array
  • the audio device 11 functions as a first generation unit 21, a second generation unit 22, and an adjustment unit 20 by the CPU executing a control program (program) stored in the memory.
  • the first generation unit 21 includes a transfer characteristic correction unit 131 and a subtraction unit 14, and the second generation unit 22 includes a transfer characteristic correction unit 132.
  • the adjustment unit 20 includes two frequency analysis units 151, 152, a comparison unit 16, and a correction unit 12.
  • Each of the first generation unit 21, the second generation unit 22, and the adjustment unit 20 may be configured using a dedicated hardware circuit.
  • the audio signal S (reproduction signal) output from the sound source 10 after being adjusted to a level corresponding to the volume set by the listener is input to the adjustment unit 20.
  • the correction unit 12 adjusts the input audio signal S to a level corresponding to a predetermined initial value (e.g., 0 dB) and reproduces the adjusted audio signal S from the speaker 2.
  • the microphone 3 detects a mixture of the reproduction sound reproduced by the speaker 2 and background noise N around the microphone 3, and outputs a detection sound signal indicating the detected detection sound to the subtraction unit 14.
  • the audio signal S output from the sound source 10 is also input to the first generation unit 21.
  • the first generation unit 21 generates a background noise signal that indicates the environmental sound around the microphone 3 based on the input audio signal S, a detection sound signal that indicates the detection sound detected by the microphone 3, and the transfer characteristic (first characteristic) of the audio signal from the speaker 2 to the microphone 3.
  • the transfer characteristic correction unit 131 performs a convolution process on the input audio signal S using the coefficient "C11" to generate the signal after the convolution process as a playback sound signal indicating the playback sound heard at the installation position of the microphone 3.
  • the transfer characteristic correction unit 131 outputs the generated playback sound signal to the subtraction unit 14.
  • coefficient “C11” is a coefficient that approximates the transfer characteristic of the audio signal from speaker 2 to microphone 3.
  • Coefficient “C11” is determined in advance, for example, based on a detected sound signal that indicates the detected sound detected by microphone 3 when an experimental audio signal is played back on speaker 2.
  • coefficient “C11” may be referred to as transfer characteristic C11 from speaker 2 to microphone 3.
  • the subtraction unit 14 subtracts the playback sound signal generated by the transfer characteristic correction unit 131 from the detection sound signal indicating the detection sound detected by the microphone 3, and generates a background noise signal indicating the background noise around the microphone 3.
  • the detected sound signal indicating the detected sound detected by the microphone 3 can be expressed as "C11 ⁇ S+N”
  • the reproduced sound signal generated by the transfer characteristic correction unit 131 can be expressed as "C11 ⁇ S”.
  • S indicates the audio signal S
  • N is an audio signal indicating the background noise N around the microphone 3.
  • the audio signal S output from the sound source 10 is also input to the second generation unit 22.
  • the second generation unit 22 generates a leakage sound signal that indicates the playback sound heard at the representative point 201 based on the input audio signal S and the transmission characteristic (second characteristic) of the audio signal from the speaker 2 to the representative point 201 of the non-playback area 200.
  • the transfer characteristic correction unit 132 performs convolution processing on the input audio signal S using the coefficient "C13", thereby generating the audio signal "C13 ⁇ S" after the convolution processing as a leakage sound signal indicating the playback sound heard at the representative point 201 of the non-playback area 200.
  • coefficient “C13” is a coefficient that approximates the transfer characteristic of the audio signal from speaker 2 to representative point 201 of non-playback area 200.
  • Coefficient “C13” is determined in advance based on a detected sound signal that indicates a detected sound detected by a microphone installed at representative point 201 of non-playback area 200 when an experimental audio signal is played back on speaker 2, for example.
  • coefficient "C13” may be referred to as transfer characteristic C13 from speaker 2 to representative point 201.
  • the representative point 201 of the non-playback area 200 may be any position outside the playback area 100, such as the position of a microphone 3 installed close to the speaker 2.
  • the coefficient "C13" can be determined using the microphone 3 without the effort of moving the installation position of the microphone 3 or installing a microphone other than the microphone 3 at the representative point 201.
  • the adjustment unit 20 adjusts the level of the audio signal S input from the sound source 10 so that the level of the leakage sound signal generated by the second generation unit 22 is smaller than the level of the background noise signal generated by the first generation unit 21.
  • the adjustment unit 20 reproduces the adjusted audio signal S on the speaker 2.
  • the frequency analysis unit 151 performs a predetermined frequency analysis process such as a fast Fourier transform (FFT) to calculate the level of each of the multiple frequency components in the background noise signal generated by the first generation unit 21.
  • the frequency analysis unit 152 like the frequency analysis unit 151, performs a predetermined frequency analysis process such as a fast Fourier transform (FFT) to calculate the level of each of the multiple frequency components in the leakage sound signal generated by the second generation unit 22.
  • FFT fast Fourier transform
  • the comparison unit 16 compares the level of each frequency component of the background noise signal calculated by the frequency analysis unit 151 with the level of each frequency component of the leaking sound signal calculated by the frequency analysis unit 152, and outputs the magnitude relationship and difference between the level of each frequency component of the background noise signal and the level of each frequency component of the leaking sound signal as a comparison result to the correction unit 12.
  • the correction unit 12 adjusts the level of the audio signal S input from the sound source 10 based on the comparison result input from the comparison unit 16 so that the level of the leakage sound signal is smaller than the level of the background noise signal.
  • the correction unit 12 reproduces the adjusted audio signal S on the speaker 2.
  • the correction unit 12 attenuates the level of the frequency component in the audio signal S that corresponds to the target frequency component (hereinafter, the target frequency component) that is greater than the level of the background noise signal in the leakage sound signal and the level of the frequency component that corresponds to the target frequency component in the background noise signal.
  • the correction unit 12 attenuates the level of the frequency component corresponding to the target frequency component in the audio signal S by a level that is a predetermined error level greater than the difference between the level of the target frequency component in the leak sound signal and the level of the frequency component corresponding to the target frequency component in the background noise signal.
  • the frequency component corresponding to the target frequency component in the audio signal is a frequency component that has the same frequency as the target frequency component among the multiple frequency components contained in the audio signal.
  • the correction unit 12 may attenuate the level of the frequency component corresponding to the target frequency component in the audio signal S by the difference between the level of the target frequency component in the leakage sound signal and the level of the frequency component corresponding to the target frequency component in the background noise signal, without using the error level.
  • FIG. 7 is a flowchart showing an example of the signal processing performed in the acoustic device 11. As shown in FIG. 7, when the sound source 10 starts to output an audio signal S adjusted to a level corresponding to the volume set by the listener, the audio signal S is input to the correction unit 12, the first generation unit 21, and the second generation unit 22 (step ST1).
  • the correction unit 12 causes the speaker 2 to play the audio signal S input in step ST1.
  • the correction unit 12 also causes the speaker 2 to play the audio signal S whose level has been adjusted in step S6 described below (step ST2).
  • the microphone 3 detects a mixture of the playback sound played by the speaker 2 and background noise around the microphone 3, and outputs a detection sound signal indicating the detected detection sound to the subtraction unit 14 (step ST3).
  • the first generator 21 generates a background noise signal indicating the environmental sound around the microphone 3 based on the input audio signal S, a detection sound signal indicating the detection sound detected by the microphone 3, and the transfer characteristic C11 of the audio signal from the speaker 2 to the microphone 3 (step ST4).
  • the second generator 22 generates a leakage sound signal indicating the playback sound heard at the representative point 201 based on the input audio signal S and the transfer characteristic C13 of the audio signal from the speaker 2 to the representative point 201 of the non-playback area 200 (step ST5).
  • the adjustment unit 20 adjusts the level of the audio signal S input from the sound source 10 so that the level of the leakage sound signal generated in step ST5 is smaller than the level of the background noise signal generated in step ST4 (step ST6).
  • step ST7 If the output of the audio signal S by the sound source 10 has not finished (NO in step ST7), the processing from step ST2 onwards is repeated. On the other hand, if the output of the audio signal S by the sound source 10 has finished (YES in step ST7), the audio device 11 ends the signal processing.
  • FIG. 8 is a diagram showing an example of the transfer characteristic C11 from the speaker 2 to the microphone 3 and the transfer characteristic C13 from the speaker 2 to the representative point 201 of the non-playback area 200.
  • the distance from speaker 2 to representative point 201 of non-playback area 200 is greater than the distance from speaker 2 to microphone 3.
  • the level of the reproduced sound at representative point 201 is smaller than the level of the reproduced sound at the installation position of microphone 3. Therefore, for example, as shown in FIG. 8, the level of transfer characteristic C13 from speaker 2 to representative point 201 is smaller than the level of transfer characteristic C11 from speaker 2 to microphone 3.
  • a background noise signal indicating the environmental sound around the microphone 3 and a leakage sound signal indicating the playback sound heard at the representative point 201 of the non-playback area 200 are generated, and the level of the audio signal S is adjusted so that the level of the leakage sound signal is smaller than the level of the background noise signal.
  • the audio signal S is adjusted by comparing the leakage sound signal indicating the playback sound heard at the representative point 201 with the background noise signal, rather than the high-level playback sound detected by the microphone 3.
  • This allows the level of the audio signal S to be adjusted appropriately without being adjusted excessively.
  • This allows the present configuration to allow the listener in the playback area 100 to hear the playback sound normally.
  • this configuration can prevent the playback sound from being recognized in the non-playback area 200 by making the level of the playback sound heard in the non-playback area 200, indicated by the leakage sound signal, lower than the level of the environmental sound around the microphone 3, indicated by the background noise signal.
  • FIGS 9A and 9B are diagrams showing an example of a difference characteristic C1311 between the two transfer characteristics C13 and C11 and an approximation characteristic CA13 thereof.
  • Figures 9A and 9B by approximating the difference characteristic C1311 between the transfer characteristics C11 and C13, it is possible to derive an approximation characteristic CA13 as shown by the dashed line in Figure 9A and the dashed line in Figure 9B. Therefore, the second generation unit 22 may generate a leakage sound signal using this approximation characteristic CA13.
  • the approximate characteristic CA13 shown by the dashed line in Figure 9A indicates that the level of frequency components in the audio signal lower than 1 KHz is a constant -5 dB, the level of frequency components between 1 KHz and 2 KHz increases linearly from -5 dB to 0 dB, and the level of frequency components higher than 2 KHz is a constant 0 dB.
  • the approximate characteristic CA13 is an approximation of the difference characteristic C1311 between the transfer characteristic C11 and the transfer characteristic C13 so as to be similar to the frequency characteristic of a low shelving filter.
  • the approximate characteristic CA13 shown by the dashed line in Figure 9B indicates that the level of each frequency component in the audio signal is a constant -2 dB.
  • the approximate characteristic CA13 is not limited to the example shown in Figures 9A and 9B, and may indicate that the level of frequency components in an audio signal lower than a reference frequency, such as 1 KHz, is a constant -5 dB, and the level of frequency components higher than the reference frequency of 1 KHz is a constant 0 dB.
  • FIG. 10 is a diagram showing an example of the configuration of an audio system 1A according to a modified example of the first embodiment.
  • an audio device 11A included in the audio system 1A according to this modified example functions as a first generator 21A and a second generator 22A instead of the first generator 21 and the second generator 22 (FIG. 6).
  • the first generator 21A includes a transfer characteristic correction section 131A instead of the transfer characteristic correction section 131 (FIG. 6).
  • the second generator 22A includes a transfer characteristic correction section 132A instead of the transfer characteristic correction section 132 (FIG. 6).
  • the transfer characteristic correction unit 131A outputs the generated playback sound signal not only to the subtraction unit 14 but also to the second generation unit 22A.
  • the transfer characteristic correction unit 132A generates a leakage sound signal using the playback sound signal and approximation characteristic CA13 input from the first generation unit 21A, instead of the audio signal S and transfer characteristic C13 output by the sound source 10.
  • the transfer characteristic correction unit 132A performs a convolution process on the reproduced sound signal "C11 ⁇ S" generated by the transfer characteristic correction unit 131A using the approximation characteristic CA13 that approximates the difference characteristic C1311 between the transfer characteristic C13 and the transfer characteristic C11.
  • the transfer characteristic correction unit 132 outputs a leakage sound signal having characteristics similar to the leakage sound signal "C13 ⁇ S" generated by the transfer characteristic correction unit 132A in FIG. 6. This makes it possible to obtain an effect equivalent to that obtained from the configuration of the acoustic system 1 shown in FIG. 6.
  • the leakage sound signal can be easily generated by simply attenuating the levels of frequency components lower than 1 KHz in the reproduced sound signal by 5 dB across the board and linearly attenuating the levels of frequency components from 1 KHz to 2 KHz in the reproduced sound signal.
  • the leakage sound signal can be easily generated by simply attenuating the levels of each frequency component in the reproduced sound signal by 2 dB across the board.
  • the leakage sound signal is generated using the approximation characteristic CA13, which indicates that the level of the frequency components in the audio signal lower than the reference frequency is a constant first level, and the level of the frequency components in the audio signal higher than the reference frequency is a constant second level different from the first level.
  • the leakage sound signal can be easily generated by simply attenuating the level of the frequency components in the reproduced sound signal lower than the reference frequency by an amount equivalent to the absolute value of the first level and attenuating the level of the frequency components in the reproduced sound signal higher than the reference frequency by an amount equivalent to the absolute value of the second level.
  • the generation of the leakage sound signal in the second generation unit 22A can be easily achieved using, for example, a biquad filter such as an IIR (Infinite Impulse Response) filter. Therefore, the scale of the configuration and the amount of calculation required to generate the leakage sound signal can be reduced compared to the acoustic device 11 shown in FIG. 6.
  • a biquad filter such as an IIR (Infinite Impulse Response) filter. Therefore, the scale of the configuration and the amount of calculation required to generate the leakage sound signal can be reduced compared to the acoustic device 11 shown in FIG. 6.
  • a sound source 10 such as a CD player typically outputs audio signals of multiple channels, such as two channels (stereo).
  • an acoustic system equipped with an acoustic device that performs signal processing on multi-channel audio signals output from a sound source 90 will be described.
  • an acoustic system 1B equipped with an acoustic device 11B that performs signal processing on two-channel (stereo) audio signals S1 and S2 output from a sound source 90 will be described.
  • FIG. 11 is a diagram showing an example of the configuration of an acoustic system 1B according to another modified example of the first embodiment.
  • the audio signal S1 first playback signal
  • the audio signal S2 second playback signal
  • the sound reproduced by speaker 2a (first reproduced sound) is mainly detected by microphone 3a (first microphone) installed close to speaker 2a.
  • the sound reproduced by speaker 2b (second reproduced sound) is mainly detected by microphone 3b (second microphone) installed close to speaker 2b.
  • a detection sound signal (first detection sound signal) indicating the detection sound detected by microphone 3a and a detection sound signal (second detection sound signal) indicating the detection sound detected by microphone 3b are input to audio device 11B.
  • the two sounds reproduced by the speakers 2a, 2b are heard in a playback area 100 (common playback area) set in a position directly in front of the two speakers 2a, 2b and close to the two speakers 2a, 2b.
  • a playback area 100 common playback area
  • the sound device 11B adjusts the levels of the two-channel audio signals S1, S2 output by the sound source 90 using the detection sound signals detected by the microphones 3a, 3b.
  • the audio device 11B like the audio devices 11 and 11A, performs signal processing to reduce the levels of frequency components equal to or greater than frequency f1 in the two audio signals S1 and S2.
  • the level of the sounds reproduced by the speakers 2a and 2b does not exceed the level of background noise, and the reproduced sounds are not recognized by people at the representative points 201a and 201b.
  • the level of frequency components above frequency f1 of the reproduced sound heard by people in the reproduction area 100 also decreases.
  • the level of the reproduced sound is sufficiently higher than the level of background noise, as shown in FIG. 4, for example. Therefore, as shown in FIG. 5, even after the above signal processing is performed, the reproduced sound in the reproduction area 100 is recognized by people in the reproduction area 100 without being drowned out by background noise.
  • FIG. 12 is a diagram showing an example of the detailed configuration of an audio system 1B according to another modified example of the first embodiment.
  • the audio device 11B functions as two first generation units 21a and 21b, two second generation units 22a and 22b, and an adjustment unit 20B.
  • the first generation unit 21a includes a transfer characteristic correction unit 131a and a subtraction unit 14a
  • the first generation unit 21b includes a transfer characteristic correction unit 131b and a subtraction unit 14b.
  • the second generation unit 22a includes a transfer characteristic correction unit 132a
  • the second generation unit 22b includes a transfer characteristic correction unit 132b.
  • the adjustment unit 20B includes two correction units 12a and 12b, four frequency analysis units 151a, 152a, 151b, and 152b, two comparison units 16a and 16b, and a judgment unit 17.
  • the two-channel audio signals S1, S2 output from the sound source 90 after being adjusted to a level corresponding to the volume set by the listener are input to the adjustment unit 20B.
  • the correction unit 12a adjusts the audio signal S1, which is one of the two-channel audio signals S1, S2 input, to a level corresponding to a predetermined initial value (e.g., 0 dB) in the same manner as the correction unit 12 ( Figure 6), and reproduces the adjusted audio signal S1 on the speaker 2a.
  • the microphone 3a detects a mixture of the playback sound reproduced by the speaker 2a and background noise N around the microphone 3a, and outputs a detection sound signal indicating the detected detection sound to the subtraction unit 14a.
  • the audio signal S1 is also input to the first generation unit 21a.
  • the first generation unit 21a Like the first generation unit 21 ( Figure 6), the first generation unit 21a generates a background noise signal (first background noise signal) that indicates the environmental sound around the microphone 3a based on the input audio signal S1, a detection sound signal that indicates the detection sound detected by the microphone 3a, and the transfer characteristic C11 (first characteristic) of the audio signal from the speaker 2a to the microphone 3a.
  • the first generation unit 21a outputs the generated background noise signal to the frequency analysis unit 151a.
  • the transfer characteristic correction unit 131a like the transfer characteristic correction unit 131 (FIG. 6), generates a signal after convolution processing of the audio signal S1 using the coefficient "C11" that approximates the transfer characteristic C11 as a reproduced sound signal indicative of the reproduced sound heard at the installation position of the microphone 3a.
  • the subtraction unit 14a generates a signal obtained by subtracting the reproduced sound signal generated by the transfer characteristic correction unit 131a from the detected sound signal indicative of the detected sound detected by the microphone 3a as a background noise signal indicative of the background noise around the microphone 3a.
  • the audio signal S1 is also input to the second generation unit 22a. Similar to the second generation unit 22 (FIG. 6), the second generation unit 22a generates a leakage sound signal (first leakage sound signal) indicative of the reproduced sound heard at the representative point 201a based on the input audio signal S1 and the transfer characteristic C13 (first second characteristic) of the audio signal from the speaker 2a to the representative point 201a. The second generation unit 22a outputs the generated leakage sound signal to the frequency analysis unit 152a.
  • first leakage sound signal indicative of the reproduced sound heard at the representative point 201a based on the input audio signal S1 and the transfer characteristic C13 (first second characteristic) of the audio signal from the speaker 2a to the representative point 201a.
  • the second generation unit 22a outputs the generated leakage sound signal to the frequency analysis unit 152a.
  • the transfer characteristic correction unit 132a like the transfer characteristic correction unit 132 ( Figure 6), generates a signal after performing convolution processing on the audio signal S1 using a coefficient "C13" that approximates the transfer characteristic C13 as a leakage sound signal that indicates the reproduced sound heard at the representative point 201a.
  • audio signal S2 which is one of the two-channel audio signals S1 and S2 input, is input to correction unit 12b, first generation unit 21b, and second generation unit 22b.
  • the correction unit 12b adjusts the level according to a predetermined initial value (e.g., 0 dB) and reproduces the adjusted audio signal S2 from the speaker 2b.
  • the microphone 3b detects a mixture of the playback sound reproduced by the speaker 2b and background noise N around the microphone 3b, and outputs a detection sound signal indicating the detected detection sound to the subtraction unit 14b.
  • the first generation unit 21b like the first generation unit 21a, generates a background noise signal (second background noise signal) indicating the environmental sound around the microphone 3b based on the input audio signal S2, a detection sound signal indicating the detection sound detected by the microphone 3b, and the transfer characteristic C21 (second first characteristic) of the audio signal from the speaker 2b to the microphone 3b.
  • the first generation unit 21b outputs the generated background noise signal to the frequency analysis unit 151b.
  • the transfer characteristic correction unit 131b like the transfer characteristic correction unit 131a, generates a signal after performing convolution processing on the audio signal S2 using the coefficient "C21" that approximates the transfer characteristic C21 as a reproduced sound signal indicative of the reproduced sound heard at the installation position of the microphone 3b.
  • the subtraction unit 14b generates a signal obtained by subtracting the reproduced sound signal generated by the transfer characteristic correction unit 131b from the detected sound signal indicative of the detected sound detected by the microphone 3b as a background noise signal indicative of the background noise around the microphone 3b.
  • the second generation unit 22b like the second generation unit 22a, generates a leakage sound signal (second leakage sound signal) indicating the reproduced sound heard at the representative point 201b based on the input audio signal S2 and the transfer characteristic C23 (second second characteristic) of the audio signal from the speaker 2b to the representative point 201b.
  • the second generation unit 22b outputs the generated leakage sound signal to the frequency analysis unit 152b.
  • the transfer characteristic correction unit 132b like the transfer characteristic correction unit 132a, generates a signal after performing convolution processing on the audio signal S2 using a coefficient "C23" that approximates the transfer characteristic C23 as a leakage sound signal that indicates the reproduced sound heard at the representative point 201b.
  • the adjustment unit 20B adjusts the levels of the two audio signals S1 and S2 so that the level of the leakage sound signal generated by the second generation unit 22a is smaller than the level of the background noise signal generated by the first generation unit 21a, and the level of the leakage sound signal generated by the second generation unit 22b is smaller than the level of the background noise signal generated by the first generation unit 21b.
  • the adjustment unit 20B reproduces the adjusted audio signal S1 on the speaker 2a, and reproduces the adjusted audio signal S2 on the speaker 2b.
  • the frequency analysis unit 151a calculates the level of each frequency component of the background noise signal generated by the first generation unit 21a, similar to the frequency analysis unit 151 ( Figure 6).
  • the frequency analysis unit 152a calculates the level of each frequency component of the leakage sound signal generated by the second generation unit 22a, similar to the frequency analysis unit 152 ( Figure 6).
  • the comparison unit 16a compares the level of each frequency component of the background noise signal calculated by the frequency analysis unit 151a with the level of each frequency component of the leakage sound signal calculated by the frequency analysis unit 152a, and outputs the magnitude relationship and difference between the level of each frequency component of the background noise signal and the level of each frequency component of the leakage sound signal as a comparison result to the judgment unit 17.
  • the frequency analysis unit 151b calculates the level of each frequency component of the background noise signal generated by the first generation unit 21b.
  • the frequency analysis unit 152b like the frequency analysis unit 152a, calculates the level of each frequency component of the leakage sound signal generated by the second generation unit 22b.
  • the comparison unit 16b compares the level of each frequency component of the background noise signal calculated by the frequency analysis unit 151b with the level of each frequency component of the leakage sound signal calculated by the frequency analysis unit 152b.
  • the comparison unit 16b outputs the magnitude relationship and difference between the level of each frequency component of the background noise signal and the level of each frequency component of the leakage sound signal as a comparison result to the judgment unit 17.
  • the determination unit 17 refers to the comparison result input from the comparison unit 16a and identifies a frequency component (hereinafter, the first frequency component) in the leakage sound signal generated by the second generation unit 22a (hereinafter, the first leakage sound signal) that has a higher level than the background noise signal generated by the first generation unit 21a (hereinafter, the first background noise signal).
  • the determination unit 17 refers to the comparison result input from the comparison unit 16b and identifies a frequency component (hereinafter, second frequency component) in the leakage sound signal generated by the second generation unit 22b (hereinafter, second leakage sound signal) that has a higher level than the background noise signal generated by the first generation unit 21b (hereinafter, second background noise signal).
  • second frequency component a frequency component in the leakage sound signal generated by the second generation unit 22b
  • the determination unit 17 outputs information indicating the identified first and second frequency components, the difference between the level of the first frequency component in the first background noise signal input from the comparison unit 16a and the level of the first frequency component in the first leakage sound signal, and the difference between the level of the second frequency component in the second background noise signal input from the comparison unit 16b and the level of the second frequency component in the second leakage sound signal to the correction unit 12a and the correction unit 12b.
  • the correction unit 12a refers to the information input from the judgment unit 17 and attenuates the level of the frequency component (hereinafter, the third frequency component) in the audio signal S1 corresponding to the first frequency component or the second frequency component by at least the larger of the difference between the level of the third frequency component in the first leakage sound signal and the level of the third frequency component in the first background noise signal, and the difference between the level of the third frequency component in the second leakage sound signal and the level of the third frequency component in the second background noise signal.
  • the third frequency component the level of the frequency component in the audio signal S1 corresponding to the first frequency component or the second frequency component by at least the larger of the difference between the level of the third frequency component in the first leakage sound signal and the level of the third frequency component in the first background noise signal, and the difference between the level of the third frequency component in the second leakage sound signal and the level of the third frequency component in the second background noise signal.
  • the correction unit 12b refers to the information input from the determination unit 17 and attenuates the level of the third frequency component in the audio signal S2 by at least the larger of the difference between the level of the third frequency component in the first leakage sound signal and the level of the third frequency component in the first background noise signal, and the difference between the level of the third frequency component in the second leakage sound signal and the level of the third frequency component in the second background noise signal.
  • the correction unit 12b attenuates the level of the third frequency component in the audio signal S2 by the same amount as the correction unit 12a attenuates the level of the third frequency component in the audio signal S1.
  • the first frequency component is a frequency component of frequency "f1”
  • the difference between the level of the frequency component of frequency "f1" in the first leakage sound signal and the level of the frequency component of frequency "f1" in the first background noise signal is level “L11”.
  • the difference between the level of the frequency component of frequency "f1" in the second leakage sound signal and the level of the frequency component of frequency "f1" in the second background noise signal is level "L12" which is smaller than level "L11".
  • the second frequency component is a frequency component of frequency "f2"
  • the difference between the level of the frequency component of frequency "f2" in the first leakage sound signal and the level of the frequency component of frequency "f2" in the first background noise signal is level “L21”.
  • the difference between the level of the frequency component of frequency "f2" in the second leakage sound signal and the level of the frequency component of frequency "f2" in the second background noise signal is level "L22", which is greater than level "L21".
  • the correction unit 12a sets the frequency component of frequency "f1" in the audio signal S1 as the third frequency component, and attenuates the level of the frequency component of frequency "f1” in the audio signal S1 by a level that is a predetermined error level higher than level "L11".
  • the correction unit 12a sets the frequency component of frequency "f2" in the audio signal S1 as the third frequency component, and attenuates the level of the frequency component of frequency "f2" in the audio signal S1 by a level that is the error level higher than level "L22".
  • the correction unit 12b sets the frequency component of frequency "f1" in the audio signal S2 as the third frequency component, and attenuates the level of the frequency component of frequency “f1” in the audio signal S2 by a level that is greater than level "L11" by the error level.
  • the correction unit 12b also sets the frequency component of frequency "f2" in the audio signal S2 as the third frequency component, and attenuates the level of the frequency component of frequency "f2" in the audio signal S2 by a level that is greater than level "L22" by the error level.
  • the correction unit 12a may attenuate the level of the frequency component of frequency "f1" in the audio signal S1 by level “L11” and attenuate the level of the frequency component of frequency f2 by level “L22” without using the error level.
  • the correction unit 12b may attenuate the level of the frequency component of frequency "f1” in the audio signal S2 by level “L11” and attenuate the level of the frequency component of frequency f2 by level “L22” without using the error level.
  • the comparison result by the comparison unit 16a is input to the correction unit 12a
  • the comparison result by the comparison unit 16b is input to the correction unit 12b.
  • the correction unit 12a then adjusts the level of the audio signal S1 based on the comparison result input from the comparison unit 16a
  • the correction unit 12b adjusts the level of the audio signal S2 based on the comparison result input from the comparison unit 16b.
  • the degree of adjustment of the level of the audio signal S1 differs from the degree of adjustment of the level of the audio signal S2
  • the listener may not be able to experience stereo reproduction of the two audio signals S1 and S2.
  • both the correction unit 12a and the correction unit 12b adjust the levels of the third frequency component in the two audio signals S1 and S2 based on the same information input from the judgment unit 17 to attenuate the levels of the third frequency component in the two audio signals S1 and S2 by an amount equal to or greater than the larger of the difference between the level of the third frequency component in the first leakage sound signal and the level of the third frequency component in the first background noise signal and the difference between the level of the third frequency component in the second leakage sound signal and the level of the third frequency component in the second background noise signal.
  • the level of the reproduced sound is lower than the level of the background noise in both of the non-reproduction areas 200a and 200b.
  • the listener can experience stereo reproduction of the two audio signals S1 and S2 in the reproduction area 100.
  • the configuration of this modified example makes it possible to adjust the levels of the audio signals S1, S2 to an appropriate level for the listeners in the playback area 100 without excessively attenuating the levels.
  • the first generation unit 21a and the second generation unit 22a of the acoustic device 11B may be configured similarly to the first generation unit 21A and the second generation unit 22A of the acoustic device 11A (FIG. 10).
  • the first generation unit 21b and the second generation unit 22b of the acoustic device 11B may be configured similarly to the first generation unit 21A and the second generation unit 22A of the acoustic device 11A (FIG. 10). In these cases, it is possible to reduce the scale of the configuration and the amount of calculation required to generate the leakage sound signal.
  • Fig. 13 is a diagram showing an example of the configuration of the acoustic system 1C according to the second embodiment.
  • the acoustic system 1C according to the second embodiment corresponds to a configuration in which two acoustic systems 1B (Fig. 11) described in the modified example of the first embodiment are arranged closely to each other, and includes four speakers 2a to 2d, four microphones 3a to 3d, two acoustic devices 11Ba, 11Bb, and two sound sources 90a, 90b.
  • the sound system 1C according to the second embodiment is used in cases where two seats are close to each other, such as two adjacent seats in a train or airplane, or the driver's seat and passenger seat in a car, and the sound reproduced by speakers installed in each seat is heard only in a playback area 100 set near the head of each seat occupant.
  • FIGS. 14A and 14B are diagrams showing an example of the installation positions of the four speakers 2a to 2d and the four microphones 3a to 3d provided in the sound system 1C.
  • FIG. 14A shows an example where the four speakers 2a to 2d are installed in the headrests of two adjacent seats where the seat backs are integrated up to the headrests, as used in train seats and the like.
  • FIG. 14B shows an example where the four speakers 2a to 2d are installed in the headrests of two adjacent seats where the seat backs are separate from the headrests, as used in the driver's seat and passenger seat of an automobile and the like.
  • the four microphones 3a to 3d are installed on the side of each of the speakers 2a to 2d.
  • FIG. 15A is a front view showing another example of the installation positions of the four speakers 2a to 2d and the four microphones 3a to 3d of the sound system 1C
  • FIG. 15B is a top view showing the other example.
  • the seat "Seat 1" first seat
  • two speakers 2a and 2b are installed on the sides of the seated person so as to sandwich the head of the seated person.
  • the seat "Seat 2" second seat
  • two speakers 2c and 2d are installed on the sides of the seated person so as to sandwich the head of the seated person.
  • the four speakers 2a to 2d are attached so as to protrude from the headrest, and the diaphragms of the four speakers 2a to 2d face the ears of the seated person.
  • the four microphones 3a to 3d are installed on the back side of each of the speakers 2a to 2d.
  • the installation positions of the four microphones 3a to 3d are not limited to the above installation positions, but may be any position close to the speakers 2a to 2d, such as immediately beside the diaphragm on the front baffle of each speaker 2a to 2d.
  • the two adjacent seats described above are not limited to seats on a vehicle, but may also be seats in a movie theater, seats in a theme park attraction, or seats in an office. In other words, it is sufficient if multiple seats with speakers installed in the headrests are lined up closely together.
  • the two-channel audio signals S1a and S2a output from the sound source 90a are processed by the acoustic device 11Ba and then reproduced by the speakers 2a and 2b.
  • the two-channel audio signals S1b and S2b output from the sound source 90b are processed by the acoustic device 11Bb and then reproduced by the speakers 2c and 2d.
  • the sound reproduced by speaker 2a is mainly detected by microphone 3a, and the sound reproduced by speaker 2b (first speaker) (first reproduced sound) is mainly detected by microphone 3b (first microphone).
  • the sound reproduced by speaker 2c (second speaker) (second reproduced sound) is mainly detected by microphone 3c (second microphone), and the sound reproduced by speaker 2d is mainly detected by microphone 3d.
  • the detection sound signal indicating the detection sound detected by the microphones 3a and 3b is input to the acoustic device 11Ba, and the detection sound signal indicating the detection sound detected by the microphones 3c and 3d is input to the acoustic device 11Bb.
  • the two sounds reproduced by the speakers 2a and 2b are heard in a playback area 100a (first playback area) set in a position close to the two speakers 2a and 2b in front of the two speakers 2a and 2b installed in the seat "Seat 1" (Figs. 14A, 14B, or 15A and 15B). Also, the two sounds reproduced by the speakers 2c and 2d are heard in a playback area 100b (second playback area) set in a position close to the two speakers 2c and 2d in front of the two speakers 2c and 2d installed in the seat "Seat 2" (Figs. 14A, 14B, or 15A and 15B) adjacent to the seat "Seat 1".
  • the microphones 3a and 3b detect the playback sounds reproduced by the speakers 2c and 2d that have leaked into the playback area 100a.
  • the audio device 11Ba adjusts the levels of the two-channel audio signals S1a and S2a output by the sound source 90a using a detection sound signal indicating the detection sound detected by the microphones 3a and 3b.
  • the microphones 3c and 3d detect the playback sounds reproduced by the speakers 2a and 2b that have leaked into the playback area 100b.
  • the audio device 11Bb adjusts the levels of the two-channel audio signals S1b and S2b output by the sound source 90b using a detection sound signal indicating the detection sound detected by the microphones 3c and 3d.
  • FIG. 16 is a diagram showing an example of the detailed configuration of an audio system 1C according to another modified example of the second embodiment.
  • FIG. 16 only shows the configuration related to the two speakers 2b, 2c located between listener "Listener A” and listener “Listener B” in FIG. 13. These are the components in the acoustic system 1C that are closest to listener “Listener A” and listener “Listener B", and the two sounds reproduced by the two speakers have a greater impact on each listener than the configuration related to the other two speakers 2a, 2d. For this reason, only the configuration and operation related to the two speakers 2b, 2c and the two microphones 3b, 3c will be described in detail below, and the configuration and operation related to the other two speakers 2a, 2d and the two microphones 3a, 3d will be omitted.
  • the configuration relating to the two speakers 2b and 2c corresponds to the configuration of the sound system 1 of the first embodiment (FIG. 6) in which two speakers are arranged independently.
  • the first generation unit 21b (transfer characteristic correction unit 131b, subtraction unit 14b), second generation unit 22b (transfer characteristic correction unit 132b), and adjustment unit 20Ba (frequency analysis unit 151b, frequency analysis unit 152b, comparison unit 16b, and correction unit 12b) of the acoustic device 11Ba related to the speaker 2b operate in the same manner as the first generation unit 21 (transfer characteristic correction unit 131, subtraction unit 14), second generation unit 22 (transfer characteristic correction unit 132), and adjustment unit 20 (frequency analysis unit 151, frequency analysis unit 152, comparison unit 16, and correction unit 12) of the acoustic device 11 ( Figure 6), respectively.
  • the first generation unit 21c (transfer characteristic correction unit 131c, subtraction unit 14c), second generation unit 22c (transfer characteristic correction unit 132c) and adjustment unit 20Bb (frequency analysis unit 151c, frequency analysis unit 152c, comparison unit 16c and correction unit 12c) of the acoustic device 11Bb related to the speaker 2c also operate in the same manner as the first generation unit 21 (transfer characteristic correction unit 131, subtraction unit 14), second generation unit 22 (transfer characteristic correction unit 132) and adjustment unit 20 (frequency analysis unit 151, frequency analysis unit 152, comparison unit 16 and correction unit 12) of the acoustic device 11 ( Figure 6).
  • the audio device 11Ba and the audio device 11Bb may be configured by the same computer, or the audio device 11Ba and the audio device 11Bb may each be configured by an individual computer.
  • the audio signal S2a (first playback signal) output from the sound source 90a after being adjusted to a level corresponding to the volume set by the listener "Listener A" is input to the adjustment unit 20Ba.
  • the correction unit 12b adjusts the audio signal S2a to a level corresponding to a predetermined initial value (e.g., 0 dB) and causes the speaker 2b to play the adjusted audio signal S2a.
  • the microphone 3b detects a mixture of the playback sound played by the speaker 2b and background noise N around the microphone 3b, and outputs a detected sound signal (first detected sound signal) indicating the detected detected sound to the subtraction unit 14b.
  • the audio signal S2a output from the sound source 90a is also input to the first generation unit 21b.
  • the first generation unit 21b generates a background noise signal (first background noise signal) that indicates the environmental sound around the microphone 3b based on the input audio signal S2a, a detection sound signal that indicates the detection sound detected by the microphone 3b, and the transfer characteristic (first transfer characteristic) of the audio signal from the speaker 2b to the microphone 3b.
  • the transfer characteristic correction unit 131b performs convolution processing on the input audio signal S2a using the coefficient "C21" to generate the signal after the convolution processing as a playback sound signal indicating the playback sound heard at the installation position of the microphone 3b.
  • the transfer characteristic correction unit 131b outputs the generated playback sound signal to the subtraction unit 14b.
  • coefficient “C21” is a coefficient that approximates the transfer characteristic of the audio signal from speaker 2b to microphone 3b.
  • Coefficient “C21” is determined in advance, for example, based on a detected sound signal that indicates the detected sound detected by microphone 3b when an experimental audio signal is played back on speaker 2b.
  • coefficient "C21” may be referred to as transfer characteristic C21 from speaker 2b to microphone 3b.
  • the subtraction unit 14b generates a background noise signal indicating the background noise around the microphone 3b by subtracting the playback sound signal generated by the transfer characteristic correction unit 131b from the detection sound signal indicating the detection sound detected by the microphone 3b.
  • the detected sound signal indicating the detected sound detected by microphone 3b can be expressed as "C21 ⁇ S2a+N,” and the reproduced sound signal generated by transfer characteristic correction unit 131b can be expressed as "C21 ⁇ S2a.”
  • S2a indicates the audio signal S2a.
  • N is an audio signal indicating the background noise N around microphone 3b.
  • the audio signal S2a output from the sound source 90a is also input to the second generation unit 22b.
  • the second generation unit 22b generates a leakage sound signal (first leakage sound signal) indicating the playback sound heard at the representative point 201b based on the input audio signal S2a and the transfer characteristic (third transfer characteristic) of the audio signal from the speaker 2b to the representative point 201b (first representative point) located within the playback area 100b.
  • the representative point 201b may be any position within the playback area 100b, such as the position of the right ear of a listener "listener B" in the playback area 100b who is to receive the playback sound reproduced by the speaker 2c.
  • the transfer characteristic correction unit 132b performs convolution processing on the input audio signal S2a using the coefficient "C23", thereby generating the audio signal "C23 ⁇ S2a" after the convolution processing as a leakage sound signal indicating the reproduced sound heard at the representative point 201b.
  • coefficient "C23” is a coefficient that approximates the transfer characteristic of the audio signal from speaker 2b to representative point 201b. Coefficient “C23” is determined in advance based on a detected sound signal that indicates a detected sound detected by a microphone installed at representative point 201b when an experimental audio signal is played back on speaker 2b. Hereinafter, coefficient “C23” may be referred to as transfer characteristic C23 from speaker 2 to representative point 201b.
  • the adjustment unit 20Ba adjusts the level of the audio signal S2a so that the level of the leakage sound signal generated by the second generation unit 22b is smaller than the level of the background noise signal generated by the first generation unit 21b.
  • the adjustment unit 20Ba reproduces the adjusted audio signal S2a on the speaker 2b.
  • the frequency analysis unit 151b calculates the level of each frequency component of the background noise signal generated by the first generation unit 21b by performing a predetermined frequency analysis process such as a fast Fourier transform (FFT).
  • the frequency analysis unit 152b calculates the level of each frequency component of the leakage sound signal generated by the second generation unit 22b in the same manner as the frequency analysis unit 151b.
  • FFT fast Fourier transform
  • the comparison unit 16b compares the level of each frequency component of the background noise signal calculated by the frequency analysis unit 151b with the level of each frequency component of the leaking sound signal calculated by the frequency analysis unit 152b, and outputs the magnitude relationship and difference between the level of each frequency component of the background noise signal and the level of each frequency component of the leaking sound signal as a comparison result to the correction unit 12b.
  • the correction unit 12b adjusts the level of the audio signal S2a input from the sound source 90a based on the comparison result input from the comparison unit 16b so that the level of the leakage sound signal is smaller than the level of the background noise signal.
  • the correction unit 12b reproduces the adjusted audio signal S2a through the speaker 2b.
  • the correction unit 12b attenuates the level of the frequency component corresponding to the target frequency component in the audio signal S2a by at least the difference between the level of the target frequency component in the leakage sound signal that is greater than the level of the background noise signal and the level of the frequency component corresponding to the target frequency component in the background noise signal.
  • the adjustment unit 20Ba adjusts the audio signal S2a by comparing the leakage sound signal indicating the playback sound heard at the representative point 201b with the background noise signal, rather than the high-level playback sound detected by the microphone 3b, and can adjust the level of the audio signal S2a appropriately without excessively adjusting it. This allows the listener "Listener A" to hear the playback sound played by the speaker 2b in the playback area 100a.
  • the level of the playback sound heard at the representative point 201b in the playback area 100b indicated by the leakage sound signal can be made lower than the level of the environmental sound around the microphone 3b indicated by the background noise signal, thereby preventing the listener "Listener B" in the playback area 100b from recognizing the playback sound played by the speaker 2b.
  • the transfer characteristic C23 may be the transfer characteristic of the audio signal from the speaker 2b to the microphone 3c.
  • the coefficient "C23" used by the second generator 22b to generate the leaked sound signal can be determined using the microphone 3c without the effort of moving the installation position of the microphone 3c or installing a microphone other than the microphone 3c at the representative point 201b.
  • audio signal S1b (second playback signal) output from sound source 90b after being adjusted to a level corresponding to the volume set by listener "Listener B" is input to adjustment unit 20Bb.
  • correction unit 12c adjusts audio signal S1b to a level corresponding to a predetermined initial value (e.g., 0 dB) and causes speaker 2c to play the adjusted audio signal S1b.
  • Microphone 3c detects a mixture of the playback sound played by speaker 2c and background noise N around microphone 3c, and outputs a detected sound signal (second detected sound signal) indicating the detected detected sound to subtraction unit 14c.
  • the audio signal S1b output from the sound source 90b is also input to the first generation unit 21c.
  • the first generation unit 21c generates a background noise signal (second background noise signal) that indicates the environmental sound around the microphone 3c based on the input audio signal S1b, a detection sound signal that indicates the detection sound detected by the microphone 3c, and the transfer characteristic (second transfer characteristic) of the audio signal from the speaker 2c to the microphone 3c.
  • the transfer characteristic correction unit 131c performs convolution processing on the input audio signal S1b using the coefficient "C31" to generate the signal after the convolution processing as a playback sound signal indicating the playback sound heard at the installation position of the microphone 3c.
  • the transfer characteristic correction unit 131c outputs the generated playback sound signal to the subtraction unit 14c.
  • coefficient “C31” is a coefficient that approximates the transfer characteristic of the audio signal from speaker 2c to microphone 3c.
  • Coefficient “C31” is determined in advance based on a detected sound signal that indicates the detected sound detected by microphone 3c when an experimental audio signal is played back on speaker 2c.
  • coefficient “C31” may be referred to as transfer characteristic C31 from speaker 2c to microphone 3c.
  • the subtraction unit 14c subtracts the reproduced sound signal generated by the transfer characteristic correction unit 131c from the detected sound signal indicating the detected sound detected by the microphone 3c, and generates a background noise signal indicating the background noise around the microphone 3c.
  • the detected sound signal indicating the detected sound detected by the microphone 3c can be expressed as "C31 ⁇ S1b+N", and the reproduced sound signal generated by the transfer characteristic correction unit 131c can be expressed as "C31 ⁇ S1b".
  • S1b indicates the audio signal S1b.
  • N is an audio signal indicating the background noise N around the microphone 3c.
  • the audio signal S1b output from the sound source 90b is also input to the second generation unit 22c.
  • the second generation unit 22c generates a leakage sound signal (second leakage sound signal) indicating the playback sound received at the representative point 201a based on the input audio signal S1b and the transfer characteristic (fourth transfer characteristic) of the audio signal from the speaker 2c to the representative point 201a (second representative point) located within the playback area 100a.
  • the representative point 201a may be any position within the playback area 100a, such as the position of the left ear of a listener "listener A" in the playback area 100a who is to receive the playback sound reproduced by the speaker 2b.
  • the transfer characteristic correction unit 132c performs convolution processing on the input audio signal S1b using the coefficient "C33", thereby generating the audio signal "C33 ⁇ S1b" after the convolution processing as a leakage sound signal indicating the reproduced sound heard at the representative point 201a.
  • coefficient “C33” is a coefficient that approximates the transfer characteristic of the audio signal from speaker 2c to representative point 201a.
  • Coefficient “C33” is determined in advance based on a detected sound signal that indicates a detected sound detected by a microphone installed at representative point 201a when an experimental audio signal is played on speaker 2c, for example.
  • coefficient "C33” may be referred to as transfer characteristic C33 from speaker 2c to representative point 201a.
  • the adjustment unit 20Bb adjusts the level of the audio signal S1b so that the level of the leakage sound signal generated by the second generation unit 22c is smaller than the level of the background noise signal generated by the first generation unit 21c.
  • the adjustment unit 20Bb reproduces the adjusted audio signal S1b through the speaker 2c.
  • the frequency analysis unit 151c calculates the level of each frequency component of the background noise signal generated by the first generation unit 21c by performing a predetermined frequency analysis process such as a fast Fourier transform (FFT).
  • the frequency analysis unit 152c calculates the level of each frequency component of the leakage sound signal generated by the second generation unit 22c in the same manner as the frequency analysis unit 151c.
  • the comparison unit 16c compares the level of each frequency component of the background noise signal calculated by the frequency analysis unit 151c with the level of each frequency component of the leaking sound signal calculated by the frequency analysis unit 152c, and outputs the magnitude relationship and difference between the level of each frequency component of the background noise signal and the level of each frequency component of the leaking sound signal as a comparison result to the correction unit 12c.
  • the correction unit 12c adjusts the level of the audio signal S1b input from the sound source 90b based on the comparison result input from the comparison unit 16c so that the level of the leakage sound signal is smaller than the level of the background noise signal.
  • the correction unit 12c reproduces the adjusted audio signal S1b through the speaker 2c.
  • the correction unit 12c attenuates the level of the frequency component corresponding to the target frequency component in the audio signal S1b by more than the difference between the level of the target frequency component in the leakage sound signal that is greater than the level of the background noise signal and the level of the frequency component corresponding to the target frequency component in the background noise signal.
  • the adjustment unit 20Bb adjusts the audio signal S1b by comparing the leakage sound signal indicating the playback sound heard at the representative point 201a with the background noise signal, rather than the high-level playback sound detected by the microphone 3c, and can adjust the level of the audio signal S1b appropriately without excessively adjusting it. This allows the listener "Listener B" to hear the playback sound played by the speaker 2c in the playback area 100b.
  • the level of the playback sound heard at the representative point 201a of the playback area 100a indicated by the leakage sound signal can be made lower than the level of the environmental sound around the microphone 3c indicated by the background noise signal, thereby preventing the listener "Listener A" in the playback area 100a from recognizing the playback sound played by the speaker 2c.
  • the transfer characteristic C33 may be the transfer characteristic of the audio signal from the speaker 2c to the microphone 3b.
  • the coefficient "C33" used by the second generator 22c to generate the leaked sound signal can be determined using the microphone 3b without the effort of moving the installation position of the microphone 3b or installing a microphone other than the microphone 3b at the representative point 201a.
  • the audio system 1C corresponds to a configuration in which two audio systems 1B (FIG. 11) described in the modified example of the first embodiment are arranged in close proximity.
  • the determination units 17 (FIG. 12) of the audio devices 11Ba and 11Bb are excluded from the configuration related to the two speakers 2b and 2c and the two microphones 3b and 3c.
  • the acoustic device 11Ba not function as the judgment unit 17 (FIG. 12), and have the correction unit 12a of the acoustic device 11Ba adjust the level of the audio signal S1a based on the comparison result input from the comparison unit 16a, and have the correction unit 12b adjust the level of the audio signal S1b with an adjustment degree separate from that of the correction unit 12a based on the comparison result input from the comparison unit 16b.
  • this configuration although it is possible to prevent a listener from perceiving the reproduced sound to be heard by other listeners, there is a risk that the listener will not be able to experience stereo reproduction.
  • each of the acoustic devices 11Ba, 11Bb performs the operation described in the modified example of the first embodiment without excluding the judgment unit 17 from each of the acoustic devices 11Ba, 11Bb.
  • the judgment unit 17 of the acoustic device 11Ba outputs information necessary for adjusting the correction unit 12a and the correction unit 12b to the correction unit 12a and the correction unit 12b based on the comparison results input from the comparison unit 16a and the comparison unit 16b.
  • the correction unit 12a and the correction unit 12b adjust the levels of the third frequency components of the audio signal S1a and the audio signal S2a by the same amount. The same applies to the acoustic device 11Bb.
  • first generation unit 21b and the second generation unit 22b of the acoustic device 11Ba may be configured similarly to the first generation unit 21A and the second generation unit 22A of the acoustic device 11A (FIG. 10).
  • first generation unit 21c and the second generation unit 22c of the acoustic device 11Bc may be configured similarly to the first generation unit 21A and the second generation unit 22A of the acoustic device 11A (FIG. 10). In these cases, it is possible to reduce the scale of the configuration and the amount of calculation required to generate the leakage sound signal.
  • the sound system 1C of the second embodiment can also be applied to cases where three or more seats are arranged closely together, such as passenger seats on a train or airplane, and sound reproduced by speakers installed on each seat is heard only in a playback area set near the head of the seat occupant.
  • three or more seats are arranged closely together, such as passenger seats on a train or airplane, and sound reproduced by speakers installed on each seat is heard only in a playback area set near the head of the seat occupant.
  • two sound systems 1Ca and 1Cb can be configured as shown in FIG. 17.
  • FIG. 17 is a diagram showing an example of the sound system 1C according to the second embodiment applied to three seats.
  • the relationship between the listener "Listener A” and the listener “Listener B” shown in FIG. 17 is the same as the relationship between the listener "Listener A” and the listener “Listener B” shown in FIG. 13, so the operation of the acoustic system 1Ca may be the same as the operation of the acoustic system 1C described with reference to FIG. 16.
  • listener “Listener B” and listener “Listener C” is the same as the relationship between listener “Listener A” and listener “Listener B” shown in FIG. 13, so the operation of acoustic system 1Cb may be the same as the operation of acoustic system 1C described with reference to FIG. 16.
  • the listener “Listener B” in FIG. 17 corresponds to the listener “Listener A” in FIG. 16, and the listener “Listener C” in FIG. 17 corresponds to the listener “Listener B” in FIG. 16. It is sufficient to consider that the representative point 201c in the playback area 100b in which the listener “Listener B” in FIG. 17 exists corresponds to the representative point 201a of the listener “Listener A” in FIG. 16. It is sufficient to consider that the representative point 201d in the playback area 100c in which the listener “Listener C” exists corresponds to the representative point 201b in the playback area 100b in which the listener "Listener B” in FIG. 16 exists. And the operation of the acoustic system 1Cb may be the same as the operation of the acoustic system 1C described using FIG. 16.
  • acoustic system 1B intended for one listener shown in FIG. 11 may be applied to acoustic system 1C intended for two listeners as shown in FIG. 13.
  • the configuration of acoustic system 1B intended for one listener shown in FIG. 11 may be applied to acoustic systems intended for three or more listeners in the same way as it is applied to acoustic systems 1Ca and 1Cb intended for three listeners as shown in FIG. 17.
  • the technology disclosed herein allows playback sound to be received normally in the playback area without using a speaker array, and also prevents playback sound leaking outside the playback area from being recognized. For this reason, the technology disclosed herein is useful in allowing only the occupants of multiple seats close together, such as passenger seats on trains and airplanes, to hear the sound played by speakers installed in each seat.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • General Health & Medical Sciences (AREA)
  • Mechanical Engineering (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Circuit For Audible Band Transducer (AREA)
PCT/JP2023/027068 2022-09-26 2023-07-24 音響装置、再生方法及びプログラム Ceased WO2024070165A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2024549784A JPWO2024070165A1 (https=) 2022-09-26 2023-07-24
CN202380068563.1A CN119923869A (zh) 2022-09-26 2023-07-24 音响装置、再生方法以及程序
EP23871408.3A EP4578739A4 (en) 2022-09-26 2023-07-24 ACOUSTIC DEVICE, PLAYBACK METHOD AND PROGRAM
US19/088,024 US20250227412A1 (en) 2022-09-26 2025-03-24 Acoustic device, playback method, and non-transitory computer readable storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022152471 2022-09-26
JP2022-152471 2022-09-26

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US19/088,024 Continuation US20250227412A1 (en) 2022-09-26 2025-03-24 Acoustic device, playback method, and non-transitory computer readable storage medium

Publications (1)

Publication Number Publication Date
WO2024070165A1 true WO2024070165A1 (ja) 2024-04-04

Family

ID=90477059

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/027068 Ceased WO2024070165A1 (ja) 2022-09-26 2023-07-24 音響装置、再生方法及びプログラム

Country Status (5)

Country Link
US (1) US20250227412A1 (https=)
EP (1) EP4578739A4 (https=)
JP (1) JPWO2024070165A1 (https=)
CN (1) CN119923869A (https=)
WO (1) WO2024070165A1 (https=)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011211266A (ja) * 2010-03-29 2011-10-20 Hitachi Omron Terminal Solutions Corp スピーカアレイ装置
JP2017050847A (ja) 2015-08-31 2017-03-09 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ エリア再生システム及びエリア再生方法
WO2021010006A1 (ja) * 2019-07-17 2021-01-21 パナソニックＩｐマネジメント株式会社 音声制御装置、音声制御システム及び音声制御方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8306235B2 (en) * 2007-07-17 2012-11-06 Apple Inc. Method and apparatus for using a sound sensor to adjust the audio output for a device
JP4640461B2 (ja) * 2008-07-08 2011-03-02 ソニー株式会社 音量調整装置およびプログラム
JP6887139B2 (ja) * 2017-03-29 2021-06-16 パナソニックＩｐマネジメント株式会社 音響処理装置、音響処理方法、およびプログラム
US11295718B2 (en) * 2018-11-02 2022-04-05 Bose Corporation Ambient volume control in open audio device
US11843927B2 (en) * 2022-02-28 2023-12-12 Panasonic Intellectual Property Management Co., Ltd. Acoustic control system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011211266A (ja) * 2010-03-29 2011-10-20 Hitachi Omron Terminal Solutions Corp スピーカアレイ装置
JP2017050847A (ja) 2015-08-31 2017-03-09 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ エリア再生システム及びエリア再生方法
WO2021010006A1 (ja) * 2019-07-17 2021-01-21 パナソニックＩｐマネジメント株式会社 音声制御装置、音声制御システム及び音声制御方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4578739A4

Also Published As

Publication number Publication date
CN119923869A (zh) 2025-05-02
EP4578739A1 (en) 2025-07-02
US20250227412A1 (en) 2025-07-10
JPWO2024070165A1 (https=) 2024-04-04
EP4578739A4 (en) 2025-11-05

Similar Documents

Publication Publication Date Title
EP3040984B1 (en) Sound zone arrangment with zonewise speech suppresion
JP6870078B2 (ja) 動的サウンド調整のための雑音推定
US10848897B2 (en) Acoustic processing device, acoustic processing method, and recording medium
EP2850611A1 (en) Noise dependent signal processing for in-car communication systems with multiple acoustic zones
EP3392619B1 (en) Audible prompts in a vehicle navigation system
US10339951B2 (en) Audio signal processing in a vehicle
WO2013187946A2 (en) Wind noise detection for in-car communication systems with multiple acoustic zones
US10560782B2 (en) Signal processor
JP2007019980A (ja) オーディオ静音化装置
JP2024026716A (ja) 信号処理装置及び信号処理方法
WO2024070165A1 (ja) 音響装置、再生方法及びプログラム
JP2020163936A (ja) 音響処理装置、音響処理方法、及びプログラム
US11122366B2 (en) Method and apparatus for attenuation of audio howling
JP2019198110A (ja) 音量制御装置
CN121792914A (zh) 音频系统
JP2019180073A (ja) 音響システム、音響再生装置、および音響再生方法
JP6556257B2 (ja) 音量制御装置、音量制御方法、及び、プログラム
JP6573657B2 (ja) 音量制御装置、音量制御方法、及び、音量制御プログラム
KR20240145832A (ko) 차량 내 좌석 별 음원 레벨을 제어하는 방법 및 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23871408

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024549784

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2023871408

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 202380068563.1

Country of ref document: CN

ENP Entry into the national phase

Ref document number: 2023871408

Country of ref document: EP

Effective date: 20250324

NENP Non-entry into the national phase

Ref country code: DE

WWP Wipo information: published in national office

Ref document number: 202380068563.1

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 2023871408

Country of ref document: EP