WO2021048893A1 - 集音放音装置、集音放音方法、およびプログラム - Google Patents

集音放音装置、集音放音方法、およびプログラム Download PDF

Info

Publication number
WO2021048893A1
WO2021048893A1 PCT/JP2019/035344 JP2019035344W WO2021048893A1 WO 2021048893 A1 WO2021048893 A1 WO 2021048893A1 JP 2019035344 W JP2019035344 W JP 2019035344W WO 2021048893 A1 WO2021048893 A1 WO 2021048893A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound
acoustic signal
unit
automobile
external
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/035344
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
小林　和則
弘章 伊藤
村田　伸
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NTT Inc
Original Assignee
Nippon Telegraph and Telephone Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Telegraph and Telephone Corp filed Critical Nippon Telegraph and Telephone Corp
Priority to JP2021544982A priority Critical patent/JP7276472B2/ja
Priority to US17/640,305 priority patent/US12289583B2/en
Priority to PCT/JP2019/035344 priority patent/WO2021048893A1/ja
Publication of WO2021048893A1 publication Critical patent/WO2021048893A1/ja
Anticipated expiration legal-status Critical
Priority to JP2022182292A priority patent/JP7371751B2/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/04—Traffic conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • H04R3/005—Circuits for transducers for combining the signals of two or more microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/54—Audio sensitive means, e.g. ultrasound
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/401—2D or 3D arrays of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/01—Aspects of volume control, not necessarily automatic, in sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/13—Acoustic transducers and sound field adaptation in vehicles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field

Definitions

  • the present invention relates to a technique for presenting a sound outside the vehicle to the inside of the vehicle.
  • the car is equipped with various sensors and warning devices. They provide, for example, a warning sound when a vehicle in front is about to collide, or a warning sound when another vehicle is in that lane when changing driving lanes. Used for
  • Non-Patent Document 1 In a moving car, various noises such as engine noise, wind noise, and vibration noise of the vehicle body are generated, which is a factor that reduces the comfort of occupants. Therefore, there is a demand for designs and parts that enhance the sound insulation of automobiles (see, for example, Non-Patent Document 1).
  • sounds outside the vehicle such as horns, crossing warnings, ambulance sirens, and parallel vehicle running sounds, are useful for alerting the driver to danger and for the driver to detect danger. Information is included.
  • the external sound heard through the window is only transmitted inside the car. Therefore, for example, when the sound insulation of a car is high, the driver's hearing is deteriorated due to aging, or when listening to audio or radio in the car, the driver in the car is external. It may be difficult to hear the sound. With regard to unnecessary noise, a comfortable interior space can be realized by sound insulation, but if the sound necessary for detecting danger or operating the car is also sound-insulated, danger detection and driving by sound can be realized. It becomes difficult to grasp the situation necessary for.
  • An object of the present invention is to allow a driver in an automobile to detect a danger or grasp a situation necessary for driving without increasing unnecessary external noise in the automobile in view of the above technical problems. It is to provide a technology that makes it easier to hear the external sounds necessary for driving.
  • the sound collecting and discharging device of the first aspect of the present invention is derived from an external acoustic signal based on an external acoustic signal emitted from an external sound source of a certain automobile and arriving at the automobile. It is a sound collecting and discharging device that emits an internal acoustic signal, which is an internal acoustic signal, to the inside of an automobile, and has a sound collecting unit that collects an external acoustic signal, a sound collecting unit that emits an internal acoustic signal, and an external sound collecting unit.
  • a determination unit that determines whether or not the acoustic signal has a predetermined characteristic indicating danger, and when it is determined that the external acoustic signal indicates danger, an internal acoustic signal is emitted so that the driver of the automobile can perceive it.
  • a control unit that controls sound emission from the sound unit.
  • the sound collecting and discharging device of the second aspect of the present invention is derived from an external acoustic signal based on an external acoustic signal emitted from an external sound source of a certain automobile and arriving at the automobile. It is a sound collecting and discharging device that emits an internal acoustic signal, which is an internal acoustic signal, to the inside of an automobile, and has a sound collecting unit that collects an external acoustic signal, a sound emitting unit that emits an internal acoustic signal, and an automobile. It includes a state acquisition unit that acquires information representing the operation state of the above, and a control unit that controls whether or not to emit an internal acoustic signal from the sound emitting unit based on the information representing the operation state.
  • the present invention it becomes easier for the driver in the automobile to hear the external sound necessary for detecting the danger and grasping the situation necessary for driving.
  • FIG. 1 is a diagram illustrating a functional configuration of the sound collecting / discharging device of the first embodiment.
  • FIG. 2 is a diagram illustrating the functional configuration of the dangerous sound detection unit.
  • FIG. 3 is a diagram illustrating the functional configuration of the sound collecting / discharging device of the modified example 1.
  • FIG. 4 is a diagram illustrating the functional configuration of the sound collecting / discharging device of the modified example 2.
  • FIG. 5 is a diagram illustrating the functional configuration of the sound collecting / discharging device of the second embodiment.
  • FIG. 6 is a diagram illustrating the functional configuration of the sound collecting / discharging device of the third embodiment.
  • FIG. 7 is a diagram illustrating a functional configuration of a computer.
  • FIG. 1 shows an example of the functional configuration of the sound collecting / discharging device 1 of the first embodiment.
  • the sound collecting / discharging device 1 is mounted on the automobile 90 and collects sounds from the outside of the automobile 90, and only sounds useful for the driver to detect danger and grasp the situation necessary for driving. Is emitted inside the automobile 90.
  • the automobile 90 is provided with a driver's seat 91 and a passenger seat 92 in the front row, and two rear seats 93 and 94 in the rear row, but the automobile 90 may be provided with at least the driver's seat 91.
  • the number and arrangement of other seats is not limited.
  • the sound collecting / discharging device 1 of the first embodiment includes at least one sound collecting unit M1, at least one sound emitting unit S1, a dangerous sound detecting unit 11 (hereinafter, also referred to as “determination unit”), and a switch unit. 12 (hereinafter, also referred to as a “control unit”) is provided.
  • the output of the sound collecting unit M1 is input to the dangerous sound detecting unit 11 and the switch unit 12.
  • the output of the dangerous sound detection unit 11 is input to the switch unit 12.
  • the output of the switch unit 12 is input to the sound emitting unit S1.
  • the sound collecting unit M1 may be installed outside the automobile 90 or inside the automobile 90.
  • the sound collecting and discharging method of the first embodiment is realized by performing the process described below by the sound collecting and discharging device 1.
  • the sound collecting / discharging device 1 is configured by loading a special program into a known or dedicated computer having, for example, a central processing unit (CPU: Central Processing Unit), a main storage device (RAM: Random Access Memory), or the like. It is a special device.
  • the sound collecting / discharging device 1 executes each process under the control of the central processing unit, for example.
  • the data input to the sound collecting / discharging device 1 and the data obtained by each process are stored in, for example, the main storage device, and the data stored in the main storage device is read out to the central processing unit as needed. It is used for other processing.
  • At least a part of the sound collecting / discharging device 1 may be configured by hardware such as an integrated circuit.
  • the sound collecting unit M1 is installed at a position where the sound outside the automobile 90 can be collected, and collects the sound emitted from the sound source outside the automobile 90 and arriving at the automobile 90.
  • the sound collecting unit M1 is, for example, a microphone or a vibration sensor. Examples of the installation position of the sound collecting unit M1 include the outside of the automobile 90, the inside of the body, the inside of the window, and the like.
  • the sound collecting unit M1 outputs an acoustic signal representing the collected external sound (hereinafter, also referred to as an “external acoustic signal”) to the dangerous sound detecting unit 11.
  • the dangerous sound detection unit 11 receives an external acoustic signal output by the sound collecting unit M1 as an input, and detects a dangerous portion including a feature representing a predetermined dangerous sound from the external acoustic signal.
  • the dangerous sound is a sound contained in an external acoustic signal that should be used for determining a predetermined danger or when operating a vehicle, or a sound caused by an event, for example, a horn, a siren, or a crossing warning. , The running sound of a parallel running vehicle, the impact sound due to an accident, the sound, etc.
  • the danger sound detection unit 11 outputs a determination result indicating whether or not a danger portion has been detected to the switch unit 12.
  • FIG. 2A shows a first configuration example of the dangerous sound detection unit 11.
  • the danger sound detection unit 11A shown in FIG. 2A includes a frequency analysis unit 111, a neural network 112, and a danger determination unit 113.
  • the frequency analysis unit 111 converts the external acoustic signal output by the sound collecting unit M1 into a frequency domain signal.
  • a frequency conversion method for example, a method of multiplying a window with a frame size of several tens to several hundreds of milliseconds and converting it into a frequency domain by Fourier transform can be used. Further, the power may be calculated after the Fourier transform and converted into a power spectrum, or the frequencies may be averaged on a logarithmic scale to obtain a mel spectrum.
  • the frequency analysis unit 111 collects one frame or a plurality of frames of the external acoustic signal after frequency conversion and outputs it to the neural network 112.
  • the neural network 112 is a neural network in which the frequency spectrum of dangerous sounds is learned in advance.
  • the neural network 112 takes an external acoustic signal after frequency conversion as an input, and obtains an estimated value of the likelihood for each danger type.
  • the neural network 112 outputs an estimated value of the likelihood for each danger type to the danger determination unit 113.
  • the danger determination unit 113 inputs the estimated value of the likelihood for each danger type and detects the danger portion. Specifically, the risk type with the highest likelihood is selected from the input estimated value of the likelihood for each risk type, and when the likelihood is larger than a predetermined threshold value, it is determined as a danger point. The danger determination unit 113 outputs the determination result to the danger sound detection unit 11.
  • FIG. 2B shows a second configuration example of the dangerous sound detection unit 11.
  • the dangerous sound detection unit 11B shown in FIG. 2B includes a frequency analysis unit 111, a frequency spectrum storage unit 114, a correlation calculation unit 115, and a type determination unit 116.
  • the frequency spectrum storage unit 114 stores at least one representative example of a frequency spectrum that can occur at a dangerous place for each dangerous type.
  • the correlation calculation unit 115 calculates the correlation between the frequency-converted external acoustic signal output by the frequency analysis unit 111 and the frequency spectrum stored in the frequency spectrum storage unit 114 for each risk type.
  • the correlation calculation unit 115 outputs the correlation for each danger type to the type determination unit 116.
  • the type determination unit 116 inputs the correlation for each danger type and detects the danger location. Specifically, the risk type having the highest correlation is selected from the input correlations for each risk type, and when the correlation is larger than a predetermined threshold value, it is determined that the risk of that type has been detected. The type determination unit 116 outputs the determination result as the danger sound detection unit 11.
  • FIG. 2C shows a third configuration example of the dangerous sound detection unit 11.
  • the dangerous sound detecting unit 11C shown in FIG. 2C includes a stationary component removing unit 117 after the frequency analysis unit 111 in the dangerous sound detecting unit 11A which is the first configuration example.
  • the steady-state component removing unit 117 removes the steady-state noise component from the external acoustic signal after frequency conversion output by the frequency analysis unit 111. Specifically, the external acoustic signal after frequency conversion is averaged for a long time in, for example, several tens of seconds to obtain a stationary noise component, and the stationary noise component is subtracted from the external acoustic signal after frequency conversion.
  • stationary noise such as the running sound of the own vehicle can be removed from the external acoustic signal, and the dangerous portion can be more easily detected.
  • the switch unit 12 controls whether or not to output the external acoustic signal output by the sound collecting unit M1 from the sound emitting unit S1 by switching on / off based on the determination result output by the dangerous sound detecting unit 11.
  • the switch unit 12 is on, the input external acoustic signal is output to the sound emitting unit S1, and when the switch unit 12 is off, nothing is output.
  • the switch unit 12 is configured to be set to on when the determination result indicates that a dangerous portion has been detected, and to be set to off in other cases.
  • the sound emitting unit S1 is installed inside the automobile 90, particularly near the driver's seat 91, and receives an acoustic signal derived from an external acoustic signal collected by the sound collecting unit M1 (hereinafter, also referred to as “internal acoustic signal”). Sound is emitted.
  • the internal acoustic signal may be the external acoustic signal itself, or may be an acoustic signal obtained by converting the external acoustic signal so that the driver seated in the driver's seat 91 can easily hear it.
  • the sound emitting unit S1 is, for example, a speaker.
  • an equalizer or the like may be used for the conversion of the acoustic signal.
  • the sound emitting unit S1 may form a beam including the driver's ear to emit sound so that the driver can easily perceive it, or another acoustic signal is emitted in the vehicle. In some cases, the dangerous sound may be emphasized and emitted more than other acoustic signals.
  • the dangerous sound is emitted into the automobile 90 only when the dangerous sound is detected from the sound coming from the outside of the automobile 90. Since it makes a sound, it is possible to make it easier for the driver to perceive a dangerous sound without transmitting unnecessary external noise to the inside of the automobile 90.
  • the sound collecting / discharging device 2 of the modified example 1 has four sound collecting units M1 to M4, four sound collecting units S1 to S4, and four dangerous sound detecting units 11-. It includes 1 to 11-4 and four switch units 12-1 to 12-4.
  • the output of the dangerous sound detection unit 11-i is input to the switch unit 12-i.
  • the output of the switch unit 12-i is input to the sound emitting unit Si.
  • the sound collecting units M1 to M4 are installed so as to collect sounds coming from four different directions.
  • the sound emitting units S1 to S4 are installed around the driver's seat 91 so as to correspond to the sound collecting directions of the sound collecting units M1 to M4, respectively.
  • the dangerous sound detection units 11-1 to 11-4 and the switch units 12-1 to 12-4 detect dangerous sounds and control the sound emission for each pair of sound collecting unit and sound emitting unit corresponding to each direction. .. That is, four sets of each processing unit included in the sound collecting / discharging device 1 of the first embodiment are prepared, and the same processing as that of the first embodiment is performed for each of the four different directions.
  • an example of four directions is shown, but the set of each processing unit may be increased so as to correspond to more directions. As a result, the driver can perceive the direction of arrival of the danger sound, and can take actions corresponding to the danger more appropriately.
  • the sound collecting / discharging device 3 of the modified example 2 includes four sound collecting units M1 to M4, four sound collecting units S1 to S4, and one dangerous sound detecting unit 11. It includes four switch units 12-1 to 12-4 and one addition unit 13.
  • the output of the addition unit 13 is input to the danger sound detection unit 11.
  • the output of the dangerous sound detection unit 11 is input to the switch units 12-1 to 12-4.
  • the output of the switch unit 12-i is input to the sound emitting unit Si.
  • the sound collecting units M1 to M4 and the sound emitting units S1 to S4 are installed in the same manner as in the modified example 1, and the switch units 12-1 to 12-4 perform the same control as in the modified example 1.
  • the addition unit 13 adds all the input output signals of the sound collection units M1 to M4 and outputs them to the danger sound detection unit 11.
  • the danger sound detection unit 11 detects a danger portion with respect to the output signal of the addition unit 13. As a result, when the external acoustic signal coming from either direction contains a dangerous sound, the internal acoustic signal is output from the sound emitting units S1 to S4, and the external acoustic signal does not include the dangerous sound. In that case, nothing is output from the sound emitting units S1 to S4.
  • the sound collecting / discharging device 4 of the second embodiment includes at least one sound collecting unit M1, at least one sound emitting unit S1, a switch unit 12, a state acquisition unit 14, and a sound output determination unit 15.
  • the output of the state acquisition unit 14 is input to the sound output determination unit 15.
  • the output of the sound output determination unit 15 is input to the switch unit 12.
  • FIG. 5 an example in which one sound collecting unit and one sound emitting unit are provided is shown. However, as in the modified example 1 and the modified example 2, a plurality of sound collecting units and sound emitting units corresponding to a plurality of directions are provided. You may prepare. At that time, a plurality of switch units are also provided according to the number of sound collecting units and sound emitting units, and the output of the sound output determination unit 15 is input to all the switch units.
  • the state acquisition unit 14 acquires information indicating the operating state from the automobile 90 and outputs the information to the sound output determination unit 15.
  • the information representing the operating state is, for example, the state of the blinker, the state of the gear, the steering angle of the steering wheel, the traveling speed, and the like.
  • the sound output determination unit 15 determines whether or not to output the external acoustic signal output by the sound collecting unit M1 from the sound emitting unit S1 from the information representing the operation state received from the state acquisition unit 14.
  • the criteria for determining whether or not to output are determined in advance depending on whether or not the driver needs an external sound for the operation. For example, when the turn signal for turning right is turned on, the sound signal collected by the sound collecting unit installed on the right side of the vehicle is controlled to be output from the sound emitting unit installed inside the vehicle. When the turn signal for turning right is on and the traveling speed is equal to or higher than a preset speed, control may be performed to output the acoustic signal collected by the sound collecting unit from the sound emitting unit installed inside the automobile.
  • the outside sound is not emitted when the vehicle is stopped, such as when waiting for a right turn at an intersection, and the outside sound is emitted when the vehicle is running, such as when changing lanes.
  • the switch unit 12 may be controlled to be turned on when the gear enters the back. Since it is difficult to check the surrounding situation when moving backward, the effect of making it easier to understand the surrounding situation can be expected by the sound.
  • the sound collecting / discharging device of the modified example 1 and the modified example 2 is provided with a plurality of sound collecting parts and sound emitting parts corresponding to predetermined directions so that the driver can perceive the arrival direction of the dangerous sound. It was configured in.
  • the sound image localization technique by applying the sound image localization technique, it is possible to make the driver perceive the direction of arrival of the dangerous sound more accurately.
  • the sound collecting / discharging device 5 of the third embodiment has four sound collecting units M1 to M4, four sound collecting units S1 to S4, a dangerous sound detecting unit 11, and directions.
  • the estimation unit 16 and the mixing unit 17 are provided.
  • the output of the dangerous sound detection unit 11 is input to the sound direction estimation unit 16 and the mixing unit 17.
  • the output of the sound direction estimation unit 16 is input to the mixing unit 17.
  • the output of the mixing unit 17 is input to the sound emitting units S1 to S4.
  • the sound collecting units M1 to M4 and the sound emitting units S1 to S4 are installed in the same manner as in the modified example 1 and the modified example 2.
  • the sound direction estimation unit 16 receives the external acoustic signals output by the sound collecting units M1 to M4 as inputs, and estimates the arrival direction of the sound. Specifically, the time difference between channels is calculated by the cross-correlation method, and the direction of arrival of sound is obtained using the time difference. Alternatively, the direction of arrival of the sound is obtained by the delay sum method.
  • the mixing unit 17 mixes the external acoustic signals output by the sound collecting units M1 to M4 and outputs them from the sound emitting units S1 to S4.
  • the mixing unit 17 outputs an acoustic signal collected by the sound collecting units M1 to M4 at a preset ratio from the sound emitting units S1 to S4 according to the arrival direction of the sound estimated by the sound direction estimating unit 16. ..
  • the sound image can be localized in the direction of arrival of the sound. For example, when it is desired to localize a sound image between the sound emitting unit S1 and the sound emitting unit S2, an acoustic signal is output from the sound emitting unit S1 and the sound emitting unit S2 at the same time.
  • the acoustic signal is output at a ratio corresponding to the position where the sound image is desired to be localized based on the relationship between the sound image localization position and the reproduction volume ratio during stereo reproduction, the sound image can be localized at the target position.
  • the relationship between the sound image localization position and the playback volume balance of each sound emitting part is investigated experimentally in advance, and the relationship between the sound image localization position and the playback volume balance of each sound emitting part is saved as a table. May be good.
  • the sound image can be localized in a place other than the place where the sound emitting part is installed.
  • the driver can identify the place where the dangerous sound is generated only by listening to the sound.
  • the program that describes this processing content can be recorded on a computer-readable recording medium.
  • the computer-readable recording medium may be, for example, a magnetic recording device, an optical disk, a photomagnetic recording medium, a semiconductor memory, or the like.
  • the distribution of this program is carried out, for example, by selling, transferring, renting, etc., portable recording media such as DVDs and CD-ROMs on which the program is recorded. Further, the program may be stored in the storage device of the server computer, and the program may be distributed by transferring the program from the server computer to another computer via a network.
  • a computer that executes such a program first stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. Then, when the process is executed, the computer reads the program stored in its own storage device and executes the process according to the read program. Further, as another execution form of this program, a computer may read the program directly from a portable recording medium and execute processing according to the program, and further, the program is transferred from the server computer to this computer. Each time, the processing according to the received program may be executed sequentially. In addition, the above processing is executed by a so-called ASP (Application Service Provider) type service that realizes the processing function only by the execution instruction and result acquisition without transferring the program from the server computer to this computer. May be.
  • the program in this embodiment includes information to be used for processing by a computer and equivalent to the program (data that is not a direct command to the computer but has a property of defining the processing of the computer, etc.).
  • the present device is configured by executing a predetermined program on the computer, but at least a part of these processing contents may be realized by hardware.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Automation & Control Theory (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Mathematical Physics (AREA)
  • Otolaryngology (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Traffic Control Systems (AREA)
PCT/JP2019/035344 2019-09-09 2019-09-09 集音放音装置、集音放音方法、およびプログラム Ceased WO2021048893A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2021544982A JP7276472B2 (ja) 2019-09-09 2019-09-09 集音放音方法
US17/640,305 US12289583B2 (en) 2019-09-09 2019-09-09 Sound collection and emission apparatus, sound collection and emission method, and program
PCT/JP2019/035344 WO2021048893A1 (ja) 2019-09-09 2019-09-09 集音放音装置、集音放音方法、およびプログラム
JP2022182292A JP7371751B2 (ja) 2019-09-09 2022-11-15 集音放音方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/035344 WO2021048893A1 (ja) 2019-09-09 2019-09-09 集音放音装置、集音放音方法、およびプログラム

Publications (1)

Publication Number Publication Date
WO2021048893A1 true WO2021048893A1 (ja) 2021-03-18

Family

ID=74866179

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/035344 Ceased WO2021048893A1 (ja) 2019-09-09 2019-09-09 集音放音装置、集音放音方法、およびプログラム

Country Status (3)

Country Link
US (1) US12289583B2 (https=)
JP (2) JP7276472B2 (https=)
WO (1) WO2021048893A1 (https=)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7459779B2 (ja) * 2020-12-17 2024-04-02 トヨタ自動車株式会社 音源候補抽出システムおよび音源探査方法
JP7444045B2 (ja) * 2020-12-17 2024-03-06 トヨタ自動車株式会社 音源探査システムおよび音源探査方法
CN117597734A (zh) * 2021-07-29 2024-02-23 松下电器（美国）知识产权公司 信息处理系统、信息处理方法以及信息处理程序

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH082339A (ja) * 1994-06-16 1996-01-09 Mitsubishi Automob Eng Co Ltd 車外音導入装置
JP2013177095A (ja) * 2012-02-29 2013-09-09 Murakami Corp 車外音導入装置

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009014653A (ja) 2007-07-09 2009-01-22 Denso Corp 車載装置
US9469247B2 (en) * 2013-11-21 2016-10-18 Harman International Industries, Incorporated Using external sounds to alert vehicle occupants of external events and mask in-car conversations
US9800983B2 (en) * 2014-07-24 2017-10-24 Magna Electronics Inc. Vehicle in cabin sound processing system
US9844981B2 (en) * 2015-06-02 2017-12-19 Karma Automotive Llc Systems and methods for use in a vehicle for detecting external events
EP3539305A4 (en) * 2016-11-13 2020-04-22 Embodyvr, Inc. SYSTEM AND METHOD FOR TAKING PICTURES OF THE EARSEL AND CHARACTERIZING THE HUMAN LOCAL ANATOMY USING PICTURES OF THE EARSEL
JP7091311B2 (ja) * 2017-03-29 2022-06-27 ソニーグループ株式会社 情報処理装置、情報処理方法、プログラム、及び、移動体
US10419868B2 (en) * 2017-08-02 2019-09-17 Faurecia Automotive Seating, Llc Sound system
JP2019121887A (ja) 2017-12-28 2019-07-22 パナソニックＩｐマネジメント株式会社 音源検知システム及び音源検知方法

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH082339A (ja) * 1994-06-16 1996-01-09 Mitsubishi Automob Eng Co Ltd 車外音導入装置
JP2013177095A (ja) * 2012-02-29 2013-09-09 Murakami Corp 車外音導入装置

Also Published As

Publication number Publication date
JP2023027068A (ja) 2023-03-01
JP7371751B2 (ja) 2023-10-31
JP7276472B2 (ja) 2023-05-18
US20220329936A1 (en) 2022-10-13
US12289583B2 (en) 2025-04-29
JPWO2021048893A1 (https=) 2021-03-18

Similar Documents

Publication Publication Date Title
JP7371751B2 (ja) 集音放音方法
CN110691299B (zh) 音频处理系统、方法、装置、设备及存储介质
US5979586A (en) Vehicle collision warning system
JP7268582B2 (ja) 乗物用消音装置及び乗物用消音方法
US7327235B2 (en) Alarm sound outputting device for vehicle and program thereof
US9744809B2 (en) Enhanced sound generation for quiet vehicles
JP4725236B2 (ja) 車外警告音報知装置
JP2019016971A (ja) 音出力装置
JP3179227B2 (ja) 車両用警報装置
JP2009113659A (ja) 車両用ノイズキャンセル装置
WO2017056707A1 (ja) 障害物報知装置及び障害物報知方法
JPWO2020003819A1 (ja) 音声信号処理装置、移動装置、および方法、並びにプログラム
CN105358382A (zh) 物体检测装置以及物体检测方法
KR20240150490A (ko) 음향 센서를 사용하여 운전자 지원 시스템을 테스트하는 테스트 스탠드 시스템
JP6726297B2 (ja) 処理装置、サーバ装置、出力方法及びプログラム
US20070274546A1 (en) Music Contents Reproducing Apparatus
JP2009073417A (ja) 騒音制御装置および方法
JP2011251587A (ja) 車内音制御装置、車内音響装置、車内音響制御システム、および車内音制御方法
JP2025151961A (ja) 車両用警報装置、車両用警報システム及びメータユニット
KR102911025B1 (ko) 차량용 음향 시스템 및 이의 음향 출력 방법
US11778369B2 (en) Notification apparatus, notification method, and program
JP2013060134A (ja) 車載警告装置、当該装置を用いた衝突警告装置及びレーン逸脱警告装置
JP2012206617A (ja) 車載用音響処理装置
JP2025181030A (ja) 車室内音響分析方法
JP2007269044A (ja) 車載用発音装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19945158

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021544982

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19945158

Country of ref document: EP

Kind code of ref document: A1

WWG Wipo information: grant in national office

Ref document number: 17640305

Country of ref document: US