JP7459779B2 - 音源候補抽出システムおよび音源探査方法 - Google Patents
音源候補抽出システムおよび音源探査方法 Download PDFInfo
- Publication number
- JP7459779B2 JP7459779B2 JP2020209729A JP2020209729A JP7459779B2 JP 7459779 B2 JP7459779 B2 JP 7459779B2 JP 2020209729 A JP2020209729 A JP 2020209729A JP 2020209729 A JP2020209729 A JP 2020209729A JP 7459779 B2 JP7459779 B2 JP 7459779B2
- Authority
- JP
- Japan
- Prior art keywords
- sound source
- vehicle
- sound
- candidate
- abnormal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000605 extraction Methods 0.000 title claims description 55
- 238000000034 method Methods 0.000 title description 34
- 230000002159 abnormal effect Effects 0.000 claims description 186
- 230000008859 change Effects 0.000 claims description 84
- 239000000284 extract Substances 0.000 claims description 17
- 230000001902 propagating effect Effects 0.000 claims description 16
- 238000003384 imaging method Methods 0.000 claims description 14
- 238000005259 measurement Methods 0.000 description 67
- 230000005540 biological transmission Effects 0.000 description 42
- 238000001514 detection method Methods 0.000 description 38
- 230000008569 process Effects 0.000 description 29
- 238000004891 communication Methods 0.000 description 24
- 238000010586 diagram Methods 0.000 description 16
- 239000000523 sample Substances 0.000 description 10
- 230000007246 mechanism Effects 0.000 description 6
- 230000001133 acceleration Effects 0.000 description 5
- 238000013461 design Methods 0.000 description 5
- 238000010191 image analysis Methods 0.000 description 4
- 238000007689 inspection Methods 0.000 description 4
- 239000010720 hydraulic oil Substances 0.000 description 3
- 239000000446 fuel Substances 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 238000002485 combustion reaction Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000009347 mechanical transmission Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000003921 oil Substances 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H9/00—Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves by using radiation-sensitive means, e.g. optical means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/16—Image acquisition using multiple overlapping images; Image stitching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
- G07C5/0866—Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/54—Audio sensitive means, e.g. ultrasound
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0816—Indicating performance data, e.g. occurrence of a malfunction
- G07C5/0833—Indicating performance data, e.g. occurrence of a malfunction using audio means
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Mechanical Engineering (AREA)
- Transportation (AREA)
- Mathematical Physics (AREA)
- Automation & Control Theory (AREA)
- Bioinformatics & Computational Biology (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Traffic Control Systems (AREA)
- Testing Of Devices, Machine Parts, Or Other Structures Thereof (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
Description
87a:第1カメラ(撮像装置)
87b:第2カメラ(撮像装置)
87c:ハイスピードカメラ(取得装置)
87d:音響カメラ(取得装置)
94、306、406、506:音源探査装置(取得装置)
94b、304、404、504:探査用制御装置(抽出装置)
Claims (2)
- 車両から発せられて車室内または車室外を伝播する異音の原因となる音源の音源候補を抽出する音源候補抽出システムであって、
前記車室内または前記車室外における前記車両の画像データを取得する撮像装置と、
マイクロホンによって集音された音データに基づいて或いは前記車両のユーザからの前記異音が発生したという情報に基づいて前記異音が発生したか否かを判定し、前記撮像装置によって取得された前記異音が発生したと判定する前の第1の画像データと、前記異音が発生したと判定したときまたは前記異音が発生したと判定した後の第2の画像データとに基づき、前記第2の画像データにおける前記第1の画像データからの前記車両に係る変化点から前記音源候補を抽出する抽出装置と、を備える
ことを特徴とする音源候補抽出システム。 - 車両から発せられて車室内または車室外を伝播する異音の原因となる音源の音源候補を抽出する音源候補抽出システムとして、前記車室内または前記車室外における前記車両の画像データを取得する撮像装置と、マイクロホンによって集音された音データに基づいて或いは前記車両のユーザからの前記異音が発生したという情報に基づいて前記異音が発生したか否かを判定し、前記撮像装置によって取得された前記異音が発生したと判定する前の第1の画像データと前記異音が発生したと判定したときまたは前記異音が発生したと判定した後の第2の画像データとに基づき、前記第2の画像データにおける前記第1の画像データからの前記車両に係る変化点から前記音源の音源候補を抽出する抽出装置と、を備える、音源候補抽出システムを用いて、前記異音の原因となる前記音源を探査する音源探査方法であって、
前記音源候補抽出システムによって、前記音源候補を抽出させる工程と、
取得装置によって、前記音源候補の振動情報または音データを取得させる工程と、を備える
ことを特徴とする音源探査方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020209729A JP7459779B2 (ja) | 2020-12-17 | 2020-12-17 | 音源候補抽出システムおよび音源探査方法 |
US17/517,340 US12084061B2 (en) | 2020-12-17 | 2021-11-02 | Sound-source-candidate extraction system and sound-source search method |
CN202111550679.8A CN114646379A (zh) | 2020-12-17 | 2021-12-17 | 声源候选提取系统以及声源探测方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020209729A JP7459779B2 (ja) | 2020-12-17 | 2020-12-17 | 音源候補抽出システムおよび音源探査方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2022096555A JP2022096555A (ja) | 2022-06-29 |
JP7459779B2 true JP7459779B2 (ja) | 2024-04-02 |
Family
ID=81992604
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2020209729A Active JP7459779B2 (ja) | 2020-12-17 | 2020-12-17 | 音源候補抽出システムおよび音源探査方法 |
Country Status (3)
Country | Link |
---|---|
US (1) | US12084061B2 (ja) |
JP (1) | JP7459779B2 (ja) |
CN (1) | CN114646379A (ja) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7444045B2 (ja) * | 2020-12-17 | 2024-03-06 | トヨタ自動車株式会社 | 音源探査システムおよび音源探査方法 |
KR20230121249A (ko) * | 2022-02-11 | 2023-08-18 | 현대자동차주식회사 | Ai 기반 전기차 pe 부품의 소음발생 진단장치 및 방법 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010091282A (ja) | 2008-10-03 | 2010-04-22 | Nissan Motor Co Ltd | 音源探査装置および音源探査方法 |
JP2016014586A (ja) | 2014-07-02 | 2016-01-28 | 株式会社ジェイテクト | 騒音測定方法 |
WO2017191362A1 (en) | 2016-05-06 | 2017-11-09 | Procemex Oy | Acoustic analysation of an operational state of process machinery |
JP2019168387A (ja) | 2018-03-26 | 2019-10-03 | 株式会社Nttドコモ | 建築物判定システム |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4679077A (en) * | 1984-11-10 | 1987-07-07 | Matsushita Electric Works, Ltd. | Visual Image sensor system |
JP4722347B2 (ja) * | 2000-10-02 | 2011-07-13 | 中部電力株式会社 | 音源探査システム |
FR2844894B1 (fr) * | 2002-09-23 | 2004-12-17 | Remy Henri Denis Bruno | Procede et systeme de traitement d'une representation d'un champ acoustique |
DE10304215A1 (de) * | 2003-01-30 | 2004-08-19 | Gesellschaft zur Förderung angewandter Informatik eV | Verfahren und Vorrichtung zur bildgebenden Darstellung von akustischen Objekten sowie ein entsprechendes Computerprogramm-Erzeugnis und ein entsprechendes computerlesbares Speichermedium |
BRPI0807594A2 (pt) * | 2007-12-18 | 2014-07-22 | Sony Corp | Dispositivo de processamento de dados, método de processamento de dados, e, meio de armazenagem |
US8699754B2 (en) * | 2008-04-24 | 2014-04-15 | GM Global Technology Operations LLC | Clear path detection through road modeling |
US8077540B2 (en) * | 2008-06-13 | 2011-12-13 | The United States Of America As Represented By The Secretary Of The Navy | System and method for determining vector acoustic intensity external to a spherical array of transducers and an acoustically reflective spherical surface |
JP5607416B2 (ja) * | 2010-04-30 | 2014-10-15 | トヨタ自動車株式会社 | 車外音検出装置 |
KR101761312B1 (ko) * | 2010-12-23 | 2017-07-25 | 삼성전자주식회사 | 마이크 어레이를 이용한 방향성 음원 필터링 장치 및 그 제어방법 |
EP2741270B1 (en) * | 2011-08-02 | 2020-11-25 | Nissan Motor Co., Ltd. | Driving assistance apparatus and driving assistance method |
KR101282673B1 (ko) * | 2011-12-09 | 2013-07-05 | 현대자동차주식회사 | 음원 위치 추정 방법 |
JP2014016308A (ja) * | 2012-07-11 | 2014-01-30 | Mitsubishi Motors Corp | 音源探査方法及び音源探査装置 |
EP2928182B1 (en) * | 2012-11-27 | 2019-07-17 | Clarion Co., Ltd. | Onboard image processing system |
KR20160122835A (ko) * | 2014-03-18 | 2016-10-24 | 로베르트 보쉬 게엠베하 | 적응형 음향 강도 분석장치 |
EP3001162A1 (de) * | 2014-09-27 | 2016-03-30 | CAE Software & Systems GmbH | Schallquellenvisualisierungssystem und Umwandlungseinheit |
US11079468B2 (en) * | 2014-12-15 | 2021-08-03 | Courtius Oy | Detection of acoustic events |
US9305463B1 (en) * | 2015-01-02 | 2016-04-05 | Atieva, Inc. | Automatically activated in-cabin vehicle camera system |
GB2540175A (en) * | 2015-07-08 | 2017-01-11 | Nokia Technologies Oy | Spatial audio processing apparatus |
KR20170130041A (ko) * | 2016-05-18 | 2017-11-28 | (주)에스엠인스트루먼트 | 소음원 가시화 데이터 누적 표시방법 및 음향 카메라 시스템 |
CN111369799B (zh) * | 2019-05-20 | 2021-11-23 | 杭州海康威视系统技术有限公司 | 一种检测改装车辆的方法、装置及系统 |
CN112082781B (zh) * | 2019-06-12 | 2022-03-15 | 比亚迪股份有限公司 | 车辆及其故障检测方法和故障检测装置 |
JP7276472B2 (ja) * | 2019-09-09 | 2023-05-18 | 日本電信電話株式会社 | 集音放音方法 |
-
2020
- 2020-12-17 JP JP2020209729A patent/JP7459779B2/ja active Active
-
2021
- 2021-11-02 US US17/517,340 patent/US12084061B2/en active Active
- 2021-12-17 CN CN202111550679.8A patent/CN114646379A/zh active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010091282A (ja) | 2008-10-03 | 2010-04-22 | Nissan Motor Co Ltd | 音源探査装置および音源探査方法 |
JP2016014586A (ja) | 2014-07-02 | 2016-01-28 | 株式会社ジェイテクト | 騒音測定方法 |
WO2017191362A1 (en) | 2016-05-06 | 2017-11-09 | Procemex Oy | Acoustic analysation of an operational state of process machinery |
JP2019168387A (ja) | 2018-03-26 | 2019-10-03 | 株式会社Nttドコモ | 建築物判定システム |
Also Published As
Publication number | Publication date |
---|---|
CN114646379A (zh) | 2022-06-21 |
JP2022096555A (ja) | 2022-06-29 |
US20220194383A1 (en) | 2022-06-23 |
US12084061B2 (en) | 2024-09-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7459779B2 (ja) | 音源候補抽出システムおよび音源探査方法 | |
JP4906808B2 (ja) | 省燃費運転診断装置、省燃費運転診断システム、車両の走行制御装置及び省燃費運転診断方法 | |
EP2799834B1 (en) | Vehicle diagnostic system, vehicle diagnostic method, and vehicle | |
JP5095549B2 (ja) | 省燃費運転診断装置、省燃費運転診断システム、走行制御装置、省燃費運転採点装置及び省燃費運転診断方法 | |
CN108216232B (zh) | 车辆和车辆的控制方法 | |
CN111081051A (zh) | 车辆事故处理方法、装置、事故监测设备、车载终端和存储介质 | |
CN109987090A (zh) | 驾驶辅助系统和方法 | |
US11433911B2 (en) | Controller for vehicle | |
CN110167812A (zh) | 用于通过发动机从引擎熄火滑行提前重新起动而运行机动车的方法 | |
CN114646383B (zh) | 声源探测系统以及声源探测方法 | |
CN110962646A (zh) | 车载控制设备和车辆 | |
CN104105630B (zh) | 减速因子推定装置 | |
US11565606B2 (en) | Diagnostic device, diagnostic system, diagnostic method, and diagnostic program | |
CN115349144A (zh) | 提示控制装置以及提示控制程序 | |
CN111942283A (zh) | 车辆 | |
JP5408920B2 (ja) | 省燃費運転診断装置、省燃費運転診断システム、走行制御装置、省燃費運転採点装置及び省燃費運転診断方法 | |
JP5408921B2 (ja) | 省燃費運転診断装置、省燃費運転診断システム、走行制御装置、省燃費運転採点装置及び省燃費運転診断方法 | |
CN210062962U (zh) | 车辆的控制装置 | |
CN102556073B (zh) | 驾驶评价装置 | |
CN118243406B (zh) | 一种汽车路测驾驶评估系统及方法 | |
US20230118002A1 (en) | Driving assistance apparatus and non-transitory computer readable medium | |
CN115303238B (zh) | 辅助刹车和鸣笛方法、装置、车辆、可读存储介质及芯片 | |
JP7472923B2 (ja) | 車両管理システム、及び車両検査方法 | |
CN114228640B (zh) | 一种面向矿用车的车辆管理系统、方法及计算机设备 | |
CN212125098U (zh) | 一种基于无人车传感装置的安全提醒系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20230223 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20231129 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20231205 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20240111 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20240123 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20240206 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20240220 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20240304 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7459779 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |