WO2017200300A3 - 소음원 가시화 데이터 누적 표시방법 및 음향 카메라 시스템 - Google Patents

소음원 가시화 데이터 누적 표시방법 및 음향 카메라 시스템 Download PDF

Info

Publication number
WO2017200300A3
WO2017200300A3 PCT/KR2017/005128 KR2017005128W WO2017200300A3 WO 2017200300 A3 WO2017200300 A3 WO 2017200300A3 KR 2017005128 W KR2017005128 W KR 2017005128W WO 2017200300 A3 WO2017200300 A3 WO 2017200300A3
Authority
WO
WIPO (PCT)
Prior art keywords
sound
signal
data
image
noise source
Prior art date
Application number
PCT/KR2017/005128
Other languages
English (en)
French (fr)
Other versions
WO2017200300A2 (ko
Inventor
김영기
Original Assignee
(주)에스엠인스트루먼트
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)에스엠인스트루먼트 filed Critical (주)에스엠인스트루먼트
Publication of WO2017200300A2 publication Critical patent/WO2017200300A2/ko
Publication of WO2017200300A3 publication Critical patent/WO2017200300A3/ko

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
    • G01H3/00—Measuring characteristics of vibrations by using a detector in a fluid
    • G01H3/10—Amplitude; Power
    • G01H3/12—Amplitude; Power by electric means
    • G01H3/125—Amplitude; Power by electric means for representing acoustic field distribution
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
    • G01H11/00—Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves by detecting changes in electric or magnetic properties
    • G01H11/06—Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves by detecting changes in electric or magnetic properties by electric means
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
    • G01S3/80—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using ultrasonic, sonic or infrasonic waves
    • G01S3/802—Systems for determining direction or deviation from predetermined direction
    • G01S3/808—Systems for determining direction or deviation from predetermined direction using transducers spaced apart and measuring phase or time difference between signals therefrom, i.e. path-difference systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52023—Details of receivers
    • G01S7/52044—Scan converters
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B41/00—Special techniques not covered by groups G03B31/00 - G03B39/00; Apparatus therefor
    • G03B41/02—Special techniques not covered by groups G03B31/00 - G03B39/00; Apparatus therefor using non-intermittently running film
    • G03B41/04—Special techniques not covered by groups G03B31/00 - G03B39/00; Apparatus therefor using non-intermittently running film with optical compensator
    • G03B41/06—Special techniques not covered by groups G03B31/00 - G03B39/00; Apparatus therefor using non-intermittently running film with optical compensator with rotating reflecting member
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10—Transforming into visible information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083—Reduction of ambient noise
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B81—MICROSTRUCTURAL TECHNOLOGY
    • B81B—MICROSTRUCTURAL DEVICES OR SYSTEMS, e.g. MICROMECHANICAL DEVICES
    • B81B2201/00—Specific applications of microelectromechanical systems
    • B81B2201/02—Sensors
    • B81B2201/0292—Sensors not provided for in B81B2201/0207 - B81B2201/0285
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166—Microphone arrays; Beamforming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/003—Mems transducers or their use
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/20—Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic
    • H04R2430/23—Direction finding using a sum-delay beam-former

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Otolaryngology (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computational Linguistics (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Health & Medical Sciences (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)

Abstract

본 발명 MEMS 음향 감지 센서(10)들과, 수신된 음향신호를 중앙처리부(40)로 송신하는 음향신호 습득부(20)와, 상기 소음원의 광학 영상을 촬영하는 촬영 렌즈(30),를 포함하여 구성된 음향 및 화상 신호 습득수단(100)를 제공하는 단계(S10)와; 제1 시간프레임(T1) 동안에, 상기 음향 및 화상 신호 습득수단(100)이 소음원의 음향 신호와 영상을 습득하는 초기 신호습득 단계(S20)와; 상기 중앙처리부(40)가 빔 파워(Pij)를 계산하여 제1 음향 데이터를 생성하고, 상기 촬영 렌즈(30)의 신호를 기초로 영상 데이터를 생성하는 초기 분석 단계(S30)와; 디스플레이부(50)가 제1 음향 데이터와 화상 데이터를 코디네이션하여 중첩적으로 표출하는 초기 표출 단계(S40)와; 상기 제1 시간프레임(T1)보다 시간적으로 이후인 제2 시간프레임(T2) 동안에 상기 음향신호 습득부(20)가 소음원의 음향 신호를 습득하는 누적 신호습득 단계(S50)와; 상기 중앙처리부(40)가 제2 시간프레임(T2) 동안에 습득된 음향 신호를 기초로 누적 음향 데이터를 생성하는 누적 신호 분석 단계(S60)와; 상기 디스플레이부(50)가 상기 누적 음향 데이터를 상기 초기 음향 데이터와 화상 데이터가 중첩 표시된 영상 위에 표출하는 누적 표출 단계(S70);를 포함하여 구성되는 것을 특징으로 하는 소음원 가시화 데이터 누적 표시방법에 관한 것이다.
PCT/KR2017/005128 2016-05-18 2017-05-17 소음원 가시화 데이터 누적 표시방법 및 음향 카메라 시스템 WO2017200300A2 (ko)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020160060542A KR20170130041A (ko) 2016-05-18 2016-05-18 소음원 가시화 데이터 누적 표시방법 및 음향 카메라 시스템
KR10-2016-0060542 2016-05-18

Publications (2)

Publication Number Publication Date
WO2017200300A2 WO2017200300A2 (ko) 2017-11-23
WO2017200300A3 true WO2017200300A3 (ko) 2018-01-04

Family

ID=57284159

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/005128 WO2017200300A2 (ko) 2016-05-18 2017-05-17 소음원 가시화 데이터 누적 표시방법 및 음향 카메라 시스템

Country Status (4)

Country Link
US (1) US10446172B2 (ko)
KR (1) KR20170130041A (ko)
CN (1) CN106124040B (ko)
WO (1) WO2017200300A2 (ko)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108694937A (zh) * 2017-04-05 2018-10-23 陈荣伟 一种数字视音频监控系统中音频可视化监控的方法
US20180335503A1 (en) * 2017-05-19 2018-11-22 Magna Electronics Inc. Vehicle system using mems microphone module
US11099075B2 (en) * 2017-11-02 2021-08-24 Fluke Corporation Focus and/or parallax adjustment in acoustic imaging using distance information
DE102019118379A1 (de) * 2018-07-12 2020-03-05 Fanuc Corporation Rauschquellenüberwachungsvorrichtung und Rauschquellenüberwachungsverfahren
KR20200032324A (ko) 2018-09-18 2020-03-26 한국철도기술연구원 소음특성 분석 시스템 및 이를 이용한 소음특성 분석 방법
KR102210041B1 (ko) * 2019-10-01 2021-02-01 (주)에스엠인스트루먼트 Cctv 연계형 음향 시각화 시스템
KR20210129942A (ko) * 2020-04-21 2021-10-29 현대자동차주식회사 이음 검사 장치 및 그 검사 방법
WO2022056327A1 (en) 2020-09-11 2022-03-17 Fluke Corporation System and method for acoustic imaging with an accumulated-time view
JP7459779B2 (ja) * 2020-12-17 2024-04-02 トヨタ自動車株式会社 音源候補抽出システムおよび音源探査方法
US20230012392A1 (en) * 2021-07-12 2023-01-12 Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America Exterior Microphone Camera System

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004286562A (ja) * 2003-03-20 2004-10-14 East Japan Railway Co 移動体のノイズ測定装置、方法及びプログラム
KR20080043687A (ko) * 2007-08-03 2008-05-19 김영기 인자 측정 및 표시 방법, 인자 측정 및 표시 장치, 인자측정 및 표시 프로그램을 기록한 컴퓨터로 읽을 수 있는매체 및 음향 스캐너
JP2012207948A (ja) * 2011-03-29 2012-10-25 Hitachi Ltd 設備異常経時変化判定装置、設備異常変化判定方法、およびプログラム
KR20130065029A (ko) * 2011-12-09 2013-06-19 현대자동차주식회사 음원 위치 추정 방법
KR20150034720A (ko) * 2012-07-19 2015-04-03 닛토보 온쿄 엔지니어링 가부시키가이샤 소음 식별장치 및 소음 식별방법

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1874603A (en) * 1927-01-26 1932-08-30 Freeman H Owens Combined motion picture and sound camera
US3895339A (en) * 1974-03-29 1975-07-15 Westinghouse Electric Corp Acoustic camera apparatus
KR100217872B1 (ko) 1996-11-22 1999-09-01 윤덕용 이동음원의 홀로그램을 측정하여 음향특성을 영상화하는 시스템 및 방법
US20090033748A1 (en) * 2005-06-15 2009-02-05 Nikon Corporation Electronic camera system, electronic camera, cradle, image accumulation device, and program
CN2821546Y (zh) * 2005-07-11 2006-09-27 中国船舶重工集团公司第七一一研究所 声像测量仪
KR20070068138A (ko) * 2005-12-26 2007-06-29 재단법인 포항산업과학연구원 동영상 방식 음향카메라
KR100838239B1 (ko) * 2007-04-17 2008-06-17 (주)에스엠인스트루먼트 음질 표시 장치, 음질 표시 방법, 음질 표시 프로그램을 기록한 컴퓨터로 읽을 수 있는 매체
DE102007041280B3 (de) * 2007-08-31 2008-11-13 Wacker Construction Equipment Ag Anordnung und Verfahren zum Überwachen eines Betonverdichtungsprozesses mit einer Schallkamera
KR20090122131A (ko) * 2008-05-22 2009-11-26 경희대학교 산학협력단 영상 및 음향 정보를 이용한 누설감시장치
TWI389579B (zh) * 2009-04-27 2013-03-11 Univ Nat Chiao Tung Acoustic camera
KR101059081B1 (ko) 2009-05-29 2011-08-24 (주)에스엠인스트루먼트 이동 소음원 가시화 장치 및 가시화 방법
KR100962552B1 (ko) * 2010-01-20 2010-06-11 (주)테슬라시스템 촬영된 영상에 음원 정보를 표시하는 카메라 시스템
KR101213540B1 (ko) * 2011-08-18 2012-12-18 (주)에스엠인스트루먼트 멤스 마이크로폰 어레이를 이용한 음향감지 장치 및 음향카메라
KR101203269B1 (ko) * 2011-11-16 2012-11-21 한국해양연구원 저주파 및 고주파를 선택적으로 운용하는 정밀수중탐사용 수중초음파카메라 및 그 작동방법
DK2838711T3 (en) * 2012-04-16 2016-09-05 Vestas Wind Sys As A method of making a composite part and an apparatus for making a composite part
KR101471299B1 (ko) * 2013-08-19 2014-12-10 (주)에스엠인스트루먼트 이동식 음향 카메라
CN103516969A (zh) * 2013-08-23 2014-01-15 Sm器械株式会社 移动式声学照相机及制造方法
US9736580B2 (en) * 2015-03-19 2017-08-15 Intel Corporation Acoustic camera based audio visual scene analysis
CN104883482A (zh) * 2015-05-15 2015-09-02 萨姆株式会社 机械类状态监视用多频道超声波声学摄像机

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004286562A (ja) * 2003-03-20 2004-10-14 East Japan Railway Co 移動体のノイズ測定装置、方法及びプログラム
KR20080043687A (ko) * 2007-08-03 2008-05-19 김영기 인자 측정 및 표시 방법, 인자 측정 및 표시 장치, 인자측정 및 표시 프로그램을 기록한 컴퓨터로 읽을 수 있는매체 및 음향 스캐너
JP2012207948A (ja) * 2011-03-29 2012-10-25 Hitachi Ltd 設備異常経時変化判定装置、設備異常変化判定方法、およびプログラム
KR20130065029A (ko) * 2011-12-09 2013-06-19 현대자동차주식회사 음원 위치 추정 방법
KR20150034720A (ko) * 2012-07-19 2015-04-03 닛토보 온쿄 엔지니어링 가부시키가이샤 소음 식별장치 및 소음 식별방법

Also Published As

Publication number Publication date
KR20170130041A (ko) 2017-11-28
US10446172B2 (en) 2019-10-15
WO2017200300A2 (ko) 2017-11-23
CN106124040A (zh) 2016-11-16
US20170337938A1 (en) 2017-11-23
CN106124040B (zh) 2020-11-13

Similar Documents

Publication Publication Date Title
WO2017200300A3 (ko) 소음원 가시화 데이터 누적 표시방법 및 음향 카메라 시스템
US10880668B1 (en) Scaling of virtual audio content using reverberent energy
US9794722B2 (en) Head-related transfer function recording using positional tracking
US11122385B2 (en) Determination of acoustic parameters for a headset using a mapping server
EP4231245A3 (en) Method and apparatus for generating a virtual image from a viewpoint selected by the user, from a camera array with transmission of foreground and background images at different frame rates
US20160364881A1 (en) Apparatus and method for hybrid eye tracking
EP1983316A3 (en) Sound quality display apparatus, sound quality display method, computer readable medium on which sound quality display program is recorded and sound camera
BR112013021658A2 (pt) aparelho para prover realimentação durante um procedimento de correção de visão, e, método para prover realimentação para um procedimento de correção de visão
US11222409B2 (en) Image/video deblurring using convolutional neural networks with applications to SFM/SLAM with blurred images/videos
WO2020261250A1 (en) Determination of spatialized virtual acoustic scenes from legacy audiovisual media
EP2207056A4 (en) ENDOSCOPIC DEVICE
WO2017134416A3 (en) Touchscreen panel signal processing
JP2016529959A5 (ko)
JP6642989B2 (ja) 制御装置、制御方法及びプログラム
JP2015085013A5 (ko)
CN113641088B (zh) 用于深度传感的时间数字转换器
Davanthapuram et al. Visually impaired indoor navigation using YOLO based object recognition, monocular depth estimation and binaural sounds
GB2570585A (en) A display system for a vehicle, a vehicle and method
KR20100117793A (ko) 음원 분석 장치
WO2019109301A1 (zh) 导盲方法、装置和导盲设备
US20210065523A1 (en) Systems and methods for characterization of mechanical impedance of biological tissues
US11006035B2 (en) Imaging system, imaging device, and imaging method
RU2018125899A (ru) Система и способ для отслеживания медицинского устройства
JP5305488B2 (ja) 遅延検出装置、遅延検出方法
US20210004080A1 (en) Position estimation apparatus, position estimation method, and program

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17799657

Country of ref document: EP

Kind code of ref document: A2

122 Ep: pct application non-entry in european phase

Ref document number: 17799657

Country of ref document: EP

Kind code of ref document: A2