KR20140145195A - 멀티-모달 매칭 방식을 이용한 오브젝트 인식 - Google Patents

멀티-모달 매칭 방식을 이용한 오브젝트 인식 Download PDF

Info

Publication number
KR20140145195A
KR20140145195A KR1020147031578A KR20147031578A KR20140145195A KR 20140145195 A KR20140145195 A KR 20140145195A KR 1020147031578 A KR1020147031578 A KR 1020147031578A KR 20147031578 A KR20147031578 A KR 20147031578A KR 20140145195 A KR20140145195 A KR 20140145195A
Authority
KR
South Korea
Prior art keywords
scene
image
audio
keypoints
code
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
KR1020147031578A
Other languages
English (en)
Korean (ko)
Inventor
에릭 비제르
하이인 왕
하십 에이 시디퀴
래훈 김
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20140145195A publication Critical patent/KR20140145195A/ko
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G06F18/254—Fusion techniques of classification results, e.g. of results related to same input data
    • G06F18/256—Fusion techniques of classification results, e.g. of results related to same input data of results relating to different input data, e.g. multimodal recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G06V10/809—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of classification results, e.g. where the classifiers operate on the same input data
    • G06V10/811—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of classification results, e.g. where the classifiers operate on the same input data the classifiers operating on different input data, e.g. multi-modal recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/15—Aspects of sound capture and related signal processing for recording or reproduction

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Otolaryngology (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Image Analysis (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Studio Devices (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
KR1020147031578A 2012-04-13 2013-03-07 멀티-모달 매칭 방식을 이용한 오브젝트 인식 Ceased KR20140145195A (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201261623910P 2012-04-13 2012-04-13
US61/623,910 2012-04-13
US13/664,295 US9495591B2 (en) 2012-04-13 2012-10-30 Object recognition using multi-modal matching scheme
US13/664,295 2012-10-30
PCT/US2013/029558 WO2013154701A1 (en) 2012-04-13 2013-03-07 Object recognition using multi-modal matching scheme

Publications (1)

Publication Number Publication Date
KR20140145195A true KR20140145195A (ko) 2014-12-22

Family

ID=49325131

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020147031578A Ceased KR20140145195A (ko) 2012-04-13 2013-03-07 멀티-모달 매칭 방식을 이용한 오브젝트 인식

Country Status (7)

Country Link
US (1) US9495591B2 (enExample)
EP (1) EP2836964A1 (enExample)
JP (2) JP2015514239A (enExample)
KR (1) KR20140145195A (enExample)
CN (1) CN104246796B (enExample)
IN (1) IN2014MN01958A (enExample)
WO (1) WO2013154701A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11431887B2 (en) 2018-07-24 2022-08-30 Sony Semiconductor Solutions Corporation Information processing device and method for detection of a sound image object

Families Citing this family (140)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8175617B2 (en) 2009-10-28 2012-05-08 Digimarc Corporation Sensor-based mobile search, related methods and systems
US8810598B2 (en) 2011-04-08 2014-08-19 Nant Holdings Ip, Llc Interference based augmented reality hosting platforms
US9489567B2 (en) * 2011-04-11 2016-11-08 Intel Corporation Tracking and recognition of faces using selected region classification
WO2013078345A1 (en) 2011-11-21 2013-05-30 Nant Holdings Ip, Llc Subscription bill service, systems and methods
US9099096B2 (en) * 2012-05-04 2015-08-04 Sony Computer Entertainment Inc. Source separation by independent component analysis with moving constraint
US8880395B2 (en) * 2012-05-04 2014-11-04 Sony Computer Entertainment Inc. Source separation by independent component analysis in conjunction with source direction information
US8886526B2 (en) * 2012-05-04 2014-11-11 Sony Computer Entertainment Inc. Source separation using independent component analysis with mixed multi-variate probability density function
US20160210957A1 (en) 2015-01-16 2016-07-21 Foundation For Research And Technology - Hellas (Forth) Foreground Signal Suppression Apparatuses, Methods, and Systems
US9554203B1 (en) * 2012-09-26 2017-01-24 Foundation for Research and Technolgy—Hellas (FORTH) Institute of Computer Science (ICS) Sound source characterization apparatuses, methods and systems
US10149048B1 (en) 2012-09-26 2018-12-04 Foundation for Research and Technology—Hellas (F.O.R.T.H.) Institute of Computer Science (I.C.S.) Direction of arrival estimation and sound source enhancement in the presence of a reflective surface apparatuses, methods, and systems
US10136239B1 (en) 2012-09-26 2018-11-20 Foundation For Research And Technology—Hellas (F.O.R.T.H.) Capturing and reproducing spatial sound apparatuses, methods, and systems
US9549253B2 (en) 2012-09-26 2017-01-17 Foundation for Research and Technology—Hellas (FORTH) Institute of Computer Science (ICS) Sound source localization and isolation apparatuses, methods and systems
US10175335B1 (en) 2012-09-26 2019-01-08 Foundation For Research And Technology-Hellas (Forth) Direction of arrival (DOA) estimation apparatuses, methods, and systems
US9955277B1 (en) * 2012-09-26 2018-04-24 Foundation For Research And Technology-Hellas (F.O.R.T.H.) Institute Of Computer Science (I.C.S.) Spatial sound characterization apparatuses, methods and systems
CN104756525B (zh) 2012-11-02 2017-04-12 索尼公司 信号处理装置和信号处理方法
CN104756526B (zh) 2012-11-02 2017-05-17 索尼公司 信号处理装置、信号处理方法、测量方法及测量装置
CN103916723B (zh) * 2013-01-08 2018-08-10 联想(北京)有限公司 一种声音采集方法以及一种电子设备
US9311640B2 (en) 2014-02-11 2016-04-12 Digimarc Corporation Methods and arrangements for smartphone payments and transactions
KR101832835B1 (ko) * 2013-07-11 2018-02-28 삼성전자주식회사 영상 처리 모듈, 초음파 영상 장치, 영상 처리 방법 및 초음파 영상 장치의 제어 방법
US9729994B1 (en) * 2013-08-09 2017-08-08 University Of South Florida System and method for listener controlled beamforming
US20150085615A1 (en) * 2013-09-25 2015-03-26 Lenovo (Singapore) Pte, Ltd. Motion modified steering vector
US9582516B2 (en) 2013-10-17 2017-02-28 Nant Holdings Ip, Llc Wide area augmented reality location-based services
EP2884491A1 (en) * 2013-12-11 2015-06-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Extraction of reverberant sound using microphone arrays
US9338575B2 (en) * 2014-02-19 2016-05-10 Echostar Technologies L.L.C. Image steered microphone array
JP6320806B2 (ja) * 2014-03-17 2018-05-09 国立大学法人豊橋技術科学大学 三次元モデル検索方法、及び三次元モデル検索システム
CN103905810B (zh) * 2014-03-17 2017-12-12 北京智谷睿拓技术服务有限公司 多媒体处理方法及多媒体处理装置
KR20150118855A (ko) * 2014-04-15 2015-10-23 삼성전자주식회사 전자 장치 및 전자 장치의 레코딩 방법
US11314826B2 (en) 2014-05-23 2022-04-26 Samsung Electronics Co., Ltd. Method for searching and device thereof
US9990433B2 (en) 2014-05-23 2018-06-05 Samsung Electronics Co., Ltd. Method for searching and device thereof
CN105224941B (zh) * 2014-06-18 2018-11-20 台达电子工业股份有限公司 对象辨识与定位方法
US10679407B2 (en) 2014-06-27 2020-06-09 The University Of North Carolina At Chapel Hill Methods, systems, and computer readable media for modeling interactive diffuse reflections and higher-order diffraction in virtual environment scenes
JP6118838B2 (ja) * 2014-08-21 2017-04-19 本田技研工業株式会社 情報処理装置、情報処理システム、情報処理方法、及び情報処理プログラム
US9536509B2 (en) * 2014-09-25 2017-01-03 Sunhouse Technologies, Inc. Systems and methods for capturing and interpreting audio
US20220199059A1 (en) * 2014-09-25 2022-06-23 Sunhouse Technologies, Inc. Systems and methods for capturing and interpreting audio
US11308928B2 (en) * 2014-09-25 2022-04-19 Sunhouse Technologies, Inc. Systems and methods for capturing and interpreting audio
US10061009B1 (en) 2014-09-30 2018-08-28 Apple Inc. Robust confidence measure for beamformed acoustic beacon for device tracking and localization
GB2533373B (en) * 2014-12-18 2018-07-04 Canon Kk Video-based sound source separation
US10037712B2 (en) * 2015-01-30 2018-07-31 Toyota Motor Engineering & Manufacturing North America, Inc. Vision-assist devices and methods of detecting a classification of an object
US10217379B2 (en) 2015-01-30 2019-02-26 Toyota Motor Engineering & Manufacturing North America, Inc. Modifying vision-assist device parameters based on an environment classification
US9791264B2 (en) * 2015-02-04 2017-10-17 Sony Corporation Method of fast and robust camera location ordering
US9736580B2 (en) * 2015-03-19 2017-08-15 Intel Corporation Acoustic camera based audio visual scene analysis
CN107980221B (zh) * 2015-04-01 2021-10-29 猫头鹰实验室股份有限公司 合成并缩放角度分离的子场景
US9769587B2 (en) * 2015-04-17 2017-09-19 Qualcomm Incorporated Calibration of acoustic echo cancelation for multi-channel sound in dynamic acoustic environments
US9892518B2 (en) * 2015-06-09 2018-02-13 The Trustees Of Columbia University In The City Of New York Systems and methods for detecting motion using local phase information
US10068445B2 (en) * 2015-06-24 2018-09-04 Google Llc Systems and methods of home-specific sound event detection
US9754182B2 (en) 2015-09-02 2017-09-05 Apple Inc. Detecting keypoints in image data
US10169684B1 (en) 2015-10-01 2019-01-01 Intellivision Technologies Corp. Methods and systems for recognizing objects based on one or more stored training images
CN107925818B (zh) * 2015-10-15 2020-10-16 华为技术有限公司 用于声音处理节点装置的声音处理节点
CN105574525B (zh) * 2015-12-18 2019-04-26 天津中科虹星科技有限公司 一种复杂场景多模态生物特征图像获取方法及其装置
EP3387648B1 (en) * 2015-12-22 2020-02-12 Huawei Technologies Duesseldorf GmbH Localization algorithm for sound sources with known statistics
TW201727537A (zh) * 2016-01-22 2017-08-01 鴻海精密工業股份有限公司 人臉識別系統及人臉識別方法
EP3414925B1 (en) 2016-02-09 2019-09-11 Dolby Laboratories Licensing Corporation System and method for spatial processing of soundfield signals
EP3209034A1 (en) * 2016-02-19 2017-08-23 Nokia Technologies Oy Controlling audio rendering
US11234072B2 (en) 2016-02-18 2022-01-25 Dolby Laboratories Licensing Corporation Processing of microphone signals for spatial playback
GB2549073B (en) * 2016-03-24 2020-02-26 Imagination Tech Ltd Generating sparse sample histograms
KR102465227B1 (ko) 2016-05-30 2022-11-10 소니그룹주식회사 영상 음향 처리 장치 및 방법, 및 프로그램이 저장된 컴퓨터 판독 가능한 기록 매체
CN116612731A (zh) 2016-07-22 2023-08-18 杜比实验室特许公司 现场音乐表演的多媒体内容的基于网络的处理及分布
CN105979442B (zh) * 2016-07-22 2019-12-03 北京地平线机器人技术研发有限公司 噪声抑制方法、装置和可移动设备
US10522169B2 (en) * 2016-09-23 2019-12-31 Trustees Of The California State University Classification of teaching based upon sound amplitude
US9942513B1 (en) * 2016-10-31 2018-04-10 Cisco Technology, Inc. Automated configuration of behavior of a telepresence system based on spatial detection of telepresence components
US10528850B2 (en) * 2016-11-02 2020-01-07 Ford Global Technologies, Llc Object classification adjustment based on vehicle communication
CN109964520B (zh) * 2016-11-17 2023-12-22 瑞典爱立信有限公司 无线设备的共同调度
JP6942472B2 (ja) * 2017-01-13 2021-09-29 キヤノン株式会社 映像認識装置、映像認識方法及びプログラム
CN110226200A (zh) 2017-01-31 2019-09-10 索尼公司 信号处理装置、信号处理方法和计算机程序
US10248744B2 (en) 2017-02-16 2019-04-02 The University Of North Carolina At Chapel Hill Methods, systems, and computer readable media for acoustic classification and optimization for multi-modal rendering of real-world scenes
JP7121470B2 (ja) * 2017-05-12 2022-08-18 キヤノン株式会社 画像処理システム、制御方法、及び、プログラム
US20180366139A1 (en) * 2017-06-14 2018-12-20 Upton Beall Bowden Employing vehicular sensor information for retrieval of data
CN107621625B (zh) * 2017-06-23 2020-07-17 桂林电子科技大学 基于双微麦克风阵的声源定位方法
EP3652675A4 (en) * 2017-07-14 2021-03-24 Memorial Sloan-Kettering Cancer Center LOWLY SUPERVISED IMAGE CLASSIFIER
CN107526568A (zh) * 2017-08-18 2017-12-29 广东欧珀移动通信有限公司 音量调节方法、装置、终端设备及存储介质
US20190129027A1 (en) 2017-11-02 2019-05-02 Fluke Corporation Multi-modal acoustic imaging tool
US11209306B2 (en) 2017-11-02 2021-12-28 Fluke Corporation Portable acoustic imaging tool with scanning and analysis capability
US11099075B2 (en) 2017-11-02 2021-08-24 Fluke Corporation Focus and/or parallax adjustment in acoustic imaging using distance information
CN109754814B (zh) * 2017-11-08 2023-07-28 阿里巴巴集团控股有限公司 一种声音处理方法、交互设备
US11030997B2 (en) * 2017-11-22 2021-06-08 Baidu Usa Llc Slim embedding layers for recurrent neural language models
CN109977731B (zh) * 2017-12-27 2021-10-29 深圳市优必选科技有限公司 一种场景的识别方法、识别设备及终端设备
US10616682B2 (en) * 2018-01-12 2020-04-07 Sorama Calibration of microphone arrays with an uncalibrated source
US10522167B1 (en) * 2018-02-13 2019-12-31 Amazon Techonlogies, Inc. Multichannel noise cancellation using deep neural network masking
US11210573B2 (en) 2018-03-20 2021-12-28 Nant Holdings Ip, Llc Volumetric descriptors
CN108564116A (zh) * 2018-04-02 2018-09-21 深圳市安软慧视科技有限公司 一种摄像头场景图像的成分智能分析方法
US10511808B2 (en) * 2018-04-10 2019-12-17 Facebook, Inc. Automated cinematic decisions based on descriptive models
US11212637B2 (en) 2018-04-12 2021-12-28 Qualcomm Incorproated Complementary virtual audio generation
GB2573173B (en) * 2018-04-27 2021-04-28 Cirrus Logic Int Semiconductor Ltd Processing audio signals
CN112703375A (zh) 2018-07-24 2021-04-23 弗兰克公司 用于投射和显示声学数据的系统和方法
CN109284673B (zh) * 2018-08-07 2022-02-22 北京市商汤科技开发有限公司 对象跟踪方法及装置、电子设备及存储介质
US10769474B2 (en) 2018-08-10 2020-09-08 Apple Inc. Keypoint detection circuit for processing image pyramid in recursive manner
DE112018007596T5 (de) * 2018-08-29 2021-03-04 Intel Corporation Vorrichtung und verfahren für merkmalspunktverfolgung unter verwendung von inter-frame-voraussage
KR102748077B1 (ko) * 2018-09-03 2024-12-31 스냅 인코포레이티드 음향 주밍
JP7119809B2 (ja) * 2018-09-13 2022-08-17 富士通株式会社 情報表示制御プログラム、情報表示制御方法および情報表示制御装置
US11605231B2 (en) * 2018-09-17 2023-03-14 Syracuse University Low power and privacy preserving sensor platform for occupancy detection
CN111050269B (zh) * 2018-10-15 2021-11-19 华为技术有限公司 音频处理方法和电子设备
EP3871217B1 (en) 2018-10-24 2024-10-09 Gracenote, Inc. Methods and apparatus to adjust audio playback settings based on analysis of audio characteristics
EP3672282B1 (en) * 2018-12-21 2022-04-06 Sivantos Pte. Ltd. Method for beamforming in a binaural hearing aid
CN109697734B (zh) * 2018-12-25 2021-03-09 浙江商汤科技开发有限公司 位姿估计方法及装置、电子设备和存储介质
CN109817193B (zh) * 2019-02-21 2022-11-22 深圳市魔耳乐器有限公司 一种基于时变多段式频谱的音色拟合系统
US11343545B2 (en) 2019-03-27 2022-05-24 International Business Machines Corporation Computer-implemented event detection using sonification
CN112233647B (zh) * 2019-06-26 2025-10-17 索尼公司 信息处理设备和方法以及计算机可读存储介质
US12386007B2 (en) 2019-06-27 2025-08-12 Rensselaer Polytechnic Institute Sound source enumeration and direction of arrival estimation using a bayesian framework
US11972767B2 (en) * 2019-08-01 2024-04-30 Dolby Laboratories Licensing Corporation Systems and methods for covariance smoothing
CN110531351B (zh) * 2019-08-16 2023-09-26 山东工商学院 一种基于Fast算法的GPR图像双曲波顶点检测方法
US11440194B2 (en) * 2019-09-13 2022-09-13 Honda Motor Co., Ltd. Physical human-robot interaction (pHRI)
US10735887B1 (en) * 2019-09-19 2020-08-04 Wave Sciences, LLC Spatial audio array processing system and method
CN112862663B (zh) * 2019-11-12 2023-06-16 芜湖每刻深思智能科技有限公司 一种近传感器端计算系统
US11610599B2 (en) * 2019-12-06 2023-03-21 Meta Platforms Technologies, Llc Systems and methods for visually guided audio separation
JP7250281B2 (ja) * 2019-12-12 2023-04-03 本田技研工業株式会社 三次元構造復元装置、三次元構造復元方法、およびプログラム
CN111191547A (zh) * 2019-12-23 2020-05-22 中电健康云科技有限公司 一种基于高光谱反卷积和解混的医疗废料在线筛选方法
US11295543B2 (en) * 2020-03-31 2022-04-05 International Business Machines Corporation Object detection in an image
US10929506B1 (en) * 2020-06-02 2021-02-23 Scientific Innovations, Inc. Computerized estimation of minimum number of sonic sources using antichain length
CN111652165B (zh) * 2020-06-08 2022-05-17 北京世纪好未来教育科技有限公司 口型评测方法、设备及计算机存储介质
US11356266B2 (en) 2020-09-11 2022-06-07 Bank Of America Corporation User authentication using diverse media inputs and hash-based ledgers
US11368456B2 (en) 2020-09-11 2022-06-21 Bank Of America Corporation User security profile for multi-media identity verification
KR102790004B1 (ko) 2020-10-12 2025-04-03 삼성전자주식회사 주파수 도메인을 이용한 이미지 센서의 검사 방법 및 이를 수행하는 검사 시스템
CN112386282B (zh) * 2020-11-13 2022-08-26 声泰特（成都）科技有限公司 一种超声自动容积扫描成像方法与系统
CN112465868B (zh) * 2020-11-30 2024-01-12 浙江华锐捷技术有限公司 一种目标检测跟踪方法、装置、存储介质及电子装置
CN112860198B (zh) * 2021-01-05 2024-02-09 中科创达软件股份有限公司 视频会议的画面切换方法、装置、计算机设备及存储介质
JP6967735B1 (ja) * 2021-01-13 2021-11-17 パナソニックＩｐマネジメント株式会社 信号処理装置及び信号処理システム
CN113035162B (zh) * 2021-03-22 2024-07-09 平安科技（深圳）有限公司 民族音乐生成方法、装置、设备及存储介质
EP4338434A1 (en) * 2021-05-14 2024-03-20 Qualcomm Incorporated Acoustic configuration based on radio frequency sensing
US20240249743A1 (en) * 2021-05-25 2024-07-25 Google Llc Enhancing Audio Content of a Captured Sense
KR102437760B1 (ko) * 2021-05-27 2022-08-29 이충열 컴퓨팅 장치에 의한 음향의 처리 방법, 영상 및 음향의 처리 방법 및 이를 이용한 시스템들
CN113177536B (zh) * 2021-06-28 2021-09-10 四川九通智路科技有限公司 基于深度残差收缩网络的车辆碰撞检测方法及装置
CN113189539B (zh) * 2021-06-30 2021-09-28 成都华日通讯技术股份有限公司 一种基于测向设备的空域滤波方法
US11408971B1 (en) 2021-07-02 2022-08-09 Scientific Innovations, Inc. Computerized estimation of minimum number of sonic sources using maximum matching of a bipartite graph
CN113887360B (zh) * 2021-09-23 2024-05-31 同济大学 一种基于迭代扩展频散模态分解的频散波提取方法
US12236631B2 (en) * 2021-09-24 2025-02-25 Qualcomm Incorporated Keypoint detection and feature descriptor computation
CN114038453B (zh) * 2021-11-26 2024-11-12 深圳市北科瑞声科技股份有限公司 基于语义场景的语音识别方法、装置、设备及介质
CN114241534B (zh) * 2021-12-01 2022-10-18 佛山市红狐物联网科技有限公司 一种全掌脉络数据的快速匹配方法及系统
CN114280533B (zh) * 2021-12-23 2022-10-21 哈尔滨工程大学 一种基于l0范数约束的稀疏贝叶斯DOA估计方法
CN114422910A (zh) * 2022-01-17 2022-04-29 江苏水声技术有限公司 基于球形麦克风阵列的场景分析声学成像设备及分析方法
CN119234196A (zh) * 2022-05-20 2024-12-31 创峰科技 具有手形校准的手势检测方法和系统
CN115499759B (zh) * 2022-06-28 2025-07-01 大连大学 基于非线性交织映射的音频恢复方法及视频麦克风系统
US12020156B2 (en) 2022-07-13 2024-06-25 Robert Bosch Gmbh Systems and methods for automatic alignment between audio recordings and labels extracted from a multitude of asynchronous sensors in urban settings
US12271815B2 (en) * 2022-07-13 2025-04-08 Robert Bosch Gmbh Systems and methods for false positive mitigation in impulsive sound detectors
US11830239B1 (en) 2022-07-13 2023-11-28 Robert Bosch Gmbh Systems and methods for automatic extraction and alignment of labels derived from camera feed for moving sound sources recorded with a microphone array
CN115601576B (zh) * 2022-12-12 2023-04-07 云南览易网络科技有限责任公司 图像特征匹配方法、装置、设备及存储介质
WO2024125793A1 (en) * 2022-12-15 2024-06-20 Telefonaktiebolaget Lm Ericsson (Publ) Focusing a camera capturing video data using directional data of audio
CN115880293B (zh) * 2023-02-22 2023-05-05 中山大学孙逸仙纪念医院 膀胱癌淋巴结转移的病理图像识别方法、装置、介质
CN116796021B (zh) * 2023-08-28 2023-12-05 上海任意门科技有限公司 图像检索方法、系统、电子设备和介质
CN119559643B (zh) * 2025-02-06 2025-05-30 浙江大华技术股份有限公司 跨模态的目标检测方法、训练方法及相关设备
CN120874089B (zh) * 2025-09-22 2025-12-09 湖南软件职业技术大学 一种基于多模态交互的人工智能科普展示系统及方法

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001067098A (ja) * 1999-08-25 2001-03-16 Sanyo Electric Co Ltd 人物検出方法と人物検出機能搭載装置
US6738745B1 (en) * 2000-04-07 2004-05-18 International Business Machines Corporation Methods and apparatus for identifying a non-target language in a speech recognition system
US7130446B2 (en) * 2001-12-03 2006-10-31 Microsoft Corporation Automatic detection and tracking of multiple individuals using multiple cues
US7133535B2 (en) 2002-12-21 2006-11-07 Microsoft Corp. System and method for real time lip synchronization
JP2005117621A (ja) * 2003-09-16 2005-04-28 Honda Motor Co Ltd 画像配信システム
EP1643769B1 (en) 2004-09-30 2009-12-23 Samsung Electronics Co., Ltd. Apparatus and method performing audio-video sensor fusion for object localization, tracking and separation
JP2009296143A (ja) * 2008-06-03 2009-12-17 Canon Inc 撮像装置
US8391615B2 (en) * 2008-12-02 2013-03-05 Intel Corporation Image recognition algorithm, method of identifying a target image using same, and method of selecting data for transmission to a portable electronic device
ES2733878T3 (es) 2008-12-15 2019-12-03 Orange Codificación mejorada de señales de audio digitales multicanales
US8548193B2 (en) * 2009-09-03 2013-10-01 Palo Alto Research Center Incorporated Method and apparatus for navigating an electronic magnifier over a target document
US9031243B2 (en) * 2009-09-28 2015-05-12 iZotope, Inc. Automatic labeling and control of audio algorithms by audio recognition
US8135221B2 (en) * 2009-10-07 2012-03-13 Eastman Kodak Company Video concept classification using audio-visual atoms
CN101742114A (zh) * 2009-12-31 2010-06-16 上海量科电子科技有限公司 通过手势识别来决定拍摄操作的方法及装置
JP4968346B2 (ja) * 2010-01-20 2012-07-04 カシオ計算機株式会社 撮像装置、画像検出装置及びプログラム
US8602887B2 (en) * 2010-06-03 2013-12-10 Microsoft Corporation Synthesis of information from multiple audiovisual sources
US8805007B2 (en) * 2011-10-13 2014-08-12 Disney Enterprises, Inc. Integrated background and foreground tracking

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11431887B2 (en) 2018-07-24 2022-08-30 Sony Semiconductor Solutions Corporation Information processing device and method for detection of a sound image object

Also Published As

Publication number Publication date
CN104246796B (zh) 2018-04-17
JP2015514239A (ja) 2015-05-18
WO2013154701A1 (en) 2013-10-17
IN2014MN01958A (enExample) 2015-07-10
JP2018077479A (ja) 2018-05-17
US20130272548A1 (en) 2013-10-17
CN104246796A (zh) 2014-12-24
EP2836964A1 (en) 2015-02-18
US9495591B2 (en) 2016-11-15

Similar Documents

Publication Publication Date Title
US9495591B2 (en) Object recognition using multi-modal matching scheme
KR101521368B1 (ko) 다중 채널 오디오 신호를 분해하는 방법, 장치 및 머신 판독가능 저장 매체
Yan et al. An initial investigation for detecting vocoder fingerprints of fake audio
JP6800995B2 (ja) スペクトログラムに対する構造テンソルを用いた調波打楽器残差音声分離装置および方法
WO2025035975A1 (zh) 语音增强网络的训练方法、语音增强方法及电子设备
JP4912778B2 (ja) 信号源の軌跡をモデル化する方法及びシステム
Chen et al. Structure from silence: Learning scene structure from ambient sound
JP2012042454A (ja) 位置検出装置及び位置検出方法
Chen et al. Multimodal fusion for indoor sound source localization
Crocco et al. Audio tracking in noisy environments by acoustic map and spectral signature
Gillet et al. Automatic transcription of drum sequences using audiovisual features
Rupesh Kumar et al. A novel approach towards generalization of countermeasure for spoofing attack on ASV systems
Al-Ali et al. Enhanced forensic speaker verification performance using the ICA-EBM algorithm under noisy and reverberant environments
Dwivedi et al. Spherical harmonics domain-based approach for source localization in presence of directional interference
CN114155850B (zh) 基于麦克风阵列的语音欺骗攻击检测系统与方法
Venkatesan et al. Analysis of monaural and binaural statistical properties for the estimation of distance of a target speaker
Salvati et al. Joint identification and localization of a speaker in adverse conditions using a microphone array
Radha et al. Improving recognition of speech system using multimodal approach
Venkatesan et al. Unsupervised auditory saliency enabled binaural scene analyzer for speaker localization and recognition
Mitchell et al. Improved direction of arrival estimations with a wearable microphone array for dynamic environments by reliability weighting
Lathoud Further applications of sector-based detection and short-term clustering
CN118711617A (zh) 音频信号处理方法及装置
Härmä Detection of audio events by boosted learning of local time-frequency patterns
CN120012031A (zh) 一种基于超高清视频的鸟群识别方法及系统
McKay et al. Evaluating ground truth for ADRess as a preprocess for automatic musical instrument identification

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20141110

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
A302 Request for accelerated examination
AMND Amendment
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20170224

Comment text: Request for Examination of Application

PA0302 Request for accelerated examination

Patent event date: 20170224

Patent event code: PA03022R01D

Comment text: Request for Accelerated Examination

AMND Amendment
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20170802

Patent event code: PE09021S01D

AMND Amendment
E601 Decision to refuse application
PE0601 Decision on rejection of patent

Patent event date: 20180118

Comment text: Decision to Refuse Application

Patent event code: PE06012S01D

Patent event date: 20170802

Comment text: Notification of reason for refusal

Patent event code: PE06011S01I

AMND Amendment
PX0901 Re-examination

Patent event code: PX09011S01I

Patent event date: 20180118

Comment text: Decision to Refuse Application

Patent event code: PX09012R01I

Patent event date: 20171101

Comment text: Amendment to Specification, etc.

Patent event code: PX09012R01I

Patent event date: 20170406

Comment text: Amendment to Specification, etc.

Patent event code: PX09012R01I

Patent event date: 20170224

Comment text: Amendment to Specification, etc.

PX0601 Decision of rejection after re-examination

Comment text: Decision to Refuse Application

Patent event code: PX06014S01D

Patent event date: 20180521

Comment text: Amendment to Specification, etc.

Patent event code: PX06012R01I

Patent event date: 20180419

Comment text: Decision to Refuse Application

Patent event code: PX06011S01I

Patent event date: 20180118

Comment text: Amendment to Specification, etc.

Patent event code: PX06012R01I

Patent event date: 20171101

Comment text: Notification of reason for refusal

Patent event code: PX06013S01I

Patent event date: 20170802

Comment text: Amendment to Specification, etc.

Patent event code: PX06012R01I

Patent event date: 20170406

Comment text: Amendment to Specification, etc.

Patent event code: PX06012R01I

Patent event date: 20170224