SG11201810089TA - Automatic visual and acoustic analytics for event detection - Google Patents

Automatic visual and acoustic analytics for event detection

Info

Publication number
SG11201810089TA
SG11201810089TA SG11201810089TA SG11201810089TA SG11201810089TA SG 11201810089T A SG11201810089T A SG 11201810089TA SG 11201810089T A SG11201810089T A SG 11201810089TA SG 11201810089T A SG11201810089T A SG 11201810089TA SG 11201810089T A SG11201810089T A SG 11201810089TA
Authority
SG
Singapore
Prior art keywords
data
international
acoustic
event
rule
Prior art date
Application number
SG11201810089TA
Inventor
Christopher Gurciullo
Original Assignee
Exxonmobil Res & Eng Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Exxonmobil Res & Eng Co filed Critical Exxonmobil Res & Eng Co
Publication of SG11201810089TA publication Critical patent/SG11201810089TA/en

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/04Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/048Monitoring; Safety
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00Testing or monitoring of control systems or parts thereof
    • G05B23/02Electric testing or monitoring
    • G05B23/0205Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
    • G05B23/0218Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterised by the fault detection method dealing with either existing or incipient faults
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • G06F16/285Clustering or classification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/61Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/23Pc programming
    • G05B2219/23288Adaptive states; learning transitions
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/36Nc in input of data, input key till input tape
    • G05B2219/36039Learning task dynamics, process

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Automation & Control Theory (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Testing And Monitoring For Control Systems (AREA)
  • Measuring Volume Flow (AREA)

Abstract

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property 111111111111101110111111110101111100101110111101a 11111111111111111111111111 Organization International Bureau (10) International Publication Number 0 (43) International Publication Date .....0\"\"\" WO 2017/213810 Al 14 December 2017 (14.12.2017) WIP0 I PCT — (51) (21) (22) (25) Filing Language: (26) (30) (71) (72) International Patent Classification: (74) Agent: BARRETT, Glenn, T. et al.; 1545 Roue 22 East, G05B 23/02 (2006.01) P.O. Box 900, Annandale, NJ 08801-0900 (US). International Application Number: (81) Designated States (unless otherwise indicated, for every PCT/US2017/032876 kind of national protection available): AE, AG, AL, AM, International Filing Date: AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, 16 May 2017 (16.05.2017) CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, English HR, HU, ID, IL, IN, IR, IS, JP, KE, KG, KH, KN, KP, KR, Publication Language: English KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, Priority Data: PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, 62/347,159 08 June 2016 (08.06.2016) US SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. Applicant: EXXONMOBIL RESEARCH AND EN- GINEERING COMPANY [US/US]; 1545 Route 22 East, (84) Designated States (unless otherwise indicated, for every P.O. Box 900, Annandale, NJ 08801-0900 (US). kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, Inventor: GURCIULLO, Christopher, S.; 1200 Old UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, Franklin Hill Road, Bangor, PA 18013 (US). TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, = Title: AUTOMATIC VISUAL : Systems and methods a camera and an audio recorder system, may include a based on the classifier, the monitoring data with least one quantifier, a predetermined rule corresponding to the at least (54) N computer IN quantify, 1-1 satisfies AND ACOUSTIC ANALYTICS FOR EVENT DETECTION T i 100 -4- system may include one and acoustic data, respectively. A monitoring data under a classifier, when the at least one quantifier An acquisition = = Acquire Imaging/ Acoustic Data La ie. = v Machine Learning Engine 120 Classify Data 122 Analyze Historical Deta 124 Historize in Daabase 170 = .ei - = 4 + = Quantify Data J24 Query Historical Data 180 = = = = Detect Event 2a — = = No Event Detected? 114 data and may be programmed at one quantifier. = = YeaAlert Workflow/ Control Hardware 144 — data the an event to classify = Visualize Data 1 41 12 Receive Feedback .1411 _ 1-1 © ,-1 ot en (57) 1-1 of 0 ei to machine learning engine acquire monitoring processes. of one of imaging and detect are provided for detecting events in industrial FIG. 1 in the form O [Continued on next page] WO 2017/213810 Al MIDEDIMOMOIDEIRMEMODIEMIOMUMMINVOIS TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Declarations under Rule 4.17: — as to applicant's entitlement to apply for and be granted a patent (Rule 4.17(H)) — as to the applicant's entitlement to claim the priority of the earlier application (Rule 4.17(iii)) Published: — with international search report (Art. 21(3)) — with amended claims (Art. 19(1))
SG11201810089TA 2016-06-08 2017-05-16 Automatic visual and acoustic analytics for event detection SG11201810089TA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201662347159P 2016-06-08 2016-06-08
PCT/US2017/032876 WO2017213810A1 (en) 2016-06-08 2017-05-16 Automatic visual and acoustic analytics for event detection

Publications (1)

Publication Number Publication Date
SG11201810089TA true SG11201810089TA (en) 2018-12-28

Family

ID=59067876

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201810089TA SG11201810089TA (en) 2016-06-08 2017-05-16 Automatic visual and acoustic analytics for event detection

Country Status (6)

Country Link
US (1) US11188047B2 (en)
EP (1) EP3469434B1 (en)
CN (1) CN109313442B (en)
CA (1) CA3026624A1 (en)
SG (1) SG11201810089TA (en)
WO (1) WO2017213810A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200348662A1 (en) * 2016-05-09 2020-11-05 Strong Force Iot Portfolio 2016, Llc Platform for facilitating development of intelligence in an industrial internet of things system
EP3469434B1 (en) * 2016-06-08 2023-07-19 ExxonMobil Technology and Engineering Company Automatic visual and acoustic analytics for event detection
US10783138B2 (en) * 2017-10-23 2020-09-22 Google Llc Verifying structured data
EP3603902B1 (en) * 2018-08-02 2023-06-28 Schneider Electric Industries SAS Method for building and/or maintaining an industrial machine

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3204874C2 (en) * 1982-02-11 1994-07-14 Atlas Elektronik Gmbh Passive method for obtaining target data from a sound source
JPH0767101A (en) 1993-08-25 1995-03-10 Hitachi Ltd Method and device for monitoring abnormality
JPH0778239A (en) 1993-09-08 1995-03-20 Mitsubishi Heavy Ind Ltd Abnormality monitoring device for plant
JPH07198331A (en) 1993-12-28 1995-08-01 Babcock Hitachi Kk Method for reading meter by image processing
JPH0816234A (en) 1994-06-28 1996-01-19 Mitsubishi Heavy Ind Ltd Device for detecting abnormality of plant
JPH08219324A (en) 1995-02-08 1996-08-30 Mitsubishi Heavy Ind Ltd Valve-opening and closing condition detecting device
US5717456A (en) 1995-03-06 1998-02-10 Champion International Corporation System for monitoring a continuous manufacturing process
JP3056053B2 (en) 1995-07-21 2000-06-26 バブコック日立株式会社 Monitoring method
JP3195537B2 (en) 1996-05-29 2001-08-06 中国電力株式会社 Monitoring device and monitoring method using the device
JPH1042274A (en) 1996-07-25 1998-02-13 Babcock Hitachi Kk Abnormality monitoring method and device
JPH10210449A (en) 1997-01-24 1998-08-07 Toshiba Corp Monitoring device
JPH10255059A (en) 1997-03-13 1998-09-25 Toshiba Corp Image processor
JPH11284982A (en) 1998-03-31 1999-10-15 Chugoku Electric Power Co Inc:The Monitoring device and method
JPH11313310A (en) 1998-04-30 1999-11-09 Toshiba Corp Plant monitoring device
US6774806B1 (en) 1998-10-01 2004-08-10 Shell Oil Company Monitoring an element of a plant
JP2001022433A (en) 1999-07-13 2001-01-26 Babcock Hitachi Kk Monitoring device and monitoring method
JP2002064811A (en) 2000-08-23 2002-02-28 Mitsubishi Heavy Ind Ltd Fault sensing device with camera directional deviation correcting function
DE102004036104A1 (en) * 2004-07-24 2006-03-16 Cognis Ip Management Gmbh Apparatus and method for monitoring production facilities
JP2006060664A (en) 2004-08-23 2006-03-02 Nec Corp Device and method for monitoring failure
JP2006270275A (en) 2005-03-22 2006-10-05 Nagasaki Univ Image processing system
JP2008017259A (en) 2006-07-07 2008-01-24 Matsushita Electric Ind Co Ltd Image recognition camera
JP4842197B2 (en) 2007-04-17 2011-12-21 財団法人ソフトピアジャパン Abnormal operation detection device using multiple divided images, abnormal operation detection method, and abnormal operation detection program
US8824731B2 (en) 2007-10-31 2014-09-02 The Boeing Comapny Image processing of apparatus condition
US9031243B2 (en) * 2009-09-28 2015-05-12 iZotope, Inc. Automatic labeling and control of audio algorithms by audio recognition
CN102522082B (en) * 2011-12-27 2013-07-10 重庆大学 Recognizing and locating method for abnormal sound in public places
JP5792671B2 (en) 2012-03-30 2015-10-14 Jx日鉱日石エネルギー株式会社 Abnormality detection method and abnormality detection device
WO2013147901A1 (en) * 2012-03-31 2013-10-03 Intel Corporation System, device, and method for establishing a microphone array using computing devices
EP2685249A1 (en) 2012-07-12 2014-01-15 ABB Research Ltd. Method and device for detecting abnormal heat emission in an industrial process
KR101335640B1 (en) 2012-09-11 2013-12-03 한국기계연구원 Checking system and method for gauge of power generation plant
GB201218209D0 (en) * 2012-10-10 2012-11-21 Univ Lancaster System state classifier
JP6044522B2 (en) 2013-11-19 2016-12-14 横河電機株式会社 Slow change detection system
JP2015153342A (en) 2014-02-19 2015-08-24 三菱電機株式会社 Facility inspection apparatus and facility inspection management system
US10914635B2 (en) 2014-09-29 2021-02-09 Rosemount Inc. Wireless industrial process monitor
US9811989B2 (en) 2014-09-30 2017-11-07 The Boeing Company Event detection system
US9736580B2 (en) * 2015-03-19 2017-08-15 Intel Corporation Acoustic camera based audio visual scene analysis
EP3469434B1 (en) * 2016-06-08 2023-07-19 ExxonMobil Technology and Engineering Company Automatic visual and acoustic analytics for event detection
US10635973B1 (en) * 2016-06-28 2020-04-28 Amazon Technologies, Inc. Recommendation system using improved neural network
US11205103B2 (en) * 2016-12-09 2021-12-21 The Research Foundation for the State University Semisupervised autoencoder for sentiment analysis
US10706295B2 (en) * 2018-06-29 2020-07-07 Ford Global Technologies, Llc Street light with infrared illumination
US10643637B2 (en) * 2018-07-06 2020-05-05 Harman International Industries, Inc. Retroactive sound identification system
US10602268B1 (en) * 2018-12-20 2020-03-24 Sonos, Inc. Optimization of network microphone devices using noise classification
US10424048B1 (en) * 2019-02-15 2019-09-24 Shotspotter, Inc. Systems and methods involving creation and/or utilization of image mosaic in classification of acoustic events

Also Published As

Publication number Publication date
CA3026624A1 (en) 2017-12-14
EP3469434A1 (en) 2019-04-17
US20170357233A1 (en) 2017-12-14
US11188047B2 (en) 2021-11-30
CN109313442A (en) 2019-02-05
WO2017213810A1 (en) 2017-12-14
CN109313442B (en) 2021-11-09
EP3469434B1 (en) 2023-07-19

Similar Documents

Publication Publication Date Title
SG11201904942YA (en) Blockchain-based service execution method and apparatus, and electronic device
SG11201807307VA (en) System and method for aerial system discrimination and action
SG11201810089TA (en) Automatic visual and acoustic analytics for event detection
SG11201808494TA (en) Signal light detection
SG11201804482UA (en) Search and retrieval data processing system for computing near real-time data aggregations
SG11201907791WA (en) Vehicle control system
SG11201901334SA (en) Convolutional neural network-based mode selection and defect classification for image fusion
SG11201808609YA (en) System and method for imaging a surface defect on an object
SG11201903379QA (en) System and method for automatically entering and leaving ride apparatus
SG11201907381UA (en) Building management system with declarative views of timeseries data
SG11201809960YA (en) System and method for automated table game activity recognition
SG11201808144SA (en) Computer systems and methods for creating asset-related tasks based on predictive models
SG11201902667UA (en) Methods and systems for chromatography data analysis
SG11201909671TA (en) Method of living body detection and terminal device
SG11201808090UA (en) Method and system for task processing
SG11201803050PA (en) Electronic device generating notification based on context data in response to speech phrase from user
SG11201909943SA (en) System and method for high accuracy location determination and parking
SG11201900293PA (en) Method and device for displaying application information
SG11201808419YA (en) All-digital software-defined cognitive heterogeneous network transceiver architecture
SG11201805874VA (en) Method and apparatus for adding notification objects
SG11201909042QA (en) Trajectory estimation system and method
SG11201909410VA (en) Machine learned decision guidance for alerts originating from monitoring systems
SG11201807325UA (en) Optimizing range of aircraft docking system
SG11201906413XA (en) Exposure apparatus
SG11201804948UA (en) Locator diagnostic for emergency dispatch