SG11201810089TA - Automatic visual and acoustic analytics for event detection - Google Patents
Automatic visual and acoustic analytics for event detectionInfo
- Publication number
- SG11201810089TA SG11201810089TA SG11201810089TA SG11201810089TA SG11201810089TA SG 11201810089T A SG11201810089T A SG 11201810089TA SG 11201810089T A SG11201810089T A SG 11201810089TA SG 11201810089T A SG11201810089T A SG 11201810089TA SG 11201810089T A SG11201810089T A SG 11201810089TA
- Authority
- SG
- Singapore
- Prior art keywords
- data
- international
- acoustic
- event
- rule
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
- G05B19/048—Monitoring; Safety
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B23/00—Testing or monitoring of control systems or parts thereof
- G05B23/02—Electric testing or monitoring
- G05B23/0205—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
- G05B23/0218—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterised by the fault detection method dealing with either existing or incipient faults
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/61—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/23—Pc programming
- G05B2219/23288—Adaptive states; learning transitions
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/36—Nc in input of data, input key till input tape
- G05B2219/36039—Learning task dynamics, process
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Automation & Control Theory (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Computation (AREA)
- Medical Informatics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Testing And Monitoring For Control Systems (AREA)
- Measuring Volume Flow (AREA)
Abstract
INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property 111111111111101110111111110101111100101110111101a 11111111111111111111111111 Organization International Bureau (10) International Publication Number 0 (43) International Publication Date .....0\"\"\" WO 2017/213810 Al 14 December 2017 (14.12.2017) WIP0 I PCT — (51) (21) (22) (25) Filing Language: (26) (30) (71) (72) International Patent Classification: (74) Agent: BARRETT, Glenn, T. et al.; 1545 Roue 22 East, G05B 23/02 (2006.01) P.O. Box 900, Annandale, NJ 08801-0900 (US). International Application Number: (81) Designated States (unless otherwise indicated, for every PCT/US2017/032876 kind of national protection available): AE, AG, AL, AM, International Filing Date: AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, 16 May 2017 (16.05.2017) CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, English HR, HU, ID, IL, IN, IR, IS, JP, KE, KG, KH, KN, KP, KR, Publication Language: English KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, Priority Data: PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, 62/347,159 08 June 2016 (08.06.2016) US SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. Applicant: EXXONMOBIL RESEARCH AND EN- GINEERING COMPANY [US/US]; 1545 Route 22 East, (84) Designated States (unless otherwise indicated, for every P.O. Box 900, Annandale, NJ 08801-0900 (US). kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, Inventor: GURCIULLO, Christopher, S.; 1200 Old UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, Franklin Hill Road, Bangor, PA 18013 (US). TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, = Title: AUTOMATIC VISUAL : Systems and methods a camera and an audio recorder system, may include a based on the classifier, the monitoring data with least one quantifier, a predetermined rule corresponding to the at least (54) N computer IN quantify, 1-1 satisfies AND ACOUSTIC ANALYTICS FOR EVENT DETECTION T i 100 -4- system may include one and acoustic data, respectively. A monitoring data under a classifier, when the at least one quantifier An acquisition = = Acquire Imaging/ Acoustic Data La ie. = v Machine Learning Engine 120 Classify Data 122 Analyze Historical Deta 124 Historize in Daabase 170 = .ei - = 4 + = Quantify Data J24 Query Historical Data 180 = = = = Detect Event 2a — = = No Event Detected? 114 data and may be programmed at one quantifier. = = YeaAlert Workflow/ Control Hardware 144 — data the an event to classify = Visualize Data 1 41 12 Receive Feedback .1411 _ 1-1 © ,-1 ot en (57) 1-1 of 0 ei to machine learning engine acquire monitoring processes. of one of imaging and detect are provided for detecting events in industrial FIG. 1 in the form O [Continued on next page] WO 2017/213810 Al MIDEDIMOMOIDEIRMEMODIEMIOMUMMINVOIS TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Declarations under Rule 4.17: — as to applicant's entitlement to apply for and be granted a patent (Rule 4.17(H)) — as to the applicant's entitlement to claim the priority of the earlier application (Rule 4.17(iii)) Published: — with international search report (Art. 21(3)) — with amended claims (Art. 19(1))
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201662347159P | 2016-06-08 | 2016-06-08 | |
PCT/US2017/032876 WO2017213810A1 (en) | 2016-06-08 | 2017-05-16 | Automatic visual and acoustic analytics for event detection |
Publications (1)
Publication Number | Publication Date |
---|---|
SG11201810089TA true SG11201810089TA (en) | 2018-12-28 |
Family
ID=59067876
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
SG11201810089TA SG11201810089TA (en) | 2016-06-08 | 2017-05-16 | Automatic visual and acoustic analytics for event detection |
Country Status (6)
Country | Link |
---|---|
US (1) | US11188047B2 (en) |
EP (1) | EP3469434B1 (en) |
CN (1) | CN109313442B (en) |
CA (1) | CA3026624A1 (en) |
SG (1) | SG11201810089TA (en) |
WO (1) | WO2017213810A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200348662A1 (en) * | 2016-05-09 | 2020-11-05 | Strong Force Iot Portfolio 2016, Llc | Platform for facilitating development of intelligence in an industrial internet of things system |
EP3469434B1 (en) * | 2016-06-08 | 2023-07-19 | ExxonMobil Technology and Engineering Company | Automatic visual and acoustic analytics for event detection |
US10783138B2 (en) * | 2017-10-23 | 2020-09-22 | Google Llc | Verifying structured data |
EP3603902B1 (en) * | 2018-08-02 | 2023-06-28 | Schneider Electric Industries SAS | Method for building and/or maintaining an industrial machine |
Family Cites Families (42)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3204874C2 (en) * | 1982-02-11 | 1994-07-14 | Atlas Elektronik Gmbh | Passive method for obtaining target data from a sound source |
JPH0767101A (en) | 1993-08-25 | 1995-03-10 | Hitachi Ltd | Method and device for monitoring abnormality |
JPH0778239A (en) | 1993-09-08 | 1995-03-20 | Mitsubishi Heavy Ind Ltd | Abnormality monitoring device for plant |
JPH07198331A (en) | 1993-12-28 | 1995-08-01 | Babcock Hitachi Kk | Method for reading meter by image processing |
JPH0816234A (en) | 1994-06-28 | 1996-01-19 | Mitsubishi Heavy Ind Ltd | Device for detecting abnormality of plant |
JPH08219324A (en) | 1995-02-08 | 1996-08-30 | Mitsubishi Heavy Ind Ltd | Valve-opening and closing condition detecting device |
US5717456A (en) | 1995-03-06 | 1998-02-10 | Champion International Corporation | System for monitoring a continuous manufacturing process |
JP3056053B2 (en) | 1995-07-21 | 2000-06-26 | バブコック日立株式会社 | Monitoring method |
JP3195537B2 (en) | 1996-05-29 | 2001-08-06 | 中国電力株式会社 | Monitoring device and monitoring method using the device |
JPH1042274A (en) | 1996-07-25 | 1998-02-13 | Babcock Hitachi Kk | Abnormality monitoring method and device |
JPH10210449A (en) | 1997-01-24 | 1998-08-07 | Toshiba Corp | Monitoring device |
JPH10255059A (en) | 1997-03-13 | 1998-09-25 | Toshiba Corp | Image processor |
JPH11284982A (en) | 1998-03-31 | 1999-10-15 | Chugoku Electric Power Co Inc:The | Monitoring device and method |
JPH11313310A (en) | 1998-04-30 | 1999-11-09 | Toshiba Corp | Plant monitoring device |
US6774806B1 (en) | 1998-10-01 | 2004-08-10 | Shell Oil Company | Monitoring an element of a plant |
JP2001022433A (en) | 1999-07-13 | 2001-01-26 | Babcock Hitachi Kk | Monitoring device and monitoring method |
JP2002064811A (en) | 2000-08-23 | 2002-02-28 | Mitsubishi Heavy Ind Ltd | Fault sensing device with camera directional deviation correcting function |
DE102004036104A1 (en) * | 2004-07-24 | 2006-03-16 | Cognis Ip Management Gmbh | Apparatus and method for monitoring production facilities |
JP2006060664A (en) | 2004-08-23 | 2006-03-02 | Nec Corp | Device and method for monitoring failure |
JP2006270275A (en) | 2005-03-22 | 2006-10-05 | Nagasaki Univ | Image processing system |
JP2008017259A (en) | 2006-07-07 | 2008-01-24 | Matsushita Electric Ind Co Ltd | Image recognition camera |
JP4842197B2 (en) | 2007-04-17 | 2011-12-21 | 財団法人ソフトピアジャパン | Abnormal operation detection device using multiple divided images, abnormal operation detection method, and abnormal operation detection program |
US8824731B2 (en) | 2007-10-31 | 2014-09-02 | The Boeing Comapny | Image processing of apparatus condition |
US9031243B2 (en) * | 2009-09-28 | 2015-05-12 | iZotope, Inc. | Automatic labeling and control of audio algorithms by audio recognition |
CN102522082B (en) * | 2011-12-27 | 2013-07-10 | 重庆大学 | Recognizing and locating method for abnormal sound in public places |
JP5792671B2 (en) | 2012-03-30 | 2015-10-14 | Jx日鉱日石エネルギー株式会社 | Abnormality detection method and abnormality detection device |
WO2013147901A1 (en) * | 2012-03-31 | 2013-10-03 | Intel Corporation | System, device, and method for establishing a microphone array using computing devices |
EP2685249A1 (en) | 2012-07-12 | 2014-01-15 | ABB Research Ltd. | Method and device for detecting abnormal heat emission in an industrial process |
KR101335640B1 (en) | 2012-09-11 | 2013-12-03 | 한국기계연구원 | Checking system and method for gauge of power generation plant |
GB201218209D0 (en) * | 2012-10-10 | 2012-11-21 | Univ Lancaster | System state classifier |
JP6044522B2 (en) | 2013-11-19 | 2016-12-14 | 横河電機株式会社 | Slow change detection system |
JP2015153342A (en) | 2014-02-19 | 2015-08-24 | 三菱電機株式会社 | Facility inspection apparatus and facility inspection management system |
US10914635B2 (en) | 2014-09-29 | 2021-02-09 | Rosemount Inc. | Wireless industrial process monitor |
US9811989B2 (en) | 2014-09-30 | 2017-11-07 | The Boeing Company | Event detection system |
US9736580B2 (en) * | 2015-03-19 | 2017-08-15 | Intel Corporation | Acoustic camera based audio visual scene analysis |
EP3469434B1 (en) * | 2016-06-08 | 2023-07-19 | ExxonMobil Technology and Engineering Company | Automatic visual and acoustic analytics for event detection |
US10635973B1 (en) * | 2016-06-28 | 2020-04-28 | Amazon Technologies, Inc. | Recommendation system using improved neural network |
US11205103B2 (en) * | 2016-12-09 | 2021-12-21 | The Research Foundation for the State University | Semisupervised autoencoder for sentiment analysis |
US10706295B2 (en) * | 2018-06-29 | 2020-07-07 | Ford Global Technologies, Llc | Street light with infrared illumination |
US10643637B2 (en) * | 2018-07-06 | 2020-05-05 | Harman International Industries, Inc. | Retroactive sound identification system |
US10602268B1 (en) * | 2018-12-20 | 2020-03-24 | Sonos, Inc. | Optimization of network microphone devices using noise classification |
US10424048B1 (en) * | 2019-02-15 | 2019-09-24 | Shotspotter, Inc. | Systems and methods involving creation and/or utilization of image mosaic in classification of acoustic events |
-
2017
- 2017-05-16 EP EP17730591.9A patent/EP3469434B1/en active Active
- 2017-05-16 SG SG11201810089TA patent/SG11201810089TA/en unknown
- 2017-05-16 CN CN201780034638.9A patent/CN109313442B/en active Active
- 2017-05-16 US US15/596,557 patent/US11188047B2/en active Active
- 2017-05-16 WO PCT/US2017/032876 patent/WO2017213810A1/en unknown
- 2017-05-16 CA CA3026624A patent/CA3026624A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
CA3026624A1 (en) | 2017-12-14 |
EP3469434A1 (en) | 2019-04-17 |
US20170357233A1 (en) | 2017-12-14 |
US11188047B2 (en) | 2021-11-30 |
CN109313442A (en) | 2019-02-05 |
WO2017213810A1 (en) | 2017-12-14 |
CN109313442B (en) | 2021-11-09 |
EP3469434B1 (en) | 2023-07-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
SG11201904942YA (en) | Blockchain-based service execution method and apparatus, and electronic device | |
SG11201807307VA (en) | System and method for aerial system discrimination and action | |
SG11201810089TA (en) | Automatic visual and acoustic analytics for event detection | |
SG11201808494TA (en) | Signal light detection | |
SG11201804482UA (en) | Search and retrieval data processing system for computing near real-time data aggregations | |
SG11201907791WA (en) | Vehicle control system | |
SG11201901334SA (en) | Convolutional neural network-based mode selection and defect classification for image fusion | |
SG11201808609YA (en) | System and method for imaging a surface defect on an object | |
SG11201903379QA (en) | System and method for automatically entering and leaving ride apparatus | |
SG11201907381UA (en) | Building management system with declarative views of timeseries data | |
SG11201809960YA (en) | System and method for automated table game activity recognition | |
SG11201808144SA (en) | Computer systems and methods for creating asset-related tasks based on predictive models | |
SG11201902667UA (en) | Methods and systems for chromatography data analysis | |
SG11201909671TA (en) | Method of living body detection and terminal device | |
SG11201808090UA (en) | Method and system for task processing | |
SG11201803050PA (en) | Electronic device generating notification based on context data in response to speech phrase from user | |
SG11201909943SA (en) | System and method for high accuracy location determination and parking | |
SG11201900293PA (en) | Method and device for displaying application information | |
SG11201808419YA (en) | All-digital software-defined cognitive heterogeneous network transceiver architecture | |
SG11201805874VA (en) | Method and apparatus for adding notification objects | |
SG11201909042QA (en) | Trajectory estimation system and method | |
SG11201909410VA (en) | Machine learned decision guidance for alerts originating from monitoring systems | |
SG11201807325UA (en) | Optimizing range of aircraft docking system | |
SG11201906413XA (en) | Exposure apparatus | |
SG11201804948UA (en) | Locator diagnostic for emergency dispatch |