CA2884714C - System and method for generating semantic annotations - Google Patents

System and method for generating semantic annotations Download PDF

Info

Publication number
CA2884714C
CA2884714C CA2884714A CA2884714A CA2884714C CA 2884714 C CA2884714 C CA 2884714C CA 2884714 A CA2884714 A CA 2884714A CA 2884714 A CA2884714 A CA 2884714A CA 2884714 C CA2884714 C CA 2884714C
Authority
CA
Canada
Prior art keywords
sas
prior
new
matching
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2884714A
Other languages
English (en)
French (fr)
Other versions
CA2884714A1 (en
Inventor
Peter Henry Tu
Jens Rittscher
Li Guan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
General Electric Co
Original Assignee
General Electric Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by General Electric Co filed Critical General Electric Co
Publication of CA2884714A1 publication Critical patent/CA2884714A1/en
Application granted granted Critical
Publication of CA2884714C publication Critical patent/CA2884714C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/70—Labelling scene content, e.g. deriving syntactic or semantic representations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G06F18/232—Non-hierarchical techniques
    • G06F18/2323—Non-hierarchical techniques based on graph theory, e.g. minimum spanning trees [MST] or graph cuts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/762—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks
    • G06V10/7635—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks based on graphs, e.g. graph cuts or spectral clustering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computational Linguistics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Discrete Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Alarm Systems (AREA)
  • Image Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CA2884714A 2012-09-13 2013-09-12 System and method for generating semantic annotations Active CA2884714C (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201261700542P 2012-09-13 2012-09-13
US61/700,542 2012-09-13
US13/918,905 2013-06-15
US13/918,905 US9251421B2 (en) 2012-09-13 2013-06-15 System and method for generating semantic annotations
PCT/US2013/059453 WO2014043340A1 (en) 2012-09-13 2013-09-12 System and method for generating semantic annotations

Publications (2)

Publication Number Publication Date
CA2884714A1 CA2884714A1 (en) 2014-03-20
CA2884714C true CA2884714C (en) 2018-05-22

Family

ID=50233312

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2884714A Active CA2884714C (en) 2012-09-13 2013-09-12 System and method for generating semantic annotations

Country Status (9)

Country Link
US (1) US9251421B2 (enExample)
EP (1) EP2895987A1 (enExample)
JP (1) JP6307082B2 (enExample)
KR (1) KR101890467B1 (enExample)
CN (1) CN104781831B (enExample)
AU (1) AU2013315478B2 (enExample)
BR (1) BR112015005541A2 (enExample)
CA (1) CA2884714C (enExample)
WO (1) WO2014043340A1 (enExample)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9251421B2 (en) * 2012-09-13 2016-02-02 General Electric Company System and method for generating semantic annotations
US9451335B2 (en) 2014-04-29 2016-09-20 At&T Intellectual Property I, Lp Method and apparatus for augmenting media content
US12248995B2 (en) 2016-04-21 2025-03-11 Wayne Fueling Systems Llc Intelligent fuel dispensers
US10269082B2 (en) 2016-04-21 2019-04-23 Wayne Fueling Systems Llc Intelligent fuel Dispensers
BR112018074266A2 (pt) 2016-05-27 2019-03-06 Wayne Fueling Systems Llc bomba transparente de abastecimento de combustível
WO2018101504A1 (ko) * 2016-11-30 2018-06-07 전자부품연구원 서비스 매쉬업을 위한 메타 데이터 생성 방법 및 시스템
US10565291B2 (en) * 2017-10-23 2020-02-18 International Business Machines Corporation Automatic generation of personalized visually isolated text
CN110475129B (zh) * 2018-03-05 2021-05-28 腾讯科技（深圳）有限公司 视频处理方法、介质及服务器
US11157524B2 (en) 2018-05-18 2021-10-26 At&T Intellectual Property I, L.P. Automated learning of anomalies in media streams with external feed labels
CN109191379B (zh) * 2018-07-26 2022-03-29 北京纵目安驰智能科技有限公司 一种全景拼接的语义标注方法、系统、终端和存储介质
US10339420B1 (en) * 2018-08-30 2019-07-02 Accenture Global Solutions Limited Entity recognition using multiple data streams to supplement missing information associated with an entity
US11119679B2 (en) * 2019-08-02 2021-09-14 Micron Technology, Inc. Storing data based on a probability of a data graph
US11373069B2 (en) 2020-03-20 2022-06-28 General Electric Company Analogy engine for grounding and situational awareness
US12112519B1 (en) * 2021-02-24 2024-10-08 Apple Inc. Scripted interactive scenarios based on scene graph matching
US11783558B1 (en) 2021-02-24 2023-10-10 Apple Inc. Object correction using scene graphs
CN112906586B (zh) * 2021-02-26 2024-05-24 上海商汤科技开发有限公司 时序动作提名生成方法和相关产品
KR20250031864A (ko) * 2023-08-29 2025-03-07 주식회사 아이디케이스퀘어드 데이터에 대한 차트 기반으로 내러티브 및 새로운 차트를 제공하기 위한 서버 및 방법

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0805405A3 (en) * 1996-02-05 1998-04-15 Texas Instruments Incorporated Motion event detection for video indexing
US6842190B1 (en) * 1999-07-06 2005-01-11 Intel Corporation Video bit stream extension with supplementary content information to aid in subsequent video processing
JP3602765B2 (ja) * 1999-07-19 2004-12-15 株式会社リコー 映像検索方法、その方法をコンピュータに実行させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体、映像検索処理装置、映像インデックス付与方法、その方法をコンピュータに実行させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体、映像内容の説明文生成方法およびその方法をコンピュータに実行させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体
GB9918248D0 (en) 1999-08-04 1999-10-06 Matra Bae Dynamics Uk Ltd Improvements in and relating to surveillance systems
US6424370B1 (en) * 1999-10-08 2002-07-23 Texas Instruments Incorporated Motion based event detection system and method
JP2001307061A (ja) * 2000-03-06 2001-11-02 Mitsubishi Electric Research Laboratories Inc マルチメディア・コンテンツの順序付け方法
US7680951B1 (en) * 2004-06-01 2010-03-16 Massachusetts Institute Of Technology High speed subscribe-and-alert service using content graphs
US20100023162A1 (en) 2004-12-08 2010-01-28 Kristijan Gresak Method, System and Components for Operating a Fuel Distribution System with Unmanned Self-Service Gasoline Stations
US7571157B2 (en) * 2004-12-29 2009-08-04 Aol Llc Filtering search results
WO2007002820A2 (en) * 2005-06-28 2007-01-04 Yahoo! Inc. Search engine with augmented relevance ranking by community participation
US7956735B2 (en) 2006-05-15 2011-06-07 Cernium Corporation Automated, remotely-verified alarm system with intrusion and video surveillance and digital video recording
WO2008086507A1 (en) 2007-01-10 2008-07-17 Decision Sciences Corporation Information collecting and decision making via tiered information network systems
US8269834B2 (en) * 2007-01-12 2012-09-18 International Business Machines Corporation Warning a user about adverse behaviors of others within an environment based on a 3D captured image stream
US20120314063A1 (en) 2007-03-14 2012-12-13 Seth Cirker Threat based adaptable network and physical security system
WO2009045218A1 (en) 2007-10-04 2009-04-09 Donovan John J A video surveillance, storage, and alerting system having network management, hierarchical data storage, video tip processing, and vehicle plate analysis
CN101334796B (zh) * 2008-02-29 2011-01-12 浙江师范大学 一种个性化及协同化融合的网上多媒体检索与查询方法
CN101616264B (zh) * 2008-06-27 2011-03-30 中国科学院自动化研究所 新闻视频编目方法及系统
US8316032B1 (en) * 2009-01-09 2012-11-20 Google Inc. Book content item search
US8285060B2 (en) 2009-08-31 2012-10-09 Behavioral Recognition Systems, Inc. Detecting anomalous trajectories in a video surveillance system
US10019677B2 (en) 2009-11-20 2018-07-10 Alert Enterprise, Inc. Active policy enforcement
CN101799827A (zh) * 2010-03-11 2010-08-11 浙江大学 基于层次化结构的视频素材库管理方法
CN101968797A (zh) * 2010-09-10 2011-02-09 北京大学 一种基于镜头间上下文的视频概念标注方法
US8760290B2 (en) 2011-04-08 2014-06-24 Rave Wireless, Inc. Public safety analysis system
CN102508923B (zh) * 2011-11-22 2014-06-11 北京大学 基于自动分类和关键字标注的自动视频注释方法
US9251421B2 (en) * 2012-09-13 2016-02-02 General Electric Company System and method for generating semantic annotations

Also Published As

Publication number Publication date
WO2014043340A1 (en) 2014-03-20
BR112015005541A2 (pt) 2017-08-08
KR20150056802A (ko) 2015-05-27
AU2013315478B2 (en) 2018-11-15
US9251421B2 (en) 2016-02-02
CN104781831B (zh) 2019-04-30
CA2884714A1 (en) 2014-03-20
AU2013315478A1 (en) 2015-04-02
KR101890467B1 (ko) 2018-08-21
JP6307082B2 (ja) 2018-04-04
JP2015528613A (ja) 2015-09-28
US20140072171A1 (en) 2014-03-13
CN104781831A (zh) 2015-07-15
EP2895987A1 (en) 2015-07-22

Similar Documents

Publication Publication Date Title
CA2884714C (en) System and method for generating semantic annotations
US10271017B2 (en) System and method for generating an activity summary of a person
US8587662B1 (en) Theft trend analysis and response
CN108027888B (zh) 使用上下文信号的局部异常检测
US20200257960A1 (en) Compressed convolutional neural network models
EP2758879B1 (en) A computing platform for development and deployment of sensor-driven vehicle telemetry applications and services
CN112507813A (zh) 事件检测方法、装置、电子设备及存储介质
CN105814587B (zh) 本地实时面部识别
US20120147192A1 (en) Video camera system
CN110309735A (zh) 异常侦测方法、装置、服务器及存储介质
US20190340496A1 (en) Information processing apparatus and information processing method
US20220198152A1 (en) Generating hypotheses in data sets
CN111062823A (zh) 一种社交图谱分析方法、装置及存储介质
FR2927446A1 (fr) Procede de tracabilite d'un terminal de paiement electronique, en cas de vol de ce dernier, programme d'ordinateur et terminal correspondants.
US20230101275A1 (en) Audited training data for an item recognition machine learning model system
Wawage et al. Integrating Internet of things (IoT), machine learning (ML), and the cloud infrastructure to monitor driving behavior for usage-based insurance in the Indian context
Ke et al. Transit Safety System Evaluation and Hotspot Identification Empowered by Edge Computing Transit Event Logging System
US20240295651A1 (en) System and method for detection and reporting of events
US20250322663A1 (en) Method and system to provide alarm risk score analysis and intelligence
CN116168341A (zh) 一种数据处理方法及装置、设备、存储介质
CN115935342A (zh) 一种业务安全监控方法及装置
CN118968160A (zh) 一种视频数据的展示方法、装置及终端设备
JP2023146860A (ja) 情報配信装置及び情報配信方法
CN120013699A (zh) 数据分析方法、装置、计算机设备、存储介质和程序产品
KR20070101956A (ko) 적응적 판매관리 시스템과 방법 및 이를 이용한경보시스템과 방법

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20171018