CA2884714C - System and method for generating semantic annotations - Google Patents

System and method for generating semantic annotations Download PDF

Info

Publication number
CA2884714C
CA2884714C CA2884714A CA2884714A CA2884714C CA 2884714 C CA2884714 C CA 2884714C CA 2884714 A CA2884714 A CA 2884714A CA 2884714 A CA2884714 A CA 2884714A CA 2884714 C CA2884714 C CA 2884714C
Authority
CA
Canada
Prior art keywords
sas
prior
new
matching
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2884714A
Other languages
English (en)
French (fr)
Other versions
CA2884714A1 (en
Inventor
Peter Henry Tu
Jens Rittscher
Li Guan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
General Electric Co
Original Assignee
General Electric Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by General Electric Co filed Critical General Electric Co
Publication of CA2884714A1 publication Critical patent/CA2884714A1/en
Application granted granted Critical
Publication of CA2884714C publication Critical patent/CA2884714C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/70—Labelling scene content, e.g. deriving syntactic or semantic representations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G06F18/232—Non-hierarchical techniques
    • G06F18/2323—Non-hierarchical techniques based on graph theory, e.g. minimum spanning trees [MST] or graph cuts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/762—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks
    • G06V10/7635—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks based on graphs, e.g. graph cuts or spectral clustering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computational Linguistics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Discrete Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Alarm Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Image Analysis (AREA)
CA2884714A 2012-09-13 2013-09-12 System and method for generating semantic annotations Active CA2884714C (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201261700542P 2012-09-13 2012-09-13
US61/700,542 2012-09-13
US13/918,905 2013-06-15
US13/918,905 US9251421B2 (en) 2012-09-13 2013-06-15 System and method for generating semantic annotations
PCT/US2013/059453 WO2014043340A1 (en) 2012-09-13 2013-09-12 System and method for generating semantic annotations

Publications (2)

Publication Number Publication Date
CA2884714A1 CA2884714A1 (en) 2014-03-20
CA2884714C true CA2884714C (en) 2018-05-22

Family

ID=50233312

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2884714A Active CA2884714C (en) 2012-09-13 2013-09-12 System and method for generating semantic annotations

Country Status (9)

Country Link
US (1) US9251421B2 (https=)
EP (1) EP2895987A1 (https=)
JP (1) JP6307082B2 (https=)
KR (1) KR101890467B1 (https=)
CN (1) CN104781831B (https=)
AU (1) AU2013315478B2 (https=)
BR (1) BR112015005541A2 (https=)
CA (1) CA2884714C (https=)
WO (1) WO2014043340A1 (https=)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9251421B2 (en) * 2012-09-13 2016-02-02 General Electric Company System and method for generating semantic annotations
US9451335B2 (en) 2014-04-29 2016-09-20 At&T Intellectual Property I, Lp Method and apparatus for augmenting media content
US10726508B2 (en) 2016-04-21 2020-07-28 Wayne Fueling Systems Llc Intelligent fuel dispensers
US12248995B2 (en) 2016-04-21 2025-03-11 Wayne Fueling Systems Llc Intelligent fuel dispensers
EP3466054B1 (en) 2016-05-27 2021-05-26 Wayne Fueling Systems Llc Transparent fuel dispenser
WO2018101504A1 (ko) * 2016-11-30 2018-06-07 전자부품연구원 서비스 매쉬업을 위한 메타 데이터 생성 방법 및 시스템
US10565291B2 (en) * 2017-10-23 2020-02-18 International Business Machines Corporation Automatic generation of personalized visually isolated text
CN108419094B (zh) 2018-03-05 2021-01-29 腾讯科技（深圳）有限公司 视频处理方法、视频检索方法、装置、介质及服务器
US11157524B2 (en) 2018-05-18 2021-10-26 At&T Intellectual Property I, L.P. Automated learning of anomalies in media streams with external feed labels
CN109191379B (zh) * 2018-07-26 2022-03-29 北京纵目安驰智能科技有限公司 一种全景拼接的语义标注方法、系统、终端和存储介质
US10339420B1 (en) * 2018-08-30 2019-07-02 Accenture Global Solutions Limited Entity recognition using multiple data streams to supplement missing information associated with an entity
US11119679B2 (en) * 2019-08-02 2021-09-14 Micron Technology, Inc. Storing data based on a probability of a data graph
US11373069B2 (en) 2020-03-20 2022-06-28 General Electric Company Analogy engine for grounding and situational awareness
US11783558B1 (en) 2021-02-24 2023-10-10 Apple Inc. Object correction using scene graphs
US12112519B1 (en) * 2021-02-24 2024-10-08 Apple Inc. Scripted interactive scenarios based on scene graph matching
CN112906586B (zh) * 2021-02-26 2024-05-24 上海商汤科技开发有限公司 时序动作提名生成方法和相关产品
US20230122338A1 (en) * 2021-10-15 2023-04-20 International Business Machines Corporation Knowledge Graph Driven Content Generation
KR20250031864A (ko) * 2023-08-29 2025-03-07 주식회사 아이디케이스퀘어드 데이터에 대한 차트 기반으로 내러티브 및 새로운 차트를 제공하기 위한 서버 및 방법

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0805405A3 (en) * 1996-02-05 1998-04-15 Texas Instruments Incorporated Motion event detection for video indexing
US6842190B1 (en) * 1999-07-06 2005-01-11 Intel Corporation Video bit stream extension with supplementary content information to aid in subsequent video processing
JP3602765B2 (ja) * 1999-07-19 2004-12-15 株式会社リコー 映像検索方法、その方法をコンピュータに実行させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体、映像検索処理装置、映像インデックス付与方法、その方法をコンピュータに実行させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体、映像内容の説明文生成方法およびその方法をコンピュータに実行させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体
GB9918248D0 (en) 1999-08-04 1999-10-06 Matra Bae Dynamics Uk Ltd Improvements in and relating to surveillance systems
US6424370B1 (en) * 1999-10-08 2002-07-23 Texas Instruments Incorporated Motion based event detection system and method
JP2001307061A (ja) * 2000-03-06 2001-11-02 Mitsubishi Electric Research Laboratories Inc マルチメディア・コンテンツの順序付け方法
US7680951B1 (en) * 2004-06-01 2010-03-16 Massachusetts Institute Of Technology High speed subscribe-and-alert service using content graphs
CA2589186A1 (en) 2004-12-08 2006-06-15 Ultra Proizvodnja Elektronskih Naprav D.O.O. Method, system and components for operating a fuel distribution system with unmanned self-service gasoline stations
US7571157B2 (en) * 2004-12-29 2009-08-04 Aol Llc Filtering search results
WO2007002820A2 (en) * 2005-06-28 2007-01-04 Yahoo! Inc. Search engine with augmented relevance ranking by community participation
US7956735B2 (en) 2006-05-15 2011-06-07 Cernium Corporation Automated, remotely-verified alarm system with intrusion and video surveillance and digital video recording
US8274377B2 (en) 2007-01-10 2012-09-25 Decision Sciences International Corporation Information collecting and decision making via tiered information network systems
US8269834B2 (en) * 2007-01-12 2012-09-18 International Business Machines Corporation Warning a user about adverse behaviors of others within an environment based on a 3D captured image stream
US20120314063A1 (en) 2007-03-14 2012-12-13 Seth Cirker Threat based adaptable network and physical security system
US7382244B1 (en) 2007-10-04 2008-06-03 Kd Secure Video surveillance, storage, and alerting system having network management, hierarchical data storage, video tip processing, and vehicle plate analysis
CN101334796B (zh) * 2008-02-29 2011-01-12 浙江师范大学 一种个性化及协同化融合的网上多媒体检索与查询方法
CN101616264B (zh) * 2008-06-27 2011-03-30 中国科学院自动化研究所 新闻视频编目方法及系统
US8316032B1 (en) * 2009-01-09 2012-11-20 Google Inc. Book content item search
US8285060B2 (en) 2009-08-31 2012-10-09 Behavioral Recognition Systems, Inc. Detecting anomalous trajectories in a video surveillance system
US10019677B2 (en) 2009-11-20 2018-07-10 Alert Enterprise, Inc. Active policy enforcement
CN101799827A (zh) * 2010-03-11 2010-08-11 浙江大学 基于层次化结构的视频素材库管理方法
CN101968797A (zh) * 2010-09-10 2011-02-09 北京大学 一种基于镜头间上下文的视频概念标注方法
US8760290B2 (en) 2011-04-08 2014-06-24 Rave Wireless, Inc. Public safety analysis system
CN102508923B (zh) * 2011-11-22 2014-06-11 北京大学 基于自动分类和关键字标注的自动视频注释方法
US9251421B2 (en) * 2012-09-13 2016-02-02 General Electric Company System and method for generating semantic annotations

Also Published As

Publication number Publication date
JP6307082B2 (ja) 2018-04-04
CA2884714A1 (en) 2014-03-20
KR101890467B1 (ko) 2018-08-21
US20140072171A1 (en) 2014-03-13
EP2895987A1 (en) 2015-07-22
AU2013315478A1 (en) 2015-04-02
BR112015005541A2 (pt) 2017-08-08
JP2015528613A (ja) 2015-09-28
KR20150056802A (ko) 2015-05-27
WO2014043340A1 (en) 2014-03-20
US9251421B2 (en) 2016-02-02
CN104781831B (zh) 2019-04-30
AU2013315478B2 (en) 2018-11-15
CN104781831A (zh) 2015-07-15

Similar Documents

Publication Publication Date Title
CA2884714C (en) System and method for generating semantic annotations
US10271017B2 (en) System and method for generating an activity summary of a person
US8587662B1 (en) Theft trend analysis and response
CN108027888B (zh) 使用上下文信号的局部异常检测
US20190340496A1 (en) Information processing apparatus and information processing method
CN108320256A (zh) 基于大数据的社会安全事件识别方法、设备及存储介质
CN112598071A (zh) 明火识别方法、装置、设备和存储介质
CN111062823A (zh) 一种社交图谱分析方法、装置及存储介质
US9207105B2 (en) System and method for incident detection with spatiotemporal thresholds estimated via nonparametric quantile regression
Patel et al. Video representation and suspicious event detection using semantic technologies
JPWO2014208025A1 (ja) 感度調整装置、感度調整方法およびコンピュータプログラム、並びに監視システム
di Bella et al. Smart Security: Integrated systems for security policies in urban environments
CN114445710A (zh) 图像识别方法、装置、电子设备以及存储介质
CN110324588B (zh) 基于字典结构的视频分析警告事件信息存储方法
CN118968160A (zh) 一种视频数据的展示方法、装置及终端设备
CN114223011A (zh) 词条推送方法、装置、电子设备及存储介质
Ke et al. Transit Safety System Evaluation and Hotspot Identification Empowered by Edge Computing Transit Event Logging System
CN115082905A (zh) 操作行为的检测方法和装置、存储介质及电子装置
US20240312338A1 (en) Device and method for selectively enabling execution of video analytics on videos captured by cameras
CN115935342A (zh) 一种业务安全监控方法及装置
WO2024011079A1 (en) Method and system to provide alarm risk score analysis and intelligence
CN120013699A (zh) 数据分析方法、装置、计算机设备、存储介质和程序产品
KR20070101956A (ko) 적응적 판매관리 시스템과 방법 및 이를 이용한경보시스템과 방법
EP3783532A1 (fr) Dispositif de detection de personnes en situation de noyade ou de situation a risque de noyade
US20160103855A1 (en) Collaborative item database

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20171018

MPN Maintenance fee for patent paid

Free format text: FEE DESCRIPTION TEXT: MF (PATENT, 11TH ANNIV.) - STANDARD

Year of fee payment: 11

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20240830

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT DETERMINED COMPLIANT

Effective date: 20241218