CA2884714C - System and method for generating semantic annotations - Google Patents

System and method for generating semantic annotations Download PDF

Info

Publication number
CA2884714C
CA2884714C CA2884714A CA2884714A CA2884714C CA 2884714 C CA2884714 C CA 2884714C CA 2884714 A CA2884714 A CA 2884714A CA 2884714 A CA2884714 A CA 2884714A CA 2884714 C CA2884714 C CA 2884714C
Authority
CA
Canada
Prior art keywords
sas
prior
new
matching
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2884714A
Other languages
English (en)
French (fr)
Other versions
CA2884714A1 (en
Inventor
Peter Henry Tu
Jens Rittscher
Li Guan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
General Electric Co
Original Assignee
General Electric Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by General Electric Co filed Critical General Electric Co
Publication of CA2884714A1 publication Critical patent/CA2884714A1/en
Application granted granted Critical
Publication of CA2884714C publication Critical patent/CA2884714C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/70—Labelling scene content, e.g. deriving syntactic or semantic representations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G06F18/232—Non-hierarchical techniques
    • G06F18/2323—Non-hierarchical techniques based on graph theory, e.g. minimum spanning trees [MST] or graph cuts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/762—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks
    • G06V10/7635—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks based on graphs, e.g. graph cuts or spectral clustering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Computational Linguistics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Discrete Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Alarm Systems (AREA)
  • Image Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CA2884714A 2012-09-13 2013-09-12 System and method for generating semantic annotations Active CA2884714C (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201261700542P 2012-09-13 2012-09-13
US61/700,542 2012-09-13
US13/918,905 2013-06-15
US13/918,905 US9251421B2 (en) 2012-09-13 2013-06-15 System and method for generating semantic annotations
PCT/US2013/059453 WO2014043340A1 (en) 2012-09-13 2013-09-12 System and method for generating semantic annotations

Publications (2)

Publication Number Publication Date
CA2884714A1 CA2884714A1 (en) 2014-03-20
CA2884714C true CA2884714C (en) 2018-05-22

Family

ID=50233312

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2884714A Active CA2884714C (en) 2012-09-13 2013-09-12 System and method for generating semantic annotations

Country Status (9)

Country Link
US (1) US9251421B2 (https=)
EP (1) EP2895987A1 (https=)
JP (1) JP6307082B2 (https=)
KR (1) KR101890467B1 (https=)
CN (1) CN104781831B (https=)
AU (1) AU2013315478B2 (https=)
BR (1) BR112015005541A2 (https=)
CA (1) CA2884714C (https=)
WO (1) WO2014043340A1 (https=)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9251421B2 (en) * 2012-09-13 2016-02-02 General Electric Company System and method for generating semantic annotations
US9451335B2 (en) 2014-04-29 2016-09-20 At&T Intellectual Property I, Lp Method and apparatus for augmenting media content
US12248995B2 (en) 2016-04-21 2025-03-11 Wayne Fueling Systems Llc Intelligent fuel dispensers
ES2968143T3 (es) 2016-04-21 2024-05-08 Wayne Fueling Systems Llc Dispensadores inteligentes de combustible
AU2017271946B2 (en) 2016-05-27 2021-11-04 Wayne Fueling Systems Llc Transparent fuel dispenser
WO2018101504A1 (ko) * 2016-11-30 2018-06-07 전자부품연구원 서비스 매쉬업을 위한 메타 데이터 생성 방법 및 시스템
US10565291B2 (en) * 2017-10-23 2020-02-18 International Business Machines Corporation Automatic generation of personalized visually isolated text
CN110475129B (zh) 2018-03-05 2021-05-28 腾讯科技（深圳）有限公司 视频处理方法、介质及服务器
US11157524B2 (en) 2018-05-18 2021-10-26 At&T Intellectual Property I, L.P. Automated learning of anomalies in media streams with external feed labels
CN109191379B (zh) * 2018-07-26 2022-03-29 北京纵目安驰智能科技有限公司 一种全景拼接的语义标注方法、系统、终端和存储介质
US10339420B1 (en) * 2018-08-30 2019-07-02 Accenture Global Solutions Limited Entity recognition using multiple data streams to supplement missing information associated with an entity
US11119679B2 (en) * 2019-08-02 2021-09-14 Micron Technology, Inc. Storing data based on a probability of a data graph
US11373069B2 (en) 2020-03-20 2022-06-28 General Electric Company Analogy engine for grounding and situational awareness
US12112519B1 (en) * 2021-02-24 2024-10-08 Apple Inc. Scripted interactive scenarios based on scene graph matching
US11783558B1 (en) 2021-02-24 2023-10-10 Apple Inc. Object correction using scene graphs
CN112906586B (zh) * 2021-02-26 2024-05-24 上海商汤科技开发有限公司 时序动作提名生成方法和相关产品
AU2022345261A1 (en) 2021-09-16 2024-03-14 Wayne Fueling Systems Llc Determining dispenser vehicle connection
US20230122338A1 (en) * 2021-10-15 2023-04-20 International Business Machines Corporation Knowledge Graph Driven Content Generation
KR20250031864A (ko) * 2023-08-29 2025-03-07 주식회사 아이디케이스퀘어드 데이터에 대한 차트 기반으로 내러티브 및 새로운 차트를 제공하기 위한 서버 및 방법

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0805405A3 (en) * 1996-02-05 1998-04-15 Texas Instruments Incorporated Motion event detection for video indexing
US6842190B1 (en) * 1999-07-06 2005-01-11 Intel Corporation Video bit stream extension with supplementary content information to aid in subsequent video processing
JP3602765B2 (ja) * 1999-07-19 2004-12-15 株式会社リコー 映像検索方法、その方法をコンピュータに実行させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体、映像検索処理装置、映像インデックス付与方法、その方法をコンピュータに実行させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体、映像内容の説明文生成方法およびその方法をコンピュータに実行させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体
GB9918248D0 (en) 1999-08-04 1999-10-06 Matra Bae Dynamics Uk Ltd Improvements in and relating to surveillance systems
US6424370B1 (en) * 1999-10-08 2002-07-23 Texas Instruments Incorporated Motion based event detection system and method
JP2001307061A (ja) * 2000-03-06 2001-11-02 Mitsubishi Electric Research Laboratories Inc マルチメディア・コンテンツの順序付け方法
US7680951B1 (en) * 2004-06-01 2010-03-16 Massachusetts Institute Of Technology High speed subscribe-and-alert service using content graphs
US20100023162A1 (en) 2004-12-08 2010-01-28 Kristijan Gresak Method, System and Components for Operating a Fuel Distribution System with Unmanned Self-Service Gasoline Stations
US7571157B2 (en) * 2004-12-29 2009-08-04 Aol Llc Filtering search results
WO2007002820A2 (en) * 2005-06-28 2007-01-04 Yahoo! Inc. Search engine with augmented relevance ranking by community participation
US7956735B2 (en) 2006-05-15 2011-06-07 Cernium Corporation Automated, remotely-verified alarm system with intrusion and video surveillance and digital video recording
WO2008086507A1 (en) 2007-01-10 2008-07-17 Decision Sciences Corporation Information collecting and decision making via tiered information network systems
US8269834B2 (en) * 2007-01-12 2012-09-18 International Business Machines Corporation Warning a user about adverse behaviors of others within an environment based on a 3D captured image stream
US20120314063A1 (en) 2007-03-14 2012-12-13 Seth Cirker Threat based adaptable network and physical security system
WO2009045218A1 (en) 2007-10-04 2009-04-09 Donovan John J A video surveillance, storage, and alerting system having network management, hierarchical data storage, video tip processing, and vehicle plate analysis
CN101334796B (zh) * 2008-02-29 2011-01-12 浙江师范大学 一种个性化及协同化融合的网上多媒体检索与查询方法
CN101616264B (zh) * 2008-06-27 2011-03-30 中国科学院自动化研究所 新闻视频编目方法及系统
US8316032B1 (en) * 2009-01-09 2012-11-20 Google Inc. Book content item search
US8285060B2 (en) 2009-08-31 2012-10-09 Behavioral Recognition Systems, Inc. Detecting anomalous trajectories in a video surveillance system
US10019677B2 (en) 2009-11-20 2018-07-10 Alert Enterprise, Inc. Active policy enforcement
CN101799827A (zh) * 2010-03-11 2010-08-11 浙江大学 基于层次化结构的视频素材库管理方法
CN101968797A (zh) * 2010-09-10 2011-02-09 北京大学 一种基于镜头间上下文的视频概念标注方法
US8760290B2 (en) 2011-04-08 2014-06-24 Rave Wireless, Inc. Public safety analysis system
CN102508923B (zh) * 2011-11-22 2014-06-11 北京大学 基于自动分类和关键字标注的自动视频注释方法
US9251421B2 (en) * 2012-09-13 2016-02-02 General Electric Company System and method for generating semantic annotations

Also Published As

Publication number Publication date
KR20150056802A (ko) 2015-05-27
JP6307082B2 (ja) 2018-04-04
JP2015528613A (ja) 2015-09-28
CA2884714A1 (en) 2014-03-20
AU2013315478B2 (en) 2018-11-15
AU2013315478A1 (en) 2015-04-02
US20140072171A1 (en) 2014-03-13
EP2895987A1 (en) 2015-07-22
CN104781831A (zh) 2015-07-15
CN104781831B (zh) 2019-04-30
BR112015005541A2 (pt) 2017-08-08
WO2014043340A1 (en) 2014-03-20
US9251421B2 (en) 2016-02-02
KR101890467B1 (ko) 2018-08-21

Similar Documents

Publication Publication Date Title
CA2884714C (en) System and method for generating semantic annotations
US10271017B2 (en) System and method for generating an activity summary of a person
US20230259977A1 (en) Systems and Methods for Switching Modes of Providing Content on a Charging Station Display
US8587662B1 (en) Theft trend analysis and response
CN108027888B (zh) 使用上下文信号的局部异常检测
CN112507813A (zh) 事件检测方法、装置、电子设备及存储介质
EP2758879B1 (en) A computing platform for development and deployment of sensor-driven vehicle telemetry applications and services
US20190340496A1 (en) Information processing apparatus and information processing method
CN112598071A (zh) 明火识别方法、装置、设备和存储介质
US20220198152A1 (en) Generating hypotheses in data sets
JPWO2014208025A1 (ja) 感度調整装置、感度調整方法およびコンピュータプログラム、並びに監視システム
di Bella et al. Smart Security: Integrated systems for security policies in urban environments
US20130254276A1 (en) Online social media platform that records and aggregates mood in color
CN111191498A (zh) 行为识别方法和相关产品
CN114445710A (zh) 图像识别方法、装置、电子设备以及存储介质
CN110324588B (zh) 基于字典结构的视频分析警告事件信息存储方法
CN118968160A (zh) 一种视频数据的展示方法、装置及终端设备
CN114223011A (zh) 词条推送方法、装置、电子设备及存储介质
KR102875729B1 (ko) 맞춤형 콘텐츠 생성 방법 및 컴퓨터프로그램
US12461233B2 (en) System and method for detection and reporting of events
Fu et al. Batman or the joker? the powerful urban computing and its ethics issues
CN115935342A (zh) 一种业务安全监控方法及装置
KR20070101956A (ko) 적응적 판매관리 시스템과 방법 및 이를 이용한경보시스템과 방법
EP3783532A1 (fr) Dispositif de detection de personnes en situation de noyade ou de situation a risque de noyade
CN114332505A (zh) 目标匹配方法、事件确定方法、装置和计算机设备

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20171018

MPN Maintenance fee for patent paid

Free format text: FEE DESCRIPTION TEXT: MF (PATENT, 11TH ANNIV.) - STANDARD

Year of fee payment: 11

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20240830

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT DETERMINED COMPLIANT

Effective date: 20241218

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20241218

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-4-4-W10-W00-W100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: LETTER SENT

Effective date: 20251205

H13 Ip right lapsed

Free format text: ST27 STATUS EVENT CODE: N-4-6-H10-H13-H100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE AND LATE FEE NOT PAID BY DEADLINE OF NOTICE

Effective date: 20260423