JP5351958B2 - デジタルコンテンツ記録のための意味論的イベント検出 - Google Patents

デジタルコンテンツ記録のための意味論的イベント検出 Download PDF

Info

Publication number
JP5351958B2
JP5351958B2 JP2011512451A JP2011512451A JP5351958B2 JP 5351958 B2 JP5351958 B2 JP 5351958B2 JP 2011512451 A JP2011512451 A JP 2011512451A JP 2011512451 A JP2011512451 A JP 2011512451A JP 5351958 B2 JP5351958 B2 JP 5351958B2
Authority
JP
Japan
Prior art keywords
event
concept
semantic
image
visual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2011512451A
Other languages
English (en)
Japanese (ja)
Other versions
JP2011525012A (ja
JP2011525012A5 (enExample
Inventor
アレクサンダー シー ルイ
ウェイ ジアン
Original Assignee
インテレクチュアル ベンチャーズ ファンド ８３ エルエルシー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インテレクチュアル ベンチャーズ ファンド ８３ エルエルシー filed Critical インテレクチュアル ベンチャーズ ファンド ８３ エルエルシー
Publication of JP2011525012A publication Critical patent/JP2011525012A/ja
Publication of JP2011525012A5 publication Critical patent/JP2011525012A5/ja
Application granted granted Critical
Publication of JP5351958B2 publication Critical patent/JP5351958B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5838—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/785—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using colour or luminescence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/7854—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using shape
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/7857—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using texture
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Library & Information Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Analysis (AREA)
  • Processing Or Creating Images (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2011512451A 2008-06-02 2009-05-22 デジタルコンテンツ記録のための意味論的イベント検出 Expired - Fee Related JP5351958B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US5820108P 2008-06-02 2008-06-02
US61/058,201 2008-06-02
US12/331,927 US8358856B2 (en) 2008-06-02 2008-12-10 Semantic event detection for digital content records
US12/331,927 2008-12-10
PCT/US2009/003160 WO2009148518A2 (en) 2008-06-02 2009-05-22 Semantic event detection for digital content records

Publications (3)

Publication Number Publication Date
JP2011525012A JP2011525012A (ja) 2011-09-08
JP2011525012A5 JP2011525012A5 (enExample) 2012-05-17
JP5351958B2 true JP5351958B2 (ja) 2013-11-27

Family

ID=41379891

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2011512451A Expired - Fee Related JP5351958B2 (ja) 2008-06-02 2009-05-22 デジタルコンテンツ記録のための意味論的イベント検出

Country Status (4)

Country Link
US (1) US8358856B2 (enExample)
EP (1) EP2289021B1 (enExample)
JP (1) JP5351958B2 (enExample)
WO (1) WO2009148518A2 (enExample)

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100052676A (ko) * 2008-11-11 2010-05-20 삼성전자주식회사 컨텐츠 앨범화 장치 및 그 방법
US8611677B2 (en) * 2008-11-19 2013-12-17 Intellectual Ventures Fund 83 Llc Method for event-based semantic classification
US8406461B2 (en) 2010-04-27 2013-03-26 Intellectual Ventures Fund 83 Llc Automated template layout system
US8406460B2 (en) 2010-04-27 2013-03-26 Intellectual Ventures Fund 83 Llc Automated template layout method
US8970720B2 (en) 2010-07-26 2015-03-03 Apple Inc. Automatic digital camera photography mode selection
JP5598159B2 (ja) * 2010-08-23 2014-10-01 株式会社ニコン 画像処理装置、撮像システム、画像処理方法、およびプログラム
US20130132377A1 (en) * 2010-08-26 2013-05-23 Zhe Lin Systems and Methods for Localized Bag-of-Features Retrieval
JP5649425B2 (ja) * 2010-12-06 2015-01-07 株式会社東芝 映像検索装置
US8923607B1 (en) * 2010-12-08 2014-12-30 Google Inc. Learning sports highlights using event detection
US8635197B2 (en) 2011-02-28 2014-01-21 International Business Machines Corporation Systems and methods for efficient development of a rule-based system using crowd-sourcing
US20120275714A1 (en) * 2011-04-27 2012-11-01 Yuli Gao Determination of an image selection representative of a storyline
US9055276B2 (en) 2011-07-29 2015-06-09 Apple Inc. Camera having processing customized for identified persons
US8983940B2 (en) 2011-09-02 2015-03-17 Adobe Systems Incorporated K-nearest neighbor re-ranking
US8634661B2 (en) * 2011-09-07 2014-01-21 Intellectual Ventures Fund 83 Llc Event classification method using light source detection
US20130058577A1 (en) * 2011-09-07 2013-03-07 Peter O. Stubler Event classification method for related digital images
US8634660B2 (en) * 2011-09-07 2014-01-21 Intellectual Ventures Fund 83 Llc Event classification method using lit candle detection
US8805116B2 (en) 2011-09-17 2014-08-12 Adobe Systems Incorporated Methods and apparatus for visual search
JP2015529365A (ja) * 2012-09-05 2015-10-05 エレメント，インク． カメラ付きデバイスに関連する生体認証のためのシステム及び方法
US8880563B2 (en) 2012-09-21 2014-11-04 Adobe Systems Incorporated Image search by query object segmentation
US9451335B2 (en) 2014-04-29 2016-09-20 At&T Intellectual Property I, Lp Method and apparatus for augmenting media content
US9898685B2 (en) 2014-04-29 2018-02-20 At&T Intellectual Property I, L.P. Method and apparatus for analyzing media content
KR102506826B1 (ko) 2014-05-13 2023-03-06 엘리먼트, 인크. 모바일 장치와 관련된 전자 키 지급 및 액세스 관리를 위한 시스템 및 방법
CN106664207B (zh) 2014-06-03 2019-12-13 埃利蒙特公司 与移动设备有关的考勤验证与管理
CN105335595A (zh) 2014-06-30 2016-02-17 杜比实验室特许公司 基于感受的多媒体处理
CN104133917B (zh) * 2014-08-15 2018-08-10 百度在线网络技术（北京）有限公司 照片的分类存储方法及装置
AU2014218444B2 (en) * 2014-08-29 2017-06-15 Canon Kabushiki Kaisha Dynamic feature selection for joint probabilistic recognition
US10572735B2 (en) * 2015-03-31 2020-02-25 Beijing Shunyuan Kaihua Technology Limited Detect sports video highlights for mobile computing devices
CN104915685A (zh) * 2015-07-02 2015-09-16 北京联合大学 基于多矩形划分的图像表示方法
KR102225088B1 (ko) * 2015-10-26 2021-03-08 에스케이텔레콤 주식회사 상황 정보 기반의 태그 생성 방법 및 장치
US9961202B2 (en) * 2015-12-31 2018-05-01 Nice Ltd. Automated call classification
US11205103B2 (en) 2016-12-09 2021-12-21 The Research Foundation for the State University Semisupervised autoencoder for sentiment analysis
US20190019107A1 (en) * 2017-07-12 2019-01-17 Samsung Electronics Co., Ltd. Method of machine learning by remote storage device and remote storage device employing method of machine learning
US10735959B2 (en) 2017-09-18 2020-08-04 Element Inc. Methods, systems, and media for detecting spoofing in mobile authentication
CN108090199B (zh) * 2017-12-22 2020-02-21 浙江大学 一种大型图像集的语义信息提取和可视化方法
CN113826110B (zh) 2019-03-12 2023-06-20 埃利蒙特公司 利用移动设备检测生物特征身份识别的欺骗的方法、系统和介质
US11586861B2 (en) 2019-09-13 2023-02-21 Toyota Research Institute, Inc. Embeddings + SVM for teaching traversability
CN110781963B (zh) * 2019-10-28 2022-03-04 西安电子科技大学 基于K-means聚类的空中目标分群方法
US11507248B2 (en) 2019-12-16 2022-11-22 Element Inc. Methods, systems, and media for anti-spoofing using eye-tracking
CN111221984B (zh) * 2020-01-15 2024-03-01 北京百度网讯科技有限公司 多模态内容处理方法、装置、设备及存储介质
EP4113327A4 (en) * 2020-02-27 2023-06-21 Panasonic Intellectual Property Management Co., Ltd. IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD
US20230215155A1 (en) * 2022-01-05 2023-07-06 Dell Products L.P. Label inheritance for soft label generation in information processing system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6832006B2 (en) * 2001-07-23 2004-12-14 Eastman Kodak Company System and method for controlling image compression based on image emphasis
US7039239B2 (en) * 2002-02-07 2006-05-02 Eastman Kodak Company Method for image region classification using unsupervised and supervised learning
US20030233232A1 (en) * 2002-06-12 2003-12-18 Lucent Technologies Inc. System and method for measuring domain independence of semantic classes
US7383260B2 (en) * 2004-08-03 2008-06-03 International Business Machines Corporation Method and apparatus for ontology-based classification of media content
US7545978B2 (en) * 2005-07-01 2009-06-09 International Business Machines Corporation Methods and apparatus for filtering video packets for large-scale video stream monitoring
JP2007317077A (ja) * 2006-05-29 2007-12-06 Fujifilm Corp 画像分類装置および方法ならびにプログラム
US8165406B2 (en) * 2007-12-12 2012-04-24 Microsoft Corp. Interactive concept learning in image search

Also Published As

Publication number Publication date
US8358856B2 (en) 2013-01-22
EP2289021B1 (en) 2013-01-02
JP2011525012A (ja) 2011-09-08
WO2009148518A3 (en) 2010-01-28
EP2289021A2 (en) 2011-03-02
WO2009148518A2 (en) 2009-12-10
US20090297032A1 (en) 2009-12-03

Similar Documents

Publication Publication Date Title
JP5351958B2 (ja) デジタルコンテンツ記録のための意味論的イベント検出
US8213725B2 (en) Semantic event detection using cross-domain knowledge
US12222980B2 (en) Generating congruous metadata for multimedia
US8548256B2 (en) Method for fast scene matching
US9317781B2 (en) Multiple cluster instance learning for image classification
Ali et al. A novel image retrieval based on visual words integration of SIFT and SURF
Quelhas et al. A thousand words in a scene
Galleguillos et al. Weakly supervised object localization with stable segmentations
US8837820B2 (en) Image selection based on photographic style
US8533204B2 (en) Text-based searching of image data
US20100226582A1 (en) Assigning labels to images in a collection
US20140172643A1 (en) System and method for categorizing an image
Amores et al. Context-based object-class recognition and retrieval by generalized correlograms
JP2016134175A (ja) ワイルドカードを用いてテキスト−画像クエリを実施するための方法およびシステム
Jiang Super: Towards real-time event recognition in internet videos
Oussama et al. A fast weighted multi-view Bayesian learning scheme with deep learning for text-based image retrieval from unlabeled galleries
CN116956052B (en) Application matching method and application matching device
Borovikov et al. Face matching for post-disaster family reunification
Tao Visual concept detection and real time object detection
Chen et al. An efficient framework for location-based scene matching in image databases
Shiue et al. Image retrieval using a scale-invariant feature transform bag-of-features model with salient object detection
Chu et al. Feature classification for representative photo selection
CN120821863A (zh) 一种图像查重方法、装置、设备及介质
Wu et al. Multi-option image completion based on semantic matching image
Rabinovich et al. Weakly supervised object localization with stable segmentations

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20120322

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20120322

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20130311

A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A711

Effective date: 20130403

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20130731

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20130806

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20130823

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees