DE60313283D1 - Verfahren zur zusammenfassung von unbekanntem videoinhalt - Google Patents

Verfahren zur zusammenfassung von unbekanntem videoinhalt

Info

Publication number
DE60313283D1
DE60313283D1 DE60313283T DE60313283T DE60313283D1 DE 60313283 D1 DE60313283 D1 DE 60313283D1 DE 60313283 T DE60313283 T DE 60313283T DE 60313283 T DE60313283 T DE 60313283T DE 60313283 D1 DE60313283 D1 DE 60313283D1
Authority
DE
Germany
Prior art keywords
video content
unknown video
unknown
content
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
DE60313283T
Other languages
English (en)
Other versions
DE60313283T2 (de
Inventor
Ajay Divakaran
Kadir A Peker
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Application granted granted Critical
Publication of DE60313283D1 publication Critical patent/DE60313283D1/de
Publication of DE60313283T2 publication Critical patent/DE60313283T2/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7834—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using audio features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/785—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using colour or luminescence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/786—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using motion, e.g. object motion or camera motion

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Library & Information Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Image Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Television Signal Processing For Recording (AREA)
DE60313283T 2002-11-01 2003-10-15 Verfahren zur zusammenfassung von unbekanntem videoinhalt Expired - Lifetime DE60313283T2 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US10/285,787 US7143352B2 (en) 2002-11-01 2002-11-01 Blind summarization of video content
US285787 2002-11-01
PCT/JP2003/013203 WO2004040480A1 (en) 2002-11-01 2003-10-15 Method for summarizing unknown content of video

Publications (2)

Publication Number Publication Date
DE60313283D1 true DE60313283D1 (de) 2007-05-31
DE60313283T2 DE60313283T2 (de) 2007-12-20

Family

ID=32175254

Family Applications (1)

Application Number Title Priority Date Filing Date
DE60313283T Expired - Lifetime DE60313283T2 (de) 2002-11-01 2003-10-15 Verfahren zur zusammenfassung von unbekanntem videoinhalt

Country Status (6)

Country Link
US (1) US7143352B2 (de)
EP (1) EP1456779B1 (de)
JP (1) JP2006508565A (de)
CN (1) CN100428229C (de)
DE (1) DE60313283T2 (de)
WO (1) WO2004040480A1 (de)

Families Citing this family (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7305133B2 (en) * 2002-11-01 2007-12-04 Mitsubishi Electric Research Laboratories, Inc. Pattern discovery in video content using association rules on multiple sets of labels
US7375731B2 (en) * 2002-11-01 2008-05-20 Mitsubishi Electric Research Laboratories, Inc. Video mining using unsupervised clustering of video content
US20060200346A1 (en) * 2005-03-03 2006-09-07 Nortel Networks Ltd. Speech quality measurement based on classification estimation
US8949235B2 (en) * 2005-11-15 2015-02-03 Yissum Research Development Company Of The Hebrew University Of Jerusalem Ltd. Methods and systems for producing a video synopsis using clustering
EP1955205B1 (de) 2005-11-15 2012-08-29 Yissum Research Development Company Of The Hebrew University Of Jerusalem Verfahren und system zum produzieren einer videosynopse
US20100005485A1 (en) * 2005-12-19 2010-01-07 Agency For Science, Technology And Research Annotation of video footage and personalised video generation
US20070226624A1 (en) * 2006-02-23 2007-09-27 Peker Kadir A Content-based video summarization using spectral clustering
US8699806B2 (en) * 2006-04-12 2014-04-15 Google Inc. Method and apparatus for automatically summarizing video
US8392183B2 (en) 2006-04-25 2013-03-05 Frank Elmo Weber Character-based automated media summarization
US8229156B1 (en) 2006-08-08 2012-07-24 Google Inc. Using curve invariants to automatically characterize videos
AU2007345938B2 (en) * 2007-02-01 2011-11-10 Briefcam, Ltd. Method and system for video indexing and video synopsis
EP2156438A1 (de) * 2007-06-15 2010-02-24 Koninklijke Philips Electronics N.V. Verfahren und vorrichtung zur automatischen erzeugung von zusammenfassungen einer multimediadatei
US8488901B2 (en) * 2007-09-28 2013-07-16 Sony Corporation Content based adjustment of an image
US8630497B2 (en) * 2007-11-27 2014-01-14 Intelliview Technologies Inc. Analyzing a segment of video
WO2009154597A1 (en) * 2008-06-19 2009-12-23 Thomson Licensing Adaptive video key frame selection
US8587668B2 (en) * 2008-07-25 2013-11-19 Anvato, Inc. Method and apparatus for detecting near duplicate videos using perceptual video signatures
US8325796B2 (en) 2008-09-11 2012-12-04 Google Inc. System and method for video coding using adaptive segmentation
US8184913B2 (en) * 2009-04-01 2012-05-22 Microsoft Corporation Clustering videos by location
US8345990B2 (en) * 2009-08-03 2013-01-01 Indian Institute Of Technology Bombay System for creating a capsule representation of an instructional video
US8786597B2 (en) 2010-06-30 2014-07-22 International Business Machines Corporation Management of a history of a meeting
US8687941B2 (en) 2010-10-29 2014-04-01 International Business Machines Corporation Automatic static video summarization
US20120173577A1 (en) * 2010-12-30 2012-07-05 Pelco Inc. Searching recorded video
JP2012212373A (ja) * 2011-03-31 2012-11-01 Casio Comput Co Ltd 画像処理装置、画像処理方法及びプログラム
US9154799B2 (en) 2011-04-07 2015-10-06 Google Inc. Encoding and decoding motion via image segmentation
US9262670B2 (en) 2012-02-10 2016-02-16 Google Inc. Adaptive region of interest
US8914452B2 (en) 2012-05-31 2014-12-16 International Business Machines Corporation Automatically generating a personalized digest of meetings
CN103065153B (zh) * 2012-12-17 2016-06-15 西南科技大学 一种基于色彩量化和聚类的视频关键帧提取方法
US10373470B2 (en) 2013-04-29 2019-08-06 Intelliview Technologies, Inc. Object detection
US9420237B2 (en) 2013-07-09 2016-08-16 Globalfoundries Inc. Insight-driven augmented auto-coordination of multiple video streams for centralized processors
EP2869236A1 (de) * 2013-10-31 2015-05-06 Alcatel Lucent Verfahren zur Erzeugung einer Video-Tag-Cloud zur Darstellung von Objekten, die in einem Videoinhalt erscheinen
JP6378503B2 (ja) * 2014-03-10 2018-08-22 国立大学法人 筑波大学 要約映像データ作成システム及び方法並びにコンピュータプログラム
US9639761B2 (en) 2014-03-10 2017-05-02 Mitsubishi Electric Research Laboratories, Inc. Method for extracting low-rank descriptors from images and videos for querying, classification, and object detection
CA2847707C (en) 2014-03-28 2021-03-30 Intelliview Technologies Inc. Leak detection
US9451335B2 (en) 2014-04-29 2016-09-20 At&T Intellectual Property I, Lp Method and apparatus for augmenting media content
US9392272B1 (en) 2014-06-02 2016-07-12 Google Inc. Video coding using adaptive source variance based partitioning
US10664687B2 (en) 2014-06-12 2020-05-26 Microsoft Technology Licensing, Llc Rule-based video importance analysis
US9578324B1 (en) 2014-06-27 2017-02-21 Google Inc. Video coding using statistical-based spatially differentiated partitioning
US10943357B2 (en) 2014-08-19 2021-03-09 Intelliview Technologies Inc. Video based indoor leak detection
KR102340196B1 (ko) * 2014-10-16 2021-12-16 삼성전자주식회사 동영상 처리 장치 및 방법
CN104978961B (zh) * 2015-05-25 2019-10-15 广州酷狗计算机科技有限公司 一种音频处理方法、装置及终端
CN105228033B (zh) * 2015-08-27 2018-11-09 联想(北京)有限公司 一种视频处理方法及电子设备
EP3157264B1 (de) * 2015-10-17 2019-02-20 Tata Consultancy Services Limited Multisensordatenzusammenfassung
US10474745B1 (en) 2016-04-27 2019-11-12 Google Llc Systems and methods for a knowledge-based form creation platform
US11039181B1 (en) 2016-05-09 2021-06-15 Google Llc Method and apparatus for secure video manifest/playlist generation and playback
US10595054B2 (en) 2016-05-10 2020-03-17 Google Llc Method and apparatus for a virtual online video channel
US10750248B1 (en) 2016-05-10 2020-08-18 Google Llc Method and apparatus for server-side content delivery network switching
US10771824B1 (en) 2016-05-10 2020-09-08 Google Llc System for managing video playback using a server generated manifest/playlist
US11069378B1 (en) 2016-05-10 2021-07-20 Google Llc Method and apparatus for frame accurate high resolution video editing in cloud using live video streams
US10785508B2 (en) 2016-05-10 2020-09-22 Google Llc System for measuring video playback events using a server generated manifest/playlist
US10750216B1 (en) 2016-05-10 2020-08-18 Google Llc Method and apparatus for providing peer-to-peer content delivery
US11032588B2 (en) 2016-05-16 2021-06-08 Google Llc Method and apparatus for spatial enhanced adaptive bitrate live streaming for 360 degree video playback
EP3473016B1 (de) * 2016-06-20 2024-01-24 Pixellot Ltd. Verfahren und system zur automatischen erzeugung von videohervorhebungen
US11561839B2 (en) * 2016-12-21 2023-01-24 Telefonaktiebolaget Lm Ericsson (Publ) Allocation of resources for a plurality of hosts
CN107562374B (zh) * 2017-08-14 2020-05-26 重庆大学 一种非易失性存储器时序数据压缩的量化方法
WO2020026332A1 (ja) * 2018-07-31 2020-02-06 三菱電機株式会社 情報処理装置、プログラム及び情報処理方法
US11481575B2 (en) * 2018-09-26 2022-10-25 Yahoo Assets Llc System and method for learning scene embeddings via visual semantics and application thereof
JP7249580B2 (ja) * 2019-02-28 2023-03-31 富士通株式会社 付与方法、付与プログラム及び付与装置
US20220292285A1 (en) * 2021-03-11 2022-09-15 International Business Machines Corporation Adaptive selection of data modalities for efficient video recognition

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69030869T2 (de) * 1989-12-29 1997-10-16 Canon Kk Bildverarbeitungsverfahren zur Bewertung von Objekten und Vorrichtung zur Qualitätsprüfung zur Durchführung des Verfahrens
US5893062A (en) * 1996-12-05 1999-04-06 Interval Research Corporation Variable rate video playback with synchronized audio
US6278446B1 (en) * 1998-02-23 2001-08-21 Siemens Corporate Research, Inc. System for interactive organization and browsing of video
JP3762835B2 (ja) * 1998-05-21 2006-04-05 富士通株式会社 データ分解装置、その方法、及び記録媒体
US6731788B1 (en) * 1999-01-28 2004-05-04 Koninklijke Philips Electronics N.V. Symbol Classification with shape features applied to neural network
US6369835B1 (en) * 1999-05-18 2002-04-09 Microsoft Corporation Method and system for generating a movie file from a slide show presentation
SE9902328A0 (sv) * 1999-06-18 2000-12-19 Ericsson Telefon Ab L M Förfarande och system för att alstra sammanfattad video
US7424677B2 (en) * 1999-09-16 2008-09-09 Sharp Laboratories Of America, Inc. Audiovisual information management system with usage preferences
US7016540B1 (en) * 1999-11-24 2006-03-21 Nec Corporation Method and system for segmentation, classification, and summarization of video images
WO2001041451A1 (en) * 1999-11-29 2001-06-07 Sony Corporation Video/audio signal processing method and video/audio signal processing apparatus
JP3621323B2 (ja) * 2000-02-28 2005-02-16 日本電信電話株式会社 映像登録・検索処理方法および映像検索装置
US6813313B2 (en) * 2000-07-06 2004-11-02 Mitsubishi Electric Research Laboratories, Inc. Method and system for high-level structure analysis and event detection in domain specific videos
US6763069B1 (en) * 2000-07-06 2004-07-13 Mitsubishi Electric Research Laboratories, Inc Extraction of high-level features from low-level features of multimedia content
US6697523B1 (en) * 2000-08-09 2004-02-24 Mitsubishi Electric Research Laboratories, Inc. Method for summarizing a video using motion and color descriptors
US7203620B2 (en) * 2001-07-03 2007-04-10 Sharp Laboratories Of America, Inc. Summarization of video content
JP4615166B2 (ja) * 2001-07-17 2011-01-19 パイオニア株式会社 映像情報要約装置、映像情報要約方法及び映像情報要約プログラム
US7296231B2 (en) * 2001-08-09 2007-11-13 Eastman Kodak Company Video structuring by probabilistic merging of video segments
US20030206710A1 (en) * 2001-09-14 2003-11-06 Ferman Ahmet Mufit Audiovisual management system
US7260439B2 (en) * 2001-11-01 2007-08-21 Fuji Xerox Co., Ltd. Systems and methods for the automatic extraction of audio excerpts
US6956904B2 (en) * 2002-01-15 2005-10-18 Mitsubishi Electric Research Laboratories, Inc. Summarizing videos using motion activity descriptors correlated with audio features
TW569148B (en) * 2002-04-09 2004-01-01 Ind Tech Res Inst Method for locating facial features in an image
US7035435B2 (en) * 2002-05-07 2006-04-25 Hewlett-Packard Development Company, L.P. Scalable video summarization and navigation system and method
US7047494B2 (en) * 2002-05-07 2006-05-16 Hewlett-Packard Development Company, L.P. Scalable video summarization
US7305133B2 (en) * 2002-11-01 2007-12-04 Mitsubishi Electric Research Laboratories, Inc. Pattern discovery in video content using association rules on multiple sets of labels
US7375731B2 (en) * 2002-11-01 2008-05-20 Mitsubishi Electric Research Laboratories, Inc. Video mining using unsupervised clustering of video content
US7103222B2 (en) * 2002-11-01 2006-09-05 Mitsubishi Electric Research Laboratories, Inc. Pattern discovery in multi-dimensional time series using multi-resolution matching

Also Published As

Publication number Publication date
US20040085339A1 (en) 2004-05-06
JP2006508565A (ja) 2006-03-09
CN100428229C (zh) 2008-10-22
DE60313283T2 (de) 2007-12-20
EP1456779A1 (de) 2004-09-15
US7143352B2 (en) 2006-11-28
CN1685344A (zh) 2005-10-19
WO2004040480A1 (en) 2004-05-13
EP1456779B1 (de) 2007-04-18

Similar Documents

Publication Publication Date Title
DE60313283D1 (de) Verfahren zur zusammenfassung von unbekanntem videoinhalt
DE60326012D1 (de) Verfahren zur Konzentration von Proteinen
DE60325210D1 (de) Verfahren und systeme zur bereitstellung von ergänzendem kontextinhalt
DE602004026698D1 (de) Verfahren zur gemeinsmen benutzung von multimedia-daten
DE60234425D1 (de) Verfahren zur optimaliserung von verkerhrsinformationsinhalt
DE60306210D1 (de) System und verfahren zur lokalen gemeinsamen nutzung von multimedia-inhalten
DE60335733D1 (de) Verfahren zur solubilisierung von protein
DE112004001806D2 (de) Verfahren zur Selbstjustierenden Verkleinerung von Strukturen
ATE437486T1 (de) Verfahren zur konfiguration von physischen kanälen
DE50210071D1 (de) Verfahren zur automatischen ergänzung von software
DE60336713D1 (de) Verfahren zur nassbehandlung von scheibenförmigen gegenständen
DE602004027181D1 (de) Gerät und Verfahren zur Lesesynchronisierung von Video-Daten und Hilfs-Daten
ATE336597T1 (de) Verfahren zur gewinnung von gold
ATE432918T1 (de) Verfahren zur herstellung von cpla 2-inhibitoren
DE60301283D1 (de) Verfahren zur Bestimmung von Biopolymeren
DE50301044D1 (de) Verfahren zur auswahl von transpondern
ATA16992003A (de) Verfahren zur qualitätssicherung von langholz
DE60322483D1 (de) Vorrichtung und Verfahren zur Feststellung von Vortragsstil
DE50105223D1 (de) Verfahren zur wiedergabe von video- und audiodaten
DE50201799D1 (de) Verfahren zur gewinnung von n-phosphonomethylglycin
DE60315255D1 (de) Zusammensetzung und verfahren zur bekämpfung von termiten
ATE356128T1 (de) Verfahren zur herstellung von tubulininhibitoren
DE60328693D1 (de) Verfahren zur oxadimierung von carbonylverbindungen
DE50308468D1 (de) Verfahren zur störbefreiung von messignalen
DE10191554D2 (de) Verfahren zur hochparallelen Analyse von Polymorphismen

Legal Events

Date Code Title Description
8364 No opposition during term of opposition
8320 Willingness to grant licences declared (paragraph 23)