KR101711677B1 - 위치에 의한 비디오들의 클러스터링 - Google Patents

위치에 의한 비디오들의 클러스터링 Download PDF

Info

Publication number
KR101711677B1
KR101711677B1 KR1020117022868A KR20117022868A KR101711677B1 KR 101711677 B1 KR101711677 B1 KR 101711677B1 KR 1020117022868 A KR1020117022868 A KR 1020117022868A KR 20117022868 A KR20117022868 A KR 20117022868A KR 101711677 B1 KR101711677 B1 KR 101711677B1
Authority
KR
South Korea
Prior art keywords
shots
clustering
similarity
clusters
frames
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
KR1020117022868A
Other languages
English (en)
Korean (ko)
Other versions
KR20120003447A (ko
Inventor
시몬 제이 베이커
3세 찰스 로렌스 지트닉
게하드 플로리안 슈로프
Original Assignee
마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 filed Critical 마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Publication of KR20120003447A publication Critical patent/KR20120003447A/ko
Application granted granted Critical
Publication of KR101711677B1 publication Critical patent/KR101711677B1/ko
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/787—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G06F18/231—Hierarchical techniques, i.e. dividing or merging pattern sets so as to obtain a dendrogram
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/762—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks
    • G06V10/7625—Hierarchical techniques, i.e. dividing or merging patterns to obtain a tree-like representation; Dendograms
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/93—Regeneration of the television signal or of selected parts thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computational Linguistics (AREA)
  • Library & Information Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Health & Medical Sciences (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Television Signal Processing For Recording (AREA)
KR1020117022868A 2009-04-01 2010-04-01 위치에 의한 비디오들의 클러스터링 Expired - Fee Related KR101711677B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12/416,152 US8184913B2 (en) 2009-04-01 2009-04-01 Clustering videos by location
US12/416,152 2009-04-01
PCT/US2010/029709 WO2010115056A2 (en) 2009-04-01 2010-04-01 Clustering videos by location

Publications (2)

Publication Number Publication Date
KR20120003447A KR20120003447A (ko) 2012-01-10
KR101711677B1 true KR101711677B1 (ko) 2017-03-02

Family

ID=42826229

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020117022868A Expired - Fee Related KR101711677B1 (ko) 2009-04-01 2010-04-01 위치에 의한 비디오들의 클러스터링

Country Status (7)

Country Link
US (1) US8184913B2 (enExample)
EP (1) EP2415256A4 (enExample)
JP (1) JP5404908B2 (enExample)
KR (1) KR101711677B1 (enExample)
CN (1) CN102388390B (enExample)
CA (1) CA2753978C (enExample)
WO (1) WO2010115056A2 (enExample)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8447120B2 (en) * 2008-10-04 2013-05-21 Microsoft Corporation Incremental feature indexing for scalable location recognition
KR20110032610A (ko) * 2009-09-23 2011-03-30 삼성전자주식회사 장면 분할 장치 및 방법
CN103210651B (zh) * 2010-11-15 2016-11-09 华为技术有限公司 用于视频概要的方法和系统
US8494305B2 (en) * 2011-12-20 2013-07-23 Mitsubishi Electric Research Laboratories, Inc. Image filtering by sparse reconstruction on affinity net
KR101369270B1 (ko) * 2012-03-29 2014-03-10 서울대학교산학협력단 멀티 채널 분석을 이용한 비디오 스트림 분석 방법
US9336302B1 (en) 2012-07-20 2016-05-10 Zuci Realty Llc Insight and algorithmic clustering for automated synthesis
CN104462139A (zh) * 2013-09-24 2015-03-25 中国科学院上海高等研究院 用户行为的聚类方法和系统
CN104516900A (zh) * 2013-09-29 2015-04-15 国际商业机器公司 用于多个序列数据的聚类方法及其装置
CN104754248B (zh) * 2013-12-30 2018-05-01 浙江大华技术股份有限公司 一种获取目标快照的方法及装置
KR102240570B1 (ko) 2014-05-13 2021-04-15 삼성전자주식회사 신장 트리 생성 방법 및 장치，스테레오 매칭 방법 및 장치，업 샘플링 방법 및 장치，및 기준 픽셀 생성 방법 및 장치
KR101989878B1 (ko) * 2016-01-07 2019-06-17 한국전자통신연구원 방송 컨텐츠의 다중 특징을 활용한 장면 경계 검출 방법 및 상기 방법을 수행하는 사용자 단말
CN106067029B (zh) * 2016-05-24 2019-06-18 哈尔滨工程大学 面向数据空间的实体分类方法
US11205103B2 (en) 2016-12-09 2021-12-21 The Research Foundation for the State University Semisupervised autoencoder for sentiment analysis
CN108012202B (zh) * 2017-12-15 2020-02-14 浙江大华技术股份有限公司 视频浓缩方法、设备、计算机可读存储介质及计算机装置
CN109522374B (zh) * 2018-09-14 2020-04-17 北京三快在线科技有限公司 一种定位方法、装置、电子设备及可读存储介质
JP7007249B2 (ja) * 2018-09-28 2022-01-24 富士フイルム株式会社 画像処理装置，画像処理方法および画像処理プログラム
CN110166829A (zh) * 2019-05-15 2019-08-23 上海商汤智能科技有限公司 视频处理方法及装置、电子设备和存储介质
CN113673360B (zh) * 2021-07-28 2025-04-11 浙江大华技术股份有限公司 人体分布检测方法、航拍设备、电子装置和存储介质
CN115080793A (zh) * 2022-07-14 2022-09-20 湖南四方天箭信息科技有限公司 视频拆条方法、装置、计算机设备和存储介质

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5708767A (en) * 1995-02-03 1998-01-13 The Trustees Of Princeton University Method and apparatus for video browsing based on content and structure
US5956026A (en) * 1997-12-19 1999-09-21 Sharp Laboratories Of America, Inc. Method for hierarchical summarization and browsing of digital video
US6807306B1 (en) * 1999-05-28 2004-10-19 Xerox Corporation Time-constrained keyframe selection method
US6965645B2 (en) * 2001-09-25 2005-11-15 Microsoft Corporation Content-based characterization of video frame sequences
US20030097186A1 (en) 2001-11-13 2003-05-22 Koninklijke Philips Electronics N.V Method and apparatus for generating a stereotypical profile for recommending items of interest using feature-based clustering
US7164797B2 (en) 2002-04-25 2007-01-16 Microsoft Corporation Clustering
US7143352B2 (en) * 2002-11-01 2006-11-28 Mitsubishi Electric Research Laboratories, Inc Blind summarization of video content
GB0406512D0 (en) * 2004-03-23 2004-04-28 British Telecomm Method and system for semantically segmenting scenes of a video sequence
KR100664959B1 (ko) 2005-07-07 2007-01-04 삼성전자주식회사 이미지 클러스터링 장치 및 방법
CN101315631B (zh) * 2008-06-25 2010-06-02 中国人民解放军国防科学技术大学 一种新闻视频故事单元关联方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Eric Galmar et al., "Representation and Analysis of Video Content for Automatic Object Extraction", EURECOM Research Report RR-10-231, 23 June 2008.*

Also Published As

Publication number Publication date
JP2012523049A (ja) 2012-09-27
WO2010115056A3 (en) 2011-01-20
CA2753978C (en) 2017-02-28
CA2753978A1 (en) 2010-10-07
US8184913B2 (en) 2012-05-22
US20100254614A1 (en) 2010-10-07
EP2415256A4 (en) 2016-12-21
KR20120003447A (ko) 2012-01-10
CN102388390B (zh) 2014-05-14
CN102388390A (zh) 2012-03-21
EP2415256A2 (en) 2012-02-08
WO2010115056A2 (en) 2010-10-07
JP5404908B2 (ja) 2014-02-05

Similar Documents

Publication Publication Date Title
KR101711677B1 (ko) 위치에 의한 비디오들의 클러스터링
Zhou et al. Violence detection in surveillance video using low-level features
US10192117B2 (en) Graph-based framework for video object segmentation and extraction in feature space
CN108140032B (zh) 用于自动视频概括的设备和方法
Luo et al. Object-based analysis and interpretation of human motion in sports video sequences by dynamic Bayesian networks
US9626585B2 (en) Composition modeling for photo retrieval through geometric image segmentation
Haq et al. Video summarization techniques: a review
CN112597341B (zh) 视频检索方法及视频检索映射关系生成方法、装置
Gong et al. Machine learning for multimedia content analysis
Gong et al. Maximum entropy model-based baseball highlight detection and classification
CN111652331B (zh) 一种图像识别方法、装置和计算机可读存储介质
Sahu et al. First person video summarization using different graph representations
CN111209897A (zh) 视频处理的方法、装置和存储介质
Zhao et al. Key‐Frame Extraction Based on HSV Histogram and Adaptive Clustering
CN114332716B (zh) 视频中场景的聚类方法、装置、电子设备及存储介质
CN113963303A (zh) 图像处理方法、视频识别方法、装置、设备及存储介质
KR20150079064A (ko) 자동 태깅 시스템 및 그 방법
CN111797850A (zh) 视频分类方法、装置、存储介质及电子设备
Zhu et al. Video scene segmentation and semantic representation using a novel scheme
Doulamis Automatic 3D reconstruction from unstructured videos combining video summarization and structure from motion
Tan et al. Intelligent Multimedia Processing with Soft Computing
Marvaniya et al. Real-time video summarization on mobile
Huang et al. Accurate and robust moving-object segmentation for telepresence systems
Sun et al. Automatic annotation of web videos
Xie et al. Automatic video summarization by affinity propagation clustering and semantic content mining

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

PN2301 Change of applicant

St.27 status event code: A-3-3-R10-R13-asn-PN2301

St.27 status event code: A-3-3-R10-R11-asn-PN2301

A201 Request for examination
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

N231 Notification of change of applicant
PN2301 Change of applicant

St.27 status event code: A-3-3-R10-R13-asn-PN2301

St.27 status event code: A-3-3-R10-R11-asn-PN2301

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

FPAY Annual fee payment

Payment date: 20200129

Year of fee payment: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 6

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 7

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 8

PC1903 Unpaid annual fee

St.27 status event code: A-4-4-U10-U13-oth-PC1903

Not in force date: 20250224

Payment event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

H13 Ip right lapsed

Free format text: ST27 STATUS EVENT CODE: N-4-6-H10-H13-OTH-PC1903 (AS PROVIDED BY THE NATIONAL OFFICE); TERMINATION CATEGORY : DEFAULT_OF_REGISTRATION_FEE

Effective date: 20250224

PC1903 Unpaid annual fee

St.27 status event code: N-4-6-H10-H13-oth-PC1903

Ip right cessation event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

Not in force date: 20250224