KR100697106B1 - 이미지 디스크립션 시스템 및 방법 - Google Patents

이미지 디스크립션 시스템 및 방법 Download PDF

Info

Publication number
KR100697106B1
KR100697106B1 KR1020017005771A KR20017005771A KR100697106B1 KR 100697106 B1 KR100697106 B1 KR 100697106B1 KR 1020017005771 A KR1020017005771 A KR 1020017005771A KR 20017005771 A KR20017005771 A KR 20017005771A KR 100697106 B1 KR100697106 B1 KR 100697106B1
Authority
KR
South Korea
Prior art keywords
descriptions
image
image object
relationships
feature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
KR1020017005771A
Other languages
English (en)
Korean (ko)
Other versions
KR20020006623A (ko
Inventor
백승엽
베니테즈아나
창시푸
리청쉥
스미스존알.
베르그만로렌스디.
푸리애털
황퀴앙
쥬디스찰리
Original Assignee
더 트러스티스 오브 콜롬비아 유니버시티 인 더 시티 오브 뉴욕
인터내셔널 비즈니스 머신즈 코오퍼레이션
에이티 앤 티
이스트맨 코닥
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 더 트러스티스 오브 콜롬비아 유니버시티 인 더 시티 오브 뉴욕, 인터내셔널 비즈니스 머신즈 코오퍼레이션, 에이티 앤 티, 이스트맨 코닥 filed Critical 더 트러스티스 오브 콜롬비아 유니버시티 인 더 시티 오브 뉴욕
Publication of KR20020006623A publication Critical patent/KR20020006623A/ko
Application granted granted Critical
Publication of KR100697106B1 publication Critical patent/KR100697106B1/ko
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/93—Document management systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/71—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7837—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7844—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using original textual content or text extracted from visual content or transcript of audio data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/30—Scenes; Scene-specific elements in albums, collections or shared content, e.g. social network photos or video

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • Business, Economics & Management (AREA)
  • Software Systems (AREA)
  • General Business, Economics & Management (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Image Analysis (AREA)
  • Television Signal Processing For Recording (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Television Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)
  • Alarm Systems (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Traffic Control Systems (AREA)
  • Burglar Alarm Systems (AREA)
KR1020017005771A 1998-11-06 1999-11-05 이미지 디스크립션 시스템 및 방법 Expired - Fee Related KR100697106B1 (ko)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US10746398P 1998-11-06 1998-11-06
US60/107,463 1998-11-06
US11802099P 1999-02-01 1999-02-01
US11802799P 1999-02-01 1999-02-01
US60/118,020 1999-02-01
US60/118,027 1999-02-01

Publications (2)

Publication Number Publication Date
KR20020006623A KR20020006623A (ko) 2002-01-23
KR100697106B1 true KR100697106B1 (ko) 2007-03-21

Family

ID=27380312

Family Applications (2)

Application Number Title Priority Date Filing Date
KR1020017005771A Expired - Fee Related KR100697106B1 (ko) 1998-11-06 1999-11-05 이미지 디스크립션 시스템 및 방법
KR1020017005773A Expired - Fee Related KR100734964B1 (ko) 1998-11-06 1999-11-05 비디오 디스크립션 시스템 및 방법

Family Applications After (1)

Application Number Title Priority Date Filing Date
KR1020017005773A Expired - Fee Related KR100734964B1 (ko) 1998-11-06 1999-11-05 비디오 디스크립션 시스템 및 방법

Country Status (6)

Country Link
EP (2) EP1147655B1 (enExample)
JP (2) JP4382288B2 (enExample)
KR (2) KR100697106B1 (enExample)
AT (2) ATE540364T1 (enExample)
AU (2) AU1713500A (enExample)
WO (2) WO2000028725A2 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12182527B2 (en) 2019-03-25 2024-12-31 Hyun Jin Kim Translating method using visually represented elements, and device therefor

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7185049B1 (en) 1999-02-01 2007-02-27 At&T Corp. Multimedia integration description scheme, method and system for MPEG-7
US6546135B1 (en) * 1999-08-30 2003-04-08 Mitsubishi Electric Research Laboratories, Inc Method for representing and comparing multimedia content
WO2002033977A1 (en) * 2000-10-17 2002-04-25 Koninklijke Philips Electronics N.V. Binary format for mpeg-7 instances
US7353236B2 (en) 2001-03-21 2008-04-01 Nokia Corporation Archive system and data maintenance method
GB0107140D0 (en) * 2001-03-21 2001-05-09 Nokia Oyj Management and distribution of electronic media
US7254570B2 (en) 2001-03-21 2007-08-07 Nokia Corporation Query resolution system and service
US6904454B2 (en) 2001-03-21 2005-06-07 Nokia Corporation Method and apparatus for content repository with versioning and data modeling
US7734997B2 (en) * 2001-05-29 2010-06-08 Sony Corporation Transport hint table for synchronizing delivery time between multimedia content and multimedia content descriptions
US6870956B2 (en) 2001-06-14 2005-03-22 Microsoft Corporation Method and apparatus for shot detection
US7231394B2 (en) * 2001-07-17 2007-06-12 Sony Corporation Incremental bottom-up construction of data documents
US7274741B2 (en) 2002-11-01 2007-09-25 Microsoft Corporation Systems and methods for generating a comprehensive user attention model
US7116716B2 (en) 2002-11-01 2006-10-03 Microsoft Corporation Systems and methods for generating a motion attention model
US7164798B2 (en) 2003-02-18 2007-01-16 Microsoft Corporation Learning-based automatic commercial content detection
KR20060020624A (ko) * 2003-05-12 2006-03-06 코닌클리케 필립스 일렉트로닉스 엔.브이. 미디어 오브젝트들의 검색 방법
EP1489591B1 (en) * 2003-06-12 2016-12-07 Microsoft Technology Licensing, LLC System and method for displaying images utilizing multi-blending
KR100447299B1 (ko) * 2003-07-03 2004-09-07 주식회사 휴맥스 디지털 방송 프로그램 정보 송신 및 수신방법
US7400761B2 (en) 2003-09-30 2008-07-15 Microsoft Corporation Contrast-based image attention analysis framework
US7471827B2 (en) 2003-10-16 2008-12-30 Microsoft Corporation Automatic browsing path generation to present image areas with high attention value as a function of space and time
US7600015B2 (en) * 2004-06-28 2009-10-06 Nokia Corporation User confirmation in data downloading
US9053754B2 (en) 2004-07-28 2015-06-09 Microsoft Technology Licensing, Llc Thumbnail generation and presentation for recorded TV programs
US7986372B2 (en) 2004-08-02 2011-07-26 Microsoft Corporation Systems and methods for smart media content thumbnail extraction
US8180826B2 (en) 2005-10-31 2012-05-15 Microsoft Corporation Media sharing and authoring on the web
US7773813B2 (en) 2005-10-31 2010-08-10 Microsoft Corporation Capture-intention detection for video content analysis
US8196032B2 (en) 2005-11-01 2012-06-05 Microsoft Corporation Template-based multimedia authoring and sharing
US7599918B2 (en) 2005-12-29 2009-10-06 Microsoft Corporation Dynamic search with implicit user intention mining
KR100641791B1 (ko) * 2006-02-14 2006-11-02 (주)올라웍스 디지털 데이터에 대한 태깅 방법 및 시스템
US7925105B2 (en) 2006-03-14 2011-04-12 Seiko Epson Corporation Image transfer and motion picture clipping process using outline of image
KR100961444B1 (ko) 2007-04-23 2010-06-09 한국전자통신연구원 멀티미디어 콘텐츠를 검색하는 방법 및 장치
CN101286351B (zh) * 2008-05-23 2011-02-23 广州视源电子科技有限公司 生成流媒体增值描述文件及插播多媒体信息的方法、系统
CN102609958A (zh) * 2012-01-19 2012-07-25 北京三星通信技术研究有限公司 视频对象提取的方法及设备
EP3059734A1 (en) * 2015-02-17 2016-08-24 Alcatel Lucent Encoder/decoder
US10821992B2 (en) 2015-06-03 2020-11-03 Volvo Construction Equipment Ab Method and system for predicting a risk for rollover of a working machine
US11294957B2 (en) * 2016-02-11 2022-04-05 Carrier Corporation Video searching using multiple query terms
EP3239896B1 (en) 2016-04-28 2018-11-28 Joanneum Research Forschungsgesellschaft mbH Data structure for describing an image sequence, and methods for extracting and matching these data structures
CN109934852B (zh) * 2019-04-01 2022-07-12 重庆理工大学 一种基于对象属性关系图的视频描述方法
US11182408B2 (en) * 2019-05-21 2021-11-23 Microsoft Technology Licensing, Llc Generating and applying an object-level relational index for images
KR102807431B1 (ko) * 2020-01-22 2025-05-15 삼성전자 주식회사 스토리를 생성하는 전자 장치 및 그의 동작 방법
CN113343982B (zh) * 2021-06-16 2023-07-25 北京百度网讯科技有限公司 多模态特征融合的实体关系提取方法、装置和设备
CN114238526B (zh) * 2022-02-23 2022-06-07 浙江大华技术股份有限公司 图像聚档方法、电子设备及存储介质
CN119227816B (zh) * 2024-12-03 2025-04-18 江西师范大学 一种基于大语言模型的图像描述文本生成方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5144685A (en) * 1989-03-31 1992-09-01 Honeywell Inc. Landmark recognition for autonomous mobile robots
JPH05144685A (ja) * 1991-11-21 1993-06-11 Elna Co Ltd 固体電解コンデンサ
US5579444A (en) * 1987-08-28 1996-11-26 Axiom Bildverarbeitungssysteme Gmbh Adaptive vision-based controller

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2837514B2 (ja) * 1990-06-19 1998-12-16 富士通株式会社 画像編集装置
JPH04220086A (ja) * 1990-12-19 1992-08-11 Ricoh Co Ltd 画像データ管理方法および画像データ管理装置
JPH05250241A (ja) * 1992-03-06 1993-09-28 Nippon Telegr & Teleph Corp <Ntt> ファイル装置
US5555354A (en) * 1993-03-23 1996-09-10 Silicon Graphics Inc. Method and apparatus for navigation within three-dimensional information landscape
JP3303543B2 (ja) * 1993-09-27 2002-07-22 インターナショナル・ビジネス・マシーンズ・コーポレーション マルチメディア・セグメントを構成してプレイする方法、および２つ以上のマルチメディア・ストーリーをハイパーストーリーとして構成してプレイする方法
US5485568A (en) * 1993-10-08 1996-01-16 Xerox Corporation Structured image (Sl) format for describing complex color raster images
CA2117846C (en) * 1993-10-20 2001-02-20 Allen Reiter Computer method and storage structure for storing and accessing multidimensional data
US5821945A (en) * 1995-02-03 1998-10-13 The Trustees Of Princeton University Method and apparatus for video browsing based on content and structure
US5841900A (en) * 1996-01-11 1998-11-24 Xerox Corporation Method for graph-based table recognition
JP3265198B2 (ja) * 1996-09-20 2002-03-11 松下電送システム株式会社 構造化文書作成装置、構造化文書作成方法、通信装置、および通信方法
JPH10187515A (ja) * 1996-12-25 1998-07-21 Nec Corp ダウンロード装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5579444A (en) * 1987-08-28 1996-11-26 Axiom Bildverarbeitungssysteme Gmbh Adaptive vision-based controller
US5144685A (en) * 1989-03-31 1992-09-01 Honeywell Inc. Landmark recognition for autonomous mobile robots
JPH05144685A (ja) * 1991-11-21 1993-06-11 Elna Co Ltd 固体電解コンデンサ

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
05144685
05579444

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12182527B2 (en) 2019-03-25 2024-12-31 Hyun Jin Kim Translating method using visually represented elements, and device therefor

Also Published As

Publication number Publication date
JP2002529863A (ja) 2002-09-10
JP4382288B2 (ja) 2009-12-09
WO2000028725A2 (en) 2000-05-18
ATE528912T1 (de) 2011-10-15
KR20020006624A (ko) 2002-01-23
AU1243400A (en) 2000-05-29
ATE540364T1 (de) 2012-01-15
EP1125245A1 (en) 2001-08-22
AU1713500A (en) 2000-05-29
EP1147655B1 (en) 2011-10-12
EP1125245B1 (en) 2012-01-04
EP1147655A2 (en) 2001-10-24
EP1147655A4 (en) 2004-04-14
EP1125245A4 (en) 2004-04-14
JP2002532918A (ja) 2002-10-02
WO2000028467A1 (en) 2000-05-18
KR100734964B1 (ko) 2007-07-03
KR20020006623A (ko) 2002-01-23
WO2000028725A3 (en) 2000-07-13

Similar Documents

Publication Publication Date Title
KR100697106B1 (ko) 이미지 디스크립션 시스템 및 방법
US7254285B1 (en) Image description system and method
US8370869B2 (en) Video description system and method
KR100605463B1 (ko) 상호 운용 멀티미디어 컨텐츠 설명 시스템 및 방법
Salembier et al. MPEG-7 multimedia description schemes
Li et al. Multimedia content description in the InfoPyramid
US7506024B2 (en) Multimedia integration description scheme, method and system for MPEG-7
Dönderler et al. BilVideo: Design and implementation of a video database management system
Paek et al. Self-describing schemes for interoperable MPEG-7 multimedia content descriptions
Vakali et al. Mpeg-7 based description schemes for multi-level video content classification
Chang et al. Exploring image functionalities in WWW applications development of image/video search and editing engines
Spaniol et al. Imagesemantics: user-generated metadata, content based retrieval & beyond
MXPA01004561A (en) Systems and methods for interoperable multimediacontent descriptions
Paek et al. Proposal Id: P480 Proposal for MPEG-7 Image Description Scheme Name
Grana et al. Video clip clustering for assisted creation of mpeg-7 pictorially enriched ontologies
Ishikawa et al. An extended object-oriented approach to a multimedia database system for networked applications
Chalhoub et al. A multimedia meta-database model for distributed MultiMedia DBMS.
Kao Parallel and Distributed Multimedia Database Systems
Chang MPEG-7: standard metadata for multimedia content
Query Visual Information Retrieval from Large Distributed On-line Repositories
MEQUANINT SIMILARITY-BASED VIDEO RETRIEVAL: MODELING AND PROCESSING

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

R17-X000 Change to representative recorded

St.27 status event code: A-3-3-R10-R17-oth-X000

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

T13-X000 Administrative time limit extension granted

St.27 status event code: U-3-3-T10-T13-oth-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

R18-X000 Changes to party contact information recorded

St.27 status event code: A-3-3-R10-R18-oth-X000

A201 Request for examination
PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PN2301 Change of applicant

St.27 status event code: A-3-3-R10-R13-asn-PN2301

St.27 status event code: A-3-3-R10-R11-asn-PN2301

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

FPAY Annual fee payment

Payment date: 20120321

Year of fee payment: 6

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 6

FPAY Annual fee payment

Payment date: 20130226

Year of fee payment: 7

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 7

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000

LAPS Lapse due to unpaid annual fee
PC1903 Unpaid annual fee

St.27 status event code: A-4-4-U10-U13-oth-PC1903

Not in force date: 20140314

Payment event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

PC1903 Unpaid annual fee

St.27 status event code: N-4-6-H10-H13-oth-PC1903

Ip right cessation event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

Not in force date: 20140314

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000