JP4382288B2 - 画像記述システムおよび方法 - Google Patents

画像記述システムおよび方法 Download PDF

Info

Publication number
JP4382288B2
JP4382288B2 JP2000581582A JP2000581582A JP4382288B2 JP 4382288 B2 JP4382288 B2 JP 4382288B2 JP 2000581582 A JP2000581582 A JP 2000581582A JP 2000581582 A JP2000581582 A JP 2000581582A JP 4382288 B2 JP4382288 B2 JP 4382288B2
Authority
JP
Japan
Prior art keywords
description
image object
image
feature
hierarchy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2000581582A
Other languages
English (en)
Japanese (ja)
Other versions
JP2002529863A (ja
Inventor
パイク，セウンユップ
ベニテス，アナ
チャン，シー−フ
リ，チュン−シェン
スミス，ジョン，アール．
バーグマン，ローレンス，ディー．
プリ，アトゥル
ファン，チァン
ファン，リアン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of JP2002529863A publication Critical patent/JP2002529863A/ja
Application granted granted Critical
Publication of JP4382288B2 publication Critical patent/JP4382288B2/ja
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/93—Document management systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/71—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7837—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7844—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using original textual content or text extracted from visual content or transcript of audio data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/30—Scenes; Scene-specific elements in albums, collections or shared content, e.g. social network photos or video

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • Business, Economics & Management (AREA)
  • Software Systems (AREA)
  • General Business, Economics & Management (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Image Analysis (AREA)
  • Television Signal Processing For Recording (AREA)
  • Processing Or Creating Images (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Television Systems (AREA)
  • Alarm Systems (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Traffic Control Systems (AREA)
  • Burglar Alarm Systems (AREA)
JP2000581582A 1998-11-06 1999-11-05 画像記述システムおよび方法 Expired - Fee Related JP4382288B2 (ja)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US10746398P 1998-11-06 1998-11-06
US60/107,463 1998-11-06
US11802799P 1999-02-01 1999-02-01
US11802099P 1999-02-01 1999-02-01
US60/118,020 1999-02-01
US60/118,027 1999-02-01
PCT/US1999/026127 WO2000028467A1 (en) 1998-11-06 1999-11-05 Image description system and method

Publications (2)

Publication Number Publication Date
JP2002529863A JP2002529863A (ja) 2002-09-10
JP4382288B2 true JP4382288B2 (ja) 2009-12-09

Family

ID=27380312

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2000581582A Expired - Fee Related JP4382288B2 (ja) 1998-11-06 1999-11-05 画像記述システムおよび方法
JP2000581801A Pending JP2002532918A (ja) 1998-11-06 1999-11-05 映像記述システムおよび方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2000581801A Pending JP2002532918A (ja) 1998-11-06 1999-11-05 映像記述システムおよび方法

Country Status (6)

Country Link
EP (2) EP1147655B1 (enExample)
JP (2) JP4382288B2 (enExample)
KR (2) KR100734964B1 (enExample)
AT (2) ATE528912T1 (enExample)
AU (2) AU1713500A (enExample)
WO (2) WO2000028725A2 (enExample)

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7185049B1 (en) 1999-02-01 2007-02-27 At&T Corp. Multimedia integration description scheme, method and system for MPEG-7
US6546135B1 (en) * 1999-08-30 2003-04-08 Mitsubishi Electric Research Laboratories, Inc Method for representing and comparing multimedia content
JP4405146B2 (ja) * 2000-10-17 2010-01-27 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Ｍｐｅｇ−７インスタンス用の二進フォーマット
GB0107140D0 (en) * 2001-03-21 2001-05-09 Nokia Oyj Management and distribution of electronic media
US7353236B2 (en) 2001-03-21 2008-04-01 Nokia Corporation Archive system and data maintenance method
US6904454B2 (en) 2001-03-21 2005-06-07 Nokia Corporation Method and apparatus for content repository with versioning and data modeling
US7254570B2 (en) 2001-03-21 2007-08-07 Nokia Corporation Query resolution system and service
US7734997B2 (en) * 2001-05-29 2010-06-08 Sony Corporation Transport hint table for synchronizing delivery time between multimedia content and multimedia content descriptions
US6870956B2 (en) 2001-06-14 2005-03-22 Microsoft Corporation Method and apparatus for shot detection
US7231394B2 (en) * 2001-07-17 2007-06-12 Sony Corporation Incremental bottom-up construction of data documents
US7116716B2 (en) 2002-11-01 2006-10-03 Microsoft Corporation Systems and methods for generating a motion attention model
US7274741B2 (en) 2002-11-01 2007-09-25 Microsoft Corporation Systems and methods for generating a comprehensive user attention model
US7164798B2 (en) 2003-02-18 2007-01-16 Microsoft Corporation Learning-based automatic commercial content detection
US20060218184A1 (en) * 2003-05-12 2006-09-28 Scholl Holger R Method of searching for media objects
EP1489591B1 (en) * 2003-06-12 2016-12-07 Microsoft Technology Licensing, LLC System and method for displaying images utilizing multi-blending
KR100447299B1 (ko) * 2003-07-03 2004-09-07 주식회사 휴맥스 디지털 방송 프로그램 정보 송신 및 수신방법
US7400761B2 (en) 2003-09-30 2008-07-15 Microsoft Corporation Contrast-based image attention analysis framework
US7471827B2 (en) 2003-10-16 2008-12-30 Microsoft Corporation Automatic browsing path generation to present image areas with high attention value as a function of space and time
US7600015B2 (en) 2004-06-28 2009-10-06 Nokia Corporation User confirmation in data downloading
US9053754B2 (en) 2004-07-28 2015-06-09 Microsoft Technology Licensing, Llc Thumbnail generation and presentation for recorded TV programs
US7986372B2 (en) 2004-08-02 2011-07-26 Microsoft Corporation Systems and methods for smart media content thumbnail extraction
US7773813B2 (en) 2005-10-31 2010-08-10 Microsoft Corporation Capture-intention detection for video content analysis
US8180826B2 (en) 2005-10-31 2012-05-15 Microsoft Corporation Media sharing and authoring on the web
US8196032B2 (en) 2005-11-01 2012-06-05 Microsoft Corporation Template-based multimedia authoring and sharing
US7599918B2 (en) 2005-12-29 2009-10-06 Microsoft Corporation Dynamic search with implicit user intention mining
KR100641791B1 (ko) * 2006-02-14 2006-11-02 (주)올라웍스 디지털 데이터에 대한 태깅 방법 및 시스템
US7925105B2 (en) 2006-03-14 2011-04-12 Seiko Epson Corporation Image transfer and motion picture clipping process using outline of image
KR100961444B1 (ko) 2007-04-23 2010-06-09 한국전자통신연구원 멀티미디어 콘텐츠를 검색하는 방법 및 장치
CN101286351B (zh) * 2008-05-23 2011-02-23 广州视源电子科技有限公司 生成流媒体增值描述文件及插播多媒体信息的方法、系统
CN102609958A (zh) * 2012-01-19 2012-07-25 北京三星通信技术研究有限公司 视频对象提取的方法及设备
EP3059734A1 (en) * 2015-02-17 2016-08-24 Alcatel Lucent Encoder/decoder
US10821992B2 (en) 2015-06-03 2020-11-03 Volvo Construction Equipment Ab Method and system for predicting a risk for rollover of a working machine
EP3414679A1 (en) * 2016-02-11 2018-12-19 Carrier Corporation Video searching using multiple query terms
EP3239896B1 (en) 2016-04-28 2018-11-28 Joanneum Research Forschungsgesellschaft mbH Data structure for describing an image sequence, and methods for extracting and matching these data structures
WO2020197257A1 (ko) 2019-03-25 2020-10-01 김현진 가시적 표현 요소를 이용한 번역 방법 및 그 장치
CN109934852B (zh) * 2019-04-01 2022-07-12 重庆理工大学 一种基于对象属性关系图的视频描述方法
US11182408B2 (en) * 2019-05-21 2021-11-23 Microsoft Technology Licensing, Llc Generating and applying an object-level relational index for images
KR102807431B1 (ko) * 2020-01-22 2025-05-15 삼성전자 주식회사 스토리를 생성하는 전자 장치 및 그의 동작 방법
CN113343982B (zh) * 2021-06-16 2023-07-25 北京百度网讯科技有限公司 多模态特征融合的实体关系提取方法、装置和设备
CN114238526B (zh) * 2022-02-23 2022-06-07 浙江大华技术股份有限公司 图像聚档方法、电子设备及存储介质
CN119227816B (zh) * 2024-12-03 2025-04-18 江西师范大学 一种基于大语言模型的图像描述文本生成方法

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5579444A (en) * 1987-08-28 1996-11-26 Axiom Bildverarbeitungssysteme Gmbh Adaptive vision-based controller
US5144685A (en) * 1989-03-31 1992-09-01 Honeywell Inc. Landmark recognition for autonomous mobile robots
JP2837514B2 (ja) * 1990-06-19 1998-12-16 富士通株式会社 画像編集装置
JPH04220086A (ja) * 1990-12-19 1992-08-11 Ricoh Co Ltd 画像データ管理方法および画像データ管理装置
JPH05144685A (ja) * 1991-11-21 1993-06-11 Elna Co Ltd 固体電解コンデンサ
JPH05250241A (ja) * 1992-03-06 1993-09-28 Nippon Telegr & Teleph Corp <Ntt> ファイル装置
US5555354A (en) * 1993-03-23 1996-09-10 Silicon Graphics Inc. Method and apparatus for navigation within three-dimensional information landscape
JP3303543B2 (ja) * 1993-09-27 2002-07-22 インターナショナル・ビジネス・マシーンズ・コーポレーション マルチメディア・セグメントを構成してプレイする方法、および２つ以上のマルチメディア・ストーリーをハイパーストーリーとして構成してプレイする方法
US5485568A (en) * 1993-10-08 1996-01-16 Xerox Corporation Structured image (Sl) format for describing complex color raster images
CA2117846C (en) * 1993-10-20 2001-02-20 Allen Reiter Computer method and storage structure for storing and accessing multidimensional data
US5821945A (en) * 1995-02-03 1998-10-13 The Trustees Of Princeton University Method and apparatus for video browsing based on content and structure
US5841900A (en) * 1996-01-11 1998-11-24 Xerox Corporation Method for graph-based table recognition
JP3265198B2 (ja) * 1996-09-20 2002-03-11 松下電送システム株式会社 構造化文書作成装置、構造化文書作成方法、通信装置、および通信方法
JPH10187515A (ja) * 1996-12-25 1998-07-21 Nec Corp ダウンロード装置

Also Published As

Publication number Publication date
KR100697106B1 (ko) 2007-03-21
EP1125245B1 (en) 2012-01-04
AU1713500A (en) 2000-05-29
JP2002532918A (ja) 2002-10-02
EP1125245A1 (en) 2001-08-22
JP2002529863A (ja) 2002-09-10
WO2000028467A1 (en) 2000-05-18
AU1243400A (en) 2000-05-29
KR20020006624A (ko) 2002-01-23
WO2000028725A2 (en) 2000-05-18
EP1125245A4 (en) 2004-04-14
KR20020006623A (ko) 2002-01-23
ATE540364T1 (de) 2012-01-15
KR100734964B1 (ko) 2007-07-03
ATE528912T1 (de) 2011-10-15
EP1147655B1 (en) 2011-10-12
EP1147655A4 (en) 2004-04-14
WO2000028725A3 (en) 2000-07-13
EP1147655A2 (en) 2001-10-24

Similar Documents

Publication Publication Date Title
JP4382288B2 (ja) 画像記述システムおよび方法
US7254285B1 (en) Image description system and method
US8370869B2 (en) Video description system and method
US7653635B1 (en) Systems and methods for interoperable multimedia content descriptions
US9507779B2 (en) Multimedia integration description scheme, method and system for MPEG-7
Salembier et al. MPEG-7 multimedia description schemes
Li et al. Multimedia content description in the InfoPyramid
US10311094B2 (en) Synthetic audiovisual description scheme, method and system for MPEG-7
Vakali et al. Mpeg-7 based description schemes for multi-level video content classification
Chang et al. Exploring image functionalities in WWW applications development of image/video search and editing engines
Spaniol et al. Imagesemantics: user-generated metadata, content based retrieval & beyond
Di Bono et al. WP9: A review of data and metadata standards and techniques for representation of multimedia content
MXPA01004561A (en) Systems and methods for interoperable multimediacontent descriptions
Smith et al. Interoperable Content-based Access of Multimedia in Digital Libraries
Paek et al. Proposal Id: P480 Proposal for MPEG-7 Image Description Scheme Name
Lyu et al. Architecture & Data Management of XML-Based Digital Video Library

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20060915

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20090120

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20090414

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20090421

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20090717

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20090825

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20090917

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20121002

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20131002

Year of fee payment: 4

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees