JP4382288B2 - 画像記述システムおよび方法 - Google Patents
画像記述システムおよび方法 Download PDFInfo
- Publication number
- JP4382288B2 JP4382288B2 JP2000581582A JP2000581582A JP4382288B2 JP 4382288 B2 JP4382288 B2 JP 4382288B2 JP 2000581582 A JP2000581582 A JP 2000581582A JP 2000581582 A JP2000581582 A JP 2000581582A JP 4382288 B2 JP4382288 B2 JP 4382288B2
- Authority
- JP
- Japan
- Prior art keywords
- description
- image object
- image
- feature
- hierarchy
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000012545 processing Methods 0.000 claims abstract description 38
- 230000000007 visual effect Effects 0.000 claims description 62
- 238000000605 extraction Methods 0.000 claims description 58
- 230000033001 locomotion Effects 0.000 claims description 15
- 230000008569 process Effects 0.000 claims description 10
- 238000010276 construction Methods 0.000 claims description 6
- 230000009471 action Effects 0.000 claims description 4
- 238000013500 data storage Methods 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims 1
- 238000004883 computer application Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 13
- 239000000463 material Substances 0.000 description 7
- 230000011218 segmentation Effects 0.000 description 7
- 230000008901 benefit Effects 0.000 description 5
- 238000001914 filtration Methods 0.000 description 5
- 238000003709 image segmentation Methods 0.000 description 5
- 230000000875 corresponding effect Effects 0.000 description 4
- 230000010354 integration Effects 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000010801 machine learning Methods 0.000 description 3
- 238000012512 characterization method Methods 0.000 description 2
- 239000003795 chemical substances by application Substances 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000007175 bidirectional communication Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000003066 decision tree Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000153 supplemental effect Effects 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/93—Document management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/71—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/7837—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/7844—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using original textual content or text extracted from visual content or transcript of audio data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/30—Scenes; Scene-specific elements in albums, collections or shared content, e.g. social network photos or video
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Library & Information Science (AREA)
- Software Systems (AREA)
- General Business, Economics & Management (AREA)
- Business, Economics & Management (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Image Analysis (AREA)
- Television Signal Processing For Recording (AREA)
- Television Systems (AREA)
- Processing Or Creating Images (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Alarm Systems (AREA)
- Closed-Circuit Television Systems (AREA)
- Traffic Control Systems (AREA)
- Burglar Alarm Systems (AREA)
- Management Or Editing Of Information On Record Carriers (AREA)
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10746398P | 1998-11-06 | 1998-11-06 | |
US11802799P | 1999-02-01 | 1999-02-01 | |
US11802099P | 1999-02-01 | 1999-02-01 | |
US60/107,463 | 1999-02-01 | ||
US60/118,027 | 1999-02-01 | ||
US60/118,020 | 1999-02-01 | ||
PCT/US1999/026127 WO2000028467A1 (en) | 1998-11-06 | 1999-11-05 | Image description system and method |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2002529863A JP2002529863A (ja) | 2002-09-10 |
JP4382288B2 true JP4382288B2 (ja) | 2009-12-09 |
Family
ID=27380312
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2000581801A Pending JP2002532918A (ja) | 1998-11-06 | 1999-11-05 | 映像記述システムおよび方法 |
JP2000581582A Expired - Fee Related JP4382288B2 (ja) | 1998-11-06 | 1999-11-05 | 画像記述システムおよび方法 |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2000581801A Pending JP2002532918A (ja) | 1998-11-06 | 1999-11-05 | 映像記述システムおよび方法 |
Country Status (6)
Families Citing this family (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7185049B1 (en) * | 1999-02-01 | 2007-02-27 | At&T Corp. | Multimedia integration description scheme, method and system for MPEG-7 |
US6546135B1 (en) * | 1999-08-30 | 2003-04-08 | Mitsubishi Electric Research Laboratories, Inc | Method for representing and comparing multimedia content |
BR0107329A (pt) * | 2000-10-17 | 2002-08-27 | Koninkl Philips Electronics Nv | Processo de codificação para codificar um elemento de descrição de uma instância de um esquema tipo xml, processo de decodificação para decodificar um fragmento compreendendo um conteúdo e uma sequência de informação de identificação, codificador para codificar um elemento de descrição de uma instância de um esquema tipo xml, decodificador para decodificar um fragmento compreendendo um conteúdo e uma sequência de informação de identificação, sistema de transmissão, sinal para transmissão através de uma rede de transmissão, e, tabela destinada a ser usada em um codificador |
US7353236B2 (en) | 2001-03-21 | 2008-04-01 | Nokia Corporation | Archive system and data maintenance method |
GB0107140D0 (en) * | 2001-03-21 | 2001-05-09 | Nokia Oyj | Management and distribution of electronic media |
US7254570B2 (en) | 2001-03-21 | 2007-08-07 | Nokia Corporation | Query resolution system and service |
US6904454B2 (en) | 2001-03-21 | 2005-06-07 | Nokia Corporation | Method and apparatus for content repository with versioning and data modeling |
US7734997B2 (en) * | 2001-05-29 | 2010-06-08 | Sony Corporation | Transport hint table for synchronizing delivery time between multimedia content and multimedia content descriptions |
US6870956B2 (en) | 2001-06-14 | 2005-03-22 | Microsoft Corporation | Method and apparatus for shot detection |
US7231394B2 (en) * | 2001-07-17 | 2007-06-12 | Sony Corporation | Incremental bottom-up construction of data documents |
US7116716B2 (en) | 2002-11-01 | 2006-10-03 | Microsoft Corporation | Systems and methods for generating a motion attention model |
US7274741B2 (en) | 2002-11-01 | 2007-09-25 | Microsoft Corporation | Systems and methods for generating a comprehensive user attention model |
US7164798B2 (en) | 2003-02-18 | 2007-01-16 | Microsoft Corporation | Learning-based automatic commercial content detection |
CN100483404C (zh) * | 2003-05-12 | 2009-04-29 | 皇家飞利浦电子股份有限公司 | 用于搜索媒体对象的方法 |
JP4554280B2 (ja) * | 2003-06-12 | 2010-09-29 | マイクロソフト コーポレーション | 多重ブレンディングを利用して画像を表示するためのシステムおよび方法 |
KR100447299B1 (ko) * | 2003-07-03 | 2004-09-07 | 주식회사 휴맥스 | 디지털 방송 프로그램 정보 송신 및 수신방법 |
US7400761B2 (en) | 2003-09-30 | 2008-07-15 | Microsoft Corporation | Contrast-based image attention analysis framework |
US7471827B2 (en) | 2003-10-16 | 2008-12-30 | Microsoft Corporation | Automatic browsing path generation to present image areas with high attention value as a function of space and time |
US7600015B2 (en) * | 2004-06-28 | 2009-10-06 | Nokia Corporation | User confirmation in data downloading |
US9053754B2 (en) | 2004-07-28 | 2015-06-09 | Microsoft Technology Licensing, Llc | Thumbnail generation and presentation for recorded TV programs |
US7986372B2 (en) | 2004-08-02 | 2011-07-26 | Microsoft Corporation | Systems and methods for smart media content thumbnail extraction |
US8180826B2 (en) * | 2005-10-31 | 2012-05-15 | Microsoft Corporation | Media sharing and authoring on the web |
US7773813B2 (en) | 2005-10-31 | 2010-08-10 | Microsoft Corporation | Capture-intention detection for video content analysis |
US8196032B2 (en) | 2005-11-01 | 2012-06-05 | Microsoft Corporation | Template-based multimedia authoring and sharing |
KR100641791B1 (ko) * | 2006-02-14 | 2006-11-02 | (주)올라웍스 | 디지털 데이터에 대한 태깅 방법 및 시스템 |
US7925105B2 (en) | 2006-03-14 | 2011-04-12 | Seiko Epson Corporation | Image transfer and motion picture clipping process using outline of image |
KR100961444B1 (ko) | 2007-04-23 | 2010-06-09 | 한국전자통신연구원 | 멀티미디어 콘텐츠를 검색하는 방법 및 장치 |
CN101286351B (zh) * | 2008-05-23 | 2011-02-23 | 广州视源电子科技有限公司 | 生成流媒体增值描述文件及插播多媒体信息的方法、系统 |
CN102609958A (zh) * | 2012-01-19 | 2012-07-25 | 北京三星通信技术研究有限公司 | 视频对象提取的方法及设备 |
EP3059734A1 (en) * | 2015-02-17 | 2016-08-24 | Alcatel Lucent | Encoder/decoder |
EP3303084B1 (en) | 2015-06-03 | 2023-07-26 | Volvo Construction Equipment AB | A method and system for predicting a risk for rollover of a working machine |
EP3239896B1 (en) | 2016-04-28 | 2018-11-28 | Joanneum Research Forschungsgesellschaft mbH | Data structure for describing an image sequence, and methods for extracting and matching these data structures |
CN109934852B (zh) * | 2019-04-01 | 2022-07-12 | 重庆理工大学 | 一种基于对象属性关系图的视频描述方法 |
US11182408B2 (en) | 2019-05-21 | 2021-11-23 | Microsoft Technology Licensing, Llc | Generating and applying an object-level relational index for images |
KR20210095291A (ko) * | 2020-01-22 | 2021-08-02 | 삼성전자주식회사 | 스토리를 생성하는 전자 장치 및 그의 동작 방법 |
CN113343982B (zh) * | 2021-06-16 | 2023-07-25 | 北京百度网讯科技有限公司 | 多模态特征融合的实体关系提取方法、装置和设备 |
CN114238526B (zh) * | 2022-02-23 | 2022-06-07 | 浙江大华技术股份有限公司 | 图像聚档方法、电子设备及存储介质 |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5579444A (en) * | 1987-08-28 | 1996-11-26 | Axiom Bildverarbeitungssysteme Gmbh | Adaptive vision-based controller |
US5144685A (en) * | 1989-03-31 | 1992-09-01 | Honeywell Inc. | Landmark recognition for autonomous mobile robots |
JP2837514B2 (ja) * | 1990-06-19 | 1998-12-16 | 富士通株式会社 | 画像編集装置 |
JPH04220086A (ja) * | 1990-12-19 | 1992-08-11 | Ricoh Co Ltd | 画像データ管理方法および画像データ管理装置 |
JPH05144685A (ja) * | 1991-11-21 | 1993-06-11 | Elna Co Ltd | 固体電解コンデンサ |
JPH05250241A (ja) * | 1992-03-06 | 1993-09-28 | Nippon Telegr & Teleph Corp <Ntt> | ファイル装置 |
US5555354A (en) * | 1993-03-23 | 1996-09-10 | Silicon Graphics Inc. | Method and apparatus for navigation within three-dimensional information landscape |
JP3303543B2 (ja) * | 1993-09-27 | 2002-07-22 | インターナショナル・ビジネス・マシーンズ・コーポレーション | マルチメディア・セグメントを構成してプレイする方法、および2つ以上のマルチメディア・ストーリーをハイパーストーリーとして構成してプレイする方法 |
US5485568A (en) * | 1993-10-08 | 1996-01-16 | Xerox Corporation | Structured image (Sl) format for describing complex color raster images |
CA2117846C (en) * | 1993-10-20 | 2001-02-20 | Allen Reiter | Computer method and storage structure for storing and accessing multidimensional data |
US5821945A (en) * | 1995-02-03 | 1998-10-13 | The Trustees Of Princeton University | Method and apparatus for video browsing based on content and structure |
US5841900A (en) * | 1996-01-11 | 1998-11-24 | Xerox Corporation | Method for graph-based table recognition |
JP3265198B2 (ja) * | 1996-09-20 | 2002-03-11 | 松下電送システム株式会社 | 構造化文書作成装置、構造化文書作成方法、通信装置、および通信方法 |
JPH10187515A (ja) * | 1996-12-25 | 1998-07-21 | Nec Corp | ダウンロード装置 |
-
1999
- 1999-11-05 WO PCT/US1999/026127 patent/WO2000028467A1/en active IP Right Grant
- 1999-11-05 KR KR1020017005771A patent/KR100697106B1/ko not_active IP Right Cessation
- 1999-11-05 JP JP2000581801A patent/JP2002532918A/ja active Pending
- 1999-11-05 EP EP99971950A patent/EP1125245B1/en not_active Expired - Lifetime
- 1999-11-05 AT AT99960214T patent/ATE528912T1/de not_active IP Right Cessation
- 1999-11-05 EP EP99960214A patent/EP1147655B1/en not_active Expired - Lifetime
- 1999-11-05 AU AU17135/00A patent/AU1713500A/en not_active Abandoned
- 1999-11-05 WO PCT/US1999/026126 patent/WO2000028725A2/en active Application Filing
- 1999-11-05 AU AU12434/00A patent/AU1243400A/en not_active Abandoned
- 1999-11-05 JP JP2000581582A patent/JP4382288B2/ja not_active Expired - Fee Related
- 1999-11-05 KR KR1020017005773A patent/KR100734964B1/ko not_active IP Right Cessation
- 1999-11-05 AT AT99971950T patent/ATE540364T1/de active
Also Published As
Publication number | Publication date |
---|---|
EP1125245B1 (en) | 2012-01-04 |
EP1147655A4 (en) | 2004-04-14 |
JP2002529863A (ja) | 2002-09-10 |
KR100734964B1 (ko) | 2007-07-03 |
KR20020006624A (ko) | 2002-01-23 |
AU1713500A (en) | 2000-05-29 |
KR100697106B1 (ko) | 2007-03-21 |
WO2000028725A2 (en) | 2000-05-18 |
WO2000028725A3 (en) | 2000-07-13 |
EP1147655A2 (en) | 2001-10-24 |
ATE540364T1 (de) | 2012-01-15 |
WO2000028467A1 (en) | 2000-05-18 |
ATE528912T1 (de) | 2011-10-15 |
EP1125245A1 (en) | 2001-08-22 |
EP1147655B1 (en) | 2011-10-12 |
KR20020006623A (ko) | 2002-01-23 |
EP1125245A4 (en) | 2004-04-14 |
JP2002532918A (ja) | 2002-10-02 |
AU1243400A (en) | 2000-05-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4382288B2 (ja) | 画像記述システムおよび方法 | |
US7254285B1 (en) | Image description system and method | |
US8370869B2 (en) | Video description system and method | |
US7653635B1 (en) | Systems and methods for interoperable multimedia content descriptions | |
US9507779B2 (en) | Multimedia integration description scheme, method and system for MPEG-7 | |
Salembier et al. | MPEG-7 multimedia description schemes | |
Li et al. | Multimedia content description in the InfoPyramid | |
US10311094B2 (en) | Synthetic audiovisual description scheme, method and system for MPEG-7 | |
Benitez et al. | Object-based multimedia content description schemes and applications for MPEG-7 | |
Chang et al. | Exploring image functionalities in WWW applications development of image/video search and editing engines | |
AT&T | ||
Vakali et al. | Mpeg-7 based description schemes for multi-level video content classification | |
Di Bono et al. | WP9: A review of data and metadata standards and techniques for representation of multimedia content | |
MXPA01004561A (en) | Systems and methods for interoperable multimediacontent descriptions | |
Smith | Interoperable Content-based Access of Multimedia in Digital Libraries | |
Paek et al. | Proposal Id: P480 Proposal for MPEG-7 Image Description Scheme Name | |
Lyu et al. | Architecture & Data Management of XML-Based Digital Video Library |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20060915 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20090120 |
|
A601 | Written request for extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A601 Effective date: 20090414 |
|
A602 | Written permission of extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A602 Effective date: 20090421 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20090717 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20090825 |
|
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20090917 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20121002 Year of fee payment: 3 |
|
R150 | Certificate of patent or registration of utility model |
Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20131002 Year of fee payment: 4 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
LAPS | Cancellation because of no payment of annual fees |