WO1999005611A1 - Verfahren zum abspeichern von suchmerkmalen einer bildsequenz - Google Patents

Verfahren zum abspeichern von suchmerkmalen einer bildsequenz Download PDF

Info

Publication number
WO1999005611A1
WO1999005611A1 PCT/DE1998/001254 DE9801254W WO9905611A1 WO 1999005611 A1 WO1999005611 A1 WO 1999005611A1 DE 9801254 W DE9801254 W DE 9801254W WO 9905611 A1 WO9905611 A1 WO 9905611A1
Authority
WO
WIPO (PCT)
Prior art keywords
image sequence
image
search features
search
features
Prior art date
Application number
PCT/DE1998/001254
Other languages
German (de)
English (en)
French (fr)
Inventor
André KAUP
Original Assignee
Siemens Aktiengesellschaft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Aktiengesellschaft filed Critical Siemens Aktiengesellschaft
Priority to JP2000504519A priority Critical patent/JP2001511560A/ja
Priority to EP98933456A priority patent/EP0996901A1/de
Priority to KR1020007000621A priority patent/KR20010022052A/ko
Publication of WO1999005611A1 publication Critical patent/WO1999005611A1/de

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84Generation or processing of descriptive data, e.g. content descriptors
    • H04N21/8405Generation or processing of descriptive data, e.g. content descriptors represented by keywords
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/71Indexing; Data structures therefor; Storage structures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream

Definitions

  • the invention relates to a method for storing search features of an image sequence and access to the image sequence on the basis of the search features.
  • a wide range of audiovisual information (image sequences) is now stored in digitized form at various locations. In order to use this audiovisual information, it is first necessary to find the data of interest.
  • the MPEG standards for image compression are well known to the person skilled in the art.
  • An image sequence identifies a series of related images.
  • a picture scene is a real one
  • Subset of an image sequence and is introduced by an intra image defined in MPEG or ITU standards.
  • the object of the invention is to provide a method for storing search features of an image sequence / image scene and to enable access to this image sequence / image scene via these search features.
  • the method enables search features of an image sequence to be stored and access to the image sequence based on the search features, the search features being determined from the image sequence.
  • the search features are saved together with the image sequence. On the The image sequence is accessed if the search features contain predetermined information.
  • search features are audio data and / or video data of the image sequence.
  • search features which in turn contain a reference (pointer), make it possible to access an image within the image sequence.
  • the access can take place in that the reference contains a temporal offset within the image sequence and thereby references the image. This ensures access to the image.
  • the reference thus addresses the picture and thus a beginning within the picture sequence.
  • Another further development consists in storing each individual image scene in a database and thus ensuring access to the image scene.
  • An additional development consists in storing individual search features in the image sequence for individual objects defined according to the MPEG or ITU standards within the image sequence. This makes it possible to also offer entry points related to such objects and linked to the search features. It is also a further development to uniquely identify the search features by a predetermined start code (header).
  • search features are stored together with the image sequence, an extensive image database can be put together from individual such image sequences.
  • a global, preferably external, reference list on the other hand, which contains search features and corresponding references to the image sequence, complicates a modular structure of the
  • Image sequence (especially if it consists of several image sequences, which in turn are to be exported individually to other databases).
  • FIG. 1 shows a block diagram which represents a method for storing search features of an image sequence and access to the image sequence on the basis of the search features
  • FIG. 3 a sketch showing the search features and associated references that dereference image data.
  • search features are determined from the image sequence.
  • images are searched which correspond to a given sample image in whole or in part. This is achieved by first analyzing the sample image for predetermined features, in particular the predominant color or typical shapes that occur. These characteristics are stored in a database and with a pointer to the image material to be referenced, i.e. the sample image found within the image sequence.
  • the search features are stored together with the image sequence in a step 1b.
  • access to the image sequence on the basis of the search features is made possible in a step 1c by comparing a predefinable feature with the search features and, if a match has been found, jumping to the image sequence within the image sequence that is referenced by the search feature.
  • Fig.2a is an image sequence GOP (Group of Pictures, as defined in MPEG standards), which has a header H and
  • FIGS. 2a to 2b Contains image information BE.
  • a time axis t which runs vertically from top to bottom applies to all of FIGS. 2a to 2b. This indicates that it is the temporal course of an image sequence that is stored as an image sequence.
  • search features M precede the image sequence GOP.
  • the search features M are preferably stored in an easily readable form as a list in plain text (ASCII code). Long lists with search features can also be saved in compressed form.
  • a pointer PTR to an image within the image sequence is connected to each individual search feature, this image indicating the start of an image sequence which is linked to the search feature within the image sequence. Such references (pointers) are shown as arrows PTR in FIGS. 2a to 2d.
  • the search features M can, as shown in FIG. 2c, be stored within an image sequence GOP.
  • references PTR linked to the search features M must refer to image information before (in FIG. 2c above the search features M) or to image information temporally after the search features M (in FIG. 2c below the search features M).
  • An audiovisual scene can contain several search feature sets Ml, M2, M31 and M32.
  • the search feature sets Ml and M2 relate to image data BD in general, while the search feature sets M31 and M32 each contain search features, the entries (references) of which, within the image sequences separated by objects 01 and 02, refer to corresponding locations to be referenced.
  • FIG. 3 An organization of a list of search features and their relationship to the image data BD is shown in FIG. 3.
  • the search features M are prefixed in the form of a list of the image sequence GOP, which contains the header H and the image data BD.
  • the list contains several search features SM1 and SM2.
  • Each search characteristic comprises a descriptive component INF01 and INF02 and each a reference (pointer) PTR1 and PTR2 to an image within the image data BD.
  • each second search characteristic SM2J_ is preferably a first object and the other search characteristic SM ( 2i + ⁇ ) is a second

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Television Signal Processing For Recording (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
PCT/DE1998/001254 1997-07-23 1998-05-05 Verfahren zum abspeichern von suchmerkmalen einer bildsequenz WO1999005611A1 (de)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2000504519A JP2001511560A (ja) 1997-07-23 1998-05-05 画像シーケンスの検索属性を記憶する方法
EP98933456A EP0996901A1 (de) 1997-07-23 1998-05-05 Verfahren zum abspeichern von suchmerkmalen einer bildsequenz
KR1020007000621A KR20010022052A (ko) 1997-07-23 1998-05-05 이미지 시퀀스의 탐색 특성을 저장하기 위한 방법

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE19731719.7 1997-07-23
DE19731719 1997-07-23

Publications (1)

Publication Number Publication Date
WO1999005611A1 true WO1999005611A1 (de) 1999-02-04

Family

ID=7836685

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/DE1998/001254 WO1999005611A1 (de) 1997-07-23 1998-05-05 Verfahren zum abspeichern von suchmerkmalen einer bildsequenz

Country Status (5)

Country Link
EP (1) EP0996901A1 (zh)
JP (1) JP2001511560A (zh)
KR (1) KR20010022052A (zh)
CN (1) CN1271443A (zh)
WO (1) WO1999005611A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7444156B2 (en) 2001-02-20 2008-10-28 Microsoft Corporation User-tagging of cellular telephone locations

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4429081B2 (ja) * 2004-06-01 2010-03-10 キヤノン株式会社 情報処理装置及び情報処理方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5600775A (en) * 1994-08-26 1997-02-04 Emotion, Inc. Method and apparatus for annotating full motion video and other indexed data structures
EP0780777A1 (en) * 1995-12-21 1997-06-25 Hewlett-Packard Company Indexing of recordings

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06162116A (ja) * 1992-11-25 1994-06-10 Ricoh Co Ltd 動画像表示装置
JPH08130701A (ja) * 1994-10-31 1996-05-21 Sanyo Electric Co Ltd 動画像データ処理方法及び処理装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5600775A (en) * 1994-08-26 1997-02-04 Emotion, Inc. Method and apparatus for annotating full motion video and other indexed data structures
EP0780777A1 (en) * 1995-12-21 1997-06-25 Hewlett-Packard Company Indexing of recordings

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SULLOW K: "AMPHORE - EIN ARBEITSPLATZ ZUR FILMDOKUMENTATION", NACHRICHTEN FUR DOKUMENTATION, vol. 47, no. 2, March 1996 (1996-03-01), pages 67 - 74, XP000615361 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7444156B2 (en) 2001-02-20 2008-10-28 Microsoft Corporation User-tagging of cellular telephone locations

Also Published As

Publication number Publication date
JP2001511560A (ja) 2001-08-14
EP0996901A1 (de) 2000-05-03
KR20010022052A (ko) 2001-03-15
CN1271443A (zh) 2000-10-25

Similar Documents

Publication Publication Date Title
DE69432660T2 (de) Vorrichtung und verfahren zur kodierung/dekodierung von daten für untertitel
DE4428517C2 (de) Verfahren zum Behandeln eines Teiles eines komprimierten Bildes sowie Bildaufbereitungseinrichtung zur Durchführung dieses Verfahrens
DE69318629T2 (de) Übertragungsfehlerkorrektur in einem digitalen Kommunikationssystem
DE69320226T2 (de) Verfahren und Einrichtung zur Vektorkodierung von Videotransformationskoeffizienten
DE69422214T2 (de) Doppelpufferschema für die Aufbereitung von mehreren Datenströmen aus gespeicherten Daten
DE69330157T2 (de) Vorrichtung und Verfahren für die Aufzeichnung von Videosignalen
DE69609503T2 (de) Verfahren und vorrichtung zur kompression von farbvideodaten
DE69629715T2 (de) Datenkomprimierung
DE69801209T2 (de) Hierarchischer rekursiver Bewegungsschätzer für Bewegtbildkodierer
DE19743202B4 (de) Verfahren zum Codieren eines Bewegungsvektors
DE69322112T2 (de) Vorrichtung zum Multiplexen von digitalen Luminanz- und Chrominanzdaten
DE4309105A1 (de) Verfahren und Einrichtung zum Behandeln eines Teils eines verdichteten Bildes für ein Aufbereiten
WO1997043863A1 (de) Verfahren zur speicherung oder übertragung von stereoskopischen videosignalen
DE112010004844T5 (de) Videocodierung unter Verwendung von Pixeldatenströmen
DE3486243T2 (de) Elektronischer Einzelbildspeicher mit Schnellsortierung und Verfahren zu seinem Betrieb.
WO1999005611A1 (de) Verfahren zum abspeichern von suchmerkmalen einer bildsequenz
DE69709293T2 (de) Verfahren und Vorrichtung zur Kodierung und Dekodierung von Bewegtbildern
DE69418942T2 (de) Gerät zur Komprimierung und Wiedergabe von Video/Audio-Daten
EP0836785B1 (de) Verfahren zur dekodierung und kodierung eines komprimierten videodatenstroms mit reduziertem speicherbedarf
DE69228913T2 (de) Verfahren und Vorrichtung zur Kodierung eines digitalen Videosignals
EP0821531A2 (de) Codierung und Decodierung von Trickfilmen
WO2000038049A1 (de) Verfahren und anordnung zur erzeugung und ausführung von komprimierten programmen eines vliw-prozessors
DE3219892A1 (de) Verfahren zum komprimieren eines digitalisierten bildes
DE3889568T2 (de) Vorrichtung zum Aufnehmen und Wiedergeben eines digitalisierten zusammengesetzten Videosignals mit Mitteln zur Synchronisierung der Phase des Farbunterträgers.
DE3811536A1 (de) Praediktiver standbildcodierer

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 98809428.2

Country of ref document: CN

AK Designated states

Kind code of ref document: A1

Designated state(s): CN JP KR US

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 1998933456

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 1020007000621

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 09463271

Country of ref document: US

WWP Wipo information: published in national office

Ref document number: 1998933456

Country of ref document: EP

WWR Wipo information: refused in national office

Ref document number: 1998933456

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020007000621

Country of ref document: KR

WWW Wipo information: withdrawn in national office

Ref document number: 1998933456

Country of ref document: EP

WWR Wipo information: refused in national office

Ref document number: 1020007000621

Country of ref document: KR