EP1446956A2 - Procede et dispositif de production de signaux acoustiques a partir d'un flux de donnees video - Google Patents

Procede et dispositif de production de signaux acoustiques a partir d'un flux de donnees video

Info

Publication number
EP1446956A2
EP1446956A2 EP02790332A EP02790332A EP1446956A2 EP 1446956 A2 EP1446956 A2 EP 1446956A2 EP 02790332 A EP02790332 A EP 02790332A EP 02790332 A EP02790332 A EP 02790332A EP 1446956 A2 EP1446956 A2 EP 1446956A2
Authority
EP
European Patent Office
Prior art keywords
vector field
motion vector
vfd
chs
img
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP02790332A
Other languages
German (de)
English (en)
Inventor
Markus Simon
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Original Assignee
Siemens AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG filed Critical Siemens AG
Priority to EP02790332A priority Critical patent/EP1446956A2/fr
Publication of EP1446956A2 publication Critical patent/EP1446956A2/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440236Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368Multiplexing of audio and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341Demultiplexing of audio and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N2007/145Handheld terminals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/144Movement detection
    • H04N5/145Movement estimation

Definitions

  • the invention relates to the generation of signals - in particular acoustic signals - from a video data stream which contains a chronological sequence of individual images.
  • the conversion of movement information into acoustic signals is e.g. known in the form of an acoustic motion detector. For example, this takes a picture using a video camera and triggers a signal, such as an acoustic alarm as soon as the picture changes.
  • a movement elder delivers a constant signal;
  • the acoustic signal can be changed by dividing the examined image area into fields, each of which is assigned a different signal. In cases where e.g. if an object moving relative to a background is to be monitored, motion detectors of this type naturally fail.
  • the generation of sounds depending on movements is also used in the fields of the performing arts.
  • the body movements performed by a person are interpreted and used to control sound generation.
  • the person performing can shape the music rhythm and theme through their movements.
  • the interaction between movements and sounds is a creative process that encourages the person to create more and more sound sequences through new movements.
  • the generation of a sound is usually based on the fact that the person responds to sensors during their movements, for example in the manner of a motion detector or a light barrier, the signals from the sensors are processed by a data processing system, and sounds associated with the sensors are generated in this way.
  • these sound generations are based on quite complex installations that receive their visual input via several recording facilities and are also installed in a fixed position during operation.
  • Such a sound generation should be able to be integrated, in particular, as a function of a cell phone with a built-in camera.
  • This object is achieved according to the invention by a method of the type mentioned at the outset with the following steps: a) determining a motion vector field from the image data of a single image with the aid of the image data of previous and / or subsequent individual images, b) deriving at least one characteristic variable from the motion vector field, and c ) Generating an acoustic signal depending on the characteristic variable (s).
  • a device with a control device with a means for determining a motion vector field from the image data of a single image with the aid of the image data of preceding and / or subsequent individual images is suitable for the method according to the invention, the control device additionally being used to derive at least one characteristic variable from the motion vector field and to generate it an acoustic signal is set up as a function of the at least one characteristic variable (s).
  • the solution according to the invention provides a generation of sounds or acoustic signals, which is based not only on the presence of movements, but also on the size and / or direction of the recorded movements. There- a differentiated design of the generated sound can be achieved. In the case of monitoring, this enables, for example, differentiated monitoring of an image area via acoustic signals, which among other things enables the differentiation of different movement sequences.
  • the solution according to the invention is implemented on the part of a telecommunication terminal, in particular a mobile telephone. Since functions for image processing are often already provided in mobile telephones, implementation of the invention is possible there in a particularly inexpensive and compact manner.
  • the video data stream can advantageously be generated by a camera device of the terminal.
  • the acoustic signals can be output via a
  • Listening device of the terminal or via a telecommunications connection existing with the terminal Listening device of the terminal or via a telecommunications connection existing with the terminal.
  • step a) it is advantageous, in particular in the case of a cell phone, if the motion vector field is determined in step a) by means of an MPEG encoder method known per se.
  • An easy-to-implement evaluation of the motion vector field in step b) is that, e.g. using statistical methods, a distribution is derived and statistical parameters are determined for this distribution, from which the at least one characteristic variable is determined.
  • FIG. 1 a front view of a mobile telephone according to the exemplary embodiment
  • Fig. 2 is a rear view of the mobile phone of Fig. 1;
  • Fig. 3 is a block diagram of the mobile phone of Fig. 1;
  • Figure 4 is a block diagram of an MPEG encoder.
  • FIG. 6 shows a movement histogram derived from the vector field of FIG. 5.
  • FIG. 1 and 2 show a mobile phone MOG which, according to the invention, converts movement recorded from the surroundings into acoustic signals (“acoustic kaleidoscope *).
  • the features of the MOG telephone which are visible on the housing, are a microphone MIC, a loudspeaker LSP and an input field EIN (e.g. a keyboard) for entering operator commands and telephone numbers, as well as an output DIS in the form of a screen, e.g. an LCD display on which a video image can be displayed.
  • the video image img comes in particular from a camera module CAM located on the back (FIG. 2), which is used to record images from the environment and feed them to the image data processing according to the invention.
  • FIG. 3 shows the components of the MOG telephone.
  • an antenna ANN in addition to the input / output elements LSP, MIC, EIN and the display DIS, an antenna ANN and a transmitting / receiving device SEE for performing the telecommunication functions;
  • a processor PRC is used as a control device for interpreting the user the input ON input commands and corresponding control of the device SEE provided.
  • the processor PRC is also set up according to the invention for processing the image data img of the camera module in order to generate sounds snd from them, as described below, with the aid of video coding and motion field analysis.
  • the function for generating sounds snd from the motion information of images img essentially comprises the following processing steps: a) encoding of the image information img by an encoder module ENC, for example by means of an MPEG algorithm, for determining an associated motion vector field vfd, b) Analysis of the vector field vfd for predetermined characteristic quantities chs, for example the prevailing motion vector, in an analysis module AAN of the processor system PRC and c) sound generation based on the quantities chs, for example generation of a sound as a function of the orientation and the amount of the prevailing motion vector, by a synthesis module SYN, which in the exemplary embodiment shown here also in the processor system PRC is realized.
  • Step a) the encoding of the image information takes place, for example, using the known MPEG encoding.
  • This is a standardized procedure for the compression and transmission of digitized image sequences and often in cell phones with cameras, e.g. already implemented for the purpose of video telephony.
  • Essential components in the method are the motion estimation BS of successive images (see below), the motion compensation BK and the transformation of the motion-compensated image into the frequency space by means of a discrete cosine transformation
  • DCT digital Signal Processing for Multimedia Systems
  • iDCT denotes the transformation inverse to DCT
  • DG is the digitization of the image stream received as input.
  • the input to motion estimation BS is the image imp preceding this at time t n - ⁇ .
  • the image imp is obtained from the DCT-transformed and motion-compensated signal of the previous image by means of an inverse DCT (iDCT), or temporarily buffered by means of an image memory IS for the duration of an image change.
  • iDCT inverse DCT
  • the image imp serves as a reference image and is subdivided into a number of blocks bbl, for example as shown in FIG. 5 into 36 pixel blocks of 16x16 pixels each. For each of these pixel blocks bbl, the best possible match is sought in the image to be evaluated in accordance with the MSE method ( ⁇ Mean Squared Error ') in a local neighborhood. In this way, information about the displacement vector is obtained for each block bbl.
  • FIG. 5 shows the image img of FIG. 1 as an example, in which the determined motion vectors v are additionally entered for each block bbl.
  • the picture shows an automobile driving against a background; the camera was pivoted with the vehicle during the recorded image sequence.
  • the motion vectors determined on the vehicle are almost zero, while the vectors in the vicinity have motion.
  • the motion vector field vfd resulting from this processing is the input for the next processing level.
  • the motion estimation described here which is part of the known MPEG method, provides a simple yet effective motion analysis.
  • Other methods of motion analysis can also be used within the scope of the invention, which provide a motion vector field and which generally use one or more images which are preceding or following the image to be examined.
  • the motion vector field vfd becomes one or more characteristic quantities chs, here e.g. the dominant movement orientation. This takes place in the AAN analysis module.
  • the orientation of all vectors from the motion field is entered in a histogram, cf. Fig. 6.
  • the maximum hmx within the distribution which is represented by the histogram his, gives the main direction of motion within the Picture.
  • an amount of the speed movement is determined, which is calculated by simple averaging from all vectors belonging to this main movement direction with a predeterminable tolerance (e.g. two classes adjacent to the histogram class of the maximum).
  • the result of this processing is a vector, the orientation and amount of which describe the main movement in the image. In the example considered here, this vector is the (two-dimensional) characteristic quantity chs from which sounds are derived in the subsequent processing stage.
  • the evaluation can of course also take place in a different way.
  • Variables that can be used as the basis for the evaluation are, in particular, statistical characteristic data of a distribution such as the most common value (maximum), secondary maxima, associated variances, weights of higher orders, etc.
  • step c) the sound is then generated in the synthesis module SYN on the basis of the characteristic size (n) chs.
  • a sound snd is generated and output via the loudspeaker LSP.
  • the sound sequence which is in the form of an acoustic signal in a known electrical representation, can be transmitted to another subscriber via a telecommunication connection of the mobile phone MOG.
  • the amount of movement speed controls the volume during sound generation, while different types of sounds are generated depending on the movement orientation.
  • each orientation class represented in the histogram his is assigned a pre-stored sound which differs from the other sounds by its pitch and / or sound characteristics (overtone spectrum).
  • the sounds can - but do not have to - be arranged according to their pitch.
  • the type of sound generation can be varied.
  • several maxima hmx, bmx of the distribution his could lead to an overlay of sounds.
  • the histogram could be fed directly to the synthesis device SYN, which uses this as the overtone spectrum of a fundamental tone; the pitch of the fundamental can remain the same (e.g. an A, 110 Hz) or can be determined using the procedure described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)

Abstract

Selon l'invention, on génère des signaux acoustiques (snd) à partir d'un flux de données vidéo qui contient une séquence chronologique d'images individuelles (img). On commence par déterminer un champ vecteur de déplacement (vfd) à partir des données image des images individuelles (img), par exemple, à l'aide d'un algorithme MPEG puis on dérive au moins une grandeur caractéristique (chs) du champ vecteur de déplacement (vfd), par exemple, un vecteur de déplacement prédominant dans un module d'analyse (AAN). Et à l'appui de ces grandeurs (chs), on génère un signal acoustique (snd) à l'aide d'un module de synthèse (SYN).
EP02790332A 2001-11-22 2002-11-04 Procede et dispositif de production de signaux acoustiques a partir d'un flux de donnees video Withdrawn EP1446956A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP02790332A EP1446956A2 (fr) 2001-11-22 2002-11-04 Procede et dispositif de production de signaux acoustiques a partir d'un flux de donnees video

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP01127842 2001-11-22
EP01127842 2001-11-22
EP02790332A EP1446956A2 (fr) 2001-11-22 2002-11-04 Procede et dispositif de production de signaux acoustiques a partir d'un flux de donnees video
PCT/EP2002/012295 WO2003045066A2 (fr) 2001-11-22 2002-11-04 Procede et dispositif de production de signaux acoustiques a partir d'un flux de donnees video

Publications (1)

Publication Number Publication Date
EP1446956A2 true EP1446956A2 (fr) 2004-08-18

Family

ID=8179319

Family Applications (1)

Application Number Title Priority Date Filing Date
EP02790332A Withdrawn EP1446956A2 (fr) 2001-11-22 2002-11-04 Procede et dispositif de production de signaux acoustiques a partir d'un flux de donnees video

Country Status (3)

Country Link
EP (1) EP1446956A2 (fr)
JP (1) JP2005510907A (fr)
WO (1) WO2003045066A2 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1507389A1 (fr) * 2003-08-13 2005-02-16 Sony Ericsson Mobile Communications AB Téléphone portable avec un dispositif de commande à distance pour arrêter la sonnerie
DE102022105681A1 (de) 2022-03-10 2023-09-14 Ebm-Papst Mulfingen Gmbh & Co. Kg Verfahren zur Ermittlung einer Schwingung eines Lüftungssystems

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3851655T2 (de) * 1987-06-09 1995-02-09 Sony Corp Verarbeitung des Bewegungsvektors in Fernsehbildern.
AUPP990199A0 (en) * 1999-04-22 1999-05-13 Griffith University Wireless video surveillance system
GB2350512A (en) * 1999-05-24 2000-11-29 Motorola Ltd Video encoder

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO03045066A3 *

Also Published As

Publication number Publication date
WO2003045066A2 (fr) 2003-05-30
JP2005510907A (ja) 2005-04-21
WO2003045066A3 (fr) 2003-11-27

Similar Documents

Publication Publication Date Title
DE10084867B4 (de) Verfahren und Vorrichtung um es einem Videokonferenzteilnehmer zu ermöglichen den zugehörigen Nutzern in der Kamera fokussiert zu erscheinen
DE19642558B4 (de) Vorrichtung zur elektronischen Programmführung
DE69523503T2 (de) Audiovisuelles Kommunikations-Verfahren und -Vorrichtung mit integrierter, wahrnehmungsabhängiger Sprach- und Videokodierung
DE69630121T2 (de) Bildkompressionssystem
DE69326751T2 (de) Bewegtbildkodierer
DE10212915A1 (de) Elektroendoskopsystem mit Elektroendoskopen mit verschiedenen Pixelanzahlen
WO1994024634A1 (fr) Procede permettant de detecter des modifications survenant dans des images en mouvement
WO2006056531A1 (fr) Procede et dispositif de transcodage
DE102008001076A1 (de) Verfahren, Vorrichtung sowie Computerprogramm zur Auflösungsreduktion eines Eingangsbilds
DE102016121755A1 (de) Verfahren zum Bestimmen eines zusammengesetzten Bilds eines Umgebungsbereichs eines Kraftfahrzeugs mit Anpassung von Helligkeit und/oder Farbe, Kamerasystem sowie Krafzfahrzeug
DE69321011T2 (de) Verfahren und Gerät zur Rauschmessung
EP0525900B1 (fr) Circuit de filtrage pour le pré-traitement d'un signal vidéo
DE102023134534A1 (de) Ausgabeverfahren und elektronische vorrichtung
EP1205067A1 (fr) Visiophone mobile
EP0897247A2 (fr) Procédé de calcul de vecteurs de mouvement
DE69801165T2 (de) Signalverarbeitung
EP1489842B1 (fr) Procédé et appareil d'interpolation des éléments d'image en fonction du vecteur de mouvement
WO2003045066A2 (fr) Procede et dispositif de production de signaux acoustiques a partir d'un flux de donnees video
DE69911964T2 (de) Leistungsmessung von fernmeldesystemen
DE19951341B4 (de) Verfahren zur bewegungskompensierenden Prädiktion von Bewegtbildern sowie Einrichtung hierzu
EP2536127A2 (fr) Procédé destiné à la correction d'éclairage automatique basée sur l'image
DE102022121955A1 (de) Audioverarbeitungsverfahren, audioverarbeitungsgerät, elektronische vorrichtung zur audioverarbeitung und speichermedium
DE19749655B4 (de) Verfahren und Vorrichtung zum Kodieren eines Bewegungsvektors
EP0363677A2 (fr) Circuit pour l'estimation de mouvement dans une image détectée
DE10210926A1 (de) Vorrichtung zur Verfolgung wenigstens eines Objekts in einer Szene

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20040301

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SK TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20090603