EP0424619B1 - Still image video telephone transmission system - Google Patents

Still image video telephone transmission system Download PDF

Info

Publication number
EP0424619B1
EP0424619B1 EP90115414A EP90115414A EP0424619B1 EP 0424619 B1 EP0424619 B1 EP 0424619B1 EP 90115414 A EP90115414 A EP 90115414A EP 90115414 A EP90115414 A EP 90115414A EP 0424619 B1 EP0424619 B1 EP 0424619B1
Authority
EP
European Patent Office
Prior art keywords
picture
signal
correcting
picture element
phase
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP90115414A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP0424619A3 (en
EP0424619A2 (en
Inventor
Koji C/O Mitsubishi Denki K.K. Kaneko
Kazuyuki C/O Mitsubishi Denki K.K Saigusa
Shinya C/O Mitsubishi Denki K.K. Yokodate
Hitoshi C/O Mitsubishi Denki K.K. Fujimoto
Akira C/O Mitsubishi Denki K.K. Teshima
Tatsuhiko C/O Mitsubishi Denki K.K. Mizushima
Gary S. Fletcher
Lawrence D. Emmons
Janet Miller
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Priority to EP96120183A priority Critical patent/EP0766450B1/en
Publication of EP0424619A2 publication Critical patent/EP0424619A2/en
Publication of EP0424619A3 publication Critical patent/EP0424619A3/en
Application granted granted Critical
Publication of EP0424619B1 publication Critical patent/EP0424619B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32128—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32106—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title separate from the image data, e.g. in a different computer file
    • H04N1/32117—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title separate from the image data, e.g. in a different computer file in a separate transmission or protocol signal prior to or subsequent to the image data transmission, e.g. in digital identification signal [DIS], in non standard setup [NSS] or in non standard field [NSF]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3225—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
    • H04N2201/3242—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document of processing required or performed, e.g. for reproduction or before recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3278—Transmission

Definitions

  • This invention relates to a still image video telephone transmission system in which a still picture taken by a video camera is sent to telephone lines during talking over telephone, and more particularly to improvement of a transmitting means and a receiving means so as to correct deteriorated picture signals sent over a transmission path.
  • FIG. 14 of the accompanying drawing is a block diagram showing this kind of still image video telephone disclosed in "Details of TTC Standard TV Telephone System," page 31, TV Technique, issued September, 1988.
  • reference numeral 1 designates a still image video telephone transmission system; 2, telephone lines; 3, an external telephone set; 4, a network control unit for inputting/outputting picture information and switching the connection between the video telephone transmission system and the external telephone set 3; 5, a modem circuit for modulating/demodulating the picture data so as to transmit the data via the telephone lines; 6, a demodulation timing recovering circuit for recovering a timing to be used by the modem circuit 5; 7, an A/D converter for converting analog data demodulated by the modem circuit 5 into digital data; 8, a keypad for triggering transmission and various operations; 9, a display for showing a picture of a speaker and that of a counterpart; 10, a video camera; 11, a picture information memory; 12, a picture control circuit to write/read the picture data into/from the picture information memory 11, to output the picture signal to the display 9, and to input the picture signal from the video camera 10; 13, a D/A converter to convert the digital picture signal from the picture control circuit 12 into an analog picture signal and send the analog picture signal to the
  • FIG. 15 illustrates a method to modulate the picture data by the video telephone transmission system of FIG. 14.
  • This kind of modulation system is based on an amplitude-phase modulation system (hereinafter referred to as AM-PM system) in which amplitude information and phase information are transmitted in combination.
  • AM-PM system amplitude-phase modulation system
  • the modulation of the picture data having a picture element with luminance "16" will be described with reference to FIG. 15.
  • first phase of a sine curve type there are two phases: a first phase of a sine curve type, and a second phase of - sine type different by 180° from the first phase, each of the first and second phases being composed of signals having 8-level amplitudes.
  • each phase is eight cycles, i.e., sixteen cycles in total.
  • the signal "0" of the maximum amplitude of the first phase corresponds to black.
  • the intermediate signals "1" to "14” correspond to gray of respective luminancees.
  • the signal "15" of the maximum amplitude of the second phase corresponds to white.
  • FIG. 16 is a diagram schematically showing a data format of the conventional system.
  • reference numeral 16 designates picture control information including a gain control signal for receiving the picture signal and a picture mode signal; 17, picture data; 18, a dual tone signal for notifying arrival of the picture data 17; and 19, a hardware preamble notifying arrival of the picture data 17.
  • the picture data 17 of the picture element at the upper left side of the screen are sent first and then those for the succeeding picture elements are sent laterally to the right in succession, then are returned to the leftmost side of the line below a first line after they reach the rightmost position, and are sent laterally again.
  • the put/output signal from the telephone set 3 is broken, and the picture signal from the modem circuit 5 is made ready for outputting the picture signal to the telephone lines 2.
  • the CPU outputs the picture control signal to the telephone lines 2 through the modem circuit 5.
  • the CPU 15 receives picture data sequentially from the picture information memory 11 via the picture control circuit 12, and sends the picture signal to the modem circuit 5.
  • the network control unit 4 switches the connection to the telephone set.
  • the CPU 15 receives a notice to start receiving information.
  • the CPU 15 switches the network control unit 4 ready for receiving the picture, starting receiving information.
  • the received picture signal is demodulated by the modem circuit 5 and the demodulation timing recovering circuit 6, is converted into a digital signal by the A/D converter 7, and then forwarded to the CPU 15.
  • the picture data for one picture sent to the CPU 15 are sequentially stored in the picture information memory 11 via the picture control circuit 12.
  • the picture data stored in the picture information memory 11 are sequentially read out via the picture control circuit 12, and are sent to the display 9 so as to have the picture displayed on the screen. Now the speaker can talk while observing the still picture from the other party.
  • system still image video telephone transmission system
  • FIGS. 1 through 6 show a first embodiment of the system.
  • the construction of the system of the first embodiment is similar to that of the prior art system and is realized by software of a CPU.
  • FIG. 3 shows a transmission signal that is provided by adding a picture element displacement detecting signal to the conventional one at regular time intervals.
  • FIG. 2 shows an example of the picture element displacement detecting signal, which is composed of six cycles (six picture elements) and varies in phase at the transition point between the fourth cycle and the fifth cycle.
  • the transmitting action will be described first.
  • the transmission signal such as shown in FIG. 3 is transmitted by the steps of procedure of FIG. 4. Specifically, upon receipt of an instruction for transmission, a picture control information signal is transmitted (step S101). Then a picture element displacement detecting signal (step S102) and a picture element signal (step S103) are transmitted in order by a predetermined length; this is repeated until transmission of these signals for the entire area of a picture is completed.
  • the picture control information signal is received (step S105), whereupon the picture element displacement detecting signal (step S106) and the picture element signal (step S107) are alternately received until receiving of these signals for the entire area of the picture is completed.
  • FIG 6 shows the detailed manner in which the picture element displacement detecting signal is received (step S106) at that time.
  • signals for some picture elements are thrown away after reading (step S109). The reason why this throwing is necessary is that in the presence of a picture element displacement, a signal which must be a picture element displacement detecting signal is occasionally and practically a picture element signal, followed by reading the picture element displacement detecting signal (step S110).
  • step S112 When the transitional position at which the phase of a signal received is changed (i.e., a point at which an individual picture element is inverted from black to white and vice versa) is detected, discrimination is made (step S112) on whether or not the counted number of picture elements received at that time coincides with a predetermined value. Specifically, discrimination is made (step S112) on whether the number of picture elements received from the phase inversion position of the previously received picture element displacement detecting signal to the phase inversion position of the present picture element displacement detecting signal is correct or not. If it is not correct, count number correcting information is transmitted (step S113). In the example of FIG. 2, the phase inversion point is located at the boundary between the fourth cycle and the fifth cycle.
  • this position will be detected as being displaced. For example, if the transition point is earlier than the regular count number by one count, this means that there is a displacement by one picture element. Now the count number is corrected to the regular one (step S113) so that a further picture element displacement will be prevented. Then the remaining picture element displacement preventing signal is thrown away after reading (step S115) to terminate receiving of succeeding picture element displacement preventing signals, whereupon the procedure proceeds to receiving of a picture signal (step S107).
  • FIGS. 7 through 13 show a second embodiment of the system.
  • the inverted information memory 20 is a circuit for storing the presence and absence of inversion occurrence of individual block. Upon receipt of signals for the entire picture and based on the information stored in the inverted information memory 20. A CPU 15 makes a correction to the picture information stored in a picture information memory 11 via an image control unit 12.
  • FIG. 8 shows an image data format to be employed in the second embodiment.
  • picture control information a picture data block and an inversion detecting signal are transmitted.
  • an inversion detecting signal is inserted between adjacent blocks, each including picture data for one line.
  • the practical operation of the system is realized by software process of a CPU.
  • the transmitting action will be described first.
  • FIG. 13 shows the procedure of this transmitting. Specifically, upon receipt of an instruction for transmission, a picture control information signal is transmitted (step S219). Then a picture element signal and a picture inversion detecting signal for one line are transmitted in order by a predetermined length (steps S220, S221); thereafter this is repeated until transmission of these signals for the entire area of a picture is completed.
  • the picture inversion detecting signal includes several cycles of a signal having a predetermined phase.
  • the picture control information is received (step S201), and a block of picture data is received (step S202).
  • FIG. 10 illustrates the detailed manner in which the block of picture data is received (step S202). Firstly one symbol is received (step S211), phase correction is made to the received data (step S213) and the corrected data are stored (step S213) in the picture information memory 11. If it does not reach the number of symbols of one block, the procedure is returned to step S211. Otherwise, the procedure is terminated.
  • phase inversion detecting signal is received (step S203), and discrimination is made (step S204) on whether phase inversion is present or not while the block of picture data is received, whereupon the result of discrimination is stored (steps S205, S206) in an inversion information memory 20.
  • the presence and absence of phase inversion can be easily discriminated based on whether a phase inversion signal coincides with a predetermined picture element signal.
  • a phase correction (step S212) is inverted (step S207) for the succeeding receiving.
  • step S208 discrimination is made (step S208) on whether the receiving of picture data for the entire area of a picture is completed or not. If completed, the picture data of the block in which inversion occurred are corrected (step S209).
  • FIG. 11 illustrates the detailed manner in which this correcting (step S209) is performed.
  • step S216 Upon receipt, from the inversion information memory, the information corresponding to the block of initial picture data (step S215), discrimination is made (step S216) on whether or not phase inversion is present in this block. If inversion occurred, picture data of a nearest block which is devoid of inversion are read from the picture information memory 11 and stored (step S217) therein the picture data of this block. And the number of blocks is discriminated; if the correction for all blocks is not completed, the procedure is returned to step S215 to perform correction to the next block.
  • step S210 the process subsequent to receiving is performed (step S210), and thus the picture receiving action is terminated.
  • the succeeding data can be received correctly only by giving an instruction from the CPU 15 to the modem unit 5 to correct the succeeding data and to output the corrected data.
  • this embodiment it is possible to reproduce a clear picture by inserting, in a predetermined position of a picture signal, a phase inversion detecting signal with a predetermined value at regular time intervals and transmitting the combined signal, and on the receiving side, by detecting phase inversion to prevent inversion of the received picture and by correcting the inverted portion by using other data.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Television Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Facsimiles In General (AREA)
EP90115414A 1989-10-23 1990-08-10 Still image video telephone transmission system Expired - Lifetime EP0424619B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP96120183A EP0766450B1 (en) 1989-10-23 1990-08-10 Still image video telephone transmission system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP1275181A JPH078036B2 (ja) 1989-10-23 1989-10-23 静止画テレビ電話装置
JP275181/89 1989-10-23

Related Child Applications (1)

Application Number Title Priority Date Filing Date
EP96120183A Division EP0766450B1 (en) 1989-10-23 1990-08-10 Still image video telephone transmission system

Publications (3)

Publication Number Publication Date
EP0424619A2 EP0424619A2 (en) 1991-05-02
EP0424619A3 EP0424619A3 (en) 1992-09-09
EP0424619B1 true EP0424619B1 (en) 1998-04-15

Family

ID=17551804

Family Applications (2)

Application Number Title Priority Date Filing Date
EP96120183A Expired - Lifetime EP0766450B1 (en) 1989-10-23 1990-08-10 Still image video telephone transmission system
EP90115414A Expired - Lifetime EP0424619B1 (en) 1989-10-23 1990-08-10 Still image video telephone transmission system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP96120183A Expired - Lifetime EP0766450B1 (en) 1989-10-23 1990-08-10 Still image video telephone transmission system

Country Status (5)

Country Link
US (1) US5042061A (ja)
EP (2) EP0766450B1 (ja)
JP (1) JPH078036B2 (ja)
KR (2) KR930004827B1 (ja)
DE (2) DE69032240T2 (ja)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5606365A (en) * 1995-03-28 1997-02-25 Eastman Kodak Company Interactive camera for network processing of captured images
USH1714H (en) * 1995-05-03 1998-03-03 Lucent Technologies Inc. Automatic still image transmission upon call connection
US5746656A (en) * 1996-04-23 1998-05-05 Bezick; William Video game competition method and apparatus
FI103628B1 (fi) 1997-09-02 1999-07-30 Nokia Mobile Phones Ltd Videodatan lähettäminen
WO1999035818A2 (en) * 1998-01-12 1999-07-15 David Monroe Apparatus for capturing, converting and transmitting a visual image signal via a digital transmission system
US6167469A (en) * 1998-05-18 2000-12-26 Agilent Technologies, Inc. Digital camera having display device for displaying graphical representation of user input and method for transporting the selected digital images thereof
GB2343586A (en) * 1998-11-06 2000-05-10 Nec Technologies Image display for mobile phones
US6792148B1 (en) 1999-10-18 2004-09-14 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for providing a camera accessory with compression
KR100476855B1 (ko) * 2000-09-22 2005-03-17 세이코 엡슨 가부시키가이샤 화상처리방법
US7643168B2 (en) 2003-01-03 2010-01-05 Monroe David A Apparatus for capturing, converting and transmitting a visual image signal via a digital transmission system
EP1571813A1 (en) 2004-03-02 2005-09-07 LG Electronics, Inc. Method and communication system for transmitting an image to the called party identifying calling party
US7535598B2 (en) 2004-06-16 2009-05-19 Ricoh Company, Ltd. Image recording apparatus and image processing system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4258387A (en) * 1979-10-17 1981-03-24 Lemelson Jerome H Video telephone
US4485400A (en) * 1981-01-13 1984-11-27 Lemelson Jerome H Video telephone
JPS59117838A (ja) * 1982-12-24 1984-07-07 Sony Corp マ−カ−信号検出回路
US4985911A (en) * 1985-11-07 1991-01-15 Mitsubishi Electronics America, Inc. Conversational video phone
JPS644185A (en) * 1987-06-26 1989-01-09 Sony Corp Transmitter for still picture
EP0314122A3 (en) * 1987-10-30 1992-04-22 Luma Telecom, Inc. Still picture picturephone communication system
US4979028A (en) * 1988-05-30 1990-12-18 Sony Corporation Video telephone

Also Published As

Publication number Publication date
EP0766450B1 (en) 2001-12-12
EP0424619A3 (en) 1992-09-09
DE69032240T2 (de) 1998-10-29
KR920003786A (ko) 1992-02-29
KR930004827B1 (ko) 1993-06-08
JPH078036B2 (ja) 1995-01-30
DE69033877T2 (de) 2002-06-06
EP0766450A3 (en) 1997-07-23
KR910009097A (ko) 1991-05-31
KR930005607B1 (ko) 1993-06-23
DE69032240D1 (de) 1998-05-20
JPH03136488A (ja) 1991-06-11
EP0424619A2 (en) 1991-05-02
DE69033877D1 (de) 2002-01-24
US5042061A (en) 1991-08-20
EP0766450A2 (en) 1997-04-02

Similar Documents

Publication Publication Date Title
EP0424619B1 (en) Still image video telephone transmission system
US4686690A (en) Synchronous data receiver circuit
EP0918313A1 (en) Signal processing method for an analogue picture signal
EP0344751B1 (en) Code violation detection circuit for use in AMI signal transmission
EP0255840B1 (en) Circuit for detecting synchronism in a digital broadcast receiver
US6888933B2 (en) Communication apparatus for selecting a communication protocol compatible to a partner station and executing the selected protocol
JP3416860B2 (ja) フレーム同期通信方法
JP2967649B2 (ja) 受信同期回路
US5426647A (en) Data communication apparatus detecting interrupt requests through data error detection
JPH088679B2 (ja) 静止画テレビ電話装置
JP3489367B2 (ja) 伝送端末器及び自動検針装置
KR920008655B1 (ko) 텔레비젼 전화기에 있어서 프레임동기 인식방법
JPH0738652B2 (ja) トレーニング信号検出装置
EP0856992A2 (en) Data reproduction apparatus for character multiplexing video signal
JPS58124369A (ja) フアクシミリ装置
JPH0415676B2 (ja)
JPH04253488A (ja) 同期信号抽出回路
JPH11112759A (ja) 通信端末装置
JPH07143305A (ja) ファクシミリ装置
JPH05327646A (ja) フレーム同期回路
JPH04311178A (ja) 同期信号抽出回路
JPH01268259A (ja) ファクシミリ装置
JPH025680A (ja) 画像データ受信装置
JP2001144820A (ja) 電文送受信システム、電文送受信方法、電文送信方法および電文受信方法
JPH05226938A (ja) 周波数変調符号化データ復調方法及び復調装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 19901231

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): DE FR GB

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): DE FR GB

17Q First examination report despatched

Effective date: 19940912

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB

DX Miscellaneous (deleted)
REF Corresponds to:

Ref document number: 69032240

Country of ref document: DE

Date of ref document: 19980520

ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed
REG Reference to a national code

Ref country code: GB

Ref legal event code: IF02

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20060803

Year of fee payment: 17

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20060808

Year of fee payment: 17

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20060809

Year of fee payment: 17

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20070810

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20080430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070810