EP0744881A2 - Appareil de reproduction par casque d'écoute - Google Patents

Appareil de reproduction par casque d'écoute Download PDF

Info

Publication number
EP0744881A2
EP0744881A2 EP96303604A EP96303604A EP0744881A2 EP 0744881 A2 EP0744881 A2 EP 0744881A2 EP 96303604 A EP96303604 A EP 96303604A EP 96303604 A EP96303604 A EP 96303604A EP 0744881 A2 EP0744881 A2 EP 0744881A2
Authority
EP
European Patent Office
Prior art keywords
sound
channel input
signals
listener
changing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP96303604A
Other languages
German (de)
English (en)
Other versions
EP0744881B1 (fr
EP0744881A3 (fr
Inventor
Toshikazu Okada
Takuma Suzuki
Mitsuo Matsumoto
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Victor Company of Japan Ltd
Original Assignee
Victor Company of Japan Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP7148323A external-priority patent/JP2900985B2/ja
Application filed by Victor Company of Japan Ltd filed Critical Victor Company of Japan Ltd
Publication of EP0744881A2 publication Critical patent/EP0744881A2/fr
Publication of EP0744881A3 publication Critical patent/EP0744881A3/fr
Application granted granted Critical
Publication of EP0744881B1 publication Critical patent/EP0744881B1/fr
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Definitions

  • the sound transmitted from the speaker 40 to the listener 41 can be represented by two different transfer functions hl(n) (from the speaker 40 to a left ear 41L) and hr(n) (from the speaker 40 to a right ear 41R), respectively.
  • these two transfer functions hl(n) and hr(n) are synthesized with input signals x(n) inputted through an input terminal 51. A sound image localized by the speaker 40 is thus reproduced through a headphone 52 in pseudo-speaker sound reproduction manner.
  • the directional feeling (transfer characteristics) are not synthesized.
  • the reflected sounds are added to the input signals as they are, without providing definite directional feeling for both the listener's left and right ears.
  • the cross-talk signals formed on the basis of the reflected sounds are formed separately on the left and right sides on the basis of the same signals to which reflected sounds are added. In other words, a cross-talk signals is not formed for each of the reflected sounds, respectively.
  • the first changing means may include a low-pass filter.
  • the present invention further provides an apparatus for creating a virtual sound based on an input audio signal, a listener be feeling as if a sound came from a virtual sound source that imaginarily exists in a space apart from the listener, the apparatus comprising: delay means for delaying a first-channel input signal and a second-channel input signal, both being separated from the input audio signal, by predetermined delay times, changing frequency characteristics of the first- and second-channel input signals to predetermined frequency characteristics, and changing sound levels of the first- and second-channel input signals to predetermined sound levels; multi-stage delay means for delaying another signal separated from the input audio signal by a plurality of predetermined delay times to output multi-stage delayed signals; processing means for delaying a plurality of third-channel input signals and a plurality of fourth-channel input signals, the third- and fourth-channel input signals being separated from the multi-stage delayed signals, by a plurality of predetermined delay times, changing frequency characteristics of the third- and fourth-channel input signals to predetermined frequency characteristics, and changing sound levels of the third-
  • Fig. 4 shows a first embodiment of a headphone reproducing apparatus according to the present invention.
  • a headphone reproducing apparatus 10 has a direction filter 12 for transfer characteristic synthesizing.
  • the direction filter 12 models acoustic components included in the transfer functions from a virtual sound source assumed to exist in a virtual space to the listener's left and right ears. And, the direction filter 12 synthesizes the directional feeling (transfer characteristics) with left- and right-channel signals divided from input signals applied through an input terminal 11.
  • Time component (a difference in arrival time from the sound source to both the listener's ears)
  • the headphone reproducing apparatus 10 includes delaying circuits for modeling the time component of the transfer characteristics, frequency characteristic changing circuits for modeling the frequency component, and sound pressure changing circuits for modeling the sound pressure component, on each side of the headphone.
  • these circuits can be fabricated easily by use of a direction filter 12 having two delay circuits 13R and 13L, two low-pass filters (LPFs) 14R and 14L, and two multipliers 15R and 15L.
  • LPFs low-pass filters
  • multipliers 15R and 15L two multipliers
  • IIR Infinite Impulse Response
  • the delay circuit 13L, the LPF 14L and the multiplier 15L are connected in series for the left channel. Further, the delay circuit 13R, the LPF 14R, and the multiplier 15R are connected in series for the right channel.
  • the transfer characteristics can be synthesized with the input signals by the direction filter 12 having the delay circuits 13L and 13R, the LPFs 14L and 14R, and the multipliers 15L and 15R. It is thus possible to synthesize the transfer characteristics (more approximate to the actual transfer functions) with the input signals in real time.
  • the headphone reproducing apparatus according to the present invention can be constructed by use of small-scale hardware of simple construction elements, as compared the conventional apparatus for executing the convolution calculations of the impulse responses.
  • a headphone reproducing apparatus 20 reproduces reflected sounds each having directional feeling from each virtual room wall to both the listener's ears, in addition to the direct sound having directional feeling from the virtual sound source to both the listener's ears.
  • the other of the two divided signals is given to a delay circuit 22, and then outputted as multi-stage delayed signals (the delay times are t 1 to t N ).
  • the multi-stage delayed signals are applied to direction filters 12(t 1 ) to 12(t N ) respectively, and then outputted as the reflected sounds each having directional feeling to both the left and right ears, respectively.
  • each of the direction filters 12(t 0 ) to 12(t N ) corresponds to the direction filter 12 of Fig. 4. Further, each of the signal processing values (delay time, frequency characteristics, and sound volume level) of these direction filters is decided on the basis of each of the directions of the reflected sounds. Further, the direct sound and the reflected sound are added to each other by adders 24 1 to 24 N for each of the left and right channels, and then given to the left channel 16L and the right channel 16R of the headphone 16, respectively.
  • the direction filter 12(t 0 ) synthesizes the transfer characteristics between the virtual sound source and the listener's left and right ears with the left- and right-channel signals obtained by dividing the input signals, respectively.
  • the direction filters 12(t 1 ) to l2(t N ) synthesizes the respective transfer characteristics of the reflected sounds to the listener's left and right ears with the left- and right-channel signals each obtained by dividing each of the reflected sounds outputted by the delay circuit 22.
  • the adder 24 1 adds the left- and right-channel signal outputs of the direction filter 12(t 0 ) to the left- and right-channel signal outputs of direction filter 12(t 1 ), respectively.
  • the adder 24 2 adds the left- and right-channel signal outputs of the adder 24 1 to the left- and right-channel signal outputs of the direction filter 12(t 2 ), respectively.
  • This addition goes on to the direction filter 12(t N ).
  • the left- and right-channel signal outputs of the adder 24 N are given to the left channel 16L and the right channel 16R of the headphone 16, respectively.
  • the directional feeling from a single virtual sound source to both the left and right ears can be synthesized, and additionally different directional feelings to both the left and right ears can be synthesized for each of the reflected sounds.
  • the headphone reproducing apparatus as described above is constructed for each channel of the stereophonic input signals to execute the similar signal processing, respectively.
  • both the direct sound and reflected sounds each having the directional feeling to both the listener's left and right ears can be synthesized for each channel, and the synthesized sound signals are transmitted to the headphone. It is thus possible to localize the two sound images outside the listener's head under excellent stereophonic feeling conditions.
  • the sound image localization feeling implies the position of the virtual sound source, the room mode, or shape and size of a room where the virtual sound source is located, etc.
  • the signal processing values to be changed are those of the direction filter 12t 0 to 12(t N ) and the delay circuit 22.
  • the more the signal processing values (delay time, frequency characteristics, and sound volume level) are changed, the more the sound image localization feeling can be changed precisely.
  • the less the number of the signal processing values are changed the more the apparatus construction can be simplified to that extent.
  • the signal processing values are changed gradually, it is possible to obtain such an effect as if the sound image were moving.
  • a headphone reproducing apparatus 30 has a head movement detector 31 and a controller 32.
  • the head movement detector 31 detects the movement of the listener's head to which the headphone 16 is attached; that is, the head rotational direction, the head rotation angle, etc.
  • the detected values are transmitted to the controller (e.g., CPU) 32. Further, the movement of the listener's head can be also calculated by the controller 32.
  • the controller 32 changes the signal processing values of a delay circuit 22, and direction filter 12(t 0 ) to 12(t N ) in such a way that the sound image can be moved by the same movement rate in the direction opposite to the movement direction of the listener's head.
  • the head movement detector 31 is provided as follows: Two ultrasonic sensors are disposed on both the left and right sides of the headphone 16, and a detection signal oscillator is disposed at a predetermined position away from the listener's head. The oscillator transmits detecting pulse signals to the two ultrasonic sensors at controlled timings. The oscillator further transmits a detecting pulse signal transmitting signal to the controller 32. Upon receiving the detecting pulse signals, the left and right ultrasonic sensors output detection time signals to the controller 32. Each detection time signal represents what time it is at which each sensor receives the detecting pulse signal.
  • the controller 32 Upon receiving the detecting pulse signal transmitting signal from the oscillator and the detection time signals from the sensors, the controller 32 detects a time difference between the detecting pulse signal transmission and reception to detect two distances between the oscillator and the left and right sides of the headphone, respectively or a difference in distance between the oscillator and the left and right sides of the headphone. The controller then calculates the head rotation angle based on the detected distance or distance difference.
  • the movement detector 31 it is also possible to use infrared sensors, gyroscope sensors, gravity sensors for detecting inclination angles relative to the vertical direction, etc.
  • the controller 32 changes the signal processing values of the delay circuit 22, and the delay circuits, LFPs, and multipliers of the direction filters 12(t 0 ) to 12(t N ).
  • the controller changes the signal processing values in accordance with the calculating expressions and the set values determined according to the rotational direction and the rotation angle both previously stored in a memory of the controller 32.
  • the sound image thus can be moved by the same rotation angle of the head movement in the direction opposite to the head rotational direction on the basis of the calculated head rotation angle.
  • Figs. 7A and 7B show the case where the listener's head is moved by an angle ⁇ in the horizontal direction.
  • a virtual sound source is located at a point A relative to a listener 33 having the headphone 16.
  • the localization point A of the virtual sound source is moved by the angle ⁇ from the point B in a direction opposite to the movement direction of the listener's head (i.e., the left horizontal direction from the point B).
  • the localization point A of the virtual sound source is moved by the angle ⁇ from the point B in a direction opposite to the movement direction of the listener's head (i.e., the left horizontal direction from the point B).
  • the position, direction and movement of the listener's body relative to the virtual sound source can be detected by use of position, direction and movement detectors.
  • the sound image localization feeling can be changed according to the position, direction and movement of the listener, it is possible to obtain more realistic extra-head sound image localization feeling.
  • three or more detecting signal oscillators are disposed within a space where the listener exists. Furthermore, when four or more oscillators are disposed on the mutually different planes, the three-dimensional position, direction and movement of the listener can be detected. In this case, two receivers are disposed on both the left and right side of the listener's head (or the headphone). And, the position, the direction and the movement of the listener's body relative to the virtual sound source can be detected by a processor.
  • the processor calculates the respective receiver positions (i.e., the listener's position) on the basis of the positions (coordinates) of the detection signal oscillators, time at which each detection signal is transmitted by the corresponding detection signal oscillator, and time at which each detection signal is received by the corresponding receiver.
  • the processor then obtains vectors among the receivers, vectors indicative of the listener's direction obtained by rotating the vectors among the receivers by 90 degrees, vectors from the listener (each midpoint between the respective receivers) to the virtual sound source.
  • the processor obtains the angle between the listener and the virtual sound source on the basis of an inner product of the calculated vectors between the respective receivers or the direction vectors and the vector between the listener (each midpoint between the respective receivers) to the virtual sound source.
  • the position, direction and movement of the listener relative to the virtual sound source can be all detected easily and accurately.
  • the signal processing values of the delay circuit 22, the direction filters 12(t 0 ) to 12(t N ) can be changed by the controller 32 according to the detected position, direction and movement of the listener. It is therefor possible to change the sound image localization feeling more realistically according to the position, direction and movement of the listener relative to the virtual sound source.
  • the transfer characteristics (directional feeling) from the virtual sound source to both the listener's left and right ears can be synthesized with the input signals. It is thus possible to achieve pseudo-speaker sound reproduction and further to localize the sound image outside the listener's head.
  • the headphone reproducing apparatus can be so constructed that the reflected sounds synthesized with the transfer characteristics (directional feeling) are added to the input signals respectively. It is thus possible to achieve pseudo-speaker sound reproduction as if the sound were heard in a room having a reverberation effect and thereby to localize the sound image outside the listener's head more clearly.
  • the transfer characteristics can be synthesized by use of the direction filter 12(t 0 ) (transfer characteristic synthesizing means) and the direction filters 12(t 1 ) to 12(t N ) (reflected sound transfer characteristic synthesizing means).
  • Each direction filter has the delay circuits 13R and 13L, LFPs (frequency characteristic changing means) 14R and 14L, and multipliers (sound volume changing means) 15R and 15L, as shown in Fig. 4.
  • the transfer characteristics thus can be synthesized more realistically in spite of small-scale hardware.
  • the present invention can be provided with the detectors for detecting the position, direction and movement of the listener in order to, based on the detected values, change the processing values of the delay circuit 22, direction filters 12(t 0 ) to 12(t N ) as shown in Fig. 6.
  • the detectors for detecting the position, direction and movement of the listener in order to, based on the detected values, change the processing values of the delay circuit 22, direction filters 12(t 0 ) to 12(t N ) as shown in Fig. 6.
  • the extra-head virtual sound source localizing position can be kept unchanged even if the listener moves, it is possible to realize more realistic extra-head sound image localization feeling.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)
EP96303604A 1995-05-22 1996-05-21 Appareil de reproduction par casque d'écoute Expired - Lifetime EP0744881B1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP14832395 1995-05-22
JP7148323A JP2900985B2 (ja) 1994-05-31 1995-05-22 ヘッドホン再生装置
JP148323/95 1995-05-22

Publications (3)

Publication Number Publication Date
EP0744881A2 true EP0744881A2 (fr) 1996-11-27
EP0744881A3 EP0744881A3 (fr) 1999-06-09
EP0744881B1 EP0744881B1 (fr) 2004-07-14

Family

ID=15450221

Family Applications (1)

Application Number Title Priority Date Filing Date
EP96303604A Expired - Lifetime EP0744881B1 (fr) 1995-05-22 1996-05-21 Appareil de reproduction par casque d'écoute

Country Status (5)

Country Link
EP (1) EP0744881B1 (fr)
CN (1) CN1108083C (fr)
DE (1) DE69632889T2 (fr)
MY (1) MY124476A (fr)
SG (1) SG89238A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1054574A1 (fr) * 1998-01-08 2000-11-22 Sanyo Electric Co., Ltd. Dispositif de localisation d'images sonores
US8023659B2 (en) 2005-06-21 2011-09-20 Japan Science And Technology Agency Mixing system, method and program
WO2013076534A1 (fr) * 2011-11-21 2013-05-30 Sony Ericsson Mobile Communications Ab Détermination de la direction d'un écran d'affichage associé à un ensemble écouteur

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI498014B (zh) * 2012-07-11 2015-08-21 Univ Nat Cheng Kung 建立最佳化揚聲器聲場之方法
CN106714017B (zh) * 2015-07-17 2019-08-23 中兴通讯股份有限公司 一种调整耳机声场的方法、装置、终端及耳机
CN105307086A (zh) * 2015-11-18 2016-02-03 王宋伟 一种双声道耳机模拟环绕立体声的方法及系统
CN105578355B (zh) * 2015-12-23 2019-02-26 惠州Tcl移动通信有限公司 一种增强虚拟现实眼镜音效的方法及系统
CN110740415B (zh) * 2018-07-20 2022-04-26 宏碁股份有限公司 音效输出装置、运算装置及其音效控制方法
CN109640226A (zh) * 2018-11-10 2019-04-16 东莞市华睿电子科技有限公司 一种耳机音频转换成虚拟声的控制方法
CN112437385A (zh) * 2020-11-19 2021-03-02 袁志钢 耳机

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2296340A1 (fr) * 1974-12-25 1976-07-23 Matsushita Electric Ind Co Ltd Systeme d'ecoute au casque
JPS58198999A (ja) * 1982-05-17 1983-11-19 Matsushita Electric Ind Co Ltd 音像制御装置
GB2220818A (en) * 1988-07-15 1990-01-17 Gary Keith Henry Stereo systems
JPH02219400A (ja) * 1989-02-20 1990-08-31 Sanyo Electric Co Ltd 立体音響再生装置
EP0464217A1 (fr) * 1990-01-19 1992-01-08 Sony Corporation Appareil de reproduction de signaux acoustiques
JPH0682242A (ja) * 1992-08-31 1994-03-22 Victor Co Of Japan Ltd ３次元位置・姿勢検出方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB8900330D0 (en) * 1989-01-07 1990-04-25 British Aerospace Binaural display apparatus
WO1993026085A1 (fr) * 1992-06-05 1993-12-23 Noise Cancellation Technologies Casque d'ecoute actif/passif a filtre vocal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2296340A1 (fr) * 1974-12-25 1976-07-23 Matsushita Electric Ind Co Ltd Systeme d'ecoute au casque
JPS58198999A (ja) * 1982-05-17 1983-11-19 Matsushita Electric Ind Co Ltd 音像制御装置
GB2220818A (en) * 1988-07-15 1990-01-17 Gary Keith Henry Stereo systems
JPH02219400A (ja) * 1989-02-20 1990-08-31 Sanyo Electric Co Ltd 立体音響再生装置
EP0464217A1 (fr) * 1990-01-19 1992-01-08 Sony Corporation Appareil de reproduction de signaux acoustiques
JPH0682242A (ja) * 1992-08-31 1994-03-22 Victor Co Of Japan Ltd ３次元位置・姿勢検出方法

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN vol. 14, no. 520 (E-1002), 14 November 1990 & JP 02 219400 A (SANYO), 31 August 1990 *
PATENT ABSTRACTS OF JAPAN vol. 18, no. 333 (P-1759), 23 June 1994 & JP 06 082242 A (VICTOR CO. OF JAPAN), 22 March 1994 *
PATENT ABSTRACTS OF JAPAN vol. 8, no. 44 (E-229), 25 February 1984 & JP 58 198999 A (MATSUSHITA), 19 November 1983 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1054574A1 (fr) * 1998-01-08 2000-11-22 Sanyo Electric Co., Ltd. Dispositif de localisation d'images sonores
EP1054574A4 (fr) * 1998-01-08 2006-04-05 Sanyo Electric Co Dispositif de localisation d'images sonores
US8023659B2 (en) 2005-06-21 2011-09-20 Japan Science And Technology Agency Mixing system, method and program
WO2013076534A1 (fr) * 2011-11-21 2013-05-30 Sony Ericsson Mobile Communications Ab Détermination de la direction d'un écran d'affichage associé à un ensemble écouteur

Also Published As

Publication number Publication date
DE69632889D1 (de) 2004-08-19
DE69632889T2 (de) 2005-07-21
EP0744881B1 (fr) 2004-07-14
MY124476A (en) 2006-06-30
CN1140968A (zh) 1997-01-22
EP0744881A3 (fr) 1999-06-09
SG89238A1 (en) 2002-06-18
CN1108083C (zh) 2003-05-07

Similar Documents

Publication Publication Date Title
EP0788723B1 (fr) Procede et appareil de presentation efficace de signaux audio a trois dimensions
US6021205A (en) Headphone device
JP2964514B2 (ja) 音響信号再生装置
US6021206A (en) Methods and apparatus for processing spatialised audio
JP3258195B2 (ja) 音像定位制御装置
US5440639A (en) Sound localization control apparatus
EP0938832B1 (fr) Procede et dispositif de mise en correspondance de sources sonores avec des haut-parleurs
WO2017064368A1 (fr) Capture et mixage audio distribué
EP0744881B1 (fr) Appareil de reproduction par casque d'écoute
AU8032998A (en) System for producing an artificial sound environment
JPH08107600A (ja) 音像定位装置
WO2000045619A1 (fr) Dispositif source sonore virtuelle et appareil acoustique comportant un tel dispositif
JPH0946800A (ja) 音像制御装置
JP2900985B2 (ja) ヘッドホン再生装置
JP2910891B2 (ja) 音響信号処理装置
JP3573797B2 (ja) ステレオ音声再生装置
JPH08297157A (ja) 位置、向き及び動き検出装置、並びにこれを用いたヘッドホン再生装置
JP2947456B2 (ja) サラウンド信号処理装置及び映像音声再生装置
JP2751512B2 (ja) 音響信号再生装置
WO2023106070A1 (fr) Appareil de traitement acoustique, procédé de traitement acoustique et programme
JP3596202B2 (ja) 音像定位装置
EP4325888A1 (fr) Procédé de traitement d'informations, programme, et système de traitement d'informations
JPH10126898A (ja) 音像定位装置及び音像定位方法
JPH07203597A (ja) ヘッドホン再生装置
JP2893779B2 (ja) ヘッドホン装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): DE FR GB

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): DE FR GB

17P Request for examination filed

Effective date: 19991005

17Q First examination report despatched

Effective date: 20021010

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 69632889

Country of ref document: DE

Date of ref document: 20040819

Kind code of ref document: P

ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20050415

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20090515

Year of fee payment: 14

Ref country code: DE

Payment date: 20090514

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20090520

Year of fee payment: 14

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20100521

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20110131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20101201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100521