EP0700559B1 - Bildspeicherungssystem für fahrzeugidentifikation - Google Patents

Bildspeicherungssystem für fahrzeugidentifikation Download PDF

Info

Publication number
EP0700559B1
EP0700559B1 EP94916083A EP94916083A EP0700559B1 EP 0700559 B1 EP0700559 B1 EP 0700559B1 EP 94916083 A EP94916083 A EP 94916083A EP 94916083 A EP94916083 A EP 94916083A EP 0700559 B1 EP0700559 B1 EP 0700559B1
Authority
EP
European Patent Office
Prior art keywords
image
sensor
data representing
pin
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP94916083A
Other languages
English (en)
French (fr)
Other versions
EP0700559A1 (de
EP0700559A4 (de
Inventor
Roy William Lock
John Stanley Dods
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LOCKTRONIC SYSTEMS Pty Ltd
Original Assignee
LOCKTRONIC SYSTEMS Pty Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LOCKTRONIC SYSTEMS Pty Ltd filed Critical LOCKTRONIC SYSTEMS Pty Ltd
Publication of EP0700559A1 publication Critical patent/EP0700559A1/de
Publication of EP0700559A4 publication Critical patent/EP0700559A4/de
Application granted granted Critical
Publication of EP0700559B1 publication Critical patent/EP0700559B1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/052—Detecting movement of traffic to be counted or controlled with provision for determining speed or overspeed
    • G08G1/054—Detecting movement of traffic to be counted or controlled with provision for determining speed or overspeed photographing overspeeding vehicles
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/04—Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors

Definitions

  • the present invention relates to an image storage system.
  • the present invention relates to an image storage system suitable for use in connection with devices for detecting/recording overspeeding vehicles known generically as "speed cameras". Nevertheless, it is to be appreciated that it is not thereby limited to such applications.
  • Prior art devices used for detecting/recording vehicles which exceed speed limits are based on conventional photographic techniques using films coated with light sensitive emulsions which must be exposed, developed and stored in film or hard copy format. Such a device is known e.g. from DE-A-3 535 588. This is not only a costly procedure but creates bulky records in the form of rolls of exposed film which are cumbersome to store and handle. Because a typical roll of film may contain hundreds of traffic infringements or violations, access to a specific infringement or violation in such a roll of film is a time consuming exercise.
  • the image of a vehicle from which the license plate can be read and which shows the mandatory surrounding roadway and vehicles needs to have a relatively high resolution or definition.
  • the image typically needs to be made up of at least about 1.4 million picture elements or pixels, each able to represent one of about 64 shades of grey.
  • a file generated from such an image occupies over 1.4M Bytes of storage space.
  • state of the art file compression techniques can reduce this by up to 60% (570 K Bytes), the processing time involved reduces the overall operating speed considerably.
  • EP-A-0 132 795 discloses an image processing apparatus having a single image sensor.
  • An object of the present invention is to provide an image storage system which at least alleviates the disadvantage of the prior art.
  • the system of the present invention may reduce the size of an uncompressed file or record by a factor of at least 10 or more, yet still provide similar resolution or definition in a relevant area or portion of the record.
  • the system of the present invention may achieve a reduction in file or record size by capturing two images of a vehicle to be recorded, each having a relatively low resolution.
  • One image may be captured using a relatively long focal length or telephoto lens.
  • the telephoto image of the vehicle may show relatively fine or detailed features such as a vehicle license plate, vehicle make and model and in some cases facial features of the occupants.
  • a further image may be captured using a relatively wide angle lens.
  • the wide angle image may show relatively coarse or less detailed features such as the infringing vehicle in relation to the surrounding roadway and other vehicles. The infringing vehicle may still be clearly recognizable in the wide angle image.
  • the two images may be captured via at least one image sensitive device or sensor such as a CCD (charge coupled device) array or vidicon tube.
  • the or each image sensor may have relatively low resolution or definiton. Nevertheless, higher resolution or definition image sensors may be used since it is always possible to reduce resolution or definition by discarding superfluous or unwanted image data prior to recording the data.
  • the or each image sensor may be capable of generating data representing an image containing at least about 50,000 picture elements or pixels, with each element or pixel being able to represent one of about 64 shades of grey.
  • a record or file generated from such data may occupy no more than about 50 KBytes of storage space.
  • the record or file representing two such images for each vehicle infringement may occupy about 100 K Bytes of storage space whilst still containing relevant infringement data. This is less than one tenth of the size of a comparable single picture system without compression techniques.
  • apparatus for use with an image storage system, said apparatus including at least one image sensor for generating data representing an image applied to said sensor; means for applying a first image to said at least one sensor for generating first data representing relatively coarse features in said first image; means for applying a second image comprising an enlarged portion of said first image to said at least one sensor for generating second data representing relatively fine features in said first image, said second data representing said relatively fine features with a set level of definition and said first data representing said relatively coarse features with a level of definition which is below said set level, thereby reducing the quantity of said data for storage purposes.
  • an image storage system including:
  • the means for applying the first image may comprise a wide angle lens having a focal length of approximately 50mm.
  • the means for applying the second image may comprise a telephoto lens having a focal length of approximately 210 mm.
  • the two lenses may be associated with a single image sensor.
  • the image sensor may be fixed and the lenses may be movable or the lenses may be fixed and the sensor may be movable.
  • a single zoom lens eg. 50-210mm
  • each lens is associated with a respective image sensor.
  • the address lines of the respective image sensors may be driven in parallel via common driving circuits.
  • the apparatus may include a self contained board video camera. Two image sensors may be used with a single board video camera. The horizontal and vertical address lines of each image sensor may be driven in parallel via the board video camera.
  • the first and second images may be generated simultaneously or sequentially. Where the first and second images are generated sequentially, means such as a video switch or the like may be used to switch between the outputs of the respective image sensors.
  • the respective outputs may be processed in the usual way via the board video camera to provide a composite video or luminance signal at its output.
  • the composite video or luminance output signal may be connected to a frame grabber circuit.
  • the frame grabber circuit may include a memory.
  • the frame grabber circuit may also include an analog to digital converter.
  • the frame grabber circuit may be adapted to store one field (odd or even) from the composite video or luminance signal. Where the resolution of the composite or luminance video signal is greater than about 100,000 picture elements or pixels per frame (2 fields), the frame grabber circuit may be arranged to limit the quantity of data stored from each field such that the resolution of the stored field is limited to about 50,000 picture elements or pixels. This may ensure that the size or volume of the record or file for each field is of a manageable size.
  • the frame grabber circuit preferably is adapted to store the composite video signal in monochrome (luminance) to minimize the quantity of data stored from each field.
  • the frame grabber circuit may store a sample of the first and/or second image in color (luminance plus chrominance).
  • the color sample may be taken from a relatively small relevant portion or area of the first and/or second image, such as a portion showing the color of an infringing vehicle, and this may be stored together with the monochrome image.
  • the portion or area from which the color was sampled may appear in true color against a monochrome background.
  • This technique may provide additional means of vehicle identification with minimum increase in image file size.
  • a change from monochrome to colour usually results in a threefold increase in file size with proportional decrease in overall operating speed.
  • the increase in file size is limited to the sampled area. Thus if the sampled area is 1% of the overall image area a 2% increase in overall file size can be expected.
  • the frame grabber circuit may transfer its data to any suitable storage medium such as a computer hard disk, static RAM or the like.
  • the data may be transferred to storage medium with other infringement related information such as details of location, user ID, speed zone together with infringing vehicle speed, distance, time and date etc.
  • the associated computer may be programmed to control operation of the apparatus of the present invention. Alternatively a dedicated microprocessor based controller may be used.
  • the apparatus may be triggered via any suitable speed/distance measuring device such as a radar based speed detector or preferably a laser based speed detector such as a model LTI 20-20 manufactured by Laser Technology Inc. of Englewood, Colorado USA.
  • the speed detecting/recording apparatus may be stationary relative to the roadway or it may be mounted in a moving patrol vehicle. Where the apparatus is mounted in a moving patrol vehicle means such as a summer device may be provided to determine absolute speed of a target vehicle from the relative speed of that vehicle and the patrol vehicle. The relative speed of the target vehicle may be determined by a speed detector mounted in the patrol vehicle. The speed of the patrol vehicle may be determined via a speedometer or tachometer in the patrol vehicle.
  • the system includes a wide angle lens 10 and associated CCD image sensor 11.
  • the output (D) of image sensor 11 is connected to a first input of analog video switch 12 and to an automatic exposure interface 13 associated with wide angle lens 10.
  • Lens 10 comprises a 50mm galvanometer type auto - iris device such as a COSMICAR type MCA5018APC.
  • Auto exposure interface 13 amplifies and buffers signals from sensor 11 and supplies them to the galvanometer type auto iris associated with lens 10.
  • the system includes a telephoto lens 14 and associated CCD image sensor 15.
  • the output (C) from image sensor 15 is connected to a second input of analog video switch 12 and to an automatic exposure interface 16. Since compact telephoto type auto-iris lenses are not readily available, this was developed by modifying a 210mm focal length compact zoom lens (Sigma type) designed for a 35mm SLR camera.
  • the lens preferably is suitable for use in the infrared region for night time operation.
  • the zoom lens may be fixed at maximum focal length and the iris detent spring and ball associated with the ring removed.
  • a ring gear may be fitted to the iris ring and the lens fitted to an adapter to allow mounting of CCD sensor 15.
  • the adapter may also include a mounting for a DC micro-servo motor (Minimotor SA type 1016) which may drive the lens iris ring via a small spur gear.
  • Interface 16 may be adapted to sample a horizontal scan line, from image sensor 15 eg. about half way down the image. This sample may be converted to a suitable level and applied to drive the auto iris servo motor associated with telephoto lens 14. This arrangement may provide closed loop feedback to automatically control exposure of image sensor 15.
  • the system includes a self contained video camera module 17 such as a TMC-7 series CCD board camera manufactured by PULNIX.
  • Video camera module 17 includes horizontal and vertical driving circuits for CCD sensors 11 and 15, timing and synch generators and a video amplifier for producing a composite video output signal (B).
  • Camera module 17 may also include an auto iris control output for use with standard type auto iris lenses.
  • CCD sensors 11 and 15 are connected to the horizontal and vertical driving circuits on camera module 17 in parallel.
  • Video switch 12 is adapted to alternately connect the output (D) of sensor 11 or output (C) of sensor 15 to the CCD sensor input (E) of camera module 17 under control of interface and logic control module 18. The latter is described in more detail with reference to Fig. 2.
  • the composite video output signal (B) is connected to interface and logic control module 18 and to frame grabber 19 associated with an IBM compatible personal computer (PC) 20.
  • Frame grabber 19 may comprise a PC frame grabber card such as a FG 302 TV frame grabber PCB. Frame grabber 19 may occupy a single slot in PC 20. Its function is to digitize and store one field of a monochrome or color TV signal with (approximately) 256 x 256 pixel resolution (7 bits grey scale resolution per pixel) and to transfer the image data to the computer memory (RAM) in a sequence of DMA cycles.
  • a TV monitor output of the stored image is not provided on the FG 302. However images may be displayed on a monitor (eg. LCD) associated with PC 20.
  • the system is triggered via a trigger device 21 such as a laser based speed detector (eg. LTI 20-20) connected to PC 20 via an RS 232 port 22.
  • a trigger device 21 such as a laser based speed detector (eg. LTI 20-20) connected to PC 20 via an RS 232 port 22.
  • interface and logic control module 18 comprises a synch separator 23 such as an LM 1881.
  • Synch separator 23 receives at its input a composite video signal (B) from camera module 17 and provides at its output an odd/even field signal having a falling edge at the end of an odd field and a rising edge at the end of an even field. The odd/even field signal is connected to one input of RS bistable latch 24.
  • Synch separator 23 also provides at its output a vertical synch pulse (K) to auto exposure interface 16.
  • a control signal (A) to latch 24 is provided from RS 232 port 22 of PC 20.
  • the Q and Q outputs of latch 24 are adapted to control the position of analog video switch 12 which alternately switches the signal (C) from sensor 15 or the signal (D) from sensor 11 to the CCD input (E) of camera module 17.
  • control signal (A) from PC 20 is connected to one input of latch 41A and B (4011) via diode D3 and resistor R1.
  • Control signal (A) switches latch 41A and B causing a change in output signals (H and J) to video multiplexer switch IC6A and C (4066).
  • This causes the input signal (E) to camera module 17 to change from, say, output (D) from wide angle sensor 11 to output (C) from telephoto sensor 15.
  • Lines (C), (D) and (E) are single lines. All other lines between sensors 11, 15 and camera module 17 are connected in parallel.
  • Control signal (A) also instructs frame grabber 19 to store the next odd field from composite input signal (B). Following this, PC 20 carries out a Direct Memory Access (DMA) transfer of image data from frame grabber 19 to Random Access Memory (RAM).
  • DMA Direct Memory Access
  • a further control signal (A) returns video multiplexer switch IC 6A and C to its previous state causing the output (D) from wide angle sensor 11 to be connected to the input (E) to camera module 17.
  • Control signal (A) again instructs frame grabber 19 to store the next odd field.
  • Image data from wide angle sensor 11 is again transferred to RAM via DMA. Details of location, user ID and speed zone are entered into PC 20 during set-up and this data, together with the infringing vehicle speed, distance, time and date may be embedded into a single file with the two images of an infringing vehicle. This complete file, occupying about 102 KBytes is stored on the hard disk of PC 20.
  • Auto exposure interface 13 comprises a converter/driver made up of transistor M1, resistors R7, R8, R11 and R13 and capacitors C6, C8 and C16.
  • An output (D) from wide angle sensor 11 is applied to the base of transistor M1 via capacitor C16 and resistor R11.
  • the output (F) of the converter/driver is available at capacitor C8 and is applied to the auto iris drive of wide angle lens 10.
  • Night time operation may be enabled by a 2mS duration signal from monostable IC3A (4528) which is synchronized to the effective camera "shutter open" period via latch 41A and B.
  • This signal may be transmitted to a large array of infra-red diodes placed at a distance at which the speed detector or trigger (eg. LT1 20/20) is set to operate.
  • the speed detector or trigger eg. LT1 20/20
  • the infra-red filter normally fitted to the CCD camera may be removed.
  • the depth of field of the lenses preferably are arranged to produce well focused images in the range 60-100m.
  • the speed detector/trigger may be placed in automatic mode where a target vehicle distance falls within a defined window before a reading is taken. This distance may be chosen to be optimum for lens focus and infra-red illumination and may be adjustable.
  • frame grabber 19 stores a frame from output (C) from telephoto image sensor 15 before it stores a frame from output (D) from wide angle image sensor 11.
  • an output (C) from telephoto sensor 15 is routed via diode D6 to DC amplifier IC5 (LM108).
  • the output from DC amplifier IC5 is applied to the input of sample and hold amplifier IC6 (LF 398).
  • the command to sample is obtained from sample time monostable IC4B (4528) set to 52 ⁇ S (duration of one line).
  • Monostable IC4B is triggered via monostable IC4A (4528) approximately 10mS (duration of half a frame) after each vertical sync pulse provided by sync separator IC2 (LM1881) (refer to Fig. 3).
  • the sample voltage is then proportional to the brightness of a single horizontal scan line approximately half way down a field. Samples representing lines or parts of lines elsewhere in a field may be chosen by changing the timing of monostables IC4A and/or IC4B.
  • the sample voltage is applied to servo amplifier IC7 (L272M) comprising dual power op amps which drive the auto iris servo associated with telephoto lens 14.
  • the iris servo is isolated from low out-of-range signals by means of microswitch S1, mounted on the lens body.
  • Steering diodes D4 and D5 provide individual direction control.
  • actuation of the trigger device produces an output which passes via interfaces 50, 51 to an associated computer (not shown) and is examined by an operation program (refer to Fig. 6) stored in the computer.
  • the program examines the output of the trigger device and decides whether the data is valid according to criteria of the trigger device. If so, the program compares the captured speed of a target vehicle with a pre-set limit. If this has been exceeded a high state signal is sent from the computer to logic module 52 via interface 51.
  • Logic module 52 controls, inter alia, switching to camera module 57, outputs (CCD OUT) from CCD sensor 53 associated wide angle lens 54, and from CCD sensor 55 associated with telephoto lens 56, respectively.
  • the high state signal instructs logic module 52 to switch to camera module 57 the output from telephoto sensor 55.
  • the operation program then instructs the computer to store image data from telephoto sensor 55.
  • a low state signal is then sent from the computer to logic module 52.
  • the low state signal instructs logic module 52 to switch to camera module 57 the output from wide angle sensor 53.
  • the operation program then instructs the computer to store image data from wide angle sensor 53.
  • the image data is then transferred into memory, a unique file name is created and time, date, vehicle speed and distance are appended to the file which is then stored onto hard disk.
  • the computer is then ready to accept a new infringement.
  • Logic module 52 also controls an auto iris servo motor (not shown) associated with wide angle lens 54, and via drive signals applied to iris module 58, controls auto iris servo motor 59 associated with telephoto lens 56.
  • horizonal and vertical drive between camera module 57 and sensors 53, 55 (H & V drive) is shown as a single line, it represents 12 horizonal and vertical lines.
  • the electronic shutter speed of camera module 57 is fixed internally to 1/500 sec.
  • Camera module 57 provides both a composite color output and a Y/C (luminance/chrominance) output.
  • the luminance output is fed to a frame grabber associated with the computer via interface 51.
  • the luminance output is preferred since encoded color information substantially degrades a monochrome image.
  • the "Y" signal also contains all of the synchronizing signals necessary to drive various parts in the circuit.
  • a composite color signal is provided as an output to the system to assist in setting up and for continuous monitoring of the video signal if required. Images so produced appear as normal color video. As a violation or infringement is recorded, the output switches from the wide angle lens to the telephoto lens for two frames and then back again, providing a useful video tape back up if required.
  • a high level signal sent from the associated computer is routed to the circuit via port J7.
  • Possible voltage spikes are limited via zener diode Z1, while resistor R1 limits current flow into Z1 and resistor R2 provides a DC current path to ground from input pin 4 of IC2 which comprises a programmable logic device (PLD) such as an EP910J.
  • PLD programmable logic device
  • Fig. 8 which shows the circuit embedded in PLD IC2
  • input pin 4 is applied to macrocell ICZ2 which has no function save to transmit identical signals from input to output. This signal is additionally routed via macrocell ICZ3 to output pin 11.
  • the output from pin 11 of IC2 is fed to the bases of NPN transistors N1, N2 via resistors R18, R19 respectively, which serve to limit base current.
  • Relays R16, R17 form the collector loads for transistor N1, N2 respectively while diodes D7, D8 clip any reverse voltage spikes caused by the inductance of relay coils associated with relays R16, R17.
  • Relays R16, R17 switch port J5 associated with the input to camera module 57 (Fig. 5), between port J4 associated with the output of telephoto CCD sensor 55, and port J6 associated with the output of wide angle CCD sensor 53.
  • Resistors R3 and R4 provide impedance matching for CCD sensors 55 and 53 respectively.
  • Relays R16, R17 each comprises a double pole relay to optimize isolation between signals from the wide angle and telephoto sensors 55, 53 respectively.
  • Capacitors C5 and C6 minimize cross talk between the outputs of the respective sensors while resistor R5 provides a suitable input impedance to camera module 57.
  • both transistors N1, N2 are turned off, neither relay R16, R17 is energized and the output from wide angle sensor 53 is routed from port J6 through a normally closed contact associated with pin 4 of relay R17 across a moving contact set from pins 2 to 7 of relay R17 and out on pin 5 of relay R17 where it is routed to the input of camera module 57 via port J5.
  • Capacitor C6 has a negligible effect on the video signal.
  • Signals from telephoto sensor 55 are routed from port J4 via pin 3 to pin 2 of relay R16. Radiation of this signal is minimized via capacitor C6.
  • the computer When the computer outputs a signal via port J7 to change from telephoto sensor 55 to wide angle sensor 53, a high level signal is applied to the bases of transistors N1, N2. This causes the collector currents so produced to energize both relays R16, R17.
  • the signal produced by telephoto sensor 55 is routed via port J4, then transferred from pin 3 of relay R16 via pins 2 and 7 to pin 6 which is connected to the input of camera module 57 via port J5. Wide angle sensor 53 is disconnected via pin 4 of relay R17 and radiation of this signal is minimized by capacitor C6.
  • the computer then instructs the frame grabber to freeze a frame taken via telephoto sensor 55. This is followed by a command to transfer the contents of this stored frame into memory. On completion of this action the computer issues a further signal via port J7 to change the signal path to the original route. Port J7 is pulled low by the computer allowing both transistors N1, N2 to be turned off. Both relays R16, R17 are released. The signal from telephoto sensor 55 via port J4 is transferred from pin 3 of relay R16 to pin 2 disconnecting it from the input of camera module 57. The signal from wide angle sensor 53 is connected to pin 4 of relay R17 and via pin 2 to pin 7 then to pin 5 of relay R17 and to port J5.
  • the computer waits for the next odd field, then issues a further signal to the frame grabber to freeze the second image taken via wide angle sensor 53.
  • This image data is transferred into memory, a unique file name is created and time, date, vehicle speed and distance one appended to the file which is then stored onto hard disk.
  • the computer is then ready to accept a new infringement.
  • Capacitor C1 excludes unwanted lower frequencies from the signal while resistors R6, R7 form a voltage divider to suitably proportion the signal. Capacitor C2 prevents dc interaction between the base of transistor T1 and the incoming signal. Resistors R8, R9 provide a collector load and appropriate forward bias for transistor T1. The dc component of the amplified signal is filtered via capacitor C3 and the resulting signal is applied to drive the wide angle auto iris via port J2. Electrolytic capacitor E1 provides decoupling of the power supply line.
  • Automatic aperture control of the auto iris associated with the telephoto lens is provided by means of a separate sampling circuit.
  • Composite video signals are fed to port J8 from camera module 57.
  • the composite video signals are applied to pin 2 of synch separator IC5 (LM 1881) via dc blocking capacitor C10.
  • IC5 When provided with composite video signals, IC5 provides outputs of odd/even fields at pin 7, vertical synch at pin 3, horizontal synch at pin 15 and composite synch which is not used in this application.
  • Capacitor C9 and resistor R28 provide the correct time constant for the internal frame integrator of IC5.
  • a negative going vertical synch pulse from pin 3 of IC5 is applied to pin 3 of PLD IC2, while horizontal synch pulses from pin 5 of IC5 are applied to pin 19 of IC2.
  • input pin 3 is applied to pin 1 of two input NAND latch IC1A.
  • this high level is output from ICG for the 64 ⁇ S duration of horizontal line 159 via macrocell ICK2 to output pin 12 of IC2.
  • Counters ICB and ICC continue counting until a count of 255 is reached when the ripple-carry out (RCO) pin 15 of ICC goes high.
  • This signal is inverted via ICD and applied to pin 2 of IC1A which sets pin 3 low and prevents clock pulses from reaching counters ICB and ICC thus leaving the counters in this state. This provides timing for a sample signal from a horizontal line approximately half way down the image.
  • this sample signal is outputted on pin 12 of IC2 via diode D6 to pin 2 of port J1.
  • Diode D6 prevents accidental voltages appearing at pin 2 of port J1 from destroying IC2.
  • Resistor R15 provides some degree of static protection for pin 12 of IC2 when left disconnected for servicing.
  • the sample signal so generated is fed from pin 2 of port J1 to pin 8 of IC2 (LF 398), a sample and hold amplifier.
  • IC2 LF 398
  • sample and hold amplifier IC2 takes a sample of the voltage produced by telephoto sensor 55 which is a close approximation of the average light level across the entire 159th horizontal line.
  • the analog input to pin 3 of sample and hold amplifier IC2 is provided from telephoto sensor 55 via pin 3 of port J1 and is scaled to an appropriate level by a voltage divider comprising resistors R12, R13.
  • the same signal is applied to pin 3 of IC1 (LF 398), a second sample and hold amplifier.
  • the logic input (pin 8) of sample and hold amplifier IC1 is provided by PNP transistor T1.
  • Transistor T1 forms an inverting amplifier which is gated on during the black level period by the 'horizontal sync' pulses decoded by IC5 of Fig. 7. These pulses are labelled 'burst' as they are intended to provide timing for the color burst of a composite video signal. However, they conveniently occur at black level when monochrome video is used.
  • Capacitor C7 blocks the dc component of the "horizontal synch”.
  • Resistor R19 holds transistor T1 in the 'off' state except during the negative going "horizontal sync" pulses applied to the base which turn it on for the duration of each pulse.
  • Resistor R18 provides the collector load for transistor T1. Positive going pulses appearing at the collector of T1 are applied to the logic input (pin 8) of IC1 and provide a 'black level' reference at pin 5 of IC1.
  • Electrolytic capacitor E4 provides decoupling of the power supply line.
  • Capacitor C3 provides requisite storage for the black level sample, while capacitor C6 provides requisite storage of the 159th line of the CCD sensor output.
  • Suitable offset reference for IC1 is provided by a voltage divider comprising resistors R9, R10.
  • Output signals obtained at respective pins 5 of amplifiers IC1, IC2 are applied to the inputs of differential amplifier IC3 (LM108).
  • the dc gain of IC3 is set by resistors R4, R5, R3 and R11. Frequency compensation is provided by capacitor C1 while frequency response is limited to an extremely low level by capacitor C2. Further, limiting and smoothing of the signal is provided by resistor R6 and electrolytic capacitor E1.
  • IC4 (L272M) contains two operational amplifiers and because of its output drive capability is used as a driver for the telephoto lens iris servo-motor.
  • the error signal provided by IC3 is fed to one inverting input (pin 8) of IC4 via resistor R31.
  • Resistors R31, R14 control the dc gain of this driver amplifier.
  • Resistor R7, trimpot P1 and resistor R8 form a voltage divider with an adjustable operating point. Trimpot P1 is used to set a reference signal which is associated with the appropriate light level reaching telephoto sensor 55.
  • Electrolytic capacitor E7 stabilizes the reference signal against minor noise and spikes. This reference signal is applied to a non-inverting input (pin 7) of one amplifier of IC4.
  • the second amplifier of IC4 is used to provide a high current, voltage centre point allowing bi-directional operation of the telephoto iris DC servo motor connected via port J11.
  • a reference voltage for this second amplifier is provided at pin 6 of IC4 from a voltage divider comprising resistors R16, R17 with unwanted noise being filtered by electrolytic capacitor E6.
  • a small amount of positive feedback is applied to the system via resistor R26.
  • the error drive signal is applied to the telephoto iris drive motor connected between pins 1 and 3 of IC4 via diode D6.
  • Diodes D6, D7 are included to prevent stalling of the servo motor when maximum aperture is reached. When this happens, the contacts of limit switch J12 open and current can only flow in the direction necessary to close the aperture. During normal operation the contacts of limit switch J12 are closed and diodes D6, D7 are in parallel and allow bi-directional operation of the iris servo motor. It was found unnecessary to include a second limit switch at maximum lens aperture as maximum light levels do not reach this point. Capacitor C4 and resistor R15 prevent spurious oscillations in this section of the circuit.
  • Flash synchronization is provided by means of a 2mS synch pulse generated for each picture by the system. Referring to Fig. 8, it may be seen that for every edge applied at input pin 4, a negative going spike, the duration of which is equal to the total transfer time of gates ICZ2 and ICZ will be formed at the output (pin 3) of XOR gate ICY.
  • Input pin 5 is connected to odd/even field pin 7 of IC5 in Fig. 7 and goes high at the beginning of an odd field. With pin 1 of ICU normally high, pin 3 must be low. At the beginning of the next odd field (which is the only time the frame grabber can be instructed to store an image) the odd/even field signal at pin 2 of ICU produces a negative going spike at the output (pin 3) of ICX, the duration of which is equal to the transfer time of gates ICV and ICW.
  • This spike coincides with the start of an image to be captured and is applied to pin 1 of ICK.
  • This action sets pin 3 of ICK high, allowing 'horizontal synch' pulses through gate ICJ to clock counters ICL1 and ICL2.
  • the binary outputs of these counters are decoded by ICM at a count of 31. This number of 64 ⁇ S pulses produces a period of 1984 ⁇ S.
  • the output of ICM goes low when 31 is decoded. This low going signal is applied to input pin 2 of ICK.
  • This action sets output pin 3 low stopping further 'horizontal synch' pulses from clocking the counters.
  • the positive going edge on the input of ICN generates a negative going spike at the output of ICQ which is applied to the "clear" inputs of counters ICL1 and ICL2, resetting these counters to zero.
  • the duration of the "strobe" signal at ICK pin 3 is approximately 2mS and is output at gate ICK3 and output pin 9.
  • the strobe signal at pin 9 of IC2 goes high for approximately 2mS and is applied to the base of NPN transistor T via resistor R14.
  • Transistor T is configured as an emitter follower with load provided via resistor R27. This buffered signal is taken from the emitter load and outputted at port J9.
  • IC regulator L1 (LM2948) is configured as a 10 volt regulator.
  • a 12 volt supply is applied to input pin 1 with some smoothing carried out by electrolytic capacitor E7.
  • Diode D2 minimizes damage by reverse voltage at the input.
  • Resistors R10, R11 form a reference voltage for regulator L1, while electrolytic capacitor E3 minimizes noise and ensures stability of this signal.
  • Electrolytic capacitor E2 provides further filtering of the regulated 10 volt supply.
  • Diode D1 protects regulator L1 from residual charge on capacitor E2 destroying L1 should the 12 volt input be shorted to ground.
  • IC regulator L2 (LM317) is configured as a 5 volt regulator. A 12 volt supply is applied to input pin 3. The reference voltage is set by voltage divider resistors R12, R13 while electrolytic capacitor E4 minimizes noise and ensures stability of regulator L2. Electrolytic capacitor E5 provides further filtering of the voltage supply.
  • Electrolytic capacitors E6 and E1 perform bypass functions and are sited appropriately to prevent current drawn by active circuit elements from generating disturbances on the supply rails.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Warehouses Or Storage Devices (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Television Signal Processing For Recording (AREA)
  • Image Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Claims (13)

  1. Vorrichtung, die zur Verwendung mit einem Bildspeichersystem geeignet ist, wobei die Vorrichtung umfaßt:
    zumindest einen Bildsensor (11, 15, 53, 55) zur Erzeugung von Daten, die ein auf den Sensor gerichtetes Bild repräsentieren;
    eine Einrichtung (10, 13) zum Richten eines ersten Bildes auf den mindestens einen Sensor zur Erzeugung erster Daten, die relativ grobe Merkmale in dem ersten Bild repräsentieren;
    eine Einrichtung (14, 16) zum Richten eines zweiten Bildes einschließlich einem vergrößerten Teil des ersten Bildes auf den mindestens einen Sensor zur Erzeugung zweiter Daten, die relativ feine Merkmale in dem ersten Bild repräsentieren;
    wobei die zweiten Daten die relativ feinen Merkmale mit einem vorgegebenen Definitionsniveau repräsentieren und die ersten Daten die relativ groben Merkmale mit einem Definitionsniveau repräsentieren, das unter dem vorgegebenen Niveau liegt, wodurch die Menge der Daten zu Speicherzwecken reduziert wird.
  2. Vorrichtung gemäß Anspruch 1, wobei der mindestens eine Bildsensor ein CCD-Array (charge coupled device array) umfaßt.
  3. Vorrichtung gemäß Anspruch 1 oder 2, wobei die Einrichtung zum Richten des ersten Bildes eine Weitwinkellinse (10) umfaßt und die Einrichtung zum Richten des zweiten Bildes eine Telephotolinse (14) umfaßt.
  4. Vorrichtung gemäß einem der vorherigen Ansprüche umfassend eine Verarbeitungseinrichtung (19, 20, 22) zur Bedienungssteuerung der Vorrichtung.
  5. Vorrichtung gemäß Anspruch 4, wobei die Verarbeitungseinrichtung einen Digitalcomputer (20) mit einer Speichereinrichtung zur Speicherung der Daten umfaßt.
  6. Vorrichtung gemäß Anspruch 4 oder 5, wobei die Verarbeitungseinrichtung einen Bildabnehmer (frame grabber) (19) zum Einfrieren der Daten umfaßt.
  7. Vorrichtung gemäß Anspruch 5 oder 6, wobei die Vorrichtung angepaßt ist, um geschwindigkeitsüberschreitende Fahrzeuge aufzunehmen.
  8. Ein Bildspeichersystem umfassend:
    mindestens einen Bildsensor (11, 15, 53, 55) zur Erzeugung von Daten, die ein auf den Sensor gerichtetes Bild repräsentieren;
    eine Einrichtung (10, 13) zum Richten eines ersten Bildes auf den mindestens einen Sensor zur Erzeugung erster Daten, die relativ grobe Merkmale in einem ersten Bild repräsentieren;
    eine Einrichtung (14, 16) zum Richten eines zweiten Bildes einschließlich einem vergrößerten Teil des ersten Bildes auf den mindestens einen Sensor zur Erzeugung zweiter Daten, die relativ feine Merkmale in dem ersten Bild repräsentieren;
    wobei die zweiten Daten die relativ feinen Merkmale mit einem vorgegebenen Definitionsniveau repräsentieren und die ersten Daten die relativ groben Merkmale mit einem Definitionsniveau repräsentieren, das unter dem vorgegebenen Niveau liegt; und
    eine Einrichtung (20) zum Speichern der Daten.
  9. Ein System gemäß Anspruch 1, wobei der mindestens eine Bildsensor ein CCD-Array (charge coupled device array) umfaßt.
  10. Ein System gemäß Anspruch 8 oder 9, wobei die Einrichtung zum Richten des ersten Bildes eine Weitwinkellinse (10) umfaßt und die Einrichtung zum Richten des zweiten Bildes eine Telephotolinse (14) umfaßt.
  11. Ein System gemäß einem der Ansprüche 8 bis 10, umfassend eine Verarbeitungseinrichtung (19, 20, 22) zur Bedienungssteuerung des Systems.
  12. Vorrichtung zum Aufnehmen geschwindigkeitsüberschreitender Fahrzeuge umfassend ein Bildspeichersystem gemäß einem der Ansprüche 8 bis 11.
  13. Vorrichtung gemäß Anspruch 12, wobei die Vorrichtung durch einen Geschwindigkeitsmesser (21) ausgelöst wird.
EP94916083A 1993-05-24 1994-05-23 Bildspeicherungssystem für fahrzeugidentifikation Expired - Lifetime EP0700559B1 (de)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
AUPL894493 1993-05-24
AUPL8944/93 1993-05-24
AUPL894493 1993-05-24
PCT/AU1994/000260 WO1994028527A1 (en) 1993-05-24 1994-05-23 Image storage system for vehicle identification

Publications (3)

Publication Number Publication Date
EP0700559A1 EP0700559A1 (de) 1996-03-13
EP0700559A4 EP0700559A4 (de) 1997-01-02
EP0700559B1 true EP0700559B1 (de) 2000-02-02

Family

ID=3776911

Family Applications (1)

Application Number Title Priority Date Filing Date
EP94916083A Expired - Lifetime EP0700559B1 (de) 1993-05-24 1994-05-23 Bildspeicherungssystem für fahrzeugidentifikation

Country Status (10)

Country Link
EP (1) EP0700559B1 (de)
JP (1) JP3410470B2 (de)
AT (1) ATE189551T1 (de)
DE (1) DE69422918T2 (de)
DK (1) DK0700559T3 (de)
ES (1) ES2144521T3 (de)
GR (1) GR3033355T3 (de)
HK (1) HK1013157A1 (de)
PT (1) PT700559E (de)
WO (1) WO1994028527A1 (de)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5938717A (en) * 1996-03-04 1999-08-17 Laser Technology, Inc. Speed detection and image capture system for moving vehicles
US6760061B1 (en) 1997-04-14 2004-07-06 Nestor Traffic Systems, Inc. Traffic sensor
JPH11213137A (ja) 1998-01-29 1999-08-06 Matsushita Electric Ind Co Ltd 画像処理装置
US6546119B2 (en) * 1998-02-24 2003-04-08 Redflex Traffic Systems Automated traffic violation monitoring and reporting system
WO2000031707A1 (en) 1998-11-23 2000-06-02 Nestor, Inc. Non-violation event filtering for a traffic light violation detection system
FR2797081B1 (fr) * 1999-07-29 2002-10-31 Positive Procede d'identification d'un vehicule automobile immatricule et appareil d'identification de vehicule automobile correspondant
DE19960887A1 (de) * 1999-12-17 2001-06-21 Robot Foto Electr Kg Ortsinformation bei Dateikompression
US7986339B2 (en) 2003-06-12 2011-07-26 Redflex Traffic Systems Pty Ltd Automated traffic violation monitoring and reporting system with combined video and still-image data
US7821422B2 (en) 2003-08-18 2010-10-26 Light Vision Systems, Inc. Traffic light signal system using radar-based target detection and tracking

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA1248218A (en) * 1983-07-29 1989-01-03 William R. Wray Method and apparatus for image processing with field portions
US4742558A (en) * 1984-02-14 1988-05-03 Nippon Telegraph & Telephone Public Corporation Image information retrieval/display apparatus
DE3535588A1 (de) * 1985-10-05 1987-04-09 Robot Foto Electr Kg Verfahren und vorrichtung zur photographischen erfassung stark leuchtender oder reflektierender teile eines zu photographierenden gesichtsfeldes
GB2266398A (en) * 1992-04-16 1993-10-27 Traffic Technology Limited Vehicle monitoring apparatus

Also Published As

Publication number Publication date
GR3033355T3 (en) 2000-09-29
ES2144521T3 (es) 2000-06-16
EP0700559A1 (de) 1996-03-13
HK1013157A1 (en) 1999-08-13
JPH08510349A (ja) 1996-10-29
EP0700559A4 (de) 1997-01-02
PT700559E (pt) 2000-07-31
JP3410470B2 (ja) 2003-05-26
WO1994028527A1 (en) 1994-12-08
DK0700559T3 (da) 2000-07-24
DE69422918T2 (de) 2000-10-12
DE69422918D1 (de) 2000-03-09
ATE189551T1 (de) 2000-02-15

Similar Documents

Publication Publication Date Title
US5938717A (en) Speed detection and image capture system for moving vehicles
US7986248B2 (en) Image recording apparatus and method
EP0700559B1 (de) Bildspeicherungssystem für fahrzeugidentifikation
WO1993021617A1 (en) Vehicle monitoring apparatus
US5936668A (en) Color image display device
EP0243977B1 (de) Stehbildkamera
KR100825669B1 (ko) 교차로통합관리시스템
CA2163424C (en) Image storage system for vehicle identification
AU694731B2 (en) Imaging apparatus and storage system for vehicle identification
EP0621572A1 (de) Verfahren und Vorrichtung zur elektronischen Aufzeichnung eines Vorfalles zum Beispiel einer Verkehrsübertretung
JP2002109589A (ja) 駐車場管理装置
JP3230998B2 (ja) 移動撮影装置
KR970049930A (ko) 차량 식별용 영상 처리 시스템 및 그의 운용 방법
JPH06129845A (ja) 路面状態検査装置
JPH0329100A (ja) 駐車違反自動警告装置
JPH1145394A (ja) 信号無視自動取締装置
JPS6246920B2 (de)
JP2663924B2 (ja) 車両ナンバープレート読み取り装置
JPH0512880Y2 (de)
JP2001266192A (ja) 入車記録装置
JPH0329099A (ja) 駐車違反自動監視システム
JPH07152992A (ja) 違法車両検出装置
JPH0562096A (ja) 速度違反取締装置
JP2595510B2 (ja) 車両ナンバープレート読み取り装置
KR970076401A (ko) 이동형 레이저 자동 영상 속도 측정장치

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 19951219

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LI LU MC NL PT SE

A4 Supplementary search report drawn up and despatched

Effective date: 19961112

AK Designated contracting states

Kind code of ref document: A4

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LI LU MC NL PT SE

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

17Q First examination report despatched

Effective date: 19990407

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LI LU MC NL PT SE

REF Corresponds to:

Ref document number: 189551

Country of ref document: AT

Date of ref document: 20000215

Kind code of ref document: T

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REF Corresponds to:

Ref document number: 69422918

Country of ref document: DE

Date of ref document: 20000309

ITF It: translation for a ep patent filed
REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20000523

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: A. BRAUN, BRAUN, HERITIER, ESCHMANN AG PATENTANWAE

ET Fr: translation filed
REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2144521

Country of ref document: ES

Kind code of ref document: T3

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

REG Reference to a national code

Ref country code: PT

Ref legal event code: SC4A

Free format text: AVAILABILITY OF NATIONAL TRANSLATION

Effective date: 20000428

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20001130

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed
REG Reference to a national code

Ref country code: GB

Ref legal event code: IF02

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PT

Payment date: 20050505

Year of fee payment: 12

Ref country code: IE

Payment date: 20050505

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20050507

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: AT

Payment date: 20050510

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20050517

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20050518

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20050524

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20050525

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20050526

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GR

Payment date: 20050530

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20050531

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: BE

Payment date: 20050606

Year of fee payment: 12

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060523

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060523

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060524

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060524

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060531

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060531

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060531

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060531

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20060531

Year of fee payment: 13

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20061123

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20061201

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20061201

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

Ref country code: DK

Ref legal event code: EBP

EUG Se: european patent has lapsed
REG Reference to a national code

Ref country code: PT

Ref legal event code: MM4A

Free format text: LAPSE DUE TO NON-PAYMENT OF FEES

Effective date: 20061123

NLV4 Nl: lapsed or anulled due to non-payment of the annual fee

Effective date: 20061201

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20070131

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20060524

BERE Be: lapsed

Owner name: *LOCKTRONIC SYSTEMS PTY. LTD

Effective date: 20060531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20061205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070523

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20130411

Year of fee payment: 20

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

Expiry date: 20140522

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20140522