EP1024748B1 - Imaging apparatus - Google Patents

Imaging apparatus Download PDF

Info

Publication number
EP1024748B1
EP1024748B1 EP98950188A EP98950188A EP1024748B1 EP 1024748 B1 EP1024748 B1 EP 1024748B1 EP 98950188 A EP98950188 A EP 98950188A EP 98950188 A EP98950188 A EP 98950188A EP 1024748 B1 EP1024748 B1 EP 1024748B1
Authority
EP
European Patent Office
Prior art keywords
user
camera
mirror
reflector
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP98950188A
Other languages
German (de)
French (fr)
Other versions
EP1024748A1 (en
Inventor
David John Mccartney
Christopher Henry Seal
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
British Telecommunications PLC
Original Assignee
British Telecommunications PLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by British Telecommunications PLC filed Critical British Telecommunications PLC
Priority to EP98950188A priority Critical patent/EP1024748B1/en
Publication of EP1024748A1 publication Critical patent/EP1024748A1/en
Application granted granted Critical
Publication of EP1024748B1 publication Critical patent/EP1024748B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/117Identification of persons
    • A61B5/1171Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • A61B5/1176Recognition of faces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/19Sensors therefor

Definitions

  • the present invention relates to an imaging apparatus. It has particular utility in relation to an imaging apparatus operable to obtain an image of one or more facial features of a user.
  • the apparatus includes an image capture unit comprising a wall-mounted body portion which rotatably supports a tiltable housing containing the optical elements used in the apparatus.
  • the camera and path-bending optics inside the housing are arranged so as to provide the camera with a view through an aperture provided in the front wall of the tiltable housing.
  • the housing additionally contains a liquid crystal display (LCD display) which is viewed by the user during the iris recognition procedure through the same aperture.
  • the LCD display is driven by the video signal which is currently being output by the camera.
  • the user moves his head until the LCD display shows an in-focus image of one of his eyes.
  • the depth of focus of the apparatus is limited and the user must position his head within a relatively narrow range of distances from the apparatus.
  • the magnification of the optical system is arranged such that, when in focus, the image of one eye fills more than one-third of the field of view of the camera. This is useful in assuring that the iris is imaged in sufficient detail to obtain an iris data sequence which is unique to that iris.
  • iris recognition apparatuses avoid the requirement that the user moves his head to a preferred position in relation to the apparatus, instead providing a camera with both an auto-focus and an auto-zoom facility. Although this relaxes the constraints imposed on the distance between the user and the apparatus, it does not provide a facility for aligning the eye within the field of view of the camera. Hence, the use of a Pan Tilt Zoom camera in conjunction with eye-tracking techniques has been proposed to ensure that the user's eye is included within the obtained image. The use of such devices markedly increases the unit production cost of the imaging component of the iris recognition apparatus.
  • Identification Technologies International Inc. produce a PAC-1000 facial recognition system.
  • the image capture part of the apparatus has a mirror on its front surface in which the user can see his reflection. Although this places constraints on the transverse position of the user's face, it does not place any positive constraints on the distance between the user and the device.
  • the user is, of course, able to estimate his distance from the apparatus owing to its apparent size (i.e. owing to perspective), but that is not a sufficiently accurate indication to enable him reliably to adopt a preferred position in relation to the apparatus.
  • UK Patent Application GB 2 119 941 describes a camera having a lens window provided in the front side of a housing and a mirror disposed adjacent to the lens window for a user to observe the coverage of the camera from a location in front of the camera.
  • United States Patent 4,821,118 describes a video image system that makes a video image of the person's face. It includes a camera located behind a window, which may be a one-way viewing mirror that is reflective from the user's side and transparent from the opposite side.
  • the present invention provides a facial feature imaging apparatus comprising:
  • a visible light reflector which is arranged to present a positive visual indication to the user that he or she is within a preferred range of distances from the camera, feedback is provided to the user enabling him to position his head at a correct distance from the apparatus.
  • the visible light reflector provides this feedback as effectively as known devices but more cheaply than has hitherto been possible.
  • the provision of such a visible light reflector reduces the need for a camera with an auto-focus (and possibly auto-zoom) facility.
  • the apparatus is made more compact than known apparatuses.
  • the reflection provides a positive indication in the sense that there is some indication other than the user being able to judge his distance from the camera owing to perspective.
  • the reflector comprises one or more optical elements which, in combination, have an optical power greater than zero. This has the result that the reflection seen by the user undergoes changes in both size and orientation as the user approaches the apparatus.
  • the reflector comprises a non-planar reflector, the surface of which is shaped so as to present said positive visual indication.
  • the advantage of such visible light reflectors is that they comprise few components and hence are inexpensive to manufacture.
  • the mirror presents a concave surface to the user.
  • the concave surface may be spherical or aspherical.
  • Spherical mirrors usually cost less than aspherical ones.
  • Some embodiments of the present invention use a camera which is responsive to light outside the visible portion of the electromagnetic spectrum.
  • the camera used may responsive to infra-red light, in which case the reflector used can be a wavelength-selective mirror, which reflects visible light but allows the passage of infra-red light, placed in the aperture in the housing. It will be appreciated that this arrangement allows infra-red light reflected from the user's face to pass through the mirror and continue along an optical path towards the camera.
  • FIG. 1 shows a multimedia kiosk 1 which is an adapted version of BT's Touchpoint® kiosk.
  • the kiosk is connected via telecommunications links to remote servers and also to the Public Switched Telephone Network (PSTN).
  • PSTN Public Switched Telephone Network
  • the kiosk comprises three sections 10,20,30 secured together and mounted on a supporting structure 2.
  • the central user interface section 10 comprises a container housing a cathode ray tube (CRT) display 12, a printer and a loudspeaker 13.
  • the CRT 12 displays information in the form of World Wide Web pages and also provides a touch screen facility allowing the user to interact with the kiosk.
  • the kiosk provides printed output through a horizontal slot 14 in the front surface of the user interface section a few centimetres underneath the CRT screen. Audio output is provided via the loudspeaker 13.
  • the second component of the kiosk is a telephone section 20 secured to the left-hand side of user interface section 10 and which includes both a telephone handset 22 and a keypad 24 to enable the user to telephone from the kiosk.
  • the third component of the kiosk is a payment acceptance section 30 secured to the right-hand side of the user interface section 10.
  • the payment acceptance section 30 has a credit-card slot 31, a coin slot 32 and a refund chamber 33.
  • the kiosk 1 is of conventional design.
  • the kiosk of the specific embodiment additionally has an iris recognition unit integrated into the upper part of the payment acceptance section 30.
  • the payment acceptance section 30 is also angled approximately fifteen degrees inwardly so that the user can divert his attention from the CRT screen 12 to the iris recognition unit without having to move his head sideways.
  • the iris recognition unit comprises an elongate image capture part 34 rotatably mounted at the front upper corner of the payment acceptance part 30 and iris data sequence generating electronics located in the rear upper part of the payment acceptance section 30.
  • the image capture part 34 comprises an elongate housing having three elongate sides (only two of which 38,39 are visible in the drawing) and two ends.
  • the housing is provided with a disc-shaped handle 37 at its right-hand end.
  • the handle 37 is concentric with the axis of rotation of the part 34.
  • One side 38 of the housing is rectangular and is forwardly directed in a normal orientation (as shown in the drawing).
  • An adjacent side 39 is of a similar rectangular shape and, in the normal orientation of the part 34, extends horizontally rearwardly from the forward panel.
  • the other wall of the housing is provided by a surface corresponding to the surface of a cylinder having an axis coincident with the axis of rotation of the image capture part 34. It will be realised that the cylindrical surface meets the sides 38,39 at an angle of greater than 90 degrees.
  • the forward side panel 38 has a centrally located cylindrical recess 40 which has a diameter of 80mm and extends rearwardly from the edges of the aperture to a point approximately coincident with the axis of rotation AA of the part 34.
  • a cylindrical wall 41 Located concentrically inside the recess 40 is a cylindrical wall 41 of a height equal to the depth of the recess and enclosing a cylindrical chamber 44 having a diameter of 70 mm.
  • the annular chamber 42 defined by the cylindrical wall 40 and the recess 41 is closed by a finely frosted glass ring 43.
  • the open end of the cylindrical chamber 44 is closed by a curved mirror 45 which reflects visible light falling upon it.
  • the cylindrical wall 41 is provided with a circumferential flange 46 located at a short distance behind the curved mirror 45.
  • a charged coupled device (CCD) camera 47 is centrally mounted on a circuit board 48 held at the bottom of the cylindrical recess 44.
  • the camera 47 is a Watec Wat 660 imager unit and has dimensions of 30mm * 30mm * 18mm.
  • the camera 47 is combined with a 12mm lens to provide a focused image of any object positioned about 100mm in front of the camera.
  • the camera 47 is responsive both to visible and infra-red light.
  • Two light-emitting diodes (LEDs) 49 are mounted on the forward side of the circumferential flange 46, at its uppermost and lowermost points respectively. Connections to the LEDs 49 run from the circuit board 48.
  • the curved mirror 45 is formed from a transparent glass substrate of 5mm thickness and has the form of part of the surface of the sphere of radius 200mm.
  • a coating 50 is provided on the rear side of the glass substrate, the coating 50 being effective to reflect visible light (whose wavelength lies between around 400nm and 700nm) but to allow the transmittance of light of other wavelengths, including the infra-red light produced by the LEDs 49. Those skilled in the art of manufacturing such coatings will have little difficulty in making a coating having such properties.
  • the present inventors have established that the iris can be imaged most sharply in the very near infra-red (i.e. in a wavelength range from 700nm to 850nm). Longer wavelengths are thought to penetrate deeper into the eye and hence lead to an obscuration of the iris pattern. To alleviate this problem, the camera 47 is supplied with a filter (not shown) that substantially removes wavelengths greater than 850nm.
  • a range sensor 51 is mounted on the surface of the camera 47 and is operable to output a proximity signal when an object moves closer than 100mm to the camera 47.
  • a ring shaped infra-red blocking filter 53 is located in the annular chamber 42 directly in front of the fluorescent tube 52.
  • the two ends of the tube 52 are held in the base of the cylindrical recess 44 and are connected to sliding contacts (not shown) on the curved side of the image capture part 34.
  • the electronics associated with capturing a data sequence which characterises the user's eye are located outside the image capture part 34 of the iris recognition unit in the upper part of the payment acceptance section 30.
  • One algorithm which may be executed by the electronics in order to characterise the iris of the user is described in US patent number 5,291,560.
  • Electronic communication between the image capture unit and the data sequence generating electronics is provided by further sliding contacts on the cylindrical surface of the image capture part 34. Similar sliding contacts are used to allow power to be transmitted to the fluorescent tube 52, camera 47 and LEDs.
  • interaction between the user and the kiosk may, for example, be as follows. Initially, the user steps up to the kiosk and views the main menu displayed on the CRT screen 12. He will normally adopt a position around 500mm from the screen 12 and payment acceptance unit 30 to do this. The user then uses the touch screen facility to (for example) order some merchandise to be delivered to his home. If he chooses to pay by credit card at this stage then the display prompts him to enter his credit card into the credit card slot 31 on the payment unit 30 , the payment unit 30 then reading account details from the card in a conventional manner.
  • the fluorescent tube 52 is illuminated and a message on the screen 12 (or perhaps a voice prompt from loudspeaker 13) prompts the user to move his eye forwardly until the point where he sees an upright focused image of his eye in the mirror 45.
  • the user must manipulate the handle 37 to tilt the mirror such that he can see an image which includes his eye.
  • the range sensor 51 outputs the proximity signal mentioned above.
  • the camera 47 begins to capture images of the user, the LEDs 49 being lit in synchrony with the moments of image capture.
  • iris representing data sequence is then transmitted to a remote server where a check can be made to see whether the iris data sequence matches that of the person to whom the card was issued. If such a match exists, then a signal is sent back to the kiosk to indicate that the transaction may be allowed.
  • Figure 3a illustrates the interaction of the optical elements with visible light.
  • visible light from his external surroundings and also from the fluorescent tube 52 falls upon his eye (E) and is reflected toward the cold mirror 45.
  • E his eye
  • the user will initially be around 500mm from the mirror 45, and the reflection he sees will therefore be an inverted image of his surroundings.
  • the user will move towards the mirror 45 and will see the inverted image increase in size until it becomes an unrecognisable blur.
  • the range sensor 51 will start to output the proximity signal.
  • the position at which the user considers the reflection of his eye to be in focus will depend on whether he is short or long-sighted. Since the position of the upright virtual image seen by the user is initially very far away and then comes closer as he moves forward, the use of a curved mirror means that even long-sighted people (who might not be able to see an upright focused image at all if a plane mirror were to be used) will find a distance at which their reflection appears focused.
  • the infra-red optical behaviour is relatively simple and is illustrated in Figure 3b.
  • the infra-red light will pass from the LEDs through the cold mirror 45 and will thereafter be reflected off the user's eye (E) towards the camera 47. Since the user is at a distance of less than 100mm from the mirror 45, the image of the user's iris should fill a reasonable proportion of the image captured by the camera 47.
  • the fluorescent tube 52 In this position, most of the visible light falling upon the user's eye (E) will have emanated from the fluorescent tube 52.
  • the image captured by the camera 47 may be spoiled if a reflection of a diffuse infra-red light source is seen by the camera to wash out some of the detail of the user's iris.
  • the function of the infra-red blocking filter 53 is to reduce the already small component of infra-red light output by the fluorescent tube 52 further so as to avoid such washing out of the image.
  • the above has assumed that the cold mirror 45 has no effect on infra-red light. However, in practice, a small percentage of the infra-red light may be reflected by the coating 50.
  • the curved mirror 45 presents a convex surface to the camera 47 and it is an advantage of the use of a curved mirror 45 that light from the LEDs undesirably reflected from the coating is generally reflected outwardly away from the camera 47.
  • additional guide markings are painted on the front surface of the curved mirror 45.
  • the guide markings comprise the central sections of the sides of a horizontally oriented 30mm * 20mm rectangle centred at the centre of the mirror 45.
  • the use and operation of the apparatus are as described in relation to the first embodiment save for the following points.
  • the user is further prompted to move to a distance such that the outer boundaries of the reflection of his eye (I) correspond as closely as possible to the guide markings.
  • this encourage the user to align his eye centrally in the field of view of the camera, since the size of the reflection (I) of the user's eye varies with distance from the mirror 45, it further results in the user being guided to a more tightly defined preferred distance from the camera 47.
  • FIG. 4A A third embodiment of the present invention is illustrated in Figures 4A and 4B.
  • Some multimedia kiosks provide a video-conferencing facility so that the user may have a video-conference with, for example, a sales assistant at the store from which he wishes to buy something.
  • a sales assistant at the store from which he wishes to buy something.
  • using only a single camera for both the video-conferencing and the iris recognition enables both the design and the use of the apparatus to be simplified.
  • the third embodiment implements one solution to this problem.
  • the embodiment shares many of the features of the first embodiment. illustrated in Figures 1 and 2 and features common to both embodiments are given like reference numerals and not described further here.
  • a Touchpoint® multimedia kiosk is modified by the addition of an iris image capture part and iris data sequence generating electronics.
  • the iris imaging unit is located on the front upper edge of the central user interface section and is also used to obtain pictures of the user for use in a video-conference with another party.
  • the iris data sequence generating electronics are housed in the central section behind the image capture part.
  • the iris imaging unit comprises a main body 60 and a slider 70.
  • the main body is substantially identical to the image capture part described in relation to the first embodiment, save for the following.
  • the forward and upper sides 38,39 have transverse dimensions which are large enough to accommodate a 120mm deep cylindrical recess 40 in the centre of the front side 38.
  • the recess 40 holds a Sony EVI 331 colour camera block 47 which has dimensions of approximately 50mm * 50mm * 100mm.
  • the camera has had the infra-red blocking filter which it normally contains removed.
  • a second difference in the image capture unit is that the curved mirror and the frosted glass ring have been removed.
  • the infra-red blocking filter 53 in front of the fluorescent tube 52 replaces the finely frosted glass ring and closes the annular chamber 42.
  • the slider 70 comprises a rectangular panel which has a depth of 15mm, a height similar to that of the forward side 38 and a length 100mm less than the forward panel 38.
  • the slider is aligned with the forward panel 38 and is slidably mounted thereon.
  • the slider is movable horizontally from a leftmost position ( Figure 4A) where its left-hand edge is flush with the left-hand edge of the main body 60 to a rightmost position ( Figure 4B) where the right-hand edge is flush with the right-hand edge of the main body 60.
  • the slider 70 has two circular apertures 73,74.
  • the left-hand aperture has a diameter of 80mm which holds an annular frosted glass ring 43 identical to that used in the first embodiment.
  • a wall extends 10mm rearwardly from the inner edge of the glass ring 43.
  • a close-up lens 71 of 70mm diameter is held in the aperture defined by the inner edge of the wall.
  • the front surface of the close-up lens is of identical shape to the rear surface of the curved mirror 45 and is provided with a similar coating 50.
  • the lens 71 is shaped to have a power of around 4 dioptres - those skilled in the art of lensmaking will have little difficulty in producing such a lens.
  • the right-hand aperture holds a plane glass disc 75 of 70mm diameter.
  • the rearward side of the disc is coated with an infra-red blocking coating 76.
  • a solenoid and controlling electronics are provided and are operable to move the slider 70 between its leftmost and rightmost positions.
  • the slider 70 is initially in its leftmost position, and the user may order goods in the same way as described in relation to the first embodiment except that he is now additionally involved in a video-conference with a sales assistant at the store from which he wishes to buy goods. If the user elects to pay using his credit card, then on inserting his card, the slider 70 is driven to its rightmost position and the fluorescent tube 52 is lit. The user is then asked to move forward until he can see an upright image of his eye in the mirrored surface of the close-up lens 71. Once a suitable image of his iris has been captured, he is thanked for having presented his eye and the solenoid drives the slider 70 back to its leftmost position.
  • the camera 47 views the user through the plane glass disc 75.
  • the disc 75 has no optical power and does not affect the range of distances over which the camera can focus.
  • the coating 76 on the disc 75 substitutes for the infra-red blocking filter which has been removed from the camera 47.
  • the camera can operate normally as a colour video-conferencing camera when the slider 70 is in the leftmost position.
  • the coating 50 on the outer surface of the close-up lens 71 prevents visible light from reaching the camera 47.
  • the surfaces of the lens 71 are effective to refract infra-red light produced from the LEDs and reflected from the user's eye.
  • the lens has positive power and hence, given the required magnification (an eye positioned 100mm from the camera should fill at least one third of the field of view of the camera) lowers the lower limit of the range of distances over which the camera 47 can provide a focused image suitable for iris recognition purposes.
  • the object distance at which the Sony EVI 331 colour camera block could provide such an image was reduced from 300mm to 60mm by the addition of such a lens.
  • the camera could be responsive to visible light and a partially reflecting mirror could be used.
  • the infra-red LEDs could be replaced with white light LEDs (now manufactured by Nichia of Japan) and a portion of the light from them reflected on the user's face would fall on the mirror and be reflected thereby enabling the user to position himself correctly.
  • the remainder of the visible light could provide the required image of the user's iris.
  • the visible light reflector could be formed of a combination of optical elements.
  • the curved mirror described above could be replaced by a combination of a suitably selected lens and a planar mirror.
  • Both the above embodiments feature a spherical mirror 45 which presents a concave surface towards the user.
  • a spherical mirror 45 which presents a concave surface towards the user.
  • an aspherical mirror which is designed to distort the user's reflection if the user is incorrectly transversely aligned.
  • the mirror might be located at a distance from the aperture, even when in use.
  • the mirror might be placed inside the housing behind the aperture.
  • the 200mm radius of curvature of the reflecting surface used in the above embodiments was chosen because it results in the user being constrained to adopt a position within a narrow range of distances from the camera.
  • the curvature of the mirror could be relaxed to, for example, radiuses of curvature as great as 1m. It is probable however that an auto-focus camera would then be needed. Although obtaining a suitably magnified focused image would then be possible without the use of a close-up lens, problems owing to camera shake or user movement might then become apparent.
  • a concave mirror might also be used.
  • the user would perceive the size of his reflection to increase in relation to the size of the mirror as he advanced towards the mirror. Then mirror could be marked so that the user's reflection became aligned with the markings on the user reaching a preferred working distance from the apparatus.
  • An advantage of using a concave mirror is that it cannot focus light onto the user's eye. There will therefore be fewer safety related design constraints in embodiments using a concave mirror.
  • a curved mirror might also be placed in the entrance window of the hand-held imager described in International Patent Applications WO 97/46978, WO 97/46979, and WO 97/46980.
  • the curved mirror would then have a diameter of only around 2cm and would have a radius of curvature so as to create a focal point around 5cm from the mirror. In this way a hand-held imager is created that advantageously does not require the user to bring the imager right up to his eye.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Veterinary Medicine (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Pathology (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Surgery (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Ophthalmology & Optometry (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Image Input (AREA)
  • Studio Devices (AREA)

Abstract

An imaging apparatus (34) suitable for capturing an image of one or more of a user's facial features is disclosed. The apparatus includes a spherical cold mirror (45) which presents a concave surface to the user and is disposed between the user and the camera (47). The user is able to conclude that he is close enough to the camera (47) for successful image capture when the reflection he sees in the mirror (45) is the right way up. In a preferred embodiment, markings are provided on the front surface of the mirror to aid the user in placing his eye within a predetermined range of distances from the camera (47). The imaging apparatus (34) is suitable for use in iris recognition apparatuses and provides a relatively inexpensive alternative to known apparatuses.

Description

  • The present invention relates to an imaging apparatus. It has particular utility in relation to an imaging apparatus operable to obtain an image of one or more facial features of a user.
  • One known apparatus of this type forms a component of the IriScan 2000 EAC™ iris recognition apparatus manufactured by IriScan Inc. The apparatus includes an image capture unit comprising a wall-mounted body portion which rotatably supports a tiltable housing containing the optical elements used in the apparatus. The camera and path-bending optics inside the housing are arranged so as to provide the camera with a view through an aperture provided in the front wall of the tiltable housing. The housing additionally contains a liquid crystal display (LCD display) which is viewed by the user during the iris recognition procedure through the same aperture. The LCD display is driven by the video signal which is currently being output by the camera.
  • In using the apparatus, the user moves his head until the LCD display shows an in-focus image of one of his eyes. Because of safety constraints on the level of illumination of the human eye, the depth of focus of the apparatus is limited and the user must position his head within a relatively narrow range of distances from the apparatus. The magnification of the optical system is arranged such that, when in focus, the image of one eye fills more than one-third of the field of view of the camera. This is useful in assuring that the iris is imaged in sufficient detail to obtain an iris data sequence which is unique to that iris.
  • The cost of the LCD display in the above apparatus is significant. Although the use of iris recognition technology is clearly desirable because of the high level of security it affords, the current cost of iris recognition units hinders their incorporation into credit card payment terminals and the like.
  • Other proposed iris recognition apparatuses avoid the requirement that the user moves his head to a preferred position in relation to the apparatus, instead providing a camera with both an auto-focus and an auto-zoom facility. Although this relaxes the constraints imposed on the distance between the user and the apparatus, it does not provide a facility for aligning the eye within the field of view of the camera. Hence, the use of a Pan Tilt Zoom camera in conjunction with eye-tracking techniques has been proposed to ensure that the user's eye is included within the obtained image. The use of such devices markedly increases the unit production cost of the imaging component of the iris recognition apparatus.
  • Identification Technologies International Inc. produce a PAC-1000 facial recognition system. The image capture part of the apparatus has a mirror on its front surface in which the user can see his reflection. Although this places constraints on the transverse position of the user's face, it does not place any positive constraints on the distance between the user and the device. The user is, of course, able to estimate his distance from the apparatus owing to its apparent size (i.e. owing to perspective), but that is not a sufficiently accurate indication to enable him reliably to adopt a preferred position in relation to the apparatus.
  • UK Patent Application GB 2 119 941 describes a camera having a lens window provided in the front side of a housing and a mirror disposed adjacent to the lens window for a user to observe the coverage of the camera from a location in front of the camera.
  • United States Patent 4,821,118 describes a video image system that makes a video image of the person's face. It includes a camera located behind a window, which may be a one-way viewing mirror that is reflective from the user's side and transparent from the opposite side.
  • Accordingly, the present invention provides a facial feature imaging apparatus comprising:
  • a camera apparatus operable to capture an image of one or more facial features of a user, light reflected from said facial features travelling along an optical path from said facial features to image capturing means within said camera apparatus;
  • a visible light reflector disposed, in use, across said optical path, and such that the user can see his reflection therein, which reflection gives a visual indication to the user that he is within a preferred range of distances from the camera for capturing said image;
  •    characterised in that:
    • said visible light reflector comprises a non-planar reflector, the surface of which is shaped so as to present said visual identification.
  • By providing a visible light reflector which is arranged to present a positive visual indication to the user that he or she is within a preferred range of distances from the camera, feedback is provided to the user enabling him to position his head at a correct distance from the apparatus. The visible light reflector provides this feedback as effectively as known devices but more cheaply than has hitherto been possible. The provision of such a visible light reflector reduces the need for a camera with an auto-focus (and possibly auto-zoom) facility. Furthermore, by arranging the reflector to lie on optical path between the user and the camera, the apparatus is made more compact than known apparatuses. The reflection provides a positive indication in the sense that there is some indication other than the user being able to judge his distance from the camera owing to perspective.
  • Preferably, the reflector comprises one or more optical elements which, in combination, have an optical power greater than zero. This has the result that the reflection seen by the user undergoes changes in both size and orientation as the user approaches the apparatus.
  • The reflector comprises a non-planar reflector, the surface of which is shaped so as to present said positive visual indication. The advantage of such visible light reflectors is that they comprise few components and hence are inexpensive to manufacture.
  • In preferred embodiments, the mirror presents a concave surface to the user. The concave surface may be spherical or aspherical. Spherical mirrors usually cost less than aspherical ones.
  • Some embodiments of the present invention use a camera which is responsive to light outside the visible portion of the electromagnetic spectrum. For example, the camera used may responsive to infra-red light, in which case the reflector used can be a wavelength-selective mirror, which reflects visible light but allows the passage of infra-red light, placed in the aperture in the housing. It will be appreciated that this arrangement allows infra-red light reflected from the user's face to pass through the mirror and continue along an optical path towards the camera.
  • By way of example only, specific embodiments of the present invention will now be described with reference to the accompanying drawings in which:
  • Figure 1 shows a multimedia kiosk adapted to incorporate an iris data sequence generation unit;
  • Figure 2 is a schematic illustration, partly in cross-section, of the arrangement of components within an iris image capture part of the data sequence generation unit;
  • Figure 3A is an optical ray diagram illustrating the effect of the curved cold mirror on visible light;
  • Figure 3B is an optical ray diagram illustrating the passage of infra-red light reflected from the user's eye;
  • Figure 4A is a schematic illustration, partly in cross-section, of the arrangement of components within an iris image capture part of a third embodiment of the present invention in a normal configuration suitable for video-conferencing; and
  • Figure 4B shows the image capture part of Figure 4A in a configuration suitable for capturing an image of the user's iris.
  • Figure 1 shows a multimedia kiosk 1 which is an adapted version of BT's Touchpoint® kiosk. The kiosk is connected via telecommunications links to remote servers and also to the Public Switched Telephone Network (PSTN). The kiosk comprises three sections 10,20,30 secured together and mounted on a supporting structure 2. The central user interface section 10 comprises a container housing a cathode ray tube (CRT) display 12, a printer and a loudspeaker 13. The CRT 12 displays information in the form of World Wide Web pages and also provides a touch screen facility allowing the user to interact with the kiosk. The kiosk provides printed output through a horizontal slot 14 in the front surface of the user interface section a few centimetres underneath the CRT screen. Audio output is provided via the loudspeaker 13.
  • The second component of the kiosk is a telephone section 20 secured to the left-hand side of user interface section 10 and which includes both a telephone handset 22 and a keypad 24 to enable the user to telephone from the kiosk.
  • The third component of the kiosk is a payment acceptance section 30 secured to the right-hand side of the user interface section 10. The payment acceptance section 30 has a credit-card slot 31, a coin slot 32 and a refund chamber 33. As so far described, the kiosk 1 is of conventional design.
  • However, the kiosk of the specific embodiment additionally has an iris recognition unit integrated into the upper part of the payment acceptance section 30. Furthermore, the payment acceptance section 30 is also angled approximately fifteen degrees inwardly so that the user can divert his attention from the CRT screen 12 to the iris recognition unit without having to move his head sideways.
  • The iris recognition unit comprises an elongate image capture part 34 rotatably mounted at the front upper corner of the payment acceptance part 30 and iris data sequence generating electronics located in the rear upper part of the payment acceptance section 30.
  • The image capture part 34 comprises an elongate housing having three elongate sides (only two of which 38,39 are visible in the drawing) and two ends. The housing is provided with a disc-shaped handle 37 at its right-hand end. The handle 37 is concentric with the axis of rotation of the part 34. One side 38 of the housing is rectangular and is forwardly directed in a normal orientation (as shown in the drawing). An adjacent side 39 is of a similar rectangular shape and, in the normal orientation of the part 34, extends horizontally rearwardly from the forward panel. The other wall of the housing is provided by a surface corresponding to the surface of a cylinder having an axis coincident with the axis of rotation of the image capture part 34. It will be realised that the cylindrical surface meets the sides 38,39 at an angle of greater than 90 degrees.
  • As can be seen from Figure 2 (which shows the upper surface 39 partially cut away and the components below in cross-section) the forward side panel 38 has a centrally located cylindrical recess 40 which has a diameter of 80mm and extends rearwardly from the edges of the aperture to a point approximately coincident with the axis of rotation AA of the part 34. Located concentrically inside the recess 40 is a cylindrical wall 41 of a height equal to the depth of the recess and enclosing a cylindrical chamber 44 having a diameter of 70 mm. The annular chamber 42 defined by the cylindrical wall 40 and the recess 41 is closed by a finely frosted glass ring 43. The open end of the cylindrical chamber 44 is closed by a curved mirror 45 which reflects visible light falling upon it. The cylindrical wall 41 is provided with a circumferential flange 46 located at a short distance behind the curved mirror 45.
  • A charged coupled device (CCD) camera 47 is centrally mounted on a circuit board 48 held at the bottom of the cylindrical recess 44. The camera 47 is a Watec Wat 660 imager unit and has dimensions of 30mm * 30mm * 18mm. The camera 47 is combined with a 12mm lens to provide a focused image of any object positioned about 100mm in front of the camera. The camera 47 is responsive both to visible and infra-red light. Two light-emitting diodes (LEDs) 49 are mounted on the forward side of the circumferential flange 46, at its uppermost and lowermost points respectively. Connections to the LEDs 49 run from the circuit board 48.
  • The curved mirror 45 is formed from a transparent glass substrate of 5mm thickness and has the form of part of the surface of the sphere of radius 200mm. A coating 50 is provided on the rear side of the glass substrate, the coating 50 being effective to reflect visible light (whose wavelength lies between around 400nm and 700nm) but to allow the transmittance of light of other wavelengths, including the infra-red light produced by the LEDs 49. Those skilled in the art of manufacturing such coatings will have little difficulty in making a coating having such properties.
  • The present inventors have established that the iris can be imaged most sharply in the very near infra-red (i.e. in a wavelength range from 700nm to 850nm). Longer wavelengths are thought to penetrate deeper into the eye and hence lead to an obscuration of the iris pattern. To alleviate this problem, the camera 47 is supplied with a filter (not shown) that substantially removes wavelengths greater than 850nm.
  • Furthermore, owing to the effect of absorption by water and oxygen molecules in the atmosphere, there are several dips in the spectrum of natural sunlight in the 750nm to 800nm wavelength range. Imaging the iris in the 700nm to 850nm range therefore results the undesirable effect of reflections of infra-red light from the sun being reduced.
  • A range sensor 51 is mounted on the surface of the camera 47 and is operable to output a proximity signal when an object moves closer than 100mm to the camera 47.
  • A fluorescent tube 52 formed into the shape of a ring save for its two ends which point rearwardly is positioned in the annular chamber 42. A ring shaped infra-red blocking filter 53 is located in the annular chamber 42 directly in front of the fluorescent tube 52. The two ends of the tube 52 are held in the base of the cylindrical recess 44 and are connected to sliding contacts (not shown) on the curved side of the image capture part 34.
  • The electronics associated with capturing a data sequence which characterises the user's eye are located outside the image capture part 34 of the iris recognition unit in the upper part of the payment acceptance section 30. One algorithm which may be executed by the electronics in order to characterise the iris of the user is described in US patent number 5,291,560. Electronic communication between the image capture unit and the data sequence generating electronics is provided by further sliding contacts on the cylindrical surface of the image capture part 34. Similar sliding contacts are used to allow power to be transmitted to the fluorescent tube 52, camera 47 and LEDs.
  • In using the modified Touchpoint® kiosk, interaction between the user and the kiosk may, for example, be as follows. Initially, the user steps up to the kiosk and views the main menu displayed on the CRT screen 12. He will normally adopt a position around 500mm from the screen 12 and payment acceptance unit 30 to do this. The user then uses the touch screen facility to (for example) order some merchandise to be delivered to his home. If he chooses to pay by credit card at this stage then the display prompts him to enter his credit card into the credit card slot 31 on the payment unit 30 , the payment unit 30 then reading account details from the card in a conventional manner. At this time, the fluorescent tube 52 is illuminated and a message on the screen 12 (or perhaps a voice prompt from loudspeaker 13) prompts the user to move his eye forwardly until the point where he sees an upright focused image of his eye in the mirror 45. Initially, the user must manipulate the handle 37 to tilt the mirror such that he can see an image which includes his eye. Thereafter, as explained below, in order to see an upright image of his eye in the mirror, the user must move to within 100mm of the image capture part 34. Once the user has moved that close to the image capture part 34, the range sensor 51 outputs the proximity signal mentioned above. On generation of the proximity signal, the camera 47 begins to capture images of the user, the LEDs 49 being lit in synchrony with the moments of image capture. Further images are captured until one suitable for forming an iris representing data sequence is obtained. Once the image has been successfully captured, a voice message is output indicating that the image has been captured and thanking the user for having presented his eye. The iris representing data sequence is then transmitted to a remote server where a check can be made to see whether the iris data sequence matches that of the person to whom the card was issued. If such a match exists, then a signal is sent back to the kiosk to indicate that the transaction may be allowed.
  • The function of each of the optical elements used in the image capture part will now be explained in relation to Figures 3a and 3b. Figure 3a illustrates the interaction of the optical elements with visible light. On the user inserting his credit card into the payment unit 30, visible light from his external surroundings and also from the fluorescent tube 52 falls upon his eye (E) and is reflected toward the cold mirror 45. It is likely that the user will initially be around 500mm from the mirror 45, and the reflection he sees will therefore be an inverted image of his surroundings. Following the instruction from the kiosk for him to move inwards towards the mirror 45 until he sees an upright image of his eye, the user will move towards the mirror 45 and will see the inverted image increase in size until it becomes an unrecognisable blur. However, as the user moves inwardly from a distance (F) 100mm from the cold mirror 45, the image (I) will begin to reduce in size and will appear the right way up. At this point the user will stop moving forwards . Since the user is then less than 100 mm from the mirror 45, the range sensor 51 will start to output the proximity signal.
  • The position at which the user considers the reflection of his eye to be in focus will depend on whether he is short or long-sighted. Since the position of the upright virtual image seen by the user is initially very far away and then comes closer as he moves forward, the use of a curved mirror means that even long-sighted people (who might not be able to see an upright focused image at all if a plane mirror were to be used) will find a distance at which their reflection appears focused.
  • Since the cold mirror 45 is largely ineffective in the very near infra-red, the infra-red optical behaviour is relatively simple and is illustrated in Figure 3b. On the two LEDs lighting, the infra-red light will pass from the LEDs through the cold mirror 45 and will thereafter be reflected off the user's eye (E) towards the camera 47. Since the user is at a distance of less than 100mm from the mirror 45, the image of the user's iris should fill a reasonable proportion of the image captured by the camera 47.
  • In this position, most of the visible light falling upon the user's eye (E) will have emanated from the fluorescent tube 52. The image captured by the camera 47 may be spoiled if a reflection of a diffuse infra-red light source is seen by the camera to wash out some of the detail of the user's iris. The function of the infra-red blocking filter 53 is to reduce the already small component of infra-red light output by the fluorescent tube 52 further so as to avoid such washing out of the image.
  • The above has assumed that the cold mirror 45 has no effect on infra-red light. However, in practice, a small percentage of the infra-red light may be reflected by the coating 50. The curved mirror 45 presents a convex surface to the camera 47 and it is an advantage of the use of a curved mirror 45 that light from the LEDs undesirably reflected from the coating is generally reflected outwardly away from the camera 47.
  • In a second embodiment of the present invention, additional guide markings are painted on the front surface of the curved mirror 45. The guide markings comprise the central sections of the sides of a horizontally oriented 30mm * 20mm rectangle centred at the centre of the mirror 45.
  • The use and operation of the apparatus are as described in relation to the first embodiment save for the following points. In addition to the prompt issued by the kiosk requesting the user to move forward until he sees a right way up reflection (I) of his eye, the user is further prompted to move to a distance such that the outer boundaries of the reflection of his eye (I) correspond as closely as possible to the guide markings. Not only does this encourage the user to align his eye centrally in the field of view of the camera, since the size of the reflection (I) of the user's eye varies with distance from the mirror 45, it further results in the user being guided to a more tightly defined preferred distance from the camera 47.
  • A third embodiment of the present invention is illustrated in Figures 4A and 4B.
  • Some multimedia kiosks provide a video-conferencing facility so that the user may have a video-conference with, for example, a sales assistant at the store from which he wishes to buy something. In this case, using only a single camera for both the video-conferencing and the iris recognition enables both the design and the use of the apparatus to be simplified.
  • The problem that then faces the designer is that video-conferencing cameras often cannot provide an image of an object close to the camera, which image is both focused and magnified to the degree required for iris recognition.
  • The third embodiment (Figures 4A, 4B) implements one solution to this problem. The embodiment shares many of the features of the first embodiment. illustrated in Figures 1 and 2 and features common to both embodiments are given like reference numerals and not described further here. In the embodiment, a Touchpoint® multimedia kiosk is modified by the addition of an iris image capture part and iris data sequence generating electronics. In contrast to the first embodiment, the iris imaging unit is located on the front upper edge of the central user interface section and is also used to obtain pictures of the user for use in a video-conference with another party. The iris data sequence generating electronics are housed in the central section behind the image capture part.
  • The iris imaging unit comprises a main body 60 and a slider 70. The main body is substantially identical to the image capture part described in relation to the first embodiment, save for the following. Firstly, the forward and upper sides 38,39 have transverse dimensions which are large enough to accommodate a 120mm deep cylindrical recess 40 in the centre of the front side 38. The recess 40 holds a Sony EVI 331 colour camera block 47 which has dimensions of approximately 50mm * 50mm * 100mm. The camera has had the infra-red blocking filter which it normally contains removed. A second difference in the image capture unit is that the curved mirror and the frosted glass ring have been removed. The infra-red blocking filter 53 in front of the fluorescent tube 52 replaces the finely frosted glass ring and closes the annular chamber 42.
  • The slider 70 comprises a rectangular panel which has a depth of 15mm, a height similar to that of the forward side 38 and a length 100mm less than the forward panel 38. The slider is aligned with the forward panel 38 and is slidably mounted thereon. The slider is movable horizontally from a leftmost position (Figure 4A) where its left-hand edge is flush with the left-hand edge of the main body 60 to a rightmost position (Figure 4B) where the right-hand edge is flush with the right-hand edge of the main body 60.
  • The slider 70 has two circular apertures 73,74. The left-hand aperture has a diameter of 80mm which holds an annular frosted glass ring 43 identical to that used in the first embodiment. A wall extends 10mm rearwardly from the inner edge of the glass ring 43. A close-up lens 71 of 70mm diameter is held in the aperture defined by the inner edge of the wall. The front surface of the close-up lens is of identical shape to the rear surface of the curved mirror 45 and is provided with a similar coating 50. The lens 71 is shaped to have a power of around 4 dioptres - those skilled in the art of lensmaking will have little difficulty in producing such a lens.
  • The right-hand aperture holds a plane glass disc 75 of 70mm diameter. The rearward side of the disc is coated with an infra-red blocking coating 76.
  • A solenoid and controlling electronics are provided and are operable to move the slider 70 between its leftmost and rightmost positions.
  • In use, the slider 70 is initially in its leftmost position, and the user may order goods in the same way as described in relation to the first embodiment except that he is now additionally involved in a video-conference with a sales assistant at the store from which he wishes to buy goods. If the user elects to pay using his credit card, then on inserting his card, the slider 70 is driven to its rightmost position and the fluorescent tube 52 is lit. The user is then asked to move forward until he can see an upright image of his eye in the mirrored surface of the close-up lens 71. Once a suitable image of his iris has been captured, he is thanked for having presented his eye and the solenoid drives the slider 70 back to its leftmost position.
  • The role of the optical elements in the third embodiment will now be explained. When the slider 70 is in its leftmost position (Figure 4A), the camera 47 views the user through the plane glass disc 75. The disc 75 has no optical power and does not affect the range of distances over which the camera can focus. However, the coating 76 on the disc 75 substitutes for the infra-red blocking filter which has been removed from the camera 47. Hence the camera can operate normally as a colour video-conferencing camera when the slider 70 is in the leftmost position.
  • However, when the slider 70 is in its rightmost position (Figure 4B), the coating 50 on the outer surface of the close-up lens 71 prevents visible light from reaching the camera 47. The surfaces of the lens 71 are effective to refract infra-red light produced from the LEDs and reflected from the user's eye. The lens has positive power and hence, given the required magnification (an eye positioned 100mm from the camera should fill at least one third of the field of view of the camera) lowers the lower limit of the range of distances over which the camera 47 can provide a focused image suitable for iris recognition purposes. In practice, the object distance at which the Sony EVI 331 colour camera block could provide such an image was reduced from 300mm to 60mm by the addition of such a lens.
  • Although the above embodiments have used a cold-mirror, it will be realised by those skilled in the art that the camera could be responsive to visible light and a partially reflecting mirror could be used. The infra-red LEDs could be replaced with white light LEDs (now manufactured by Nichia of Japan) and a portion of the light from them reflected on the user's face would fall on the mirror and be reflected thereby enabling the user to position himself correctly. The remainder of the visible light could provide the required image of the user's iris.
  • In some embodiments, the visible light reflector could be formed of a combination of optical elements. For example, the curved mirror described above could be replaced by a combination of a suitably selected lens and a planar mirror.
  • Both the above embodiments feature a spherical mirror 45 which presents a concave surface towards the user. However, it is possible, for example, to use an aspherical mirror which is designed to distort the user's reflection if the user is incorrectly transversely aligned.
  • In other implementations, the mirror might be located at a distance from the aperture, even when in use. For example, the mirror might be placed inside the housing behind the aperture.
  • The 200mm radius of curvature of the reflecting surface used in the above embodiments was chosen because it results in the user being constrained to adopt a position within a narrow range of distances from the camera. In principle, however, the curvature of the mirror could be relaxed to, for example, radiuses of curvature as great as 1m. It is probable however that an auto-focus camera would then be needed. Although obtaining a suitably magnified focused image would then be possible without the use of a close-up lens, problems owing to camera shake or user movement might then become apparent.
  • The above embodiments describe the use of a concave mirror. However, a convex mirror might also be used. In such embodiments, the user would perceive the size of his reflection to increase in relation to the size of the mirror as he advanced towards the mirror. Then mirror could be marked so that the user's reflection became aligned with the markings on the user reaching a preferred working distance from the apparatus. An advantage of using a concave mirror is that it cannot focus light onto the user's eye. There will therefore be fewer safety related design constraints in embodiments using a concave mirror.
  • The above embodiments have related to a kiosk having an integral iris recognition unit. However, a curved mirror might also be placed in the entrance window of the hand-held imager described in International Patent Applications WO 97/46978, WO 97/46979, and WO 97/46980. The curved mirror would then have a diameter of only around 2cm and would have a radius of curvature so as to create a focal point around 5cm from the mirror. In this way a hand-held imager is created that advantageously does not require the user to bring the imager right up to his eye.
  • It will be seen how the embodiments of the present invention provide an inexpensive facility allowing a user to adopt a preferred position in relation to an imaging apparatus.

Claims (10)

  1. A facial feature imaging apparatus comprising:
    a camera apparatus operable to capture an image of one or more facial features of a user, light reflected from said facial features travelling along an optical path from said facial features to image capturing means within said camera apparatus;
    a visible light reflector disposed, in use, across said optical path, and such that the user can see his reflection therein, which reflection gives a visual indication to the user that he is within a preferred range of distances from the camera for capturing said image;
       characterised in that:
    said visible light reflector comprises a non-planar reflector, the surface of which is shaped so as to present said visual identification.
  2. An apparatus according to claim 1 wherein said reflector comprises one or more optical elements which, in combination, have an optical power greater than zero.
  3. An apparatus according to claim 1 or 2 wherein said visible light reflector comprises a concave curved reflector whose concave surface is viewed by the user.
  4. An apparatus according to claim 1 or 2 wherein the visual indication is the uprightness of the reflection.
  5. An apparatus according to any one of claims 2 to 4 wherein said reflector comprises a mirror.
  6. An apparatus according to any one of claims 2 to 4 wherein said reflector comprises a lens having a reflective coating thereon.
  7. An apparatus according to any preceding claim wherein said reflector is provided with markings to be aligned with one or more of the user's facial features.
  8. An apparatus according to any preceding claim wherein said camera is responsive to non-visible light and said reflector allows the passage of said non-visible light.
  9. An apparatus according to any preceding claim wherein said apparatus is an iris imaging apparatus.
  10. An identification apparatus comprising a facial feature imaging apparatus according to any preceding claim, a storage means storing one or more facial feature data sequences and a comparison means for comparing facial feature data sequences derived from one or more images obtained by the imaging apparatus with the one or more facial feature data sequences stored in the storage means.
EP98950188A 1997-10-24 1998-10-23 Imaging apparatus Expired - Lifetime EP1024748B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP98950188A EP1024748B1 (en) 1997-10-24 1998-10-23 Imaging apparatus

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP97308526 1997-10-24
EP97308526A EP0910986A1 (en) 1997-10-24 1997-10-24 Imaging apparatus
EP98950188A EP1024748B1 (en) 1997-10-24 1998-10-23 Imaging apparatus
PCT/GB1998/003177 WO1999021479A1 (en) 1997-10-24 1998-10-23 Imaging apparatus

Publications (2)

Publication Number Publication Date
EP1024748A1 EP1024748A1 (en) 2000-08-09
EP1024748B1 true EP1024748B1 (en) 2005-03-23

Family

ID=8229569

Family Applications (2)

Application Number Title Priority Date Filing Date
EP97308526A Withdrawn EP0910986A1 (en) 1997-10-24 1997-10-24 Imaging apparatus
EP98950188A Expired - Lifetime EP1024748B1 (en) 1997-10-24 1998-10-23 Imaging apparatus

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP97308526A Withdrawn EP0910986A1 (en) 1997-10-24 1997-10-24 Imaging apparatus

Country Status (10)

Country Link
US (1) US6687389B2 (en)
EP (2) EP0910986A1 (en)
JP (1) JP2001520904A (en)
KR (1) KR20010031389A (en)
CN (1) CN1221212C (en)
AU (1) AU743382B2 (en)
CA (1) CA2306876C (en)
DE (1) DE69829496T2 (en)
ES (1) ES2241168T3 (en)
WO (1) WO1999021479A1 (en)

Families Citing this family (72)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3595164B2 (en) * 1998-06-19 2004-12-02 沖電気工業株式会社 Imaging device
KR100582052B1 (en) * 1999-09-03 2006-05-23 엘지전자 주식회사 iris cognition system
US6592223B1 (en) * 1999-10-07 2003-07-15 Panaseca, Inc. System and method for optimal viewing of computer monitors to minimize eyestrain
US7233312B2 (en) * 2000-07-31 2007-06-19 Panaseca, Inc. System and method for optimal viewing of computer monitors to minimize eyestrain
JP4265076B2 (en) * 2000-03-31 2009-05-20 沖電気工業株式会社 Multi-angle camera and automatic photographing device
US7271839B2 (en) * 2001-03-15 2007-09-18 Lg Electronics Inc. Display device of focal angle and focal distance in iris recognition system
GB2381305B (en) 2001-06-29 2003-08-13 Wjw Ltd A new light source for part-adapted diagnostic instruments
JP4172930B2 (en) * 2001-10-31 2008-10-29 松下電器産業株式会社 Eye imaging device and entrance / exit management system
US7305108B2 (en) * 2001-11-08 2007-12-04 Pelco Security identification system
TWI222029B (en) * 2001-12-04 2004-10-11 Desun Technology Co Ltd Two-in-one image display/image capture apparatus and the method thereof and identification system using the same
US20050084137A1 (en) * 2002-01-16 2005-04-21 Kim Dae-Hoon System and method for iris identification using stereoscopic face recognition
KR100842501B1 (en) * 2002-02-21 2008-07-01 엘지전자 주식회사 Indicated device of iris location for iris recognition system
CN100370473C (en) * 2002-04-26 2008-02-20 马堃 Image pick-up method for image identification
US20040099369A1 (en) * 2002-11-22 2004-05-27 Sparks Darrell L. Composite sheet with mirror finish
KR20040062247A (en) * 2003-01-02 2004-07-07 엘지전자 주식회사 Structure of iris recognition camera and using method of the same
US8090157B2 (en) 2005-01-26 2012-01-03 Honeywell International Inc. Approaches and apparatus for eye detection in a digital image
US8442276B2 (en) 2006-03-03 2013-05-14 Honeywell International Inc. Invariant radial iris segmentation
US8049812B2 (en) 2006-03-03 2011-11-01 Honeywell International Inc. Camera with auto focus capability
US7593550B2 (en) 2005-01-26 2009-09-22 Honeywell International Inc. Distance iris recognition
US8064647B2 (en) 2006-03-03 2011-11-22 Honeywell International Inc. System for iris detection tracking and recognition at a distance
US8705808B2 (en) 2003-09-05 2014-04-22 Honeywell International Inc. Combined face and iris recognition system
US8098901B2 (en) 2005-01-26 2012-01-17 Honeywell International Inc. Standoff iris recognition system
CN1299231C (en) * 2004-06-11 2007-02-07 清华大学 Living body iris patterns collecting method and collector
US7614747B2 (en) * 2004-07-28 2009-11-10 Solohealth, Inc. Automated vision screening apparatus and method
US8182091B2 (en) 2004-07-28 2012-05-22 Solohealth, Inc. Automated vision screening apparatus and method
CN101065766A (en) * 2004-09-03 2007-10-31 潘那西卡股份有限公司 Vision center kiosk
TWI258296B (en) * 2005-01-28 2006-07-11 Benq Corp Portable electronic device with a fine-tuning camera module
WO2008019168A2 (en) 2006-03-03 2008-02-14 Honeywell International, Inc. Modular biometrics collection system architecture
WO2007103834A1 (en) 2006-03-03 2007-09-13 Honeywell International, Inc. Indexing and database search system
KR101299074B1 (en) 2006-03-03 2013-08-30 허니웰 인터내셔널 인코포레이티드 Iris encoding system
DE602007007062D1 (en) 2006-03-03 2010-07-22 Honeywell Int Inc IRISER IDENTIFICATION SYSTEM WITH IMAGE QUALITY METERING
AU2007220010B2 (en) 2006-03-03 2011-02-17 Gentex Corporation Single lens splitter camera
AU2007223336B2 (en) * 2006-03-03 2011-03-10 Honeywell International, Inc. A combined face and iris recognition system
US7767967B2 (en) * 2006-11-01 2010-08-03 Sony Corporation Capturing motion using quantum nanodot sensors
US8063889B2 (en) 2007-04-25 2011-11-22 Honeywell International Inc. Biometric data collection system
US11839430B2 (en) 2008-03-27 2023-12-12 Doheny Eye Institute Optical coherence tomography-based ophthalmic testing methods, devices and systems
WO2010009447A2 (en) 2008-07-18 2010-01-21 Doheny Eye Institute Optical coherence tomography - based ophthalmic testing methods, devices and systems
US8348429B2 (en) 2008-03-27 2013-01-08 Doheny Eye Institute Optical coherence tomography device, method, and system
US8436907B2 (en) 2008-05-09 2013-05-07 Honeywell International Inc. Heterogeneous video capturing system
US8213782B2 (en) 2008-08-07 2012-07-03 Honeywell International Inc. Predictive autofocusing system
US8090246B2 (en) 2008-08-08 2012-01-03 Honeywell International Inc. Image acquisition system
US8280119B2 (en) 2008-12-05 2012-10-02 Honeywell International Inc. Iris recognition system using quality metrics
US8630464B2 (en) 2009-06-15 2014-01-14 Honeywell International Inc. Adaptive iris matching using database indexing
US8472681B2 (en) 2009-06-15 2013-06-25 Honeywell International Inc. Iris and ocular recognition system using trace transforms
CN102822770B (en) * 2010-03-26 2016-08-17 惠普发展公司,有限责任合伙企业 Associated with
US8742887B2 (en) 2010-09-03 2014-06-03 Honeywell International Inc. Biometric visitor check system
US8366273B2 (en) * 2011-01-31 2013-02-05 National Chiao Tung University Iris image definition estimation system using the astigmatism of the corneal reflection of a non-coaxial light source
US8854446B2 (en) * 2011-04-28 2014-10-07 Iristrac, Llc Method of capturing image data for iris code based identification of vertebrates
KR20120140324A (en) * 2011-06-21 2012-12-31 정하철 Capture apparatus
DE102011079285A1 (en) * 2011-07-15 2013-01-17 Bundesdruckerei Gmbh Device for detecting biometric features
US9138140B2 (en) * 2012-03-20 2015-09-22 Lrs Identity, Inc. Compact iris imaging system
US9628676B2 (en) * 2012-06-07 2017-04-18 Complete Genomics, Inc. Imaging systems with movable scan mirrors
US9265458B2 (en) 2012-12-04 2016-02-23 Sync-Think, Inc. Application of smooth pursuit cognitive testing paradigms to clinical drug development
US9380976B2 (en) 2013-03-11 2016-07-05 Sync-Think, Inc. Optical neuroinformatics
US10772497B2 (en) 2014-09-12 2020-09-15 Envision Diagnostics, Inc. Medical interfaces and other medical devices, systems, and methods for performing eye exams
US9226856B2 (en) 2013-03-14 2016-01-05 Envision Diagnostics, Inc. Inflatable medical interfaces and other medical devices, systems, and methods
WO2017048873A1 (en) 2015-09-17 2017-03-23 Envision Diagnostics, Inc. Medical interfaces and other medical devices, systems, and methods for performing eye exams
US20140327754A1 (en) * 2013-05-06 2014-11-06 Delta ID Inc. Method and apparatus for compensating for sub-optimal orientation of an iris imaging apparatus
CN103440483B (en) * 2013-09-03 2016-09-28 吉林大学 A kind of iris image acquiring device of initiative focusing
CN103413126B (en) * 2013-09-04 2017-06-16 北京天诚盛业科技有限公司 Iris collection device
DE102014112494B4 (en) * 2014-08-29 2024-10-24 Bundesdruckerei Gmbh Device for detecting biometric features of a person's face
US10425814B2 (en) 2014-09-24 2019-09-24 Princeton Identity, Inc. Control of wireless communication device capability in a mobile device with a biometric key
EP3227816A4 (en) 2014-12-03 2018-07-04 Princeton Identity, Inc. System and method for mobile device biometric add-on
US10379496B2 (en) * 2014-12-08 2019-08-13 Levent Onural System and method for displaying and capturing holographic true 3D images
JP2019506694A (en) 2016-01-12 2019-03-07 プリンストン・アイデンティティー・インコーポレーテッド Biometric analysis system and method
WO2017173228A1 (en) 2016-03-31 2017-10-05 Princeton Identity, Inc. Biometric enrollment systems and methods
US10373008B2 (en) 2016-03-31 2019-08-06 Princeton Identity, Inc. Systems and methods of biometric analysis with adaptive trigger
EP3448234A4 (en) 2016-04-30 2019-05-01 Envision Diagnostics, Inc. Medical devices, systems, and methods for performing eye exams and eye tracking
US10607096B2 (en) 2017-04-04 2020-03-31 Princeton Identity, Inc. Z-dimension user feedback biometric system
JP2020529073A (en) 2017-07-26 2020-10-01 プリンストン・アイデンティティー・インコーポレーテッド Biosecurity systems and methods
DE102018121256A1 (en) * 2018-08-30 2020-03-05 Bundesdruckerei Gmbh Access control system for capturing a facial image of a person
US11771320B2 (en) * 2020-08-27 2023-10-03 GE Precision Healthcare LLC System and method for augmenting patient-technologist communication

Family Cites Families (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4109237A (en) 1977-01-17 1978-08-22 Hill Robert B Apparatus and method for identifying individuals through their retinal vasculature patterns
JPS6054053B2 (en) 1977-11-15 1985-11-28 ミノルタ株式会社 Fundus camera for easy pupil alignment
FR2461481A1 (en) 1979-07-18 1981-02-06 Castro Christophe Camera for iris diagnostic photography - produces composite picture of iris and topography to permit diagnostic interpretation
US4256384A (en) 1979-10-15 1981-03-17 Konan Camera Research Institute Eyeball examining device
JPS5663330A (en) 1979-10-25 1981-05-29 Canon Kk Inspecting machine for eye
US4394074A (en) 1980-09-22 1983-07-19 Mcmahon William Fiberoptic-lighted optical apparatus
US4393366A (en) 1981-02-17 1983-07-12 Eye-D Development Ii Ltd. Rotating beam ocular identification apparatus and method
FR2516778A1 (en) 1981-11-20 1983-05-27 Houdret Jean Claude Lens with movable shutters for examination of iris - has reference iris display on shutters and variable indirect lighting
FR2521851B1 (en) 1982-02-24 1988-04-15 Gerpi LIGHTING DEVICE FOR PARTICULARLY PROVIDING IRIS MACROPHOTOGRAPHY FOR IRIDOLOGICAL EXAMINATION
US4560261A (en) * 1982-05-07 1985-12-24 Minolta Camera Kabushiki Kaisha Flat camera with self photograph framing mirror
US4620318A (en) 1983-04-18 1986-10-28 Eye-D Development Ii Ltd. Fovea-centered eye fundus scanner
US4755043A (en) 1985-02-15 1988-07-05 Somec, Inc. Portable scanning digital pupillometer and method of use thereof
US4641349A (en) 1985-02-20 1987-02-03 Leonard Flom Iris recognition system
US4786142A (en) 1986-06-16 1988-11-22 Eyedentify, Inc. Optical instrument line of sight aligning device
US4834528A (en) 1986-08-15 1989-05-30 Cornell Research Foundation, Inc. Infrared photoretinoscope
FR2604080A1 (en) 1986-09-19 1988-03-25 Laflaquiere Henri Portable general observation device, used in particular in iridoscopy, using a stereo binocular lens
US4795224A (en) * 1986-10-06 1989-01-03 Katsuchika Goto Optical scanning pattern generator
US4821118A (en) * 1986-10-09 1989-04-11 Advanced Identification Systems, Inc. Video image system for personal identification
JPS63214730A (en) * 1987-03-04 1988-09-07 Janome Sewing Mach Co Ltd Camera device equipped with figure matching half-mirror
FR2622786A1 (en) 1987-11-10 1989-05-12 Giet Francis APPARATUS FOR EYE EXAMINATION BY IRISCOPY AND IRIGRAPHY
FR2627074B1 (en) 1988-02-16 1990-09-28 Laflaquiere Henri PORTABLE OBSERVATION DEVICE IN GENERAL, USED IN IRISCOPY IN PARTICULAR, FROM A STEREO BINOCULAR MAGNIFIER
FR2630365B1 (en) 1988-04-25 1990-07-13 Stein Industrie INTERNAL SLEEVING MACHINE WITH SLEEVE OF THE END OF HEAT EXCHANGER TUBES
JP2927446B2 (en) 1989-04-26 1999-07-28 株式会社トプコン Ophthalmic imaging equipment
US5291330A (en) * 1989-11-03 1994-03-01 Joseph Daniels Method and apparatus for enhancing image resolution by means of a multiplicity of phase objects and an optional external radiant flux
US4993068A (en) 1989-11-27 1991-02-12 Motorola, Inc. Unforgeable personal identification system
US5187506A (en) 1990-09-28 1993-02-16 Fairville Medical Optics Inc. Method and apparatus for determining physiological parameters based on pupil response
JPH04158829A (en) 1990-10-22 1992-06-01 Topcon Corp Retinal camera
US5291560A (en) 1991-07-15 1994-03-01 Iri Scan Incorporated Biometric personal identification system based on iris analysis
DE9112040U1 (en) * 1991-09-26 1993-01-28 Hebeisen, Susan, 8390 Passau Facility for producing passport photographs or similar.
US5359669A (en) * 1992-04-13 1994-10-25 Motorola, Inc. Remote retinal scan identifier
FR2690329A1 (en) 1992-04-22 1993-10-29 Boucobza Fabien Device for external examination of human eye - has eye mask placed over eye and containing infrared video camera and infrared source
US5433197A (en) 1992-09-04 1995-07-18 Stark; Edward W. Non-invasive glucose measurement method and apparatus
DE4330265B4 (en) 1992-09-07 2004-07-29 Canon K.K. Device for detecting the visual axis of an eye of a person operating an optical device
TW286275B (en) 1992-11-06 1996-09-21 Res Dev Foundation
US5357369A (en) * 1992-12-21 1994-10-18 Geoffrey Pilling Wide-field three-dimensional viewing system
JPH07151958A (en) 1993-11-30 1995-06-16 Canon Inc Optical equipment with line-of-sight detecting function
JP3293308B2 (en) * 1994-03-10 2002-06-17 三菱電機株式会社 Person state detection device
DE59510912D1 (en) * 1994-04-11 2004-07-15 Leica Mikroskopie Systeme Ag H Surgical microscope system with data processing unit
US5808589A (en) * 1994-08-24 1998-09-15 Fergason; James L. Optical system for a head mounted display combining high and low resolution images
US5572596A (en) 1994-09-02 1996-11-05 David Sarnoff Research Center, Inc. Automated, non-invasive iris recognition system and method
US5712912A (en) 1995-07-28 1998-01-27 Mytec Technologies Inc. Method and apparatus for securely handling a personal identification number or cryptographic key using biometric techniques
US5639151A (en) * 1996-02-16 1997-06-17 Mcnelley; Steve H. Pass-through reflective projection display
WO1997046980A1 (en) * 1996-06-06 1997-12-11 British Telecommunications Public Limited Company Personal identification
US5777719A (en) * 1996-12-23 1998-07-07 University Of Rochester Method and apparatus for improving vision and the resolution of retinal images

Also Published As

Publication number Publication date
KR20010031389A (en) 2001-04-16
JP2001520904A (en) 2001-11-06
EP0910986A1 (en) 1999-04-28
CA2306876A1 (en) 1999-05-06
AU743382B2 (en) 2002-01-24
DE69829496D1 (en) 2005-04-28
ES2241168T3 (en) 2005-10-16
CA2306876C (en) 2007-09-25
EP1024748A1 (en) 2000-08-09
AU9635198A (en) 1999-05-17
US6687389B2 (en) 2004-02-03
DE69829496T2 (en) 2006-04-13
CN1221212C (en) 2005-10-05
CN1276710A (en) 2000-12-13
WO1999021479A1 (en) 1999-05-06
US20020164054A1 (en) 2002-11-07

Similar Documents

Publication Publication Date Title
EP1024748B1 (en) Imaging apparatus
US6850631B1 (en) Photographing device, iris input device and iris image input method
EP1625745B1 (en) Mirror assembly with integrated display device
US20090141196A1 (en) Photo microprojector
JP2001512851A (en) Apparatus and method for creating and displaying a planar virtual image
JP2000514204A (en) Compact display device with two-stage magnification system equipped with immersion type beam splitter
JPH10124640A (en) Smart card with visual picture display
CN108227203A (en) AR display methods, equipment and device
US20180324332A1 (en) Display apparatus and method using image renderers and optical combiners
CN109071209A (en) The projector for being configured as projecting image on surface and the mancarried device including this projector
CN112285934A (en) Image display device and wearable equipment
JP3504177B2 (en) Photographing device and iris image input device
JP4148700B2 (en) Eye imaging device
CN113676623A (en) Electronic device and control method thereof
CN113208373A (en) Control method of intelligent cosmetic mirror and intelligent cosmetic mirror
CN111317315A (en) Mirror with electronic display screen
CN220305565U (en) Telescope based on scenic spot is used
JPH1189820A (en) Iris input device
JPH09168141A (en) Display device with image pickup device
JP2005092224A (en) Small-sized display device and image display control method
CN108378819A (en) Fundus camera and virtual reality imaging device
CN221261392U (en) Head-mounted display device
US20040126104A1 (en) Kiosk having a light source
JPH09262210A (en) Optical system
JPH11298779A (en) Image capturing device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20000425

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): BE CH DE ES FR GB IE IT LI NL SE

17Q First examination report despatched

Effective date: 20031008

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): BE CH DE ES FR GB IE IT LI NL SE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050323

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED.

Effective date: 20050323

Ref country code: CH

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050323

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050323

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 69829496

Country of ref document: DE

Date of ref document: 20050428

Kind code of ref document: P

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2241168

Country of ref document: ES

Kind code of ref document: T3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20051024

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20051227

ET Fr: translation filed
REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1031671

Country of ref document: HK

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050623

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20100224

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20100215

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20101022

Year of fee payment: 13

REG Reference to a national code

Ref country code: NL

Ref legal event code: V1

Effective date: 20110501

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110501

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20111118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20101024

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20111103

Year of fee payment: 14

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20130628

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130501

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 69829496

Country of ref document: DE

Effective date: 20130501

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121031

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20171019

Year of fee payment: 20

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

Expiry date: 20181022

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20181022