EP0833587B1 - Method of identifying people - Google Patents

Method of identifying people Download PDF

Info

Publication number
EP0833587B1
EP0833587B1 EP97916354A EP97916354A EP0833587B1 EP 0833587 B1 EP0833587 B1 EP 0833587B1 EP 97916354 A EP97916354 A EP 97916354A EP 97916354 A EP97916354 A EP 97916354A EP 0833587 B1 EP0833587 B1 EP 0833587B1
Authority
EP
European Patent Office
Prior art keywords
skin
ultrasonic
echo
sweat glands
ultrasonic transducer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP97916354A
Other languages
German (de)
French (fr)
Other versions
EP0833587A1 (en
Inventor
Peter-Christian Eccardt
Martin Vossiek
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Infineon Technologies AG
Original Assignee
Infineon Technologies AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DE19614220 external-priority
Application filed by Infineon Technologies AG filed Critical Infineon Technologies AG
Publication of EP0833587A1 publication Critical patent/EP0833587A1/en
Application granted granted Critical
Publication of EP0833587B1 publication Critical patent/EP0833587B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/117Identification of persons
    • A61B5/1171Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • A61B5/1172Identification of persons based on the shapes or appearances of their bodies or parts thereof using fingerprinting
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1365Matching; Classification
    • G06V40/1371Matching features related to minutiae or pores

Abstract

The invention concerns a method of identifying people by means of the sweat glands in the skin of a finger and/or by means of the structure of a skin-forming layer located below the stratum corneum. To that end, ultrasound waves are emitted into the skin and the echoes received are evaluated.

Description

Die Erfindung betrifft ein Verfahren zur Personenidentifikation mittels Ultraschall.The invention relates to a method for personal identification using ultrasound.

Aus dem Stand der Technik US 4 564 019 ist ein Verfahren zur Messung von Charakteristika lebenden Gewebes durch Ultraschall bekannt. Aus der DE 4 226 865 A1 ist ein Ultraschalldiagnosegerät für die Dermatologie bekannt.From the prior art US 4,564,019 is a method for Ultrasound measurement of living tissue characteristics known. DE 4 226 865 A1 describes an ultrasound diagnostic device known for dermatology.

Bildgebende Verfahren zur Erkennung der Leistenstruktur der Hautoberfläche sind aus der US 5 224 174 und der WO 95/12354 bekannt. Aus der WO 94/25938 ist ein Verfahren zur Personenidentifikation bekannt, welches ebenfalls die Position der Schweißporen erfaßt. Aus der US 4 977 601, der EP 0 619 095 A1, der US 5 218 644, der US 5 258 922, der EP 0 402 779 A2 und der WO 94/24937 sind Verfahren bekannt, die den Betrag des von einer Wandlerstrecke gewonnenen und über mehrere Wandlerstrecken gemittelten Ortsfrequenzspektrum der Leistenstruktur oder anderer in den Anmeldungen nicht näher beschriebenen Zellstrukturen ("Epithelstruktur") zur Personenidentifikation heranziehen.Imaging methods for the detection of the last structure Skin surface are from US 5 224 174 and WO 95/12354 known. WO 94/25938 describes a method for Personal identification known, which also detects the position of the welding pores. From US 4 977 601, EP 0 619 095 A1, US 5 218 644, US 5 258 922, EP 0 402 779 A2 and WO 94/24937 Methods are known which determine the amount of a converter path obtained and averaged over several converter paths Spatial frequency spectrum of the inguinal structure or other in cell structures not described in detail in the applications ("Epithelial structure") for personal identification.

Aus der WO 94/01043 ist ein Verfahren bekannt, das Ultraschallwellen mit elektromagnetischen Wellen kombiniert.A method is known from WO 94/01043, the ultrasonic waves combined with electromagnetic waves.

Aus der WO 95/06262 ist ein Verfahren bekannt, das mit inverser Anregung arbeitet.From WO 95/06262 a method is known which uses inverse Suggestion works.

Die Aufgabe der Erfindung ist es, ein Verfahren zur Personenidentifikation anzugeben, das eine sichere Personenidentifikation gewährleistet und einfach zu realisieren ist.The object of the invention is a method for personal identification indicate that a secure personal identification guaranteed and easy to implement.

Die Aufgabe wird durch ein Verfahren gemäß dem Patentanspruch 1 gelöst.The object is achieved by a method according to the patent claim 1 solved.

Vorteilhafte Weiterbildungen ergeben sich aus den abhängigen Ansprüchen. Advantageous further developments result from the dependent ones Claims.

Die Erfindung wird anhand von drei Figuren weiter beschrieben.The invention is further described with reference to three figures.

Die Oberhaut der menschlichen Fingerkuppe, auch als Epidermis bezeichnet, besteht aus einer Hornschicht, einer Keimschicht und einer Basalschicht. Die Grenzfläche der Hornschicht zum ankoppelnden Medium stellt für Ultraschall einen hohen Impedanzsprung dar und kann zur Erkennung der Oberfläche herangezogen werden. Die aus dem obengenannten Stand der Technik bekannten bildgebenden Verfahren zur Erkennung der Leistenstruktur der Hautoberfläche nutzen diesen Effekt.The epidermis of the human fingertip called consists of a horny layer, a seed layer and a basal layer. The interface of the horny layer to the coupling medium represents a high impedance jump for ultrasound and can be used to recognize the surface become. The known from the above prior art imaging method for recognizing the last structure the skin surface use this effect.

Die Hornschicht ist in ihren akustischen Eigenschaften weitgehend konstant und somit echoarm. Eine Ausnahme bilden die in der Hornschicht vorhandenen Schweißporen, die meist entlang der Furchen zwischen den Leisten angeordnet sind und in einem Schnitt des Ultraschallbildes (C-Scan) in einer bestimmten Tiefe, typischerweise zwischen 100 und 250 um unter der Hautoberfläche erfaßt werden können (vgl. hierzu Figur 1).The horny layer is largely in its acoustic properties constant and therefore low-echo. The exception is sweat pores present in the horny layer, mostly along the furrows are arranged between the strips and in a section of the ultrasound image (C-scan) in a specific one Depth, typically between 100 and 250 µm below the surface of the skin can be detected (see FIG 1).

Die an der Fingeroberfläche vorhandene Leistenstruktur wiederholt sich in einer tieferliegenden Hautschicht, typischerweise 200 bis 500 µm (vgl. Figur 2). Der Übergang von der abgestorbenen (wasserarmen) Schicht der Oberhaut zu den wasserhaltigen, wie die Fingerleisten strukturierten hautbildenden Schichten stellt einen deutlich meßbaren Impedanzsprung dar, so daß sich diese Hautschicht ebenfalls zur Selektion von personenspezifischen Merkmalen eignet.Repeat the last structure on the finger surface yourself in a deeper layer of skin, typically 200 to 500 µm (see FIG. 2). The transition from the dead (low water) layer of the epidermis to the water-containing, like the finger strips structured skin-forming Layers represent a clearly measurable jump in impedance, so that this skin layer is also suitable for the selection of person-specific characteristics.

Ein Vorteil der zusätzlichen Detektion der tieferen Hautschichten ist eine höhere Fälschungssicherheit und eine gleichbleibende Erkennungsrate bei einer oberflächlichen Verletzung der Haut. Aufgrund des guten von der Oberfläche der Haut zu erzielenden mit Ultraschall aufgenommenen Bildes wird die Oberflächenstruktur der Haut ständig zur Identifizierung herangezogen. Die zusätzliche Identifizierung aufgrund von tieferliegenden Hautschichten verbessert das Verfahren jedoch wesentlich.An advantage of the additional detection of the deeper skin layers is a higher security against counterfeiting and one constant detection rate for a superficial injury of the skin. Because of the good of the surface of the Skin to be obtained with ultrasound image the surface structure of the skin constantly for identification used. The additional identification due to however, the procedure improves deeper skin layers essential.

Ein besonderer Vorteil der Detektion der Kanäle von Schweißdrüsen liegt darin, daß die gewonnenen Datensätze wegen der binären Information (Schweißdrüse vorhanden oder nicht vorhanden) mit wenig Speicherbedarf und Rechenzeit verarbeitet werden können.A special advantage of the detection of the channels of sweat glands is that the records obtained because of the binary information (sweat gland present or not present) processed with little memory and computing time can be.

Ein zweidimensionales Ultraschallwandler-Array von ca. 20*20 bis 200*200, typischerweise 100*100 Ultraschallwandlern mit einem Wandlerabstand von ca. 50 bis 200 µm wird so angeordnet, daß die informationstragenden Teile der Fingerkuppe, d.h. der Bereich, in dem auch die an der Hautoberfläche erkennbare Leistenstruktur signifikante Merkmale aufweist, erfaßt werden (vgl. Figur 3). Durch ein Puls-Echo-Verfahren wird die Echoamplitude der zu untersuchenden Hautschicht im Bereich von 100 bis 1000 µm untersucht. Die einzelnen Wandlerstrecken können als Einzelwandlerstrecke (jeder Wandler mißt sein eigenes Echo) oder als getrennte Wandlerstrecken (ein Wandler sendet und ein oder mehrere Wandler empfangen) ausgeführt sein.A two-dimensional ultrasonic transducer array of approximately 20 * 20 up to 200 * 200, typically 100 * 100 ultrasonic transducers with a transducer spacing of approx. 50 to 200 µm is arranged that the information-bearing parts of the fingertip, i.e. the area in which is also recognizable on the surface of the skin Last structure has significant features be (see Figure 3). Through a pulse-echo process the echo amplitude of the skin layer to be examined in the Range from 100 to 1000 µm examined. The individual converter sections can be used as a single converter section (each converter measures its own echo) or as separate converter paths (one converter sends and one or more converters receive) be executed.

Die kostengünstige Realisierung gemäß des vorliegenden Erfindung ergibt sich, wenn die Echoamplituden nur einer bestimmten Tiefe, z.B. die Ebene der Schweißdrüsen oder die Ebene der tieferliegenden informationstragenden Hautschichten, als skalarer oder binärer Wert abgespeichert und einer Mustererkennung zugeführt werden. Zum Ausgleich von unterschiedlichen Hautdicken kann hierbei die Adaption der Meßtiefe notwendig sein. The cost-effective implementation according to the present invention results when the echo amplitudes only a certain depth, e.g. the level of Sweat glands or the level of the underlying information-carrying Skin layers, saved as a scalar or binary value and a pattern recognition are supplied. To the Compensation of different skin thicknesses can Adaptation of the measuring depth may be necessary.

Die Erfindung benutzt die Schweißdrüsen der Hornschicht der menschlichen Fingerkuppe als personenspezifisches Merkmal. Diese werden mittels einer Ultrallschall-Sende/Empfangseinheit detektiert. Die von der Ultraschall-Sende/Empfangseinheit stammenden Informationen werden in der der Ultraschall-Sende/Empfangseinheit nachgeschalteten Auswerteeinheit weiter verarbeitet.The invention uses the sweat glands of the horny layer of the human fingertip as a person-specific characteristic. These are by means of an ultrasound transmitter / receiver unit detected. The from the ultrasound transmitter / receiver unit Information originating in the ultrasound transmitter / receiver unit downstream evaluation unit processed.

Die einzelnen Ultraschallwandler des Ultraschallwandlerarrays haben eine laterale Auflösung zwischen 50 und 200 um und können mikromechanisch hergestellt werden.The individual ultrasound transducers of the ultrasound transducer array have a lateral resolution between 50 and 200 µm and can be produced micromechanically.

Es ist auch möglich, 2-2-Composite-Ultraschallwandler mit einer lateralen Auflösung zwischen 50 und 200 µm zu verwenden.It is also possible to use 2-2 composite ultrasonic transducers use lateral resolution between 50 and 200 µm.

Die Echoamplituden oder die Maxima der Echoamplituden können in einer bestimmten Hautschicht aufgezeichnet und einer Bildverarbeitung zugeführt werden.The echo amplitudes or the maxima of the echo amplitudes can recorded in a certain layer of skin and image processing are fed.

Claims (4)

  1. Method for personal identification, in which the person or the persons are identified with the aid of their sweat glands in the skin, characterized in that the sweat glands are detected by means of an ultrasonic transmission/reception unit, where a pulse-echo method is used and echo amplitudes of a specific depth of a plane of the sweat glands in the region between 100 µm and 250 µm are detected and stored in scalar or binary value form and fed to a pattern recognition stage.
  2. Method according to Claim 1, in which a two-dimensional ultrasonic transducer array of 20×20 to 200×200 ultrasonic transducers with a transducer separation of 50 µm to 200 µm is used.
  3. Method according to Claim 2, in which the ultrasonic transducer array is configured with individual transducer channels and each ultrasonic transducer measures its own echo.
  4. Method according to Claim 2, in which the ultrasonic transducer array is configured with split transducer channels and, in addition to a transmitting ultrasonic transducer, one or more receiving ultrasonic transducers are provided.
EP97916354A 1996-04-10 1997-03-21 Method of identifying people Expired - Lifetime EP0833587B1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
DE19614220 1996-04-10
DE19614220 1996-04-10
PCT/DE1997/000585 WO1997037592A1 (en) 1996-04-10 1997-03-21 Method of identifying people
US09/301,448 US6228029B1 (en) 1996-04-10 1999-04-29 Method for the identification of persons

Publications (2)

Publication Number Publication Date
EP0833587A1 EP0833587A1 (en) 1998-04-08
EP0833587B1 true EP0833587B1 (en) 2003-10-22

Family

ID=26024638

Family Applications (1)

Application Number Title Priority Date Filing Date
EP97916354A Expired - Lifetime EP0833587B1 (en) 1996-04-10 1997-03-21 Method of identifying people

Country Status (10)

Country Link
US (1) US6228029B1 (en)
EP (1) EP0833587B1 (en)
JP (1) JP3065356B2 (en)
CN (1) CN1155335C (en)
AT (1) AT252344T (en)
DE (1) DE59710883D1 (en)
ES (1) ES2210512T3 (en)
IN (1) IN191434B (en)
MX (1) MX9710027A (en)
WO (1) WO1997037592A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004023999A1 (en) * 2002-09-13 2004-03-25 Fujitsu Limited Biosensing instrument and method and identifying device having biosensing function
JP4158097B2 (en) * 2003-02-27 2008-10-01 ソニー株式会社 Authentication system
US8255039B2 (en) * 2006-09-29 2012-08-28 Tearscience, Inc. Meibomian gland illuminating and imaging
CN100390812C (en) * 2005-11-18 2008-05-28 敦南科技股份有限公司 Testing tools applied for dermatoglyphics reader
US8249695B2 (en) 2006-09-29 2012-08-21 Tearscience, Inc. Meibomian gland imaging
ES2737881T3 (en) 2009-04-01 2020-01-16 Tearscience Inc Apparatus for measuring the thickness of the ocular tear film layer
JP6615748B2 (en) 2013-05-03 2019-12-04 テイアサイエンス・インコーポレーテツド Eyelid irradiation system and method for imaging meibomian glands for meibomian gland analysis
US9830424B2 (en) 2013-09-18 2017-11-28 Hill-Rom Services, Inc. Bed/room/patient association systems and methods
CN103488985A (en) * 2013-10-16 2014-01-01 无锡优创生物科技有限公司 Identify recognition system and method based on hand back pore distribution
US10628693B2 (en) 2016-12-21 2020-04-21 Essenlix Corporation Devices and methods for authenticating a sample and use of the same

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4190056A (en) * 1977-10-31 1980-02-26 General Medical Company Method and means for recording sweat gland activity
FR2578412A1 (en) * 1985-03-06 1986-09-12 Vanoni Regis METHOD AND DEVICE FOR RECOGNIZING AN INDIVIDUAL
US5143063A (en) * 1988-02-09 1992-09-01 Fellner Donald G Method of removing adipose tissue from the body
US5224174A (en) * 1990-11-07 1993-06-29 Niagara Technology Incorporated Surface feature mapping using high resolution c-scan ultrasonography
DE4310390C2 (en) * 1993-03-30 1995-03-16 Topping Best Ltd Ultrasound imaging device for detecting and / or identifying surface structures and structures close to the surface
US5647364A (en) * 1995-02-15 1997-07-15 Ultra-Scan Corporation Ultrasonic biometric imaging and identity verification system
US5709206A (en) * 1995-11-27 1998-01-20 Teboul; Michel Imaging system for breast sonography

Also Published As

Publication number Publication date
MX9710027A (en) 1998-03-31
ES2210512T3 (en) 2004-07-01
IN191434B (en) 2003-12-06
DE59710883D1 (en) 2003-11-27
JP3065356B2 (en) 2000-07-17
CN1195278A (en) 1998-10-07
CN1155335C (en) 2004-06-30
AT252344T (en) 2003-11-15
US6228029B1 (en) 2001-05-08
JPH10507679A (en) 1998-07-28
EP0833587A1 (en) 1998-04-08
WO1997037592A1 (en) 1997-10-16

Similar Documents

Publication Publication Date Title
DE60028952T2 (en) METHOD AND DEVICE FOR GENERATING PICTURES THROUGH THE USE OF SHEARS
DE10248745B4 (en) Method of using ultrasound to analyze media of interest and ultrasound analysis system
DE19723053C2 (en) Ultrasound imaging device
EP0833587B1 (en) Method of identifying people
DE102012108353B4 (en) CLASSIFICATION PREPROCESSING IN MEDICAL ULTRASONIC SHEAR WAVE IMAGING
US5107837A (en) Method and apparatus for measurement and imaging of tissue compressibility or compliance
CN109044407A (en) It is formed and/or is rebuild using the ultrasound image of multi-frequency waveform
WO1987005790A1 (en) Process for recognizing a fingerprint
WO2000034769A1 (en) Method for examining a solidified and/or hardened material using ultrasound, receptacle and ultrasound sensor for carrying out the method
DE102005020041B4 (en) Improved automatic adjustment of a power level for contrast agent imaging
Costello et al. Comparison of acoustic and pump sampling techniques for the analysis of zooplankton distributions
DE112011104312T5 (en) Blood pressure information measuring device and method for calculating the index of the degree of arteriosclerosis with this device
WO2011089160A1 (en) Device for determining vertebra spacing in the spinal column
CN106063711B (en) A kind of bone Guided waves with detach, identify and reconstructing method
DE102004043876A1 (en) Method and system for determining the authenticity of the individual characteristics of test objects
DE4016105B4 (en) Method and device for detecting surface structures
Rouvre et al. Empirical mode decomposition (EMD) for multi-gate, multi-transducer ultrasound Doppler fetal heart monitoring
WO2002037402A1 (en) Method and device for identifying test objects
DE19915583A1 (en) Device and method for 3D real-time sonography
Akhbardeh et al. Ballistocardiogram classification using a novel transform so-called AliMap and biorthogonal wavelets
EP1486169A3 (en) Device for the acoustic examination of the heart of a patient
Iula et al. Experimental evaluation of the moving linear array technique applied to livescan biometrics
Geisheimer et al. Applications of neural networks to the radarcardiogram (RCG)
KR19990022764A (en) Personal identification method
Hall Experimental methods for accurate determination of acoustic backscatter coefficients.

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT CH DE ES FR GB IT LI

17P Request for examination filed

Effective date: 19971208

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: INFINEON TECHNOLOGIES AG

17Q First examination report despatched

Effective date: 20020830

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT CH DE ES FR GB IT LI

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REF Corresponds to:

Ref document number: 59710883

Country of ref document: DE

Date of ref document: 20031127

Kind code of ref document: P

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: ICB INGENIEURS CONSEILS EN BREVETS SA

GBT Gb: translation of ep patent filed (gb section 77(6)(a)/1977)

Effective date: 20040116

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20040302

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20040322

Year of fee payment: 8

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2210512

Country of ref document: ES

Kind code of ref document: T3

ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20040723

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050321

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050322

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050331

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050331

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20050322

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20091203 AND 20091209

REG Reference to a national code

Ref country code: FR

Ref legal event code: TP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 59710883

Country of ref document: DE

Owner name: ORITAL SOLUTIONS LLC, WILMINGTON, US

Free format text: FORMER OWNER: INFINEON TECHNOLOGIES AG, 81669 MUENCHEN, DE

Effective date: 20110329

Ref country code: DE

Ref legal event code: R081

Ref document number: 59710883

Country of ref document: DE

Owner name: ORITAL SOLUTIONS LLC, US

Free format text: FORMER OWNER: INFINEON TECHNOLOGIES AG, 81669 MUENCHEN, DE

Effective date: 20110329

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20120216 AND 20120222

REG Reference to a national code

Ref country code: FR

Ref legal event code: TP

Owner name: ORITAL SOLUTIONS LLC, US

Effective date: 20120220

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 59710883

Country of ref document: DE

Representative=s name: SCHWEIGER & PARTNER, DE

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 59710883

Country of ref document: DE

Representative=s name: SCHWEIGER & PARTNERS, DE

Effective date: 20120521

Ref country code: DE

Ref legal event code: R082

Ref document number: 59710883

Country of ref document: DE

Representative=s name: SCHWEIGER & PARTNER, DE

Effective date: 20120521

Ref country code: DE

Ref legal event code: R081

Ref document number: 59710883

Country of ref document: DE

Owner name: ORITAL SOLUTIONS LLC, WILMINGTON, US

Free format text: FORMER OWNER: WI-LAN, INC., OTTAWA, ONTARIO, CA

Effective date: 20120521

Ref country code: DE

Ref legal event code: R081

Ref document number: 59710883

Country of ref document: DE

Owner name: ORITAL SOLUTIONS LLC, US

Free format text: FORMER OWNER: WI-LAN, INC., OTTAWA, CA

Effective date: 20120521

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: AT

Payment date: 20120228

Year of fee payment: 16

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 252344

Country of ref document: AT

Kind code of ref document: T

Effective date: 20130321

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130321

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20160224

Year of fee payment: 20

Ref country code: FR

Payment date: 20160223

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20160324

Year of fee payment: 20

REG Reference to a national code

Ref country code: DE

Ref legal event code: R071

Ref document number: 59710883

Country of ref document: DE

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

Expiry date: 20170320

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20170320