EP3732612A1 - A system and method for face recognition - Google Patents

A system and method for face recognition

Info

Publication number
EP3732612A1
EP3732612A1 EP18814503.1A EP18814503A EP3732612A1 EP 3732612 A1 EP3732612 A1 EP 3732612A1 EP 18814503 A EP18814503 A EP 18814503A EP 3732612 A1 EP3732612 A1 EP 3732612A1
Authority
EP
European Patent Office
Prior art keywords
face
face recognition
picture
images
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP18814503.1A
Other languages
German (de)
French (fr)
Inventor
Louis Chen
Koray AYDOGDU
Norman LIN
Oliver Huang
Chiu GOODSPEED
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Arcelik AS
Original Assignee
Arcelik AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Arcelik AS filed Critical Arcelik AS
Publication of EP3732612A1 publication Critical patent/EP3732612A1/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/96—Management of image or video recognition tasks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation

Definitions

  • the present invention relates to a system and method for face recognition in which, before comparing with a database storing all face images, comparison is conducted with the faces in a second database in which the most recently detected face images are stored, comprising a less number of face images with respect to said database.
  • a face recognition process is generally executed as follows: first, a plurality of pictures are taken by means of a camera, and whether each of said pictures contain a face image is detected by using a face detection algorithm. If no face image is detected in a picture, then the same process is repeated for the next picture. If a face image/face images are detected in a picture, a face recognition algorithm is executed on the picture containing said face image/images, comparing the face image/images in said pictures with the face images stored in a database, thereby identifying the face in each picture. These processes are repeated by being applied to every picture taken by the camera.
  • a higher number of face images stored in the database for comparison with the face images contained in the pictures taken by the camera proportionally increases the number of the comparison processes to be executed, thereby slowing down the performance of the face recognition algorithm. Furthermore, following said time consuming comparison processes, after identifying in the database the face matching with the face image contained in the picture taken by the camera, said face recognition processes are repeated for the face images in each newly taken picture. Since said processes are repeated even for the identical face images contained in consecutive pictures, these redundant repetitions lead to bottlenecks in the performance of the face recognition algorithm.
  • the aim of the present invention is to realize a system and a method for face recognition to enhance the efficiency of the entire face recognition process by reducing the redundant operations in face recognition algorithms.
  • a system adapted to execute the face recognition method of the invention comprises at least one camera to take pictures; at least one face database in which face images and identity information related to said face images are stored; at least one temporary storage unit in which the identified face images from the pictures received from the camera, are temporarily stored; and a control unit adapted to operate a face detection algorithm for detecting the faces in the pictures taken by the camera, a matching algorithm for comparing the face images detected by the face detection algorithm with the face images stored in the temporary storage unit, and a face recognition algorithm for determining the identity information of the faces not matched by the matching algorithm by comparing said face images with the face images in the face database, and to save in the temporary storage unit, the face images identified by the face recognition algorithm and the identity information related to said face images.
  • a temporary storage unit containing the previously identified face images is used instead of a database in which all face images are stored, enabling executing the face recognition process in a shorter time, thereby enhancing the performance of image processing.
  • a face recognition method whether a face image is present in a picture received from a camera, is detected by applying a face detection algorithm to said picture. Then, a control unit operates a matching algorithm to match at least one face image detected in a picture, with the face images in a temporary storage unit in which the most recently identified face images are stored. If at least one face image in this picture matches with one of the face images in the temporary storage unit, then the process is repeated for the next picture taken by the camera, applying face detection and matching algorithms to said next picture in the same manner. If there is no match, then the control unit operates the face recognition algorithm to identify the identity information of said at least one face by comparing said at least one face image with the face images in the face database. The control unit transmits to the temporary storage unit and saves therein said at least one face image and its identity information identified by the face recognition algorithm. An identical face image appearing in the following pictures is thus enabled to be identified in a shorter time.
  • Figure 1 is a flow chart related to the face recognition method of the invention.
  • Figure 2 is a schematic view of the face recognition system of the invention.
  • Figure 3 is a flow chart related to the face recognition method used in the prior art.
  • Figure 4 is a schematic view of the face recognition system used in the prior art.
  • the face recognition system (1) of the invention comprises, at least one camera (2) to take pictures; at least one face database (3) in which face images and identity information related to said face images are stored; at least one temporary storage unit (4) in which the identified face images are temporarily stored; and at least one control unit (5) adapted to operate a face detection algorithm for detecting the faces in the pictures taken by the camera (2), a matching algorithm for determining the identity information related to said faces by comparing the face images detected by the face detection algorithm with the face images stored in the temporary storage unit (4), and a face recognition algorithm for determining the identity information of the faces not matched by the matching algorithm by comparing said face images with the face images in the face database (3), and to save in the temporary storage unit (4), the face images identified by the face recognition algorithm and the identity information related to said face images.
  • the face recognition method executed by using the face recognition system (1) of the invention comprises the steps of
  • the face recognition method of the invention instead of comparing the face images in each picture with all of the face images in the face database (3) each time, these face images are first compared with the face images stored in the temporary storage unit (4) comprising the most recently identified face images which are of a lower amount than the face images of the face database (3). Therefore, by means of comparing the faces in the most recently taken pictures with the face images in the temporary storage unit (4) before comparing with those in the face database (3), the identity information of said pictures are determined in a shorter time.
  • Said face recognition method begins with taking a picture by means of the camera (2).
  • a face detection algorithm is applied by the control unit (5) to the first picture taken by means of the camera (2), and whether a face image is present in said picture, is detected.
  • control unit (5) queries whether the face recognition process continues. If the camera (2) keeps on taking pictures, then the face recognition process continues and the step of receiving pictures from the camera (2) is resumed, and the control unit (5) applies the face detection algorithm to the next picture taken by the camera (2). If the camera (2) does not continue taking pictures, then the face recognition process is terminated.
  • the control unit (5) operates a matching algorithm to match these face images with those stored in the temporary storage unit (4).
  • a faster matching is provided compared to a normal face recognition algorithm since said matching algorithm does not compare all features of a face in a face image.
  • Any image matching algorithm known in the art may be used as the matching algorithm.
  • the control unit (5) queries whether there is at least one unmatched face image in the picture. According to the result of said query, one of, a plurality of, or all of the face images in a picture may be matched or unmatched.
  • the control unit (5) queries whether the face recognition process continues. If the camera (2) keeps on taking pictures, then the face recognition process continues and the step of receiving pictures from the camera (2) is resumed, and the control unit (5) applies the face detection and the matching algorithms to the next picture taken by the camera (2). If the camera (2) does not continue taking pictures, then the face recognition process is terminated.
  • the control unit (5) operates a face recognition algorithm to determine the identity of said at least one unmatched face image. Any face recognition algorithm known in the art may be used as the face recognition algorithm.
  • the face recognition algorithm compares said at least one unmatched face image with the face images in the face database (3), determining the identity information of said at least one face image. Then the control unit (5) transmits this identified face image and its identity information to the temporary storage unit (4), saving said face image for subsequent face recognition operations.
  • control unit (5) queries whether the face recognition process continues. If the camera (2) keeps on taking pictures, then the face recognition process continues and the step of receiving pictures from the camera (2) is resumed, and the control unit (5) applies the same algorithms to the next picture taken by the camera (2). If the camera (2) does not continue taking pictures, then the face recognition process is terminated.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Collating Specific Patterns (AREA)

Abstract

By means of the invention, instead of comparing the face images in each picture with all of the face images in the face database (3) each time, these face images are first compared with the face images stored in the temporary storage unit (4) comprising the most recently detected face images. Therefore, by means of comparing the detected faces in the most recently taken pictures with the face images in the temporary storage unit (4) before comparing with the face database (3), the identity information of said faces are determined in a shorter time. In the face recognition method proposed to achieve this aim, a picture is taken by means of a camera (2), a face detection algorithm is applied to the taken picture by the control unit (5), a matching algorithm is applied by the control unit (5) to the detected face images to match a detected face image with the face images in the temporary storage unit (4), a face recognition algorithm is applied by the control unit (5) to the unmatched face image(s) and the identified face image(s) are saved in the temporary storage unit (4).

Description

    A SYSTEM AND METHOD FOR FACE RECOGNITION
  • Technical Field
  • The present invention relates to a system and method for face recognition in which, before comparing with a database storing all face images, comparison is conducted with the faces in a second database in which the most recently detected face images are stored, comprising a less number of face images with respect to said database.
  • Prior Art
  • In the field of machine vision, a face recognition process is generally executed as follows: first, a plurality of pictures are taken by means of a camera, and whether each of said pictures contain a face image is detected by using a face detection algorithm. If no face image is detected in a picture, then the same process is repeated for the next picture. If a face image/face images are detected in a picture, a face recognition algorithm is executed on the picture containing said face image/images, comparing the face image/images in said pictures with the face images stored in a database, thereby identifying the face in each picture. These processes are repeated by being applied to every picture taken by the camera.
  • A higher number of face images stored in the database for comparison with the face images contained in the pictures taken by the camera, proportionally increases the number of the comparison processes to be executed, thereby slowing down the performance of the face recognition algorithm. Furthermore, following said time consuming comparison processes, after identifying in the database the face matching with the face image contained in the picture taken by the camera, said face recognition processes are repeated for the face images in each newly taken picture. Since said processes are repeated even for the identical face images contained in consecutive pictures, these redundant repetitions lead to bottlenecks in the performance of the face recognition algorithm.
  • Problems Solved by the Invention
  • The aim of the present invention is to realize a system and a method for face recognition to enhance the efficiency of the entire face recognition process by reducing the redundant operations in face recognition algorithms.
  • A system adapted to execute the face recognition method of the invention, comprises at least one camera to take pictures; at least one face database in which face images and identity information related to said face images are stored; at least one temporary storage unit in which the identified face images from the pictures received from the camera, are temporarily stored; and a control unit adapted to operate a face detection algorithm for detecting the faces in the pictures taken by the camera, a matching algorithm for comparing the face images detected by the face detection algorithm with the face images stored in the temporary storage unit, and a face recognition algorithm for determining the identity information of the faces not matched by the matching algorithm by comparing said face images with the face images in the face database, and to save in the temporary storage unit, the face images identified by the face recognition algorithm and the identity information related to said face images.
  • In the method of the invention, in order to identify a previously identified face image which reappears in following pictures, a temporary storage unit containing the previously identified face images is used instead of a database in which all face images are stored, enabling executing the face recognition process in a shorter time, thereby enhancing the performance of image processing.
  • In the face recognition method realized to achieve the aim of the invention, whether a face image is present in a picture received from a camera, is detected by applying a face detection algorithm to said picture. Then, a control unit operates a matching algorithm to match at least one face image detected in a picture, with the face images in a temporary storage unit in which the most recently identified face images are stored. If at least one face image in this picture matches with one of the face images in the temporary storage unit, then the process is repeated for the next picture taken by the camera, applying face detection and matching algorithms to said next picture in the same manner. If there is no match, then the control unit operates the face recognition algorithm to identify the identity information of said at least one face by comparing said at least one face image with the face images in the face database. The control unit transmits to the temporary storage unit and saves therein said at least one face image and its identity information identified by the face recognition algorithm. An identical face image appearing in the following pictures is thus enabled to be identified in a shorter time.
  • Detailed Description of the Invention
  • A system and method for face recognition realized to achieve the aims of the present invention are illustrated in the accompanying drawings, wherein:
    Figure 1: is a flow chart related to the face recognition method of the invention.
    Figure 2: is a schematic view of the face recognition system of the invention.
    Figure 3: is a flow chart related to the face recognition method used in the prior art.
    Figure 4: is a schematic view of the face recognition system used in the prior art.
  • The elements in the figures are numbered individually and the correspondence of these numbers are given hereinafter.
    1. Face recognition system
    2. Camera
    3. Face database
    4. Temporary storage unit
    5. Control unit
  • In its most basic form, the face recognition system (1) of the invention comprises, at least one camera (2) to take pictures; at least one face database (3) in which face images and identity information related to said face images are stored; at least one temporary storage unit (4) in which the identified face images are temporarily stored; and at least one control unit (5) adapted to operate a face detection algorithm for detecting the faces in the pictures taken by the camera (2), a matching algorithm for determining the identity information related to said faces by comparing the face images detected by the face detection algorithm with the face images stored in the temporary storage unit (4), and a face recognition algorithm for determining the identity information of the faces not matched by the matching algorithm by comparing said face images with the face images in the face database (3), and to save in the temporary storage unit (4), the face images identified by the face recognition algorithm and the identity information related to said face images.
  • In its most basic form, the face recognition method executed by using the face recognition system (1) of the invention, comprises the steps of
    • taking a picture by means of the camera (2),
    • applying by the control unit (5) a face detection algorithm to the taken picture,
    • querying whether at least one face image is present in the taken picture,
      • - querying whether the face recognition process continues if there is no face image,
        • - in case the face recognition process continues, returning back to the step of "taking a picture by means of the camera (2),"
        • - in case the face recognition process does not continue, stopping the face recognition process,
        • - if at least one face image is found, then operating by the control unit (5) a matching algorithm to match said at least one face image with the face images in the temporary storage unit (4),
    • querying whether at least one previously not matched face image is present in the picture,
      • - if there is at least one previously not matched face image, then operating by the control unit (5) a face recognition algorithm to identify said at least one not matched face image by comparing it with the face images in the face database (3), and saving at least one identified face image to the temporary storage unit (4),
        - if there is no previously not matched face image, querying whether the face recognition process continues,
        • - in case the face recognition process continues, returning back to the step of "taking a picture by means of the camera (2),"
        • - in case the face recognition process does not continue, stopping the face recognition process.
  • Thanks to the face recognition method of the invention, instead of comparing the face images in each picture with all of the face images in the face database (3) each time, these face images are first compared with the face images stored in the temporary storage unit (4) comprising the most recently identified face images which are of a lower amount than the face images of the face database (3). Therefore, by means of comparing the faces in the most recently taken pictures with the face images in the temporary storage unit (4) before comparing with those in the face database (3), the identity information of said pictures are determined in a shorter time.
  • Said face recognition method begins with taking a picture by means of the camera (2). A face detection algorithm is applied by the control unit (5) to the first picture taken by means of the camera (2), and whether a face image is present in said picture, is detected.
  • If there is no face image present in said picture, the control unit (5) queries whether the face recognition process continues. If the camera (2) keeps on taking pictures, then the face recognition process continues and the step of receiving pictures from the camera (2) is resumed, and the control unit (5) applies the face detection algorithm to the next picture taken by the camera (2). If the camera (2) does not continue taking pictures, then the face recognition process is terminated.
  • If at least one face image is detected in a taken picture, in the next step, the control unit (5) operates a matching algorithm to match these face images with those stored in the temporary storage unit (4). A faster matching is provided compared to a normal face recognition algorithm since said matching algorithm does not compare all features of a face in a face image. Any image matching algorithm known in the art may be used as the matching algorithm.
  • In the next step, after operating the matching algorithm, the control unit (5) queries whether there is at least one unmatched face image in the picture. According to the result of said query, one of, a plurality of, or all of the face images in a picture may be matched or unmatched.
  • In case one or a plurality of face images are detected in said picture, if all of these face images are matched by the matching algorithm, then in the next step, the control unit (5) queries whether the face recognition process continues. If the camera (2) keeps on taking pictures, then the face recognition process continues and the step of receiving pictures from the camera (2) is resumed, and the control unit (5) applies the face detection and the matching algorithms to the next picture taken by the camera (2). If the camera (2) does not continue taking pictures, then the face recognition process is terminated.
  • In case one or a plurality of face images are detected in said picture, if at least one of these face images does not match with the face images in the temporary storage unit (4) by the matching algorithm, then the control unit (5) operates a face recognition algorithm to determine the identity of said at least one unmatched face image. Any face recognition algorithm known in the art may be used as the face recognition algorithm. The face recognition algorithm compares said at least one unmatched face image with the face images in the face database (3), determining the identity information of said at least one face image. Then the control unit (5) transmits this identified face image and its identity information to the temporary storage unit (4), saving said face image for subsequent face recognition operations.
  • Then the control unit (5) queries whether the face recognition process continues. If the camera (2) keeps on taking pictures, then the face recognition process continues and the step of receiving pictures from the camera (2) is resumed, and the control unit (5) applies the same algorithms to the next picture taken by the camera (2). If the camera (2) does not continue taking pictures, then the face recognition process is terminated.

Claims (3)

  1. A face recognition system (1) comprising at least one camera (2) to take pictures; at least one face database (3) in which face images and identity information related to said face images are stored; and at least one control unit (5) adapted to operate a face detection algorithm for detecting the faces in the pictures taken by the camera (2), and a face recognition algorithm for determining the identity information of said faces by comparing them with the face images in the face database (3), characterized by:
    - at least one temporary storage unit (4) for temporarily storing the face images identified by the face recognition algorithm, and by
    - the control unit (5) adapted to operate a matching algorithm for comparing the face images detected by the face detection algorithm with the face images stored in the temporary storage unit (4) and to save in the temporary storage unit (4), the face images identified by the face recognition algorithm and the identity information related to said face images.
  2. A face recognition method executed by a face recognition system (1) according to claim 1, comprising the steps of
    - taking a picture by means of the camera (2),
    - applying by the control unit (5) a face detection algorithm to the taken picture,
    - querying whether at least one face image is present in the taken picture, characterized by the steps of
    - querying whether the face recognition process continues if there is no face image,
    - in case the face recognition process continues, returning back to the step of "taking a picture by means of the camera (2),"
    - in case the face recognition process does not continue, stopping the face recognition process,
    - if at least one face image is found, then operating a matching algorithm by the control unit (5) to match said at least one face image with the face images in the temporary storage unit (4),
    - querying whether at least one previously not matched face image is present in the picture,
    - if there is at least one previously not matched face image, then operating by the control unit (5) a face recognition algorithm to identify said at least one not matched face image by comparing it with the face images in the face database (3), and, saving at least one identified face image to the temporary storage unit (4),
    - if there is no previously not matched face image, querying whether the face recognition process continues,
    - in case the face recognition process continues, returning back to the step of "taking a picture by means of the camera (2)," and
    - in case the face recognition process does not continue, stopping the face recognition process.
  3. A face recognition method according to claim 2, characterized by the step of querying whether the camera (2) continues taking further pictures in the step of "querying whether the face recognition process continues"; if picture taking continues, returning back to the step of "taking a picture by means of the camera (2)," and if mage taking is not continued, then terminating the face recognition process.
EP18814503.1A 2017-12-25 2018-11-22 A system and method for face recognition Withdrawn EP3732612A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR2017/21657A TR201721657A2 (en) 2017-12-25 2017-12-25 ONE FACE RECOGNITION SYSTEM AND METHOD
PCT/EP2018/082144 WO2019129444A1 (en) 2017-12-25 2018-11-22 A system and method for face recognition

Publications (1)

Publication Number Publication Date
EP3732612A1 true EP3732612A1 (en) 2020-11-04

Family

ID=64604606

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18814503.1A Withdrawn EP3732612A1 (en) 2017-12-25 2018-11-22 A system and method for face recognition

Country Status (3)

Country Link
EP (1) EP3732612A1 (en)
TR (1) TR201721657A2 (en)
WO (1) WO2019129444A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112183282A (en) * 2020-09-22 2021-01-05 北京金山云网络技术有限公司 Face image processing method, device, equipment and storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006126141A1 (en) * 2005-05-27 2006-11-30 Koninklijke Philips Electronics N.V. Images identification method and apparatus
US9245276B2 (en) * 2012-12-12 2016-01-26 Verint Systems Ltd. Time-in-store estimation using facial recognition
SG10201504080WA (en) * 2015-05-25 2016-12-29 Trakomatic Pte Ltd Method and System for Facial Recognition

Also Published As

Publication number Publication date
TR201721657A2 (en) 2019-07-22
WO2019129444A1 (en) 2019-07-04

Similar Documents

Publication Publication Date Title
US11238605B2 (en) Simultaneous localization and mapping method, computer device, and storage medium
US8401313B2 (en) Image processing apparatus and image processing method
US20140347511A1 (en) Methods and systems for confidence-based image processing
US11494188B2 (en) Prefetch strategy control for parallel execution of threads based on one or more characteristics of a stream of program instructions indicative that a data access instruction within a program is scheduled to be executed a plurality of times
US20140023248A1 (en) Apparatus and method for protecting privacy information based on face recognition
US10262186B2 (en) Method for authenticating fingerprint and authentication apparatus using same
US20120098948A1 (en) Fingerprint authentication apparatus having a plurality of fingerprint sensors and method for same
EP3182067A1 (en) Method and apparatus for determining spacecraft attitude by tracking stars
US11281922B2 (en) Face recognition system, method for establishing data of face recognition, and face recognizing method thereof
CN110363790B (en) Target tracking method, device and computer readable storage medium
CN110633289A (en) License plate number determining method, server and parking management system
US11804072B2 (en) Method for training convolutional neural network, and method for face recognition and device
WO2019129444A1 (en) A system and method for face recognition
CN115797759A (en) Multi-target paper image rapid identification method
CN111476101A (en) Video shot switching detection method and device and computer readable storage medium
CN114125082A (en) Telemetry data processing method, device and system
US20170124380A1 (en) Fingerprint image processing method and device
WO2018121414A1 (en) Electronic device, and target image recognition method and apparatus
CN111222367B (en) A fingerprint identification method and device, storage medium, and terminal
CN112365527B (en) Method and system for tracking vehicles across mirrors in a park
KR101995711B1 (en) Method and apparatus for biometrics authentication
US8611599B2 (en) Information processing apparatus, information processing method, and storage medium
JP5537140B2 (en) SAFETY CONTROL DEVICE AND SAFETY CONTROL PROGRAM
JP5371541B2 (en) Data processing apparatus and processing method thereof
CN113888608A (en) Target tracking method, device, equipment and medium

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200629

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20210216