WO2019221618A1 - Dispositif électronique de commande de lunettes et système et procédé de commande de lunettes comprenant un tel dispositif électronique - Google Patents

Dispositif électronique de commande de lunettes et système et procédé de commande de lunettes comprenant un tel dispositif électronique Download PDF

Info

Publication number
WO2019221618A1
WO2019221618A1 PCT/PL2018/050022 PL2018050022W WO2019221618A1 WO 2019221618 A1 WO2019221618 A1 WO 2019221618A1 PL 2018050022 W PL2018050022 W PL 2018050022W WO 2019221618 A1 WO2019221618 A1 WO 2019221618A1
Authority
WO
WIPO (PCT)
Prior art keywords
customer
pictures
eyewear
cameras
ordering
Prior art date
Application number
PCT/PL2018/050022
Other languages
English (en)
Inventor
Eryk MAKOWSKI
Michal JARON
Stanislaw Nowak
Original Assignee
Optimy Sp. Z O.O.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Optimy Sp. Z O.O. filed Critical Optimy Sp. Z O.O.
Priority to PCT/PL2018/050022 priority Critical patent/WO2019221618A1/fr
Publication of WO2019221618A1 publication Critical patent/WO2019221618A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Shopping interfaces
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/11—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for measuring interpupillary distance or diameter of pupils
    • A61B3/111—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for measuring interpupillary distance or diameter of pupils for measuring interpupillary distance
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14—Arrangements specially adapted for eye photography

Definitions

  • This invention relates to an electronic device for ordering eyewear and system and method for ordering eyewear comprising such an electronic device.
  • the invention is applicable in the field of taking measurements performed by an optician / optometrist in order to let optical workshop swiftly and most accurately get parameters aiming at defining optical center and level of progression on progressive lenses before preparing ordered eyewear.
  • the eyewear market requires very high standard of customer service, ach customer should be individually served to meet its own needs. Such services require for e ample a possibility of measuring the distance between the pupils.
  • the optician store staff is often short of time.
  • the orthoptist or technical staff member will make use of relatively unprecise and unadapted tools to measure pupillary distance PD .
  • bo ing uses the lower tangent to the eyeglass frame, ut this may result in even less precise result.
  • the measurement-taking process is a long and boring procedure, that demotivates people from consulting eye-doctors as often as they should to preserve their vision from deterioration.
  • the object of the invention is to provide a compact self-service device and system for ordering eyewear while offering high accuracy measurement of pupillary distance PD and half-height SH and moreover simplifying and making the process of ordering new eyewear more efficient.
  • the invention is aimed at providing an effective self-service tool and system for ordering eyewear while getting two critical measurements, namely pupillary distance PD and half-height SH, in a hassle-free funny way and with the accuracy up to 0,5 mm.
  • the invention relates to an electronic device for ordering eyewear comprising a first camera for taking pictures of the customer eye region, a control unit comprising processor and memory means for managing components of the device, a user interface for providing inputs from the customer, a display for prompting the customer , means for accessing a database with at least 2D model data related to eyeglass frames upon purchase characterized in that it further comprises at least one additional camera for taking pictures of the customer face, disposed at different height than the first camera, means for reading marking from an eyeglass frame for accessing model data of said eyeglass frame from the database, wherein at least said two cameras are calibrated so as to take at least two pictures of the customer face which match geometrically and wherein the control unit is adapted to process said at least two pictures acquired by at least said two cameras so as to find characteristic points of the customer face and is adapted to calculate pupillary distance and half-height based on the at least 2D model data of the eyeglass frame from the database and said characteristic points of the customer face.
  • the device comprises a frame and a two-way mirror arranged on at least a part of a front side of the frame so as to cover said at least two cameras and constitute the display surface.
  • the electronic device for ordering eyewear thanks to the presence of the two- way mirror eases the trial of new eyeglass frames, allowing shortsighted users to see themselves immediately while wearing new spectacles.
  • the invention relates to a system for ordering eyewear characterized in that it comprises:
  • an external server for managing orders - an electronic device for ordering eyewear comprising
  • control unit comprising processor and memory means for managing components of the device, the control unit being adapted to acquire and process data on lenses required for the customer
  • At least one additional camera for taking pictures of the customer face disposed at different height than the first camera
  • control unit is adapted to process said at least two pictures acquired by at least said two cameras so as to find characteristic points of the customer face and is adapted to calculate pupillary distance PD and half-height SH based on the at least 2D model data of the eyeglass frame from the database and said characteristic points of the customer face.
  • control unit is further adapted to automatically complete an order for eyewear.
  • the invention relates to a method of ordering eyewear, comprising steps of:
  • inputs from the customer are provided with the use of a user interface built in the device for ordering eyewear.
  • inputs from the customer are provided with the use of a user interface of the mobile device.
  • acquiring data on lenses required for the customer is performed by scanning a prescription with a scanner.
  • the device for ordering eyewear contains built in cameras that allow potential customers to take pictures and send them to customers' mobile devices via different media.
  • the device for ordering eyewear enables biometrical measurement of important elements of the face (especially distance between pupils) using high quality pictures.
  • the system for ordering eyewear allows the customer to purchase the eyeglasses in self-service manner via cell phone or dedicated self-service device. [0032] It allows for the most accurate measurement of both above-mentioned measurements that are critical to adapt optical lenses mounting to selected eyeglass frames.
  • the electronic device and the system for ordering eyewear according to the invention allow an interactive electronic shopping experience that can be accessed in store.
  • the system for ordering eyewear allows for promptly transferring indications required for the mounting of lenses on eyeglass frames from store to workshop.
  • the electronic device for ordering eyewear according to the invention namely "a digital mirror” is designed for automating and fine-tuning measurements necessary to match optical lenses with eyeglass frames, to provide end-users with perfectly fitted eye-glasses.
  • a method for ordering eyewear according to the invention allows to automate preparatory works to fine-tune the cutting and mounting of ophthalmic lenses on eyeglass frames thanks to the process of automatically measuring pupillary distance (PD) and half-height (SH).
  • PD pupillary distance
  • SH half-height
  • Fig.l is a general view of the electronic device for ordering eyewear, namely 'a digital mirror', according to the invention placed at the optician store;
  • Fig.2 is a block diagram of the system for ordering eyewear according to the invention
  • Fig.3 is a block diagram of the device for ordering eyewear, namely the digital mirror, according to the invention
  • Fig.4 is a flowchart of the eyewear ordering process
  • Fig.5 is a flowchart of the PD calculation algorithm
  • Fig.6 is a flowchart of the SH calculation algorithms
  • Fig.7 is a general flowchart of PD and SH calculation process
  • Fig.8 illustrates exemplary pattern sheets for the calibration process
  • Fig.9 illustrates geometrical relations between points in 3d space in the camera calibration process
  • the electronic device and the system for ordering eyewear according to the invention are aimed at helping the customer with eyeglass frame and lenses selection by prompting for user information and automatically deriving required optical parameters based on taken pictures and sending an order. They also allow to order new eyeglasses without assistance of the optician.
  • Fig.2 is a block diagram of the system 100 for ordering eyewear. It comprises an electronic device 200 for ordering eyewear according to the invention, also called a digital mirror 200, which is the main device of the system 100 for ordering eyewear. Among other functionalities, since the electronic device 200 for ordering eyewear is a central module, it communicates with all other modules of the system 100, including receiving the requests from other modules and responding to them.
  • the digital mirror 200 serves for selecting and gathering details of an order. It also serves for measuring pupillary distance PD and half-height SH of a person wishing to purchase new eyeglasses.
  • the electronic device 200 for ordering eyewear namely the digital mirror 200 has a compact form.
  • the electronic device 200 for ordering eyewear has a frame 230, preferably of substantially cuboid shape.
  • the frame 230 is at least partially covered by a two-way mirror 219 which causes the digital mirror 200 to look like a typical mirror.
  • the digital mirror 200 might be mountable to various places in the optical store.
  • the digital mirror 200 may be located right where customers would try on eyeglass frames 400 such as a display area. It should be noted that customers try on eyeglass frames 400 from a certain distance d which allow proper measuring process. In reality, said distance d is comprised within a certain range of allowable distances.
  • the digital mirror 200 comprises a computer hardware in the form of a control unit 202, comprising a processor 203 for controlling components of the digital mirror 200 with the use of various applications and memory means 204 for storing code of various software applications running on the processor 203 as well as various data.
  • Memory means 204 might be any type of memory like hard drive, solid state drive or memory card.
  • One of the applications running on the processor 203, namely a digital mirror application 215 enables registering / logging in / logging out of the system 100 with the use of a given username and password. Only one user might be logged in at a given time.
  • measurement application 213 for measuring and calculating characteristic values PD and SH
  • admin interface application 214 for administrative and maintenance access.
  • application 216 serving hardware interfaces as well as FrontEnd application 217 for guiding the customer through the purchase process
  • BackEnd application 218 for communication with BackOffice 300.
  • the digital mirror 200 may comprise a frame 230 and at least one mounting plate (not shown) for attaching internal components.
  • a frame 230 Inside the digital mirror 200 at least two cameras 201a, 201b are disposed at two different heights for taking pictures of a person standing in front of it.
  • cameras 201a, 201b, 201c disposed at different heights for making measurements more accurate.
  • Pictures taken by the cameras (201a, 201b) are used to determine the pupillary distance PD and half-height distance SH of the customer by a measurement application 213 as explained later.
  • Those two parameters are used to design properly different types of lenses like mono-focal lenses and progressive lenses.
  • the digital mirror 200 may also comprise an RFID reader 209 connected to the control unit 202 for reading marking means 401 ( tags/ tag chips 401) attached to different eyeglass frames 400.
  • the customer takes selected eyeglass frame 400 off the shelf and puts in proximity of the RFID reader 209, advantageously while wearing it on one's nose, to cause the RFID reader 209 to read the information from the chip tag 401 disposed on the selected eyeglass frame 400.
  • means 209 for reading marking from eyeglass frames 400 may have another form depending on the type of the marking of the specific eyeglass frame 400.
  • the digital mirror 200 comprises advantageously an internal built-in display means 206 connected to the control unit 202 for displaying messages and instructions to the user of the digital mirror 200 in order to help him to get thorough the whole purchase process.
  • the internal display means 206 displays advertisements or other audio and video material.
  • the two-way mirror 219 arranged on the frame 230 of the digital mirror 200 constitutes a display surface covering said display means 206.
  • the internal built-in display means 206 for example a screen 206 enables displaying information read for identified eyeglass frames 400, for example dimensions, price, picture and accessible options (for example eyeglass frame color, material etc., type of lenses) from internal storage means 204. Data related to a selected eyeglass frame 400 are associated directly with the information read from the tag chip 401.
  • the front side of the device 200 for ordering eyewear according to the invention is covered by a two-way mirror 219 for example a Venetian mirror 219.
  • the two-way mirror 219 on one hand allows the purchaser standing in front of it to try on various eyeglass frames 400 and on the other hand to see and read messages displayed on the internal display means 206.
  • the device 200 for ordering eyewear according to the invention namely the digital mirror 200 comprises advantageously a user interface 211, for example a touch pad or touch screen or a keypad.
  • the user interface 211 might be implemented as a part of an external mobile device 500, for example as a user interface of a mobile phone 500.
  • the user interface 211 allows inputting various information required to place an order, for example details of refraction, namely distance vision, near vision information, such as a spherical correction, cylindrical correction, axis, prism, base as well as mailing details, payment details.
  • the customer may also make with the user interface 211 selections related to the details of chosen eyeglass frame 400 and lenses.
  • the information from the customer may be inputted in various manner, for example as voice messages or thumb scan or eye scan etc.
  • modem 207 connected to the control unit 202 for communicating with external devices.
  • the modem 207 is any type of transceiver communicating via wireless connection or wired connection.
  • modem 207 supports communication with the mobile device 500 and the BackOffice system 300.
  • the digital mirror 200 advantageously comprises a payment interface 208 (for example build -in card terminal 208) for enabling payment for the service by the customer and a scanner 212 for scanning prescriptions (as shown in Fig.3) for acquiring alternative or additional data relating to the eyes of the customer and eyewear to be ordered.
  • the payment interface 208 is connected to the control unit 202.
  • the scanner 212 is also connected to the control unit 202. It is advantageously an optical scanner 212.
  • the payment interface 800 and the scanner 801 for scanning prescriptions are external components (as shown in Fig.2), namely external devices connected to the digital mirror 200.
  • the digital mirror 200 can also use an electronic card reader, namely RFID reader 209 for acquiring personal data required for logging in or for creating an account, like address, email details, contact details. Such data may be stored on an electronic card provided with an electronic chip.
  • RFID reader 209 for acquiring personal data required for logging in or for creating an account, like address, email details, contact details.
  • data may be stored on an electronic card provided with an electronic chip.
  • the system 100 for ordering eyewear further comprises a BackOffice system 300 which among other comprises a database 302 with information on eyeglass frames 400 upon purchase. It also comprises a user interface 303 implemented for example as a set of xml documents with declarative user interface logic description and html and JavaScript documents defining user interface. Flowever, the person skilled in the art will appreciate that another implementation of the user interface 303 is also possible.
  • Said BackOffice system 300 serves among other for receiving data from the digital mirror 200 relating to the customer order, obtained measurements, prescription scan, customer contact data and coordinating the order handling process between every involved party (customer, workshop, lens manufacturer, shop, etc.).
  • the system 100 for ordering eyewear also comprises a set of eyeglass frames 400 with tag chip 401 on (or alternatively other type of marking means 401) and a customer mobile device 500 with a user interface application 501.
  • the mobile device 500 comprises at least hardware means for QR code scanning, namely QR code scanner 502, user interface application 501 and a QR code reading application 503. It allows setting up a connection between the digital mirror 200 and the mobile device 500. Namely a QR code to be scanned is displayed on the front part of the digital mirror 200 once the customer inputs into its mobile application a request for setting up a connection with the digital mirror 200.
  • the internal QR code generator 205 embedded in the control unit 202 of the digital mirror 200 generates a unique QR code to be displayed. The customer approaches the digital mirror 200 for scanning said QR code.
  • the system 100 for ordering eyewear contains also a web application 701 for handling orders running on an external server 700, wherein it enables logging in / logging out of the system 100 via web browser by using a username and a login. It might be accessed by the customer or staff of an optician store or by glasses manufacturers. For example, the customer, with the use of its mobile device 500 may see, change and manage a list of his orders, details of any of her/his orders, including status, date, final price, ordered frames and lenses, delivery address while the manufacture may see and modify details of any issued order. Thanks to the order handling application 701 running on an external server 700 the customer is notified using SMS and/or email when her/his order state is changed by glasses manufacturer using settings (enable/disable, telephone number, email address).
  • eyeglasses ordering process will be described in relation to Fig. 4.
  • the person wishing to purchase new glasses visits the optical store or other type of retail establishment in order to select and order a set of eyeglass frames 400 and lenses that are fitting well.
  • the optical store includes special display areas, for example in the form of various shelves for displaying available models of eyeglass frames 400.
  • the purchaser takes the eyeglass frame 400 that he is interested in and try it on before a normal mirror.
  • the system 200 for ordering eyewear according to the invention the purchaser does not have to change his habits. The only difference is that instead a normal mirror he tries on selected frames 400 in front of the digital mirror 200 according to the invention.
  • the customer switches on or activates the digital mirror 200 via the user interface 211, for example by touching the touchscreen or by pressing an appropriate button on the keypad.
  • the customer activates an application on his mobile device 500 which communicates with the digital mirror 200, particularly via a user interface application 501 running on the mobile device 500 (as shown in Fig.2).
  • Another software application namely a display application 216 stored in the memory means 204 causes the internal display means 206 to display instructions for the customer relating to next actions to be performed by him.
  • logging in is required by inputting username and a password via available user interface 211.
  • This process is performed via digital mirror application 215 running on the digital mirror 200.
  • this step might be a last step before inputting payment details.
  • the customer picks-up a chosen eyeglass frame 400 and encouraged by the displayed instruction he waives the eyeglass frame 400 in front of the digital mirror 200, which allows, thanks to the RFID reader 209, for identifying which eyeglass frame 400 model is involved in the measurement-taking process.
  • the RFID reader 209 reads the information included in the tag chip 401 on the picked eyeglass frame 400 and based on this the device 200 for ordering eyewear, namely the digital mirror 200, access external data base 302 for more information about said eyeglass frame 400.
  • the frame model 400 appears on the screen 206 in a corner of the digital mirror 200. Also, another associated information is displayed as explained later on.
  • all eyeglass frames 400 in the optical store are provided with a special marking 401 able to be read automatically by the digital mirror 200.
  • the marking 401 may be in the form of an RFID tag 401.
  • the tag 401 include an individual code of a specific eyewear frame 400.
  • the individual code is associated with a set of data concerning a specific frame model 400, for example its 3D model as well as data on relative coordinates of the characteristic points of the specific frame model 400.
  • Other data about specific frame 400 model might be color, material, possible patterns etc.
  • a precise data on measurement of selected elements of eyeglass frames 400 are stored in the external database 302 and are used by measuring application 213 involved in image-processing to analyze a picture of the face of an ophthalmic lenses user taken with the selected eyeglass frame being worn on. Said picture with additional information is then converted for measuring a distance on the picture in order to obtain the PD and SH with accuracy up to a hundredth of mm.
  • the external database 302 of eyeglass frame 400 details is maintained on the BackOffice server 300 and regularly synchronized with digital mirror 200 internal storage means 204, to keep the internal storage up to date.
  • the method of ordering eyeglasses involves among other steps picking-up a chosen eyeglass frame 400 and waiving it in front of the digital mirror 200 for accessing information about said eyeglass frame 400. Next step is wearing it in front of the digital mirror 200.
  • Specialized software namely measurement application 213 then precisely measures pupillary distance PD and half-height SH based upon eyeglass frame 400 characteristics stored in the database 302 and other information acquired from the pictures taken by at least two cameras 201a, 201b.
  • Basic pictures might be shared by the customer with others for example by sending pictures via email using digital mirror application 215 on the digital mirror 200. It is possible to save and cancel any picture taken by cameras 201a, 201b using digital mirror application 215.
  • the digital mirror application 215 also allows to modify pictures, for example by filtering on the customer request. Said request can be input by the user interface 211 build-in the digital mirror 200 or by using user interface being integral part of the mobile phone 500 as well as the user interface application 501 running on the mobile phone 500. Once the pictures are taken the customer may share the photo through text messaging, email, social networking websites or other online posting.
  • having pictures taken while trying on eyeglass frames 400 and displaying them later on the screen 206 it allows the user to see himself/herself while wearing glasses and also allows for side by side comparison of different eyeglass frame 400 models.
  • the customer provides lacking information, particularly prescription details, for example by scanning it with the use of the optical scanner 212 built in the digital-mirror 200.
  • the customer selects further details of the chosen eyeglass frame 400, details of the lenses type etc. as well as provide payment details.
  • the customer may choose via the user interface 211 different types of lenses and additional parameters like the material of the lenses (glass, plastic, polycarbonate, trivex), coating type (hardening - anti-scratch, anti-reflecting), high refractive index (for large diopters), computer lenses, single vision/progressive lenses etc.
  • material of the lenses glass, plastic, polycarbonate, trivex
  • coating type hardening - anti-scratch, anti-reflecting
  • high refractive index for large diopters
  • computer lenses single vision/progressive lenses etc.
  • the customer knows one's refraction parameters or ideally, has one's eye-doctor's prescription with oneself.
  • the customer is asked to wave one's prescription under the scanner 212. If not, the customer inputs it manually in accordance with the displayed instructions using the user interface 211.
  • the customer enters manually optometric data known to him such as: pupillary distance PD, the diopters for both distance and near vision of both eyes, spherical, cylindrical, axis (for cylindrical lenses), add (for progressive lenses) etc.
  • PD pupillary distance
  • the diopters for both distance and near vision of both eyes
  • spherical, cylindrical, axis for cylindrical lenses
  • add for progressive lenses
  • Such information may be obtained from a recent doctor's prescription or past prescription.
  • the user may provide different types of prescriptions (e.g., reading, distance, bifocal, trifocal, progressives, etc.). This gathered information may be saved in the user's profile for later access to be used
  • data related to mailing details and generally to the customer account details may be acquired automatically from an electronic card reader, namely RFID reader 209, the customer holding any type of electronic card with a RFID readable chip.
  • the account details may be provided earlier via the user interface application 501 open at the mobile device 500 like a smartphone.
  • the payment step ends by the payment step.
  • Information displayed on the screen 206 allows to choose the payment step to begin.
  • the payment may be performed using special hardware like payment interface 208 integrated in the digital mirror 200 or the payment interface 800 provided externally and linked via an available network with the digital mirror 200, for example an external card terminal 800. It is also possible to choose a payment option - cash on delivery.
  • the ordering process continues by providing the customer with payment confirmation and transaction details as well as sending the order to the manufacturer.
  • the customer may be provided with a date on which the ordered eyeglasses will be delivered to the customer.
  • all required information is forwarded from the digital mirror 200 to a chosen manufacturer who executes the order and produces ordered lenses and place it within the chosen eyeglass frame 400.
  • the flow chart of steps of the method of ordering eyewear according to the invention has been illustrated in Fig.4.
  • the customer can manage later on its order via a user interface application 501 which is running on its mobile device 500. It allows the customer to reach the order details forwarded from the digital mirror 200 to external server 700 for storing and managing by manufacturer.
  • the web application 701 for handling orders running on an external server 700 enables logging in / logging out of the system 100 via web browser by using a username and a login. It might be accessed by the customer or staff of an optician store or by glasses manufacturers. For example, the customer, with the use of its mobile device 500 may see, change and manage a list of his orders, details of any of her/his orders, including status, date, final price, ordered frames and lenses, delivery address while the manufacture may see and modify details of any issued order.
  • Two sources of data are used for calculating pupillary distance PD and half-height SH according to the invention.
  • the pupillary distance PD and half-height SH are calculated based on the individual set of data associated with the eyeglass frame 400 that the customer registered via RFID reader 209 and wears later on. Data related to the selected eyeglass frame 400 may be used as reference points or as a known dimension.
  • the pupillary distance PD and half-height SH are calculated based on characteristics points of the customer face found on the pictures taken by the device 200 for ordering eyewear.
  • At least two cameras 201a, 201b built in the device 200 for ordering eyewear are involved in taking pictures of the customer standing in front of the digital mirror 200 at an indicated distance d.
  • the digital mirror 200 displays on the screen 206 visual and/or written instructions that direct the customer through the steps required to complete proper measurements of predetermined optical parameters. For example, displayed instructions direct the customer to take a specific position such that both eyes of the customer are substantially in a plane parallel to the surface of the two-way mirror 219 of the digital mirror 200. Another instruction may direct the customer to position himself at a certain distance d from the digital mirror 200 while the customer may see his face matching with a frame of reference displayed on the screen 206 of the digital mirror 200.
  • cameras 201a, 201b may use facial recognition software to identify when a face is in view of both and then automatically capture picture of the customer.
  • At least two cameras 201a, 201b disposed on different heights take one or more pictures of the customer. Said two cameras (201a, 201b) are calibrated so as to take at least two pictures of the customer face which match geometrically.
  • the control unit 202 of the digital mirror 200 manages the cameras 201a, 201b via an application and then process the acquired data with the aid of the measurement application 213 which runs on the processor 203.
  • the measurement application 213 processes the acquired data. It outputs two parameters in proper units, namely pupillary distance PD and height between pupils and eyeglass frame bottom edge SH, namely half-height. Two different algorithms are implemented in order to output those two dimensions.
  • a method of determining the pupillary distance PD according to the invention, performed by the measuring application 213 comprises at least four further steps.
  • an image smoothing step is performed.
  • the captured image needs to be smoothed, e.g. by a Gaussian filter, in order to avoid problems that arise due to bright outliers such as reflections of glasses. This helps in detections of pupils' centers. Moreover, it is required to convert the captured image into greyscale image.
  • Next operation is a face detection step, for example performed by the OpenCV. Based on the position of detected face and anthropometric relations, there are extracted rough eye regions relative to the size of the detected face. Those regions are used to estimate the eye centers accurately in the following step.
  • Eye centers detection may be performed for example by using the algorithm described in detail in "Accurate eye center localization by means of gradients" , Fabian Timm and Erhardt Barth, Institute for Neuro- and Bioinformatics. It bases on strong contrast between iris and sclera. It is assumed that there will be a peak of grey scale gradient to detect in each direction of the captured image. Next a procedure which looks for an intersection of most of directions of those gradients is performed. Because of circular eye shape the intersection points will estimate eye center.
  • the measurement application 213 calculates pupil position in the two captured pictures and further reconstruct 3D pupil position based on known physical location of both cameras 201a, 201b using the algorithm for measuring real distance as described below.
  • a method for measuring real distance from captured pictures comprises at first a calibration step. This step involves calculating camera angles of rotation and finding position of the cameras, which are measured after fixing the cameras in permanent positions. Various calibration methods are possible.
  • the calibration algorithm involves simulated annealing with minimization of mean squared 3d reconstruction error.
  • Said task comprises calculating the position of cameras: namely their coordinates in the space 3d (x,y,z) as well as their inclination in three planes (angles of rotation): angles alfa, beta, gamma.
  • input data is a series of input pictures of a predetermined pattern from both cameras, as shown in Fig. 8.
  • Said predetermined pattern is a panel with two aruco markers, placed in a predetermined distance (for example 64 mm).
  • the 2d coordinates of said two markers are found on each of the pictures using a simple detection algorithm (for example using OpenCV). Said coordinates are used in all further steps of the calibration process.
  • the initial range for searches is set to for x,y,z and +/- 0.1 degree for angles alfa, beta, gamma. In further iterations said range is narrowed.
  • the calibration step can be done using a known pattern (i.e. aruco markers, as shown in Fig. 8), in the following way.
  • the pattern sheet is placed parallel to the front surface of the two-way mirror 219 of the digital mirror 200 at lm distance and markers are in such position that if both cameras 201a, 201b were mounted perfectly (perpendicular to the digital mirror plane), optical axes would intersect the calibration sheet in those marker points.
  • Each camera 201a, 201b takes picture of the sheet with pattern (as shown in Fig.8). Then processing of data from said taken pictures is performed.
  • rotation angles of cameras are calculated as follows: first angles of rotation around real optical axes are calculated separately for both cameras (pixels are counted separately for each photo):
  • nl,n2 number of pixels horizontally and vertically between the nearest marker and the center of the photo.
  • the control unit 203 in particular measuring application 213 is adapted to process at least two pictures acquired by at least said two cameras 201a, 201b so as to find characteristic points of the customer face (i.e. pupil centers in 2D space) which are relative positions of pupils. Then the measuring application 213 calculates pupillary distance PD based on said characteristic points of the customer face.
  • a false detection filtering algorithm can be applied.
  • the measurements are compared to the set of rules to ensure the accuracy of the result, i.e. average physiological traits of face among society.
  • the first couple operations are the same as for the algorithm for determining pupillary distance described above, namely acquiring reference data from the selected eyeglass frame 400, capturing at least two pictures by two different cameras at two different heights, smoothing, face detection and eye center detection steps.
  • the next step comprises forehead area extraction and then image enhancement. In that case the Otsu's method is used. It reduces greyscale image to a binary image.
  • the height between pupils and frame bridge top edge SD is determined, based on the location of pupils that was found earlier and frame bridge top edge, using the same method for distance measuring from taken pictures as in pupillary distance calculation.
  • the measurement application 213 reads all pixels from the top of the image line by line until a first object pixel is found (i.e. first black pixel is found). Said pixel is a frame bridge top edge.
  • the measurement application 213 reconstructs in the next step 3D frame bridge position based on calculated directions of both optical axes of both cameras 201a, 201b.
  • the last step of calculation is determining the half-height SH, based on height between pupils and frame bridge top edge SD from previous step and the at least 2D model data of the eyeglass frame 400 from the database 302. Additionally, like for the pupillary distance calculation, a false detection filtering algorithm can be applied at the end.
  • the measurement application 213 and the said at least two cameras 201a, 201b are configured to acquire the measurements PD and SH in near real time fashion, in order to allow multiple measurements of one customer, further allowing the filtration and refinement of the most accurate results.
  • the measurements are executed in a loop, comprising steps of:
  • a dedicated stack for each camera 201a, 201b there is a dedicated stack for each camera 201a, 201b.
  • Dedicated stacks are stored in the internal memory 204 of the device for ordering eyewear. Thanks to adding the result of each loop to a set of measurements a way for comparison of multiple results for single customer is provided. By repeating measurements in a loop more customer related data is obtained allowing more accurate final result. Processing of a set of pictures instead of only two or three allows to implement a method of filtering false positive results by applying measure of quality for each result. The condition of the end of the loop is obtaining sufficient measurements above the required quality threshold.
  • the method of ordering eyewear according to the second embodiment further comprises calculating pupillary distance PD and half-height SH based on the at least 2D model data of the eyeglass frame 400 from the database (302) and said characteristic points of the customer face.
  • the device and the system 100 for ordering eyewear according to the invention will enable customers to select and purchase eyeglass frames 400 and lenses without the support of shop assistant also via a mobile device 500, for example via a cell phone.
  • a method of operating the digital mirror 200 (as shown in Fig. 4) is performed with the use of a mobile device 500, a smartphone for example.
  • the whole process of eye glasses configuration and ordering, except measuring pupillary distance and half-height, might be completed via the mobile device 500 communicating with the digital mirror 200. This is possible thanks to a set of mobile applications that run on the device 200 for ordering eyewear according to the invention and on the mobile device 500 like smartphone.
  • Appropriate computer instructions may be provided in the form of an app downloaded to the mobile device 500 or may be executed within a browser running on the mobile device 500.
  • the connection between the digital mirror 200 and the user interface application 501 might be advantageously set by generating and reading QR code.
  • QR code generator 205 build in the digital mirror 200 as well as QR code scanner 502 and QR code reading application 503 on the mobile device 500.
  • a control unit (not shown) incorporated in the mobile device 500, for example smartphone is configured to execute computer instructions associated with the display means application 216 running on the digital mirror 200 for displaying information and prompts on the screen 206 and for receiving input from the user via a user interface being an integral part of the mobile device 500.
  • the process of registration or logging in is managed by the digital mirror application 215 running on the digital mirror 200.
  • the displays might include advertisements and user prompts for the frame selection feature, the lens/lens option selection feature, etc.
  • the device 200 for ordering eyewear and system 100 allows for providing the customer with purchase recommendations based on computer aided analysis of customer appearance, traits and choices, by facilitating the use of image processing algorithms and Al based algorithms.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Accounting & Taxation (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Eyeglasses (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

L'invention concerne un dispositif électronique (100) destiné à commander des lunettes qui comprend une première caméra (201a) destinée à prendre des photos de la région de l'œil du client, une unité de commande (202) comprenant un processeur (203) et un moyen de mémoire (204), destinée à gérer des composants du dispositif (100), l'unité de commande (202) étant conçue pour acquérir et traiter des données sur des lentilles requises pour le client, un moyen de communication (207) destiné à envoyer des commandes, caractérisé en ce qu'il comprend en outre au moins une caméra supplémentaire (201b) pour prendre des photos du visage du client, disposée à une hauteur différente de celle de la première caméra (201a), des moyens (209) de lecture de marquage à partir de montures de lunettes (400) destinés à accéder aux données de modèle de celles-ci à partir de la base de données (302), au moins les deux caméras (201a, 201b) ou plus étant étalonnées de manière à prendre au moins deux photos du visage du client qui correspondent géométriquement et l'unité de commande (202) étant conçue pour traiter les deux images ou plus acquises par lesdites caméras (201a, 201b) de façon à trouver des points caractéristiques du visage du client et étant apte à calculer la distance pupillaire PD et la demi-hauteur SH sur la base des données de modèle au moins 2D de la monture de lunettes (400) de la base des données (302) et desdits points caractéristiques du visage du client, et l'unité de commande (202) étant en outre conçue pour passer automatiquement une commande pour les lunettes. L'invention concerne également sur un système et un procédé destinés à commander des lunettes.
PCT/PL2018/050022 2018-05-18 2018-05-18 Dispositif électronique de commande de lunettes et système et procédé de commande de lunettes comprenant un tel dispositif électronique WO2019221618A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/PL2018/050022 WO2019221618A1 (fr) 2018-05-18 2018-05-18 Dispositif électronique de commande de lunettes et système et procédé de commande de lunettes comprenant un tel dispositif électronique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/PL2018/050022 WO2019221618A1 (fr) 2018-05-18 2018-05-18 Dispositif électronique de commande de lunettes et système et procédé de commande de lunettes comprenant un tel dispositif électronique

Publications (1)

Publication Number Publication Date
WO2019221618A1 true WO2019221618A1 (fr) 2019-11-21

Family

ID=62842179

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/PL2018/050022 WO2019221618A1 (fr) 2018-05-18 2018-05-18 Dispositif électronique de commande de lunettes et système et procédé de commande de lunettes comprenant un tel dispositif électronique

Country Status (1)

Country Link
WO (1) WO2019221618A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4300172A1 (fr) 2022-07-01 2024-01-03 Fielmann AG Procédé pour déterminer des paramètres d'ajustement de lentille

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001088654A2 (fr) * 2000-05-18 2001-11-22 Visionix Ltd. Systeme d'adaptation de lunettes et procedes d'adaptation correspondants
US20130188128A1 (en) * 2011-09-28 2013-07-25 Fabien Divo Method of measuring morpho-geometrical parameters of a person wearing eyeglasses
WO2015011286A1 (fr) * 2013-07-26 2015-01-29 Essilor International (Compagnie Generale D'optique) Présentoir de lunettes sur prescription en libre service
US20150363853A1 (en) * 2014-06-12 2015-12-17 Eyempower, Llc System, assembly, and method for providing corrective eyewear
US20160011437A1 (en) * 2013-02-28 2016-01-14 Hoya Corporation Spectacle lens design system, supply system, design method and manufacturing method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001088654A2 (fr) * 2000-05-18 2001-11-22 Visionix Ltd. Systeme d'adaptation de lunettes et procedes d'adaptation correspondants
US20130188128A1 (en) * 2011-09-28 2013-07-25 Fabien Divo Method of measuring morpho-geometrical parameters of a person wearing eyeglasses
US20160011437A1 (en) * 2013-02-28 2016-01-14 Hoya Corporation Spectacle lens design system, supply system, design method and manufacturing method
WO2015011286A1 (fr) * 2013-07-26 2015-01-29 Essilor International (Compagnie Generale D'optique) Présentoir de lunettes sur prescription en libre service
US20150363853A1 (en) * 2014-06-12 2015-12-17 Eyempower, Llc System, assembly, and method for providing corrective eyewear

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4300172A1 (fr) 2022-07-01 2024-01-03 Fielmann AG Procédé pour déterminer des paramètres d'ajustement de lentille

Similar Documents

Publication Publication Date Title
US20210088811A1 (en) Systems and methods for adjusting stock eyewear frames using a 3d scan of facial features
US8690326B2 (en) Method and systems for measuring interpupillary distance
US20160171596A1 (en) Self-service prescription eyewear kiosk
AU2015218530B2 (en) Multiple-reference based system and method for ordering eyeglasses
EP2898819A1 (fr) Système de mesure de la distance interpupillaire au moyen d'un dispositif équipé d'un écran et d'une caméra
US10222634B2 (en) Optical measurement aid device
WO2019147815A1 (fr) Système, plateforme et procédé d'achat personnalisé à l'aide d'un assistant d'achat virtuel
CN104160416B (zh) 用于订购眼镜片的方法以及相关联的系统
WO2018191784A1 (fr) Système de commande de lunettes et son interface numérique
CN111512217B (zh) 用于确定镜片的光学参数的方法
WO2019221618A1 (fr) Dispositif électronique de commande de lunettes et système et procédé de commande de lunettes comprenant un tel dispositif électronique
CN109804301B (zh) 用于确定光学设备的参数的方法
AU2010249222A1 (en) Configuration of lenses
US20210393121A1 (en) System and method for measuring pupillary distance and uses thereof
WO2015044309A1 (fr) Procédé et dispositif pour afficher de manière correcte et réaliste une paire de lunettes
KR102534394B1 (ko) 온라인 안경 쇼핑 시스템
CN114730101B (zh) 使用面部特征的3d扫描来调整库存眼镜框架的系统和方法
CN113592592B (zh) 生成眼镜框试戴效果图的方法及眼镜框虚拟试戴系统
KR100359892B1 (ko) 온라인 안경 조제 시스템 및 그 방법
KR20220124053A (ko) 안경점용 안경 추천도우미 키오스크 시스템 및 그 운영 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18738015

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18738015

Country of ref document: EP

Kind code of ref document: A1