EP3186767A1 - Empfehlungssystem, verfahren, computerprogramm und zugehöriges medium - Google Patents

Empfehlungssystem, verfahren, computerprogramm und zugehöriges medium

Info

Publication number
EP3186767A1
EP3186767A1 EP15759916.8A EP15759916A EP3186767A1 EP 3186767 A1 EP3186767 A1 EP 3186767A1 EP 15759916 A EP15759916 A EP 15759916A EP 3186767 A1 EP3186767 A1 EP 3186767A1
Authority
EP
European Patent Office
Prior art keywords
user
frames
frame
computer apparatus
computer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP15759916.8A
Other languages
English (en)
French (fr)
Inventor
Philippe WARGNIER
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Np2w
Original Assignee
Np2w
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Np2w filed Critical Np2w
Publication of EP3186767A1 publication Critical patent/EP3186767A1/de
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0621Item configuration or customization
    • GPHYSICS
    • G02OPTICS
    • G02CSPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
    • G02C13/00Assembling; Repairing; Cleaning
    • G02C13/003Measuring during assembly or fitting of spectacles
    • G02C13/005Measuring geometric parameters required to locate ophtalmic lenses in spectacles frames
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • G06Q30/0643Graphical representation of items or shoppers
    • GPHYSICS
    • G02OPTICS
    • G02CSPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
    • G02C7/00Optical parts
    • G02C7/02Lenses; Lens systems ; Methods of designing lenses
    • G02C7/024Methods of designing ophthalmic lenses
    • G02C7/028Special mathematical design techniques

Definitions

  • the present invention relates to the general technical field of eyewear, and more specifically to computerized systems for selecting frames adapted to a given user.
  • the present invention more particularly relates to a recommendation system for helping a user to choose a spectacle frame from a plurality of frames.
  • the invention also relates to an automated recommendation method for assisting a user in selecting a spectacle frame from a plurality of frames.
  • the invention further relates to a computer program comprising computer program code means adapted to perform the steps of an automated recommendation method for assisting a user in choosing a spectacle frame from a plurality of frames when said program is executed. on a computer.
  • the invention also relates to such a computer program implemented on a computer readable medium, and a support that can be read by a computer and on which is recorded such a program.
  • the objects assigned to the invention are therefore intended to remedy the various disadvantages listed above and to propose a new system and method of recommendation to help a user to choose optimally (including price) a spectacle frame among a plurality of frames, and which allow in particular each user to quickly identify which frame could suit him from a very large choice of frames and this particularly simple, fast and economical.
  • Another object of the invention is to propose a new system and method of recommendation to help a user to choose a spectacle frame among a plurality of frames, which can be implemented easily and in all circumstances.
  • Another object of the invention is to propose a new system and method of recommendation to help a user to choose a spectacle frame among a plurality of frames, which are particularly low in computing resources.
  • Another object of the invention is to propose a new system and method of recommendation to help a user to choose a spectacle frame from among a plurality of frames, which can be implemented using simple and robust technical means. .
  • Another object of the invention is to propose a new system and method of recommendation to help a user to choose a spectacle frame among a plurality of frames, the implementation of which is particularly playful and spectacular for the user.
  • Another object of the invention is to propose a new system and method of recommendation to help a user to choose a spectacle frame from a plurality of frames, which provide a particularly reliable, accurate and repeatable result.
  • Another object of the invention is to propose a new system and method of recommendation for helping a user to choose a spectacle frame from among a plurality of frames, which are particularly suitable for use within a store of convenience. sale.
  • the objects assigned to the invention are achieved by means of a recommendation system to help a user to choose a spectacle frame from among a plurality of frames, said system comprising on the one hand a database storing data relating to said plurality of frames, said data including at least one three-dimensional digital model of each frame, and secondly a computer apparatus which is connected to the database and which includes at least one camera, a screen of display and an acquisition interface, said computer apparatus being adapted to prompt the user to respond, by means of said acquisition interface, to a questionnaire, said computer apparatus including an image analysis tool adapted to determine automatically, from images of the user obtained through the camera, at least the anatomical characteristics of the user, said app computer hardware further enabling the user to virtually try each mount of his choice by implementing an augmented reality process of superimposing in real time an animated image of the user obtained by means of the setting device views and the three-dimensional digital model of the mount concerned and display the resulting moving image on said screen, said computer apparatus including processing means capable of developing a selection of frames from at least the user's responses audit
  • an automated recommendation method for assisting a user in selecting a frame from among a plurality of frames comprising connecting a base of data with a computer apparatus, said database storing data relating to said plurality of frames, said data including at least a three-dimensional digital model of each frame, while said computer apparatus includes at least one camera, a screen display, an acquisition interface, an image analysis tool and processing means, said method comprising:
  • a recommendation step during which said processing means develop a selection of frames from at least the user's answers to said questionnaire and said anatomical characteristics, said selection being submitted, via the screen, to the user,
  • a virtual fitting step during which said computer apparatus allows the user to virtually try each frame of his choice by implementing an augmented reality process of superimposing in real time an animated image of the user obtained by means of the camera and the three-dimensional digital model of the mount concerned and to display the resulting moving picture on said screen.
  • the invention relates to a recommendation system for helping a user to choose a spectacle frame from among a plurality of frames, and preferably from at least several hundreds, and even several thousand (for example at least 10,000).
  • eyeglass frames is meant here conventionally a support on which are intended to be fixed glasses (correctors and / or tinted to provide sun protection) and which is itself intended to rest on the nose and / or ears of a user so as to hold the glasses in front of the eyes of the user.
  • the frames in question are designed to rest on both the nose (by means of a suitable support) and the ears (not via two branches more or less curved) of the user.
  • the system according to the invention comprises a database, recorded for example on a computer server, storing data relating to said plurality of frames.
  • the data in question includes at least one three-dimensional digital model of each frame, so that each frame has, in the database, a three-dimensional graphical representation as faithful as possible.
  • digital model we mean a virtual piece as such, which, unlike a photograph or an image, has neither background nor background.
  • a numerical model can be manipulated in several dimensions, at least two and preferably three, thus forming a three-dimensional numerical model, and in particular so that a user can visualize each of its shapes, faces, edges, etc., without any effort on his part.
  • the digital model intrinsically contains data relating to the modeled element, such as dimensions, shapes, textures, colors, materials, etc.
  • the digital model is realized by means of a design tool assisted by a computer and / or a scanner connected to a computer that is able, from real measurements, to build the digital model, that is to say the corresponding virtual part, and this in at least two dimensions, and preferably three.
  • a virtual model requires computer software that allows a user to view it.
  • said data relating to said plurality of frames includes at least one or more of the following information:
  • each of said frames including for example in particular the spacing of the branches, the length of the branches, the size of the glasses, which is for example expressed for example in the form of an area);
  • each of said frames that is to say the shape of the supports for accommodating glasses (this form may preferably be part of a predetermined list including for example the following forms: rounded, rectangular, square, to closed contour, open contour, etc.);
  • each of said frames (part of a list comprising for example: chromed metal, brushed aluminum, steel, carbon, scales, plastic ...)
  • each mount which can be for example a note between 1 and 3 depending on the nature more or less" discreet "of the mount concerned).
  • the system according to the invention also comprises a computer apparatus, that is to say a programmable digital electronic machine, of the computer type, comprising means (processor, memory, etc.) enabling it to execute computer programs.
  • the computer apparatus implemented in the context of the invention is connected to the abovementioned database, so as to be able to access the data recorded in the database and to be able to use them in the context of automated processing, in the species under the control of an application executed by the computer device.
  • the computer apparatus is connected to the database via the Internet.
  • the computer apparatus includes at least one camera, such as a digital camera or a digital camera, capable of capturing images of a real scene in a punctual manner (in the manner of a camera) and / or sequentially (in the manner of a video camera).
  • a camera such as a digital camera or a digital camera, capable of capturing images of a real scene in a punctual manner (in the manner of a camera) and / or sequentially (in the manner of a video camera).
  • the camera thus allows the computer apparatus to obtain a digital image faithfully reflecting the visual appearance of the scene located in the field of view of the camera.
  • the computer apparatus also comprises a display screen, which is for example in the form of a substantially rectangular slab (of the LCD panel type) and preferably allows a color display.
  • the system comprises a device for adjusting the height positioning of the display screen and / or the camera, in order to position the display screen and / or the device in a precise and stable manner.
  • the height positioning adjustment member comprises a support on which are intended to be arranged the camera and / or the display screen, said support being mounted on one or more actuators actuated by a user to adjust the altitude of the support.
  • the camera and the display screen can be mounted on separate cylinders.
  • the cylinder or cylinders are actuated automatically according to orders issued by the recommendation system, and in particular to vary the height of the device to automatically adapt to the different steps of the recommendation process.
  • the system comprises a lighting device designed to illuminate the face of the user in front.
  • Said lighting device includes, for example, light sources (for example LED lamps) positioned around the display screen, in a plane substantially parallel to the plane in which the display screen is located, way to directly illuminate the face of the user who is in front of the screen and therefore in front of said light sources.
  • said lighting device allows adjustment of said light sources, especially in terms of colorimetry and intensity. This adjustment can be performed manually or automatically by the system itself, preferably from anatomical features (including skin color and age) of the user whose face is illuminated. In the preferred case where the adjustment is carried out automatically, the anatomical characteristics are determined by an image analysis tool, as described below.
  • the system advantageously comprises a light shielding device designed to totally or partially isolate the user's face from the ambient light.
  • Said light shielding device comprises for example a roof intended to be disposed above the head of the user to mitigate or eliminate the influence of possible ambient lighting from the ceiling of the place where the system is installed.
  • the light shielding device can even be advantageously formed by a cabin that can completely isolate the user from the ambient lighting.
  • the computer apparatus also comprises an acquisition interface, that is to say a peripheral device allowing a user to provide instructions and / or information to the computing device, with a view in particular to controlling or controlling the operation of the latter and supply it with data necessary for said operation.
  • the acquisition interface may take the form of any device known in the field, and may for example comprise a keyboard, a pointing device of the mouse type, etc.
  • the display screen is a touch screen which therefore allows, in addition to its conventional display function, a pointing function by touching the screen with one or more fingers of the user or with the tip of the screen. a stylus manipulated by the latter.
  • the display screen also advantageously forms the acquisition interface.
  • the system according to the invention includes an independent portable computing terminal, such as a touch pad or a smart phone, forming said computing device, the latter being connected to the database via the Internet, by means of a connection with or wireless.
  • the computer apparatus is in the form of an integrated unit that can be manipulated by hand and that includes at least the camera, the display screen and the interface therein. acquisition.
  • the computer apparatus is in the form of a fixed installation (not manually movable) in which the camera, the screen
  • the display and the acquisition interface are not part of a single housing but form respective separate units operatively connected to each other by any appropriate means (cable, wireless link ).
  • the aforesaid computer apparatus is adapted to prompt the user to respond, by means of said acquisition interface, to a questionnaire.
  • This questionnaire aims to provide the computer device various information that will be useful for recommending to the user one or more frames among said plurality of frames.
  • the questionnaire aims to indicate preferably to the computer apparatus at least one or more of the following information:
  • D - identifier of the user eg first name and / or name and / or insurance number ...
  • - Particular constraints for the optical correction of the user eed a correction with progressive glasses, need a correction of important level (which can suppose the implementation of glasses particularly thick and heavy which are not necessarily compatible with all frames), need only sunglasses, need only corrective lenses ...);
  • the objective of the questionnaire is to lead the user to express his preferences in a field where the latter will not necessarily think of all the parameters.
  • the questionnaire therefore aims to extract certain preferences of a qualitative nature (for example: a classical model is preferred to an unrealistic model) or a quantitative one (budget).
  • the user can also indicate, using the form, psychological characteristics (introverted / extrovert, sensitivity to brands, desire for change ).
  • the questionnaire may be in the form of open or closed questions put directly on the screen and to which the user responds sequentially by means of the acquisition interface, or by alternative modes of interaction (the user can for example be offered a virtual assistant, a game, in order to identify his preferences).
  • Such a question posed “on the fly” preferably has a high discriminating power (example: ask the user to classify three frames in order of preference).
  • the set of answers provided by the user to the questionnaire contributes to constructing a model of the user, said model being formed of a plurality of characteristics directly entered by the user in response to said questionnaire or automatically deduced from said answers by the user. computer apparatus.
  • the construction of the user's model does not rely only on a positive user's approach, consisting in answering in a more or less direct and conscious manner to a questionnaire, but also on detection operations and automatic analysis which in particular make it possible to communicate to the computer apparatus anatomical and / or physiological data characterizing the user.
  • the computer apparatus includes an image analysis tool designed to automatically determine, from user images obtained through the camera, at least the anatomical characteristics of the user.
  • the computer apparatus is designed to capture one or more images of the user, and in particular of the face of the latter, possibly from different angles (for example from the front, and possibly also from the profile), and then to submit these images.
  • digital to an automated processing performed by means of an application executed by the computer apparatus, for extracting from the image data representative of certain anatomical and / or physiological characteristics of the user.
  • the image analysis tool is designed to determine one or more of the following characteristics:
  • the tool should preferably be able to determine the dominant color in the user's eyes, based on the following colors: blue, green, brown and black); - shape of the user's face (for example, the tool must be able to determine the overall shape of the user's face from among the following shapes: round, oval, heart, square (marked jaw) Certainly ;
  • the age range to which the user belongs (for example, the tool should be able to determine the age range of the person being photographed among the following age groups: under 0, 10 to 20 years, 20 to 30, 30 to 45, 45 to 60, over 60);
  • the width of the user's face at the temples (for this purpose, the user will for example be placed at a fixed distance from the camera, for example between 1 m and 1 m, and the tool will be able to provide a distance in millimeters);
  • the tool will be able to determine the horizontal distance between the two pupils of the user, for this purpose the user will for example be placed at a fixed distance from the camera - between 1 m and 1, 20 m distance for example - the expected value will be in this case a difference in vision called "intermediate” expressed in millimeters, the tool is advantageously designed to turn this pupillary difference into “intermediate” vision in pupillary distance far vision from a predetermined mathematical formula, known as such);
  • the tool may for example be able to determine the dominant color in the user's hair, based on the following colors: blond, chestnut, brown, red, others (for the hair colored), etc.);
  • the tool will be able to determine the length of the user's hair on the basis of slices of the following length: ras (less than 1 cm), short, half long (between the ears and the shoulders), long (lower than the shoulders) ...);
  • the tool can then propose the detection of the general shape of the current frame of the user among for example the following forms: round, oval, rectangular, square ...);
  • the tool may propose the detection of the color cast of the current frame among the following main colors: black, white, red, yellow, blue, green, orange, purple, pink, brown / tortoiseshell, transparent / translucent, golden, silver, multicolored ...);
  • the tool may for example propose the detection of the height of the current frame on the basis of the following sizes: small, medium, large, each frame size may correspond to a percentage of recovery of the face) .
  • the analysis tool is not necessarily designed to automatically determine all the above characteristics.
  • the image analysis tool is designed to determine at least, automatically by image analysis, the essential characteristics that are: sex, age, the shape of the face, the width of the face at the temples and the pupillary distance of the user.
  • the system can access, preferably automatically or semi-automatically. automatic positioning of the pupil of the user in the future mount that the latter will choose.
  • the system advantageously comprises a measuring frame of predetermined dimensions carrying visual references, and that the user is invited to wear so that the camera takes a picture of the user wearing said frame. measurement.
  • the image analysis tool is designed to automatically determine, by analysis of the facial image of the user wearing the measuring frame, the position of the pupils of the user relative to said visual cues
  • said computer apparatus being designed to automatically determine, from said position of the user's pupils relative to said visual cues of the measurement mount, the position of the user's pupils relative to each frame of the plurality of frames recorded in the database.
  • the computer apparatus includes processing means capable of developing a selection of frames (for example a selection of three to ten frames) from at least the user's answers to said questionnaire and said anatomical characteristics. automatically determined by the image analysis tool.
  • processing means capable of developing a selection of frames (for example a selection of three to ten frames) from at least the user's answers to said questionnaire and said anatomical characteristics. automatically determined by the image analysis tool.
  • the processing means are in this case formed by an application executed by the computer apparatus and using all the data collected on the one hand by means of the questionnaire and on the other hand by means of the tool.
  • image analysis system anatomical characteristics of the face of the user for automatically offering the user a selection of frames selected from the plurality of frames recorded in the database.
  • the computer apparatus is of course designed to then submit, for example via the display screen, said selection to the user.
  • the computer apparatus also allows the user to virtually try each frame of his choice, and in this case preferably each frame of the aforementioned selection of frames, by the implementation of an augmented reality process consisting of superimposing in real time (i) an animated image of the user obtained by means of the camera and (ii) the three-dimensional digital model of the frame concerned, and displaying the animated image result on the display screen of the computing device.
  • an augmented reality process consisting of superimposing in real time (i) an animated image of the user obtained by means of the camera and (ii) the three-dimensional digital model of the frame concerned, and displaying the animated image result on the display screen of the computing device.
  • the display screen thus plays the role of a mirror augmented reality that allows the user to observe in real time an image of his face shod "virtually" of the chosen frame.
  • a virtual mirror thus makes it possible to virtually test each frame in a particularly realistic manner, the three-dimensional digital model of the frame concerned being furthermore perfectly positioned thanks to the various information of anatomical and / or physiological nature collected automatically, by image processing, by the image analysis tool built into the system.
  • the system's reactivity time to perform the implementation of the augmented reality process must be less than half a second and preferentially be of the order of a tenth of a second.
  • the preceding expression "superimpose in real time” designates a process that is carried out particularly rapidly, in a manner virtually invisible to the user, and typically in one-tenth of a second.
  • the system comprises a device for simulating the weight of the frame, which is designed to make the user feel the weight of the frame that he is wearing. try virtually.
  • the device for simulating the weight of the frame includes a certain number of templates of different weights, which are for example in the form of transparent frames, or in any case designed to not be visible on the screen during virtual fitting (for this purpose, it is also possible that the augmented reality process is specifically designed to make the image of the template disappear on the screen).
  • the system is then designed to automatically invite the user to put on one of said particular templates, the weight of which corresponds as closely to the weight of the selected frame, so that not only the user will see on the screen with the mount on the nose, but will feel the weight.
  • the system may also preferably include a device for simulating the outline of the frame (or corresponding lenses when it comes to 'a pierced mount, without circles).
  • the contour simulation device includes a number of templates of different shapes, designed to not be visible on the screen during
  • the user is invited to assemble a nose support (intended to simulate the weight of the frame) and an armature (intended to simulate the circles or glasses) and to wear the resulting template thus obtained. during the virtual fitting) to feel as accurately as possible the presence of the mount during the virtual fitting.
  • the system according to the invention which is preferably based on a web interface, allows to determine automatically and quickly frames that will likely be suitable for the user not only from a morphological point of view but also against other more personal criteria (psychology, stylistic ...), in preferably implementing the following process:
  • the user informs the system with basic information (for example name, special constraints for its optical correction: allergies, strong correction, progressive lenses, solar / optical);
  • the image analysis tool analyzes an image of the user's face, captured by means of the shooting device equipping the computer apparatus, to collect information which is in particular of a morphological nature;
  • the processing means are designed to develop, based on at least the user's answers to said questionnaire and said anatomical characteristics, a list of weighted criteria used to develop said selection of frames.
  • each criterion used by the processing means to elaborate the selection is preferably weighted, the system advantageously comprising an administration interface 2251
  • the system may be able to automatically adjust the weight of the criteria dynamically.
  • the weight of another criterion will be increased or decreased. For example, if a user responds "extrovert” to the question “what is your style? "The criterion" form mounts must match the shape of the face "should no longer have weight in the sorting frames (thus” debride “selection). If on the other hand the user answers “classical” to the question "what is your style? The criterion "form mounts must match your facial shape” will have a strong impact in the automatic selection of mounts by the system.
  • the criteria can be classified into three groups, namely the group of critical criteria, the group of low-weight criteria and the group of learning criteria.
  • the determining criteria are absolute criteria that will filter the results presented in the selection of frames. These criteria are linked to particular "business" constraints, or to particular "user” constraints. For example, if the user needs a strong correction of progressive lenses, the system will not be able to offer some mounts because the glasses can not be mounted on it. Another example, if the width of the face of the user at the temples is greater than the spacing between branches of a frame, this mount will not be offered by the system, because its size is not suitable for the user and may compress his temples.
  • the criteria of low weight are criteria that will primarily define the display order of frames of the selection made automatically by the system. These criteria will not be directly “filtering”, but will weight a given list of results. These criteria will also make it possible to establish basic rules in selection, these basic rules being advantageously called to evolve automatically, by self-learning, as will be explained in what follows. Thus, the system will associate with each given value of these "low weight" criteria a set of corresponding frames.
  • the corresponding frames will therefore have a greater "weight" in the frame selection system.
  • the weight added to each result may itself depend on other criteria. For example, if the user has an "extravagant” style of dress, the "face shape” criterion will have no weight on the selection of the frame. On the other hand, if the user has a "classic” style, the "face shape” criterion will have a significant weight to select the frames (for example according to the rule "no round frame for a round face”).
  • the weight of the criteria will evolve according to usage statistics, as mentioned in the following, so that after a large number of uses of the system, the statistical data take over the "ground rules".
  • the system is therefore designed to record the way it is used by each user, in order to use this information to develop said selection of frames.
  • all interactions of the user with the system will be recorded, to allow accurate statistics on each user in particular and on all users in general.
  • the geographical location from which the user uses the system is also recorded.
  • the processing means will elaborate said selection of frames from not only the user's answers to the questionnaire and the anatomical characteristics determined automatically by the image analysis tool, but also from, for example, sales statistics ⁇ the system is indeed advantageously provided with an electronic commerce interface allowing the user to purchase directly online, by means of the acquisition interface, a copy of the frame he has chosen ), and questionnaire responses from other users, for example to identify general trends in public taste and fashion.
  • the processing means will also advantageously take into account models of frames rejected by the user, either during the current recommendation session or during a previous recommendation session, as well as possibly frames already selected, or even purchased, during a previous recommendation session performed by the same user using the system.
  • the system will then rely primarily on its own experience (usage and sales statistics), according to a self-learning process, either during the current recommendation session or during a session. previous recommendation.
  • the system will be able to record in a local or remote memory (on a remote server for example) global data and statistics per user, it being understood that the system is advantageously designed to associate a selection of frames to a user session identifier. This allows the system, for example, to use data relating to any previous purchases by the user to refine the system's recommendations to the user.
  • the system returns a selection of frames, in the form of a list ranked in order of relevance, based on:
  • the invention also relates as such, in another aspect, to an automated method of recommendation to assist a user in selecting a spectacle frame from a plurality of frames, said method being advantageously implemented by means of the system described above. Therefore, the entire description
  • Said method thus comprises linking a database with a computer apparatus, said database storing data relating to said plurality of frames as previously discussed.
  • Said data includes, as described above, at least one three-dimensional digital model of each frame, while said computer apparatus includes at least one camera, a display screen, an acquisition interface, a tool image analysis and processing means.
  • the method according to the invention further comprises a data entry step, during which the computer device invites the user to respond, by means of said acquisition interface, to a questionnaire, as explained in what follows. above.
  • the method further comprises a data acquisition step, in which the image analysis tool automatically determines, from user images obtained by the camera (in the form of photographic snapshots or short videos, for example of a duration of two seconds), at least the anatomical characteristics of the user, as described above.
  • the method also comprises a recommendation step, during which the processing means develop a selection of frames from at least the user's answers to said questionnaire and said anatomical characteristics, said selection being submitted, for example via the screen display, to the user.
  • the method according to the invention comprises at least one virtual fitting step, during which the computer apparatus allows the user to virtually try each frame of his choice by implementing a process of augmented reality consisting in superimposing in real time an animated image of the user obtained by means of the camera and the three-dimensional digital model of the frame concerned, and displaying the resulting animated image on said display screen.
  • the method according to the invention advantageously implemented by means of the system described above, thus makes it possible to implement the following overall process, preferably via a web interface:
  • the user provides the computer device, via the acquisition interface, some basic information about him (for example the user's first name and the special constraints in terms of optical correction: allergies , strong correction, progressive lenses, solar / optical ...);
  • the user is then invited, for example by means of a message broadcast on the display screen, to remove his glasses (if he already wears them) and to take place at the right of a mark placed on the ground facing the purpose of the camera.
  • the camera then takes a snapshot (or records a short video, for example of a duration of 2 seconds);
  • the user will be invited, by means of a message broadcast for example on the display screen, to put on the measurement frame, so as to allow the camera to take a second shot (or a second short video) of the user wearing the measuring mount; - the outi! analysis of images then analyzes the images (or videos) thus obtained to deduce a certain number of anatomical and / or morphological and / or physiological characteristics of the user, in order to contribute to define a profile (modeling) of this last ;
  • a questionnaire for example about psychology, style and budget
  • the user's responses will be collected by the computer device so as to be processed, by the processing means, with the characteristics deduced from the aforementioned image analysis, to develop a selection of frames that may correspond to the user profile thus determined.
  • the processing means will advantageously also use the various available statistical data, as mentioned above.
  • the user can then choose from the selection that is offered, the frames that he wants to try virtually, thanks to the augmented reality module described above allowing him to virtually visualize the mount on his face, realistically.
  • the user can validate his final choice and then start an order process that will be finalized for example with a seller of the store where the system is used.
  • the system determines which mounts correspond to which answers for the questionnaire submitted to the user, what are the "standard” rules of mount proposal to be put in
  • the invention thus makes it possible to automatically provide an "intelligent" selection of frames based on these segmentations and rules, it being understood that for the same level of relevance, the frames will be presented in a random order (relevance is defined by the rules initials (low weight criteria) and learning as mentioned above).
  • weight of configurable criteria (the weight of each criterion, defined at startup, may be modified by the administrator).
  • the weight of the criteria will preferably be stored in a database that can be accessed by an administration interface, for modification purposes. Refreshing weights can be done in a cyclical and non-constant way (daily for example).
  • the system and the method according to the invention implement a segmentation of the frames.
  • the screen will display for example three types of predefined frames (for example according to the following categories: traditional, modern, bold).
  • the user will have for example a selection of five frames.
  • the invention makes it possible to install, on a modest work surface (for example between 8 and 20 square meters) a recommendation system. particularly powerful, which provides an "intelligent" assistance to the choice of a mount within an extremely supplied catalog (for example more than 10 000 frames) while allowing the user to try “virtually” each model of his choice .
  • the system and method according to the invention thus make it much easier for the consumer to choose new glasses, and this quickly, cheap (no stock, small sales area) and relatively fun. It is thus possible and preferable to install the system within a store (which may or may not be an optical store), it being understood that the system can also be implemented exclusively online.
  • the invention relates as such to the application for implementing the method referred to above and intended for this purpose to be performed by the computer apparatus.
  • the invention therefore also relates to a computer program comprising computer program code means adapted to perform the steps of a method according to the foregoing description, when said program is executed on a computer (the term "computer” is to be taken here in its widest sense, and refers not only to “classic” computers but also devices like desktop, tablet, personal assistant ).
  • the invention also relates as such to the above computer program when it is implemented on a computer readable medium, whatever the nature) of this medium (hard disk, CD, DVD, USB key ... ).
  • the invention also relates as such to a support that can be read by a computer and on which is recorded said program.
  • the use of the previously mentioned questionnaire and the user's> answers to the questionnaire may be replaced by a device for automatically determining additional parameters specific to the user, so does not involve the need to use a questionnaire in any form, the other elements of the system remaining unchanged. So according to this aspect independent of the invention, instead of an "active" questionnaire, one can recover parameters specific to the user in a "passive" way without action of the specific user.
  • this independent invention relates to a recommendation system for helping a user to choose a spectacle frame from among a plurality of frames, said system comprising on the one hand a database storing data relating to said plurality of frames, said data including at least one three-dimensional digital model of each frame, and secondly a computer apparatus which is connected to the database and which includes at least one camera and a display screen, said computer apparatus including a tool image analysis system designed to automatically determine, from user images obtained by the camera, at least the anatomical characteristics of the user, said computer apparatus also including an automatic determination system an additional parameter specific to the user, said computer apparatus further enabling the user to to virtually try each mount of its choice by the implementation of an augmented reality process of superimposing in real time an animated image of the user obtained by means of the camera and the three-dimensional digital model of the frame concerned and displaying the resulting animated image on said screen, said computer apparatus including processing means capable of developing a selection of frames from at least said anatomical characteristics and said additional parameter specific to the user, said apparatus computer being designed to submit, via the
  • said additional parameter specific to the user may for example relate to the location from which the user uses the system.
  • the geographical indication of the place (continent, country, city, district, etc.) where the user is located can give an interesting information from which the processing means will advantageously make the selection of frames, particularly of a morphological point of view or style.
  • This determination may preferentially be made from data such as the IP address of said computing device, or its geofocusing (by GPS for example).
  • this parameter adds! the user's style is relative to his style, such as the user's style of dress.
  • the clothing style is automatically identifiable, in particular by means of the image analysis tool present in the system, for example using logos, trademarks or other distinctive signs present on the clothes.
  • this automatic identification also applies to a spectacle frame that would already be worn by the user.
  • the system determines this additional parameter specific to the user from a connection, in particular thanks to the Internet network, with a personal space of the user, such as, for example, social networks (F & cebook® for example).
  • a personal space of the user such as, for example, social networks (F & cebook® for example).
  • the processing means can advantageously have access to the user's favorite items, such as his favorite music, his favorite fashion items, etc. From tors, these elements can advantageously be used in the development of the selection of frames, especially in terms of style, thus avoiding explicitly asking the user.
  • an automated recommendation method to assist a user in selecting a spectacle frame from among a plurality of frames, said method comprising in relation to a database with a computing device, said database storing data relating to said plurality of frames, said data including at least a three-dimensional digital model of each frame, whereas said computing device includes at least one device camera, a display screen, an image analysis tool, a device for automatically determining additional parameters specific to the user and processing means, said method comprising:
  • a recommendation step during which said processing means develop a selection of frames from at least said anatomical characteristics and said additional parameter specific to the user, said selection being submitted, via the screen, to the user,
  • a virtual fitting step during which said computer apparatus enables the user to virtually try each frame of his choice by implementing an augmented reality process consisting of superimposing in real time an animated image of the user obtained by means of the camera and the three-dimensional digital model of the mount concerned and to display the resulting moving picture on said screen.
  • the invention finds its industrial application in particular in the design, production and operation of a recommendation system to help a user to choose a spectacle frame among a plurality of frames.

Landscapes

  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • General Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Development Economics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Optics & Photonics (AREA)
  • Processing Or Creating Images (AREA)
EP15759916.8A 2014-08-25 2015-08-21 Empfehlungssystem, verfahren, computerprogramm und zugehöriges medium Withdrawn EP3186767A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1457958A FR3025044B1 (fr) 2014-08-25 2014-08-25 Systeme de recommandation, procede, programme informatique et support correspondant
PCT/FR2015/052251 WO2016030620A1 (fr) 2014-08-25 2015-08-21 Systeme de recommandation, procede, programme informatique et support correspondant

Publications (1)

Publication Number Publication Date
EP3186767A1 true EP3186767A1 (de) 2017-07-05

Family

ID=52627273

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15759916.8A Withdrawn EP3186767A1 (de) 2014-08-25 2015-08-21 Empfehlungssystem, verfahren, computerprogramm und zugehöriges medium

Country Status (3)

Country Link
EP (1) EP3186767A1 (de)
FR (1) FR3025044B1 (de)
WO (1) WO2016030620A1 (de)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107862334A (zh) * 2017-11-06 2018-03-30 广东欧珀移动通信有限公司 眼镜的推荐方法、装置、存储介质及终端设备
US10685457B2 (en) 2018-11-15 2020-06-16 Vision Service Plan Systems and methods for visualizing eyewear on a user
CN111177337B (zh) * 2019-12-02 2023-07-21 网之易信息技术(北京)有限公司 一种调查问卷的数据处理方法及装置

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4171153A (en) * 1977-10-25 1979-10-16 Melluish James W Weight system for glasses
US5592248A (en) * 1995-11-16 1997-01-07 Norton; Ross A. Computerized method for fitting eyeglasses
KR100365664B1 (ko) * 1998-02-03 2003-01-24 츄요시 사이고 안경 착용 시뮬레이션 시스템
US6144388A (en) * 1998-03-06 2000-11-07 Bornstein; Raanan Process for displaying articles of clothing on an image of a person
US6095650A (en) * 1998-09-22 2000-08-01 Virtual Visual Devices, Llc Interactive eyewear selection system
US7062454B1 (en) * 1999-05-06 2006-06-13 Jarbridge, Inc. Previewing system and method
CA2329811A1 (en) * 2000-04-07 2001-10-07 Vision Optic Co., Ltd. Method and system for eyeglass ordering on a network
US6535223B1 (en) * 2000-05-31 2003-03-18 Schmidt Laboratories, Inc. Method and system for determining pupiltary distant and element height
US7016824B2 (en) * 2001-02-06 2006-03-21 Geometrix, Inc. Interactive try-on platform for eyeglasses
US20080201641A1 (en) * 2007-02-21 2008-08-21 Yiling Xie Method And The Associated Mechanism For 3-D Simulation Stored-Image Database-Driven Spectacle Frame Fitting Services Over Public Network

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None *
See also references of WO2016030620A1 *

Also Published As

Publication number Publication date
FR3025044B1 (fr) 2018-06-15
FR3025044A1 (fr) 2016-02-26
WO2016030620A1 (fr) 2016-03-03

Similar Documents

Publication Publication Date Title
EP2989628B1 (de) Verfahren zum individuellen anpassen einer elektronischen bildanzeigevorrichtung und elektronische bildanzeigevorrichtung unter verwendung derselben
JP7268089B2 (ja) 自動ショッピングアシスタントを使用したパーソナライズショッピングのためのシステム、プラットフォームおよび方法
US9183557B2 (en) Advertising targeting based on image-derived metrics
EP3004976B1 (de) Verfahren zur bestimmung von mindestens einem wert eines parameters zur anpassung einer vorrichtung zur visuellen kompensation
US20180268458A1 (en) Automated recommendation and virtualization systems and methods for e-commerce
KR20220049600A (ko) 안경용 가상 피팅 시스템 및 방법
CN111837152A (zh) 使用虚拟购物助手进行个性化购物的系统、平台和方法
WO2003081536A1 (en) System and method for 3-dimension simulation of glasses
WO2017177259A1 (en) System and method for processing photographic images
CA2958717A1 (en) System and method of providing custom-fitted and styled eyewear based on user-provided images and preferences
CN104408764A (zh) 眼镜虚拟试戴方法、装置及系统
FR2961608A1 (fr) Procede d'estimation d'une posture de reference
US20200160556A1 (en) Systems and methods for visualizing eyewear on a user
CN111066051A (zh) 使用自动化购物助手进行个性化购物的系统、平台以及方法
EP3186767A1 (de) Empfehlungssystem, verfahren, computerprogramm und zugehöriges medium
Landy A gloss on surface properties
FR2885231A1 (fr) Procedes et dispositifs permettant de faciliter le choix d'une monture de lunettes
CA2949683C (fr) Procede de determination d'au moins un parametre comportemental
TWI492174B (zh) 雲端體感虛擬實境配戴眼鏡系統
Ma et al. Understanding image quality and trust in peer-to-peer marketplaces
FR3055709A1 (fr) Methode de determination d'un equipement ophtalmique progressif de compensation visuelle personnalise pour un individu
Kim et al. Method and analysis of color changes of facial skin after applying skin makeup
WO2023242244A1 (fr) Système d'essayage digital pour vente en ligne de vêtements, procédé et programme sur la base d'un tel système
CN113592592B (zh) 生成眼镜框试戴效果图的方法及眼镜框虚拟试戴系统
FR2986893A1 (fr) Systeme de creation de representations tridimensionnelles a partir de modeles reels ayant des caracteristiques similaires et predeterminees

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20170323

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20180209

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20180620