WO1996021201A1 - Automatic recognition of characteristic features and simulation of an aesthetic image of a real objective such as a face - Google Patents

Automatic recognition of characteristic features and simulation of an aesthetic image of a real objective such as a face Download PDF

Info

Publication number
WO1996021201A1
WO1996021201A1 PCT/FR1995/001747 FR9501747W WO9621201A1 WO 1996021201 A1 WO1996021201 A1 WO 1996021201A1 FR 9501747 W FR9501747 W FR 9501747W WO 9621201 A1 WO9621201 A1 WO 9621201A1
Authority
WO
WIPO (PCT)
Prior art keywords
face
image
aesthetic
database
color
Prior art date
Application number
PCT/FR1995/001747
Other languages
French (fr)
Inventor
Jean-Marc Robin
Claude Gaudeau
Original Assignee
Robin Jean Marc
Claude Gaudeau
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robin Jean Marc, Claude Gaudeau filed Critical Robin Jean Marc
Priority to AU44522/96A priority Critical patent/AU4452296A/en
Publication of WO1996021201A1 publication Critical patent/WO1996021201A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/001—Texturing; Colouring; Generation of texture or colour

Definitions

  • the present invention relates to a computer system for automatically simulating an aesthetic image of a real objective, for example of a face, by recognizing its characteristic features.
  • the present invention therefore relates to a method and a device making it possible to carry out automatically by computer means, the simulation of an initial objective, a face for example.
  • the computer system implemented is installed in a cabin or console. It essentially comprises a computer with a hard disk of at least 420 MB, a "CD ROM” reader, a digital camera and an expert system, provided with a database and powered by an interference engine, that is to say by a powerful deductive system independent of the database.
  • This expert system used is of class zero plus (0+).
  • the present invention therefore relates to a method and a device making it possible to simulate, by an automatic process, an ideal image, from a real image of a lens, a face for example, characterized in that the real image captured by a device digital photographic photography in color is segmented, then in that we determine the fine characteristic features of this image by a recognition of shapes, textures and outline and finally in that we modify some of these features according to criteria decision of an expert system with a knowledge base enriched by several thousand combinations and harmonies. Capturing the color image is obtained in a few seconds by means of a digital camera of the ION type or video camera with his cane digital acquisition, under appropriate illumination from light spots. It is from this image, segmented beforehand, that the method and the device according to the invention will enable the simulation of the ideal aesthetic image.
  • the process essentially comprises three phases:
  • An acquisition phase we analyze and recognize the shapes and contours of a digitized photographic image using techniques characterized by the use of deductive logic,.
  • a restitution phase offering the desired aesthetic simulation on a large screen and / or on paper, in particular A4 format.
  • the image processing software will coordinate several successive operations.
  • the histograms of the 256 levels of colors or of the 256 levels of gray equivalent corresponding to each elementary segment of the image are considered.
  • it determines the points where the histograms undergo a discontinuity or else pass through minima or maxima so as to optimize the method we will determine the derivatives of the variance, the mean and the coefficient of variation of the gray levels of each image line.
  • contour following automata are used. Objects can thus be easily isolated from the background. The regions of interest of the image are thus delimited. In the present case, this binarization can be carried out automatically by the search for the minima of the gray level histograms in preferred directions.
  • This first phase finally includes a determination of the structural effects during which a more general evaluation is made of the degree of homeomorphism of the tissues, the degree of symmetry of the image and more particularly the degree of orthogonal symmetry when the object examined is a face (chilarity). In all of these treatments, the image quality can be improved by eliminating or attenuating noise.
  • the noises correspond to random fluctuations and to parasitic information caused in particular by lighting.
  • noises are in the form of pixels isolated from the neighborhood. In addition, these isolated pixels are not partially correlated.
  • transformations can be contextual, that is to say that the parameters of the operators are likely to vary according to an environment or a position relative to the frame of the image or compared to characteristic shapes previously detected. . We reduce the importance of these noises by applying filters to the image.
  • Filters should be classified into two categories:
  • the differentiation operator filters likely, on the contrary, to enhance the contrast.
  • these filters are applied locally or globally on the image and they must possibly take into account the local context of the image by taking into account its statistical properties.
  • these filters are intended for operations performed in binary in grayscale, or on the contrary to operate in 256 colors. In all cases, the application of these filters requires efficient management of the intermediate "caches".
  • the process determines which sex the face belongs to, whether it is of the child, adolescent, adult or old man type, then brings improvements of an aesthetic nature, depending on its program. of care. Some features of the initial face are improved. So, for example, small ⁇ des, dark circles, crow's feet, freckles, acne and rosacea are greatly reduced. More generally, the characteristic features of the face are modified according to decisions by the base of the expert system.
  • the software analyzes the dominant colors that appear in the different regions of the face (for example, lip color, eyes, dominant skin tone, etc.) and provides if necessary cosmetic improvements
  • the data necessary for inferences from the expert system may be incomplete or uncertain
  • the use of fuzzy logic makes it possible to balance the premises of the rules and the rules themselves so as to be able to infer even presence of incomplete or imprecise data Cosmetic choices may be made even if we do not have all the necessary data with precision
  • this aesthetic and made-up image will be presented as the simulation of the isolated image.
  • the restitution phase is reflected first by the display, in 256 colors, on a high-definition color screen of the image gradually transformed, then by the printing of a photograph in 256 gray levels thanks to an image jet ink or laser, in A4 format, and by the edinon of the "care and beauty or beauty passport" information sheet
  • a print of a second photograph in 256 colors in A4 format is edited a few minutes later thanks to a thermal sublimation, inkjet or laser printer, incorporated into 1 installation, thus revealing its new simulated face on the subject examined.
  • the simulated image and the corresponding information are recorded by means of a digital optical card reader reader which is part of the installation.
  • the treatment sheet and the final color photograph are edited in front of the client.
  • the expert system is able to simulate on request makeup styles adapted to the circumstances. We can thus make a makeup best suited to a party, an evening, either at work or even at work. stay by the sea, etc.
  • the expert system is able to simulate on demand and verify the effects of a skin care program.
  • FIG. 1 represents the image of a woman's face to be modified
  • FIG. 2 represents a photograph of the same face in computer form in 256 gray levels or 256 colors
  • FIG. 3 shows in dark gray, the portions of the image subjected to a first treatment
  • FIG. 4 shows the face modified by the method of the present invention, registered under the name MAGIC LUMIERE.
  • FIG. 1 is the image of the woman's face to be modified. In order to be able to carry out computer processing of the image, this image is replaced by another image obtained by means of a digital camera in 256 colors.
  • FIG. 2 represents the image of this woman's face thus obtained in computer form, formed of elementary segments, each characterized by a histogram specifying for this elementary segment the level of each of the 256 colors. It is then possible to analyze and recognize the shapes of this face.
  • points such as (V; Hl) are determined where the histograms undergo a discontinuity corresponding to the limit of the dark hair of the face studied. We will also reveal all the points such as (V I; H2) or (V I; H5) where the histograms pass through minima.
  • the software will then analyze the dominant colors that have been highlighted on certain parts of the face. In this case, the software analyzes the color of the eyes, eyelashes, eyelids, eyebrows, then the coloring of the lips. These extracts are then modified according to the decisions of the expert system.
  • Figure 3 illustrates these operations. Having defined the elements to modify (eyelids, eyelashes, eyebrows), we proceed to extract the contours of these elements. So that these appear in dark gray or white on the image. We therefore store all the pixels in these zones in order to modify their color and achieve the desired makeup.
  • FIG. 4 corresponds to the restitution phase during which the fine characteristic features of the initial image have been transformed to give an aesthetic and made-up image.
  • This process and device can obviously be applied to the simulation of an aesthetic image of a face, from a simple black and white or color photograph, making it possible to perform, from the scanning of this photograph by a scanner high definition, photographic portraits of a subject by improving the aesthetics of this face by capillary and make-up techniques, blurring or rectification of certain anatomical defects, change in skin color (tanning), in this
  • the database corresponding to the aesthetic simulation of the face is completed by a collection of aesthetic rules concerning makeup, hairstyling, hair techniques, skin texture and / or plastic surgery, thus making it possible to treat simultaneously the face and the hair part of a subject to edit and restore a new rewarding and ideal image
  • the expert system database is enriched with rules concerning the anatomy and the corresponding surgical technique. After healing, this last image must be compared with the result obtained in order to see if there is still reason to make some additional corrections.
  • the image acquisition and processing system associated with an expert system makes it possible to carry out a diagnostic aid model and to suggest the nature of the treatment to be performed (ointment, etc.).
  • the device makes it easier for the dermatologist to appreciate the evolution of the condition and to easily observe the changes in color of the skin tissue (eczema, shingles, psoriasis, dermatitis, changes in color of the skin spots likely to cancer, nevi, evolving scars, bedsores, vasomotor disorders, mucosal disorders, etc.).
  • the database of the expert system is enriched with information concerning the changes in color of the skin tissue or skin spots corresponding to a set of conditions, accompanied by examples of the treatments, making it possible to suggest the nature of the treatment to be carried out.
  • the device according to the invention helps to make the choice of a better aesthetic by facilitating the superposition of different types of hairstyle and different hair colors on a visase.
  • This application can be implemented directly with the MAGIC LUMIERE system, the application to the hair technique can be directly included in the facial treatment.
  • the database corresponding to the aesthetic simulation of the face is completed by a collection of esthetic rules concerning the hairstyle and the hair color thus making it possible to simultaneously treat the face and the capillary part of a subject.
  • the device according to the invention allows the eyewear optician to help make the choice of a better aesthetic by facilitating the superposition of different spectacle frames or different colored lenses on a face.
  • This application can be implemented directly with the MAGIC LIGHT system, the application to the technique of glasses or optical instruments can be directly included in the treatment of the face.
  • the database corresponding to the aesthetic simulation of the face is completed by a collection of aesthetic rules concerning spectacle frames and optical instruments (colored lenses, etc.) thus making it possible to simultaneously treat the face and superimpose different glasses frames adequately or different colored lenses on the face.
  • the system according to the invention making it possible to recognize the face of a known person without fail can be used to control an opening system.
  • the database is filled with information corresponding to all the characteristic features of one or more known faces making it possible to recognize the face of a so-called self-assertive person for sure.
  • the system according to the invention also makes it possible to recognize a face partially masked or totally masked by a fabric and to compare it to a database of features characteristic of a face, and this whatever its orientation
  • a 3D reconstruction system from ' 2D images whose orientation is unknown allowing the reconstruction of the facies and its face and profile representation for comparison with a file.
  • the database is enriched with information corresponding to all the characteristic features of faces making it possible to reconstruct a facies from the front and from the profile.
  • Another database is associated with this database. data containing faces of people which will allow their comparison with the reconstructed facies from the front and from the side.
  • the system according to the invention makes it possible, during a photograph taken in a digital photography booth, to improve the aesthetics and enhance the image of a subject.
  • the database corresponding to the aesthetic simulation of the vase is completed by a collection of aesthetic rules concerning make-up, hairstyling, hair techniques and skin texture, thus making it possible to simultaneously treat the face, the capillary part of a subject. to edit photographs that are rewarding for the client.
  • the system according to the invention makes it possible, from a photograph of the face of a subject, supplied on conventional photographic support in black and white or in color, after having been scanned by a digitizing apparatus, to be retouched and aesthetically improved.
  • the database corresponding to the aesthetic simulation of the face is completed by a collection of aesthetic rules concerning make-up, hairstyling, hair techniques and skin texture, thus making it possible to simultaneously treat the face, the capillary part of a subject for editing rewarding portraits.
  • the device according to the invention makes it possible to observe and "read” with meticulousness a face the wrinkles and fine lines, the balance between the upper and lower part, the size and the shape of the nose, the earlobe and the commissures lips, etc., so it is possible to detect and determine the personality of others.
  • This application can be implemented directly with the MAGIC LUMIERE system.
  • the system database is enriched with a set of techniques corresponding to the observation of faces, supplemented by those of psychologists, psychiatrists and anatomists in this field.

Abstract

Process for a simulation of an ideal aesthetic image from a color digital photographic image of a real objective, particularly the face of a person, characterized in that after an image segmentation step, a first acquisition phase is used to determine the fine characteristic features of the face and of its cutaneous structure and, during a transformation phase an aesthetic modification or improvement of the characteristic features of the initial image is carried out on the one hand and, on the other hand the modification of certain colors of the cutaneous structure is achieved as a function of selection criteria determined by a expert system of zero + class driven by an interference motor associated to a data base containing several thousand of combinations of shapes and harmonies of colors.

Description

Reconnaissance automatique des traits caractéristiques et simulation d'une image esthétique d'un objectif réel, tel qu'un visage. Automatic recognition of characteristic features and simulation of an aesthetic image of a real objective, such as a face.
La présente invention concerne un système informatique permettant de simuler automatiquement une image esthétique d'un objectif réel, par exemple d'un visage, par la reconnaissance de ses traits caractéristiques.The present invention relates to a computer system for automatically simulating an aesthetic image of a real objective, for example of a face, by recognizing its characteristic features.
On sait qu'il existe dans la cosmétique, un certain nombre d'équipements de dessin et de coloriage manuels. Ces équipements permettent de modifier l'image initiale d'un visage et d'en déduire par voie manuelle une image parfaitement esthétique. Mais ce procédé est toujours lent et parfois aléatoire.We know that in cosmetics, there are a number of manual drawing and coloring equipments. This equipment makes it possible to modify the initial image of a face and to deduce therefrom manually a perfectly aesthetic image. But this process is always slow and sometimes random.
La présente invention concerne donc un procédé et un dispositif permettant de réaliser automatiquement par voie informatique, la simulation d'un objectif initial, un visage par exemple.The present invention therefore relates to a method and a device making it possible to carry out automatically by computer means, the simulation of an initial objective, a face for example.
Le système informatique mis en œuvre est installé dans une cabine ou une console. Il comporte essentiellement un ordinateur possédant un disque dur d'au moins à 420 Mo, un lecteur de "CD ROM", un appareil photographie numérique et un système expert, muni d'une base de données et animé par un moteur d'interférence, c'est-à-dire par un puissant système déductif indépendant de la base de données. Ce système expert utilisé est de la classe zéro plus (0+).The computer system implemented is installed in a cabin or console. It essentially comprises a computer with a hard disk of at least 420 MB, a "CD ROM" reader, a digital camera and an expert system, provided with a database and powered by an interference engine, that is to say by a powerful deductive system independent of the database. This expert system used is of class zero plus (0+).
La présente invention concerne donc un procédé et un dispositif permettant de simuler par un processus automatique une image idéale, à partir d'une image réelle d'un objectif, un visage par exemple, caractérisé en ce que l'image réelle capturée par un appareil photographique numérique en couleurs est segmentée, puis en ce que l'on détermine les traits caractéristiques fins de cette image par une reconnaissance de formes, de textures et de contour et enfin en ce que l'on modifie certains de ces traits en fonction de critères de décision d'un système expert doté d'une base de connaissance enrichie de plusieurs milliers de combinaisons et d'harmonies. La capture de l'image en couleurs est obtenue en quelques secondes au moyen d'un appareil photographique numérique du type ION ou d'une caméra vidéo avec sa cane d'acquisition numérique, sous un éclairage approprié issu de spots lumineux. C'est à partir de cette image, segmentée au préalable, que le procédé et le dispositif selon l'invention vont permetσe de simuler l'image esthétique idéale. Le procédé comprend essentiellement trois phases :The present invention therefore relates to a method and a device making it possible to simulate, by an automatic process, an ideal image, from a real image of a lens, a face for example, characterized in that the real image captured by a device digital photographic photography in color is segmented, then in that we determine the fine characteristic features of this image by a recognition of shapes, textures and outline and finally in that we modify some of these features according to criteria decision of an expert system with a knowledge base enriched by several thousand combinations and harmonies. Capturing the color image is obtained in a few seconds by means of a digital camera of the ION type or video camera with his cane digital acquisition, under appropriate illumination from light spots. It is from this image, segmented beforehand, that the method and the device according to the invention will enable the simulation of the ideal aesthetic image. The process essentially comprises three phases:
. Une phase d'acquisition : on procède à l'analyse et à la reconnaissance des formes et des contours d'une image photographique numérisée en mettant en œuvre des techniques caractérisées par le recours d'une logique déductive, . Une phase de transformation conduisant à la modification des traits caractéristiques fins de l'image initiale en fonction des critères de décision établis dans une base de règles du système expert interface avec les outils de segmentation et de reconnaissance des formes.. An acquisition phase: we analyze and recognize the shapes and contours of a digitized photographic image using techniques characterized by the use of deductive logic,. A transformation phase leading to the modification of the fine characteristic features of the initial image according to the decision criteria established in a rule base of the expert system interface with the segmentation and shape recognition tools.
. Une phase de restitution offrant sur un grand écran et/ou sur du papier, en particulier de format A4, la simulation esthétique recherchée.. A restitution phase offering the desired aesthetic simulation on a large screen and / or on paper, in particular A4 format.
Au cours de la première phase, le logiciel du traitement de l'image va coordonner plusieurs opérations successives.During the first phase, the image processing software will coordinate several successive operations.
Dans un premier temps, il procède à la détection et à la reconnaissance des contours. A cette fin, on considère les histogrammes des 256 niveaux de couleurs ou des 256 niveaux de gris équivalents correspondant à chaque segment élémentaire de l'image. En suivant deux directions privilégiées (verticale et horizontale, par exemple), il détermine les points où les histogrammes subissent une discontinuité ou bien passent par des minima ou des maxima de manière à optimiser la méthode, on déterminera les dérivés de la variance, la moyenne et le coefficient de variation des niveaux de gris de chaque ligne d'image. On arrive ainsi à préciser les formes de l'image. Ainsi, par exemple, avec un visage ,ces opérateurs permettent de définir non seulement sa forme mais également la forme des traits caractéristiques du visage (yeux, nez, cils, paupières, pommettes, bouche, etc.). On utilise à cette fin des automates suiveurs de contour. On peut ainsi isoler facilement les objets par rapport au fond. On délimite ainsi les régions d'intérêt de l'image. Dans le cas présent, cette binarisation peut être opérée de façon automatique par la recherche des minima des histogrammes des niveaux de gris suivant des directions privilégiées.First, it detects and recognizes the contours. To this end, the histograms of the 256 levels of colors or of the 256 levels of gray equivalent corresponding to each elementary segment of the image are considered. By following two preferred directions (vertical and horizontal, for example), it determines the points where the histograms undergo a discontinuity or else pass through minima or maxima so as to optimize the method, we will determine the derivatives of the variance, the mean and the coefficient of variation of the gray levels of each image line. We thus manage to specify the forms of the image. So, for example, with a face, these operators make it possible to define not only its shape but also the shape of the characteristic features of the face (eyes, nose, eyelashes, eyelids, cheekbones, mouth, etc.). To this end, contour following automata are used. Objects can thus be easily isolated from the background. The regions of interest of the image are thus delimited. In the present case, this binarization can be carried out automatically by the search for the minima of the gray level histograms in preferred directions.
La reconnaissance et l'analyse des textures cutanées suivent dans un deuxième temps la reconnaissance des formes.The recognition and analysis of skin textures then follow the recognition of the shapes.
On procède notamment à l'évaluation du degré d'entropie de la texture de la peau qui tient compte de l'importance de l'organisation ou du désordre de ce tissu ainsi que de l'existence ou de l'absence de motifs spatialement répétitifs.We proceed in particular to the evaluation of the degree of entropy of the texture of the skin which takes into account the importance of the organization or the disorder of this tissue as well as the existence or the absence of spatially repeating patterns. .
On relève également la présence de dislocations cutanées correspondant à des cicatrices, à des traces de couperose, susceptibles d'apparaître sur l'image. Cette première phase comporte enfin une détermination des effets structuraux au cours de laquelle on évalue d'une manière plus générale le degré d'homéomorphisme des tissus, le degré de symétrie de l'image et plus particulièrement le degré de symétrie orthogonale lorsque l'objet examiné est un visage (chilarité). Dans tous ces traitements, la qualité de l'image peut être améliorée par l'élimination ou par l'atténuation des bruits.We also note the presence of skin dislocations corresponding to scars, traces of rosacea, which may appear on the image. This first phase finally includes a determination of the structural effects during which a more general evaluation is made of the degree of homeomorphism of the tissues, the degree of symmetry of the image and more particularly the degree of orthogonal symmetry when the object examined is a face (chilarity). In all of these treatments, the image quality can be improved by eliminating or attenuating noise.
Les bruits correspondent à des fluctuations aléatoires et à des informations parasites provoquées notamment par l'éclairage.The noises correspond to random fluctuations and to parasitic information caused in particular by lighting.
Ces bruits se présentent sous forme de pixels isolés du voisinage. De plus, ces pixels isolés ne sont pas partiellement corrélés.These noises are in the form of pixels isolated from the neighborhood. In addition, these isolated pixels are not partially correlated.
On obtient l'élimination de ces bruits :We get the elimination of these noises:
- d'une part, par l'"érosion" qui permet d'éliminer des points extérieurs aux formes (par exemple, l'élimination de points sur fond blanc),- on the one hand, by "erosion" which makes it possible to eliminate points external to the forms (for example, the elimination of points on a white background),
- d'autre part, par la "dilatation" qui permet d'éliminer les "trous" apparaissant dans les formes.- on the other hand, by the "dilation" which eliminates the "holes" appearing in the shapes.
Ces transformations peuvent être contextuelles, c'est-à-dire que les paramètres des opérateurs sont susceptibles de varier en fonction d'un environnement ou d'une position par rapport au cadre de l'image ou par rapport à des formes caractéristiques préalablement détectées. On atténue l'importance de ces bruits en appliquant des filtres sur l'image.These transformations can be contextual, that is to say that the parameters of the operators are likely to vary according to an environment or a position relative to the frame of the image or compared to characteristic shapes previously detected. . We reduce the importance of these noises by applying filters to the image.
Il y a lieu de classer les filtres en deux catégories :Filters should be classified into two categories:
- les filtres opérateurs d'intégration susceptibles d'atténuer les bruits.- integration operator filters capable of attenuating noise.
- les filtres opérateurs de différenciation susceptibles, au contraire, de renforcer le contraste. Suivant le cas, ces filtres sont appliqués localement ou globalement sur l'image et ils doivent éventuellement tenir compte du contexte local de l'image en prenant en compte ses propriétés statistiques.- the differentiation operator filters likely, on the contrary, to enhance the contrast. Depending on the case, these filters are applied locally or globally on the image and they must possibly take into account the local context of the image by taking into account its statistical properties.
Suivant le cas, ces filtres sont destinés à des opérations effectuées en binaire en niveaux de gris, soit au contraire à opérer en 256 couleurs. Dans tous les cas, l'application de ces filtres demande une gestion efficace des "caches" intermédiaires.Depending on the case, these filters are intended for operations performed in binary in grayscale, or on the contrary to operate in 256 colors. In all cases, the application of these filters requires efficient management of the intermediate "caches".
Au cours de la phase de transformation de l'image originale, le procédé détermine à quel sexe appartient le visage, s'il est de type enfant, adolescent, adulte ou vieillard, ensuite apporte des améliorations de caractère esthétique, en fonction de son programme de soins. Certaines particularités du visage initial sont améliorées. Ainsi, par exemple, les petites πdes, les cernes, les "pattes d'oie", les taches de rousseur, l'acné et la couperose sont fortement estompées. D'une façon plus générale, les traits caractéristiques du visage sont modifiés en fonction de décisions de la base du système expert. Au cours de cette phase de transformation, le logiciel analyse les couleurs dominantes qui paraissent dans les différentes régions du visage (par exemple, couleur des lèvres, des yeux, teint dominant de la peau, etc.) et apporte si cela s'avère nécessaire des améliorations de caractère cosmétique Dans le cas où les données nécessaires aux inférences du système expert peuvent être incomplètes ou incertaines, l'utilisation de la logique floue permet de pondérer les prémisses des règles et les règles elles-même de manière à pouvoir inférer même en présence de données incomplètes ou imprécises Des choix cosmétiques pourront être ainsi effectués même si on ne dispose pas avec précision de toutes les données nécessairesDuring the transformation phase of the original image, the process determines which sex the face belongs to, whether it is of the child, adolescent, adult or old man type, then brings improvements of an aesthetic nature, depending on its program. of care. Some features of the initial face are improved. So, for example, small πdes, dark circles, crow's feet, freckles, acne and rosacea are greatly reduced. More generally, the characteristic features of the face are modified according to decisions by the base of the expert system. During this transformation phase, the software analyzes the dominant colors that appear in the different regions of the face (for example, lip color, eyes, dominant skin tone, etc.) and provides if necessary cosmetic improvements In the case where the data necessary for inferences from the expert system may be incomplete or uncertain, the use of fuzzy logic makes it possible to balance the premises of the rules and the rules themselves so as to be able to infer even presence of incomplete or imprecise data Cosmetic choices may be made even if we do not have all the necessary data with precision
Au cours de la phase de décision, c'est cette image esthétique et maquillée qui va être présentée comme la simulation de limage isoléeDuring the decision phase, this aesthetic and made-up image will be presented as the simulation of the isolated image.
La phase de restitution se traduit d'abord par l'affichage, en 256 couleurs, sur écran couleur haute définition de limage progressivement transformée, ensuite par l'impression d'une photographie en 256 niveaux de gris grâce à une impπmante à jet d'encre ou laser, dans un format A4, et par l'édinon de la feuille d'information "soins et beauté ou passeport beauté" Dans l'application du procédé au visage, chaque partie du visage qui a subi des soins est directement renseignée par un commentaire scientifique et esthétique avec la descπption du produit a utiliser Enfin. 1 impression d une seconde photographie en 256 couleurs de format A4 est éditée quelques minutes plus tard grâce a une impπmante a sublimation thermique, jet d encre ou laser, incorporée dans 1 installation, révélant ainsi son nouveau visage simule au sujet examineThe restitution phase is reflected first by the display, in 256 colors, on a high-definition color screen of the image gradually transformed, then by the printing of a photograph in 256 gray levels thanks to an image jet ink or laser, in A4 format, and by the edinon of the "care and beauty or beauty passport" information sheet In the application of the procedure to the face, each part of the face which has been treated is directly informed by a scientific and aesthetic comment with the description of the product to be used Finally. A print of a second photograph in 256 colors in A4 format is edited a few minutes later thanks to a thermal sublimation, inkjet or laser printer, incorporated into 1 installation, thus revealing its new simulated face on the subject examined.
L image simulée et les informations correspondantes sont enregistrées au moyen d un lecteur enregistreur de carte optique numéπque faisant partie de 1 installation La feuille de soins et la photographie définitive en couleurs sont éditées devant la ou le clientThe simulated image and the corresponding information are recorded by means of a digital optical card reader reader which is part of the installation. The treatment sheet and the final color photograph are edited in front of the client.
Toujours dans 1 application du procédé au visage humain, le système expert est en mesure de simuler à la demande des styles de maquillage adaptés aux circonstances On peut ainsi réaliser un maquillage le mieux adapté a une fête, une soirée, soit au travail ou même au séjour au bord de la mer, etc Le système expert est en mesure de simuler à la demande et de vérifier les effets d'un programme de soins de peau.Always in 1 application of the process to the human face, the expert system is able to simulate on request makeup styles adapted to the circumstances. We can thus make a makeup best suited to a party, an evening, either at work or even at work. stay by the sea, etc. The expert system is able to simulate on demand and verify the effects of a skin care program.
Le procédé de mise en œuvre dans la présente invention sera mieux compris en se reportant à la description d'un exemple simplifié concernant un visage de femme décrit en référence aux dessins joints, sur lesquels :The implementation process in the present invention will be better understood by referring to the description of a simplified example concerning a woman's face described with reference to the accompanying drawings, in which:
- la figure 1 représente l'image d'un visage de femme à modifier,FIG. 1 represents the image of a woman's face to be modified,
- la figure 2 représente une photographie du même visage sous forme informatique en 256 niveaux de gris ou 256 couleurs,FIG. 2 represents a photograph of the same face in computer form in 256 gray levels or 256 colors,
- la figure 3 fait apparaître en gris foncé, les portions de l'image soumises à un premier traitement, etFIG. 3 shows in dark gray, the portions of the image subjected to a first treatment, and
- la figure 4 représente le visage modifié par le procédé de la présente invention, déposé sous le nom MAGIC LUMIERE.- Figure 4 shows the face modified by the method of the present invention, registered under the name MAGIC LUMIERE.
La figure 1 est l'image du visage de femme à modifier. Pour pouvoir procéder au traitement informatique de l'image, on substitue à cette image une autre image obtenue au moyen d'un appareil photographique numérique en 256 couleurs.FIG. 1 is the image of the woman's face to be modified. In order to be able to carry out computer processing of the image, this image is replaced by another image obtained by means of a digital camera in 256 colors.
La figure 2 représente l'image de ce visage de femme ainsi obtenu sous forme informatique, formé de segments élémentaires, caractérisé chacun par un histogramme précisant pour ce segment élémentaire le niveau de chacune des 256 couleurs. II est alors possible de procéder à l'analyse et à la reconnaissance des formes de ce visage.FIG. 2 represents the image of this woman's face thus obtained in computer form, formed of elementary segments, each characterized by a histogram specifying for this elementary segment the level of each of the 256 colors. It is then possible to analyze and recognize the shapes of this face.
On choisit alors deux directions privilégiées telles que les droites (V) et (H) de la figure 3.Two preferred directions are then chosen such as the lines (V) and (H) of FIG. 3.
En suivant ces directions privilégiées, on détermine les points tels que (V ; Hl) où les histogrammes subissent une discontinuité correspondant à la limite de la chevelure sombre du visage étudié. On révélera également tous les points tels que (V I ; H2) ou (V I ; H5) où les histogrammes passent par des minima.Following these privileged directions, points such as (V; Hl) are determined where the histograms undergo a discontinuity corresponding to the limit of the dark hair of the face studied. We will also reveal all the points such as (V I; H2) or (V I; H5) where the histograms pass through minima.
En déplaçant les lignes V et H le long de l'image du visage, on définit des lignes continues représentant la forme des différents éléments du visage. On est alors en mesure de procéder à la reconnaissance et à l'analyse des textures cutanées en examinant par exemple les histogrammes des points relevés suivant les directions telles que H2, H3, ..., H7.By moving the lines V and H along the image of the face, we define continuous lines representing the shape of the different elements of the face. We are then able to recognize and analyze the skin textures by examining, for example, the histograms of the points noted along the directions such as H2, H3, ..., H7.
Ayant déterminé les formes et la nature des textures cutanées de cette image, on est en mesure de passer à la phase de transformation. Le logiciel va alors analyser les couleurs dominantes qui ont été mises en évidence sur certaines parties du visage. Dans le cas présent, le logiciel analyse la couleur des yeux, des cils, des paupières, des sourcils, puis la coloration des lèvres. Ces extraits sont alors modifiés en fonction des décisions du système expert.Having determined the shapes and nature of the skin textures in this image, we are able to move on to the transformation phase. The software will then analyze the dominant colors that have been highlighted on certain parts of the face. In this case, the software analyzes the color of the eyes, eyelashes, eyelids, eyebrows, then the coloring of the lips. These extracts are then modified according to the decisions of the expert system.
La figure 3 illustre ces opérations. Ayant défini les éléments à modifier (paupières, cils, sourcils), on procède à l'extraction des contours de ces éléments. De sorte que ceux-ci apparaissent en gris foncé ou blanc sur l'image. On met donc en mémoire tous les pixels de ces zones pour modifier leur couleur et réaliser le maquillage recherché.Figure 3 illustrates these operations. Having defined the elements to modify (eyelids, eyelashes, eyebrows), we proceed to extract the contours of these elements. So that these appear in dark gray or white on the image. We therefore store all the pixels in these zones in order to modify their color and achieve the desired makeup.
La figure 4 correspond à la phase de restitution au cours de laquelle les traits caractéristiques fins de limage initiale ont été transformés pour donner une image esthétique et maquilléeFIG. 4 corresponds to the restitution phase during which the fine characteristic features of the initial image have been transformed to give an aesthetic and made-up image.
Ainsi, on note que les éléments extraits de limage (figure 3) ont été remplacés par des éléments nouveaux : les paupières et la base des sourcils ont été rendues plus clairs et soulignées de bleu ; les cils ont été maquillés. L'opération de restitution s'est poursuivie en modifiant le rouge des lèvres et leur contour C'est cette image qui révèle son nouveau visage simulé à la cliente.Thus, we note that the elements extracted from the image (Figure 3) have been replaced by new elements: the eyelids and the base of the eyebrows have been made clearer and underlined in blue; the eyelashes were made up. The restitution operation continued by modifying the lipstick and their outline. It is this image which reveals her new simulated face to the client.
On peut évidemment appliquer ce procédé et de dispositif à la simulation d une image esthétique d'un visage, à partir d'une simple photographie noire et blanc ou couleurs, permettant d'effectuer, à partir de la numérisation de cette photographie par un scanner de haute définition, des portraits photographiques d'un sujet en améliorant l'esthétique de ce visage par des techniques capillaires et de maquillage, l'estompage ou la rectification de certains défauts anatomiques, de changement de la couleur cutanée (bronzage), dans ce cas, la base de données correspondant à la simulation esthétique du visage est complétée par une collection de règles d'esthétique concernant le maquillage, la coiffure, les techniques capillaires, la texture de la peau et/ou la chirurgie plastique permettant ainsi de traiter simultanément le visage et la partie capillaire d'un sujet pour éditer et restituer une nouvelle image valorisante et idéaleThis process and device can obviously be applied to the simulation of an aesthetic image of a face, from a simple black and white or color photograph, making it possible to perform, from the scanning of this photograph by a scanner high definition, photographic portraits of a subject by improving the aesthetics of this face by capillary and make-up techniques, blurring or rectification of certain anatomical defects, change in skin color (tanning), in this In this case, the database corresponding to the aesthetic simulation of the face is completed by a collection of aesthetic rules concerning makeup, hairstyling, hair techniques, skin texture and / or plastic surgery, thus making it possible to treat simultaneously the face and the hair part of a subject to edit and restore a new rewarding and ideal image
On conçoit facilement que ce système peut recevoir de très nombreuses applications en complétant le système expert par des données scientifiquesIt is easy to see that this system can receive many applications by supplementing the expert system with scientific data
En chirurgie plastique.In plastic surgery.
On peut ainsi visualiser à partir de l'anatomie existante du corps ou du visage à traiter, les modifications à y apporter telles qu'un lifting, une rectification du nez, une transformanon maxillaire, une rectification du bec de lièvre, la disparition de la culotte de cheval, etc . Le logiciel simule alors les modifications à apporter, ainsi que l'aspect futur du visage ou de la partie du corps traitée.It is thus possible to visualize, from the existing anatomy of the body or face to be treated, the modifications to be made therein such as a facelift, a correction of the nose, a maxillary transformanon, a correction of the hare's beak, the disappearance of the breeches, etc. The software then simulates the changes to be made, as well as the future appearance of the face or the part of the body treated.
La base de données du système expert est enrichie de règles concernant l'anatomie et la technique chirurgicale correspondante. Après cicatrisation, cette dernière image doit être comparée au résultat obtenu afin de voir s'il y a encore lieu de procéder à quelques rectifications complémentaires.The expert system database is enriched with rules concerning the anatomy and the corresponding surgical technique. After healing, this last image must be compared with the result obtained in order to see if there is still reason to make some additional corrections.
En technique de remise en forme.In fitness technique.
On peut ainsi visualiser à partir de l'image de l'anatomie existante du corps à traiter, les modifications à y apporter (élimination du tissu adipeux abdominal, musculation de la paroi abdominal, etc.), la base de données du système expert étant enrichie de règles concernant l'ensemble des techniques de la culture physique, les régimes alimentaires et les différentes méthodes de musculation.It is thus possible to visualize, from the image of the existing anatomy of the body to be treated, the modifications to be made thereto (elimination of the adipose abdominal tissue, musculation of the abdominal wall, etc.), the database of the expert system being enriched with rules concerning all the techniques of physical culture, diets and different methods of bodybuilding.
En dermatologie.In dermatology.
L'emploi d'un système expert du traitement de limage cutanée en couleur permet un nouveau développement en quantifiant et qualifiant l'état de la peau grâce aux analyseurs de texture et de la distribution des couleurs.The use of an expert system for the treatment of skin color filing allows a new development by quantifying and qualifying the condition of the skin thanks to the texture and color distribution analyzers.
En particulier, le système d'acquisition et de traitement d'images associé à un système expert permet de réaliser un modèle d'aide au diagnostic et de suggérer la nature du traitement à effectuer (pommade, etc.).In particular, the image acquisition and processing system associated with an expert system makes it possible to carry out a diagnostic aid model and to suggest the nature of the treatment to be performed (ointment, etc.).
En outre, le dispositif permet au dermatologue d'apprécier plus facilement l'évolution de l'affection et de constater sans difficulté les changements de coloration du tissu cutané (eczéma, zona, psoriasis, dermites, les changements de coloration des taches cutanées susceptibles de se cancériser, les naevi, les cicatrices en évolution, les escarres, les troubles vasomoteurs, les affections des muqueuses, etc.).In addition, the device makes it easier for the dermatologist to appreciate the evolution of the condition and to easily observe the changes in color of the skin tissue (eczema, shingles, psoriasis, dermatitis, changes in color of the skin spots likely to cancer, nevi, evolving scars, bedsores, vasomotor disorders, mucosal disorders, etc.).
La base de données du système expert est enrichie d'informations concernant les changements de coloration du tissu cutané ou des taches cutanées correspondant à un ensemble d'affections, accompagnées d'exemples des traitements, permettant de suggérer la nature du traitement à effectuer.The database of the expert system is enriched with information concerning the changes in color of the skin tissue or skin spots corresponding to a set of conditions, accompanied by examples of the treatments, making it possible to suggest the nature of the treatment to be carried out.
En coiffure et en techniques capillaires.In hairdressing and hair techniques.
Le dispositif selon l'invention permet d'aider à faire le choix d'une meilleure esthétique en facilitant la superposition de différents types de coiffure et de différentes colorations de cheveux sur un visase. Cette application pouvant être mise en œuvre directement avec le système MAGIC LUMIERE, l'application à la technique capillaire peut être directement incluse dans le traitement du visage.The device according to the invention helps to make the choice of a better aesthetic by facilitating the superposition of different types of hairstyle and different hair colors on a visase. This application can be implemented directly with the MAGIC LUMIERE system, the application to the hair technique can be directly included in the facial treatment.
La base de données correspondant à la simulation esthétique du visage est complétée par une collection de règles d'esthétique concernant la coiffure et la couleur des cheveux permettant ainsi de traiter simultanément le visage et la partie capillaire d'un sujet.The database corresponding to the aesthetic simulation of the face is completed by a collection of esthetic rules concerning the hairstyle and the hair color thus making it possible to simultaneously treat the face and the capillary part of a subject.
En lunetterie. Le dispositif selon l'invention permet, à l'opticien lunetier, d'aider à faire le choix d'une meilleure esthétique en facilitant la superposition de différentes montures de lunettes ou de différentes lentilles de couleurs sur un visage.In eyewear. The device according to the invention allows the eyewear optician to help make the choice of a better aesthetic by facilitating the superposition of different spectacle frames or different colored lenses on a face.
Cette application pouvant être mise en œuvre directement avec le système MAGIC LUMIERE, l'application à la technique de la lunetteπe ou des instruments d'optiques peut être directement incluse dans le traitement du visage.This application can be implemented directly with the MAGIC LIGHT system, the application to the technique of glasses or optical instruments can be directly included in the treatment of the face.
La base de données correspondant à la simulation esthétique du visage est complétée par une collection de règles d'esthétique concernant les montures de lunettes et les instruments d'optiques (lentilles de couleurs, etc.) permettant ainsi de traiter simultanément le visage et de superposer différentes montures de lunettes de manière adéquate ou différentes lentilles de couleur au visage.The database corresponding to the aesthetic simulation of the face is completed by a collection of aesthetic rules concerning spectacle frames and optical instruments (colored lenses, etc.) thus making it possible to simultaneously treat the face and superimpose different glasses frames adequately or different colored lenses on the face.
En sécurité.Safe.
Le système selon l'invention permettant de reconnaître à coup sûr le visage d une personne connue peut être utilisé pour commander un système d'ouverture. La base de données est enπchie d'informations correspondant a tous les traits caractéristiques d'un ou plusieurs visages connus permettant de reconnaître à coup sûr le visage d'une personne dite autoπsée.The system according to the invention making it possible to recognize the face of a known person without fail can be used to control an opening system. The database is filled with information corresponding to all the characteristic features of one or more known faces making it possible to recognize the face of a so-called self-assertive person for sure.
Le système selon l'invention permet également de reconnaître un visage partiellement masqué ou totalement masqué par un tissu et de le comparer à une base de données de traits caractéristiques d un visage, et ceci quelque sou son oπentation Un système de reconstruction 3D à partir d'images 2D dont l'orientation est inconnue permettant la reconstruction du faciès et sa représentation face et profil pour comparaison avec un fichier. La base de données est enrichie d'informations correspondant à tous les traits caractéπstiques de visages permettant de reconstruire un faciès de face et de profil. A cette base de données est associée une autre base de données contenant des visages de personnes qui permettront leur comparaison avec le faciès reconstruit de face et de profil.The system according to the invention also makes it possible to recognize a face partially masked or totally masked by a fabric and to compare it to a database of features characteristic of a face, and this whatever its orientation A 3D reconstruction system from ' 2D images whose orientation is unknown allowing the reconstruction of the facies and its face and profile representation for comparison with a file. The database is enriched with information corresponding to all the characteristic features of faces making it possible to reconstruct a facies from the front and from the profile. Another database is associated with this database. data containing faces of people which will allow their comparison with the reconstructed facies from the front and from the side.
En photographie numérique. Le système selon l'invention permet lors d'une photographie effectuée en cabine de photographie numérique d'améliorer l'esthétique et valoriser l'image d'un sujet. La base de données correspondant à la simulation esthétique du vase est complétée par une collection de règles esthétiques concernant le maquillage, la coiffure, les techniques capillaires et la texture de la peau permettant ainsi de traiter simultanément le visage, la partie capillaire d'un sujet pour éditer des photographies valorisantes pour le client.In digital photography. The system according to the invention makes it possible, during a photograph taken in a digital photography booth, to improve the aesthetics and enhance the image of a subject. The database corresponding to the aesthetic simulation of the vase is completed by a collection of aesthetic rules concerning make-up, hairstyling, hair techniques and skin texture, thus making it possible to simultaneously treat the face, the capillary part of a subject. to edit photographs that are rewarding for the client.
En traitement de photographie.Processing photography.
Le système selon l'invention permet à partir d'une photographie du visage d'un sujet, fourni sur support photographique classique en noir et blanc ou en couleurs, après avoir été scannérisé par un appareil de numérisation, d'être retouché et amélioré esthétiquement. La base de données correspondant à la simulation esthétique du visage est complétée par une collection de règles d'esthétique concernant le maquillage, la coiffure, les techniques capillaires et la texture de la peau permettant ainsi de traiter simultanément le visage, la partie capillaire d'un sujet pour éditer des portraits valorisants.The system according to the invention makes it possible, from a photograph of the face of a subject, supplied on conventional photographic support in black and white or in color, after having been scanned by a digitizing apparatus, to be retouched and aesthetically improved. . The database corresponding to the aesthetic simulation of the face is completed by a collection of aesthetic rules concerning make-up, hairstyling, hair techniques and skin texture, thus making it possible to simultaneously treat the face, the capillary part of a subject for editing rewarding portraits.
En morphopsychologie.In morphopsychology.
Le dispositif selon l'invention permet d'observer et de "lire" avec minutie un visage les rides et les ridules, l'équilibre entre la partie supérieure et inférieure, la taille et la forme du nez, du lobe des oreilles et des commissures des lèvres, etc., ainsi il est possible de déceler et de déterminer la personnalité d'autrui.The device according to the invention makes it possible to observe and "read" with meticulousness a face the wrinkles and fine lines, the balance between the upper and lower part, the size and the shape of the nose, the earlobe and the commissures lips, etc., so it is possible to detect and determine the personality of others.
Cette application pouvant être mise en œuvre directement avec le système MAGIC LUMIERE. La base de données du système est enrichie d'un ensemble de techniques correspondant à l'observation des visages, complété par celles des psychologues, des psychiatres et des anatomistes dans ce domaine. This application can be implemented directly with the MAGIC LUMIERE system. The system database is enriched with a set of techniques corresponding to the observation of faces, supplemented by those of psychologists, psychiatrists and anatomists in this field.

Claims

Revendications : Claims:
1.- Procédé de simulation d'une image esthétique idéale à partir d'une image photographique numérique en couleurs d'un objectif réel, en particulier un visage, caractérisé en ce qu'après une étape de segmentation de l'image, on procède au cours d'une première phase d'acquisition à la détermination des traits caractéristiques fins du visage et de sa structure cutanée puis au cours d'une phase de transformation, on procède d'une part à la modification ou à l'amélioration esthétique des traits caractéπstiques de limage initiale et d'autre part à la modification de certaines des couleurs de la structure cutanée, en fonction des critères de sélection déterminés par un système expert de classe zéro + animé par un moteur d'interférence en s'appuyant sur une base de données enπchie de plusieurs milliers de combinaisons de forme et d'harmonies de couleurs1.- Method for simulating an ideal aesthetic image from a digital photographic image in colors of a real objective, in particular a face, characterized in that after a step of segmenting the image, one proceeds during a first acquisition phase to determine the fine characteristic features of the face and its skin structure, then during a transformation phase, we proceed on the one hand to the modification or the aesthetic improvement of the characteristic features of the initial image and on the other hand to the modification of some of the colors of the skin structure, according to the selection criteria determined by an expert system of class zero + driven by an interference engine based on a database of several thousand combinations of shape and color harmonies
2 - Procédé selon la revendication 1, dans lequel après avoir déterminé les histogrammes des niveaux de couleurs des segments du visage, on procède suivant le programme du système expert à une reconnaissance des structures du visage en recherchant suivant deux directions privilégiées les lieux de discontinuité des histogrammes des niveaux de couleur.2 - Method according to claim 1, wherein after determining the histograms of the color levels of the facial segments, we proceed according to the program of the expert system to a recognition of the facial structures by searching in two preferred directions the places of discontinuity of the color level histograms.
3.- Procédé selon la revendication 1 ou 2, dans lequel la reconnaissance de contours de limage est obtenue par l'analyse des couleurs ou des niveaux de gπs équivalents correspondant à chaque segment élémentaire de limage 4 - Procédé selon l'une quelconque des revendications 1 à 3, dans lequel au cours de la reconnaissance et de l'analyse de la texture cutanée, les irrégulaπtés de celle-ci sont estompées ou corrigées par une technique cosmétique en fonction des cπtères de décision du système expert3.- Method according to claim 1 or 2, wherein the recognition of filing contours is obtained by the analysis of colors or equivalent levels of gπs corresponding to each elementary filing segment 4 - Method according to any one of claims 1 to 3, in which during the recognition and analysis of the skin texture, the irregularities thereof are blurred or corrected by a cosmetic technique according to the decision criteria of the expert system
5 - Procédé selon l'une quelconque des revendicaαons précédentes, appliqué à la chirurgie plastique permettant de visualiser à partir de l'anatomie existante les modifications à lui apporter sous forme d'un lifting, d'une rectification de nez, de la dispaπtion de la culotte de cheval, dans lequel la base de données associée au système expert est enrichie de règles concernant l'anatomie et la technique chirurgicale correspondante 6 - Procédé selon l'une quelconque des revendications précédentes, appliqué au domaine de la dermatologie, dans lequel la base de données est enπchie d'informations concernant les changements de coloration du tissu cutané ou des taches cutanées correspondant à un ensemble d'affections de caractère dermatologique permettant de suggérer le traitement à effectuer par la suite.5 - Method according to any one of the preceding claims, applied to plastic surgery making it possible to visualize, from the existing anatomy, the modifications to be made to it in the form of a facelift, a rectification of the nose, the disappearance of horse breeches, in which the database associated with the expert system is enriched with rules concerning the anatomy and the corresponding surgical technique 6 - Method according to any one of the preceding claims, applied to the field of dermatology, in which the database is full of information regarding changes in color of skin tissue or skin spots corresponding to a set of dermatological conditions allowing to suggest the treatment to be carried out thereafter.
7.- Procédé selon l'une quelconque des revendications précédentes, appliqué à la technique capillaire, dans lequel la base de données correspondant à la simulation esthétique du visage est complétée par une collection de règles d'esthétique concernant la coiffure et la couleur des cheveux permettant de traiter simultanément le visage et la partie capillaire du sujet.7.- Method according to any one of the preceding claims, applied to the hair technique, in which the database corresponding to the aesthetic simulation of the face is supplemented by a collection of aesthetic rules concerning the hairstyle and the color of the hair. allowing to simultaneously treat the face and the capillary part of the subject.
8.- Procédé selon l'une quelconque des revendications précédentes, appliqué au domaine de la lunetterie permettant de traiter simultanément la simulation de l'image esthétique d'un visage et de la monture de lunettes et des verres de couleur qui lui sont superposés, dans lequel la base de données correspondant à la simulation esthétique d'un visage est complétée par un ensemble de règles esthétiques concernant les montures de lunettes et les verres de couleur.8.- Method according to any one of the preceding claims, applied to the field of eyewear making it possible to simultaneously process the simulation of the aesthetic image of a face and of the frame of glasses and colored lenses which are superimposed on it, in which the database corresponding to the aesthetic simulation of a face is supplemented by a set of aesthetic rules relating to spectacle frames and colored lenses.
9.- Procédé selon l'une quelconque des revendications précédentes, appliqué à la simulation de l'image esthétique du corps humain à partir de l'anatomie existante par une modification des tissus adipeux et par une musculation éventuelle de ceux-ci, dans lequel la base de données du système expert est enrichie de règles concernant la culture physique, le régime alimentaire et la musculation.9.- Method according to any one of the preceding claims, applied to the simulation of the aesthetic image of the human body from the existing anatomy by a modification of the adipose tissues and by a possible bodybuilding thereof, in which the expert system database is enriched with rules concerning physical culture, diet and bodybuilding.
10.- Procédé selon l'une quelconque des revendications précédentes, appliqué aux techniques de sécurité permettant l'identification d'un ou de plusieurs visages, dans lequel la base de données est enrichie d'informations correspondant à l'ensemble des traits caractéristiques d'un ou de plusieurs visages permettant de reconnaître avec sûreté un visage connu d'après la base de données.10.- Method according to any one of the preceding claims, applied to security techniques allowing the identification of one or more faces, in which the database is enriched with information corresponding to all the characteristic features d '' one or more faces allowing to recognize with confidence a face known according to the database.
11.- Procédé selon l'une quelconque des revendications précédentes, permettant d'identifier un visage masqué par un tissu par comparaison à une base de données de traits caractéristiques d'un visage, quelle que soit son orientation, dans lequel la base de données est enrichie d'une part d'informations coπespondant à tous les traits caractéristiques du visage permettant de reconsσuire un visage de face et de profil et d'autre part d'informations concernant des visages connus présentés de face et de profil.11.- Method according to any one of the preceding claims, making it possible to identify a face masked by a fabric by comparison with a database of features characteristic of a face, whatever its orientation, in which the database is enriched on the one hand with information corresponding to all the characteristic features of the face allowing the reconstruction of a face from the front and from the profile and on the other hand from information concerning known faces presented from the front and from the profile.
12.- Procédé selon l'une quelconque des revendications précédentes, permettant de déterminer la personnalité d'une personne examinée à partir de l'observation morphologique d'un visage telle que, par exemple, la présence et l'importance de rides et de ridules, la taille et la forme du nez, du lobe des oreilles, dans lequel la base de données coπespondant à l'observation des visages est complétée par les techniques mises en œuvre par les psychologues, les psychiatres et les anatomistes dans le domaine considéré.12.- Method according to any one of the preceding claims, making it possible to determine the personality of a person examined from the morphological observation of a face such as, for example, the presence and extent of wrinkles and fine lines, the size and shape of the nose, ear lobe, in which the database responding to the observation of faces is supplemented by techniques implemented by psychologists, psychiatrists and anatomists in the field under consideration.
13.- Dispositif pour mettre en œuvre le procédé selon l'une quelconque des revendications 1 à 12, comprenant un système informatique disposé dans une cabine ou sur une console, au moins un appareil de photographie numérique en couleurs doté de spots lumineux, un écran couleur, au moins une imprimante et un lecteur enregistreur de carte optique, caractérisé en ce que le système informatique assurant le traitement de l'image comprend un ordinateur doté d'un disque dur d'une capacité égale au moins à 420 Mo, associé à un lecteur de disque du type "CD ROM" et en ce que les appareils de photographie numérique en couleurs permettent d'obtenir au cours d'une première phase une photographie réelle numérique en 256 couleurs de l'image réelle d'origine, tandis que l'image esthétique transformée suivant les critères de décision du système expert zéro + est affiché sur un écran en couleurs à haute définition. 14.- Dispositif selon la revendication 13, dans lequel après l'affichage de l'image transformée sur un écran couleur, l'imprimante à jet d'encre fournit une photographie à 256 niveaux de gris, puis une deuxième imprimante à sublimation thermique, à jet d'encre ou au laser procède à l'impression d'une seconde photographie en 256 couleurs de préférence de format A4. 13.- Device for implementing the method according to any one of claims 1 to 12, comprising a computer system arranged in a cabin or on a console, at least one digital color photography device with light spots, a screen color, at least one printer and an optical card recorder reader, characterized in that the computer system ensuring the image processing comprises a computer equipped with a hard disk with a capacity equal to at least 420 MB, associated with a disc reader of the "CD ROM" type and in that digital color photography devices make it possible to obtain, during a first phase, a real digital photograph in 256 colors of the original real image, while the aesthetic image transformed according to the decision criteria of the zero + expert system is displayed on a high definition color screen. 14.- Device according to claim 13, in which after the display of the transformed image on a color screen, the inkjet printer provides a photograph with 256 gray levels, then a second printer with thermal sublimation, inkjet or laser prints a second photograph in 256 colors, preferably A4 format.
PCT/FR1995/001747 1994-12-29 1995-12-28 Automatic recognition of characteristic features and simulation of an aesthetic image of a real objective such as a face WO1996021201A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU44522/96A AU4452296A (en) 1994-12-29 1995-12-28 Automatic recognition of characteristic features and simulation of an aesthetic image of a real objective such as a face

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR9415894A FR2728982A1 (en) 1994-12-29 1994-12-29 AUTOMATIC RECOGNITION OF FACE CHARACTERISTICS AND SIMULATION OF AN AESTHETIC IMAGE OF A REAL OBJECTIVE (FACE)
FR94/15894 1994-12-29

Publications (1)

Publication Number Publication Date
WO1996021201A1 true WO1996021201A1 (en) 1996-07-11

Family

ID=9470432

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/FR1995/001747 WO1996021201A1 (en) 1994-12-29 1995-12-28 Automatic recognition of characteristic features and simulation of an aesthetic image of a real objective such as a face

Country Status (3)

Country Link
AU (1) AU4452296A (en)
FR (1) FR2728982A1 (en)
WO (1) WO1996021201A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2783949A1 (en) * 1998-09-30 2000-03-31 Lucette Robin Remote digital processing of an image, in particular an image of a human face
WO2001075796A1 (en) * 2000-03-30 2001-10-11 Lucette Robin Digital remote data processing system for transforming an image, in particular an image of the human face
AU769041B2 (en) * 1999-07-07 2004-01-15 Unilever Plc Virtual makeover
US6810130B1 (en) * 1999-09-29 2004-10-26 L'oreal Apparatus for assisting makeup and an assembly constituted by such apparatus and apparatus for delivering makeup having a predetermined BRDF as selected by the apparatus for assisting makeup
FR2907569A1 (en) * 2006-10-24 2008-04-25 Jean Marc Robin Video image sequence's virtual simulation method for beauty industry, involves modifying features of images of sequence and color of cutaneous structure based on criterions in database and decision criterions of expert system
EP1968016A1 (en) 2007-03-08 2008-09-10 Sagem Telecommunications Interactive system for assisting the selection of cosmetic products
FR2920938A1 (en) * 2008-09-30 2009-03-13 Jean Marc Robin Image simulating method for beauty industry, involves deforming parametric models to adapt to contours of features on face, and detecting and analyzing cutaneous structure of areas of face by maximizing gradient flow of brightness
CN104599297A (en) * 2013-10-31 2015-05-06 厦门美图网科技有限公司 Image processing method for automatically blushing human face
CN110767288A (en) * 2018-07-26 2020-02-07 王东 Virtual face contour adjusting method
CN111353931A (en) * 2018-12-24 2020-06-30 黄庆武整形医生集团(深圳)有限公司 Shaping simulation method, shaping simulation system, readable storage medium and device

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6437866B1 (en) * 1999-07-07 2002-08-20 Fd Management, Inc. System for assisting customers in selecting an optimum color cosmetic product
WO2001077976A2 (en) * 2000-03-28 2001-10-18 Eyeweb, Inc. Image segmenting to enable electronic shopping for wearable goods and cosmetic services
FR2810761B1 (en) * 2000-06-26 2003-09-05 Oreal COSMETIC TREATMENT PROCESS AND DEVICE, IN PARTICULAR FOR CARE, MAKE-UP OR COLORING
US6959119B2 (en) * 2000-11-03 2005-10-25 Unilever Home & Personal Care Usa Method of evaluating cosmetic products on a consumer with future predictive transformation

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4276570A (en) * 1979-05-08 1981-06-30 Nancy Burson Method and apparatus for producing an image of a person's face at a different age
EP0226959A2 (en) * 1985-12-18 1987-07-01 Tsukasa Horikita Make-up simulator
JPH0535827A (en) * 1991-05-10 1993-02-12 Miki:Kk Spectacles selection and designing system
EP0583055A2 (en) * 1992-07-17 1994-02-16 International Business Machines Corporation Image enhancement

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4276570A (en) * 1979-05-08 1981-06-30 Nancy Burson Method and apparatus for producing an image of a person's face at a different age
EP0226959A2 (en) * 1985-12-18 1987-07-01 Tsukasa Horikita Make-up simulator
JPH0535827A (en) * 1991-05-10 1993-02-12 Miki:Kk Spectacles selection and designing system
EP0583055A2 (en) * 1992-07-17 1994-02-16 International Business Machines Corporation Image enhancement

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
CHOW G. & XIAOBO LI: "Towards a System for Automatic Facial Feature Detection", PATTERN RECOGNITION, vol. 26, no. 12, December 1993 (1993-12-01), UK, pages 1739 - 1755, XP000420368 *
HIROSHI YAMADA ET AL: "A Facial Image Processing System for Psychological Studies", PROCEEDINGS, IEEE INTERNATIONAL WORKSHOP ON ROBOT AND HUMAN COMMUNICATION, 1 September 1992 (1992-09-01) - 3 September 1992 (1992-09-03), TOKYO, JAPAN, pages 358 - 362, XP002001781 *
PATENT ABSTRACTS OF JAPAN vol. 17, no. 326 (P - 1560) 21 June 1993 (1993-06-21) *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2783949A1 (en) * 1998-09-30 2000-03-31 Lucette Robin Remote digital processing of an image, in particular an image of a human face
AU769041B2 (en) * 1999-07-07 2004-01-15 Unilever Plc Virtual makeover
US6810130B1 (en) * 1999-09-29 2004-10-26 L'oreal Apparatus for assisting makeup and an assembly constituted by such apparatus and apparatus for delivering makeup having a predetermined BRDF as selected by the apparatus for assisting makeup
WO2001075796A1 (en) * 2000-03-30 2001-10-11 Lucette Robin Digital remote data processing system for transforming an image, in particular an image of the human face
EP2450852A1 (en) * 2006-10-24 2012-05-09 Jean-Marc Robin Method and device for virtual simulation of an image
FR2907569A1 (en) * 2006-10-24 2008-04-25 Jean Marc Robin Video image sequence's virtual simulation method for beauty industry, involves modifying features of images of sequence and color of cutaneous structure based on criterions in database and decision criterions of expert system
WO2008050062A1 (en) * 2006-10-24 2008-05-02 Jean-Marc Robin Method and device for the virtual simulation of a sequence of video images
EP1968016A1 (en) 2007-03-08 2008-09-10 Sagem Telecommunications Interactive system for assisting the selection of cosmetic products
FR2920938A1 (en) * 2008-09-30 2009-03-13 Jean Marc Robin Image simulating method for beauty industry, involves deforming parametric models to adapt to contours of features on face, and detecting and analyzing cutaneous structure of areas of face by maximizing gradient flow of brightness
CN104599297A (en) * 2013-10-31 2015-05-06 厦门美图网科技有限公司 Image processing method for automatically blushing human face
CN104599297B (en) * 2013-10-31 2018-07-10 厦门美图网科技有限公司 A kind of image processing method for going up blush automatically to face
CN110767288A (en) * 2018-07-26 2020-02-07 王东 Virtual face contour adjusting method
CN111353931A (en) * 2018-12-24 2020-06-30 黄庆武整形医生集团(深圳)有限公司 Shaping simulation method, shaping simulation system, readable storage medium and device
CN111353931B (en) * 2018-12-24 2023-10-03 黄庆武整形医生集团(深圳)有限公司 Shaping simulation method, system, readable storage medium and apparatus

Also Published As

Publication number Publication date
FR2728982B1 (en) 1997-02-28
FR2728982A1 (en) 1996-07-05
AU4452296A (en) 1996-07-24

Similar Documents

Publication Publication Date Title
CA2678551C (en) Method and apparatus for simulation of facial skin aging and de-aging
FR2907569A1 (en) Video image sequence's virtual simulation method for beauty industry, involves modifying features of images of sequence and color of cutaneous structure based on criterions in database and decision criterions of expert system
WO1996021201A1 (en) Automatic recognition of characteristic features and simulation of an aesthetic image of a real objective such as a face
US6885766B2 (en) Automatic color defect correction
US11416988B2 (en) Apparatus and method for visualizing visually imperceivable cosmetic skin attributes
EP2174296B1 (en) Method and apparatus for realistic simulation of wrinkle aging and de-aging
Jain et al. On detecting GANs and retouching based synthetic alterations
EP2309449B1 (en) Method to produce a full-color smoothed image
FR3014675A1 (en) METHOD FOR EVALUATING AT LEAST ONE CLINICAL FACE SIGN
EP0569291A1 (en) Procedure for the making-up of a face, in particular the eyes and a device for carrying out the same
FR2984721A1 (en) METHOD AND DEVICE FOR DETECTION AND QUANTIFICATION OF SKIN SIGNS ON A SKIN AREA
WO2012001289A1 (en) Method and device for detecting and quantifying skin symptoms on an area of the skin
Park et al. An automatic virtual makeup scheme based on personal color analysis
Rosin et al. Benchmarking non-photorealistic rendering of portraits
FR2915820A1 (en) METHOD FOR EVALUATING A TYPOLOGY OF LIP AND EVALUATION SYSTEM FOR IMPLEMENTING SUCH A METHOD
Varshovi Facial makeup detection using HSV color space and texture analysis
WO2001075796A1 (en) Digital remote data processing system for transforming an image, in particular an image of the human face
Gronenschild et al. The use of faces as stimuli in neuroimaging and psychological experiments: A procedure to standardize stimulus features
CA3181954A1 (en) Smart system for skin testing and customised formulation and manufacturing of cosmetics
FR2783949A1 (en) Remote digital processing of an image, in particular an image of a human face
Lipowezky et al. Automatic freckles detection and retouching
Roshan et al. Truncate Threshold Segmentation of Skin Cancer using Computer Aided Diagnostic Tools
Rajasundaram Efficient Biometric Authentication Technique Using the Gray scale Information’s of Sclera, Iris and Pupil
WO2020049257A1 (en) Improved method for creating a virtual three-dimensional representation of a person's torso
WO2023083583A1 (en) Method and system for characterizing keratinous fibers, in particular human eyelashes

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AU BR CA CN CZ HU JP KR NZ RU US

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase