Classifications

• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T11/00—2D [Two Dimensional] image generation
  • G06T11/001—Texturing; Colouring; Generation of texture or colour
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/20—Analysis of motion
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis

Definitions

• the present invention relates to a method and a device for automatically simulating and processing in real time one or more aesthetic images of a real objective, for example a face and / or a head of a moving character in a scene, by detecting and monitoring its characteristic features.
• the features of the face participate in the act of communication between human beings. Nevertheless, it should be noted that the visualization of the characteristic features of the face is a support for communication only if these features are extracted with sufficient precision. In the opposite case, the information resulting from an analysis that is too brief constitutes more an inconvenience than an aid, particularly for high-level industrial applications for the aesthetic embellishment of a face / head, for example.
• an online user on the Internet from their own PC or Mac can use with a delay of more than 24 hours, and after posting on the Internet their color portrait photograph in JPEG format and under a number of constraints.
• an ASP web server platform (“Application Service Provider") which provides users of a third-party Web site with contour contouring functions, color detection hair, carnation and eyes, which are obtained according to statistical and manual methods performed by the intervention of human technical teams.
• the photograph can also be retouched using different layer techniques.
• each element can be placed on a different layer, the final result being obtained by the superposition of all the layers, which allows to obtain the final retouched photograph for its exploitation.
• the retouched photograph can then be exploited locally in a dedicated Microsoft® X Active Type application.
• This technology and the set of tools developed by Microsoft® make it possible to program components that can make the content of a Web page interact with applications executable on the computer of the Internet user type PC, in particular under a computer system. Windows® operation. Another equivalent technique is to use the Java® application.
• WO 01/75796 discloses a system for virtually transforming a still image, such as a photo of a face.
• the present invention aims to provide a method and an image processing device do not reproduce the disadvantages of the prior art.
• the present invention is intended in particular to provide such a method and device for processing video image sequences, in particular for moving subjects.
• the present invention also aims to provide such a method and device, which is simple, reliable and inexpensive to make and use.
• the present invention therefore relates to a method and a high-performance digital device, allowing in a video stream composed of a succession of images, for example from 25 to 30 images per second, component the illusion of movement, to obtain by computer and in real time, an automatic and precise extraction of the contours of all the characteristic features of the face, the hair, the color of the eyes, the complexion and the hair and taking into account certain occlusions.
• the set leads to an aesthetic and individualized virtual simulation of an initial objective, for example a face / head of a character moving in a scene, in a video stream by a robust and real-time or delayed processing or " play-back Marin This simulation can comprise an encoding then a transformation by a new reading of the sequence.
• the subject of the present invention is therefore an automatic method for virtual simulation of an individualized video image sequence for each user, which can be produced from a real video image sequence of a moving face / head, comprising, for example, an acquisition and initialization phase: the detection and analysis of the shapes and / or contours and / or dynamic components of an image of the face / head of the actual video sequence, the extraction of characteristic points of the face head, such as the corners of the eyes and mouth, using predefined parametric models; during a phase of evolution: the definition of specific parametric models from said extracted characteristic points, serving as initial points of initiation, the deformation of said specific models to adapt to the contours of the features present on the analyzed face, the detection and analysis of cutaneous structure of one or more regions of the face / head; and during a follow-up and transformation phase: the modification of the characteristic features of the other images of the video sequence, the modification of the colors of the cutaneous structure, said modifications being performed according to criteria provided for in at least one database and / or according to decision criteria of at least one expert
• the detection and analysis step for determining region / contour and temporal spatial information, is performed by maximizing the luminance gradient and / or chrominance fluxes.
• said modifications are obtained by translations of the neighborhoods of the characteristic points of the preceding image in the following image, affine models, including a deformation matrix, which can be used when the neighborhood of the characteristic points can also undergo a deformation.
• the tracking phase uses an algorithm to follow characteristic points from one image to another.
• said algorithm uses only the neighborhood of characteristic points.
• the characteristic points are recaled using a simplified version of the active contours, and / or by deforming the curves of a model obtained in the previous image.
• the method comprises a step of modeling the closed and / or open mouth by means of a plurality of characteristic points connected by a plurality of cubic curves.
• the present invention also relates to a device for implementing the method described above, comprising a computer system, a light source, an electronic message management system, at least one database, local or remote on the networks digital, such as the Internet, and / or at least one expert system of order 0+ or 1, for obtaining and transforming a sequence of digital real images into a virtual image sequence, preferably at the speed of 25 frames per second, said virtual image sequence being transformed according to decision criteria of at least one expert system of order 0+ or 1.
• said computer system is based on a microprocessor type CPU ("Central Processing Unit”) mono, dual, quad cores and higher, or conventional multicore processors, types pentium, athlon or higher or type SPU ("Streaming Processor Unit”) , equipped with a main core and up to eight specific cores, arranged in a cabin, a console, a self-service device, a pocket or mobile device, a digital television, a local server, or deported over digital networks, such as the Internet, at least one digital video camera, at least one screen, at least one printer and / or a connection to digital networks, such as the Internet, in wherein the computer system providing the image processing comprises a computer having a hard disk, preferably of a capacity of at least 500K bytes, and / or a digital storage memory, one or more media, such as CD-ROM, DVD, Multimedia Card®, Memory Stick®, MicroDrive®, XD Card®, SmartMedia®, SD Card®, Compact Flash® Type 1 and 2, USB stick, modem or wired or radio
• a printer After displaying the virtual image sequence on a screen, a printer proceeds locally, or remotely, printing, preferably color, of at least one photograph selected from all or part of the sequence of virtual images.
• the image processing module to carry out the steps of acquisition, detection, transformation and monitoring, is integrated in one or more processors specialized in the processing of signals of the DSP ("Digital Signal Processor” or "DSP") type. digital signal processor).
• DSP Digital Signal Processor
• DSP digital signal processor
• the present invention therefore relates to a method and a device for simulating, by automatic processing and in all the environmental conditions and poses of the moving subject, an image or a sequence of aesthetic images in a video stream, starting from a or several images of a real objective, for example a face / head of a moving character in a scene, where one extracts from the image and / or from the sequence of real images, captured preferably by a Color digital video camera, at the real-time rate, the contours of the dynamic components of the face / head of the moving character, to produce relevant parameters to synchronize the tools of virtual aesthetic transformations, for example in the regions of the eyes, eyebrows , mouth and neighborhoods, in multi-criteria function provided in at least one local and / or remote database on digital networks, such as the Internet, and / or according to decision criteria previously defined in the knowledge base of at least one expert system of order 0+ or 1.
• the computer system implemented may be installed in a cabin or console or a self-service device or a pocket or mobile device or a digital television or a local server or remote on digital networks, including the Internet, or any form of possible devices to come.
• the computer may include a computer or a microprocessor for processing type CPU ("Central Processing Unit” or CPU), mono, dual, quad cores and higher or multi core processors classic types pentium, athlon or higher , or SPU type ("Streaming Processor Unit"), equipped with a main core and up to eight or more specific cores, with a hard disk of at least 500K bytes and / or a digital storage memory, one or more media of the CD-ROM, DVD, Multimedia Card®, Memory Stick®, MicroDrive®, XD Card®, SmartMedia®, SD Card®, Compact Flash® types 1 and 2, USB key or other, all types of modems or modules for wired or wireless connections to digital networks, such as the Internet, one or more connection modules for the local environment such as Bluetooth®, infrared, wifi®, wimax® and forthcoming , a color camera fixed video or type CCD and superior digital television, a discrete light source or not, all types of screens, preferably colors, current and future, all types of printers monochrome or current
• CPU
• the vision system defined above can be composed of a discreet daylight or white light-emitting diode, a mono CCD or higher camera, a graphics card, a flat and touch-sensitive color screen. a receipt-type printer or A4 and A3 paper color or higher.
• the assembly can then be fully integrated in a lightweight "panel PC" ultra light whose size is given by the dimensions of all types of flat screen, preferably color.
• the processing is local and all technical updates or content such as maintenance can be done via a wired connection or radio frequency to digital networks including the Internet.
• the system operates by the visual servoing of the device via its camera, automatically leaning on the face of the user by the use of a module for detecting and tracking a face / head of a character. From a position that we say balance, when a simulation is desired by a user, the system will stop when it has detected its purpose, for example the image of a face / head.
• the vision system can automatically adjust the camera's illumination and zoom in order to have an image size and a facial image code on the screen of almost constant optimal quality.
• control system of the process functions can be a terminal, such as an alphanumeric keyboard, a mouse or any other means.
• the camera depending on the terminal, can be connected by all connections or all types of digital networks to an editing system, preferably with the outputs on color screen and / or paper assembled in a single device next to the user.
• the processing and calculation part can be managed by one or more local servers, or deported on digital networks, including the Internet, and equipped with at least one microprocessor, for example 32 or 64 bit CPU ("Central Processing Unit") type. mono, dual, quad-core and higher or multi-core processors classic types pentium, athlon, or type SPU ("Streaming Process Unit") or a main core and eight specific cores type cell, and all types of electronic or magnetic memories.
• CPU Central Processing Unit
• the capture of the color images is advantageously obtained in real time by means of all types of digital video cameras, preferably color, such as a digital color video camera mono or CCD, or a device to load coupling and superior, a complementary color CMOS (metal-oxide semiconductor) video camera, or similar, for example, a webcam, in order to provide, in real time, a valuable aesthetic simulation by high quality detection, components geometric and dynamic facial features and appropriate image processing.
• CMOS metal-oxide semiconductor
• the processing can be done locally or on a remote server and according to the speed of calculation, in real time or assimilated as such, or in playback mode.
• the whole treatment can be done without too many lighting constraints and poses for each character present in the image, considering an uncertain background fixed or mobile, and a number of occlusions.
• the experiments demonstrate that the method implemented according to the present invention remains robust and sufficiently precise during the phase of extraction and evolution of the contours of the permanent features of the face / head namely namely: the eyes, eyebrows, lips, hair and other morphological elements, according to the work of aesthetic transformation sought, etc.
• the method advantageously comprises three synchronized phases: 1.
• An acquisition and initialization phase the shapes and contours of the face / head are analyzed and detected in a digitized video image corresponding to the first image of the image. 'a sequence. Dots characteristics and areas of interest of the face / head are extracted, corners of eyes and mouth for example, and serve as initial anchors for each of the predefined adapted parametric models.
• each model is deformed in order to coincide with the contours of the features present on the analyzed face. This deformation is done by maximizing a luminance gradient flux and / or chrominance along the contours defined by each curve of the model.
• the definition of models makes it possible to naturally introduce a regularization constraint on the contours sought. Nevertheless, the chosen models remain flexible enough to allow a realistic extraction of the contours of the eyes, the eyebrows and the mouth.
• a phase of monitoring and transformation Tracking makes segmentation more robust and faster in subsequent frames of the video clip.
• the transformation leads to the modification of the fine characteristic areas of the face / head followed in the video sequence according to multiple criteria provided for in the database and / or as the case may be according to decision criteria of an expert system of order 0 + or 1.
• a rendering phase offering on a screen and / or paper and / or via a server on all digital networks, the results of the transformation phase for the entire video sequence.
• the video processing system will coordinate several successive operations.
• the detected face / head corresponds to an area of interest in the image.
• the method makes it possible to overcome illumination variations by using a filter adapted to the behavior of the retina, for the region of interest.
• the system then proceeds, for the region of interest thus filtered, to the extraction of the characteristic features of the face, preferably using suitable parametric models, namely the irises, eyes, eyebrows, lips, the contour of the face and the helmet of the hair.
• the initial positioning of each model on the image to be processed takes place after the automatic extraction of characteristic points on the face.
• a maximum luminance gradient point tracking process can be used to detect the corner of the eyes.
• Two Bézier curves one of which is curved towards its end to naturally follow the drawing of the lower contours of the eye, models chosen for the upper and lower contours of the eye, can be initialized by the two corners of the eyes. and the lowest point of the circle detected for the iris for the lower contour, and by the two corners of the eyes and the center of the circle detected for the iris for the upper contour.
• the proposed model for the modeling of the lips is advantageously at least composed of five independent curves, each of them naturally describing part of the outer lip contour and at least two curves for the inner contours.
• the characteristic points of the mouth in order to initialize the model can be analyzed by using a discriminant information combining luminance and chrominance as well as the convergence of an active contour type that makes it possible to overcome the parameters of the parameters of the contour. as well as its high dependence on the initial position.
• the modeling of the contour of the face advantageously uses eight characteristic points situated on this contour. These eight points initialize an outline modeled by deformable ellipse quarters, according to the position of the face in a temporal dimension.
• the hair helmet can be segmented from the detection of the contour of the face by associating the filtering of the background of the image with the use of active contours. Characteristic points located on the contour of the hair are thus detected. Between each of these points, the model used can be a cubic polynomial curve.
• each desired contour is a set of points of maximum luminance gradient.
• the selected curves will preferably be those that maximize the normalized luminance gradient flux across the contour.
• the tracking step allows the segmentation in the following images of the video sequence.
• the results obtained in previous images provide additional information that can make segmentation more robust and faster.
• the precise tracking procedure uses an algorithm that makes it possible to follow characteristic points from one image to another. This differential method, using only the neighborhood of points, brings a significant time saving compared to a direct extraction technique.
• the characteristic points can be recalculated by using a simplified version of the active contours, and / or by deforming the curves of a model obtained in the previous image.
• the transformation step may lead to the modification of the fine characteristic areas of the face / head followed in the video sequence according to multiple criteria provided in the database (s) and / or as the case may be according to decision criteria of at least one expert system of order 0+ or 1.
• the present invention may offer the user different looks, palettes, present in the database for viewing on his face.
• the system can search, from anthropometric ratios calculated by an expert system of order 0+ or 1, the characteristic zones, for example the cheekbones, to transform .
• the expert system can define makeup procedures that are dependent on the shape of the face, round or elongate or square or triangular or oval, and certain features, eyes apart or eyes close together or eyes equal, nose size, etc. These rules can be communicated to the transformation module for a realistic and dependent simulation of each face to transform.
• the method also carries out during this phase a classification of faces such man, woman, child, teenager in particular.
• the rendering phase offers on a screen and / or on paper and / or via a server on all digital networks, the results of the transformation phase for the entire video sequence and / or for part of this sequence
• FIG. 1 is a block diagram of a virtual image simulation system according to an advantageous embodiment of the present invention
• FIG. 2 is a block diagram illustrating the phase of extraction of the faces / heads of characters and the characteristic zones according to an advantageous embodiment of the present invention
• FIG. 3 represents the block diagram of the retinal filtering
• FIG. 4 is a drawing of one of the parametric models adapted to the tracking of moving lips
• FIG. 5 represents the result of the automatic extraction of the characteristic areas of the face from a video sequence presenting a single character with the head moving in front of the camera lens along the axes of orientations X, Y and Z symbolized in this same figure, namely the contour of the face, the iris, the eyes, the mouth, the eyebrows, and the headgear of the hair;
• FIG. 1 represents an example of a detection system and real-time automatic tracking of the characteristic features of a real objective, such as a face / head of a character moving in a scene, with the possibility of virtual simulation of images and comprising an image acquisition and initialization module 1, a tracking and transformation module 2 and a reproduction module 3. Each module will be described in detail below.
• the image acquisition and initialization module 1 is implemented from all types of digital color video cameras, such as a color digital video camera CCD mono or charge coupled device and superior, a video camera complementary color CMOS (metal-oxide-semiconductor), or the like.
• CMOS metal-oxide-semiconductor
• the sequence of images taken by the acquisition module is analyzed in order to detect the zones and characteristic points of the face / head.
• This analysis is implemented in the form of a microprocessor of the 32 or 64-bit CPU type, SPU, or a main core and eight specific cores type cell, mono, double, quad cores and higher or multi core processors classic types pentium, athlon , a personal computer or a digital signal processor.
• the zones and characteristic points of the face / head of the moving character in a scene thus extracted and coupled to the flow of images are sent to the tracking and transformation module which according to the multiple criteria provided in one or more database (s) of data or, depending on the case, according to decision criteria of one or more expert system (s) 21, refers to the rendering module 3 its results: a video sequence with, for example, the masked face.
• the rendering module offers, according to the present invention, the results on any type of screen (cathodic, LCD, plasma or the like) and / or on any paper format and / or via a server on all digital networks, for example the Internet.
• Figure 2 shows a block diagram illustrating the extraction phase of the face / head of the character and characteristic areas according to the present invention.
• the software for processing the video sequence clocked at the acquisition speed of the digital video sensor will coordinate several successive operations according to the invention.
• the software for processing the video sequence clocked at the acquisition speed of the digital video sensor will coordinate several successive operations according to the invention.
• he proceeds to locate the face / head of the character in a scene.
• the typical chrominance information associated with the skin is considered.
• a pretreatment phase 12 of this region of interest makes it possible to overcome illumination variations by using adapted filtering inspired by the behavior of the retina.
• This filtering makes it possible, by performing a succession of filterings and adaptive compressions, to perform a local smoothing of the variations of illumination.
• I 1n be the initial image and Ii the result of its filtering
• the image X 0 makes it possible to define the compression function C by the relation:
• Figure 3 gives the block diagram of the retinal filtering, the output of this filtering is noted I out .
• the luminance variations will be greatly reduced.
• the automatic extraction of the contours of the permanent features of the face namely the contour of the face, whose homogeneity is taken into account, the irises, the eyes, the eyebrows, the lips, the hair helmet, follows in a second time .
• a specific parametric model (cubic polynomial curves, Bezier curves, circle, etc.) capable of accounting for all possible deformations is defined.
• the iris we search for the semicircle that maximizes the normalized luminance gradient flux in each right and left quarter of the rectangle encompassing the face since the contour of the iris is the border between a dark zone, the iris, and a clear area, the white of the eye.
• the method of maximizing the standardized gradient flow has the advantage of being very fast, without parameter adjustment, and it leads unambiguously to the selection of the right semicircle since the standardized gradient flow always has a very marked peak corresponding to the correct position for the desired semi-circle.
• Characteristic points of the face are extracted (corners of the eyes and mouth for example) and serve as initial anchors 13 for each of the other models.
• Bezier curves one of which is curved towards its end, models chosen for the upper and lower contours of the eye, are initialized by the two corners of the eyes, detected by a process of tracking points of maximum luminance gradient, and the lowest point of the circle detected for the iris for the lower contour and the two corners of the eyes and the center of the circle detected for the iris for the upper contour.
• the two inner and outer corners of each eyebrow are advantageously extracted.
• the search area of these points is reduced to the area of the image above the detected iris.
• the abscissae of the inner and outer corners we search the abscissa of the points for which there is a change of sign or cancellation of the derivative of the horizontal projection of the valley image along the lines.
• the two inner and outer corners and the center of its two corners serve as initial control points for the Bezier curve associated with each eyebrow. Since this method is subject to noise, the points thus detected are readjusted during the deformation phase of the model associated with the eyebrows.
• the proposed model for lip modeling can be composed of five independent cubic curves, each of which describes a part of outside lip contour.
• Figure 4 shows a drawing of this model for a closed mouth. Unlike most models proposed in the literature, this original model is sufficiently deformable to faithfully represent the specificities of very different lips. Between Q2 and Q4, Cupid's bow is described by a broken line while the other portions of the outline are described by cubic polynomial curves. In addition, it requires having a zero derivative at point Q2, Q4 and Q6. For example, the cubic between Qi and Q 2 must have a null derivative in Q 2 .
• Extraction of the characteristic points Q 1 , Q 2 , Q 3 , Q 4 , Q 5 , Q 6 from the mouth in order to initialize the model is done by using a discriminant information combining luminance and chrominance as well as the convergence of an active contour type that makes it possible to dispense with the settings of the parameters of the active contour as well as its high dependence on the initial position. The same goes for the internal labial contours where two curves allow to perfectly marry the inner contours.
• Detecting the inner contour is more difficult when the mouth is open, because of non-linear variations in appearance inside the mouth. Indeed, during a conversation, the area between the lips can take different configuration: teeth, oral cavity, gums and tongue.
• the parametric model for the inner contour when the mouth is open, can be composed of four cubic.
• "Cupid's bow inside” is less pronounced than for a closed mouth; thus two cubic is enough to precisely extract the upper inner contour of the lips.
• the model With four cubic, the model is flexible and overcomes the problem of the segmentation of the inner contour for asymmetrical mouths.
• jumping snakes Two active contours called jumping snakes can be used to adjust the model; one for the upper contour and one for the lower contour.
• the convergence of a jumping snake is a succession of phases of growth and jumping.
• the "snake” is initialized from a germ, then it grows adding points to the left and right of the germ. Each new point is found by maximizing a gradient flow through the segment formed by the current point to be added and the previous point. Finally, the seed jumps to a new position closer to the desired outline. The growth and jump processes are repeated until the jump amplitude is below a certain threshold.
• the initialization of the two "snakes” begins with the search for two points on the upper and lower contours, and belonging to the vertical passing through Q 3 in Figure 4.
• the difficulty of the task lies in the fact that there can have different areas between the lips, which may have characteristics (color, texture or luminance) similar or completely different than those of the lips, when the mouth is open.
• the final inner contour can be given by four cubic.
• the two cubes for the upper contour can be calculated by the least squares method.
• the two cubic of the lower contour can also be calculated by the least squares method.
• the modeling of the contour of the face preferably uses eight characteristic points situated on this contour a priori since a face can present very long hair which completely cover the forehead and possibly the eyebrows and the eyes: two points at the level of the eyes, two points at the level of the eyebrows, two points at the mouth, a point at the chin and a point at the forehead, which are extracted from a thresholding in the V plane of the HSV representation of the image. These eight points initialize an outline modeled by quarter ellipses.
• the helmet of the hair can be segmented from the detection of the contour of the face by associating the filtering of the bottom of the image with the use of active contours. Characteristic points located on the contour of the hair are thus detected. Between each of these points, the model used can be a cubic polynomial curve. It is possible that the automatic extraction of one or more points fails, in this case the point or points can be very easily replaced manually to correctly replace the model or models and approach their evolution phase.
• each model is deformed to coincide with the contours of the features present on the analyzed face. This deformation is done by maximizing a luminance gradient flux and / or chrominance, along the contours defined by each curve of the model.
• FIG. 5 represents the result of the automatic extraction of the characteristic zones of the face, namely the contour of the face, the irises, the eyes, the mouth, the eyebrows, and the helmet of the hair, which respectively form anthropometric modules of the face, according to an aspect of the present invention.
• the software tracks the face / head and facial features in the video sequence.
• the results obtained in the previous images provide additional information that can make the segmentation more robust and faster.
• the precise tracking procedure uses an algorithm that makes it possible to follow characteristic points from one image to another.
• This differential method using only the neighborhood of points, brings a significant time saving compared to a direct extraction technique.
• This method is based on the apparent motion stress equation derived from a Taylor development of the equation below:
• the method advantageously uses a registration of the characteristic points by using a simplified version of the active contours and / or by deforming the curves of the model obtained in the image. previous. Finally, the final contours are extracted. For this, the shape of the characteristic zones in the previous image as well as the characteristic points are used to calculate the optimal curves constituting the different models.
• the tools for recognizing and monitoring the anthropometric areas of the face in the image communicate all the data they have extracted during the transformation phase.
• the module will then determine the treatments to be performed. These will be determined by the theme or themes that the user will have chosen. For example, if it is a make-up operation, the characteristic areas of the face, defined according to the extraction results and according to the function chosen by the user (look / palette), are automatically modified in the sequence of consecutive images according to harmonic and personalized choices. For example, for a round face, the process blurs the sides of the face in a darker tone.
• the user can also choose zone by zone (lips, eyes, cheekbones, face, etc.) the color he wishes to apply. These colors will be in harmony with the characteristics of the face.
• the expert system determines a range of available colors, correlated with those of a range available in its database or databases, according to the data from the initialization phase and evolution.
• the tool will be able to make a coloring proposal in harmony with the face for example, but also offer a selection of colors, from a range, in perfect harmony with the face.
• the colors complemented by their original textures are analyzed, calculated and defined in their particular context (lipsticks or glosses or powders in particular).
• the tools will then apply depending on the texture of the area (lip, cheek, hair, etc.) the color corresponding to the makeup, but also in a transparent manner the effect of the cosmetic product, that is to say that it will reproduce its real appearance, for example its brilliance, its powdered or glittery appearance (glittery lipstick in figure 6, especially its matte appearance)
• This operation takes into account the context of the sequence of consecutive images in each of their respective areas (lighting, brightness, shadows, reflections, etc.), which will allow the help of algorithmic tools to calculate their textures, to define them in their real aspect, as they would be reproduced in reality .
• the quality and realistic properties of the consecutive image sequence are substantially improved.
• some features of the face are improved. For example, face wrinkles, crow's feet wrinkles, dark circles, lion wrinkles, nasolabial folds, bitter creases, perioral wrinkles, freckles, acne and rosacea are strongly blurred.
• aesthetic treatments such as face whitening, tanning, teeth whitening, eyelid lifting, thickening of the lips, the light rectification of the oval of the face, the rectification of the shape of the chin and / or the nose, the raising and raising of the cheekbones are simulated automatically for a face appearing in a video sequence.
• the invention also makes it possible to recognize visemes that describe the different configurations, or different pronounced phonemes, of a talking mouth. It thus makes it possible to determine the personality and the character of a person, examined from the morphological observation of his / her face / head, such as, for example, the presence of the folds of bitterness, the size and the spacing of the eyes, the size and shape of the nose, the lobe of the ears, the database corresponding to the observation of the faces being then supplemented by the techniques implemented by the morpho psychologists, the psychiatrists, the profilers and the anatomists in the domain considered.
• RGB or red, green, blue completed indications drawings, thresholds and coordinates constituting the realization of a "Look" or the natural visualization of a lipstick in a palette for example can be made and recorded in the form of a simple file consisting of a low-weight alphanumeric string broadcast on all digital media or download from a server on digital networks such as the Internet.
• This file can be used for the artistic update of the database or the expert system in a flexible and fast way or be used immediately by the user from a simple download from a web page for example.
• the database associated with the expert system is enriched with specific rules relating to the application of the invention, for example cosmetics and / or dermatology, plastic surgery and / or aesthetic medicine, ophthalmology, hairdressers and / or hairdressers, facial biometrics, etc.
• the treatment is independent of the content which allows a use of the process on an industrial scale and a very strong propagation of its use with a strong increase in yield.
• Figure 6 shows the before / after result of a makeup simulation (look), accessories (color lenses, piercing), and hair coloring for an image extracted from a video sequence acquired by a color video camera.
• the rendering module translates, according to the present invention, the display of the sequence of transformed images on any type of color screen and / or then by printing one or more images simulated on n ' any paper format and / or via a server on any digital network.
• the restitution phase results in an aesthetic proposition characterized by the transformation of the initial video sequence into a a new virtual video sequence on which the desired aesthetic modifications appear in perfect harmony.
• a makeup complete with accessories and a hair color and the references and sales prices of the corresponding products in one or more brands.
• a static image chosen by the user from the video sequence can then be edited locally, on a color printer of needles type, inkjet, solid inkjet, laser, or thermal sublimation, in A4 format or any other format available technically.
• the content of its information formulates a beauty prescription, taking the initial image and the transformed image, technical and scientific advice, professional tips, facial features (shape, color, etc.), product photography, personal color palette in harmony with the transformed facial features, a color garment board compared to our colors etc.
• the results can be similarly edited on high definition delocalized printers from an Internet server which will send them to the user's postal address.
• the new image and / or the new video sequence completed or not information can be sent by the email function and using the command "Insert attachment" to one or more correspondents with an email address type email.
• the same is true with a mobile phone device having an MMS mode, email or future.
• this system can receive a large number of applications by completing the expert system (s) and / or the local database (s) or remote (s) by scientific data. and specific techniques.
• the invention can find an application for image processing in two or three dimensions.
• a 3D application we can build a 3D modeling of the face, to precisely apply 3D makeup.
• the 3D reconstruction of the face, from a static image of the face or a flow of images of faces, is made using conventional algorithms and procedures, such as the analysis of shadows, texture , movement, the use of generic 3D models of the face or the use of a stereo scopic system.

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Multimedia (AREA)
• Image Processing (AREA)
• Processing Or Creating Images (AREA)
• Image Analysis (AREA)

Priority Applications (1)

Applications Claiming Priority (2)

Publications (1)

Family

ID=37964796

Family Applications (2)

Family Applications Before (1)

Country Status (8)

Families Citing this family (23)

Family Cites Families (7)

• 2006
  • 2006-10-24 FR FR0654483A patent/FR2907569B1/fr not_active Expired - Fee Related
• 2007
  • 2007-10-23 EP EP11007429A patent/EP2450852A1/de not_active Withdrawn
  • 2007-10-23 CA CA002667526A patent/CA2667526A1/fr not_active Abandoned
  • 2007-10-23 BR BRPI0718306-2A2A patent/BRPI0718306A2/pt not_active IP Right Cessation
  • 2007-10-23 WO PCT/FR2007/052234 patent/WO2008050062A1/fr active Search and Examination
  • 2007-10-23 US US12/447,197 patent/US20100189357A1/en not_active Abandoned
  • 2007-10-23 EP EP07858653A patent/EP2076886A1/de not_active Withdrawn
  • 2007-10-23 KR KR1020097010541A patent/KR20090098798A/ko not_active Application Discontinuation
  • 2007-10-23 JP JP2009533912A patent/JP2010507854A/ja active Pending

Non-Patent Citations (6)

Also Published As

Similar Documents

Legal Events