WO2018201662A1

WO2018201662A1 - Lip color rendering method, apparatus, and electronic device

Info

Publication number: WO2018201662A1
Application number: PCT/CN2017/104367
Authority: WO
Inventors: 张硕
Original assignee: 广州视源电子科技股份有限公司; 广州睿鑫电子科技有限公司
Priority date: 2017-05-05
Filing date: 2017-09-29
Publication date: 2018-11-08
Also published as: CN107229905A; CN107229905B

Abstract

Provided is a lip color rendering method, apparatus, and electronic device. The method comprises: performing recognition on an image to determine a lip rendering area (S110); coloring the lip rendering area according to color number information to generate a colored lip image layer (S120); extracting from the image an initial lip image layer corresponding to the lip rendering area, adjusting color gradation after the initial lip image layer is converted to grayscale to obtain a highlighted lip image layer, and brightening and mixing the highlighted lip image layer and an image layer in which the image is located to obtain a brightened mixed image layer (S130); and superimposing and mixing the brightened mixed image layer and the colored lip image layer according to a preset algorithm to obtain a lip color-rendered image (S140). The generated image can not only express textures in the lip, but also simulate gloss when lipstick is applied in a real scenario, providing the experience of a real color test without having to apply lipstick.

Description

Method, device and electronic device for rendering color of lips

Technical field

The present application relates to the field of image processing technologies, and in particular, to a method, an apparatus, and an electronic device for rendering colors of a lip.

Background technique

Choosing the color number of the lipstick is an important part of the purchase of lipstick. Generally, the color is selected by color test. The commonly used color test method is to apply lipstick on the hand or the lips. The method of coloring on the hand is simple, but it cannot accurately determine the effect of lipstick on the lips; the way of applying it on the lips is related to hygiene, etc., which is usually used by the shopping guide to paint the customer. The whole process is cumbersome and requires one-on-one service. Either way, you need lipstick to test, so you usually need to go to the physical counter for color test, and you need to remove the lipstick after the test. It can be seen that the traditional color test method is inconvenient.

The color replacement of the lips of the image makes the lip look like a flat color, which does not show the state when the person actually applies the lipstick, and the color test effect is not good.

Summary of the invention

In view of this, the present application provides a method, device, and electronic device for rendering colors of a lip.

Specifically, the present application is implemented by the following technical solutions:

A method of rendering a color of a lip, comprising the following steps:

Identifying the image to determine the lip rendering area;

Coloring the lip rendering area according to the color number information to generate a colored lip layer;

Extract the initial lip layer corresponding to the lip rendering area from the image, adjust the color gradation after the initial lip layer is grayed out to obtain a highlight lip layer, and brighten and blend the highlight lip layer with the image layer to obtain a brightening blend. Layer

According to the preset algorithm, the brightened mixed layer is superimposed and blended with the colored lip layer to obtain an effect diagram after the lip renders the color.

In one embodiment, the step of superimposing the brightened mixed layer and the colored lip layer according to a preset algorithm to obtain an effect map after the lip renders the color includes:

Obtaining shallow pixel position information that the pixel value of the colored lip layer is smaller than a preset threshold, and the pixel value corresponding to the shallow pixel position in the mixed layer is brightened as the first pixel;

Pixeling a pixel value greater than or equal to a preset threshold in the colored layer with a corresponding pixel value in the highlight lip layer according to a preset algorithm to obtain a second pixel;

Rendering the first pixel and the second pixel onto the image to obtain an effect map.

In one embodiment, the step of coloring the lip rendering area according to the color number information to generate a colored lip layer comprises:

The pixel value of each pixel of the lip rendering area is multiplied by the pixel value in the color number information to obtain a colored lip layer.

In one embodiment, the step of identifying the image to determine the lip rendering area comprises:

Performing face detection on the image to recognize the face image, and extracting the lip feature points from the face image;

Triangulating the lip feature points to obtain the lip contour area;

The lip contour area is white, and the lip outline area is black, and the lip contour area is blurred to generate a lip rendering area.

In one embodiment, the step of triangulating the lip feature points to obtain the lip contour region comprises:

Whether the lips are in an open state according to the distribution state of the inner circle points in the feature points of the lips;

When the lips are not in the open state, the outer circle points in the lip feature points are triangulated to obtain the lip contour area;

When the lips are in the open state, the outer circle points and the inner circle points are combined to triangulate to obtain the lip contour area.

The application also discloses a device for rendering a color of a lip, comprising:

a region module for identifying an image to determine a lip rendering area;

a rendering module, configured to generate a colored lip layer by coloring the lip rendering area according to the color number information; and

Extract the initial lip layer corresponding to the lip rendering area from the image, adjust the color gradation after the initial lip layer is grayed out to obtain a highlight lip layer, and brighten and blend the highlight lip layer with the image layer to obtain a brightening blend. Layer; and

In one embodiment, the rendering module includes:

a color picking unit, configured to obtain shallow pixel position information that the pixel value of the colored lip layer is less than a preset threshold, and to change a pixel value corresponding to the shallow pixel position in the mixed layer as the first pixel;

a color mixing unit, configured to superimpose a pixel value greater than or equal to a preset threshold in the coloring layer and a corresponding pixel value in the highlight lip layer according to a preset algorithm to obtain a second pixel;

a rendering unit, configured to render the first pixel and the second pixel onto the image to obtain an effect diagram.

In one embodiment, the rendering module is further configured to multiply a pixel value of each pixel of the lip rendering area by a pixel value in the color number information to obtain a colored lip layer.

In one embodiment, the area module includes:

a point taking unit for performing face detection on the image to recognize the face image, and extracting the lip feature point from the face image;

a region unit for triangulating the lip feature points to obtain a lip contour region;

The blur unit is configured to white the lip contour area and black outside the lip contour area, and blur the lip contour area to generate a lip rendering area;

The area unit is further configured to determine whether the lips are in an open state according to a distribution state of the inner circle points in the feature points of the lips; and

The application also discloses an electronic device, including:

processor;

a memory for storing processor executable instructions;

Wherein the processor is configured to:

Identifying the image to determine the lip rendering area;

Extract the initial lip layer corresponding to the lip rendering area from the image, and adjust the color gradation after the initial lip layer is grayed out. To the high-gloss lip layer, brighten the highlight lip layer and the layer where the image is located to obtain a brightened mixed layer;

The invention performs color rendering on the lip region in the image according to the color number signal, adjusts the color gradation after the initial lip layer is grayed out to obtain a highlight lip layer, and brightens and blends the highlight layer with the layer where the image is located to obtain a change. Brightly blend the layer to simulate the partial highlighting effect after applying the lipstick. According to the preset algorithm, the brightened mixed layer and the colored lip layer are superimposed and mixed to obtain the effect diagram of the lip rendered color, and the generated effect diagram is not only It can reveal the texture in the lips, and it can also simulate the luster that people have after applying lipstick in real scenes. You can experience the true color test without applying lipstick.

DRAWINGS

1 is a flow chart showing a method for rendering a color of a lip according to an exemplary embodiment of the present application;

2 is a detailed flowchart of identifying an image of a lip rendering area according to an exemplary embodiment of the present application;

3 is a schematic diagram of extracting feature points from a face image;

Figure 4a is a schematic view of the triangulation of feature points when the lips are in an open state;

Figure 4b is a schematic view of the triangulation of feature points when the lips are in a closed state;

Figure 4c is an effect diagram of the lip rendering area of the present application;

Figure 4d is an effect diagram of the colored lip layer generated by the present application;

FIG. 5 is a detailed flowchart showing superimposing and mixing a brightened mixed layer and a colored lip layer according to an exemplary embodiment of the present application; FIG.

6 is a flow chart showing a refinement of a lip contour region by triangulating a lip feature point according to an exemplary embodiment of the present application;

FIG. 7 is a logic block diagram of an apparatus for rendering a color of a lip according to an exemplary embodiment of the present application; FIG.

FIG. 8 is a detailed logic block diagram of a rendering module according to an exemplary embodiment of the present application; FIG.

9 is a detailed logic block diagram of a region module shown in an exemplary embodiment of the present application;

FIG. 10 is a diagram showing an effect of an electronic device according to an exemplary embodiment of the present application.

detailed description

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. The following description refers to the same or similar elements in the different figures unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are merely examples of devices and methods consistent with aspects of the present application as detailed in the appended claims.

The terminology used in the present application is for the purpose of describing particular embodiments, and is not intended to be limiting. The singular forms "a", "the" and "the" It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used to describe various information in this application, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, the first information may also be referred to as the second information without departing from the scope of the present application. Similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "when" or "in response to a determination."

1 is a flow chart of a method for rendering a color of a lip according to an exemplary embodiment of the present application; as shown in FIG. 1, the method may include steps S110 to S140:

Step S110: Identifying an image to determine a lip rendering area;

When the image is received, the image may be subjected to face detection to determine whether there is a face in the image and the face position is located, and then the lip is recognized from the face, and the area where the lips are located is used as the lip rendering area; The neural network, the color recognition, the region segmentation, the key point detection and the like are used to identify the face and lips from the image. The manner of determining the lip rendering area provided by an embodiment of the present application is as shown in FIG. 2, and the image is identified. The steps to determine the lip rendering area include:

Step S211: performing face detection on the image to identify the face image, and extracting the lip feature point from the face image;

Step S212: Triangulating the lip feature points to obtain a lip contour area;

In step S213, the lip contour area is white and the lip contour area is black, and the lip contour area is blurred to generate a lip rendering area.

The feature points corresponding to the human face are as shown in FIG. 3. Since the present application only performs rendering processing on the lip portion, only the feature points in the frame 302 corresponding to the human face lip 301 can be extracted, and the number of the feature points can be any number of , the application of the feature The number of points is not limited. For convenience of description, 20 feature points are taken as an example. As shown in FIG. 4a, there are 12 outer ring points and eight inner circle points, and outer ring points can be sequentially connected to form a large polygon. The inner circle points are sequentially connected to form a small polygon, and the two polygons are nested, and the polygon circle between the large polygon and the small polygon is the lip contour region; for the convenience of program description, the feature points of the outer circle point and/or the inner circle point of the embodiment are composed. The triangle represents the lip contour area. As can be seen from Fig. 4a and Fig. 4b, the edge of the lip contour area drawn by the feature point line is sharp, there is no real lip shape smoothness, and the color of the lip (lipstick) and the skin is a gradual transition at the junction, in order to be able to More closely related to the shape and color effect of the real lips, an embodiment of the present application smoothes and/or blurs the edge of the lip contour region, and the lip contour region is white and the lip contour region is black, and the lip contour region is performed. Blurring processing generates a lip rendering area as shown in Figure 4c. There are various methods for the fuzzy processing, for example, a Gaussian operator, a Laplacian Gaussian operator, etc., taking a Gaussian operator as an example in the embodiment of the present application, and a total of 9 pixels of the A pixel and each of the left and right pixels. For a group, the Gaussian operator weighting operation (horizontal operation) is performed on the RGB values of the 9 pixels, and the RGB value of the A pixel is obtained, and then the A pixel and the upper and lower 4 pixels are 9 pixels in total. The Gaussian operator weighting operation (vertical operation) is performed on the RGB values of the nine pixels, and the RGB values of the A pixels are obtained. The pixels at the edge of the lip contour area are used as A pixels. The GPU (Graphics Processing Unit) performs the above operations at the same time, and the processing speed is fast. Of course, in order to enhance the effect, the above operation can be repeated (one horizontal operation + one time) The vertical operation is one operation). Thus, the lip rendering area transitions from the middle to the edge with a gradient color. When the lip rendering area is colored, the effect of the real lipstick can be more naturally applied, so that the initial lip layer extracted from the image of the lip rendering area can be closer to the real one. Lips.

Step S120: Coloring the lip rendering area according to the color number information to generate a colored lip layer;

The color number information includes the name of the color, the corresponding RGB value, etc. The color number information may be generated according to the user's instruction, or may be automatically generated by the system according to historical data, user skin color, etc., of course, different manufacturers have the same name color. The RGB values used for lipsticks may also be different. For example, the color of the coral color of different brands may have different RGB values. Therefore, the name of the color may include information such as brand and color number to facilitate user use. The name of the center color corresponds to the RGB value to color the lip rendering area according to the RGB value to generate a colored lip layer, as shown in Figure 4d. There are a plurality of ways of coloring the lip rendering area, which may be processed one by one pixel or may be processed by the area. In order to improve the speed of coloring, the lip rendering area is colored according to the color number information according to an embodiment of the present application. The steps to color the lip layer include:

For example, select the coral color to color the lip rendering area, that is, mix the RGB value of the coral color with the RGB value of the lip rendering area. For example, the black RGB values are 0, 0, 0, respectively, and the white RGB values are 255, 255, respectively. 255, the RGB values of the coral color are 255, 127, and 80 respectively. Since the values of R, G, and B are in the range of 0-255, for the convenience of calculation, Convert RGB values into numbers between 0-1. For example, black RGB values are 0, 0, 0, white RGB values are 1, 1, 1, and coral RGB values are 1, 0.498, 0.314, respectively. When mixing, multiply the RGB value of the pixel by the RGB value of the coral color. For example, the RGB values after the coral color on the white are 1, 0.498, and 0.314, respectively, and the RGB value after the coral color on the black is 0. 0, 0, the overall rendering of the area can greatly improve the coloring speed.

Step S130: extract an initial lip layer corresponding to the lip rendering area from the image, adjust the color gradation to obtain a highlight lip layer after graying the initial lip layer, and brighten and mix the highlight lip layer with the image layer. Brighten the mixed layer;

The human lips have a reflection (reflection) on the light. When a lipstick, lip oil, etc. is applied to the lips to form a glaze, the reflection (highlight) is more obvious. Only the color of the lip rendering area in the image cannot reach the highlight. In this regard, the present application proposes a scheme for adding highlights to the lips. Of course, an automatic matching highlight or the like may be adopted. In order to enhance the realism of highlights, an embodiment of the present application generates highlights by enhancing the original reflective effect of the lips; The initial lip layer corresponding to the lip rendering area is extracted, and the initial lip layer is grayed out and the color gradation is adjusted to obtain a highlight lip layer. The gray level used in this embodiment refers to making the pixel R value=G value=B value. The gradation can be performed according to the R value, the G value, or the B value, or the RGB whole can be grayed out according to a certain ratio. This application does not limit this, and the gradation (including gamma correction) is adjusted after the gradation. Enhance the contrast between light and dark, for example, map the RGB values of the grayscale pixels to the interval of 50-150, and then restore to 0-255, so that the pixels with the original RGB values in the range of 0-50 eventually become 0, the original RGB Value is at 150- The pixels in the range of 255 eventually become 255, and the pixels with RGB values of 50-150 also enhance the contrast between light and dark, making dark pixels darker and brighter pixels brighter, thus forming a highlight effect. For example, if the gradation is adjusted by grading the four pixels in the initial lip layer, if the RGB values are (40, 40, 70), (70, 40, 70), (140, 70, 140), ( 200, 140, 200), according to (0.3, 0.59, 0.11), the RGB values are (43, 43, 43), (52, 52, 52), (99, 99, 99), ( 165, 165, 165), mapping the above RGB values to the interval of 50-150 and combining gamma correction: (43-50) ÷ (150-50) = -0.07 (takes 0 when less than 0), (52-50) ÷(150-50)=0.02,(99-50)÷(150-50)=0.49,(165-50)÷(150-50)=1.15 (take 1 when greater than 1), the calculation result is (0, 0,0), (0.02,0.02,0.02), (0.49,0.49,0.49), (1,1,1); restored to 0-255:0→0, 0.02→5, 0.49→125,1→255 , that is, the RGB values after adjusting the color gradation are (0, 0, 0), (5, 5, 5), (125, 125, 125), (255, 255, 255). Brighten the highlight lip layer and the layer where the image is located to create a brightened blend layer that adds highlight to the original lip layer.

Step S140: superimposing and blending the brightened mixed layer and the colored lip layer according to a preset algorithm to obtain an effect diagram after the lip renders the color.

After actually applying lipstick, you can still see the texture on the lips. The lipstick effect also has a certain relationship with the lip color. To this end, Ben Applying a preset algorithm to superimpose and blend the brightened mixed layer with the colored lip layer, so that the gloss and texture that should be seen after the actual application of the lipstick can be seen in the effect picture.

There are various ways to superimpose and blend the brightened mixed layer and the colored lip layer according to a preset algorithm, for example, a preset algorithm as shown in the formula (1).

Where a represents the RGB value of the pixel in the colored lip layer and b represents the RGB value of the pixel in the brightened mixed layer. However, as can be seen from Fig. 4d, in the colored lip layer, except for the lip portion, the other regions are black, and the black RGB values are 0, 0, and 0, respectively, and the white RGB values are 255, 255, and 255, respectively (using the formula ( 1) The calculation is performed by converting the RGB value into a number between 0-1, and the R value, the G value, and the B value are calculated independently. Obviously, superimposing and mixing using the formula (1) will make the pixels in the image outside the lip area. The value is also changed. In this regard, as shown in FIG. 5, the step of superimposing the brightened mixed layer and the colored lip layer according to a preset algorithm according to a preset algorithm to obtain a rendering result after the lip is rendered. include:

Step S541: acquiring shallow pixel position information whose pixel value of the colored lip layer is smaller than a preset threshold, and changing a pixel value corresponding to the shallow pixel position in the mixed layer as the first pixel;

Step S542: superimposing the pixel values in the coloring layer that are greater than or equal to the preset threshold and the corresponding pixel values in the highlight lip layer according to a preset algorithm to obtain a second pixel;

Step S543: Rendering the first pixel and the second pixel onto the image to obtain an effect map.

The above steps S541 and S542 can be understood as a preset algorithm as shown in the formula (2).

Where a represents the RGB value of the pixel in the colored lip layer and b represents the RGB value of the pixel in the brightened mixed layer. The default value in the formula (2) is a preset threshold value that is compared with the pixel value of the colored lip layer. The preset threshold value can be arbitrarily set, for example, 0.5 or 0.8, which is not limited in this application. Other types of mixing formulas can also be used in equation (2). Since the black RGB values are 0, 0, and 0, respectively, it is obvious that the black area except the lip portion in Fig. 4d will display the area in the brightened mixed layer. Of course, other areas other than the lip portion may be used in other ways. Skin or add makeup effect; the lip part is calculated according to formula (2), in which part of the pixel value is the pixel value of the corresponding position in the brightened mixed layer, and part of the pixel value is the pixel in the colored lip layer and the brightened mixed layer The result of the mixing, and thus, the final effect diagram can show the lipstick effect, the gloss and texture that should be present after the actual application of lipstick.

Further, since the human lips have open and closed states, the present application proposes different processing manners for different states. As shown in FIG. 6, the step of triangulating the lip feature points to obtain the lip contour region includes :

Step S611: determining whether the lips are in an open state according to the distribution state of the inner circle points in the feature points of the lips;

Step S612: when the lips are not in the open state, triangulating the outer circle points in the lip feature points to obtain a lip contour region;

Step S613: When the lips are in the open state, triangulation is performed in a combination of the outer circle points and the inner circle points to obtain a lip contour region.

There are various ways to determine whether the lips are in an open state. For example, by comparing the pixel RGB values to distinguish lips, teeth, etc. to determine whether the lips are in an open state, the current calculation method of the judgment method is complicated, and the present application proposes The positional relationship of each feature point of the circle determines whether the lip is in an open state, and when the lip is in an open state or a closed state, the variation of the feature point spacing of the inner ring is more obvious, as shown in FIG. 4a and FIG. 4b, according to the feature point 414. The distribution states of 415, 416, 418, 419, and 420 determine whether the lips are in an open state, for example, calculating a first average of the ordinates of the feature points 414, 415, and 416, and the ordinates of the feature points 418, 419, and 420 a second average value, comparing whether the difference between the first average value and the second average value is less than a preset threshold (for example, 2 pixels, 5 pixels, etc.); of course, feature points 414 and 420, 415 and 419 may also be calculated separately, Whether the difference between the 416 and the 418 ordinate is less than a preset threshold, and greater than the preset threshold can determine that the lips are in an open state (as shown in FIG. 4a), otherwise the lips can be judged to be in a closed state (as shown in FIG. 4b). Shown). Further, different triangulation treatments may be adopted for the lips to be in an open state or a closed state. As shown in FIG. 4a, when the lips are in an open state, the outer circle points and the inner circle points are combined to obtain a lip contour. The region, for example, consists of a triangle with

feature points

401, 402, 413, and then the next triangle with 402, 413, 414, which in turn loops to all feature points, the triangles form a closed region and do not overlap, resulting in a lip contour region. If the combination of the circle point and the inner circle point is triangulated in the closed state of the lips, the triangles in which the partial regions overlap may occur due to the interlaced position of the inner circle points, and the overlapping of the lip contour regions by the triangle region will result in overlapping portions. Repeat the coloring and darken the color. To this end, as shown in FIG. 4b, when the lips are not in the open state, the outer circle points in the lip feature points are triangulated to obtain the lip contour regions, for example, the feature points 401, 402, 412 form a triangle, and then The next triangle is composed of 402, 412, and 403, and sequentially loops to all the outer circle points, and the triangles form a closed area and do not overlap to obtain a lip contour area. Therefore, by the above-described discrimination processing of the closed state of the lips, not only the efficiency of acquiring the lip contour region but also the coloring effect can be ensured.

Corresponding to an embodiment of the aforementioned method of rendering a color of a lip, the present application also provides an embodiment of a device for rendering a color of a lip.

Please refer to FIG. 7. FIG. 7 is a logic block diagram of an apparatus 700 for rendering colors of a lip according to an exemplary embodiment of the present application. As shown in FIG. 7, the device 700 for rendering colors of a lip may include a region module 710 and a rendering module. 720:

The area module 710 is configured to identify an image to determine a lip rendering area;

a rendering module 720, configured to generate a colored lip layer by coloring the lip rendering area according to the color number information; and

As shown in FIG. 8, the rendering module 720 includes:

The color picking unit 721 is configured to obtain shallow pixel position information that the pixel value of the colored lip layer is smaller than a preset threshold, and the pixel value corresponding to the shallow pixel position in the brightened mixed layer is used as the first pixel;

a color mixing unit 722, configured to superimpose a pixel value greater than or equal to a preset threshold in the colored layer with a corresponding pixel value in the highlight lip layer according to a preset algorithm to obtain a second pixel;

The rendering unit 723 is configured to render the first pixel and the second pixel onto the image to obtain an effect map.

Further, the rendering module 720 is further configured to multiply pixel values of each pixel of the lip rendering area by pixel values in the color number information to obtain a colored lip layer.

As shown in FIG. 9, the area module 710 includes:

The pointing unit 711 is configured to perform face detection on the image to identify the face image, and extract the lip feature point from the face image;

a region unit 712, configured to triangulate the lip feature points to obtain a lip contour region;

The blurring unit 713 is configured to black out the lip contour area and black out the lip contour area to blur the lip contour area to generate a lip rendering area;

The area unit 712 is further configured to determine whether the lips are in an open state according to a distribution state of the inner circle points in the lip feature points; and

When the lips are in the open state, the outer circle points and the inner circle points are combined to triangulate to obtain the lip contour. region.

Corresponding to the foregoing embodiment of the method for rendering a color of a lip, the present application further provides an electronic device, including:

processor;

a memory for storing processor executable instructions;

Wherein the processor is configured to:

Identifying the image to determine the lip rendering area;

The electronic device of the present application may be an electronic device 100 installed with a lip rendering color function application software, and the color of the lips in the image may be rendered by installing the application software in the electronic device 100, and the image may be acquired by the camera 101. It may also be an image stored in the electronic device 100 or acquired by other means.

The implementation process of the function and the function of each unit in the foregoing device is specifically described in the implementation process of the corresponding steps in the foregoing method, and details are not described herein again.

For the device embodiment, since it basically corresponds to the method embodiment, reference may be made to the partial description of the method embodiment. The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the objectives of the present application. Those of ordinary skill in the art can understand and implement without any creative effort.

The above is only the preferred embodiment of the present application, and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc., which are made within the spirit and principles of the present application, should be included in the present application. Within the scope of protection.

Claims

A method for rendering a color of a lip, comprising the steps of:

Identifying the image to determine the lip rendering area;

Coloring the lip rendering area according to the color number information to generate a colored lip layer;

Extract the initial lip layer corresponding to the lip rendering area from the image, adjust the color gradation after the initial lip layer is grayed out to obtain a highlight lip layer, and brighten and blend the highlight lip layer with the image layer to obtain a brightening blend. Layer

According to the preset algorithm, the brightened mixed layer is superimposed and blended with the colored lip layer to obtain an effect diagram after the lip renders the color.
The method for rendering a color of a lip according to claim 1, wherein the step of superimposing the brightened mixed layer and the colored lip layer according to a preset algorithm to obtain an effect map after the lip is rendered by the lip comprises:

Obtaining shallow pixel position information that the pixel value of the colored lip layer is smaller than a preset threshold, and the pixel value corresponding to the shallow pixel position in the mixed layer is brightened as the first pixel;

Pixeling a pixel value greater than or equal to a preset threshold in the colored layer with a corresponding pixel value in the highlight lip layer according to a preset algorithm to obtain a second pixel;

Rendering the first pixel and the second pixel onto the image to obtain an effect map.
The method for rendering a color of a lip according to claim 1, wherein the step of coloring the lip rendering region according to the color number information to generate a colored lip layer comprises:

The pixel value of each pixel of the lip rendering area is multiplied by the pixel value in the color number information to obtain a colored lip layer.
The method for rendering a color of a lip according to any one of claims 1 to 3, wherein the step of identifying the image to determine a lip rendering area comprises:

Performing face detection on the image to recognize the face image, and extracting the lip feature points from the face image;

Triangulating the lip feature points to obtain the lip contour area;

The lip contour area is white, and the lip outline area is black, and the lip contour area is blurred to generate a lip rendering area.
The method for rendering a color of a lip according to claim 4, wherein the step of triangulating the lip feature point to obtain a lip contour region comprises:

Whether the lips are in an open state according to the distribution state of the inner circle points in the feature points of the lips;

When the lips are not in the open state, the outer circle points in the lip feature points are triangulated to obtain the lip contour area;

When the lips are in the open state, the outer circle points and the inner circle points are combined to triangulate to obtain the lip contour area.
A device for rendering a color of a lip, comprising:

a region module for identifying an image to determine a lip rendering area;

a rendering module, configured to generate a colored lip layer by coloring the lip rendering area according to the color number information; and

Extract the initial lip layer corresponding to the lip rendering area from the image, adjust the color gradation after the initial lip layer is grayed out to obtain a highlight lip layer, and brighten and blend the highlight lip layer with the image layer to obtain a brightening blend. Layer; and

According to the preset algorithm, the brightened mixed layer is superimposed and blended with the colored lip layer to obtain an effect diagram after the lip renders the color.
The apparatus for rendering a color of a lip according to claim 6, wherein the rendering module comprises:

a color picking unit, configured to obtain shallow pixel position information that the pixel value of the colored lip layer is less than a preset threshold, and to change a pixel value corresponding to the shallow pixel position in the mixed layer as the first pixel;

a color mixing unit, configured to superimpose a pixel value greater than or equal to a preset threshold in the coloring layer and a corresponding pixel value in the highlight lip layer according to a preset algorithm to obtain a second pixel;

a rendering unit, configured to render the first pixel and the second pixel onto the image to obtain an effect diagram.
The apparatus for rendering a color of a lip according to claim 6, wherein the rendering module is further configured to multiply a pixel value of each pixel of the lip rendering area by a pixel value in the color number information to obtain a colored lip layer.
The apparatus for rendering a color of a lip according to any one of claims 6 to 8, wherein the area module comprises:

a point taking unit for performing face detection on the image to recognize the face image, and extracting the lip feature point from the face image;

a region unit for triangulating the lip feature points to obtain a lip contour region;

The blur unit is configured to white the lip contour area and black outside the lip contour area, and blur the lip contour area to generate a lip rendering area;

The area unit is further configured to determine whether the lips are in an open state according to a distribution state of the inner circle points in the feature points of the lips; and

When the lips are not in the open state, the outer circle points in the lip feature points are triangulated to obtain the lip contour area;

When the lips are in the open state, the outer circle points and the inner circle points are combined to triangulate to obtain the lip contour area.
An electronic device, comprising:

processor;

a memory for storing processor executable instructions;

Wherein the processor is configured to:

Identifying the image to determine the lip rendering area;

Coloring the lip rendering area according to the color number information to generate a colored lip layer;

Extract the initial lip layer corresponding to the lip rendering area from the image, adjust the color gradation after the initial lip layer is grayed out to obtain a highlight lip layer, and brighten and blend the highlight lip layer with the image layer to obtain a brightening blend. Layer

According to the preset algorithm, the brightened mixed layer is superimposed and blended with the colored lip layer to obtain an effect diagram after the lip renders the color.