WO2023045946A1

WO2023045946A1 - Image processing method and apparatus, electronic device, and storage medium

Info

Publication number: WO2023045946A1
Application number: PCT/CN2022/120104
Authority: WO
Inventors: 苏柳; 孙仁辉
Original assignee: 上海商汤智能科技有限公司
Priority date: 2021-09-27
Filing date: 2022-09-21
Publication date: 2023-03-30
Also published as: CN113763287A

Abstract

An image processing method and apparatus, an electronic device, and a storage medium. The method comprises: receiving a beautification operation for a user image, and determining a target part to be beautified in the user image (S11); determining a reference brightness of the target part according to the brightness of a central position of the target part (S12); increasing the brightness of a pixel point in the target part according to the reference brightness to obtain a target brightness of the pixel point in the target part (S13); and according to a beautification material inputted in the beautification operation and the target brightness, generating a target user image after beautification of the target part (S14).

Description

Image Processing

Cross References to Related Applications

This application claims priority to a Chinese patent application with application number CN2021111377232 filed with the China Patent Office on September 27, 2021, the entire contents of which are incorporated in this disclosure by reference.

technical field

This disclosure relates to the field of computer vision, and more particularly to image processing.

Background technique

With the development of computer vision technology, operations such as eyebrow shape or color rendering on the eyebrows in the image have been more and more widely used in the field of image processing.

Contents of the invention

The present disclosure proposes an image processing scheme.

According to the first aspect of the present disclosure, an image processing method is provided, including: receiving a beautification operation for a user image, determining a target part to be beautified in the user image; according to the brightness of the center position of the target part, Determine the reference brightness of the target part; according to the reference brightness, increase the brightness of the pixels in the target part to obtain the target brightness of the pixels in the target part; according to the beautification material input in the beautification operation and the The target brightness is used to generate a target user image after beautifying the target part.

According to a second aspect of the present disclosure, an image processing device is provided, including: a receiving module, configured to receive a beautification operation on a user image, and determine a target part to be beautified in the user image; a brightness determination module, configured to Determine the reference brightness of the target part according to the brightness of the central position of the target part; the brightness enhancement module is configured to increase the brightness of the pixels in the target part according to the reference brightness, and obtain the pixels in the target part The target brightness of the point; a beautification module, configured to generate a target user image after beautifying the target part according to the beautification material input in the beautification operation and the target brightness.

According to a third aspect of the present disclosure, there is provided an electronic device, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to: execute the above image processing method.

According to a fourth aspect of the present disclosure, there is provided a computer-readable storage medium on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the above image processing method is implemented.

In the embodiment of the present disclosure, by receiving the beautification operation on the user image and determining the target part to be beautified in the user image, the reference brightness is determined according to the brightness of the center position of the target part, and then the pixels in the target part are raised according to the reference brightness brightness to obtain the target brightness, and based on the beautification material and the target brightness input in the beautification operation, a target user image after beautification of the target part is generated. Through the above process, the target part in the user image can be lightened by increasing the brightness, reducing the influence of the original color of the target part on the beautification process, and improving the beautification effect of the target user image.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the accompanying drawings.

Description of drawings

The accompanying drawings here are incorporated into the description and constitute a part of the present description. These drawings show embodiments consistent with the present disclosure, and are used together with the description to explain the technical solution of the present disclosure.

Fig. 1 shows a flowchart of an image processing method according to an embodiment of the present disclosure.

FIG. 2 shows an image of a beautification material according to an embodiment of the present disclosure.

FIG. 3 shows an image of a beautification material according to another embodiment of the present disclosure.

FIG. 4 shows a schematic diagram of a target site mask according to an embodiment of the disclosure.

Fig. 5 shows a schematic diagram of a preset face image according to an embodiment of the present disclosure.

Fig. 6 shows a schematic diagram of a user image according to an embodiment of the present disclosure.

Fig. 7 shows a schematic diagram of an intermediate user image according to an embodiment of the present disclosure.

Fig. 8 shows a schematic diagram of a user image according to another embodiment of the present disclosure.

Fig. 9 shows a schematic diagram of an intermediate user image according to another embodiment of the present disclosure.

Fig. 10 shows a schematic diagram of a target user image according to an embodiment of the present disclosure.

Fig. 11 shows a schematic diagram of a target user image according to another embodiment of the present disclosure.

Fig. 12 shows a schematic diagram of a target user image according to yet another embodiment of the present disclosure.

Fig. 13 shows a schematic diagram of a target user image according to yet another embodiment of the present disclosure.

FIG. 14 shows a block diagram of an image processing device according to an embodiment of the present disclosure.

Fig. 15 shows a block diagram of an electronic device according to an embodiment of the present disclosure.

FIG. 16 shows a block diagram of another electronic device according to an embodiment of the present disclosure.

Detailed ways

Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in the figures indicate functionally identical or similar elements. While various aspects of the embodiments are shown in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" should not be construed as preferred or better than other embodiments.

The term "and/or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations. In addition, the term "at least one" herein means any one of a variety or any combination of at least two of the more, for example, including at least one of A, B, and C, which may mean including from A, Any one or more elements selected from the set formed by B and C.

In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific implementation manners. It will be understood by those skilled in the art that the present disclosure may be practiced without some of the specific details. In some instances, methods, means, components and circuits that are well known to those skilled in the art have not been described in detail so as to obscure the gist of the present disclosure.

Fig. 1 shows a flowchart of an image processing method according to an embodiment of the present disclosure. The method can be applied to an image processing device or an image processing system, and the image processing device can be a terminal device, a server, or other processing devices. Among them, the terminal device can be user equipment (User Equipment, UE), mobile device, user terminal, cellular phone, cordless phone, personal digital assistant (Personal Digital Assistant, PDA), handheld device, computing device, vehicle-mounted device, wearable device wait. In an example, the image processing method can be applied to a cloud server or a local server, and the cloud server can be a public cloud server or a private cloud server, which can be flexibly selected according to actual conditions.

In some possible implementation manners, the image processing method may also be implemented in a manner in which the processor invokes computer-readable instructions stored in the memory.

With the development of computer vision technology, operations such as eyebrow shape or color rendering on the eyebrows in the image have been more and more widely used in the field of image processing. However, due to the heavy color of the eyebrows and other parts, the rendering effect is often difficult to achieve as expected.

In view of this, the present disclosure proposes an image processing method, as shown in FIG. 1 , in a possible implementation manner, the image processing method may include:

Step S11, receiving a beautification operation on the user's image, and determining a target part to be beautified in the user's image.

Wherein, the user image can be any image containing the target part of one or more objects, and the user image can contain one or more objects or the target part of one or more objects, which can be flexibly determined according to the actual situation. There is no limitation in the embodiments of the present disclosure.

The target part can be any part of the user's image that needs to be beautified, and can be flexibly determined according to the actual situation of the beautification operation. For example, for the beautification operation of the eyebrow rendering operation, the target part can be the eyebrow part; for the beautification operation of the hair dyeing operation, The target part may be a hair part; for a beautification operation for lip makeup operation, the target part may be a lip part, etc.

The beautification operation can be any operation to beautify the target part of the user's image, such as eyebrow rendering operation, hair dyeing operation, lip makeup operation, eye makeup operation, or cosmetic operation. The operation content included in the beautification operation can be flexibly determined according to the actual situation, and is not limited to the following disclosed embodiments. In a possible implementation manner, the beautification operation may include an operation indicating to beautify the target part of the object in the user image; in some possible implementation manners, the beautification operation may also include inputting one or more parameters, etc., Such as beautifying the material or adjusting parameters.

The beautification material can be any material input in the beautification operation to beautify the target part of the user image. The beautification material can be the same or different from the color of the target part in the user image. The beautification material can be flexibly selected and set according to the actual situation. There is no limitation in the embodiments of the present disclosure. In some possible implementation manners, multiple beautification materials may also be provided to the user, and the selected beautification material is determined according to the user's selection. In the beautification operation, a single beautification material can be input or selected, or multiple beautification materials can be input or selected at the same time. Fig. 2 and Fig. 3 respectively show the image of the beautification material according to an embodiment of the present disclosure, as shown in Fig. 2, in an example, the beautification material can be the first eyebrow material with eyebrow peak; In an example, the beautification material may also be a second eyebrow material with a gentle eyebrow shape.

The adjustment parameters may be input during the beautification operation, and are relevant parameters for beautifying and adjusting the target part of the user image. The adjustment parameters may include various parameter types. In some possible implementations, the adjustment parameters may include: At least one of intensity, highlight, mid-tone, glossiness, or grayness of the color of the target part should be beautified. The process of beautifying the target part can be flexibly changed with different beautification materials, which is not limited in this embodiment of the present disclosure.

The manner of determining the target site is not limited in the embodiments of the present disclosure, and is not limited to the following disclosed embodiments. In a possible implementation manner, the position of the target part in the user image may be determined through a target part mask (mask for a target part). In one example, the target part mask can be used to extract the target part image to be beautified in the user image, for example: multiply the pre-made target part mask with the user image to obtain the target part to be beautified in the user image image.

Wherein, the target part mask may be a mask image of the target part, which may be flexibly changed according to different target parts. FIG. 4 shows a schematic diagram of a target part mask according to an embodiment of the present disclosure. As shown in the figure, in an example, the target part mask may be a mask image of an eyebrow part. In one example, under the effect of the mask image of the target part, the image values of the target part may remain unchanged compared to the user image, while the image values other than the target part may be 0.

The method of determining the target part in the user image according to the target part mask can be flexibly determined according to the actual situation. In one example, the position of the target part in the user image can be identified to obtain the initial position of the target part in the user image. Wherein, the manner of recognition is not limited in the embodiments of the present disclosure, for example, key point recognition or direct recognition of the entire eyebrow part may be performed.

In an example, the target part in the user's image may be determined according to the initial position. In an example, the exact position of the target part in the user image can be further determined based on the initial position. For example, the target part mask can be fused with the target part in the preset face image to obtain a standard material image , and then extract the target part in the standard material image according to the initial position to obtain the extracted material of the target part. If the pixel transparency in the extracted material belongs to the preset transparency range, the corresponding The pixel points are confirmed as the pixel points belonging to the target part, and then the target part in the user's image can be determined.

Wherein, the preset face image may be a standard face image template, which may include complete and comprehensive face parts, and the position of each face part in the preset face image is standard. The implementation form of the preset face image can be flexibly determined according to the actual situation, and any standard face (standard face) used in the field of face image processing can be used as the preset face image. Fig. 5 shows a schematic diagram of a preset face image according to an embodiment of the present disclosure (in order to protect objects in the image, some parts of the face in Fig. 5 have been mosaiced), as can be seen from Fig. 5 , In one example, the facial parts included in the preset human face image are clear, complete and conform to the objective distribution of the facial parts in the human face. At the same time, since the position of each face part in the preset face image is standard, the target part mask can be directly fused with the position corresponding to the target part in the preset face image to obtain a standard material image.

Step S12, determining the reference brightness of the target part according to the brightness of the central position of the target part.

Wherein, the center position of the target part can be flexibly determined according to the actual situation of the target part. In one example, when the target part is an eyebrow part, the center position can be the center position between the left eyebrow and the right eyebrow. In one example, when the target part is the eyebrow part, the center position may also be the center point position of the left eyebrow or the center point position of the right eyebrow, etc., which can be flexibly set according to the actual situation. The reference brightness can be used as a reference to determine the boost value of the brightness of each pixel in the target part.

In a possible implementation manner, step S12 may include: obtaining the reference brightness of the target part according to the original brightness of at least one pixel at the central position of the target part.

Wherein, the original brightness of the pixel in the target part may be the original brightness of the pixel in the user image. The original brightness can be determined according to the color values of pixels in the user image, or directly read from the user image. Therefore, in a possible implementation manner, the method proposed in the embodiment of the present disclosure may also include:

According to the original color of the pixel in the target part, the original brightness of the pixel in the target part is determined.

Wherein, the original color of the pixel in the target part may be the original color value of the pixel in the user image, for example, RGB color value. The way to determine the original brightness according to the original color can be flexibly selected according to the actual situation. For example, the channel value of each color channel in the original color can be calculated to obtain the brightness value as the original brightness; or the original color can be converted to a color space containing brightness. In, such as HSL (hue H, saturation S and lightness L) color space, or HSV (hue H, saturation S and lightness V) color space, etc., and then based on the lightness or lightness component in the color space, determine the original brightness.

In one example, the original brightness of the pixel at the center of the target part can be used as the reference brightness; in one example, the average or weighted average of the original brightness of multiple pixels at the center of the target part Values, etc. are used as the reference brightness, etc., and the method of confirming the reference brightness can be flexibly selected according to the actual situation.

Through the embodiments of the present disclosure, the original luminance of one or more pixels in the center of the target part can be used to determine the reference luminance, which increases the diversity of ways to determine the reference luminance, thereby improving the flexibility and application range of the image processing process.

Step S13 , according to the reference brightness, the brightness of the pixel points in the target part is increased to obtain the target brightness of the pixel points in the target part.

Wherein, the pixel points in the target part may be every pixel contained in the target part, or may be some pixels in the target part. The target brightness may be the brightness obtained by increasing the brightness of the pixels in the target part. How to determine which pixels to increase the brightness of, and how to increase the brightness of the pixels according to the reference brightness, the implementation may refer to the following disclosed embodiments, which will not be expanded here. For example, the brightness of the pixel can be increased according to the difference between the reference brightness and the original brightness of the pixel in the target part.

Step S14, according to the beautification material and target brightness input in the beautification operation, generate a target user image after beautifying the target part.

For the implementation form of the beautification material, reference may be made to the above-mentioned disclosed embodiments, which will not be repeated here. The target user image can be an image obtained by beautifying the target part of the user image based on the target brightness and beautification materials. The method of generating the target user image can be flexibly determined according to the actual situation. The converted color is fused with the color of each pixel in the beautification material to obtain the target user image, or the color of each pixel in the beautification material is converted into brightness, and then fused with the target brightness to obtain the target user image, etc.

For some possible implementation manners of step S14, reference may be made to the following disclosed embodiments in detail, which will not be expanded here.

In a possible implementation, step S13 may include:

Determine the brightness enhancement value of the pixel in the target part according to the original brightness and the reference brightness;

According to the brightness enhancement value and the original brightness, the target brightness of the pixels in the target part is obtained.

Wherein, the brightness enhancement value may be an enhancement value or a value range for enhancing the brightness of a pixel point. In some possible implementations, the brightness boost value can be determined according to the numerical relationship between the original brightness and the reference brightness, for example, the brightness boost can be determined according to the difference between the original brightness and the reference brightness or the absolute value of the difference, etc. value.

The calculation method for determining the brightness boost value can be flexibly selected according to the actual situation, see the following disclosed embodiments for details, and will not be expanded here.

The method of obtaining the target brightness according to the brightness enhancement value and the original brightness can also be flexibly selected according to the actual situation. For example, the original brightness and the brightness enhancement value can be fused or weighted to obtain the target brightness. The fusion method can also be based on the actual situation. Make selections such as stacking or multiplying. In one example, the original brightness and the brightness boost value can be added to obtain the target brightness.

In some embodiments, determining the target brightness of the pixels in the target part according to the brightness boost value and the original brightness includes: determining the first original brightness of the pixels in the target part according to the original color of one or more pixels in the target part, Wherein, the first original brightness may represent the average original brightness of the pixels in the target part; according to the first original brightness and the reference brightness, determine the first brightness enhancement value of the pixels in the target part; according to the first A brightness boost value and the first original brightness, determining the target brightness of the pixel in the target part, for example, for each pixel in the target part, adding the original brightness of the pixel to the first brightness boost value, Get the target brightness of the pixel. In some other embodiments, determining the target brightness of the pixel in the target part according to the brightness enhancement value and the original brightness includes: for each pixel in the pixel in the target part, according to the original color of the pixel, determine the pixel the second original brightness; according to the second original brightness and the reference brightness, determine the second brightness boost value of the pixel; according to the second brightness boost value and the second original brightness, determine the pixel target brightness. It should be noted that the method for specifically determining the target brightness of the pixel points in the target part is not limited in this disclosure, and any extension scheme based on the technical solutions in this disclosure belongs to the rights of this disclosure without creative work. the scope of protection required.

Through the embodiments of the present disclosure, it is possible to first determine the brightness boost value of a pixel point according to the original brightness and the reference brightness, and then determine the target brightness of the pixel point based on the brightness boost value. Compared with directly determining the target brightness according to the original brightness and the reference brightness, this The methods proposed in the disclosed embodiments can determine the target brightness more conveniently, and facilitate simultaneous determination of the target brightness of multiple pixels, improving the efficiency and convenience of image processing.

In a possible implementation manner, according to the original brightness and the reference brightness, determining the brightness enhancement value of the pixel in the target part may include:

If the original luminance of the pixel in the target part is lower than the reference luminance, based on the first difference between the reference luminance and the original luminance, the brightness enhancement value of the pixel in the target part is obtained.

Wherein, the first difference may be the difference result obtained by subtracting the original brightness from the reference brightness, and if the original brightness of the pixel in the target part is lower than the reference brightness, it indicates that the original brightness of the pixel in the target part is relatively dark, In this case, if the pixel is beautified directly, the beautification effect may be poor due to the influence of the original color of the pixel. Therefore, the pixel can be determined when the original brightness of the pixel is lower than the reference brightness. The brightness of the point needs to be increased, and the brightness enhancement value of the pixel point is obtained according to the first difference value.

The calculation relationship between the first difference value and the brightness boost value can be flexibly set according to the actual situation. For details, please refer to the following disclosed embodiments, which will not be expanded here.

In some possible implementations, when the original brightness of the pixel in the target part is higher than or equal to the reference brightness, it can be indicated that the pixel itself has a higher brightness, so the original brightness of the pixel in the target part can be Brightness as the target brightness.

Through the embodiments of the present disclosure, it is possible to determine whether the brightness of the pixel needs to be improved by comparing the original brightness of the pixel with the reference brightness, thereby effectively reducing the number of pixels that need brightness improvement in the image processing process to improve the efficiency of image processing.

In a possible implementation manner, based on the first difference between the reference brightness and the original brightness, the brightness enhancement value of the pixel in the target part is obtained, which may include:

Obtain the first difference between the reference brightness and the original brightness;

According to the first difference value and the preset channel value, the brightness enhancement value of the pixel in the target part is obtained.

Wherein, the way of acquiring the first difference can refer to the above-mentioned disclosed embodiments, which will not be repeated here.

The preset channel value may be a channel value determined according to the target part mask, and the realization of the target part mask may refer to the above-mentioned disclosed embodiments, which will not be repeated here. The preset channel value may be a channel value of the target part mask on a certain color-related channel. In one example, the alpha channel value of each pixel in the target part mask may be used as the preset channel value.

The calculation process of obtaining the brightness boost value according to the first difference value and the preset channel value is not limited to the following disclosed embodiments, and can be flexibly adjusted according to actual conditions. In an example, the process of obtaining the brightness boost value can be expressed by the following formula (1):

add_bright＝pow((ref_luminance-V),x)*mask_alpha (1)

Among them, add_bright is the luminance enhancement value, ref_luminance is the reference luminance, V is the original luminance of the pixel in the target part, x is the preset calculation value, mask_alpha is the preset channel value, pow(a,b) indicates the calculation of b of a The result of the power.

Through the embodiments of the present disclosure, the first difference value and the preset channel value contained in the target part mask can be used to jointly determine the brightness boost value of the pixel in the target part, and the first difference formed by the reference brightness and the original brightness can be fully utilized. On the basis of the difference, it also effectively uses the channel value of the target part mask determined from the user image, so that the obtained brightness enhancement value has a higher correlation with the position of the pixel point in the user image, and then improves the entire target part. The overall brightness enhancement effect makes the beautification effect of the subsequent target parts more natural.

In a possible implementation manner, according to the reference brightness and the original brightness, determining the brightness enhancement value of the pixel in the target part may also include:

If the brightness boost value is greater than the preset brightness threshold, the brightness boost value is updated based on a second difference between the brightness boost value and the preset brightness threshold to obtain an updated brightness boost value.

Wherein, the preset brightness threshold may be a brightness threshold flexibly set according to actual conditions, and specific values may be flexibly selected according to actual conditions, and are not limited to the following disclosed embodiments. In a possible implementation manner, the preset brightness threshold may be calculated according to the reference brightness.

The calculation relationship between the preset brightness threshold and the reference brightness can also be flexibly set according to the actual situation, and is not limited to the following disclosed embodiments. In one example, the calculation relationship between the preset brightness threshold and the reference brightness It can be expressed by the following formula (2):

V_threshold=ref_luminance*y (2)

Among them, V_threshold is the preset brightness threshold, ref_luminance is the reference brightness, and y is the preset ratio value.

Through the embodiments of the present disclosure, the preset brightness threshold can be further determined according to the reference brightness, so that when the reference brightness is determined, the brightness of the pixels in the target part can be better brightened, reducing the need to obtain additional data and at the same time Better improve the beautification effect of subsequent target parts.

The second difference can be the difference result obtained by subtracting the preset brightness threshold from the brightness boost value. Individual positions have a more abrupt brightness enhancement effect, which may affect the beautification effect of subsequent target parts. Therefore, in order to reduce the occurrence of this situation, the brightness boost value may be updated according to the second difference between the brightness boost value and the preset brightness threshold, so as to limit the brightness boost value of the pixel in the target part.

The calculation relationship between the second difference and the updated brightness boost value can be flexibly set according to the actual situation. For details, please refer to the following disclosed embodiments, which will not be expanded here.

In some possible implementations, when the brightness boost value is less than or equal to the preset brightness threshold, it can be indicated that the brightness boost value of the pixel is reasonable, so the brightness boost value can be directly used as the updated brightness boost value .

In the case of obtaining the updated brightness boost value, the target brightness of the pixel point in the target part can be obtained according to the updated brightness boost value and the original brightness. The method of obtaining the target brightness by increasing the value and the original brightness will not be repeated here.

Through the embodiments of the present disclosure, by comparing the brightness boost value with the preset brightness threshold, the brightness boost value of the pixel in the target part can be limited within a certain value range, thereby reducing the brightness at the edge of the target part caused by the brightness boost. Some pixels are too bright, which makes the beautified target part have a better transition as a whole and enhances the natural effect of beautification.

In a possible implementation manner, based on the second difference between the brightness boost value and the preset brightness threshold, the brightness boost value is updated to obtain an updated brightness boost value, including:

Acquiring a second difference between the brightness boost value and a preset brightness threshold;

An updated brightness boost value is obtained according to the second difference value, the original brightness and the preset channel value.

Wherein, the manner of obtaining the second difference value and the manner of realizing the preset channel value can refer to the above-mentioned disclosed embodiments, which will not be repeated here.

The calculation process of obtaining the updated brightness boost value according to the second difference value, the original brightness of the pixel and the preset channel value is not limited to the following disclosed embodiments, and can be flexibly adjusted according to the actual situation. In an example, the process of obtaining the updated brightness boost value can be expressed by the following formula (3):

add_bright_new＝V_threshold+(add_bright-V_threshold)*V*mask_alpha (3)

Among them, add_bright_new is the updated brightness enhancement value, add_bright is the brightness enhancement value, V_threshold is the preset brightness threshold, V is the original brightness of the pixel in the target part, and mask_alpha is the preset channel value.

Through the embodiments of the present disclosure, the second difference value, the original brightness and the preset channel value contained in the target part mask can be used to jointly update the brightness enhancement value of the pixel in the target part, so that the pixel in the target part The brightness enhancement value is limited within a more reasonable range to improve the overall beautification effect of the target part.

Fig. 6 shows a schematic diagram of a user image according to an embodiment of the present disclosure (in order to protect the objects in the image, some parts of the face in each figure have been mosaiced, and the images in the following disclosed embodiments are the same, No more details), Figure 7 is a schematic diagram of the intermediate user image obtained after the brightness of the pixels in the eyebrows of the first user in Figure 6 is increased, and Figure 6 and Figure 7 are displayed as grayscale images, so the brightness changes The display is not obvious, but it can still be seen through comparison that the eyebrows of the first user in FIG. 7 are significantly brighter and lighter in color than the eyebrows of the first user in FIG. 6 . Therefore, according to the image processing methods proposed in the above disclosed embodiments, the brightness of the target part can be effectively enhanced.

Similarly, FIG. 8 shows a schematic diagram of a user image according to an embodiment of the present disclosure, and FIG. 9 is a schematic diagram of an intermediate user image obtained after enhancing the brightness of pixels in the eyebrows of the second user in FIG. 8 , through It can also be seen from the comparison that in different user images, the image processing method proposed in the embodiments of the present disclosure can better improve the brightness of the target part.

In a possible implementation, step S14 may include:

According to the brightness of the target, determine the middle color of the pixel in the target part;

Merge the intermediate color with the beautification color in the beautification material to obtain the target color of the pixel in the target part;

Based on the target color, an image of the target user after beautifying the target part is obtained.

Among them, the intermediate color can be the color obtained by converting the target brightness into brightness and color value, and the method of obtaining the intermediate color according to the target brightness can be flexibly determined according to the actual situation, for example, according to the relationship between each channel value and brightness in the color Perform reverse calculation to obtain the intermediate color, or convert the color space where the target brightness is located, such as HSV space or HSL space, to a color space, such as RGB space, to obtain the intermediate color of the pixel.

The beautification color may be the color of each pixel in the beautification material, and the target color may be a color obtained by beautifying the color of the pixel in the target part according to the beautification color. In a possible implementation manner, the target color may be obtained by fusing the intermediate color and the beautification color, and the fusing manner may be flexibly selected according to actual conditions, and is not limited to the following disclosed embodiments.

In a possible implementation, the target color can be obtained by mixing the intermediate color and the beautification color by means of multiplication, wherein the multiplication can use the intermediate color and the beautification color as two layers by multiplying , which darkens the colors of the two layers in a smooth, non-linear fashion. In an example, the process of blending the intermediate color and the beautification color by multiplying can be expressed by the following formula (4):

result_color=fade_color*material_color (4)

Among them, result_color is the fused target color, fade_color is the intermediate color, and material_color is the beautification color.

After the target color is determined, the target color can be used as the color of the pixels in the beautified target part to obtain the beautified target user image, and the color of the pixels in the target part can also be further rendered based on the target color to obtain a beautified image. After the target user image. How to implement it can be flexibly selected according to the actual situation, which is not limited in the embodiments of the present disclosure.

Through the embodiments of the present disclosure, based on the increased target brightness, the color beautification of the pixel points in the target part can be realized, and then the influence of the original color of the pixel points in the target part on the beautification process can be reduced by increasing the brightness, thereby improving the Beautification effect and degree of naturalness.

Based on the above disclosed embodiments, a target user image in which a target part in the user image is beautified can be obtained. 10-13 respectively show schematic diagrams of target user images according to an embodiment of the present disclosure, wherein FIG. 10 shows the eyebrow rendering operation on the first user image in FIG. 6 through the first eyebrow material in FIG. 2 The obtained target user image, FIG. 11 is the target user image obtained after the eyebrow rendering operation is performed on the first user image in FIG. 6 through the second eyebrow material in FIG. 3 , and FIG. An eyebrow material is the target user image obtained after the eyebrow rendering operation is performed on the second user image in FIG. 8. FIG. 13 is the eyebrow rendering of the second user image in FIG. The resulting image of the target user after the operation.

Although the grayscale image cannot clearly reflect the changes of the eyebrows, it can still be seen through comparison that through the image processing methods proposed in the above-mentioned disclosed embodiments, a target user image with a more realistic and natural eyebrow rendering can be obtained.

FIG. 14 shows a block diagram of an image processing device according to an embodiment of the present disclosure. As shown in the figure, the image processing device 20 may include:

The receiving module 21 is configured to receive a beautification operation on the user's image, and determine a target part to be beautified in the user's image.

The brightness determination module 22 is configured to determine the reference brightness of the target part according to the brightness of the central position of the target part.

The brightness enhancement module 23 is configured to increase the brightness of the pixel points in the target part according to the reference brightness, so as to obtain the target brightness of the pixel points in the target part.

The beautification module 24 is configured to generate a beautified target user image of the target part according to the beautification material and target brightness input in the beautification operation.

In a possible implementation manner, the device is also used to: determine the original brightness of the pixels in the target part according to the original color of the pixels in the target part; the brightness enhancement module is used to: determine the target part according to the original brightness and the reference brightness The brightness enhancement value of the pixels in the center; according to the brightness enhancement value and the original brightness, the target brightness of the pixels in the target part is obtained.

In a possible implementation, the brightness enhancement module is further configured to: when the original brightness of the pixel in the target part is lower than the reference brightness, based on the first difference between the reference brightness and the original brightness, obtain the target part The brightness boost value of the pixels in the middle.

In a possible implementation, the brightness enhancement module is further used to: obtain the first difference between the reference brightness and the original brightness; obtain the brightness enhancement of the pixel in the target part according to the first difference and the preset channel value value, wherein the preset channel value is determined according to the target part mask, and the target part mask is used to determine the target part to be beautified in the user image.

In a possible implementation manner, the brightness boost module is further configured to: when the brightness boost value is greater than the preset brightness threshold, based on the second difference between the brightness boost value and the preset brightness threshold, adjust the brightness boost value Perform an update to obtain the updated brightness enhancement value; obtain the target brightness of the pixel points in the target part according to the brightness enhancement value and the original brightness, including: obtain the target brightness of the pixel points in the target part according to the updated brightness enhancement value and the original brightness brightness.

In a possible implementation, the brightness enhancement module is further used to: obtain the second difference between the brightness enhancement value and the preset brightness threshold; obtain the updated The brightness enhancement value of , wherein, the preset channel value is determined according to the target part mask, and the target part mask is used to determine the target part to be beautified in the user image.

In a possible implementation manner, the preset brightness threshold is calculated according to the reference brightness.

In a possible implementation manner, the brightness determining module is configured to: obtain the reference brightness of the target part according to the original brightness of at least one pixel at the central position of the target part.

In a possible implementation, the beautification module is used to: determine the intermediate color of the pixel in the target part according to the target brightness; fuse the intermediate color with the beautification color in the beautification material to obtain the target color of the pixel in the target part ; Based on the target color, an image of the target user after beautifying the target part is obtained.

In a possible implementation manner, the target part includes an eyebrow part, and the beautification operation includes an eyebrow shape rendering operation.

This disclosure relates to the field of augmented reality. By acquiring the image information of the target object in the real environment, and then using various visual correlation algorithms to detect or identify the relevant features, states and attributes of the target object, and thus obtain the image information that matches the specific application. AR effect combining virtual and reality. Exemplarily, the target object may involve faces, limbs, gestures, actions, etc. related to the human body, or markers and markers related to objects, or sand tables, display areas or display items related to venues or places. Vision-related algorithms can involve visual positioning, SLAM, 3D reconstruction, image registration, background segmentation, object key point extraction and tracking, object pose or depth detection, etc. Specific applications can not only involve interactive scenes such as guided tours, navigation, explanations, reconstructions, virtual effect overlays and display related to real scenes or objects, but also special effects processing related to people, such as makeup beautification, body beautification, special effect display, virtual Interactive scenarios such as model display. The relevant features, states and attributes of the target object can be detected or identified through the convolutional neural network. The above-mentioned convolutional neural network is a network model obtained by performing model training based on a deep learning framework.

Application Scenario Example

In the field of computer vision, how to obtain more realistic and natural eyebrow rendering images has become an urgent problem to be solved.

The disclosed application example proposes an image processing method, including the following process:

The first step is to calculate the luminance of the pixel at the brow center position in the user image as the reference luminance and record it as ref_luminance.

In the second step, the eyebrow part mask (mask) is used as the target part mask to obtain the eyebrow part in the user image.

The third step is to traverse each pixel of the eyebrows and perform the following processing:

Convert the original color of the pixel from the RGB color space to the HSV color space, and convert both to the range of [0.0,1.0] to obtain the original brightness of the pixel;

If the original luminance of the pixel is less than ref_luminance, the luminance of the pixel is increased, and the luminance enhancement value add_bright is obtained by referring to the formula (1) in the above disclosed embodiments;

If the brightness of the brightness boost value add_bright is greater than the preset brightness threshold, add_bright is limited by the formula (2) in the above-mentioned disclosed embodiments to obtain an updated brightness boost value, so as to reduce the abrupt effect of lightening eyebrows caused by too brightening the occurrence of the situation;

Add the original brightness of the pixel to the brightness enhancement value add_bright or the updated brightness enhancement value to obtain the target brightness, and then convert the target brightness to the RGB color space to obtain the intermediate color fade_color of the pixel after lightening the eyebrows.

The fourth step is to multiply and mix the beautification color in the eyebrow material and the intermediate color fade_color according to the formula (4) in each of the above-mentioned disclosed embodiments, and obtain the image of the target user after rendering the eyebrow shape.

Through the application example of the present disclosure, users can be provided with a variety of selectable eyebrow shape effects, and according to the eyebrow material selected by the user, corresponding makeup effect processing is performed on the eyebrow parts to obtain the eyebrow shape effect required by the user. The application example of the present disclosure The proposed method can support both real-time eyebrow rendering and eyebrow rendering to preset images.

The image processing method proposed in the application example of this disclosure can not only be applied to the beautification operation of the eyebrow part in the user image, but also can be extended to other parts of the beautification operation, such as lip makeup or hair coloring, etc., as the beautification operation Depending on the type, the image processing method proposed by the application example of the present disclosure can be flexibly expanded and modified accordingly.

It can be understood that the above-mentioned method embodiments mentioned in this disclosure can all be combined with each other to form a combined embodiment without violating the principle and logic. Due to space limitations, this disclosure will not repeat them.

Those skilled in the art can understand that in the above method of specific implementation, the writing order of each step does not mean a strict execution order and constitutes any limitation on the implementation process. The specific execution order of each step should be based on its function and possible The inner logic is OK.

Embodiments of the present disclosure also provide a computer-readable storage medium, on which computer program instructions are stored, and the above-mentioned method is implemented when the computer program instructions are executed by a processor. The computer readable storage medium may be a volatile computer readable storage medium or a nonvolatile computer readable storage medium.

An embodiment of the present disclosure also proposes an electronic device, including: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured as the above method.

In practical application, the above-mentioned memory can be volatile memory (volatile memory), such as RAM; or non-volatile memory (non-volatile memory), such as ROM, flash memory (flash memory), hard disk (Hard Disk Drive , HDD) or solid-state drive (Solid-State Drive, SSD); or a combination of the above types of memory, and provide instructions and data to the processor.

The aforementioned processor may be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor. It can be understood that, for different devices, the electronic device used to implement the above processor function may also be other, which is not specifically limited in this embodiment of the present disclosure.

Electronic devices may be provided as terminals, servers, or other forms of devices.

Based on the same technical idea as the foregoing embodiments, the embodiments of the present disclosure further provide a computer program, which implements the above method when the computer program is executed by a processor.

FIG. 15 is a block diagram of an electronic device 800 according to an embodiment of the present disclosure. For example, the electronic device 800 may be a terminal such as a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, or a personal digital assistant.

15, electronic device 800 may include one or more of the following components: processing component 802, memory 804, power supply component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814 , and the communication component 816.

The processing component 802 generally controls the overall operations of the electronic device 800, such as those associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above method. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802 .

The memory 804 is configured to store various types of data to support operations at the electronic device 800 . Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. The memory 804 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

The power supply component 806 provides power to various components of the electronic device 800 . Power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for electronic device 800 .

The multimedia component 808 includes a screen providing an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense a boundary of a touch or swipe action, but also detect duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 800 is in operation modes, such as call mode, recording mode and voice recognition mode. Received audio signals may be further stored in memory 804 or sent via communication component 816 . In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: a home button, volume buttons, start button, and lock button.

Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of electronic device 800 . For example, the sensor component 814 can detect the open/closed state of the electronic device 800, the relative positioning of components, such as the display and the keypad of the electronic device 800, the sensor component 814 can also detect the electronic device 800 or a Changes in position of components, presence or absence of user contact with electronic device 800 , electronic device 800 orientation or acceleration/deceleration and temperature changes in electronic device 800 . Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on communication standards, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related personnel information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wide Band (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation for performing the methods described above.

In an exemplary embodiment, there is also provided a non-volatile computer-readable storage medium, such as the memory 804 including computer program instructions, which can be executed by the processor 820 of the electronic device 800 to implement the above method.

FIG. 16 is a block diagram of an electronic device 1900 according to an embodiment of the present disclosure. For example, electronic device 1900 may be provided as a server. Referring to FIG. 16 , electronic device 1900 includes processing component 1922 , which further includes one or more processors, and a memory resource represented by memory 1932 for storing instructions executable by processing component 1922 , such as application programs. The application programs stored in memory 1932 may include one or more modules each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.

Electronic device 1900 may also include a power supply component 1926 configured to perform power management of electronic device 1900, a wired or wireless network interface 1950 configured to connect electronic device 1900 to a network, and an input-output (I/O) interface 1958 . The electronic device 1900 can operate based on an operating system stored in the memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™ or the like.

In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium, such as the memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to implement the above method.

The present disclosure can be a system, method and/or computer program product. A computer program product may include a computer readable storage medium having computer readable program instructions thereon for causing a processor to implement various aspects of the present disclosure.

A computer readable storage medium may be a tangible device that can retain and store instructions for use by an instruction execution device. A computer readable storage medium may be, for example, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or flash memory), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanically encoded device, such as a printer with instructions stored thereon A hole card or a raised structure in a groove, and any suitable combination of the above. As used herein, computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., pulses of light through fiber optic cables), or transmitted electrical signals.

Computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or downloaded to an external computer or external storage device over a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or a network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .

Computer program instructions for performing the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or Source or object code written in any combination, including object-oriented programming languages—such as Smalltalk, C++, etc., and conventional procedural programming languages—such as the “C” language or similar programming languages. Computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as via the Internet using an Internet service provider). connect). In some embodiments, electronic circuits, such as programmable logic circuits, field programmable gate arrays (FPGAs) or programmable logic arrays (PLAs), are personalized by utilizing status personnel information of computer readable program instructions, the electronic circuits Computer readable program instructions may be executed to implement various aspects of the present disclosure.

Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It should be understood that each block of the flowcharts and/or block diagrams, and combinations of blocks in the flowcharts and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine such that when executed by the processor of the computer or other programmable data processing apparatus , producing an apparatus for realizing the functions/actions specified in one or more blocks in the flowchart and/or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause computers, programmable data processing devices and/or other devices to work in a specific way, so that the computer-readable medium storing instructions includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks in flowcharts and/or block diagrams.

It is also possible to load computer-readable program instructions into a computer, other programmable data processing device, or other equipment, so that a series of operational steps are performed on the computer, other programmable data processing device, or other equipment to produce a computer-implemented process , so that instructions executed on computers, other programmable data processing devices, or other devices implement the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, a portion of a program segment, or an instruction that includes one or more Executable instructions. In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified function or action , or may be implemented by a combination of dedicated hardware and computer instructions.

Having described various embodiments of the present disclosure above, the foregoing description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and alterations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principle of each embodiment, practical application or technical improvement in the market, or to enable other ordinary skilled in the art to understand each embodiment disclosed herein.

Claims

An image processing method, characterized in that, comprising:

Receive beautification operations on user images,

Determining the target part to be beautified in the user image;

determining the reference brightness of the target part according to the brightness of the central position of the target part;

increasing the brightness of the pixels in the target part according to the reference brightness to obtain the target brightness of the pixels in the target part;

A target user image after beautification of the target part is generated according to the beautification material input in the beautification operation and the target brightness.
The method according to claim 1, further comprising: determining the original brightness of the pixels in the target part according to the original color of the pixels in the target part;

The step of increasing the brightness of the pixels in the target part according to the reference brightness to obtain the target brightness of the pixels in the target part includes:

determining a brightness enhancement value of a pixel in the target part according to the original brightness and the reference brightness;

According to the brightness enhancement value and the original brightness, the target brightness of the pixels in the target part is obtained.
The method according to claim 2, wherein the determining the brightness enhancement value of the pixel in the target part according to the original brightness and the reference brightness comprises:

If the original luminance of the pixel in the target part is lower than the reference luminance, based on the first difference between the reference luminance and the original luminance, the pixel in the target part is obtained Brightness boost value.
The method according to claim 3, wherein the obtaining the brightness enhancement value of the pixel in the target part based on the first difference between the reference brightness and the original brightness includes:

acquiring a first difference between the reference brightness and the original brightness;

According to the first difference value and the preset channel value, the brightness enhancement value of the pixel in the target part is obtained, wherein the preset channel value is determined according to the target part mask, and the target part mask is used for Determine the target part to be beautified in the user image.
The method according to any one of claims 2 to 4, wherein, according to the original brightness and the reference brightness, determining the brightness enhancement value of the pixel in the target part further includes:

If the brightness boost value is greater than a preset brightness threshold, based on a second difference between the brightness boost value and the preset brightness threshold, update the brightness boost value to obtain an updated brightness boost value;

The obtaining the target brightness of the pixels in the target part according to the brightness boost value and the original brightness includes:

According to the updated brightness enhancement value and the original brightness, the target brightness of the pixels in the target part is obtained.
The method according to claim 5, characterized in that, based on the second difference between the brightness boost value and the preset brightness threshold, the brightness boost value is updated to obtain the updated brightness Boost values, including:

Acquiring a second difference between the brightness boost value and the preset brightness threshold;

According to the second difference value, the original brightness and the preset channel value, the updated brightness boost value is obtained, wherein the preset channel value is determined according to the target part mask, and the target part mask It is used to determine the target part to be beautified in the user image.
The method according to claim 5 or 6, wherein the preset brightness threshold is calculated according to the reference brightness.
The method according to any one of claims 1 to 7, wherein the determining the reference brightness of the target part according to the brightness of the central position of the target part comprises:

The reference brightness of the target part is obtained according to the original brightness of at least one pixel at the central position of the target part.
The method according to any one of claims 1 to 8, characterized in that, according to the beautification material input in the beautification operation and the target brightness, a target user image after beautification of the target part is generated ,include:

determining an intermediate color of pixels in the target part according to the target brightness;

Fusing the intermediate color with the beautification color in the beautification material to obtain the target color of the pixel in the target part;

Based on the target color, an image of the target user after beautifying the target part is obtained.
The method according to any one of claims 1 to 9, wherein the target part includes an eyebrow part, and the beautification operation includes an eyebrow shape rendering operation.
An image processing device, characterized in that it comprises:

A receiving module, configured to receive a beautification operation for the user image, and determine a target part to be beautified in the user image;

A brightness determination module, configured to determine the reference brightness of the target part according to the brightness of the central position of the target part;

A brightness enhancement module, configured to increase the brightness of the pixels in the target part according to the reference brightness, to obtain the target brightness of the pixels in the target part;

A beautification module, configured to generate a beautified target user image of the target part according to the beautification material input in the beautification operation and the target brightness.
An electronic device, characterized in that it comprises:

processor;

memory for storing processor-executable instructions;

Wherein, the processor is configured to invoke instructions stored in the memory to execute the method according to any one of claims 1-10.
A computer-readable storage medium, on which computer program instructions are stored, wherein, when the computer program instructions are executed by a processor, the method according to any one of claims 1 to 10 is implemented.