WO2023045950A1

WO2023045950A1 - Image processing method and apparatus, electronic device, and storage medium

Info

Publication number: WO2023045950A1
Application number: PCT/CN2022/120109
Authority: WO
Inventors: 孙仁辉; 苏柳
Original assignee: 上海商汤智能科技有限公司
Priority date: 2021-09-27
Filing date: 2022-09-21
Publication date: 2023-03-30
Also published as: CN113781359A

Abstract

The present disclosure relates to an image processing method and apparatus, an electronic device, and a storage medium. The method comprises: in response to an eye makeup operation for a user image, determining an eye object to be subjected to eye makeup processing in the user image; dividing the eye object into multiple target regions on the basis of tone information and a preset region parameter of the eye object, wherein the target regions are larger in range than an original target region, and the original target region is obtained by dividing the eye object on the basis of the tone information; according to eye makeup parameters of the eye makeup operation, respectively performing, on the multiple target regions, eye makeup processing matching the tones of the target regions to obtain multiple eye makeup results; and generating a target user image according to the multiple eye makeup results.

Description

Image processing method and device, electronic device and storage medium

Cross References to Related Applications

This disclosure claims the priority of the Chinese patent application with application number 202111137187.6 filed on September 27, 2021, which is incorporated herein by reference.

technical field

The present disclosure relates to the field of computer vision, and in particular to an image processing method and device, electronic equipment and a storage medium.

Background technique

With the development of computer vision technology, various eye makeup operations on eye parts in face images have become more and more widely used in the field of image processing. How to obtain a more beautiful and natural eye makeup effect has become an urgent problem to be solved at present.

Contents of the invention

The present disclosure proposes an image processing scheme.

According to an aspect of the present disclosure, an image processing method is provided, including:

In response to the eye makeup operation on the user image, determine an eye object to be subjected to eye makeup processing in the user image; divide the eye object into multiple target areas, wherein, the range of the target area is larger than the original target area, and the original target area is obtained by dividing the eye objects based on the hue information; according to the eye makeup parameters in the eye makeup operation , performing eye makeup processing matching the color tone of the target area to each of the multiple target areas to obtain multiple eye makeup results; generating a target user image according to the multiple eye makeup results.

In a possible implementation manner, the determining the eye object to be subjected to eye makeup processing in the user image includes: performing key point recognition processing on the user image, and determining that the eye object is in the user image The initial position in the image; the user image is copied to multiple layers respectively; for each layer in the multiple layers, in this layer, the position is expanded with the initial position as the center to obtain An extension location, according to the extension location, determine the object to be processed for eye makeup in the layer.

In a possible implementation manner, the hue information includes at least one of shadow information or midtone information; the division of the eye object based on the hue information of the eye object and preset area parameters For multiple target areas, at least one of the following operations is included: based on the shadow information of the eye object, combined with the first preset area parameter among the preset area parameters, extracting the shadow from the eye object region; or, based on the midtone information of the eye object, in combination with the second preset region parameter among the preset region parameters, extract a midtone region from the eye object.

In a possible implementation manner, the extracting a shadow area from the eye object based on the shadow information of the eye object in combination with the first preset area parameter in the preset area parameters includes: Based on the reverse grayscale image of the eye object, perform multiply blending to obtain a first blending result; determine the pixels in the eye object according to the first blending result and the first preset area parameter The first transparency of the point; according to the first preset transparency threshold and the first transparency, pixel points in the eye object are extracted to obtain the shadow area, wherein the shadow area is larger than the original shadow area, The original shadow area is obtained by dividing the eye object based on the shadow information.

In a possible implementation manner, the midtone area is extracted from the eye object based on the midtone information of the eye object in combination with the second preset area parameter among the preset area parameters, The method includes: performing exclusion mixing based on the grayscale image of the eye object to obtain a second mixing result; determining the pixel points in the eye object according to the second mixing result and the second preset area parameter Second transparency: according to the second preset transparency threshold and the second transparency, extract the pixel points in the eye object to obtain the midtone area, wherein the midtone area is larger than the original midtone area , the original midtone area is obtained by dividing the eye object based on the midtone information.

In a possible implementation, according to the eye makeup parameters in the eye makeup operation, each of the multiple target areas is subjected to eye makeup processing that matches the color tone of the target area to obtain multiple The eye makeup results include: according to the color parameters in the eye makeup parameters, respectively rendering the multiple target areas to obtain multiple intermediate eye makeup results; according to the hues of the multiple target areas, determining the multiple target areas A processing method corresponding to each of the target areas; according to the processing methods corresponding to the plurality of target areas, the eye object and the plurality of intermediate eye makeup results are respectively mixed to obtain a plurality of eye makeup results.

In a possible implementation manner, the target area includes at least one of the following: a shadow area or a midtone area; according to the hues of the multiple target areas, determining the corresponding processing methods of the multiple target areas , comprising: in response to determining that the target area includes a shadow area, determining that the processing manner includes multiply blending; in response to determining that the target area includes a midtone area, determining that the processing manner includes normal blending.

In a possible implementation manner, the generating the target user image according to the multiple eye makeup results includes: superimposing the multiple eye makeup results to obtain the target eye makeup result; Fusion parameters in , the target eye makeup result is fused with the user image to obtain the target user image.

According to an aspect of the present disclosure, an image processing device is provided, including:

A determination module, configured to determine an eye object to be subjected to eye makeup processing in the user image in response to an eye makeup operation on the user image; a division module, configured to based on the hue information of the eye object and preset area parameters , dividing the eye object into a plurality of target areas, wherein the scope of the target area is larger than the original target area, and the original target area is obtained by dividing the eye object based on the hue information; the eye A makeup module, configured to perform eye makeup processing on each of the multiple target areas according to the eye makeup parameters in the eye makeup operation to match the color tone of the target area, to obtain multiple eye makeup results; a generation module , for generating a target user image according to the multiple eye makeup results.

In a possible implementation manner, the determining module is configured to: perform key point recognition processing on the user image, determine the initial position of the eye object in the user image; copy the user image respectively to a plurality of layers; for each layer in the plurality of layers, in the layer, the position is expanded with the initial position as the center to obtain the extended position, and the layer is determined according to the expanded position The object to be treated with eye makeup.

In a possible implementation manner, the hue information includes at least one of shadow information or midtone information; the dividing module is used for at least one of the following: based on the shadow information of the eye object, combined with the The first preset area parameter in the preset area parameters is used to extract the shadow area from the eye object; or, based on the midtone information of the eye object, combined with the second preset area parameter in the preset area parameters Set a region parameter to extract a midtone region from the eye object.

In a possible implementation manner, the division module is further configured to: perform multiplicative blending based on the reverse grayscale image of the eye object to obtain a first blending result; according to the first blending result and The first preset area parameter determines the first transparency of the pixels in the eye object; extracts the pixels in the eye object according to the first preset transparency threshold and the first transparency, The shadow area is obtained, wherein the shadow area is larger than the original shadow area obtained by dividing the eye object based on the shadow information.

In a possible implementation manner, the dividing module is further configured to: perform exclusion mixing based on the grayscale image of the eye object to obtain a second mixing result; according to the second mixing result and the second Preset area parameters to determine the second transparency of the pixels in the eye object; extract the pixels in the eye object according to the second preset transparency threshold and the second transparency to obtain the intermediate a midtone area, wherein the midtone area is larger than an original midtone area, and the original midtone area is obtained by dividing the eye object based on the midtone information.

In a possible implementation manner, the eye makeup module is configured to: respectively render the multiple target areas according to the color parameters in the eye makeup parameters to obtain multiple intermediate eye makeup results; according to the The color tone of the multiple target areas, determine the corresponding processing methods of the multiple target areas; according to the processing methods corresponding to the multiple target areas, the eye objects are respectively compared with the multiple intermediate eye makeup results Blend the treatment for multiple eye makeup results.

In a possible implementation manner, the target area includes at least one of the following: one or more of a shadow area or a midtone area; the eye makeup module is further configured to: respond to determining that the target area includes For the shaded area, it is determined that the processing method includes multiply blending; in response to determining that the target area includes a midtone area, it is determined that the processing method includes normal blending.

In a possible implementation manner, the generating module is configured to: superimpose the multiple eye makeup results to obtain a target eye makeup result; The result is fused with the user image to obtain the target user image.

According to an aspect of the present disclosure, an electronic device is provided, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to: execute the above image processing method.

According to one aspect of the present disclosure, there is provided a computer-readable storage medium, on which computer program instructions are stored, and the above-mentioned image processing method is implemented when the computer program instructions are executed by a processor.

In the embodiment of the present disclosure, by responding to the eye makeup operation on the user image, the eye object to be subjected to eye makeup processing in the user image is determined, thereby according to the hue information of the eye object and the preset area parameters. Divide the eye object into a plurality of target regions, wherein the range of the target region is larger than the range of the original target region divided by the hue, and according to the eye makeup parameters in the eye makeup operation, each of the plurality of target regions is compared with the The eye makeup processing of the color tone matching of the target area to obtain multiple eye makeup results, and generate the target user image after eye makeup processing on the eye object according to the multiple eye makeup results. Through the above process, the difference in hue between different target areas can be made greater by preset area parameters, and a larger target area can be obtained than the original target area obtained by dividing only based on the hue. Performing corresponding eye makeup processing based on the target area can make the overall eye makeup effect of the eye object more natural and real. For example, eye objects can be divided into shadow areas and mid-tone areas according to tones such as shadows and mid-tones, so that in the process of applying eye makeup to shadow areas, the brightness of eye makeup can be reduced as much as possible, and eye makeup can be applied to mid-tone areas. In the process of makeup treatment, the brightness of the eye makeup should be kept as much as possible, so that the eye makeup effect of the eye object can match the original color distribution of the eye object, and the authenticity and naturalness of the eye makeup can be improved, and the eye makeup can be omitted. The process of dividing an object into highlight areas reduces the amount of data processed and improves the efficiency of image processing.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the accompanying drawings.

Description of drawings

The accompanying drawings here are incorporated into the description and constitute a part of the present description. These drawings show embodiments consistent with the present disclosure, and are used together with the description to explain the technical solution of the present disclosure.

Fig. 1 shows a flowchart of an image processing method according to an embodiment of the present disclosure.

Fig. 2 shows a flowchart of an image processing method according to an embodiment of the present disclosure.

Fig. 3 shows a flowchart of an image processing method according to an embodiment of the present disclosure.

Fig. 4 shows a flowchart of an image processing method according to an embodiment of the present disclosure.

FIG. 5 shows a block diagram of an image processing device according to an embodiment of the present disclosure.

Fig. 6 shows a block diagram of an electronic device according to an embodiment of the present disclosure.

Fig. 7 shows a block diagram of an electronic device according to an embodiment of the present disclosure.

Detailed ways

Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in the figures indicate functionally identical or similar elements. While various aspects of the embodiments are shown in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as superior or better than other embodiments.

The term "and/or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations. In addition, the term "at least one" herein means any one of a variety or any combination of at least two of the more, for example, including at least one of A, B, and C, which may mean including from A, Any one or more elements selected from the set formed by B and C.

In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific implementation manners. It will be understood by those skilled in the art that the present disclosure may be practiced without some of the specific details. In some instances, methods, means, components and circuits that are well known to those skilled in the art have not been described in detail so as to obscure the gist of the present disclosure.

Fig. 1 shows a flowchart of an image processing method according to an embodiment of the present disclosure. The method can be applied to an image processing device or an image processing system, and the image processing device can be a terminal device, a server, or other processing devices. Among them, the terminal device can be user equipment (User Equipment, UE), mobile device, user terminal, cellular phone, cordless phone, personal digital assistant (Personal Digital Assistant, PDA), handheld device, computing device, vehicle-mounted device, wearable device wait. In an example, the image processing method can be applied to a cloud server or a local server, and the cloud server can be a public cloud server or a private cloud server, which can be flexibly selected according to actual conditions.

In some possible implementation manners, the image processing method may also be implemented in a manner in which the processor invokes computer-readable instructions stored in the memory.

As shown in Figure 1, in a possible implementation, the image processing method may include:

Step S11 , in response to the eye makeup operation on the user image, determine eye objects to be subjected to eye makeup processing in the user image.

Wherein, the user image can be any image including the user's eyes, and the user image can include one or more users, or one or more users' eyes, and its implementation form can be flexibly determined according to the actual situation. No limitation is imposed in the disclosed embodiments.

The eye object can be a part of the face that needs eye makeup processing in the user image. The eye object can include the complete eye, such as the eyes and the related parts near the eyes that can be used for eye makeup, such as eye shadow rendering. Parts, or eyeball parts that can be rendered with color contact lenses, etc., can also only include objects such as the left eye or right eye, which can be flexibly selected according to the actual situation of eye makeup operation.

The eye makeup operation can be any operation of eye makeup processing on the eye object of the user image, such as eye shadow rendering or color contact lens rendering. The operation content included in the eye makeup operation can be flexibly determined according to the actual situation, and is not limited to the following disclosed embodiments. In a possible implementation manner, the eye makeup operation may include performing eye makeup processing on the eye objects in the user image; in some possible implementation manners, the eye makeup operation may also include the input makeup parameters, etc.

The eye makeup parameters can be user-input parameters related to eye makeup processing on eye objects. The implementation form of the eye makeup parameters can be flexibly determined, such as color parameters, fusion parameters and other parameters.

The manner of determining the eye object is not limited in the disclosed embodiments, and is not limited to the following disclosed embodiments. In a possible implementation manner, eye recognition processing may be performed on the user image to determine the target location. The manner of recognition processing is not limited in the embodiment of the present disclosure, for example, it may be key point recognition, direct recognition of the whole eye, and the like.

Step S12, dividing the eye object into a plurality of target areas based on the hue information of the eye object and preset area parameters.

Wherein, the hue information may reflect the relative lightness and darkness of the eye object. The information contained in the hue information may be flexibly determined according to actual conditions. In a possible implementation manner, the hue information may include one or more of highlight information, shadow information, and midtone information.

Among them, the highlight information can reflect the region with higher brightness in the eye object, the shadow information can reflect the region with lower brightness in the eye object, and the midtone information can reflect the brightness in the eye object is between the highlight and shadow Area.

Different hue information can be determined from the eye object in different hue ways. In some possible implementations, the above hue information can be obtained directly according to the brightness of the pixels in the eye object. In some possible implementations, Eye objects can also be processed in different ways to obtain different hue information. The manner of acquiring hue information can be referred to the following disclosed embodiments in detail, and will not be expanded here.

The preset area parameter may be a related parameter used to determine the target area, and the implementation form of the preset area parameter is not limited in the embodiment of the present disclosure, for example, it may be related parameters such as a set area range or a range threshold.

In a possible implementation, based on the hue information of the eye object, the eye object can be divided into multiple original target areas. Based on the original target area, the original target area can be The target area is further determined on the basis of the original target area. In this case, the preset area parameters may be related parameters used to determine the target area on the basis of the original target area. For example, it may be the preset value for adjusting the range of the original target area, or the relevant parameters that need to be used in the process of further determining the target area on the basis of the original target area. See the following disclosed embodiments for details. Do not expand here. Since the target area can be determined on the basis of the original target area, there may be a certain corresponding relationship between the two. In a possible implementation manner, the range of the target area may be larger than the original target area.

The area type and area position contained in the target area can be flexibly determined according to the actual situation of the color tone information in the eye object. There may be overlapping areas between multiple target areas, and they may also be independent of each other. In the embodiment of the present disclosure No restrictions.

In some possible implementation manners, the target area may include one or more of a highlight area, a shadow area, and a midtone area.

According to the hue information, the method of dividing the eye object into multiple target areas can be flexibly changed with the different hue information, for example, according to the obtained highlight information, shadow information and midtone information, the pixels in the eye object can be Points are divided into highlight area, shadow area and midtone area etc. respectively. For some possible implementations of step S12, refer to the following disclosed embodiments for details, which will not be expanded here.

Step S13 , according to the eye makeup parameters in the eye makeup operation, perform eye makeup processing on each of the multiple target areas that matches the color tone of the target area, and obtain multiple eye makeup results.

For the implementation form of the eye makeup parameters, reference may be made to the above disclosed embodiments, which will not be repeated here. For multiple target areas, the eye makeup parameters corresponding to different target areas can be the same or different. For example, different target areas can correspond to the same or different color parameters, or different areas can use the same or different fusion parameters. The fusion of color parameters and the like can be flexibly set according to actual conditions, and are not limited to the embodiments of the present disclosure.

The eye makeup result may be the result obtained after the target area has been treated with eye makeup. Depending on the target area, the way of eye makeup treatment may also be different, so corresponding eye makeup treatment can be performed on multiple target areas to obtain multiple eye makeup results. For some possible implementation manners of step S13, reference may be made to the following disclosed embodiments in detail, which will not be expanded here.

Step S14, generating target user images according to multiple eye makeup results.

The target user image can be an image obtained by performing eye makeup processing on the eye object of the user image, and the method of generating the target user image can be flexibly determined according to the actual situation. For example, multiple eye makeup results can be fused to obtain the target user image. the user image, or combine multiple eye makeup results with the user image to obtain the target user image. In some possible implementation manners, multiple eye makeup results may also respectively belong to multiple layers. In this case, the target user image may be obtained by superimposing the layers.

For some possible implementation manners of step S14, reference may be made to the following disclosed embodiments in detail, which will not be expanded here.

In the embodiment of the present disclosure, by responding to the eye makeup operation on the user image, the eye object to be subjected to eye makeup processing in the user image is determined, so that according to the hue information of the eye object and the preset area parameters, the eye object Divide into a plurality of target areas, wherein the range of the target area is larger than the range of the original target area divided by the color tone, and according to the eye makeup parameters in the eye makeup operation, each of the plurality of target areas is compared with the color tone of the target area Matching eye makeup processing to obtain multiple eye makeup results, and generate a target user image after performing eye makeup processing on eye objects according to the multiple eye makeup results. Through the above process, the difference in hue between different target areas can be made greater by presetting the area parameters, and a larger target area can be obtained compared to the original target area that is only divided according to the hue. Based on the target The corresponding eye makeup treatment of the area can make the overall eye makeup effect of the eye object more natural and real. For example, the eye object can be divided into a shadow area and a mid-tone area according to the shades such as shadows and mid-tones, so that the shadow area can be adjusted. In the process of eye makeup processing, the brightness of eye makeup should be reduced as much as possible, and in the process of eye makeup processing in the middle tone area, the brightness of eye makeup should be kept as much as possible, so that the eye makeup effect of the eye object is consistent with the original color of the eye object. Matching the color tone distribution improves the authenticity and naturalness of eye makeup, and can omit the process of dividing eye objects into highlight areas, reducing the amount of processed data and improving the efficiency of image processing.

In a possible implementation manner, the eye object may include multiple eye objects respectively located in multiple layers. For example, for the eye makeup operation of eye shadow rendering, one or Multiple areas are rendered, such as the basic eye shadow area, the basic lower eye shadow area, the upper eyelid area, the outer corner area, the inner eye corner area, and the upper right eye shadow area. In this case, these six regions can be used as eye objects for subsequent operations.

Therefore, in a possible implementation manner, step S11 may include:

Perform key point recognition processing on the user image to determine the initial position of the eye object in the user image;

Copy user images to multiple layers respectively;

In each layer, expand the position centered on the initial position to obtain the expanded position, and determine the eye object in each layer according to the expanded position.

Wherein, the key point identification method is not limited in the embodiment of the present disclosure, for example, it may be identified through a relevant key point identification algorithm, or through a neural network with a key point identification function.

The initial position may be the position of the eye object in the user image. In a possible implementation, if there are multiple eye objects, the positions of the central areas of these eye objects may be used as the initial position. For example, In other words, for the operation of eye shadow rendering, multiple eye shadow areas as eye objects are distributed around the eyes, so the position of the eyes in the user image can be used as the initial position.

A layer may be any layer with image processing or editing functions, such as an editing layer in image editing software (Photoshop, PS).

The number of multiple layers can be flexibly determined according to the actual situation, and is not limited in this embodiment of the present disclosure. In some possible implementations, the number of layers can be the same as the number of multiple eye objects; in some possible In the implementation mode, the number of layers can also be smaller than the number of multiple eye objects. In this case, it is possible to determine two or more eye objects in one or some layers at the same time, such as In a layer, you can determine both the base eye shadow area object and the base eye shadow area object.

Copy the user image to multiple layers respectively, which can be to copy multiple eye objects in the user image to multiple layers, or copy the entire user image to multiple layers, or directly copy the user image to multiple layers. The original layer the image was on is copied to multiple layers, etc.

In each layer, the position can be expanded with the initial position as the center to obtain the expanded position, and the eye objects in each layer can be determined according to the expanded position. The way of extension is not limited in this embodiment of the present disclosure. For example, in each layer, according to the position correspondence between the eye object in the layer and the initial position, the corresponding position direction can be Expand according to the corresponding range, and the position correspondence can be determined according to the objective relationship between the eye object and the initial position. The inside of the initial position, etc.

After the eye object is determined in each layer, the eye makeup result of the eye object can be determined in each layer through steps S12 to S14. In some possible implementations, each image can be Layer eye makeup results are superimposed to further obtain the target user image after eye makeup processing.

Through the embodiments of the present disclosure, multiple eye objects can be determined separately and independently by copying user images to multiple layers, which facilitates subsequent eye makeup processing on multiple eye objects, improves the flexibility of eye makeup, and also It is convenient to change the eye makeup effect of each eye object to enhance the richness of eye makeup.

FIG. 2 shows a flowchart of an image processing method according to an embodiment of the present disclosure. As shown in the figure, in a possible implementation manner, step S12 may include one or more of the following operations:

Step S121 , based on the shadow information of the eye object, combined with the first preset area parameter among the preset area parameters, extract the shadow area from the eye object. or,

Step S122, based on the midtone information of the eye object, combined with the second preset region parameter among the preset region parameters, extracting a midtone region from the eye object.

Wherein, the numbers of step S121 and step S122 are only used to distinguish the above-mentioned different steps, and do not limit the implementation order of different steps. Different steps can be executed simultaneously or sequentially, and the order is not limited in the embodiments of the present disclosure. . Step S12 may include the above two steps at the same time, and may also selectively execute some of the steps.

Through the embodiments of the present disclosure, eye objects can be flexibly divided into shadow regions and/or midtone regions according to shadow information and/or midtone information. On the one hand, it can effectively improve the flexibility of eye object beautification, and it is convenient to realize eye makeup processing flexibly and quickly; The embodiment of the present disclosure can omit the processing of the highlight area, and improve the efficiency of eye makeup processing.

In a possible implementation, step S121 may include:

Based on the reverse grayscale image of the eye object, perform multiplication and bottom blending to obtain the first blending result;

determining a first transparency of pixels in the eye object according to the first mixing result and the first preset area parameter;

According to the first preset transparency threshold and the first transparency, pixel points in the eye object are extracted to obtain a shadow area.

Wherein, the reverse grayscale image of the eye object can be an image obtained after performing reverse grayscale processing on each pixel in the eye object, and the reverse grayscale can perform linear or non-linear inversion to obtain an image opposite to the grayscale image of the eye object. Multiply blending based on the reversed grayscale image of the eye object may be to perform multiplicative blending on the reversed grayscale image of the eye object itself to obtain the first blended result, specifically, it may be After copying the reversed grayscale image of the eye object, multiply blending is performed based on the two identical reversed grayscaled images to obtain the first blending result.

The first mixed result obtained by the above method can reflect the shadow information of the eye object, therefore, based on the first mixed result, the original shadow area in the eye object can be further determined, and the original shadow area can be obtained only according to The shadow information represented by the first blending result is used to divide the eye object into the obtained area.

Therefore, in a possible implementation manner, the shadow area may be determined according to the first mixing result and further combined with the first preset area parameter. Wherein, the first preset area parameter may be a preset parameter for determining the shaded area, and its parameter value may be flexibly determined according to actual conditions, and is not limited to the embodiments of the present disclosure. In an example, the first preset parameter may be any value greater than 1 (for example, 1.1˜1.7).

Specifically, an alpha (alpha) channel value of each pixel in the first mixed result may be obtained, and the alpha channel value may be multiplied by a first preset area parameter to obtain a multiplied first grayscale result. The first grayscale result can be mapped to a transparency value through the mapping relationship between grayscale and transparency, so as to determine the first transparency of each pixel in the eye object. The specific mapping manner of the mapping relationship can be flexibly set according to the actual situation, and is not limited in this embodiment of the present disclosure.

The first preset transparency threshold may be a preset threshold for filtering the pixels belonging to the shadow area in the eye object, and the specific value of the first preset transparency threshold is not limited in this embodiment of the present disclosure.

According to the first preset transparency threshold, it can be judged whether the first transparency of each pixel in the eye object is within the range of the first preset transparency threshold, if so, it is determined that the pixel belongs to the shadow area, otherwise it is considered that the pixel belongs to the shadow For regions other than the region, through the above screening process, multiple pixels belonging to the shadow region can be obtained from the eye object, and then the pixels belonging to the shadow region in the eye object are extracted to obtain the shadow region.

Since the first transparency can be obtained based on the multiplication of the first blending result and the first preset area parameter, for some pixels in the eye object, the transparency determined based on its own first blending result may be If it does not belong to the range of the first preset transparency threshold, and after multiplying it by the first preset area parameter, the pixel can be classified into a shadow area. Therefore, the shadow area obtained by the method of the embodiment of the present disclosure may be larger than the original shadow area determined only according to the shadow information. For example, in one example, according to the first blending result, it can be determined that the alpha channel value of a certain pixel is 100, and the corresponding transparency is 39%, which is not within the range of the first preset transparency threshold (for example, greater than 40%) , and after multiplying the first mixed result with the first preset area parameter (such as 1.2), it can be determined that the first grayscale result of the pixel is 120, and the first transparency obtained by mapping is 47%, so by combining with After the first preset area parameter is multiplied, the pixel point may belong to the range of the first preset transparency threshold, and then belong to the shadow area.

Through the embodiments of the present disclosure, the first blending result reflecting the shadow information can be obtained by multiplying and blending the reverse grayscale image of the eye object, so that according to the blending result and the first preset area parameters, the Extract the shadow area from the object. On the one hand, this method of obtaining shadow information is fast and convenient, and the accuracy is high. While improving the efficiency of eye makeup processing, it can effectively improve the accuracy of eye makeup, and then improve the effect of eye makeup; On the one hand, by introducing the first preset area parameter, the contrast of the shadow area relative to other target areas can be effectively enhanced, and the area range of the shadow area can be expanded to make up for the omission of the divided highlight area, so that the eyes based on the divided target area Makeup processing can be more accurate and have better results.

In a possible implementation manner, step S122 may include:

Based on the grayscale image of the eye object, performing exclusion mixing to obtain a second mixing result;

According to the second mixing result and the second preset area parameter, determine the second transparency of the pixel in the eye object;

According to the second preset transparency threshold and the second transparency, pixel points in the eye object are extracted to obtain a midtone area.

Wherein, the grayscale image of the eye object may be an image obtained by performing grayscale processing on the eye object. Excluding and mixing based on the grayscale image of the eye object may be to mix the grayscale image of the eye object itself in a form of exclusion to obtain the second mixed result, and its implementation form can refer to the above-mentioned disclosed embodiments, which are not described herein. Let me repeat. Wherein, exclusion blending can be an image blending mode in PS editing software, which can change the brightness and grayscale of an image, and based on the result of exclusion blending, midtone information of eye objects can be obtained.

Therefore, the second mixed result obtained in the above manner can reflect the midtone information of the eye object, and therefore, based on the second mixed result, the original midtone region in the eye object can be further determined, and the original midtone region It may be the region obtained by dividing the eye object only according to the middle tone information represented by the obtained second mixing result.

Therefore, in a possible implementation manner, the middle tone area may be determined according to the second mixing result and further combined with the second preset area parameter. Wherein, the second preset area parameter may be a preset parameter for determining the midtone area, and its parameter value may be flexibly determined according to actual conditions, and is not limited to the embodiments of the present disclosure. The value of the second preset area parameter may be the same as or different from the first preset area parameter. In an example, the second preset parameter may also be any value greater than 1 (for example, 1.1 to 1.7).

Specifically, the alpha channel value of each pixel in the second mixed result can be obtained, and the alpha channel value can be multiplied by the second preset area parameter to obtain the multiplied second grayscale result. The second grayscale result can be mapped to a transparency value through the mapping relationship between grayscale and transparency, so as to determine the second transparency of each pixel in the eye object. For the specific mapping manner of the mapping relationship, reference may be made to the foregoing disclosed embodiments.

The second preset transparency threshold may be a preset threshold for filtering the pixel points belonging to the midtone region in the eye object, and the specific value of the second preset transparency threshold is not limited in the embodiments of the present disclosure. In a possible implementation manner, the second preset transparency threshold may be different from the first preset transparency threshold.

According to the second preset threshold, it can be judged whether the second transparency of each pixel in the eye object is within the range of the second preset threshold, if so, it is determined that the pixel belongs to the midtone area, otherwise, the pixel is considered to belong to the midtone For regions other than the region, through the above screening process, multiple pixels belonging to the midtone region can be obtained from the eye object, and then the pixels belonging to the midtone region in the eye object are extracted to obtain the midtone region.

Similar to the relationship between the shadow area and the original shadow area, the midtone area obtained through the second preset area parameter may be larger than the original midtone area determined only based on the midtone information. For the principle, reference may be made to the above disclosed embodiments.

Through the embodiments of the present disclosure, the grayscale image of the eye object can be excluded and mixed to obtain the second mixed result reflecting the midtone information, so that according to the mixed result and the second preset area parameters, the eye object can be extracted Obtaining the mid-tone area, on the one hand, this method of obtaining mid-tone information is fast and convenient, and it is convenient for batch processing at the same time as the method of obtaining shadow information, thereby improving the efficiency and effect of eye makeup as a whole; on the other hand, by introducing the second The preset area parameters can effectively enhance the contrast of the midtone area relative to other target areas, and can expand the area range of the midtone area to make up for the omission of the divided highlight area, so that the eye makeup processing based on the divided target area can be More accurate and with better results.

FIG. 3 shows a flowchart of an image processing method according to an embodiment of the present disclosure. As shown in the figure, in a possible implementation manner, step S13 may include:

In step S131, according to the color parameters in the eye makeup parameters, the multiple target areas are respectively rendered to obtain multiple intermediate eye makeup results.

Step S132, according to the hues of the multiple target areas, determine the processing modes corresponding to the multiple target areas.

In step S133, the eye object is mixed with multiple intermediate eye makeup results to obtain multiple eye makeup results according to the corresponding processing methods of multiple target areas.

Wherein, the intermediate eye makeup result may be a rendering result obtained after rendering the color parameters to the target area. The color parameter may be a parameter for color rendering of the eye object, and the color parameter may be a color value or an RGB channel value. The color parameter can be determined according to the color selected by the user or the color value input by the user, or the color can be set in advance, and can be flexibly selected according to the actual situation.

Among the multiple target areas, different target areas may correspond to the same color parameters, or may correspond to different color parameters, which can be flexibly selected according to the actual situation. In a possible implementation manner, each target area may be mixed with corresponding color parameters to obtain an intermediate eye makeup result corresponding to each target area.

Since different target areas can be divided based on different hue information, different target areas can correspond to different hues, such as the shaded areas corresponding to shadows and the midtone area corresponding to midtones mentioned in the above disclosed embodiments.

Target areas with different tones may have different eye makeup treatment methods. The corresponding relationship between the color tones and the treatment methods can be found in the following disclosed embodiments in detail, and will not be expanded here.

After the processing method of each target area is determined, the eye object can be mixed with each intermediate eye makeup result according to the processing method, so as to obtain multiple eye makeup results.

Through the embodiments of the present disclosure, according to the hues corresponding to different target areas, the mixed processing of the corresponding processing methods can be performed on each target area to obtain the eye makeup result of each target area, so that different target areas can have the same color tone. The corresponding eye makeup effect effectively improves the accuracy and richness of the overall eye makeup effect, and also improves the flexibility of the eye makeup process.

In a possible implementation manner, step S132 may include:

Where the target area includes shaded areas, determine that the processing includes multiply blending;

Where the target area includes the midtone area, it is determined that the processing includes normal mixing.

From the above disclosed embodiments, it can be seen that when the target area is a shadow area, the intermediate eye makeup effect and eye objects in the shadow area can be mixed in the manner of multiplying and blending to obtain the eye makeup in the shadow area result. Among them, multiply and bottom blending can darken the blending result, thereby fully retaining the tonal properties of the shadow area and improving the processing effect.

In the case that the target area is a mid-tone area, the mid-tone eye makeup effect and eye objects in the mid-tone area can be mixed in a normal blending manner to obtain an eye makeup result in the mid-tone area. Among them, normal blending has little effect on the brightness of the blending result, so as to fully preserve the tone properties of the midtone area and improve the processing effect.

From the above-mentioned disclosed embodiments, it can be seen that, for the tones of different target areas, different mixing methods are used for mixing, so that the obtained eye makeup result is consistent with the original color tone of the eye object, thereby greatly improving the eye makeup effect. authenticity.

FIG. 4 shows a flowchart of an image processing method according to an embodiment of the present disclosure. As shown in the figure, in a possible implementation manner, step S14 may include:

Step S141, superimposing multiple eye makeup results to obtain the target eye makeup result;

Step S142, according to the fusion parameters in the eye makeup parameters, the target eye makeup result is fused with the user image to obtain the target user image.

In a possible implementation manner, the above-mentioned multiple target areas may also be determined in multiple layers respectively, in this case, the multiple eye makeup results obtained may also belong to multiple layers respectively, therefore, In an example, eye makeup results in multiple layers may be superimposed to obtain a target eye makeup result.

The way of overlay can be flexibly decided according to the actual situation, for example, it can be direct overlay between layers, and in some possible implementations, overlay can also be realized through some or some mixed methods, for example, multiple layers can be passed through Multiply the way to mix and overlay.

In a possible implementation manner, multiple eye makeup results may also be directly fused or mixed to obtain a target eye makeup result.

After the target eye makeup result is obtained, the target eye makeup result and the user image can be fused according to the fusion parameters to obtain the target user image. The fusion method is also not limited in this embodiment of the disclosure. The pixel values of the same position are added or multiplied to achieve fusion, or the pixel values of the pixels at the same position are weighted and fused.

Wherein, the fusion weight of the target eye makeup result in the weighted fusion can be determined according to the fusion parameters, and the fusion parameters can be preset parameter values, or can be determined according to the parameter values input by the user in the eye makeup operation, etc., according to the actual situation Choose flexibly.

In a possible implementation, the fusion parameter can be transparency. The target eye makeup result is multiplied by the transparency and then added to the used image to obtain the target user image. By changing the transparency in the fusion parameter, you can Change the transparency effect of the entire eye makeup.

Through the embodiments of the present disclosure, the target eye makeup result can be fused with the user image according to the fusion parameters in the eye makeup parameters to obtain the target user image. By changing the fusion parameters, it is easy to adjust the eye makeup effect, thereby improving the overall The flexibility and autonomy of the eye makeup process.

FIG. 5 shows a block diagram of an image processing device according to an embodiment of the present disclosure. As shown in the figure, the image processing device 20 may include:

The determination module 21 is configured to determine eye objects to be subjected to eye makeup processing in the user image in response to the eye makeup operation on the user image.

The dividing module 22 is used to divide the eye object into a plurality of target areas based on the hue information of the eye object and preset area parameters, wherein the scope of the target area is larger than the original target area, and the original target area is divided into multiple target areas based on the hue information. It is obtained by dividing the department object.

The eye makeup module 23 is configured to, according to the eye makeup parameters in the eye makeup operation, perform eye makeup processing on each of the multiple target areas matching the color tone of the target area to obtain multiple eye makeup results.

The generating module 24 is configured to generate target user images according to multiple eye makeup results.

In a possible implementation manner, the hue information includes at least one of the following: shadow information or midtone information; the dividing module is used for at least one of the following: based on the shadow information of the eye object, Extracting a shadow area from the eye object in combination with the first preset area parameter in the preset area parameters; or, based on the midtone information of the eye object, combining the first preset area parameter in the preset area parameters Two preset area parameters, extracting a midtone area from the eye object.

In a possible implementation manner, the target area includes at least one of the following: one or more of shadow areas and/or midtone areas; the eye makeup module is further configured to: respond to determining the target In response to determining that the target area includes a midtone area, it is determined that the processing includes normal blending in response to determining that the target area includes a shaded area.

This disclosure relates to the field of augmented reality. By acquiring the image information of the target object in the real environment, and then using various visual correlation algorithms to detect or identify the relevant features, states and attributes of the target object, and thus obtain the image information that matches the specific application. AR effect combining virtual and reality. Exemplarily, the target object may involve faces, limbs, gestures, actions, etc. related to the human body, or markers and markers related to objects, or sand tables, display areas or display items related to venues or places. Vision-related algorithms can involve visual positioning, SLAM, 3D reconstruction, image registration, background segmentation, object key point extraction and tracking, object pose or depth detection, etc. Specific applications can not only involve interactive scenes such as guided tours, navigation, explanations, reconstructions, virtual effect overlays and display related to real scenes or objects, but also special effects processing related to people, such as makeup beautification, body beautification, special effect display, virtual Interactive scenarios such as model display. The relevant features, states and attributes of the target object can be detected or identified through the convolutional neural network. The above-mentioned convolutional neural network is a network model obtained by performing model training based on a deep learning framework.

Application Scenario Example

In the field of computer vision, how to obtain realistic and rich eye makeup images has become an urgent problem to be solved.

The disclosed application example proposes an image processing method, including the following process:

Face recognition is performed based on the user image, the eye object is extracted from the user image, and the shadow area and the midtone area are separated for the eye object to obtain two target areas such as the high shadow area and the midtone area.

The process of shadow separation can include:

Multiply and mix the reverse grayscale image of the eye object and the reverse grayscale image of the eye object (for example, after copying the reverse grayscale image of the eye object, based on two identical reverse grayscale images Figures are multiplied and blended) to get the first blended result. Obtain the alpha channel value in the first mixed result, and multiply the alpha channel value by the first preset area parameter (such as 1.2, etc.) to obtain the first grayscale result. According to the black-white relationship of the first grayscale result, the second A grayscale result is mapped to transparency, so as to obtain the first transparency of each pixel in the eye object, and based on the first transparency, pixel points belonging to the shadow area are screened from the eye object to obtain the shadow area.

The process of separating midtones can include:

Perform exclusion blending of the grayscale image of the eye object and the grayscale image of the eye object (for example, after copying the reverse grayscale image of the eye object, perform exclusion blending based on two identical reverse grayscale images), A second mixed result is obtained. Obtain the alpha channel value in the second mixed result, and multiply the alpha channel value by the second preset area parameter (such as 1.2, etc.) to obtain the second grayscale result. According to the black-white relationship of the second grayscale result, the first The second grayscale result is mapped to transparency, thereby obtaining the second transparency of each pixel in the eye object, and based on the second transparency, the pixels belonging to the midtone area are screened from the eye object to obtain the midtone area.

After the shadow area and the midtone area are respectively obtained, the color parameters of the eye makeup input by the user can be mixed with the shadow area and the midtone area respectively to obtain the intermediate eye makeup results x and y respectively.

Multiply and mix the obtained intermediate eye makeup result x with the eye object to obtain the eye makeup result g;

The obtained intermediate eye makeup result y is normally mixed with the eye object to obtain the eye makeup result h.

Superimpose the two layers where the eye makeup results g and h are located, that is, pack them into a group, so as to obtain the target eye makeup result i, which can be fused with the user image to obtain the target user image, the target user image is an image obtained by performing the above-mentioned eye makeup processing on the eye object in the user image. Changing the transparency of i can change the transparency effect of the entire eye makeup color, wherein the target eye makeup result i can be fused with the target user image through normal mixing.

The image processing method proposed in the application example of the present disclosure can make the eye makeup effect more natural by processing the target areas of different tones, including the skin texture details of the eyes, and can realize the processing effect of what you see is what you get. Moreover, the method proposed in the embodiments of the present disclosure can achieve more parameter definitions, such as changing the color parameters of eye makeup in different target areas, changing the fusion parameters of the target eye makeup result and the user image, etc., so that the eye makeup effect is more predictable. control, which is convenient for users to customize beautification parameters according to their preferences. For example, a designer may need to change the color of eye shadow in eye makeup in the process of designing makeup. The method proposed in the application example of this disclosure can be used, or the method steps in the application example of this disclosure can be used According to the operation process, it is recorded as a set of actions and run in PS and other software, so that the eye makeup effect can be changed conveniently and quickly. It is also convenient for institutions to provide users with richer custom functions according to the methods in the application examples of the present disclosure. For example, software developers in institutions can incorporate the methods of the application examples of the disclosure into the underlying technology when developing makeup-related software , and retain the interface for modifying the eye makeup color, so as to facilitate color changes, etc.

It can be understood that the above-mentioned method embodiments mentioned in this disclosure can all be combined with each other to form a combined embodiment without violating the principle and logic. Due to space limitations, this disclosure will not repeat them.

Those skilled in the art can understand that in the above method of specific implementation, the writing order of each step does not mean a strict execution order and constitutes any limitation on the implementation process. The specific execution order of each step should be based on its function and possible The inner logic is OK.

Embodiments of the present disclosure also provide a computer-readable storage medium, on which computer program instructions are stored, and the above-mentioned method is implemented when the computer program instructions are executed by a processor. The computer readable storage medium may be a volatile computer readable storage medium or a nonvolatile computer readable storage medium.

An embodiment of the present disclosure also proposes an electronic device, including: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured as the above method.

In practical application, the above-mentioned memory can be volatile memory (volatile memory), such as RAM; or non-volatile memory (non-volatile memory), such as ROM, flash memory (flash memory), hard disk (Hard Disk Drive , HDD) or solid-state drive (Solid-State Drive, SSD); or a combination of the above types of memory, and provide instructions and data to the processor.

The aforementioned processor may be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor. It can be understood that, for different devices, the electronic device used to implement the above processor function may also be other, which is not specifically limited in this embodiment of the present disclosure.

Electronic devices may be provided as terminals, servers, or other forms of devices.

Based on the same technical idea as the foregoing embodiments, the embodiments of the present disclosure further provide a computer program, which implements the above method when the computer program is executed by a processor.

FIG. 6 is a block diagram of an electronic device 800 according to an embodiment of the present disclosure. For example, the electronic device 800 may be a terminal such as a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, or a personal digital assistant.

6, electronic device 800 may include one or more of the following components: processing component 802, memory 804, power supply component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814 , and the communication component 816.

The processing component 802 generally controls the overall operations of the electronic device 800, such as those associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above method. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802 .

The memory 804 is configured to store various types of data to support operations at the electronic device 800 . Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. The memory 804 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

The power supply component 806 provides power to various components of the electronic device 800 . Power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for electronic device 800 .

The multimedia component 808 includes a screen providing an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense a boundary of a touch or swipe action, but also detect duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 800 is in operation modes, such as call mode, recording mode and voice recognition mode. Received audio signals may be further stored in memory 804 or sent via communication component 816 . In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: a home button, volume buttons, start button, and lock button.

Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of electronic device 800 . For example, the sensor component 814 can detect the open/closed state of the electronic device 800, the relative positioning of components, such as the display and the keypad of the electronic device 800, the sensor component 814 can also detect the electronic device 800 or a Changes in position of components, presence or absence of user contact with electronic device 800 , electronic device 800 orientation or acceleration/deceleration and temperature changes in electronic device 800 . Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on communication standards, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related personnel information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wide Band (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation for performing the methods described above.

In an exemplary embodiment, there is also provided a non-volatile computer-readable storage medium, such as the memory 804 including computer program instructions, which can be executed by the processor 820 of the electronic device 800 to implement the above method.

FIG. 7 is a block diagram of an electronic device 1900 according to an embodiment of the present disclosure. For example, electronic device 1900 may be provided as a server. Referring to FIG. 7 , electronic device 1900 includes processing component 1922 , which further includes one or more processors, and a memory resource represented by memory 1932 for storing instructions executable by processing component 1922 , such as application programs. The application programs stored in memory 1932 may include one or more modules each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.

Electronic device 1900 may also include a power supply component 1926 configured to perform power management of electronic device 1900, a wired or wireless network interface 1950 configured to connect electronic device 1900 to a network, and an input-output (I/O) interface 1958 . The electronic device 1900 can operate based on an operating system stored in the memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™ or the like.

In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium, such as the memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to implement the above method.

The present disclosure can be a system, method and/or computer program product. A computer program product may include a computer readable storage medium having computer readable program instructions thereon for causing a processor to implement various aspects of the present disclosure.

A computer readable storage medium may be a tangible device that can retain and store instructions for use by an instruction execution device. A computer readable storage medium may be, for example, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or flash memory), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanically encoded device, such as a printer with instructions stored thereon A hole card or a raised structure in a groove, and any suitable combination of the above. As used herein, computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., pulses of light through fiber optic cables), or transmitted electrical signals.

Computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or downloaded to an external computer or external storage device over a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or a network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .

Computer program instructions for performing the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or Source or object code written in any combination, including object-oriented programming languages—such as Smalltalk, C++, etc., and conventional procedural programming languages—such as the “C” language or similar programming languages. Computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as via the Internet using an Internet service provider). connect). In some embodiments, electronic circuits, such as programmable logic circuits, field programmable gate arrays (FPGAs) or programmable logic arrays (PLAs), are personalized by utilizing status personnel information of computer readable program instructions, the electronic circuits Computer readable program instructions may be executed to implement various aspects of the present disclosure.

Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It should be understood that each block of the flowcharts and/or block diagrams, and combinations of blocks in the flowcharts and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine such that when executed by the processor of the computer or other programmable data processing apparatus , producing an apparatus for realizing the functions/actions specified in one or more blocks in the flowchart and/or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause computers, programmable data processing devices and/or other devices to work in a specific way, so that the computer-readable medium storing instructions includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks in flowcharts and/or block diagrams.

It is also possible to load computer-readable program instructions into a computer, other programmable data processing device, or other equipment, so that a series of operational steps are performed on the computer, other programmable data processing device, or other equipment to produce a computer-implemented process , so that instructions executed on computers, other programmable data processing devices, or other devices implement the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, a portion of a program segment, or an instruction that includes one or more Executable instructions. In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified function or action , or may be implemented by a combination of dedicated hardware and computer instructions.

Having described various embodiments of the present disclosure above, the foregoing description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and alterations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principle of each embodiment, practical application or technical improvement in the market, or to enable other ordinary skilled in the art to understand each embodiment disclosed herein.

Claims

An image processing method, comprising:

In response to an eye makeup operation on the user image, determine an eye object to be subjected to eye makeup processing in the user image;

Based on the hue information of the eye object and preset area parameters, the eye object is divided into a plurality of target areas, wherein the scope of the target area is larger than the original target area, and the original target area is based on the Hue information is obtained by dividing the eye object;

According to the eye makeup parameters in the eye makeup operation, perform eye makeup processing on each of the multiple target areas to match the color tone of the target area, to obtain multiple eye makeup results;

A target user image is generated according to the plurality of eye makeup results.
The method according to claim 1, characterized in that,

The determining the eye object to be subjected to eye makeup processing in the user image includes:

Perform key point recognition processing on the user image to determine the initial position of the eye object in the user image;

Copying the user images to multiple layers respectively;

For each layer in the plurality of layers, in the layer, the position is extended centering on the initial position to obtain an extended position, and according to the extended position, it is determined that the eye makeup treatment is to be performed in the layer Object.
The method according to claim 1 or 2, wherein the hue information includes at least one of shadow information or midtone information;

The dividing the eye object into multiple target areas based on the hue information of the eye object and preset area parameters includes at least one of the following operations:

Based on the shadow information of the eye object, combined with the first preset area parameter among the preset area parameters, extracting a shadow area from the eye object; or,

Based on the midtone information of the eye object and in combination with a second preset region parameter among the preset region parameters, a midtone region is extracted from the eye object.
The method according to claim 3, wherein, based on the shadow information of the eye object, the shadow is extracted from the eye object in combination with the first preset area parameter among the preset area parameters area, including:

Based on the reverse grayscale image of the eye object, perform multiplication and bottom blending to obtain a first blending result;

determining a first transparency of pixels in the eye object according to the first mixing result and the first preset area parameter;

According to the first preset transparency threshold and the first transparency, pixel points in the eye object are extracted to obtain the shadow area, wherein the shadow area is larger than the original shadow area, and the original shadow area is obtained by obtained by dividing the eye object based on the shadow information.
The method according to claim 3 or 4, wherein the midtone information based on the eye object is combined with the second preset area parameter in the preset area parameters, and the eye object Extract midtone areas, including:

Based on the grayscale image of the eye object, performing exclusion mixing to obtain a second mixing result;

determining a second transparency of pixels in the eye object according to the second mixing result and the second preset area parameter;

According to the second preset transparency threshold and the second transparency, pixel points in the eye object are extracted to obtain the midtone area, wherein the midtone area is larger than the original midtone area, and the original The midtone area is obtained by dividing the eye object based on the midtone information.
The method according to any one of claims 1 to 5, characterized in that, according to the eye makeup parameters in the eye makeup operation, the multiple target areas are respectively matched with the color tone of the target area eye makeup treatment for multiple eye makeup results, including:

According to the color parameters in the eye makeup parameters, the plurality of target areas are respectively rendered to obtain a plurality of intermediate eye makeup results;

According to the hues of the multiple target areas, determine processing modes corresponding to the multiple target areas;

According to the corresponding processing manners of the plurality of target areas, the eye objects are respectively mixed with the plurality of intermediate eye makeup results to obtain a plurality of eye makeup results.
The method according to claim 6, wherein the target area comprises at least one of the following:

shadow or midtone areas;

The determining the processing methods respectively corresponding to the multiple target areas according to the hues of the multiple target areas includes:

In response to determining that the target area includes a shaded area, determining that the processing includes multiply blending;

In response to determining that the target region includes a midtone region, it is determined that the processing includes normal blending.
The method according to any one of claims 1 to 7, wherein said generating target user images according to said multiple eye makeup results comprises:

superimposing the multiple eye makeup results to obtain the target eye makeup result;

According to the fusion parameters in the eye makeup parameters, the target eye makeup result is fused with the user image to obtain the target user image.
An image processing device, comprising:

A determining module, configured to determine an eye object to be subjected to eye makeup processing in the user image in response to an eye makeup operation on the user image;

A division module, configured to divide the eye object into a plurality of target areas based on the hue information of the eye object and preset area parameters, wherein the scope of the target area is larger than the original target area, and the original target area The region is obtained by dividing the eye object based on the hue information;

An eye makeup module, configured to perform eye makeup processing on the multiple target areas according to the eye makeup parameters in the eye makeup operation to match the color tone of the target areas, to obtain multiple eye makeup results;

A generating module, configured to generate target user images according to the plurality of eye makeup results.
An electronic device comprising:

processor;

memory for storing processor-executable instructions;

Wherein, the processor is configured to invoke instructions stored in the memory to execute the method according to any one of claims 1-8.
A computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.