WO2022042570A1

WO2022042570A1 - Image processing method and apparatus

Info

Publication number: WO2022042570A1
Application number: PCT/CN2021/114378
Authority: WO
Inventors: 王剑; 汪洋; 杨浩
Original assignee: 北京达佳互联信息技术有限公司
Priority date: 2020-08-24
Filing date: 2021-08-24
Publication date: 2022-03-03
Also published as: CN114095646B; CN114095646A

Abstract

The present disclosure relates to the technical field of computers. Provided are an image processing method and apparatus. The method comprises: by means of acquiring a target image including a part to be beautified and acquiring a coordinate value of a contour feature point of said part in the target image, and in combination with a predetermined configuration file, obtaining a grid structure of said part, and beautifying said part to obtain a beautified image.

Description

Image processing method and device

CROSS-REFERENCE TO RELATED APPLICATIONS

The present disclosure claims priority to Chinese patent application No. "202010859036.0" filed on Aug. 24, 2020, the entire contents of which are incorporated herein by reference.

technical field

The present disclosure relates to the field of computer technology, and in particular, to an image processing method and apparatus.

Background technique

With the development of smart phones, the performance of mobile phone computing and photography has been greatly improved. Especially in recent years, the more advanced AI processing functions have enabled mobile terminals to perform real-time operations, resulting in the birth of a large number of video recording applications with special effects.

Among all kinds of special effects, beauty is one of the most common special effects. For eye makeup, the real world eye makeup will have a smooth curve, which will bend upward when the eyes are closed, and straight or downward when the eyes are open. However, the grid structure currently constructed is too stable, resulting in unsatisfactory effects when using it for beauty. As shown in Figure 1, the overall grid structure cannot follow the flexible movement of the eyes, resulting in abnormal structure of the corners of the eyes when the eyes are closed. Among them, the M mark in Figure 1 shows that when the eyes are closed, the outer corner of the grid structure is still similar to that when the eyes are opened, but the eyelid part has moved downward as a whole, resulting in a large dislocation of this part of the image. That is, the effect indicated by the M mark in Figure 1.

SUMMARY OF THE INVENTION

The present disclosure provides an image processing method and apparatus.

According to a first aspect of the present disclosure, an image processing method is provided, comprising:

Get the target image that contains the makeup part;

Obtain the coordinate value of the contour feature point of the part to be beautified in the target image, as the target coordinate value;

According to the target coordinate value and the predetermined configuration file, the grid structure of the part to be beautified is obtained as the target grid structure;

According to the target grid structure, beauty makeup processing is performed on the beauty makeup part to obtain a beauty makeup image;

Wherein, the configuration file includes a preset triangle in the mesh structure of the part to be beautified and coordinate values of vertices of the preset triangle, and the preset triangle includes at least one first-type triangle and a A triangle of the second type corresponds to a triangle of the first type, the vertex of a triangle of the first type includes two stable points and a first extension point, and the vertex of a triangle of the second type includes the first extension point of the corresponding triangle of the first type , a switch point and a second expansion point;

The stable point and the switch point are respectively the point with the smallest movement range and the one with the largest movement range among the contour feature points of the beautified part in the process of changing from the first state to the second state of the beautified part. point, the first extension point and the second extension point are points set in advance according to the contour of the part to be beautified.

Optionally, the method further includes:

In response to the user's first operation, modifying the predetermined coordinate value of one of the first extension points in the configuration file;

save the modified configuration file;

The grid structure of the part to be beautified is obtained according to the target coordinate value and a predetermined configuration file, including:

According to the target coordinate value and the modified configuration file, the target grid structure is obtained.

Optionally, the coordinate value of the switch point in the second type of triangle is the coordinate value of the position of the switch point when the cosmetic part is in the first state, wherein a triangle of the second type is There is a target triangle corresponding to it, and the vertex of the target triangle includes the first expansion point in the corresponding second type of triangle, and the point on the position of the switch point when the cosmetic part is in the second state and the target point, the second type of triangle is similar to its corresponding target triangle;

The method also includes:

According to the similar relationship between the second type of triangle and its corresponding target triangle, as well as the coordinate value of the vertex of the second type of triangle, the point at the position of the switch point when the part to be beautified is in the second state The coordinate value of , calculate the coordinate value of the target point;

According to the coordinate value of the target point and the coordinate value of the second extension point, displaying the direction from the target point to the corresponding second extension point;

The second extension point corresponding to the target point is the second extension point in the second type of triangle corresponding to the target triangle to which the target point belongs.

The first operation is a user's modification operation on the coordinate value of a target point displayed on the target interface;

The modifying the predetermined coordinate value of one of the first extension points in the configuration file in response to the user's first operation includes:

According to the first operation, the modified coordinate value of a reference point is determined, and the reference point is the target point targeted by the first operation;

According to the target triangle to which the reference point belongs, the similarity relationship of the second type of triangle corresponding to the target triangle, and the target parameters, calculate the modified first extension point of the second type of triangle corresponding to the target triangle to which the reference point belongs. coordinate value;

Wherein, the target parameter includes the modified coordinate value of the reference point, the coordinate value of the point where the switch point is located when the cosmetic part is in the first state, and the cosmetic part is in the first state. In the second state, the coordinate value of the point where the switch point is located, and the coordinate value of the second extension point of the second type of triangle corresponding to the target triangle to which the reference point belongs.

Optionally, according to the target coordinate value and a predetermined configuration file, the grid structure of the part to be beautified is obtained, including:

Using the similar triangle algorithm, according to the coordinate value of the stable point in the contour feature points of the part to be beautified in the target image, and the coordinate value of the vertex of the first type triangle in the configuration file, the first type is calculated. The coordinate value of the extension point;

Using the similar triangle algorithm, according to the coordinate value of the switch point in the contour feature point of the part to be beautified in the target image, the coordinate value of the first type of extension point and the second type of triangle in the configuration file The coordinate value of the vertex is calculated to obtain the coordinate value of the second type of extension point;

According to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the target coordinate value, calculate the coordinate value of the third type of extension point;

Obtain the target grid structure according to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the coordinate value of the third type of extension point;

The first type of extension point is a point in the target grid structure that corresponds to the first extension point in the first type of triangle; the second type of extension point is in the target grid structure , the point corresponding to the second expansion point in the second type of triangle, and the third type of expansion point is the contour feature point of the makeup part in the target image except the contour feature point in the target image, all the Points other than the first type of extension point and the second type of extension point.

Optionally, the coordinate values of at least some points in the third type of extension points are determined by using a smooth transition or interpolation method.

Optionally, the preset triangle further includes at least one triangle of the third type, wherein the vertex of a triangle of the third type includes a third extension point and two of the points in the target set, and the third extension point is The points set in advance according to the contour of the part to be beautified, the target set includes the vertices of the first type of triangle and the vertex of the second type of triangle, as well as the contour feature points of the part to be beautified. points other than the stable point and the switching point;

According to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the target coordinate value, the coordinate value of the third type of extension point is calculated and obtained, including:

Using the similar triangle algorithm, according to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the target coordinate value, and the coordinate value of the vertex of the third type of triangle in the configuration file , and calculate the coordinate value of the third type of extension point.

Optionally, in the case where the cosmetic parts are eyes, the stable points are two corner points, and the switch point is the midpoint of the contour of the upper eyelid.

According to a second aspect of the present disclosure, there is provided an image processing apparatus, comprising:

an image acquisition module, configured to acquire a target image containing the part to be beautified;

A coordinate acquisition module, configured to acquire the coordinate value of the contour feature point of the part to be beautified in the target image, as the target coordinate value;

a grid structure acquisition module, configured to obtain the grid structure of the part to be beautified according to the target coordinate value and a predetermined configuration file, as a target grid structure;

an image drawing module, configured to perform beauty makeup processing on the beautified part according to the target grid structure to obtain a beauty makeup image;

Optionally, the device further includes:

a modification module, configured to modify the predetermined coordinate value of one of the first extension points in the configuration file in response to the user's first operation;

a saving module configured to save the modified configuration file;

The grid structure acquisition module is specifically configured as:

The device also includes:

The first calculation module is configured to describe the second type of triangle according to the similarity relationship between the second type of triangle and its corresponding target triangle, as well as the coordinate value of the vertex of the second type of triangle, when the part to be beauty makeup is in the second state. The coordinate value of the point at the position of the switch point, and the coordinate value of the target point is calculated;

a display module, configured to display a direction from the target point to the corresponding second extension point according to the coordinate value of the target point and the coordinate value of the second extension point;

The modification module includes:

a first determination submodule, configured to determine, according to the first operation, a modified coordinate value of a reference point, where the reference point is a target point targeted by the first operation;

The first calculation sub-module is configured to calculate the second type of triangle corresponding to the target triangle to which the reference point belongs, according to the target triangle to which the reference point belongs, the similarity relationship of the second type of triangle corresponding to the target triangle, and the target parameter. The modified coordinate value of the first extension point of the triangle;

Optionally, the grid structure acquisition module includes:

The second calculation sub-module is configured to adopt a similar triangle algorithm, according to the coordinate value of the stable point in the contour feature points of the part to be beautified in the target image, and the vertices of the first type of triangle in the configuration file. The coordinate value of , calculate the coordinate value of the first type of extension point;

The third calculation sub-module is configured to adopt a similar triangle algorithm, according to the coordinate value of the switch point in the contour feature points of the part to be beautified in the target image, the coordinate value of the first type of extension point and the The coordinate value of the vertex of the second type of triangle in the configuration file is calculated to obtain the coordinate value of the second type of extension point;

The fourth calculation submodule is configured to calculate the coordinate value of the third type of expansion point according to the coordinate value of the first type of expansion point, the coordinate value of the second type of expansion point and the target coordinate value;

A grid structure drawing submodule, configured to obtain the target grid according to the coordinate values of the first type of extension points, the coordinate values of the second type of extension points and the coordinate values of the third type of extension points structure;

The fourth computing submodule is specifically configured as:

According to a third aspect of the present disclosure, there is provided an electronic device, comprising:

processor;

a memory for storing the processor-executable instructions;

Wherein, the processor is configured to execute the operations performed by any one of the image processing methods described above.

According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein, when the instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute any one of the images described above. The action performed by the handler method.

According to a fifth aspect of the embodiments of the present disclosure, there is provided According to the fifth aspect of the embodiments of the present disclosure, there is provided a computer program product, comprising one or more instructions, the one or more instructions can be executed by a processor of an electronic device when executed , so that the electronic device can perform an operation performed by the image processing method provided by the present disclosure.

In the embodiment of the present disclosure, two stable points and a first expansion point are used to form a first type of triangle, and a first expansion point, a switching point and a second expansion point are used to form a second type of triangle, that is, a double similar triangle structure is used The triangles that make up the mesh structure of the part to be beautified form a configuration file, so that the configuration file and the coordinate values of the contour feature points of the part to be beautified in the target image are calculated to obtain the target mesh of the part to be beautified. According to the target grid structure, beauty makeup processing is performed on the part to be beautified to obtain a beauty makeup image.

Among them, the first type of triangle includes a stable point and a first expansion point, so that the state change of the part to be beautified has little effect on the verification result of the first expansion point, while the second type of triangle includes the first expansion point, The switch point and the second expansion point, when the second expansion point is checked, when the cosmetic part is in a different state, the change of the verification result of the second expansion point depends on the different states of the switch point in the beautified part. It can be seen that the target grid structure generated according to the above configuration file can follow the change of the state of the part to be beautified to produce different changes, so as to produce different cosmetic effects in different states of the part to be beautified.

It can be seen that, the embodiments of the present disclosure can produce different cosmetic effects in different states of the part to be beautified.

It should be noted here that the points included in the configuration file have a one-to-one correspondence with the points in the target grid structure to be calculated, and then an extension point in the configuration file is checked and calculated, that is, the calculation configuration file. The coordinates of the corresponding point in the target grid structure for this extension point in .

The above description is only an overview of the technical solutions of the present disclosure. In order to understand the technical means of the present disclosure more clearly, it can be implemented according to the contents of the description, and in order to make the above-mentioned and other purposes, features and advantages of the present disclosure more obvious and easy to understand , the following specific embodiments of the present disclosure are given.

Description of drawings

Various advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are for illustrating preferred embodiments only and are not to be considered limiting of the present disclosure. Also, the same components are denoted by the same reference numerals throughout the drawings. In the attached image:

FIG. 1 is a schematic diagram showing the comparison of the display and beauty effects of the human eye in different states using the grid structure constructed in the prior art;

2 is a flowchart of an image processing method according to Embodiment 1 of the present disclosure;

3 is a flowchart of an image processing method according to Embodiment 2 of the present disclosure;

4 is a schematic flowchart of a configuration file from design to use in an embodiment of the present disclosure;

5 is a schematic diagram of a design flow of a first-type triangle and a second-type triangle in an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of a point structure set for the cosmetic effect of the blinking eye corner extension in an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of a point structure set for the beauty effect of blinking the corner of the eye raised in an embodiment of the present disclosure;

8 is a schematic diagram of a first type of triangle formed in a configuration file in an embodiment of the present disclosure;

9 is a schematic diagram of a second type of triangle formed in a configuration file in an embodiment of the present disclosure;

10 is one of the schematic diagrams of the third type of triangle formed in a configuration file in an embodiment of the present disclosure;

11 is a second schematic diagram of a third type of triangle formed in a configuration file in an embodiment of the present disclosure;

12 is a schematic display diagram of a direction in which a target point points to its corresponding second expansion point in an embodiment of the present disclosure;

FIG. 13 is a schematic diagram showing a grid structure obtained by using a configuration file in an embodiment of the present disclosure in different states of the human eye and comparison of beauty effects;

14 is a structural block diagram of an image processing apparatus according to Embodiment 3 of the present disclosure;

15 is a structural block diagram of an image processing apparatus according to Embodiment 4 of the present disclosure;

16 is a structural block diagram of an electronic device according to Embodiment 5 of the present disclosure;

17 is a schematic diagram of the principle of solving one of the angles of a triangle formed by the three points with the coordinates of known three points in an embodiment of the present disclosure;

FIG. 18 is a schematic diagram of the principle of a similar triangle algorithm in an embodiment of the present disclosure.

detailed description

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as recited in the appended claims.

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be more thoroughly understood, and will fully convey the scope of the present disclosure to those skilled in the art.

Example 1

Referring to FIG. 2, an image processing method provided by an embodiment of the present disclosure is shown, and the image processing method may include the following steps:

Step 801: Acquire a target image including the part to be beautified.

The target image may be a locally stored image, an image captured in real time by an electronic device, or one of the images in a locally stored video file, or one of the video files captured in real time by an electronic device. frame image.

Step 802: Acquire the coordinate value of the contour feature point of the part to be beautified in the target image, as the target coordinate value.

Wherein, the above-mentioned contour feature points are points located on the contour of the part to be beautified.

Step 803: According to the target coordinate value and the predetermined configuration file, obtain the grid structure of the part to be beautified, as the target grid structure.

Wherein, the configuration file includes a preset triangle in the mesh structure of the part to be beautified and coordinate values of vertices of the preset triangle, and the preset triangle includes at least one first-type triangle and a A triangle of the second type corresponds to a triangle of the first type. The vertex of a triangle of the first type includes two stable points and a first extension point, and the vertex of a triangle of the second type includes the first extension point of the corresponding triangle of the first type. , a switch point and a second expansion point;

The stable point and the switch point are respectively the point with the smallest movement range and the one with the largest movement range among the contour feature points of the beautified part in the process of changing from the first state to the second state of the beautified part. point.

That is, the stable point is the point at which the movement range is the smallest among the contour feature points of the part to be made-up during the process of changing from the first state to the second state of the part to be made-up; During the process of the beauty makeup part changing from the first state to the second state, the point with the largest movement range among the contour feature points of the beauty makeup part, the first extension point and the second extension point It is a point set in advance according to the contour of the part to be beautified.

It can be seen from this that, in the embodiment of the present disclosure, the configuration file includes multiple points, and the multiple points include contour feature points of the part to be beautified and manually set points (ie, extension points). For example, the configuration file for eyes may include points 39-50, points 401-404, points 481-484, and points 423-478 as shown in FIG. 8, wherein points 39-50 in FIG. 8 are contour features Points, points 401 to 404, points 481 to 484, and points 423 to 478 are all extension points. The multiple points included in the configuration file form multiple triangles according to certain rules. The rules for forming triangles are predetermined.

Among them, the configuration file is used as the basis for generating the grid structure in the process of beautifying the part to be beautified. Specifically, using a known configuration file, when beautifying the part to be beautified, it is first necessary to obtain an image of the part to be beautified, and then detect the contour feature points of the part to be beautified in the image, and then extract the contour features from these contour features. The points corresponding to the contour feature points included in the configuration file are selected from the points as input parameters, and then the input parameters and configuration files are used to calculate the extension points that constitute the grid structure, and then all contour feature points included in the input parameters and All calculated extension points are drawn as a grid structure. Finally, using the drawn grid structure, the pre-drawn beautification picture is drawn to the part to be beautified, so as to realize the beauty of the part to be beautified.

Wherein, the specific process of determining the rule that multiple points in the configuration file form a triangle can be described as follows:

First of all, confirm the application scene, such as eye makeup, in the case of blinking, the outer corner of the eye has a problem of bending angle. In this problem, the motion scene is the "blink" and the area to be controlled is the "outer corner of the eye", then the goal is to get a point that moves reasonably with the blink, which can be called the "final point (ie, the second extension point)" ( That is, point F) in FIG. 5 .

Secondly, in order to get the final point (ie the second extension point), an intermediate point needs to be generated, which can be called a "leverage point (ie the first extension point)", which is also a manually set point. Among them, the calculation rules of similar triangles are followed, but the two AI points (ie, contour feature points) for checking and calculating it require special selection, that is, points with relatively stable positions during the blinking process need to be selected. This can ensure that the position of the lever point is stable during the entire movement process, which is convenient for subsequent processing. During the blinking process, the positions of the two points located at the corner of the eye are almost unchanged. Therefore, these two points are stable points, that is, the points A1 and A2 in Figure 5 are stable points, then the point A1 in Figure 5 is the stable point. , A2, and A form a triangle of the first kind.

Thirdly, it is also necessary to find the point (or structure) with the most obvious change in the whole blinking process, which is usually also found in the contour feature point. The movement trajectory of this point can be called the "switching path". Among them, during the blinking process, the "switch point" of the eye is obviously the center point of the upper eyelid, which has the largest movement range in the blinking action in the real world. Wherein, it is hoped that the movement trajectory of the "final point (ie, the second expansion point)" is synchronized with the movement rhythm of the switch point in the switch trajectory.

Finally, after finding the lever point and the switch point, these two can be used as input parameters for similar triangles to generate the final point (ie the second extension point), as shown in Figure 5, points A, S, F form a triangle (ie Points A, S, and F in Figure 5 form a second type of triangle). At this time, these three points will be similar to a lever (here is an analogy, not a complete equivalent), one end moves and the other end also makes corresponding movements. Therefore, the final point also has the characteristics of dynamic position change, and it will move synchronously with the switch point. point) is moved from the position of point F to the position of point F`.

It can be seen from the above that in the configuration file of the embodiment of the present disclosure, the first extension point of a first type of triangle is also used as the vertex of the second type of triangle. Therefore, the embodiment of the present invention adopts double similar triangles.

In addition, it should be noted that the above only describes the process of forming a first-type triangle and its corresponding second-type triangle. Using the same method as above, a plurality of first-type triangles and a second-type triangle corresponding to each first-type triangle can be obtained. For example, in the configuration file for eyes shown in FIG. 8 , points 401 to 404 are all lever points (ie, the first expansion point), points 481 to 484 are the final points (ie, the second expansion point), and point 42 is the switch point, the first type of triangles in this configuration file includes triangles connected by dashed lines as shown in FIG. 8 , and the second type of triangles includes triangles connected by dashed lines as shown in FIG. 9 .

Using the similar triangle algorithm, according to the coordinate value of the stable point in the contour feature points of the part to be beautified in the target image, and the coordinate value of the vertex of the first type of triangle in the configuration file, the first type of triangle is calculated. The coordinate value of the extension point;

In the embodiment of the present disclosure, the configuration file includes the first type of triangle and the second type of triangle, and the first extension point of the first type of triangle is also a vertex of the second type of triangle. Therefore, in the embodiment using the present disclosure configuration file, when calculating the expansion point of the target mesh structure, there is a calculation sequence, that is, the first expansion point of the first type of triangle is checked first, and then the second expansion point of the second type of triangle is checked. Specifically, for example, in the configuration file shown in Figure 8, it is necessary to first check the points 401 to 404 according to the triangle shown by the dotted line in Figure 8, and then check the points 481 to 484 according to the triangle shown by the dotted line in Figure 5, and then again , check other extension points in the static configuration file. Wherein, in the process of checking and calculating other extension points in the static configuration file, other extension points are checked and calculated based on the known points in the previous process (including the known contour feature points and the empirically calculated extension points).

Among them, after the verification of some extension points in the configuration file is completed, the related extension points adjacent to them can be generated by means of smooth transition or difference interpolation, which can reduce the amount of calculation and improve the processing speed.

It can be seen from this that, in the embodiment of the present disclosure, a configuration file may also include a third extension point, and two points among the contour feature points of the part to be beauty makeup, the first extension point, and the second extension point. , such as the triangles shown in dashed lines in Figures 10 and 11.

Specifically, the points included in the configuration file have a one-to-one correspondence with the points in the target grid structure to be calculated, and the preset triangles included in the configuration file are in a one-to-one relationship with the triangles included in the target grid structure. One-to-one correspondence and similarity, the above-mentioned similar triangle algorithm is used, according to the coordinate value of the stable point in the contour feature points of the part to be beautified in the target image, and the vertices of the first type of triangle in the configuration file. Coordinate value, the process of calculating the coordinate value of the first type of extension point is as follows:

According to the first type of triangle, the similarity relationship with the triangle corresponding to the first type of triangle in the target mesh structure, and the stable point in the contour feature points of the makeup part in the target image The coordinate value and the coordinate value of the vertex of the first type of triangle in the configuration file are calculated to obtain the coordinate value of the first type of extension point.

In the same way, the above "adopting the similar triangle algorithm, according to the coordinate value of the switch point in the contour feature point of the part to be beautified in the target image, the coordinate value of the first type of extension point and the The process of calculating the coordinate values of the vertices of the second type of triangle to obtain the coordinate value of the second type of extension point" is the same as the above process of "using the similar triangle algorithm, according to the coordinate value of the first type of extension point, the second type of extension point". The coordinate value of the point and the target coordinate value, as well as the coordinate value of the vertex of the third type of triangle in the configuration file, the process of calculating the coordinate value of the third type of extension point” is the same as the calculation here to obtain the first The specific process of a class of extension points is similar and will not be repeated here.

In summary, as shown in Figure 18, for the similar triangle algorithm, 5 known points need to be used, three of which are the points in the aforementioned configuration file (usually two AI points, one extension point), here we use it as Named as A, B, C (that is, A, B are AI points, C is an extension point). The other two points are provided by the AI module, and their values are the values of screen coordinates, which are named A` and B` here. In the grid structure, A and A`, B and B` represent the same point. The value of a point C` can be obtained through the knowledge of basic trigonometric functions, which satisfies △ABC∽△A`B`C`, where C` is an extension point of the grid structure to be constructed.

Among them, in the embodiment of the present disclosure, the preset triangle in the configuration file is similar to the triangle corresponding to the preset triangle in the above-mentioned target mesh structure, and the vertices of the two are in one-to-one correspondence, that is, the two are similar and have a unique direction, so the calculation The resulting extension point is unique.

Step 804 : According to the target grid structure, perform beauty makeup processing on the part to be beautified to obtain a beauty makeup image.

It can be seen from the above that in the embodiment of the present disclosure, two stable points and a first expansion point are used to form a first type of triangle, and a first expansion point, a switching point and a second expansion point are used to form a second type of triangle, that is, two Re-similar triangles construct the triangles that form the mesh structure of the part to be beautified to form a configuration file, so as to facilitate the configuration file and the coordinate values of the contour feature points of the part to be beautified in the target image, calculate and obtain the part to be beautified The target grid structure is based on the target grid structure, and then according to the target grid structure, beauty makeup processing is performed on the part to be beautified, and a beauty makeup image is obtained.

Embodiment 2

In this embodiment, it should be noted in advance that, as shown in FIG. 4 , a configuration file is first designed by the program developer in advance, and then provided to the beauty make-up staff, wherein the make-up staff can make the configuration file Modify to debug configuration files that can present different beauty effects, so that the beauty effects corresponding to the debugged configuration files can be released to experience users for use.

Referring to FIG. 3, an image processing method provided by an embodiment of the present disclosure is shown, and the image processing method may include the following steps:

Step 901: In response to the user's first operation, modify the coordinate value of one of the first extension points in the predetermined configuration file.

For the relevant description of the configuration file, and the specific process of determining the rule that multiple points in the configuration file form a triangle, reference may be made to the relevant description of Embodiment 1, and details are not repeated here.

Additionally, the first operation is for modifying one of the first extension points in the predetermined configuration file. In the embodiment of the present disclosure, a configuration file may include multiple first-type triangles, so a configuration file may include multiple first extension points, and each first extension point may be modified, so that the Adjust the beauty effect of different parts of the beauty part. For example, the points 401 to 404 shown in FIG. 8 are all the first expansion points, then the specific coordinate value of each point of the points 401 to 404 can be changed, so as to change the beauty effect of different parts, for example, the coordinates of the point 401 can be modified value to change the cosmetic effect at the corner of the eye indicated by the H arrow in Figure 8.

For example, in the configuration file obtained by modifying the coordinate value of point 401, in the two states of open and closed eyes, the generated grid structure is as shown in Figure 13. The effect can be shown in Figure 13, wherein, when the eyes are open, the beauty makeup effect at the P position shown in Figure 13 has an upturned effect, and when the eyes are closed, the beauty makeup effect at the Q position shown in Figure 13 The makeup effect is adjusted to be upturned instead of downturned.

13 , it can be seen from the comparison of FIG. 1 and FIG. 13 , that the corners of the eyes are bent obviously when the eyes are closed in the prior art makeup effect, but the image processing method according to the embodiment of the present disclosure is smoother overall and has a better bending effect.

Step 902: Save the modified configuration file.

Step 903: Acquire a target image including the part to be beautified.

Step 904: Acquire the coordinate value of the contour feature point of the part to be beautified in the target image as the target coordinate value.

Step 905: According to the target coordinate value and the modified configuration file, the grid structure of the part to be beautified is obtained as the target grid structure.

Step 906: According to the target grid structure, perform beauty makeup processing on the beauty makeup part to obtain a beauty makeup image.

It can be seen from the above that after the configuration file is determined, the beauty producer can generate the configuration file corresponding to different beauty effects by modifying the coordinate value of the first extension point in the configuration file, and save it, so that the modification can be directly used in the future. After the configuration files of various makeup effects are created, the images containing the makeup parts are processed.

Before the acquiring the target image including the part to be beautified, the method further includes:

It should be noted here that the coordinate value of the target point is the coordinate value of the position of the second expansion point corresponding to the target point when the beauty makeup part is in the second state. That is, the beauty makeup part changes from the first state to the second state, the second expansion point moves from the first position to the second position following the switch point, and the point at the second position forms a target point.

It can be seen from this that the grid structure of the part to be beautified composed of the preset triangles included in the configuration file can match the first state of the part to be beautified, and the direction from the target point to the corresponding second expansion point , which is used to indicate the movement track or movement trend of the second expansion point during the process of changing the beauty makeup part from the first state to the second state.

Among them, since the first expansion point is relatively stable, there is basically no need to consider its weak movement when the state of the cosmetic part changes. Therefore, the movement of the second expansion point depends on the movement of the switch point. As shown in Figure 6, it can be presumed that the movement end point of the switch point is the point S', then the movement end point F' of the second expansion point can be calculated, thus obtaining FF` is such a line segment, that is, the movement trajectory or movement trend of the second extension point.

In addition, by adjusting the position of the first expansion point, different motion trends of the second expansion point can be realized. For example, for the application scenario of blinking, by modifying the coordinate value of the first extension point (that is, the coordinate value of point A in Figure 6 and Figure 7 ), the two point structures shown in Figure 6 and Figure 7 can be obtained, Corresponding to the two effects of "blinking out the corner of the eye" (Figure 6) and "blinking the corner of the eye up" (Figure 7). The lifting effect of the corner of the eye is in line with the movement effect of the corner of the eye in the real world, and has very important practical significance. In addition, some effects that are not in line with the current world can also make special effects. For example, the falling of the corners of the eyes will create a very "weak" feeling. It also has practical significance in specific needs.

To sum up, in the embodiment of the present disclosure, a configuration file may include a plurality of second-type triangles, and when the second expansion point of each second-type triangle moves from the start position to the end position, will move accordingly, so that the movement direction or movement trend of the second expansion point of each second type of triangle can be obtained. For example, in the configuration file shown in Figure 12, after modifying the coordinate value of point A (ie, the first expansion point), an arrow pointing from F to F' is displayed, which can indicate the position from point F to point S following the switch point The movement trend of the movement to the position of point S`.

That is, in the embodiment of the present disclosure, the second expansion point in the configuration file can be displayed in real time, following the movement trend of the switch point. There is a one-to-one correspondence between the points in the configuration file and the points in the grid structure. Therefore, the second extension point in the configuration file, following the movement trend of the switch point, can represent the relationship between the second extension point in the grid structure and the second extension point in the configuration file. The corresponding point follows the movement trend of the switch point, so that the beauty producers can timely understand the changes in the grid structure generated after modifying a first expansion point, and then the changes caused by modifying the first expansion point can be avoided. There is a good estimate for the change of the beauty effect, that is, the second extension point of the second type of triangle to which the modified first extension point belongs, following the display of the movement trend of the switch point, provides adjustment for beauty producers. The basis for different cosmetic effects.

Optionally, a save button can be set on the interface showing the direction in which the above-mentioned target point points to the second extension point corresponding to it, and the beauty producer can point to the corresponding second extension point from the target point through the previously displayed target point. If it is estimated that the modified configuration file can achieve the desired beauty effect, you can click the save button to save the modified configuration file.

Optionally, the first operation is a first drag operation performed by the user on a displayed first extension point;

obtaining the coordinate value of the termination position of the first drag operation;

Determine the coordinate value of the end position of the drag operation as the modified coordinate value of the dragged first extension point.

It can be seen from this that, in the embodiment of the present disclosure, each first extension point can be displayed, and the beauty producer can drag any one of the first extension points to modify the coordinate value of the first extension point , that is, to which position the displayed first extension point is dragged, and the coordinate value at which position is the coordinate value of the modified first extension point, which greatly facilitates the makeup production staff to adjust the first extension point. Revise.

In the embodiment of the present disclosure, the ultimate purpose of modifying the coordinate value of the first extension point is to change the second extension point of the second type of triangle to which the first extension point belongs, following the movement trend of the switch point, as shown in FIG. 12 , The purpose of modifying the coordinate value of point A is to change the direction that F points to F`, and point F is a point set in the configuration file, that is, it is a known point, so you want to change the direction of point F to point F', The position of the point F' can also be changed. Therefore, in the embodiment of the present disclosure, the point F' can also be displayed, so that the beauty producer can directly drag the point F' to make the point F point in the direction of the point F'. adjustment is more flexible.

However, this method needs to infer the position of the first expansion point A based on the point F`. It should be noted that the equation system to be solved in reverse is a binary quadratic equation system, and there is no solution, which needs to be handled reasonably.

In some embodiments, when the position of the first expansion point A is inferred from the point F', a calculation formula can be derived as follows. As shown in Figure 17, the coordinates of three points are known: D(X1,Y1), B(X2,Y2), C(X3,Y3), then when solving the angle ∠BDC, first, based on D point, make X The parallel line of the axis, and take point E at its positive distal end, so as to obtain ∠BDC=∠EDB-∠EDC; secondly, make the vertical line of DE based on the two points B and C respectively, and obtain the two points B` and C` , where the coordinates of B` are (x2, y1), and the coordinates of C` are (x3, y1); again, the following calculations can be performed according to Figure 17 and the coordinates of the known points above:

cos∠BDC=cos(∠EDB-∠EDC)

=cos∠EDB*cos∠EDC+sin∠EDB*sin∠EDC

＝|DB`|/|DB|*|DC`|/|DC|+|BB`|/|DB|*|CC`|/|DC|

=[(x2-x1)(x3-x1)+(y2-y1)(y3-y1)]/|DB||DC|

After the above analysis, the target formula can be obtained:

cos∠BDC=[(x2-x1)(x3-x1)+(y2-y1)(y3-y1)]/|DB||DC|.

At this time, the position of the first expansion point A can be reversely deduced based on the point F' by using the above formula. That is, as shown in Figure 12, due to △F`AS`∽△FAS, there are ∠F`AS`=∠FAS, ∠F`S`A=∠FSA, so that cos∠F`AS`=cos∠ FAS, cos∠F`S`A=cos∠FSA, then the coordinates of point A are unknown, let it be (x, y), and the coordinates of F, F`, S, S` are all known, then you can According to cos∠F`AS`=cos∠FAS, cos∠F`S`A=cos∠FSA, and the above target formula to obtain the binary quadratic equation system about x and y, then the binary quadratic equation can be obtained based on the The group solves to get the coordinates of point A.

Among them, it should be noted that, based on the characteristics of the binary quadratic equation system, there may be 0, 1, 2, and infinitely many solutions in the number of solutions under different discriminants. Therefore, when the position of the lever point A is reversed based on the point F', there may be no solution.

Optionally, in the case where the cosmetic parts are eyes, the stable points are two corner points, and the switch point is the midpoint of the contour of the upper eyelid. That is, the image processing method in the embodiment of the present disclosure can be applied to the beauty makeup of the eyes. It should be noted that the image processing method in the embodiment of the present disclosure is not limited to be applied to the beauty makeup of the eyes, but can also be applied to other parts of the human face. makeup.

In addition, it should be noted that, in the configuration file in the embodiment of the present disclosure, the extension point of one triangle is also used as the vertex of another triangle. Therefore, the embodiment of the present invention adopts a double similar triangle. The double similar triangle can be extended to more similar triangles, the principle is the same, and will not be repeated here.

To sum up, the embodiments of the present disclosure provide a complete implementation scheme of the variable bending angle of beauty makeup by using multiple combinations of similar triangle algorithms, so as to make the beauty makeup effect more natural, and provide a set of efficient implementation of double similarity The tool implementation scheme of triangle algorithm configuration can greatly reduce the difficulty of configuration.

In addition, for the setting of extension points, the construction logic can be developed for a specific point through coding, the changes will be very flexible, and the performance of the performance is highly dependent on the code logic, which can achieve more peculiar and more natural effects. However, this method has a large workload, and the effect is flexible but the production is not flexible. However, this method can be mixed with the double similar triangle scheme and the common basic similar triangle scheme adopted in the embodiments of the present disclosure.

Embodiment 3

Referring to FIG. 14 , an image processing apparatus provided by an embodiment of the present disclosure is shown. The image processing apparatus 200 may include:

The image acquisition module 2001 is configured to acquire a target image including the part to be beautified;

The coordinate acquisition module 2002 is configured to acquire the coordinate value of the contour feature point of the part to be beautified in the target image, as the target coordinate value;

The grid structure acquisition module 2003 is configured to obtain the grid structure of the part to be beautified according to the target coordinate value and a predetermined configuration file, as the target grid structure;

The image drawing module 2004 is configured to, according to the target grid structure, perform beauty makeup processing on the beauty makeup part to obtain a beauty makeup image;

Embodiment 4

Referring to FIG. 15 , an image processing apparatus provided by an embodiment of the present disclosure is shown. The image processing apparatus 210 may include:

The image acquisition module 2101 is configured to acquire the target image including the part to be beautified;

The coordinate obtaining module 2102 is configured to obtain the coordinate value of the contour feature point of the part to be beautified in the target image, as the target coordinate value;

The grid structure acquisition module 2103 is configured to obtain the grid structure of the part to be beautified according to the target coordinate value and a predetermined configuration file, as the target grid structure;

The image drawing module 2104 is configured to, according to the target grid structure, perform beauty makeup processing on the beautified part to obtain a beauty makeup image;

Optionally, the device further includes:

A modification module 2105, configured to modify the predetermined coordinate value of one of the first extension points in the configuration file in response to the first operation of the user;

A saving module 2106, configured to save the modified configuration file;

The grid structure acquisition module 2103 is specifically configured as:

The device also includes:

The first calculation module 2107 is configured to be based on the similarity relationship between the second type of triangle and its corresponding target triangle, and the coordinate values of the vertexes of the second type of triangle, which are determined when the beauty makeup part is in the second state. The coordinate value of the point on the position where the switch point is located, and the coordinate value of the target point is calculated;

The display module 2108 is configured to display the direction from the target point to the corresponding second extension point according to the coordinate value of the target point and the coordinate value of the second extension point;

The modification module 2105 includes:

The first determination sub-module 21051 is configured to determine, according to the first operation, a modified coordinate value of a reference point, where the reference point is the target point for the first operation;

The first calculation sub-module 21052 is configured to calculate the second corresponding to the target triangle to which the reference point belongs according to the target triangle to which the reference point belongs, the similarity relationship of the second type of triangle corresponding to the target triangle, and the target parameters. The modified coordinate value of the first extension point of the quasi-triangle;

Optionally, the grid structure acquisition module 2103 includes:

The second calculation sub-module 21031 is configured to use a similar triangle algorithm, according to the coordinate value of the stable point in the contour feature points of the part to be beautified in the target image, and the first type of triangle in the configuration file. The coordinate value of the vertex is calculated to obtain the coordinate value of the first type of extension point;

The third calculation sub-module 21032 is configured to use the similar triangle algorithm, according to the coordinate value of the switch point in the contour feature points of the makeup part in the target image, the coordinate value of the first type of extension point, and all The coordinate value of the vertex of the second type of triangle in the configuration file is calculated to obtain the coordinate value of the second type of extension point;

The fourth calculation sub-module 21033 is configured to calculate the coordinate value of the third type of extension point according to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the target coordinate value;

The grid structure drawing sub-module 21034 is configured to obtain the target mesh according to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the coordinate value of the third type of extension point lattice structure;

The fourth calculation sub-module 21033 is specifically configured as:

Regarding the apparatus in the above-mentioned embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be described in detail here.

Embodiment 5

Referring to FIG. 16 , a structural block diagram of an electronic device provided by the present disclosure is shown.

The electronic device of the present disclosure may include: a memory, a processor, and a program stored on the memory and executable on the processor for determining the execution of an action, for determining that the action execution program is executed by the processor to achieve the described in the present disclosure The steps of any image processing method.

FIG. 16 is a block diagram of an electronic device 2200 according to an exemplary embodiment. For example, electronic device 2200 may be a mobile phone, computer, digital broadcast electronic device, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, and the like.

16, an electronic device 2200 may include one or more of the following components: a processing component 2202, a memory 2204, a power supply component 2206, a multimedia component 2208, an audio component 2210, an input/output (I/O) interface 2212, a sensor component 2214 , and the communication component 2216.

The processing component 2202 generally controls the overall operation of the device 2200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 2202 may include one or more processors 2220 to execute instructions to perform all or part of the steps of the above-described image processing method. Additionally, processing component 2202 may include one or more modules that facilitate interaction between processing component 2202 and other components. For example, processing component 2202 may include a multimedia module to facilitate interaction between multimedia component 2208 and processing component 2202.

The memory 2204 is configured to store various types of data to support operation at the electronic device 2200 . Examples of such data include instructions for any application or method operating on electronic device 2200, contact data, phonebook data, messages, pictures, videos, and the like. Memory 2204 may be implemented by any type of volatile or non-volatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

Power supply component 2206 provides power to various components of electronic device 2200. Power supply components 2206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 2200 .

Multimedia component 2208 includes a screen that provides an output interface between the electronic device 2200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 2208 includes a front-facing camera and/or a rear-facing camera. When the electronic device 2200 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.

Audio component 2210 is configured to output and/or input audio signals. For example, audio component 2210 includes a microphone (MIC) that is configured to receive external audio signals when electronic device 2200 is in operating modes, such as call mode, recording mode, and voice recognition mode. The received audio signal may be further stored in memory 2204 or transmitted via communication component 2216. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 2212 provides an interface between the processing component 2202 and a peripheral interface module, which may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.

Sensor assembly 2214 includes one or more sensors for providing status assessments of various aspects of electronic device 2200 . For example, the sensor component 2214 can detect the open/closed state of the electronic device 2200, the relative positioning of components, such as the display and the keypad of the electronic device 2200, the sensor component 2214 can also detect the electronic device 2200 or one of the electronic device 2200 The location of components changes, the presence or absence of user contact with the electronic device 2200, the orientation or acceleration/deceleration of the device 2200, and the temperature of the electronic device 2200 changes. Sensor assembly 2214 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor assembly 2214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 2214 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 2216 is configured to facilitate wired or wireless communication between electronic device 2200 and other devices. Electronic device 2200 may access wireless networks based on communication standards, such as WiFi, 2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 2216 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 2216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, electronic device 2200 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform any one of the image processing methods described in this disclosure.

In an exemplary embodiment, a computer-readable storage medium including instructions, such as a memory 2204 including instructions, is also provided, and the instructions can be executed by the processor 2220 of the electronic device 2200 to complete the image processing method described above. For example, the computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is enabled to perform the steps of any one of the image processing methods described in the present disclosure. As for the apparatus embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for related parts.

All the embodiments of the present disclosure are implemented independently, and may also be implemented in combination with other embodiments, which are all regarded as the protection scope required by the present disclosure.

The information extraction schemes presented herein are not inherently related to any particular computer, virtual system, or other device. Various general-purpose systems can also be used with teaching based on this. From the above description, the structure required to construct a system having the present disclosure is apparent. Furthermore, this disclosure is not directed to any particular programming language. It should be understood that various programming languages may be used to implement the disclosures described herein and that the descriptions of specific languages above are intended to disclose the best mode of the disclosure.

In the description provided herein, numerous specific details are set forth. It will be understood, however, that embodiments of the present disclosure may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it will be appreciated that in the above description of exemplary embodiments of the present disclosure, various features of the present disclosure are sometimes grouped together into a single embodiment, figure, or its description. However, this method of disclosure should not be interpreted as reflecting an intention that the claimed disclosure requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of the present disclosure.

Those skilled in the art will understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. The modules or units or components in the embodiments may be combined into one module or unit or component, and further they may be divided into multiple sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method so disclosed may be employed in any combination unless at least some of such features and/or procedures or elements are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that although some of the embodiments described herein include certain features, but not others, included in other embodiments, that combinations of features of different embodiments are intended to be within the scope of the present disclosure within and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.

Various component embodiments of the present disclosure may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or digital signal processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in the information extraction scheme according to the present disclosure. The present disclosure can also be implemented as apparatus or apparatus programs (eg, computer programs and computer program products) for performing some or all of the methods described herein. Such a program implementing the present disclosure may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.

It should be noted that the above-described embodiments illustrate rather than limit the disclosure, and that alternative embodiments may be devised by those skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present disclosure may be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names.

Claims

An image processing method, comprising:

Get the target image that contains the makeup part;

Obtain the coordinate value of the contour feature point of the part to be beautified in the target image, as the target coordinate value;

According to the target coordinate value and the predetermined configuration file, the grid structure of the part to be beautified is obtained as the target grid structure;

According to the target grid structure, beauty makeup processing is performed on the beauty makeup part to obtain a beauty makeup image;

Wherein, the configuration file includes a preset triangle in the mesh structure of the part to be beautified and coordinate values of vertices of the preset triangle, and the preset triangle includes at least one first-type triangle and a A triangle of the second type corresponds to a triangle of the first type. The vertex of a triangle of the first type includes two stable points and a first extension point, and the vertex of a triangle of the second type includes the first extension point of the corresponding triangle of the first type. , a switch point and a second expansion point;

The stable point and the switch point are respectively the point with the smallest movement range and the one with the largest movement range among the contour feature points of the beautified part in the process of changing from the first state to the second state of the beautified part. point, the first extension point and the second extension point are points set in advance according to the contour of the part to be beautified.
The image processing method according to claim 1, wherein the method further comprises:

In response to the user's first operation, modifying the predetermined coordinate value of one of the first extension points in the configuration file;

save the modified configuration file;

The grid structure of the part to be beautified is obtained according to the target coordinate value and a predetermined configuration file, including:

According to the target coordinate value and the modified configuration file, the target grid structure is obtained.
The image processing method according to claim 1, wherein the coordinate value of the switch point in the second type of triangle is the coordinate value of the position of the switch point when the part to be beautified is in the first state value, wherein, a second-type triangle has a corresponding target triangle, and the vertex of the target triangle includes the first extension point in the corresponding second-type triangle, and the value of the target triangle when the makeup part is in the second state. The point on the position where the switch point is located and the target point, the second type of triangle is similar to its corresponding target triangle;

The method also includes:

According to the similar relationship between the second type of triangle and its corresponding target triangle, as well as the coordinate value of the vertex of the second type of triangle, the point at the position of the switch point when the part to be beautified is in the second state The coordinate value of , calculate the coordinate value of the target point;

According to the coordinate value of the target point and the coordinate value of the second extension point, displaying the direction from the target point to the corresponding second extension point;

The second extension point corresponding to the target point is the second extension point in the second type of triangle corresponding to the target triangle to which the target point belongs.
The image processing method according to claim 2, wherein the coordinate value of the switch point in the second type of triangle is the coordinate value of the position of the switch point when the part to be beautified is in the first state value, wherein, a second-type triangle has a corresponding target triangle, and the vertex of the target triangle includes the first extension point in the corresponding second-type triangle, and the value of the target triangle when the makeup part is in the second state. The point on the position where the switch point is located and the target point, the second type of triangle is similar to its corresponding target triangle;

The first operation is a user's modification operation on the coordinate value of a target point displayed on the target interface;

The modifying the predetermined coordinate value of one of the first extension points in the configuration file in response to the user's first operation includes:

According to the first operation, the modified coordinate value of a reference point is determined, and the reference point is the target point targeted by the first operation;

According to the target triangle to which the reference point belongs, the similarity relationship of the second type of triangle corresponding to the target triangle, and the target parameters, calculate the modified first extension point of the second type of triangle corresponding to the target triangle to which the reference point belongs. coordinate value;

Wherein, the target parameter includes the modified coordinate value of the reference point, the coordinate value of the point where the switch point is located when the cosmetic part is in the first state, and the cosmetic part is in the first state. In the second state, the coordinate value of the point where the switch point is located, and the coordinate value of the second extension point of the second type of triangle corresponding to the target triangle to which the reference point belongs.
The image processing method according to claim 1, wherein, according to the target coordinate value and a predetermined configuration file, the grid structure of the part to be beautified is obtained, comprising:

Using the similar triangle algorithm, according to the coordinate value of the stable point in the contour feature points of the part to be beautified in the target image, and the coordinate value of the vertex of the first type of triangle in the configuration file, the first type of triangle is calculated. The coordinate value of the extension point;

Using the similar triangle algorithm, according to the coordinate value of the switch point in the contour feature point of the part to be beautified in the target image, the coordinate value of the first type of extension point and the second type of triangle in the configuration file The coordinate value of the vertex is calculated to obtain the coordinate value of the second type of extension point;

According to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the target coordinate value, calculate the coordinate value of the third type of extension point;

Obtain the target grid structure according to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the coordinate value of the third type of extension point;

The first type of extension point is a point in the target grid structure that corresponds to the first extension point in the first type of triangle; the second type of extension point is in the target grid structure , the point corresponding to the second expansion point in the second type of triangle, and the third type of expansion point is the contour feature point of the makeup part in the target image except the contour feature point in the target image, all the Points other than the first type of extension point and the second type of extension point.
The image processing method according to claim 5, wherein the coordinate values of at least some points in the third type of extension points are determined by using a smooth transition or interpolation method.
The image processing method according to claim 5, wherein the preset triangle further comprises at least one triangle of the third type, wherein the vertex of a triangle of the third type comprises a third extension point and two of the target set point, the third extension point is a point set in advance according to the contour of the part to be beautified, the target set includes the vertices of the first type of triangles and the vertices of the second type of triangles, and the Other points except the stable point and the switch point in the contour feature points of the part to be beauty makeup;

According to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the target coordinate value, the coordinate value of the third type of extension point is calculated and obtained, including:

Using the similar triangle algorithm, according to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the target coordinate value, and the coordinate value of the vertex of the third type of triangle in the configuration file , and calculate the coordinate value of the third type of extension point.
The image processing method according to claim 1, wherein, in the case that the beauty makeup parts are eyes, the stable points are two corner points, and the switch point is the midpoint of the contour of the upper eyelid.
An image processing device, comprising:

an image acquisition module, configured to acquire a target image containing the part to be beautified;

A coordinate acquisition module, configured to acquire the coordinate value of the contour feature point of the part to be beautified in the target image, as the target coordinate value;

a grid structure acquisition module, configured to obtain the grid structure of the part to be beautified according to the target coordinate value and a predetermined configuration file, as a target grid structure;

an image drawing module, configured to perform beauty makeup processing on the beautified part according to the target grid structure to obtain a beauty makeup image;

Wherein, the configuration file includes a preset triangle in the mesh structure of the part to be beautified and coordinate values of vertices of the preset triangle, and the preset triangle includes at least one first-type triangle and a A triangle of the second type corresponds to a triangle of the first type. The vertex of a triangle of the first type includes two stable points and a first extension point, and the vertex of a triangle of the second type includes the first extension point of the corresponding triangle of the first type. , a switch point and a second expansion point;

The stable point and the switch point are respectively the point with the smallest movement range and the one with the largest movement range among the contour feature points of the beautified part in the process of changing from the first state to the second state of the beautified part. point, the first extension point and the second extension point are points set in advance according to the contour of the part to be beautified.
The image processing apparatus according to claim 9, wherein the apparatus further comprises:

a modification module, configured to modify the predetermined coordinate value of one of the first extension points in the configuration file in response to the user's first operation;

a saving module configured to save the modified configuration file;

The grid structure acquisition module is specifically configured as:

According to the target coordinate value and the modified configuration file, the target grid structure is obtained.
The image processing device according to claim 9, wherein the coordinate value of the switch point in the second type of triangle is the coordinate value of the position of the switch point when the part to be beautified is in the first state value, wherein, a second-type triangle has a corresponding target triangle, and the vertex of the target triangle includes the first extension point in the corresponding second-type triangle, and the value of the target triangle when the makeup part is in the second state. The point on the position where the switch point is located and the target point, the second type of triangle is similar to its corresponding target triangle;

The device also includes:

The first calculation module is configured to describe the second type of triangle according to the similarity relationship between the second type of triangle and its corresponding target triangle, as well as the coordinate value of the vertex of the second type of triangle, when the part to be beauty makeup is in the second state. The coordinate value of the point at the position of the switch point, and the coordinate value of the target point is calculated;

a display module, configured to display a direction from the target point to the corresponding second extension point according to the coordinate value of the target point and the coordinate value of the second extension point;

The second extension point corresponding to the target point is the second extension point in the second type of triangle corresponding to the target triangle to which the target point belongs.
The image processing device according to claim 10, wherein the coordinate value of the switch point in the second type of triangle is the coordinate value of the position of the switch point when the part to be beautified is in the first state value, wherein, a second-type triangle has a corresponding target triangle, and the vertex of the target triangle includes the first extension point in the corresponding second-type triangle, and the value of the target triangle when the makeup part is in the second state. The point on the position where the switch point is located and the target point, the second type of triangle is similar to its corresponding target triangle;

The first operation is a user's modification operation on the coordinate value of a target point displayed on the target interface;

The modification module includes:

a first determination submodule, configured to determine, according to the first operation, a modified coordinate value of a reference point, where the reference point is a target point targeted by the first operation;

The first calculation sub-module is configured to calculate the second type of triangle corresponding to the target triangle to which the reference point belongs, according to the target triangle to which the reference point belongs, the similarity relationship of the second type of triangle corresponding to the target triangle, and the target parameter. The modified coordinate value of the first extension point of the triangle;

Wherein, the target parameter includes the modified coordinate value of the reference point, the coordinate value of the point where the switch point is located when the cosmetic part is in the first state, and the cosmetic part is in the first state. In the second state, the coordinate value of the point where the switch point is located, and the coordinate value of the second extension point of the second type of triangle corresponding to the target triangle to which the reference point belongs.
The image processing apparatus according to claim 9, wherein the grid structure acquisition module comprises:

The second calculation sub-module is configured to adopt a similar triangle algorithm, according to the coordinate value of the stable point in the contour feature points of the part to be beautified in the target image, and the vertices of the first type of triangle in the configuration file. The coordinate value of , calculate the coordinate value of the first type of extension point;

The third calculation sub-module is configured to adopt a similar triangle algorithm, according to the coordinate value of the switch point in the contour feature points of the part to be beautified in the target image, the coordinate value of the first type of extension point and the The coordinate value of the vertex of the second type of triangle in the configuration file is calculated to obtain the coordinate value of the second type of extension point;

The fourth calculation submodule is configured to calculate the coordinate value of the third type of expansion point according to the coordinate value of the first type of expansion point, the coordinate value of the second type of expansion point and the target coordinate value;

A grid structure drawing submodule, configured to obtain the target grid according to the coordinate values of the first type of extension points, the coordinate values of the second type of extension points and the coordinate values of the third type of extension points structure;

The first type of extension point is a point in the target grid structure that corresponds to the first extension point in the first type of triangle; the second type of extension point is in the target grid structure , the point corresponding to the second expansion point in the second type of triangle, and the third type of expansion point is the contour feature point of the makeup part in the target image except the contour feature point in the target image, all the Points other than the first type of extension point and the second type of extension point.
The image processing apparatus according to claim 13, wherein the coordinate values of at least some points in the third type of extension points are determined by using a smooth transition or interpolation method.
The image processing apparatus according to claim 13, wherein the preset triangle further comprises at least one third type of triangle, wherein a vertex of one third type of triangle comprises a third extension point and two of the target set point, the third extension point is a point set in advance according to the contour of the part to be beautified, the target set includes the vertices of the first type of triangles and the vertices of the second type of triangles, and the Other points except the stable point and the switch point in the contour feature points of the part to be beauty makeup;

The fourth computing submodule is specifically configured as:

Using the similar triangle algorithm, according to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the target coordinate value, and the coordinate value of the vertex of the third type of triangle in the configuration file , and calculate the coordinate value of the third type of extension point.
The image processing device according to claim 9, wherein, in the case where the beauty makeup parts are eyes, the stable points are two corner points, and the switching point is a midpoint of the contour of the upper eyelid.
An electronic device comprising:

processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to perform the following steps:

Get the target image that contains the makeup part;

Obtain the coordinate value of the contour feature point of the part to be beautified in the target image, as the target coordinate value;

According to the target coordinate value and the predetermined configuration file, the grid structure of the part to be beautified is obtained as the target grid structure;

According to the target grid structure, beauty makeup processing is performed on the beauty makeup part to obtain a beauty makeup image;

Wherein, the configuration file includes a preset triangle in the mesh structure of the part to be beautified and coordinate values of vertices of the preset triangle, and the preset triangle includes at least one first-type triangle and a A triangle of the second type corresponds to a triangle of the first type. The vertex of a triangle of the first type includes two stable points and a first extension point, and the vertex of a triangle of the second type includes the first extension point of the corresponding triangle of the first type. , a switch point and a second expansion point;

The stable point and the switch point are respectively the point with the smallest movement range and the one with the largest movement range among the contour feature points of the beautified part in the process of changing from the first state to the second state of the beautified part. point, the first extension point and the second extension point are points set in advance according to the contour of the part to be beautified.
The electronic device of claim 17, wherein the processor is further configured to perform the steps of:

In response to the user's first operation, modifying the predetermined coordinate value of one of the first extension points in the configuration file;

save the modified configuration file;

The grid structure of the part to be beautified is obtained according to the target coordinate value and a predetermined configuration file, including:

According to the target coordinate value and the modified configuration file, the target grid structure is obtained.
The electronic device according to claim 17, wherein the coordinate value of the switch point in the second type of triangle is the coordinate value of the position of the switch point when the part to be beautified is in the first state , wherein, a second-type triangle has a corresponding target triangle, and the vertex of the target triangle includes the first expansion point in the corresponding second-type triangle, and the makeup part is in the second state. The point at the position of the switch point and the target point, the second type of triangle is similar to its corresponding target triangle;

The processor is also configured to perform the following steps:

According to the similar relationship between the second type of triangle and its corresponding target triangle, as well as the coordinate value of the vertex of the second type of triangle, the point at the position of the switch point when the part to be beautified is in the second state The coordinate value of , calculate the coordinate value of the target point;

According to the coordinate value of the target point and the coordinate value of the second extension point, displaying the direction from the target point to the corresponding second extension point;

The second extension point corresponding to the target point is the second extension point in the second type of triangle corresponding to the target triangle to which the target point belongs.
The electronic device according to claim 18, wherein the coordinate value of the switch point in the second type of triangle is the coordinate value of the position of the switch point when the part to be beautified is in the first state , wherein, a second-type triangle has a corresponding target triangle, and the vertex of the target triangle includes the first expansion point in the corresponding second-type triangle, and the makeup part is in the second state. The point at the position of the switch point and the target point, the second type of triangle is similar to its corresponding target triangle;

The first operation is a user's modification operation on the coordinate value of a target point displayed on the target interface;

The processor is also configured to perform the following steps:

According to the first operation, the modified coordinate value of a reference point is determined, and the reference point is the target point targeted by the first operation;

According to the target triangle to which the reference point belongs, the similarity relationship of the second type of triangle corresponding to the target triangle, and the target parameters, calculate the modified first extension point of the second type of triangle corresponding to the target triangle to which the reference point belongs. coordinate value;

Wherein, the target parameter includes the modified coordinate value of the reference point, the coordinate value of the point where the switch point is located when the cosmetic part is in the first state, and the cosmetic part is in the first state. In the second state, the coordinate value of the point where the switch point is located, and the coordinate value of the second extension point of the second type of triangle corresponding to the target triangle to which the reference point belongs.
The electronic device of claim 17, wherein the processor is further configured to perform the steps of:

Using the similar triangle algorithm, according to the coordinate value of the stable point in the contour feature points of the part to be beautified in the target image, and the coordinate value of the vertex of the first type triangle in the configuration file, the first type is calculated. The coordinate value of the extension point;

Using the similar triangle algorithm, according to the coordinate value of the switch point in the contour feature point of the part to be beautified in the target image, the coordinate value of the first type of extension point and the second type of triangle in the configuration file The coordinate value of the vertex is calculated to obtain the coordinate value of the second type of extension point;

According to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the target coordinate value, calculate the coordinate value of the third type of extension point;

Obtain the target grid structure according to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the coordinate value of the third type of extension point;

The first type of extension point is a point in the target grid structure that corresponds to the first extension point in the first type of triangle; the second type of extension point is in the target grid structure , the point corresponding to the second expansion point in the second type of triangle, and the third type of expansion point is the contour feature point of the makeup part in the target image except the contour feature point in the target image, all the Points other than the first type of extension point and the second type of extension point.
The electronic device according to claim 21, wherein the coordinate values of at least some points in the third type of extension points are determined by using a smooth transition or interpolation method.
The electronic device according to claim 21, wherein the preset triangle further includes at least one triangle of the third type, wherein the vertex of a triangle of the third type includes a third extension point and two of the points in the target set , the third extension point is a point set in advance according to the contour of the part to be beautified, and the target set includes the vertices of the first type of triangle and the vertices of the second type of triangle, and the Points other than the stable point and the switch point in the contour feature points of the beauty makeup part;

The processor is also configured to perform the following steps:

Using the similar triangle algorithm, according to the coordinate value of the first type of extension point, the coordinate value of the second type of extension point and the target coordinate value, and the coordinate value of the vertex of the third type of triangle in the configuration file , and calculate the coordinate value of the third type of extension point.
The electronic device according to claim 17, wherein, when the beauty makeup part is the eye, the stable point is two corner points, and the switch point is the midpoint of the contour of the upper eyelid.
A storage medium, wherein when the instructions in the storage medium are executed by a processor of an electronic device, the electronic device can perform the following steps:

Get the target image that contains the makeup part;

Obtain the coordinate value of the contour feature point of the part to be beautified in the target image, as the target coordinate value;

According to the target coordinate value and the predetermined configuration file, the grid structure of the part to be beautified is obtained as the target grid structure;

According to the target grid structure, beauty makeup processing is performed on the beauty makeup part to obtain a beauty makeup image;

Wherein, the configuration file includes a preset triangle in the mesh structure of the part to be beautified and coordinate values of vertices of the preset triangle, and the preset triangle includes at least one first-type triangle and a A triangle of the second type corresponds to a triangle of the first type. The vertex of a triangle of the first type includes two stable points and a first extension point, and the vertex of a triangle of the second type includes the first extension point of the corresponding triangle of the first type. , a switch point and a second expansion point;

The stable point and the switch point are respectively the point with the smallest movement range and the one with the largest movement range among the contour feature points of the beautified part in the process of changing from the first state to the second state of the beautified part. point, the first extension point and the second extension point are points set in advance according to the contour of the part to be beautified.