WO2020135286A1

WO2020135286A1 - Shaping simulation method and system, readable storage medium and device

Info

Publication number: WO2020135286A1
Application number: PCT/CN2019/127251
Authority: WO
Inventors: 黄庆武
Original assignee: 甄选医美邦(杭州)网络科技有限公司
Priority date: 2018-12-24
Filing date: 2019-12-22
Publication date: 2020-07-02
Also published as: CN111353931A; CN111353931B

Abstract

The present invention relates to a shaping simulation method and system, a readable storage medium and a device, belonging to the field of image processing technology. The method comprises: acquiring an original image of an object to be shaped, and performing face recognition on the original image to obtain face feature data; performing matching and analysis between the face feature data and a preset shaped face feature database, to acquire a face feature adjustment value; and performing simulation adjustment on the original image according to the face feature adjustment value, to obtain a shaping simulation image. By means of a face feature adjustment value obtained by performing matching between face feature data and data of a shaped face feature database, simulation adjustment on an original image better conforms to the requirements of shaping, and a shaping simulation effect which is relatively close to reality and is more intuitive can be obtained, improving the pre-operative reference effect of a shaping simulation image.

Description

Shaping simulation method, system, readable storage medium and equipment

Related application

This application requires the priority of the Chinese patent application with the application number 201811581506.0 and the name "Shaping Simulation Methods, Systems, Readable Storage Media, and Equipment" that was filed on December 24, 2018, and the entire content of which is hereby incorporated by reference.

Technical field

The present invention relates to the field of image processing technology, and in particular, to a plastic modeling method, system, readable storage medium, and device.

Background technique

With the continuous improvement of social living standards, more and more people seeking beauty have promoted the rapid development of the medical beauty industry. Users can use various image processing software and tools to perform image processing on self-portraits to achieve the effect of plastic simulation, which enriches daily life. Users of image processing software often use the software to perform image stretching on the eyes, nose, face, chin (chin), etc. in the image, such as eye enlargement, chin stretching, face thinning, nose stretching, etc., traditional The image processing method is usually to extract part features of the user's static original image, and then use simple image blur calculation processing to make a certain feature point of the image change. This method only performs image processing according to the user's preferences and simulates the resulting image It is difficult to have a preoperative reference for plastic surgery.

Summary of the invention

Based on this, it is necessary to provide a plastic simulation method, system, readable storage medium, and equipment for the problem that the traditional image processing method can not have the pre-operative reference effect of plastic surgery.

A shaping simulation method includes the following steps:

Obtain the original image of the object to be shaped, perform face recognition on the original image, and obtain the facial feature data of the object to be shaped;

Perform matching analysis on the face feature data and the preset plastic face feature database to obtain the face feature adjustment value;

The original image is simulated and adjusted according to the face feature adjustment value to obtain a plastic analog image.

According to the above-mentioned shaping simulation method, it is to obtain the original image of the object to be shaped, perform face recognition on the original image to obtain face feature data; perform matching analysis on the face feature data and the preset shaped face feature database to obtain the person Face feature adjustment value; simulate and adjust the original image according to the face feature adjustment value to obtain a plastic analog image. The adjustment value of the face feature obtained by matching the face feature data with the data of the plastic face feature database, the simulation adjustment of the original image is more in line with the needs of plastic surgery, and it can obtain a relatively close to real and more intuitive plastic simulation effect, improve plastic surgery Pre-operative reference function of simulated images.

In one of the embodiments, the original image of the object to be shaped is acquired, and the step of performing face recognition on the original image includes the following steps:

Obtain the front image and multiple side images of the object to be shaped, and perform face recognition on the front image and the multiple side images.

In one of the embodiments, the step of acquiring face feature data of the object to be shaped includes the following steps:

Obtain the feature points of the face area of the object to be shaped, partition the face according to the feature points of the face area, and obtain the feature data of each area and the contour data of the face; where each area includes the eye, nose, mouth, For the face and chin, the feature data includes position data of the current partition and relative position data between the current partition and other partitions.

In one of the embodiments, the step of performing matching analysis on the face feature data and the preset plastic face feature database includes the following steps:

Search matching data in the plastic face feature database according to the face feature data, wherein the similarity between the match data and the face feature data is greater than or equal to a preset value;

The step of obtaining the adjustment value of face features also includes the following steps:

Obtain the ratio of the facial feature data to the matching data, and obtain the facial feature adjustment value according to the ratio, where the facial feature adjustment value is between the ratio and the value 1.

Receiving the first selection instruction, and selecting the first target partition among the partitions according to the first selection instruction;

According to the feature data of other partitions except the first target partition, select a sub-database in the plastic face feature database, where the face feature data in the sub-database matches the feature data of other partitions than the first target partition;

Perform matching analysis on the feature data of the first target partition and the sub-database.

In one of the embodiments, the shaping simulation method further includes the following steps:

Receive the modification instruction, and fine-tune the characteristic data of the plastic analog image according to the modification instruction;

Or, select the first target partition from each partition again according to the modification instruction.

Receiving a trigger instruction for the second target partition, and selecting multiple candidate partition images in the plastic face feature database according to the trigger instruction, wherein the partition type of each partition image is the same as the partition type of the second target partition;

Display each partition image, receive the second selection instruction, and select the target partition image from each partition image according to the second selection instruction;

The target partition image is fused to the position of the second target partition in the original image.

In one of the embodiments, the step of fusing the target partition image to the position of the second target partition in the original image includes the following steps:

Obtain the image size, position and color data of the second target partition, adjust the target partition image according to the image size, position and color data, replace the part of the original image corresponding to the second target partition with the adjusted image, and adjust The butt edge of the original image and the original image are blurred.

Send the processed image to the shaping server through the server, receive the modification opinion data returned by the shaping server, and feed back the processing information of the modification opinion data.

A shaping simulation system, including:

The image recognition unit is used to obtain the original image of the object to be shaped, perform face recognition on the original image, and obtain the facial feature data of the object to be shaped;

The image analysis unit is used to perform matching analysis on the face feature data and the preset plastic face feature database to obtain the face feature adjustment value;

The image adjustment unit performs analog adjustment on the original image according to the adjustment value of the face feature to obtain a plastic analog image.

According to the above-mentioned shaping simulation system, the image recognition unit obtains the original image of the object to be shaped and performs face recognition on the original image to obtain face feature data; the image analysis unit matches the face feature data with the preset shaped face feature database Analyze and obtain the facial feature adjustment value; the image adjustment unit performs analog adjustment on the original image according to the facial feature adjustment value to obtain a plastic analog image. The adjustment value of the face feature obtained by matching the face feature data with the data of the plastic face feature database, the simulation adjustment of the original image is more in line with the needs of plastic surgery, and it can obtain a relatively close to real and more intuitive plastic simulation effect, improve plastic surgery Pre-operative reference function of simulated images.

In one of the embodiments, the image recognition unit acquires a front image and a plurality of side images of the object to be shaped, and performs face recognition on the front image and the plurality of side images.

In one of the embodiments, the image recognition unit acquires the feature points of the face area of the object to be shaped, partitions the face according to the feature points of the face area, and obtains the feature data of each partition and the contour data of the face; wherein, each partition Including the eyes, nose, mouth, face and chin, the feature data includes the position data of the current partition and the relative position data between the current partition and other partitions.

In one of the embodiments, the image analysis unit searches for matching data in the plastic face feature database based on the face feature data, wherein the similarity between the match data and the face feature data is greater than or equal to a preset value;

The image analysis unit obtains the ratio of the face feature data and the matching data, and obtains the face feature adjustment value according to the ratio, where the face feature adjustment value is between the ratio and the value 1.

In one of the embodiments, the image analysis unit receives the first selection instruction and selects the first target partition among the partitions according to the first selection instruction; according to the feature data of the partitions other than the first target partition, the face features are reshaped The database selects a sub-database, and performs matching analysis on the feature data of the first target partition and the sub-database; wherein, the face feature data in the sub-database matches the feature data of the partitions other than the first target partition.

In one of the embodiments, the shaping simulation system further includes an image modification unit for receiving a modification instruction, fine-tuning the characteristic data of the shaping simulation image according to the modification instruction; or, according to the modification instruction, reselecting the first target partition in each partition.

In one of the embodiments, the shaping simulation system further includes an image combination unit for receiving a trigger instruction for the second target partition, and selecting a plurality of candidate partition images in the shaping facial feature database according to the trigger instruction, wherein each The partition type of the partition image is the same as the partition type of the second target partition;

The image combination unit is further used to display the images of each partition, receive the second selection instruction, and select the target partition image among the partition images according to the second selection instruction;

The image combining unit is also used to fuse the target partition image to the position corresponding to the second target partition in the original image.

In one of the embodiments, the image combining unit acquires the image size, position and color data of the second target partition, adjusts the target partition image according to the image size, position and color data, and compares the part of the original image corresponding to the second target partition Replace with the adjusted image, and blur the edge of the interface between the adjusted image and the original image.

In one of the embodiments, the shaping simulation system further includes a data interaction unit for sending the processed image to the shaping server through the server, receiving the modification opinion data returned by the shaping server, and feeding back processing information on the modification opinion data .

A readable storage medium has stored thereon an executable program, and when the executable program is executed by a processor, the steps of the above-mentioned shaping simulation method are realized.

The above-mentioned readable storage medium, through the executable program stored in it, can achieve the adjustment value of the facial features by matching the facial feature data with the data of the plastic facial feature database, and the analog adjustment of the original image is more in line with the needs of plastic surgery. A relatively close to real and more intuitive plastic simulation effect can be obtained, and the preoperative reference function of the plastic simulation image can be improved.

A shaping simulation device includes a memory and a processor. The memory stores an executable program. When the processor executes the executable program, the steps of the shaping simulation method described above are implemented.

The above-mentioned shaping simulation device can achieve the adjustment value of the face feature by matching the face feature data with the data of the shaping face feature database by running the executable program on the processor, and the simulation adjustment of the original image is more in line with the needs of shaping , You can get relatively close to the real and more intuitive plastic simulation effect, improve the pre-operative reference role of plastic simulation images.

BRIEF DESCRIPTION

FIG. 1 is an application scenario diagram of a shaping simulation method in an embodiment;

2 is a schematic flow chart of a method for shaping simulation in an embodiment;

FIG. 3 is an interactive schematic diagram of a shaping simulation method in an embodiment;

4 is a schematic structural diagram of a shaping simulation system in an embodiment;

5 is a schematic structural diagram of a shaping simulation system in another embodiment;

6 is a schematic structural diagram of a shaping simulation system in yet another embodiment;

7 is a schematic structural diagram of a shaping simulation system in yet another embodiment;

FIG. 8 is a schematic diagram of a specific application process of the shaping simulation method in an embodiment.

detailed description

In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, and do not limit the protection scope of the present invention. In addition, it should be noted that, in order to facilitate description, the drawings only show parts related to the present invention rather than all contents.

It should be noted that the term “first\second” involved in the embodiment of the present invention is only to distinguish similar objects, and does not represent a specific order for objects. Understandably, “first\second” is allowed The specific order or sequence can be interchanged below. It should be understood that the objects distinguished by “first\second” may be interchanged under appropriate circumstances, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein.

The shaping simulation method provided in this application can be applied in the application environment shown in FIG. 1, the mobile device can obtain the original image of the object to be shaped (ie, the user), perform face recognition on the original image, and obtain face feature data ; Perform matching analysis on the face feature data and the preset plastic face feature database to obtain the face feature adjustment value; simulate and adjust the original image according to the face feature adjustment value to obtain the plastic simulation image. Among them, the mobile device may be a variety of devices with functions of acquiring user images and image processing, such as personal computers, notebook computers, PDAs, smart phones, tablet computers, and portable wearable devices.

Referring to FIG. 2, it is a schematic flowchart of a shaping simulation method according to an embodiment of the present invention. The shaping simulation method in this embodiment includes the following steps:

Step S110: Obtain the original image of the object to be shaped, perform face recognition on the original image, and obtain the facial feature data of the object to be shaped;

In this step, the original image can be captured by the camera of the electronic device or obtained by scanning; during facial recognition, the characteristics of the human face in the original image can be analyzed to obtain facial feature data;

Step S120: Perform matching analysis on the face feature data and the preset plastic face feature database to obtain the face feature adjustment value;

In this step, the plastic face feature database is a pre-set collection of commonly used face feature material data for plastic surgery. Through the matching analysis of the actual face feature data and the data of the plastic face feature database, you can know the face features The difference between the characteristics of the data and the plastic face. According to this difference, the facial feature adjustment value can be obtained. The facial feature adjustment value can reduce the feature difference, so that the face in the adjusted image is close to the plastic face to achieve The effect of plastic simulation;

Step S130: Perform simulation adjustment on the original image according to the face feature adjustment value to obtain a plastic simulation image;

In this step, when performing analog adjustment according to the face feature adjustment value, it is mainly to adjust the face feature data, and image deformation processing can be performed based on the face feature points.

In this embodiment, the original image of the object to be shaped is obtained, and the original image is subjected to face recognition to obtain face feature data; the face feature data is matched with the preset shaped face feature database to obtain face features Adjustment value; adjust the original image according to the adjustment value of the facial features to obtain the plastic simulation image. The adjustment value of the face feature obtained by matching the face feature data with the data of the plastic face feature database, the simulation adjustment of the original image is more in line with the needs of plastic surgery, and it can obtain a relatively close to real and more intuitive plastic simulation effect, improve plastic surgery Pre-operative reference function of simulated images.

It should be noted that when matching analysis of the facial feature data and the preset plastic facial feature database, an image facial analysis report can be generated, and the plastic surgery based on the facial feature adjustment value is given in the report It is recommended that after receiving the confirmation information, the original image is automatically simulated and adjusted, and a plastic recommendation report is given after completion, including specific plastic parts, plastic methods and plastic effect description information.

Furthermore, diffusion, sharpening, and deformation algorithms can be used to process images during simulation adjustment.

Further, when acquiring the original image of the object to be shaped, the shooting area can be defined, such as a shooting area similar to the shape of the face, etc. When the face of the object to be shaped enters the shooting area, the original image is The required face image can reduce the time of face recognition and improve the accuracy of recognition. In addition, when acquiring the original image of the object to be shaped, it senses the brightness when shooting, if the brightness is less than the preset brightness value, turn on The flash or the brightness is insufficient; during face recognition, you can also detect the makeup on the face, prompt to clean and then perform plastic simulation, if you detect accessories on the face, prompt to remove the accessories, such as glasses, false eyelashes, Nose nails, etc.

In an embodiment, the original image of the object to be shaped is obtained, and the step of performing face recognition on the original image includes the following steps:

In this embodiment, multiple images of the object to be shaped can be obtained, including a frontal image and a side image. The frontal image and the multiple side images are images obtained from different angles, based on which the influence of illumination, angle, etc. can be reduced To make face recognition more accurate.

Specifically, in actual operation, a front image of the object to be shaped and two side images at a 45-degree angle can be obtained.

Further, after obtaining the front image and the side image, the 3D original image model can be constructed based on this, and the 3D model algorithm can be used for accurate face recognition.

In one embodiment, the step of acquiring face feature data of the object to be shaped includes the following steps:

In this embodiment, after face recognition, facial region feature points can be obtained, and the feature point distribution of different regions on the human face is different. The facial region feature points can be used to partition the facial region to obtain, for example, eye parts. , Nose, mouth, face, chin, etc. and the contour data of the face, the feature data includes the position data of the current face part and the relative position data between the current face part and other parts, In order to simulate and shape different areas of the human face.

Specifically, the characteristic regions on the human face may include forehead, eyes, eyebrows, eyelids, nose bridge, nose, nose wings, cheeks, mouth, chin, etc., and also include facial contour data such as the overall contour of the face. Feature points, to achieve the division of facial feature area parts, when acquiring feature data, not only the data of the feature area parts themselves, but also the position data of the feature area parts and the relative position data with other feature areas, and the feature area parts The data such as color and brightness can be integrated in the shaping simulation to improve the coordination of the simulation effect.

Further, in addition to partitioning the face area based on the face recognition results, you can also manually set the points for selection, such as receiving an area selection instruction, selecting a specified area on the face of the original image, and obtaining the characteristic data of the specified area to improve The flexibility of plastic modeling.

Further, after partitioning the face area, and matching the feature data of the partition area with the preset plastic face feature database, it is possible to obtain a partition area that is recommended to be shaped and obtain the adjustment value of the face feature of the partition area.

In one embodiment, the step of performing matching analysis on the face feature data and the preset plastic face feature database includes the following steps:

Obtain the ratio of the facial feature data to the matching data in the plastic facial feature database, and obtain the facial feature adjustment value according to the ratio, where the facial feature adjustment value is between the ratio and the value 1.

In this embodiment, the similarity between the face feature data and the data in the plastic face feature database can be used to determine the matching data. After the similarity matching analysis is performed on the face feature data and the plastic face feature database, the person can be shaped The matching data matching the face feature data after image analysis is obtained from the face feature database, but it is different from the face feature data after image analysis. Calculate the ratio of the data of the specific feature points of the two and use the ratio as the adjustment value. Set the face feature adjustment value between this ratio and the value 1, and use the face feature adjustment value to simulate the adjustment of the image. You can compare the face feature data in the image with the data in the plastic face database Approximation, to achieve the simulation effect of plastic surgery.

Further, the face feature adjustment value may be dynamic data, which is dynamically adjusted between the ratio and the value 1 according to the needs of the object to be shaped.

In this embodiment, the first target partition can be selected through the first selection instruction, and a sub-database can be selected in the plastic face feature database according to the feature data of other partitions, because the face feature data in the sub-database is different from the first target partition The feature data of the other partitions of the database match. Therefore, when the feature data of the first target partition and the sub-database are matched and analyzed, the feature adjustment value of the first target partition obtained can make the first target partition coordinate with other partitions and improve the The overall coordination of the plastic simulation of a single partition.

In one embodiment, the shaping simulation method further includes the following steps:

In this embodiment, the image is simulated and adjusted according to the facial feature adjustment value, and after obtaining the plastic simulation image, the plastic simulation image may not meet the requirements of the object to be shaped, at this time, a modification instruction may be received, and the features may be modified according to the modification instruction. Fine-tune the data to meet the specific requirements of the object to be reshaped; or, the current simulation of the first target partition does not meet the requirements of the object to be reshaped. You can select a new first target partition for reshaping simulation, so that you can follow the The requirements of the object to be reshaped adjust the simulated reshaping.

In this embodiment, a second target partition can be selected and triggered, multiple candidate partition images of the same type as the second target partition are selected in the plastic face feature database, and the partition images are displayed for selection of objects to be shaped After the object to be shaped selects the target partition image through the second selection instruction, the target partition image is fused into the original image, so that the object to be shaped can independently select the shaping content and show the effect of shaping the simulated image.

Specifically, the second target partition may be a forehead, eyes, eyebrows, nose, mouth, chin, etc. For example, selecting an eye part as the second target partition may select and display eye images of different shapes in the plastic face feature database and display For selection of the object to be shaped, and after the determination, the selected new eye shape is merged into the original image of the object to be shaped to form a shaped simulation image.

In one embodiment, the step of fusing the target partition image to the position of the second target partition in the original image includes the following steps:

In this embodiment, the second target partition is a part of the original image, which has attributes such as image size, position, color, etc. The target partition image is adjusted according to data such as image size, position, and color, so that the target partition image and the original The image is coordinated. In addition, the edge of the interface between the adjusted image and the original image is blurred. The above processing can avoid the abrupt display of the final image and reflect a good simulation effect.

It should be noted that after the fusion and blur processing, another plastic simulation image can be obtained, which is different from the plastic simulation image obtained by adjusting the original image according to the adjustment value of the face feature; after the fusion and blur processing, The modification instruction may be received, and the obtained image may be fine-tuned for the characteristic data according to the modification instruction; or, the second target partition may be selected again from each partition according to the modification instruction.

Send the processed image to the shaping server through the server, receive the modification opinion data returned by the shaping server, and feed back the processing information on the modification opinion data.

In this embodiment, after the image is processed, it can be sent to the shaping server through the server, and the shaping server can obtain the modification opinion data for the image and return it; the sending end can feed back the corresponding processing information for the modification opinion data, Through this interactive way, the image can be further adjusted and modified.

It should be noted that the processed image may be an orthopaedic simulated image obtained by performing simulation adjustment according to the adjustment value of the face feature, or an image obtained by selecting different partitions and performing fusion processing.

Specifically, the above processing procedure can be applied to the consulting terminal device on the user side, and the shaping server can be provided on the receiving terminal on the side of the plastic doctor. The consulting terminal of the user sends the plastic simulation image to the receiving terminal of the plastic doctor, inviting the doctor Adjust the plastic simulation image and give the modification opinion, the receiving terminal returns the modification opinion data, and the interactive schematic diagram is shown in Figure 3.

Further, the original image of the object to be reshaped can be directly sent to the reshaping server through the server, receive the modification opinion data returned by the reshaping server, and feed back processing information on the modification opinion data.

According to the above-mentioned shaping simulation method, an embodiment of the present invention also provides a shaping simulation system. The embodiment of the shaping simulation system of the present invention will be described in detail below.

Referring to FIG. 4, it is a schematic structural diagram of a shaping simulation system according to an embodiment of the present invention. The shaping simulation system in this embodiment includes:

The image recognition unit 210 is used to obtain the original image of the object to be shaped, perform face recognition on the original image, and obtain the facial feature data of the object to be shaped;

The image analysis unit 220 is used to perform matching analysis on the facial feature data and the preset plastic facial feature database to obtain the facial feature adjustment value;

The image adjustment unit 230 performs analog adjustment on the original image according to the face feature adjustment value to obtain a plastic analog image.

In this embodiment, the image recognition unit 210 obtains the original image of the object to be shaped, and performs face recognition on the original image to obtain face feature data; the image analysis unit 220 compares the face feature data with the preset shaped face feature database Perform matching analysis to obtain the face feature adjustment value; the image adjustment unit 230 performs analog adjustment on the original image according to the face feature adjustment value to obtain a plastic analog image. The adjustment value of the face feature obtained by matching the face feature data with the data of the plastic face feature database, the simulation adjustment of the original image is more in line with the needs of plastic surgery, and it can obtain a relatively close to real and more intuitive plastic simulation effect, improve plastic surgery Pre-operative reference function of simulated images.

In one embodiment, the image recognition unit 210 acquires a front image and multiple side images of the object to be shaped, and performs face recognition on the front image and the multiple side images.

In one embodiment, the image recognition unit 210 acquires the facial region feature points of the object to be shaped, partitions the face according to the facial region feature points, and acquires the feature data of each partition and the contour data of the face; wherein, each partition Including the eyes, nose, mouth, face and chin, the feature data includes the position data of the current partition and the relative position data between the current partition and other partitions.

In one embodiment, the image analysis unit 220 searches for matching data in the plastic face feature database according to the face feature data, where the similarity of the match data and the face feature data is greater than or equal to a preset value;

The image analysis unit 220 acquires the ratio of the facial feature data to the matching data, and acquires the facial feature adjustment value according to the ratio, where the facial feature adjustment value is between the ratio and the value 1.

In one embodiment, the image analysis unit 220 receives the first selection instruction and selects the first target partition among the partitions according to the first selection instruction; according to the feature data of the partitions other than the first target partition, the face features are reshaped The database selects a sub-database, and performs matching analysis on the feature data of the first target partition and the sub-database; wherein, the face feature data in the sub-database matches the feature data of the partitions other than the first target partition.

In one embodiment, as shown in FIG. 5, the shaping simulation system further includes an image modification unit 240 for receiving a modification instruction, and fine-tuning the characteristic data of the shaping simulation image according to the modification instruction; or, according to the modification instruction, in each partition Select the first target partition.

In one embodiment, as shown in FIG. 6, the shaping simulation system further includes an image combining unit 250 for receiving a trigger instruction for the second target partition, and selecting a plurality of candidate candidates in the shaping facial feature database according to the trigger instruction Partition images, where the partition type of each partition image is the same as the partition type of the second target partition;

The image combining unit 250 is further used to display each partition image, receive a second selection instruction, and select a target partition image from each partition image according to the second selection instruction;

The image combining unit 250 is also used to fuse the target partition image to the position of the original image corresponding to the second target partition.

In one embodiment, the image combining unit 250 acquires the image size, position and color data of the second target partition, adjusts the target partition image according to the image size, position and color data, and compares the part of the original image corresponding to the second target partition Replace with the adjusted image, and blur the edge of the interface between the adjusted image and the original image.

In one embodiment, as shown in FIG. 7, the shaping simulation system further includes a data interaction unit 270 for sending the shaping simulation image to the shaping server via the server, receiving the modification opinion data returned by the shaping server, and feeding back the modification Processing information of opinion data.

The shaping simulation system of the present invention corresponds to the shaping simulation method of the present invention, and the technical features and beneficial effects described in the above embodiments of the shaping simulation method are applicable to the embodiments of the shaping simulation system.

The above-mentioned shaping simulation device, by running an executable program on the processor, obtains the face feature adjustment value by matching the face feature data with the data of the shaping face feature database, and the simulation adjustment of the original image is more in line with the needs of shaping. Obtain a relatively close to real and more intuitive plastic simulation effect, and improve the preoperative reference function of plastic simulation images.

A person of ordinary skill in the art may understand that all or part of the processes in the method of the foregoing embodiments may be completed by instructing relevant hardware through a computer program, and the program may be stored in a non-volatile computer-readable storage medium. As in the embodiment, the program may be stored in a storage medium of the computer system and executed by at least one processor in the computer system to implement the process including the embodiment of the above-described shaping simulation method. Among them, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.

In one embodiment, the shaping simulation device further includes a shaping server device.

In one embodiment, the shaping simulation method can be applied to a mobile device, which can be a personal computer, a notebook computer, a palmtop computer, a smartphone, a tablet computer, a portable wearable device, and the like.

The flow chart of the shaping simulation method is shown in Figure 8. Specifically, the user can scan or photograph the face through electronic devices such as mobile phones, tablets, cameras, and upload three face images (front and side (45 degrees) two) to establish a 3D original image model. Then perform face recognition on the user's original image model, partition each part of the face into forehead, eye (single eye, including eyes, eyebrows), nose (nose, nose wings), chin, face (both cheeks) ) And other partitions (parts are selected by the user manually setting points), through the face data calculation algorithm, the user's facial features are analyzed, and the preset standard values are compared to obtain a facial analysis report, The user can perform automatic shaping simulation according to the suggestions in the analysis report, and the shaping recommendation report is obtained after completion. The user can save the image and report formed by the simulation as a certain shaping reference. At the same time, users can also analyze individual face parts and replace them with images of various parts in the plastic face database to obtain plastic simulation images. After the analysis, adjustment data can be obtained to adjust the user's face images to obtain plastic simulation. The image can also be replaced with a part image. The user can select a part independently and select the same type of part image from the plastic face database for the user to choose. After the user determines the required part image, the selected part image is fused to the user's face In the part of the image, the docking position is simulated to obtain another shape simulation image. If the effect of the shape simulation is not satisfactory, the user can use the fine-tuning function to process the image of a single part, or reselect the part to perform the shape simulation. Finally, after recalculating and mixing the standard values of the system design, the original image is subjected to corresponding shaping simulation processing to obtain the final shaped simulation image. The user can send this simulation effect image to the online shaping through the online consulting service module (ie, data interaction module) Doctors conduct point-to-point consultations. Online plastic surgeons can fine-tune or rematch each part based on this simulated image to obtain the best plastic simulation image; let the plastic surgeon provide plastic suggestions online and modify customers Simulation data of both sides, so that you can get a plastic simulation image that both parties think is good. Then the user can save the simulation image and print the 3D simulation image. The image will be saved in the database of the doctor’s plastic surgery server. During the doctor's face consultation, the doctor can call up the data as a basis for the face consultation to reduce the communication time between the two parties; it can also be shared with friends through instant messaging software such as WeChat and QQ through the sharing function. Compared with the traditional plastic simulation technology, it can only be achieved through simple Blurred image processing cannot be integrated with medical and cosmetic professional technology, which reduces the user's operation time and improves the efficiency and professionalism of plastic simulation, especially when applied to the customer's face-to-face consultation after medical cosmetic surgery, which can make the user more intuitive in advance Obtain post-operative effect simulation images.

The technical features of the above-mentioned embodiments can be arbitrarily combined. To simplify the description, all possible combinations of the technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, All should be considered within the scope of this description.

A person of ordinary skill in the art may understand that all or part of the steps in the method of the foregoing embodiments may be implemented by a program instructing relevant hardware. The program can be stored in a computer-readable storage medium. When this program is executed, it includes the steps described in the above method. The storage medium includes: ROM/RAM, magnetic disk, optical disk, etc.

The above examples only express several implementations of the present invention, and their descriptions are more specific and detailed, but they should not be construed as limiting the patent scope of the invention. It should be noted that, for a person of ordinary skill in the art, without departing from the concept of the present invention, a number of modifications and improvements can also be made, which all fall within the protection scope of the present invention. Therefore, the protection scope of the invention patent shall be subject to the appended claims.

Claims

A shaping simulation method is characterized by the following steps:

Acquiring the original image of the object to be shaped, performing face recognition on the original image, and acquiring the facial feature data of the object to be shaped;

Perform matching analysis on the face feature data and a preset plastic face feature database to obtain face feature adjustment values;

The original image is simulated and adjusted according to the face feature adjustment value to obtain a plastic analog image.
The shaping simulation method according to claim 1, wherein the step of acquiring the original image of the object to be shaped and performing face recognition on the original image includes the following steps:

Obtain a front image and multiple side images of the object to be shaped, and perform face recognition on the front image and the multiple side images.
The shaping simulation method according to claim 1, wherein the step of acquiring face feature data of the object to be shaped includes the following steps:

Obtain the feature points of the face area of the object to be reshaped, partition the face according to the feature points of the face area, and obtain the feature data of each zone and the contour data of the face; wherein, each of the zones includes the eye, For the nose, mouth, face and chin, the characteristic data includes position data of the current partition and relative position data between the current partition and other partitions.
The shaping simulation method according to claim 1, wherein the step of matching and analyzing the face feature data with a preset shaping face feature database includes the following steps:

Searching matching data in the plastic face feature database according to the face feature data, wherein the similarity between the match data and the face feature data is greater than or equal to a preset value;

The step of obtaining the adjustment value of the facial features further includes the following steps:

Obtain a ratio of the face feature data to the matching data, and obtain the face feature adjustment value according to the ratio, where the face feature adjustment value is between the ratio and the value 1.
The shaping simulation method according to claim 3, wherein the step of matching and analyzing the face feature data with a preset shaping face feature database includes the following steps:

Receiving a first selection instruction, and selecting a first target partition among the partitions according to the first selection instruction;

According to the feature data of other partitions than the first target partition, select a sub-database in the plastic face feature database, wherein the face feature data in the sub-database and other than the first target partition Match the feature data of the partition;

Perform matching analysis on the feature data of the first target partition and the sub-database.
The shaping simulation method according to claim 5, further comprising the following steps:

Receiving a modification instruction, and fine-tuning feature data of the plastic analog image according to the modification instruction;

Or, select the first target partition among the partitions again according to the modification instruction.
The shaping simulation method according to claim 3, further comprising the following steps:

Receiving a trigger instruction for a second target partition, and selecting a plurality of candidate partition images in the plastic face feature database according to the trigger instruction, wherein the partition type of each partition image and the second target partition The partition type is the same;

Displaying each of the partition images, receiving a second selection instruction, and selecting a target partition image from each of the partition images according to the second selection instruction;

Fuse the target partition image to a position corresponding to the second target partition in the original image.
The shaping simulation method according to claim 7, wherein the step of fusing the target partition image to the position corresponding to the second target partition in the original image includes the following steps:

Obtain the image size, position and color data of the second target partition, adjust the target partition image according to the image size, position and color data, and place the original image corresponding to the second target partition Replace with the adjusted image, and blur the edge of the interface between the adjusted image and the original image.
The shaping simulation method according to any one of claims 1 to 8, further comprising the following steps:

Send the processed image to the shaping server via the server, receive the modification opinion data returned by the shaping server, and feed back processing information on the modification opinion data.
A shaping simulation system, which is characterized by including:

An image recognition unit, configured to obtain an original image of the object to be shaped, perform face recognition on the original image, and obtain facial feature data of the object to be shaped;

An image analysis unit, configured to perform matching analysis on the face feature data and a preset plastic face feature database to obtain face feature adjustment values;

The image adjustment unit performs analog adjustment on the original image according to the face feature adjustment value to obtain a plastic analog image.
A readable storage medium on which an executable program is stored, characterized in that when the executable program is executed by a processor, the steps of the shaping simulation method according to any one of claims 1 to 7 are realized.
A shaping simulation device includes a memory and a processor, and the memory stores an executable program, wherein the processor implements the shaping according to any one of claims 1 to 7 when the processor executes the executable program The steps of the simulation method.