WO2020135287A1 - Plastic surgery simulation information processing method, plastic surgery simulation terminal and plastic surgery service terminal - Google Patents

Abstract

A plastic surgery simulation image processing method and system, a readable storage medium and a device, which relate to the technical field of image processing. An original image of an subject to undergo plastic surgery is obtained, and facial recognition is performed on the original image to obtain facial feature data. The facial feature data characterizes specific features of a face, and the features of each person's face are different. The facial feature data may be used to determine a corresponding face type, and then face template data corresponding to the face type is selected from a preset face-shaping feature database. The face template data is standard shaping data for the face type. The original image of the subject to undergo plastic surgery is simulated and adjusted by means of the face template data, which may adapt to the specific features of the face. According to the present invention, the simulation and adjustment are more coordinated, and the plastic surgery simulation is more realistically reflected and better meets plastic surgery requirements. The present invention may obtain a plastic surgery simulation effect which is relatively close to reality and more intuitive, and improve the plastic surgery simulation effect.

Description

Shaping simulation information processing method, shaping simulation terminal and shaping service terminal

Related application

This application requires the priority of the Chinese patent application filed on December 24, 2018, with the application number 201811581508.X and titled "Plastic Simulation Information Processing Methods, Plastic Simulation Terminals, and Plastic Service Terminals," the full text of which is hereby incorporated Reference.

Technical field

The invention relates to the technical field of plastic images, in particular to a plastic analog information processing method, a plastic analog terminal and a plastic service terminal.

Background technique

With the continuous improvement of social living standards, more and more people seeking beauty have promoted the rapid development of the medical beauty industry.

The traditional pre-plastic surgery communication scene is usually: Scene 1: The customer takes the photo he likes to show to the doctor, and expresses to the doctor: ask the doctor to reshape a part of himself into the facial features in the photo; the disadvantage is: in this photo The facial features that fit on the customer’s face are the most suitable for the customer’s facial features, or whether the customer’s own wishes really like it, because there is no intuitive simulation picture before surgery, which is easy to produce misunderstandings and complain for the postoperative The dispute is buried. Scenario 2: The plastic surgeon uses three-dimensional imaging technology to obtain the digital analog original image of the plastic object. According to the professional plastic technology, he gives plastic opinion to the user's original image, adjusts and modifies the original image, and makes eye, nose, face, Chin (chin) and other image stretching processing, such as eye enlargement (double eyelid widening), chin stretching, face thinning, nose stretching, facial lifting, etc., to obtain the effect image of plastic simulation for plastic object reference; disadvantages Yes: The image formed by this technology has a certain distance from the realism, and the operation of image modification requires certain skills. It is difficult for doctors and customers to quickly adjust the image to the desired form in his mind. Such communication The scene is not smooth enough and takes a long time.

Summary of the invention

Based on this, it is necessary to provide an ink cartridge detection method, system, readable storage medium, and equipment for the problem of high cost of ink cartridge testing equipment.

Based on this, it is necessary to provide a simulation image that accurately expresses the customer's plastic surgery wishes and the recommendations of the plastic surgeon in the scene of the traditional pre-plastic surgery communication, the scene 1 without the pre-operative simulated image, and the scene 2 A plastic analog information processing method, a plastic analog terminal and a plastic service terminal.

A plastic analog information processing method includes the following steps:

Obtain the first image containing the human face, and send the first image to the plastic service terminal via the server;

Receiving a second image returned by the shaping service terminal via the server, where the second image is an image obtained after the shaping service terminal adjusts the first image according to the received first modification instruction;

Receive feedback on the second image, and send the feedback to the plastic service terminal via the server.

According to the above-mentioned plastic analog information processing method, it can be applied to the plastic object side, obtain the first image containing the face, and send the first image to the plastic service terminal. The plastic service terminal can be set on the plastic doctor side, and the plastic service terminal is receiving After the first image is received, the first modification instruction can be received to adjust the first image to obtain and return the second image; the plastic object side can receive feedback on the second image and send the feedback to the plastic service The terminal realizes the information interaction between the plastic object side and the plastic doctor side on the plastic image, and determines the plastic simulation effect image more quickly, which is more in line with the needs of plastic surgery, and can obtain relatively close to the real and more intuitive plastic simulation effect, improve the plastic simulation The preoperative reference role of the effect image.

In one of the embodiments, the first image includes an original image or a simulated image of the object to be shaped.

In one of the embodiments, the shaping analog information processing method further includes the following steps:

Obtain and display the information of multiple plastic surgeons, receive the first selection instruction, select the information of the target plastic surgeon according to the first selection instruction, establish a communication connection with the plastic service terminal via the server, wherein the information of the target plastic surgeon and the plastic service terminal Associated.

In one of the embodiments, the shaping analog information processing method further includes the following steps:

Display the communication window, and exchange information with the plastic service terminal through the communication window.

In one of the embodiments, the step of acquiring the first image containing the face includes the following steps:

Obtain the original image of the object to be reshaped, send the original image to the server, receive the facial feature adjustment value returned by the server, and adjust the original image according to the facial feature adjustment value to obtain the plastic simulation image;

Among them, the server performs face recognition on the original image to obtain the face feature data of the object to be reshaped; performs matching analysis on the face feature data and the preset shaped face feature database to obtain the face feature adjustment value.

In one of the embodiments, the step of acquiring the original image of the object to be shaped includes the following steps:

Obtain the front image and multiple side images of the object to be shaped.

In one of the embodiments, the step of acquiring face feature data of the object to be shaped includes the following steps:

Obtain the feature points of the face area of the object to be shaped, partition the face according to the feature points of the face area, and obtain the feature data of each area and the contour data of the face; where each area includes the eye, nose, mouth, For the face and chin, the feature data includes position data of the current partition and relative position data between the current partition and other partitions.

In one of the embodiments, the step of performing matching analysis on the face feature data and the preset plastic face feature database includes the following steps:

Compare the face feature data with the face feature preset value to determine the face type, obtain the first sub-database matching the face type in the plastic face feature database, and based on the face feature data in the first sub-database Search matching data in, where the similarity between the matching data and the face feature data is greater than or equal to the preset value;

The step of obtaining the adjustment value of face features also includes the following steps:

Obtain the ratio of the facial feature data to the matching data, and obtain the facial feature adjustment value according to the ratio, where the facial feature adjustment value is between the ratio and the value 1.

In one of the embodiments, the shaping analog information processing method further includes the following steps:

Receiving a second selection instruction, the second selection instruction is used to select a first target partition among the partitions;

Among them, the server selects the second sub-database from the plastic face feature database based on the feature data of other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; The face feature data in the sub-database matches the feature data of other partitions than the first target partition.

In one of the embodiments, the shaping analog information processing method further includes the following steps:

Receive the second modification instruction, and fine-tune the characteristic data of the shaped analog image according to the second modification instruction;

Alternatively, a third modification instruction is received, and the third modification instruction is used to reselect the first target partition among the partitions.

In one of the embodiments, the shaping analog information processing method further includes the following steps:

Receiving a trigger instruction for the second target partition, where the trigger instruction is used to select multiple candidate partition images in the plastic face feature database, and the partition type of each partition image is the same as the partition type of the second target partition;

Display images of each partition, and receive a third selection instruction, where the third selection instruction is used to select a target partition image from each partition image;

The target partition image is fused to the position of the second target partition in the original image.

In one of the embodiments, the step of fusing the target partition image to the position of the second target partition in the original image includes the following steps:

Obtain the image size, position and color data of the second target partition, adjust the target partition image according to the image size, position and color data, replace the part of the original image corresponding to the second target partition with the adjusted image, and adjust The butt edge of the original image and the original image are blurred.

In one of the embodiments, the shaping analog information processing method further includes the following steps:

If the feedback is information agreed by the representative, a three-dimensional image is constructed based on the second image and displayed.

In one of the embodiments, the shaping analog information processing method further includes the following steps:

Receive a modification instruction, modify the three-dimensional image according to the modification instruction, obtain and display the final image.

A plastic simulation terminal for acquiring a first image containing a human face, and sending the first image to a plastic service terminal via a server; receiving a second image returned by the plastic service terminal via the server, and receiving feedback for the second image, Send the feedback to the shaping service terminal via the server; where the second image is an image obtained after the shaping service terminal adjusts the first image according to the received modification instruction.

According to the above-mentioned plastic simulation terminal, it can be applied on the plastic object side. The plastic simulation terminal obtains the first image containing the face and sends the first image to the plastic service terminal. The plastic service terminal can be set on the plastic doctor side, and the plastic service terminal is receiving After the first image is received, the first modification instruction can be received to adjust the first image to obtain and return the second image to the plastic simulation terminal; the plastic simulation terminal can receive feedback on the second image and send the feedback To the plastic service terminal, to realize the information interaction between the plastic object side and the plastic doctor side on the plastic image, to determine the plastic simulation effect image more quickly, which is more in line with the needs of plastic surgery, and can get relatively close to the real and more intuitive plastic simulation effect. Improve the pre-operative reference effect of plastic simulation images.

A plastic analog information processing method includes the following steps:

Receiving a first image containing a human face; wherein, the first image is sent by the shaping analog terminal via the server;

Receiving the first modification instruction, adjusting the first image according to the first modification instruction, obtaining the second image, and sending the second image to the shaping simulation terminal via the server;

Receive feedback for the second image; where the feedback is sent by the shaping service terminal via the server;

If the feedback is information agreed by the representative, save the second image.

According to the above-mentioned plastic simulation information processing method, it can be applied on the side of the plastic surgeon to receive the first image containing the face sent by the plastic simulation terminal, and then can receive the first modification instruction to adjust the first image to obtain and return The second image to the plastic simulation terminal; from the plastic simulation terminal, you can receive feedback on the second image, and when the feedback represents the agreed information, save the second image, which can be used as a plastic simulation effect image to achieve plastic objects The information exchange between the side and the plastic surgeon's side of the plastic image can determine the image of the plastic simulation effect relatively quickly, which is more in line with the needs of plastic surgery, and can obtain a relatively close to the real and more intuitive plastic simulation effect, and improve the pre-operative image of the plastic simulation effect Reference role.

A shaping service terminal for receiving a first image containing a human face; receiving a first modification instruction, adjusting the first image according to the first modification instruction, obtaining a second image, and passing the second image to the server Send to the plastic simulation terminal; receive the feedback for the second image; if the feedback is the information representing the consent, save the second image; where the first image and the feedback are sent by the plastic simulation terminal via the server.

According to the above-mentioned shaping service terminal, it can be applied on the side of the shaping doctor. The shaping service terminal receives the first image containing the face sent by the shaping simulation terminal, and then can receive the first modification instruction to adjust the first image to obtain and Return the second image to the plastic simulation terminal; the plastic simulation terminal sends feedback on the second image to the plastic service terminal. When the feedback represents the agreed information, the plastic service terminal saves the second image, which can be used as a plastic simulation Effect image, to realize the information interaction between the plastic object side and the plastic surgeon side, to determine the plastic simulation effect image more quickly, which is more in line with the needs of plastic surgery, and can get relatively close to the real and more intuitive plastic simulation effect, improve plastic surgery The pre-operative reference role of the simulated effect image.

BRIEF DESCRIPTION

FIG. 1 is an application scenario diagram of a method for processing plastic analog information in an embodiment;

2 is a schematic flow chart of a method for processing plastic analog information in an embodiment;

FIG. 3 is a schematic flowchart of a method for processing plastic analog information in another embodiment;

4 is an interactive schematic diagram of a method for processing plastic analog information in an embodiment;

FIG. 5 is a schematic diagram of a specific application flow of a method for processing plastic analog information in an embodiment.

detailed description

In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, and do not limit the protection scope of the present invention. In addition, it should be noted that, in order to facilitate description, the drawings only show parts related to the present invention rather than all contents.

It should be noted that the term “first\second” involved in the embodiment of the present invention is only to distinguish similar objects, and does not represent a specific order for objects. Understandably, “first\second” is allowed The specific order or sequence can be interchanged below. It should be understood that the objects distinguished by “first\second” may be interchanged under appropriate circumstances, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein.

The plastic simulation information processing method provided in this application can be applied in the application environment shown in FIG. 1, and the object to be plasticized (ie, the user) uses the plastic simulation terminal to obtain the first image containing the human face, and the first image is passed through the server. Sent to the plastic surgery terminal used by the plastic surgeon. The plastic surgeon can apply the first modification instruction to the plastic surgery terminal, adjust the first image to obtain the second image, and send the second image to the plastic simulation terminal. The object to be shaped can be Enter the feedback for the second image in the plastic simulation terminal. The plastic simulation terminal can send the feedback to the plastic service terminal for reference by the plastic surgeon to determine the final plastic simulation effect image. Among them, the plastic simulation terminal and the plastic service terminal can be various devices with functions of acquiring images and image processing, such as personal computers, notebook computers, palmtop computers, smart phones, tablet computers, portable wearable devices, etc.

Referring to FIG. 2, it is a schematic flowchart of a method for processing shaping analog information according to an embodiment of the present invention. The shaping analog information processing method in this embodiment includes the following steps:

Step S110: Acquire a first image containing a human face, and send the first image to the plastic service terminal via the server;

In this step, the first image contains the face image that needs to be shaped, and a communication link is provided between the server and the shaping service terminal;

Step S120: Receive a second image returned by the shaping service terminal via the server, where the second image is an image obtained after the shaping service terminal adjusts the first image according to the received first modification instruction;

In this step, the orthopaedic service terminal is located on the side of the orthopaedic doctor. The orthopedic doctor can enter the first modification instruction in the orthopedic service terminal according to his profession and experience, adjust and modify the first image according to the first modification instruction, and obtain and return to the first Two images

Step S130: Receive feedback opinions for the second image, and send the feedback opinions to the shaping service terminal via the server.

In this step, the feedback for the second image can be the information representing the consent or other modification opinions. If there are other modification opinions, the modified second image can be received again, and the feedback can be used to determine the final plastic simulation Effect image.

In this embodiment, the plastic analog information processing method can be applied on the plastic object side, obtain the first image containing the human face, and send the first image to the plastic service terminal. The plastic service terminal can be set on the plastic doctor side, the plastic service terminal After receiving the first image, you can receive the first modification instruction to adjust the first image to obtain and return the second image; the plastic object side can receive feedback on the second image and send the feedback to The plastic service terminal realizes the information interaction between the plastic object side and the plastic doctor side on the plastic image, and determines the plastic simulation effect image more quickly, which is more in line with the needs of plastic surgery, and can obtain relatively close to the real and more intuitive plastic simulation effect, improve The pre-operative reference role of the plastic simulation effect image.

In one embodiment, the first image includes an original image or a simulated image of the object to be shaped.

In this embodiment, the first image may be the original image of the object to be reshaped, and the original image is sent to the reshaping service terminal to allow the plastic surgeon to directly modify the original image to obtain a professional reshaping simulation effect picture; or, the user The plastic simulation images adjusted by yourself are sent to the plastic service terminal, and the plastic surgeon can adjust the plastic simulation images to make the plastic simulation images better.

In one embodiment, the method for processing plastic analog information further includes the following steps:

Obtain and display the information of multiple plastic surgeons, receive the first selection instruction, select the information of the target plastic surgeon according to the first selection instruction, establish a communication connection with the plastic service terminal via the server, wherein the information of the target plastic surgeon and the plastic service terminal Associated.

In this embodiment, before sending the first image, it is necessary to establish a communication connection with the plastic service terminal. Since different plastic doctors have different plastic service terminals, the information of multiple plastic doctors can be given to the user first. A selection instruction selects the information of the target plastic surgeon desired by the user, and establishes a communication connection with the plastic service terminal corresponding to the information of the target plastic surgeon to meet the needs of the user.

In one embodiment, the method for processing plastic analog information further includes the following steps:

Display the communication window, and exchange information with the plastic service terminal through the communication window.

In this embodiment, on the basis of establishing a communication connection with the orthopaedic service terminal, a communication window can also be displayed, through which the information exchange with the orthopaedic service terminal can realize communication with the orthopedic doctor, so that the orthopedic doctor can understand the user’s The specific needs of plastic surgery, in order to get plastic simulation effect images faster.

In one embodiment, the step of acquiring the first image containing the face includes the following steps:

Obtain the original image of the object to be reshaped, send the original image to the server, receive the facial feature adjustment value returned by the server, and adjust the original image according to the facial feature adjustment value to obtain the plastic simulation image;

Among them, the server performs face recognition on the original image to obtain the face feature data of the object to be reshaped; performs matching analysis on the face feature data and the preset shaped face feature database to obtain the face feature adjustment value.

In this embodiment, the original image of the object to be shaped is obtained, the original image is sent to the server for face recognition to obtain face feature data, and the face feature data is matched and analyzed with a preset shaped face database to obtain Face feature adjustment value and return; adjust the original image according to the received face feature adjustment value to obtain a plastic analog image. The adjustment value of the face feature obtained by matching the face feature data with the data of the plastic face feature database, the simulation adjustment of the original image is more in line with the needs of plastic surgery, and it can obtain a relatively close to real and more intuitive plastic simulation effect, improve plastic surgery Pre-operative reference function of simulated images.

It should be noted that the original image can be captured by the camera of the electronic device or obtained by scanning; during facial recognition, the characteristics of the face in the original image can be analyzed to obtain facial feature data; the plastic face feature database is pre-defined The set of commonly used face feature material data for plastic surgery. Through the matching analysis of the actual face feature data and the data of the plastic face feature database, you can know the difference between the face feature data and the face features. According to this The difference can obtain the face feature adjustment value. The face feature adjustment value can reduce the feature difference, so that the face in the adjusted image is close to the plastic face to achieve the effect of plastic simulation; adjust the value according to the face feature When performing analog adjustment, it is mainly to adjust the facial feature data, and image deformation processing can be performed based on the facial feature points.

In addition, the server can generate and return an image face analysis report when matching analysis of the face feature data and the preset face facial feature database; the report gives the shape based on the face feature adjustment value It is recommended that after receiving the confirmation information that is modified according to the plastic recommendation, the original image is automatically simulated and adjusted, and after completion, a plastic recommendation report is provided, including specific plastic parts, plastic methods and plastic effect description information.

Furthermore, diffusion, sharpening, and deformation algorithms can be used to process images during simulation adjustment.

Further, when acquiring the original image of the object to be shaped, the shooting area can be defined, such as a shooting area similar to the shape of the face, etc. When the face of the object to be shaped enters the shooting area, the original image is The required face image can reduce the time of face recognition and improve the accuracy of recognition. In addition, when acquiring the original image of the object to be shaped, it senses the brightness when shooting, if the brightness is less than the preset brightness value, turn on The flash or the brightness is insufficient; during face recognition, you can also detect the makeup on the face, prompt to clean and then perform plastic simulation, if you detect accessories on the face, prompt to remove the accessories, such as glasses, false eyelashes, Nose nails, etc.

In one embodiment, the step of acquiring the original image of the object to be shaped includes the following steps:

Obtain the front image and multiple side images of the object to be shaped.

In this embodiment, multiple images of the object to be shaped can be obtained, including a frontal image and a side image. The frontal image and the multiple side images are images obtained from different angles, based on which the influence of illumination, angle, etc. can be reduced To make face recognition more accurate.

Specifically, in actual operation, a front image of the object to be shaped and two side images at a 45-degree angle can be obtained.

Further, after obtaining the front image and the side image, the server constructs a 3D original image model based on this, and uses the 3D model algorithm to perform accurate face recognition.

In one embodiment, the step of acquiring face feature data of the object to be shaped includes the following steps:

Obtain the feature points of the face area of the object to be shaped, partition the face according to the feature points of the face area, and obtain the feature data of each area and the contour data of the face; where each area includes the eye, nose, mouth, For the face and chin, the feature data includes position data of the current partition and relative position data between the current partition and other partitions.

In this embodiment, after face recognition, facial region feature points can be obtained, and the feature point distribution of different regions on the human face is different. The facial region feature points can be used to partition the facial region to obtain, for example, eye parts. , Nose, mouth, face, chin, etc. and the contour data of the face, the feature data includes the position data of the current face part and the relative position data between the current face part and other parts, In order to simulate and shape different areas of the human face.

Specifically, the characteristic regions on the human face may include forehead, eyes, eyebrows, eyelids, nose bridge, nose, nose wings, cheeks, mouth, chin (chin), etc., and also include facial contour data such as the overall contour of the face. Construct different feature points to realize the division of facial feature areas. When acquiring feature data, not only the data of the feature area parts themselves, but also the position data of the feature area parts and the relative position data with other feature areas, and The data such as the color and brightness of the feature area can be integrated in the shaping simulation to improve the coordination of the simulation effect.

Further, in addition to partitioning the face area based on the face recognition results, you can also manually set the points for selection, such as receiving an area selection instruction, selecting a specified area on the face of the original image, and obtaining the characteristic data of the specified area to improve The flexibility of plastic modeling.

Further, after partitioning the face area, and matching the feature data of the partition area with the preset plastic face feature database, it is possible to obtain a partition area that is recommended to be shaped and obtain the adjustment value of the face feature of the partition area.

In one embodiment, the step of performing matching analysis on the face feature data and the preset plastic face feature database includes the following steps:

Compare the face feature data with the face feature preset value to determine the face type, obtain the first sub-database matching the face type in the plastic face feature database, and based on the face feature data in the first sub-database Search matching data in, where the similarity between the matching data and the face feature data is greater than or equal to the preset value;

The step of obtaining the adjustment value of face features also includes the following steps:

Obtain the ratio of the facial feature data to the matching data in the plastic facial feature database, and obtain the facial feature adjustment value according to the ratio, where the facial feature adjustment value is between the ratio and the value 1.

In this embodiment, the preset value of the face feature is used to determine the face type, and the first sub-database matching it is selected. The similarity between the face feature data and the data in the first sub-database can be used to determine the matching data , After performing similarity matching analysis on the face feature data and the plastic face feature database, you can get matching data in the plastic face feature database that matches the image analyzed face feature data, but it matches the image analyzed person The face feature data is different. Calculate the ratio of the data of the specific feature points of the two, use the ratio as the limit of the adjustment value, set the face feature adjustment value between the ratio and the value 1, use the face feature adjustment value to the image After the simulation adjustment, the facial feature data in the image can be approximated with the data in the plastic face database to achieve the simulation effect of plastic shaping.

Further, the face feature adjustment value may be dynamic data, which is dynamically adjusted between the ratio and the value 1 according to the needs of the object to be shaped.

In one embodiment, the method for processing plastic analog information further includes the following steps:

Receiving a second selection instruction, the second selection instruction is used to select a first target partition among the partitions;

Among them, the server selects the second sub-database from the plastic face feature database based on the feature data of other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; The face feature data in the sub-database matches the feature data of other partitions than the first target partition.

In this embodiment, the first target partition can be selected through the second selection instruction, and the second sub-database can be selected in the plastic face feature database according to the feature data of other partitions. The feature data of other partitions other than a target partition match, so when matching analysis is performed on the feature data of the first target partition and the second sub-database, the feature adjustment value of the first target partition obtained can make the first target partition match other Coordination of partitions improves the overall coordination when performing modeling simulation on a single partition.

It should be noted that after receiving the second selection instruction, the second selection instruction is sent to the server for determining the first target partition. After matching and analyzing the characteristic data of the first target partition with the second sub-database, the server The feature adjustment value of the first target partition may be returned, and the original image is simulated and adjusted by using the feature adjustment value of the first target partition to obtain a plastic analog image.

In one embodiment, the method for processing plastic analog information further includes the following steps:

Receive the second modification instruction, and fine-tune the characteristic data of the shaped analog image according to the second modification instruction;

Alternatively, a third modification instruction is received, and the third modification instruction is used to reselect the first target partition among the partitions.

In this embodiment, the image is simulated and adjusted according to the adjustment value of the facial features, and after obtaining the plastic analog image, the plastic analog image may not meet the requirements of the object to be shaped, at this time, a second modification instruction may be received, according to the second Modify the instruction to fine-tune the characteristic data to make it conform to the specific requirements of the object to be shaped; or, if the current simulation of the first target partition does not meet the requirements of the object to be shaped, you can receive the third modification instruction and send the third modification instruction To the server, re-select the new first target partition for shaping simulation according to the third modification instruction, so that the simulated shaping can be adjusted according to the requirements of the object to be shaped.

In one embodiment, the method for processing plastic analog information further includes the following steps:

Receiving a trigger instruction for the second target partition, where the trigger instruction is used to select multiple candidate partition images in the plastic face feature database, and the partition type of each partition image is the same as the partition type of the second target partition;

Display images of each partition, and receive a third selection instruction, where the third selection instruction is used to select a target partition image from each partition image;

The target partition image is fused to the position of the second target partition in the original image.

In this embodiment, a second target partition can be selected and triggered, multiple candidate partition images of the same type as the second target partition are selected in the plastic face feature database, and the partition images are displayed for selection of objects to be shaped After the object to be shaped selects the target partition image through the third selection instruction, the target partition image is fused into the original image, so that the object to be shaped can independently select the shaping content and show the effect of shaping the simulated image.

Specifically, the second target partition may be a forehead, eyes, eyebrows, nose, mouth, chin (chin), etc. For example, selecting eye parts as the second target partition may select eyes of different shapes in the plastic face feature database The image is also displayed for selection of the object to be shaped, and after the determination is made, the selected new eye figure is merged into the original image of the object to be shaped to form a shaped simulation image.

In one embodiment, the step of fusing the target partition image to the position of the second target partition in the original image includes the following steps:

Obtain the image size, position and color data of the second target partition, adjust the target partition image according to the image size, position and color data, replace the part of the original image corresponding to the second target partition with the adjusted image, and adjust The butt edge of the original image and the original image are blurred.

In this embodiment, the second target partition is a part of the original image, which has attributes such as image size, position, color, etc. The target partition image is adjusted according to data such as image size, position, and color, so that the target partition image and the original The image is coordinated. In addition, the edge of the interface between the adjusted image and the original image is blurred. The above processing can avoid the abrupt display of the final image and reflect a good simulation effect.

It should be noted that after the fusion and blur processing, another plastic simulation image can be obtained, which is different from the plastic simulation image obtained by adjusting the original image according to the adjustment value of the face feature; after the fusion and blur processing, The fourth modification instruction may be received, and the obtained image may be fine-tuned for feature data according to the fourth modification instruction; or, the second target partition may be selected again from each partition according to the fifth modification instruction.

In addition, the first image sent may be a plastic simulation image obtained by performing simulation adjustment according to the adjustment value of the facial features, or an image obtained by selecting different partitions for fusion processing.

In one embodiment, the method for processing plastic analog information further includes the following steps:

If the feedback is information agreed by the representative, a three-dimensional image is constructed based on the second image and displayed.

In this embodiment, if the feedback opinion agrees, the second image can be used as a plastic simulation effect image, and a three-dimensional image can be constructed therefrom to display the plastic simulation effect more intuitively and clearly from a three-dimensional perspective.

In one embodiment, the method for processing plastic analog information further includes the following steps:

Receive a modification instruction, modify the three-dimensional image according to the modification instruction, obtain and display the final image.

In this embodiment, the plastic simulation effect image is mainly aimed at the face area, and the image of the entire head where the human face is located is also related to the plastic simulation effect. At this time, the three-dimensional image can be modified using the modification instruction to make the final image more Beauty.

According to the above-mentioned shaping analog information processing method, an embodiment of the present invention further provides a shaping analog terminal, and the embodiment of the shaping analog terminal of the present invention will be described in detail below.

An orthopaedic simulation terminal according to an embodiment of the present invention is used to obtain a first image containing a human face, and send the first image to the orthopedic service terminal via the server; receive a second image returned by the orthopedic service terminal via the server, and receive The feedback is sent to the shaping service terminal via the server; the second image is an image obtained after the shaping service terminal adjusts the first image according to the received modification instruction.

In this embodiment, the plastic simulation terminal can be applied on the plastic object side, the plastic simulation terminal obtains the first image containing the human face, and sends the first image to the plastic service terminal. The plastic service terminal can be set on the plastic doctor side, plastic service After receiving the first image, the terminal can receive the first modification instruction to adjust the first image to obtain and return the second image to the plastic emulation terminal; the plastic emulation terminal can receive feedback on the second image. Send feedback to the plastic service terminal to realize the information interaction between the plastic object side and the plastic doctor side on the plastic image, determine the plastic simulation effect image more quickly, which is more in line with the needs of plastic surgery, and can get relatively close to the real and more intuitive plastic Simulation effect, improve the pre-operative reference function of the image of plastic simulation effect.

In one embodiment, the first image includes an original image or a simulated image of the object to be shaped.

In one embodiment, the plastic simulation terminal obtains and displays information of multiple plastic surgeons, receives the first selection instruction, selects the information of the target plastic surgeon according to the first selection instruction, and establishes a communication connection with the plastic service terminal via the server, wherein, The information of the target plastic surgeon is associated with the plastic service terminal.

In one embodiment, the plastic simulation terminal displays a communication window, and performs information interaction with the plastic service terminal through the communication window.

In one embodiment, the shaping simulation terminal obtains the original image of the object to be shaped, sends the original image to the server, receives the face feature adjustment value returned by the server, and performs simulation adjustment on the original image according to the face feature adjustment value to obtain the shaping simulation image;

Among them, the server performs face recognition on the original image to obtain the face feature data of the object to be reshaped; performs matching analysis on the face feature data and the preset shaped face feature database to obtain the face feature adjustment value.

In one embodiment, the shaping simulation terminal obtains a front image and a plurality of side images of the object to be shaped.

In one embodiment, the server acquires the facial region feature points of the object to be shaped, partitions the face according to the facial region feature points, and obtains the feature data of each partition and the contour data of the face; wherein, each partition includes the eye , Nose, mouth, face, and chin. The feature data includes the location data of the current partition and the relative location data between the current partition and other partitions.

In one embodiment, the server compares the face feature data with the preset value of the face feature, determines the face type, and obtains the first sub-database matching the face type in the plastic face feature database, according to the face The feature data searches for matching data in the first sub-database, wherein the similarity between the matching data and the face feature data is greater than or equal to a preset value;

The server obtains the ratio of the facial feature data and the matching data, and obtains the facial feature adjustment value according to the ratio, where the facial feature adjustment value is between the ratio and the value 1.

In one embodiment, the plastic simulation terminal receives a second selection instruction, and the second selection instruction is used to select a first target partition among the partitions;

Among them, the server selects the second sub-database from the plastic face feature database based on the feature data of other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; The face feature data in the sub-database matches the feature data of other partitions than the first target partition.

In one embodiment, the shaping simulation terminal receives the second modification instruction, and fine-tunes the characteristic data of the shaping simulation image according to the second modification instruction;

Alternatively, the plastic simulation terminal receives the third modification instruction, and the third modification instruction is used to select the first target partition from each partition again.

In one embodiment, the plastic simulation terminal receives a trigger instruction for the second target partition, where the trigger instruction is used to select multiple candidate partition images in the plastic face feature database, and the partition type of each partition image is the same as the second The partition type of the target partition is the same;

The plastic simulation terminal displays images of each partition, and receives a third selection instruction, where the third selection instruction is used to select a target partition image from each partition image;

The shaping simulation terminal fuses the target partition image to the position corresponding to the second target partition in the original image.

In one embodiment, the plastic simulation terminal acquires the image size, position and color data of the second target partition, adjusts the target partition image according to the image size, position and color data, and replaces the part of the original image corresponding to the second target partition Into an adjusted image, and blur the edge of the interface between the adjusted image and the original image.

In one embodiment, the plastic simulation terminal constructs and displays a three-dimensional image based on the second image when the feedback opinion is information representing consent.

In one embodiment, the orthopedic simulation terminal receives the retouching instruction, retouches the three-dimensional image according to the retouching instruction, obtains the final image and displays it.

The shaping analog terminal of the present invention corresponds to the shaping analog information processing method of the present invention, and the technical features and beneficial effects described in the embodiments of the shaping analog information processing method described above are applicable to the shaping analog terminal embodiment.

According to the above-mentioned shaping analog information processing method, an embodiment of the present invention further provides another shaping analog information processing method. The following describes in detail another embodiment of the shaping analog information processing method of the present invention.

Referring to FIG. 3, it is a schematic flowchart of a method for processing plastic analog information according to an embodiment of the present invention. The shaping analog information processing method in this embodiment includes the following steps:

Step S210: receiving a first image containing a human face; wherein, the first image is sent by the plastic simulation terminal via the server;

Step S220: Receive a first modification instruction, adjust the first image according to the first modification instruction, obtain a second image, and send the second image to the shaping simulation terminal via the server;

Step S230: Receive feedback on the second image, and if the feedback is information representing consent, save the second image; where the feedback is sent by the shaping service terminal via the server.

In this embodiment, the plastic simulation information processing method can be applied on the side of the plastic surgeon to receive the first image containing the face sent by the plastic simulation terminal, and then can receive the first modification instruction to adjust the first image to obtain And return the second image to the plastic simulation terminal; from the plastic simulation terminal, you can receive feedback on the second image, and when the feedback represents the agreed information, save the second image, which can be used as a plastic simulation effect image to achieve The information interaction between the plastic object side and the plastic surgeon side on the plastic image can determine the plastic simulation effect image more quickly, which is more in line with the needs of plastic surgery, and can obtain a relatively close to the real and more intuitive plastic simulation effect, improve the image of the plastic simulation effect image Preoperative reference role.

Further, the feedback opinion on the second image may be the information agreed by the representative or other modification opinions. If other modification opinions, the first modification instruction may be received again to further modify the first image, and the feedback opinions may be used to determine The final shape simulation image.

Further, after the shaping simulation effect image is obtained, the shaping simulation effect image may be saved locally, or the shaping simulation effect image may be sent to the shaping simulation terminal and stored in the shaping simulation terminal.

Further, when adjusting the first image according to the first modification instruction, the subunit in the face part area in the first image can be adjusted, for example, the face part area is the eye, and the subunit can be the eye, eyelid, eyebrow Part of the face is the nose, and the subunit can be the bridge of the nose, nose, wings, nasal pillars, etc. The part of the face is the face, and the subunit can be the cheeks, cheekbones, etc.

In one embodiment, the method for processing plastic analog information further includes the following steps:

Display the communication window, and exchange information with the plastic simulation terminal through the communication window.

In this embodiment, on the basis of establishing a communication connection with the plastic simulation terminal, a communication window can also be displayed, through which information is exchanged with the plastic simulation terminal to realize communication with the object to be plasticized, so that the plastic surgeon understands the plastic The specific needs of the object for plastic surgery, in order to get the plastic simulation effect image faster.

According to the above-mentioned shaping analog information processing method, an embodiment of the present invention further provides a shaping service terminal, and the embodiment of the shaping service terminal of the present invention will be described in detail below.

An orthopaedic service terminal according to an embodiment of the present invention is used to receive a first image containing a human face; receive a first modification instruction, adjust the first image according to the first modification instruction, obtain a second image, and convert the second image The server sends to the plastic simulation terminal; receives the feedback for the second image; if the feedback is the information representing the consent, save the second image; wherein, the first image and the feedback are sent by the plastic simulation terminal via the server.

In this embodiment, the orthopaedic service terminal can be applied on the side of the orthopedic doctor. The orthopedic service terminal receives the first image containing the human face sent by the orthopedic simulation terminal, and then can receive the first modification instruction to adjust the first image. Obtain and return the second image to the plastic simulation terminal; the plastic simulation terminal sends feedback on the second image to the plastic service terminal. When the feedback represents the agreed information, the plastic service terminal saves the second image, which can be used as Plastic simulation effect image, to realize the information interaction between the plastic object side and the plastic surgeon side, to determine the plastic simulation effect image more quickly, which is more in line with the needs of plastic surgery, and can get relatively close to the real and more intuitive plastic simulation effect, Improve the pre-operative reference effect of plastic simulation images.

In one embodiment, the shaping service terminal displays a communication window, and performs information interaction with the shaping simulation terminal through the communication window.

The shaping service terminal of the present invention corresponds to the above shaping analog information processing method, and the technical features and beneficial effects described in the above shaping analog information processing method embodiments are applicable to the shaping service terminal embodiment.

A readable storage medium has an executable program stored thereon, and when the executable program is executed by a processor, the steps of the above-mentioned shaping analog information processing method are realized.

The above-mentioned readable storage medium, through the executable program stored in it, can realize the information interaction between the plastic object side and the plastic surgeon side on the plastic image, and determine the plastic simulation effect image more quickly, which is more in line with the needs of plastic and can get the relative It is close to the real and more intuitive plastic simulation effect, and improves the preoperative reference function of the plastic simulation effect image.

A shaping simulation device includes a shaping simulation terminal and a shaping service terminal. The shaping simulation terminal obtains a first image containing a human face, and sends the first image to the shaping service terminal via the server; the shaping service terminal receives the first modification instruction, and A modification instruction adjusts the first image, obtains the second image, and sends the second image to the shaping simulation terminal through the server; the shaping simulation terminal receives feedback on the second image, and sends the feedback to the shaping service terminal through the server ; The plastic service terminal obtains the plastic simulation effect image according to the feedback and saves it.

The above-mentioned shaping simulation equipment can realize the information interaction between the shaping object side and the shaping doctor side on the shaping image through the information interaction between the shaping simulation terminal and the shaping service terminal, and the shaping simulation effect image can be determined relatively quickly, which is more in line with shaping If necessary, a plastic simulation effect that is relatively close to reality and more intuitive can be obtained, and the pre-operative reference function of the image of the plastic simulation effect is improved.

In one embodiment, the shaping simulation device further includes a server.

A person of ordinary skill in the art may understand that all or part of the processes in the method of the foregoing embodiments may be completed by instructing relevant hardware through a computer program, and the program may be stored in a non-volatile computer-readable storage medium. As in the embodiment, the program may be stored in the storage medium of the computer system and executed by at least one processor in the computer system to implement the process including the embodiment of the above-described shaping analog information processing method. Among them, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.

Specifically, the above plastic simulation information processing method can be applied to the plastic simulation terminal on the user side and the plastic service terminal on the plastic surgeon side, the plastic simulation terminal sends the plastic simulation image to the plastic service terminal, and invites the plastic surgeon to the plastic simulation image Make adjustments and give revision opinions, and the plastic service terminal returns the revision opinion data. The interactive schematic diagram is shown in Figure 4.

Further, the original image of the object to be reshaped can be directly sent to the reshaping server through the server, receive the modification opinion data returned by the reshaping server, and feed back processing information on the modification opinion data.

In one embodiment, the plastic simulation terminal and the plastic service terminal may be a personal computer, a notebook computer, a palmtop computer, a smart phone, a tablet computer, a portable wearable device, or the like.

The flow chart of plastic analog information processing method is shown in Figure 5. Specifically, the user can scan or photograph the face through electronic devices such as mobile phones, tablets, cameras, and upload three face images (front and side (45 degrees) two) to establish a 3D original image model. Then perform face recognition on the user's original image model, partition each part of the face into forehead, eye (single eye, including eyes, eyebrows), nose (nose, nose wings), jaw, face (both cheeks) Equal partitioning (part partitioning is selected by the user manually setting points), through the face data calculation algorithm, the facial features of the user are analyzed, and the preset standard values are compared to obtain a facial analysis report, the user Automatic shaping simulation can be carried out according to the suggestions in the analysis report, and the shaping recommendation report can be obtained after completion. Users can save the images and reports formed by the simulation as a certain shaping reference. At the same time, users can also analyze individual face parts and replace them with images of various parts in the plastic face database to obtain plastic simulation images. After the analysis, adjustment data can be obtained to adjust the user's face images to obtain plastic simulation. The image can also be replaced with a part image. The user can select a part independently and select the same type of part image from the plastic face database for the user to choose. After the user determines the required part image, the selected part image is fused to the user's face In the part of the image, the docking position is simulated to obtain another shape simulation image. If the effect of the shape simulation is not satisfactory, the user can use the fine-tuning function to process the image of a single part, or reselect the part to perform the shape simulation. Finally, after recalculating and mixing the standard values of the system design, the original image is subjected to corresponding shaping simulation processing to obtain the final shaped simulation image. The user can send this simulation effect image to the online shaping through the online consulting service module (ie, data interaction module) Doctors conduct point-to-point consultations. Online plastic surgeons can fine-tune or rematch each part based on this simulated image to obtain the best plastic simulation image; let the plastic surgeon provide plastic suggestions online and modify customers Simulation data of both sides, so that you can get a plastic simulation image that both parties think is good. Then the user can save the simulation image and print the 3D simulation image. The image will be saved in the database of the doctor’s plastic surgery server. During the doctor's face consultation, the doctor can call up the data as a basis for the face consultation to reduce the communication time between the two parties; the plastic surgeon can use this as a reference for performing plastic surgery, and the customer can also use the sharing function, through WeChat, QQ and other instant messaging software Share with friends. Compared with traditional plastic surgery simulation technology, it can only carry out blurred image processing simply, and cannot integrate medical and cosmetic professional technology, which reduces the user's operation time and improves the efficiency and professionalism of plastic surgery simulation, especially in medical treatment. In the face-to-face consultation of customers after cosmetic surgery, users can get more intuitive simulated images of postoperative effects in advance.

In addition, the solution of the embodiment of the present invention can also be provided with a third-party institutional service terminal such as a hospital. After the plastic surgeon obtains the final plastic simulation image, the configuration requirement information of the plastic surgery can be sent to the institutional service terminal, the hospital and other third-party After arranging the content of plastic surgery, the staff will send the specific plastic stroke information to the plastic simulation terminal of the object to be plasticized and the plastic doctor's plastic service terminal to facilitate the smooth arrangement of plastic surgery.

The technical features of the above-mentioned embodiments can be arbitrarily combined. To simplify the description, all possible combinations of the technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, All should be considered within the scope of this description.

A person of ordinary skill in the art may understand that all or part of the steps in the method of the foregoing embodiments may be implemented by a program instructing relevant hardware. The program can be stored in a computer-readable storage medium. When this program is executed, it includes the steps described in the above method. The storage medium includes: ROM/RAM, magnetic disk, optical disk, etc.

The above examples only express several implementations of the present invention, and their descriptions are more specific and detailed, but they should not be construed as limiting the patent scope of the invention. It should be noted that, for a person of ordinary skill in the art, without departing from the concept of the present invention, a number of modifications and improvements can also be made, which all fall within the protection scope of the present invention. Therefore, the protection scope of the invention patent shall be subject to the appended claims.

Claims (17)

1. A plastic analog information processing method, characterized in that it includes the following steps:

   Obtain a first image containing a human face, and send the first image to a plastic service terminal via a server;

   Receiving a second image returned by the shaping service terminal via the server, where the second image is an image obtained after the shaping service terminal adjusts the first image according to the received first modification instruction;

   Receiving feedback opinions for the second image, and sending the feedback opinions to the plastic service terminal via the server.
2. The shaping analog information processing method according to claim 1, wherein the first image includes an original image or a shaping simulation image of the object to be shaped.
3. The plastic analog information processing method according to claim 2, further comprising the following steps:

   Acquiring and displaying information of multiple plastic surgeons, receiving a first selection instruction, selecting information of a target plastic surgeon according to the first selection instruction, and establishing a communication connection with the plastic service terminal via the server, wherein the target The information of the plastic doctor is associated with the plastic service terminal.
4. The plastic analog information processing method according to claim 3, further comprising the following steps:

   Display a communication window, and perform information interaction with the plastic service terminal through the communication window.
5. The plastic analog information processing method according to claim 2, wherein the step of acquiring the first image containing a human face includes the following steps:

   Obtain the original image of the object to be shaped, send the original image to the server, receive the facial feature adjustment value returned by the server, and perform analog adjustment on the original image according to the facial feature adjustment value to obtain Describe plastic modeling images;

   Wherein, the server performs face recognition on the original image to obtain face feature data of the object to be reshaped; performs matching analysis on the face feature data and a preset shaped face feature database to obtain a face Feature adjustment value.
6. The method for processing analog simulation information according to claim 5, wherein the step of acquiring the original image of the object to be shaped includes the following steps:

   Obtain a front image and multiple side images of the object to be shaped.
7. The plastic analog information processing method according to claim 5, characterized in that the step of acquiring face feature data of the object to be shaped includes the following steps:

   Obtain the feature points of the face area of the object to be reshaped, partition the face according to the feature points of the face area, and obtain the feature data of each zone and the contour data of the face; wherein, each of the zones includes the eye, For the nose, mouth, face and chin, the characteristic data includes position data of the current partition and relative position data between the current partition and other partitions.
8. The plastic analog information processing method according to claim 5, wherein the step of matching and analyzing the facial feature data with a preset plastic facial feature database includes the following steps:

   Comparing the face feature data with the preset value of the face feature to determine the face type, obtaining the first sub-database matching the face type in the plastic face feature database, and according to the person The face feature data searches for matching data in the first sub-database, wherein the similarity between the match data and the face feature data is greater than or equal to a preset value;

   The step of obtaining the adjustment value of the facial features further includes the following steps:

   Obtain a ratio of the face feature data to the matching data, and obtain the face feature adjustment value according to the ratio, where the face feature adjustment value is between the ratio and the value 1.
9. The plastic analog information processing method according to claim 7, further comprising the following steps:

   Receiving a second selection instruction, the second selection instruction is used to select a first target partition among the partitions;

   Wherein, the server selects a second sub-database from the plastic face feature database based on the feature data of other partitions than the first target partition, and compares the feature data of the first target partition with the second The sub-database performs matching analysis; wherein, the face feature data in the second sub-database matches the feature data of other partitions than the first target partition.
10. The plastic analog information processing method according to claim 9, further comprising the following steps:

    Receiving a second modification instruction, and fine-tuning the characteristic data of the shaped analog image according to the second modification instruction;

    or,

    A third modification instruction is received, and the third modification instruction is used to select a first target partition from each of the partitions again.
11. The plastic analog information processing method according to claim 7, further comprising the following steps:

    Receiving a trigger instruction for a second target partition, where the trigger instruction is used to select multiple candidate partition images in the plastic face feature database, the partition type of each partition image and the second target The partition types are the same;

    Displaying each of the partition images and receiving a third selection instruction, wherein the third selection instruction is used to select a target partition image from each of the partition images;

    Fuse the target partition image to a position corresponding to the second target partition in the original image.
12. The plastic analog information processing method according to claim 11, wherein the step of fusing the target partition image to the position of the original image corresponding to the second target partition includes the following steps:

    Obtain the image size, position and color data of the second target partition, adjust the target partition image according to the image size, position and color data, and place the original image corresponding to the second target partition Replace with the adjusted image, and blur the edge of the interface between the adjusted image and the original image.
13. The plastic analog information processing method according to any one of claims 1 to 12, further comprising the following steps:

    If the feedback is the information representing the consent, a three-dimensional image is constructed based on the second image and displayed.
14. The plastic analog information processing method according to claim 13, further comprising the following steps:

    Receiving a modification instruction, modifying the three-dimensional image according to the modification instruction, obtaining a final image and displaying it.
15. A plastic modeling terminal, characterized in that the plastic modeling terminal is used to obtain a first image containing a human face, and the first image is sent to a plastic service terminal via a server; the plastic service terminal is received via the server The returned second image, receiving feedback on the second image, and sending the feedback to the plastic service terminal via the server; wherein, the second image is based on the received by the plastic service terminal An image obtained after the modification instruction adjusts the first image.
16. A plastic analog information processing method, characterized in that it includes the following steps:

    Receiving a first image containing a human face; wherein, the first image is sent by the shaping analog terminal via the server;

    Receiving a first modification instruction, adjusting the first image according to the first modification instruction, obtaining a second image, and sending the second image to the reshaping simulation terminal via the server;

    Receiving feedback on the second image; wherein, the feedback is sent by the shaping service terminal via the server;

    If the feedback is information agreed by the representative, save the second image.
17. A shaping service terminal, characterized in that the shaping service terminal is used to receive a first image containing a human face; receive a first modification instruction, adjust the first image according to the first modification instruction, and obtain a first Two images, and send the second image to the reshaping simulation terminal via the server; receive feedback on the second image; if the feedback is information representing consent, save the second image ; Wherein, the first image and the feedback are sent by the shaping analog terminal via the server.

Images