WO2020135286A1 - Procédé et système de simulation de mise en forme, support de stockage lisible et dispositif - Google Patents

Procédé et système de simulation de mise en forme, support de stockage lisible et dispositif Download PDF

Info

Publication number
WO2020135286A1
WO2020135286A1 PCT/CN2019/127251 CN2019127251W WO2020135286A1 WO 2020135286 A1 WO2020135286 A1 WO 2020135286A1 CN 2019127251 W CN2019127251 W CN 2019127251W WO 2020135286 A1 WO2020135286 A1 WO 2020135286A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
data
face
face feature
shaping
Prior art date
Application number
PCT/CN2019/127251
Other languages
English (en)
Chinese (zh)
Inventor
黄庆武
Original Assignee
甄选医美邦(杭州)网络科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 甄选医美邦(杭州)网络科技有限公司 filed Critical 甄选医美邦(杭州)网络科技有限公司
Publication of WO2020135286A1 publication Critical patent/WO2020135286A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/04—Context-preserving transformations, e.g. by using an importance map
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30—Computing systems specially adapted for manufacturing

Definitions

  • the present invention relates to the field of image processing technology, and in particular, to a plastic modeling method, system, readable storage medium, and device.
  • image processing software can use various image processing software and tools to perform image processing on self-portraits to achieve the effect of plastic simulation, which enriches daily life.
  • Users of image processing software often use the software to perform image stretching on the eyes, nose, face, chin (chin), etc. in the image, such as eye enlargement, chin stretching, face thinning, nose stretching, etc., traditional
  • the image processing method is usually to extract part features of the user's static original image, and then use simple image blur calculation processing to make a certain feature point of the image change. This method only performs image processing according to the user's preferences and simulates the resulting image It is difficult to have a preoperative reference for plastic surgery.
  • a shaping simulation method includes the following steps:
  • the original image is simulated and adjusted according to the face feature adjustment value to obtain a plastic analog image.
  • the shaping simulation method it is to obtain the original image of the object to be shaped, perform face recognition on the original image to obtain face feature data; perform matching analysis on the face feature data and the preset shaped face feature database to obtain the person Face feature adjustment value; simulate and adjust the original image according to the face feature adjustment value to obtain a plastic analog image.
  • the adjustment value of the face feature obtained by matching the face feature data with the data of the plastic face feature database, the simulation adjustment of the original image is more in line with the needs of plastic surgery, and it can obtain a relatively close to real and more intuitive plastic simulation effect, improve plastic surgery Pre-operative reference function of simulated images.
  • the original image of the object to be shaped is acquired, and the step of performing face recognition on the original image includes the following steps:
  • the step of acquiring face feature data of the object to be shaped includes the following steps:
  • the feature points of the face area of the object to be shaped partition the face according to the feature points of the face area, and obtain the feature data of each area and the contour data of the face; where each area includes the eye, nose, mouth, For the face and chin, the feature data includes position data of the current partition and relative position data between the current partition and other partitions.
  • the step of performing matching analysis on the face feature data and the preset plastic face feature database includes the following steps:
  • the step of obtaining the adjustment value of face features also includes the following steps:
  • the step of performing matching analysis on the face feature data and the preset plastic face feature database includes the following steps:
  • the shaping simulation method further includes the following steps:
  • the shaping simulation method further includes the following steps:
  • the target partition image is fused to the position of the second target partition in the original image.
  • the step of fusing the target partition image to the position of the second target partition in the original image includes the following steps:
  • the shaping simulation method further includes the following steps:
  • a shaping simulation system including:
  • the image recognition unit is used to obtain the original image of the object to be shaped, perform face recognition on the original image, and obtain the facial feature data of the object to be shaped;
  • the image analysis unit is used to perform matching analysis on the face feature data and the preset plastic face feature database to obtain the face feature adjustment value;
  • the image adjustment unit performs analog adjustment on the original image according to the adjustment value of the face feature to obtain a plastic analog image.
  • the image recognition unit obtains the original image of the object to be shaped and performs face recognition on the original image to obtain face feature data; the image analysis unit matches the face feature data with the preset shaped face feature database Analyze and obtain the facial feature adjustment value; the image adjustment unit performs analog adjustment on the original image according to the facial feature adjustment value to obtain a plastic analog image.
  • the adjustment value of the face feature obtained by matching the face feature data with the data of the plastic face feature database, the simulation adjustment of the original image is more in line with the needs of plastic surgery, and it can obtain a relatively close to real and more intuitive plastic simulation effect, improve plastic surgery Pre-operative reference function of simulated images.
  • the image recognition unit acquires a front image and a plurality of side images of the object to be shaped, and performs face recognition on the front image and the plurality of side images.
  • the image recognition unit acquires the feature points of the face area of the object to be shaped, partitions the face according to the feature points of the face area, and obtains the feature data of each partition and the contour data of the face; wherein, each partition Including the eyes, nose, mouth, face and chin, the feature data includes the position data of the current partition and the relative position data between the current partition and other partitions.
  • the image analysis unit searches for matching data in the plastic face feature database based on the face feature data, wherein the similarity between the match data and the face feature data is greater than or equal to a preset value;
  • the image analysis unit obtains the ratio of the face feature data and the matching data, and obtains the face feature adjustment value according to the ratio, where the face feature adjustment value is between the ratio and the value 1.
  • the image analysis unit receives the first selection instruction and selects the first target partition among the partitions according to the first selection instruction; according to the feature data of the partitions other than the first target partition, the face features are reshaped
  • the database selects a sub-database, and performs matching analysis on the feature data of the first target partition and the sub-database; wherein, the face feature data in the sub-database matches the feature data of the partitions other than the first target partition.
  • the shaping simulation system further includes an image modification unit for receiving a modification instruction, fine-tuning the characteristic data of the shaping simulation image according to the modification instruction; or, according to the modification instruction, reselecting the first target partition in each partition.
  • the shaping simulation system further includes an image combination unit for receiving a trigger instruction for the second target partition, and selecting a plurality of candidate partition images in the shaping facial feature database according to the trigger instruction, wherein each The partition type of the partition image is the same as the partition type of the second target partition;
  • the image combination unit is further used to display the images of each partition, receive the second selection instruction, and select the target partition image among the partition images according to the second selection instruction;
  • the image combining unit is also used to fuse the target partition image to the position corresponding to the second target partition in the original image.
  • the image combining unit acquires the image size, position and color data of the second target partition, adjusts the target partition image according to the image size, position and color data, and compares the part of the original image corresponding to the second target partition Replace with the adjusted image, and blur the edge of the interface between the adjusted image and the original image.
  • the shaping simulation system further includes a data interaction unit for sending the processed image to the shaping server through the server, receiving the modification opinion data returned by the shaping server, and feeding back processing information on the modification opinion data .
  • a readable storage medium has stored thereon an executable program, and when the executable program is executed by a processor, the steps of the above-mentioned shaping simulation method are realized.
  • the above-mentioned readable storage medium through the executable program stored in it, can achieve the adjustment value of the facial features by matching the facial feature data with the data of the plastic facial feature database, and the analog adjustment of the original image is more in line with the needs of plastic surgery.
  • a relatively close to real and more intuitive plastic simulation effect can be obtained, and the preoperative reference function of the plastic simulation image can be improved.
  • a shaping simulation device includes a memory and a processor.
  • the memory stores an executable program.
  • the processor executes the executable program, the steps of the shaping simulation method described above are implemented.
  • the above-mentioned shaping simulation device can achieve the adjustment value of the face feature by matching the face feature data with the data of the shaping face feature database by running the executable program on the processor, and the simulation adjustment of the original image is more in line with the needs of shaping , You can get relatively close to the real and more intuitive plastic simulation effect, improve the pre-operative reference role of plastic simulation images.
  • FIG. 1 is an application scenario diagram of a shaping simulation method in an embodiment
  • FIG. 2 is a schematic flow chart of a method for shaping simulation in an embodiment
  • FIG. 3 is an interactive schematic diagram of a shaping simulation method in an embodiment
  • FIG. 4 is a schematic structural diagram of a shaping simulation system in an embodiment
  • FIG. 5 is a schematic structural diagram of a shaping simulation system in another embodiment
  • FIG. 6 is a schematic structural diagram of a shaping simulation system in yet another embodiment
  • FIG. 7 is a schematic structural diagram of a shaping simulation system in yet another embodiment
  • FIG. 8 is a schematic diagram of a specific application process of the shaping simulation method in an embodiment.
  • first ⁇ second involved in the embodiment of the present invention is only to distinguish similar objects, and does not represent a specific order for objects. Understandably, “first ⁇ second” is allowed The specific order or sequence can be interchanged below. It should be understood that the objects distinguished by “first ⁇ second” may be interchanged under appropriate circumstances, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein.
  • the shaping simulation method provided in this application can be applied in the application environment shown in FIG. 1, the mobile device can obtain the original image of the object to be shaped (ie, the user), perform face recognition on the original image, and obtain face feature data ; Perform matching analysis on the face feature data and the preset plastic face feature database to obtain the face feature adjustment value; simulate and adjust the original image according to the face feature adjustment value to obtain the plastic simulation image.
  • the mobile device may be a variety of devices with functions of acquiring user images and image processing, such as personal computers, notebook computers, PDAs, smart phones, tablet computers, and portable wearable devices.
  • FIG. 2 it is a schematic flowchart of a shaping simulation method according to an embodiment of the present invention.
  • the shaping simulation method in this embodiment includes the following steps:
  • Step S110 Obtain the original image of the object to be shaped, perform face recognition on the original image, and obtain the facial feature data of the object to be shaped;
  • the original image can be captured by the camera of the electronic device or obtained by scanning; during facial recognition, the characteristics of the human face in the original image can be analyzed to obtain facial feature data;
  • Step S120 Perform matching analysis on the face feature data and the preset plastic face feature database to obtain the face feature adjustment value
  • the plastic face feature database is a pre-set collection of commonly used face feature material data for plastic surgery.
  • the facial feature adjustment value can be obtained.
  • the facial feature adjustment value can reduce the feature difference, so that the face in the adjusted image is close to the plastic face to achieve The effect of plastic simulation;
  • Step S130 Perform simulation adjustment on the original image according to the face feature adjustment value to obtain a plastic simulation image
  • this step when performing analog adjustment according to the face feature adjustment value, it is mainly to adjust the face feature data, and image deformation processing can be performed based on the face feature points.
  • the original image of the object to be shaped is obtained, and the original image is subjected to face recognition to obtain face feature data; the face feature data is matched with the preset shaped face feature database to obtain face features Adjustment value; adjust the original image according to the adjustment value of the facial features to obtain the plastic simulation image.
  • the adjustment value of the face feature obtained by matching the face feature data with the data of the plastic face feature database, the simulation adjustment of the original image is more in line with the needs of plastic surgery, and it can obtain a relatively close to real and more intuitive plastic simulation effect, improve plastic surgery Pre-operative reference function of simulated images.
  • an image facial analysis report can be generated, and the plastic surgery based on the facial feature adjustment value is given in the report It is recommended that after receiving the confirmation information, the original image is automatically simulated and adjusted, and a plastic recommendation report is given after completion, including specific plastic parts, plastic methods and plastic effect description information.
  • diffusion, sharpening, and deformation algorithms can be used to process images during simulation adjustment.
  • the shooting area can be defined, such as a shooting area similar to the shape of the face, etc.
  • the original image is The required face image can reduce the time of face recognition and improve the accuracy of recognition.
  • it senses the brightness when shooting, if the brightness is less than the preset brightness value, turn on The flash or the brightness is insufficient; during face recognition, you can also detect the makeup on the face, prompt to clean and then perform plastic simulation, if you detect accessories on the face, prompt to remove the accessories, such as glasses, false eyelashes, Nose nails, etc.
  • the original image of the object to be shaped is obtained, and the step of performing face recognition on the original image includes the following steps:
  • multiple images of the object to be shaped can be obtained, including a frontal image and a side image.
  • the frontal image and the multiple side images are images obtained from different angles, based on which the influence of illumination, angle, etc. can be reduced To make face recognition more accurate.
  • a front image of the object to be shaped and two side images at a 45-degree angle can be obtained.
  • the 3D original image model can be constructed based on this, and the 3D model algorithm can be used for accurate face recognition.
  • the step of acquiring face feature data of the object to be shaped includes the following steps:
  • the feature points of the face area of the object to be shaped partition the face according to the feature points of the face area, and obtain the feature data of each area and the contour data of the face; where each area includes the eye, nose, mouth, For the face and chin, the feature data includes position data of the current partition and relative position data between the current partition and other partitions.
  • facial region feature points can be obtained, and the feature point distribution of different regions on the human face is different.
  • the facial region feature points can be used to partition the facial region to obtain, for example, eye parts. , Nose, mouth, face, chin, etc. and the contour data of the face, the feature data includes the position data of the current face part and the relative position data between the current face part and other parts, In order to simulate and shape different areas of the human face.
  • the characteristic regions on the human face may include forehead, eyes, eyebrows, eyelids, nose bridge, nose, nose wings, cheeks, mouth, chin, etc., and also include facial contour data such as the overall contour of the face.
  • Feature points to achieve the division of facial feature area parts, when acquiring feature data, not only the data of the feature area parts themselves, but also the position data of the feature area parts and the relative position data with other feature areas, and the feature area parts
  • the data such as color and brightness can be integrated in the shaping simulation to improve the coordination of the simulation effect.
  • the step of performing matching analysis on the face feature data and the preset plastic face feature database includes the following steps:
  • the step of obtaining the adjustment value of face features also includes the following steps:
  • the similarity between the face feature data and the data in the plastic face feature database can be used to determine the matching data.
  • the person After the similarity matching analysis is performed on the face feature data and the plastic face feature database, the person can be shaped
  • the matching data matching the face feature data after image analysis is obtained from the face feature database, but it is different from the face feature data after image analysis.
  • the face feature adjustment value may be dynamic data, which is dynamically adjusted between the ratio and the value 1 according to the needs of the object to be shaped.
  • the step of performing matching analysis on the face feature data and the preset plastic face feature database includes the following steps:
  • the first target partition can be selected through the first selection instruction, and a sub-database can be selected in the plastic face feature database according to the feature data of other partitions, because the face feature data in the sub-database is different from the first target partition
  • the feature data of the other partitions of the database match. Therefore, when the feature data of the first target partition and the sub-database are matched and analyzed, the feature adjustment value of the first target partition obtained can make the first target partition coordinate with other partitions and improve the The overall coordination of the plastic simulation of a single partition.
  • the shaping simulation method further includes the following steps:
  • the image is simulated and adjusted according to the facial feature adjustment value, and after obtaining the plastic simulation image, the plastic simulation image may not meet the requirements of the object to be shaped, at this time, a modification instruction may be received, and the features may be modified according to the modification instruction. Fine-tune the data to meet the specific requirements of the object to be reshaped; or, the current simulation of the first target partition does not meet the requirements of the object to be reshaped. You can select a new first target partition for reshaping simulation, so that you can follow the The requirements of the object to be reshaped adjust the simulated reshaping.
  • the shaping simulation method further includes the following steps:
  • the target partition image is fused to the position of the second target partition in the original image.
  • a second target partition can be selected and triggered, multiple candidate partition images of the same type as the second target partition are selected in the plastic face feature database, and the partition images are displayed for selection of objects to be shaped After the object to be shaped selects the target partition image through the second selection instruction, the target partition image is fused into the original image, so that the object to be shaped can independently select the shaping content and show the effect of shaping the simulated image.
  • the second target partition may be a forehead, eyes, eyebrows, nose, mouth, chin, etc.
  • selecting an eye part as the second target partition may select and display eye images of different shapes in the plastic face feature database and display For selection of the object to be shaped, and after the determination, the selected new eye shape is merged into the original image of the object to be shaped to form a shaped simulation image.
  • the step of fusing the target partition image to the position of the second target partition in the original image includes the following steps:
  • the second target partition is a part of the original image, which has attributes such as image size, position, color, etc.
  • the target partition image is adjusted according to data such as image size, position, and color, so that the target partition image and the original The image is coordinated.
  • the edge of the interface between the adjusted image and the original image is blurred.
  • another plastic simulation image can be obtained, which is different from the plastic simulation image obtained by adjusting the original image according to the adjustment value of the face feature; after the fusion and blur processing, The modification instruction may be received, and the obtained image may be fine-tuned for the characteristic data according to the modification instruction; or, the second target partition may be selected again from each partition according to the modification instruction.
  • the shaping simulation method further includes the following steps:
  • the image after the image is processed, it can be sent to the shaping server through the server, and the shaping server can obtain the modification opinion data for the image and return it; the sending end can feed back the corresponding processing information for the modification opinion data, Through this interactive way, the image can be further adjusted and modified.
  • the processed image may be an orthopaedic simulated image obtained by performing simulation adjustment according to the adjustment value of the face feature, or an image obtained by selecting different partitions and performing fusion processing.
  • the above processing procedure can be applied to the consulting terminal device on the user side, and the shaping server can be provided on the receiving terminal on the side of the plastic doctor.
  • the consulting terminal of the user sends the plastic simulation image to the receiving terminal of the plastic doctor, inviting the doctor Adjust the plastic simulation image and give the modification opinion, the receiving terminal returns the modification opinion data, and the interactive schematic diagram is shown in Figure 3.
  • the original image of the object to be reshaped can be directly sent to the reshaping server through the server, receive the modification opinion data returned by the reshaping server, and feed back processing information on the modification opinion data.
  • an embodiment of the present invention also provides a shaping simulation system.
  • the embodiment of the shaping simulation system of the present invention will be described in detail below.
  • FIG. 4 it is a schematic structural diagram of a shaping simulation system according to an embodiment of the present invention.
  • the shaping simulation system in this embodiment includes:
  • the image recognition unit 210 is used to obtain the original image of the object to be shaped, perform face recognition on the original image, and obtain the facial feature data of the object to be shaped;
  • the image analysis unit 220 is used to perform matching analysis on the facial feature data and the preset plastic facial feature database to obtain the facial feature adjustment value;
  • the image adjustment unit 230 performs analog adjustment on the original image according to the face feature adjustment value to obtain a plastic analog image.
  • the image recognition unit 210 obtains the original image of the object to be shaped, and performs face recognition on the original image to obtain face feature data; the image analysis unit 220 compares the face feature data with the preset shaped face feature database Perform matching analysis to obtain the face feature adjustment value; the image adjustment unit 230 performs analog adjustment on the original image according to the face feature adjustment value to obtain a plastic analog image.
  • the adjustment value of the face feature obtained by matching the face feature data with the data of the plastic face feature database, the simulation adjustment of the original image is more in line with the needs of plastic surgery, and it can obtain a relatively close to real and more intuitive plastic simulation effect, improve plastic surgery Pre-operative reference function of simulated images.
  • the image recognition unit 210 acquires a front image and multiple side images of the object to be shaped, and performs face recognition on the front image and the multiple side images.
  • the image recognition unit 210 acquires the facial region feature points of the object to be shaped, partitions the face according to the facial region feature points, and acquires the feature data of each partition and the contour data of the face; wherein, each partition Including the eyes, nose, mouth, face and chin, the feature data includes the position data of the current partition and the relative position data between the current partition and other partitions.
  • the image analysis unit 220 searches for matching data in the plastic face feature database according to the face feature data, where the similarity of the match data and the face feature data is greater than or equal to a preset value;
  • the image analysis unit 220 acquires the ratio of the facial feature data to the matching data, and acquires the facial feature adjustment value according to the ratio, where the facial feature adjustment value is between the ratio and the value 1.
  • the image analysis unit 220 receives the first selection instruction and selects the first target partition among the partitions according to the first selection instruction; according to the feature data of the partitions other than the first target partition, the face features are reshaped
  • the database selects a sub-database, and performs matching analysis on the feature data of the first target partition and the sub-database; wherein, the face feature data in the sub-database matches the feature data of the partitions other than the first target partition.
  • the shaping simulation system further includes an image modification unit 240 for receiving a modification instruction, and fine-tuning the characteristic data of the shaping simulation image according to the modification instruction; or, according to the modification instruction, in each partition Select the first target partition.
  • the shaping simulation system further includes an image combining unit 250 for receiving a trigger instruction for the second target partition, and selecting a plurality of candidate candidates in the shaping facial feature database according to the trigger instruction Partition images, where the partition type of each partition image is the same as the partition type of the second target partition;
  • the image combining unit 250 is further used to display each partition image, receive a second selection instruction, and select a target partition image from each partition image according to the second selection instruction;
  • the image combining unit 250 is also used to fuse the target partition image to the position of the original image corresponding to the second target partition.
  • the image combining unit 250 acquires the image size, position and color data of the second target partition, adjusts the target partition image according to the image size, position and color data, and compares the part of the original image corresponding to the second target partition Replace with the adjusted image, and blur the edge of the interface between the adjusted image and the original image.
  • the shaping simulation system further includes a data interaction unit 270 for sending the shaping simulation image to the shaping server via the server, receiving the modification opinion data returned by the shaping server, and feeding back the modification Processing information of opinion data.
  • the shaping simulation system of the present invention corresponds to the shaping simulation method of the present invention, and the technical features and beneficial effects described in the above embodiments of the shaping simulation method are applicable to the embodiments of the shaping simulation system.
  • a readable storage medium has stored thereon an executable program, and when the executable program is executed by a processor, the steps of the above-mentioned shaping simulation method are realized.
  • the above-mentioned readable storage medium through the executable program stored in it, can achieve the adjustment value of the facial features by matching the facial feature data with the data of the plastic facial feature database, and the analog adjustment of the original image is more in line with the needs of plastic surgery.
  • a relatively close to real and more intuitive plastic simulation effect can be obtained, and the preoperative reference function of the plastic simulation image can be improved.
  • a shaping simulation device includes a memory and a processor.
  • the memory stores an executable program.
  • the processor executes the executable program, the steps of the shaping simulation method described above are implemented.
  • the above-mentioned shaping simulation device can achieve the adjustment value of the face feature by matching the face feature data with the data of the shaping face feature database by running the executable program on the processor, and the simulation adjustment of the original image is more in line with the needs of shaping , You can get relatively close to the real and more intuitive plastic simulation effect, improve the pre-operative reference role of plastic simulation images.
  • the above-mentioned shaping simulation device by running an executable program on the processor, obtains the face feature adjustment value by matching the face feature data with the data of the shaping face feature database, and the simulation adjustment of the original image is more in line with the needs of shaping. Obtain a relatively close to real and more intuitive plastic simulation effect, and improve the preoperative reference function of plastic simulation images.
  • the program may be stored in a non-volatile computer-readable storage medium.
  • the program may be stored in a storage medium of the computer system and executed by at least one processor in the computer system to implement the process including the embodiment of the above-described shaping simulation method.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.
  • the shaping simulation device further includes a shaping server device.
  • the shaping simulation method can be applied to a mobile device, which can be a personal computer, a notebook computer, a palmtop computer, a smartphone, a tablet computer, a portable wearable device, and the like.
  • the flow chart of the shaping simulation method is shown in Figure 8.
  • the user can scan or photograph the face through electronic devices such as mobile phones, tablets, cameras, and upload three face images (front and side (45 degrees) two) to establish a 3D original image model. Then perform face recognition on the user's original image model, partition each part of the face into forehead, eye (single eye, including eyes, eyebrows), nose (nose, nose wings), chin, face (both cheeks) ) And other partitions (parts are selected by the user manually setting points), through the face data calculation algorithm, the user's facial features are analyzed, and the preset standard values are compared to obtain a facial analysis report, The user can perform automatic shaping simulation according to the suggestions in the analysis report, and the shaping recommendation report is obtained after completion.
  • the user can save the image and report formed by the simulation as a certain shaping reference.
  • users can also analyze individual face parts and replace them with images of various parts in the plastic face database to obtain plastic simulation images.
  • adjustment data can be obtained to adjust the user's face images to obtain plastic simulation.
  • the image can also be replaced with a part image.
  • the user can select a part independently and select the same type of part image from the plastic face database for the user to choose. After the user determines the required part image, the selected part image is fused to the user's face In the part of the image, the docking position is simulated to obtain another shape simulation image.
  • the user can use the fine-tuning function to process the image of a single part, or reselect the part to perform the shape simulation.
  • the original image is subjected to corresponding shaping simulation processing to obtain the final shaped simulation image.
  • the user can send this simulation effect image to the online shaping through the online consulting service module (ie, data interaction module) Doctors conduct point-to-point consultations. Online plastic surgeons can fine-tune or rematch each part based on this simulated image to obtain the best plastic simulation image; let the plastic surgeon provide plastic suggestions online and modify customers Simulation data of both sides, so that you can get a plastic simulation image that both parties think is good.
  • the user can save the simulation image and print the 3D simulation image.
  • the image will be saved in the database of the doctor’s plastic surgery server.
  • the doctor can call up the data as a basis for the face consultation to reduce the communication time between the two parties; it can also be shared with friends through instant messaging software such as WeChat and QQ through the sharing function.
  • instant messaging software such as WeChat and QQ through the sharing function.
  • it can only be achieved through simple Blurred image processing cannot be integrated with medical and cosmetic professional technology, which reduces the user's operation time and improves the efficiency and professionalism of plastic simulation, especially when applied to the customer's face-to-face consultation after medical cosmetic surgery, which can make the user more intuitive in advance Obtain post-operative effect simulation images.
  • the program can be stored in a computer-readable storage medium. When this program is executed, it includes the steps described in the above method.
  • the storage medium includes: ROM/RAM, magnetic disk, optical disk, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)

Abstract

La présente invention concerne un procédé et un système de simulation de mise en forme, un support de stockage lisible et un dispositif, appartenant au domaine de la technologie de traitement d'image. Le procédé consiste à : acquérir une image d'origine d'un objet à mettre en forme, et effectuer une reconnaissance faciale sur l'image d'origine pour obtenir des données de caractéristiques de visage ; effectuer une mise en correspondance et une analyse entre les données de caractéristiques de visage et une base de données de caractéristiques de visages mis en forme prédéfinie, pour acquérir une valeur d'ajustement de caractéristiques de visage ; et effectuer un ajustement de simulation sur l'image d'origine selon la valeur d'ajustement de caractéristiques de visage, pour obtenir une image de simulation de mise en forme. Au moyen d'une valeur d'ajustement de caractéristiques de visage obtenue en effectuant une mise en correspondance entre des données de caractéristiques de visage et des données d'une base de données de caractéristiques de visages mis en forme, un ajustement de simulation sur une image d'origine se conforme mieux aux critères de mise en forme, et un effet de simulation de mise en forme qui est relativement proche de la réalité et est plus intuitif peut être obtenu, ce qui améliore l'effet de référence préopératoire d'une image de simulation de mise en forme.
PCT/CN2019/127251 2018-12-24 2019-12-22 Procédé et système de simulation de mise en forme, support de stockage lisible et dispositif WO2020135286A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811581506.0A CN111353931B (zh) 2018-12-24 2018-12-24 整形模拟方法、系统、可读存储介质和设备
CN201811581506.0 2018-12-24

Publications (1)

Publication Number Publication Date
WO2020135286A1 true WO2020135286A1 (fr) 2020-07-02

Family

ID=71126289

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/127251 WO2020135286A1 (fr) 2018-12-24 2019-12-22 Procédé et système de simulation de mise en forme, support de stockage lisible et dispositif

Country Status (2)

Country Link
CN (1) CN111353931B (fr)
WO (1) WO2020135286A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114494601B (zh) * 2022-02-09 2024-03-08 南京医科大学附属口腔医院 基于人脸图像的三维人脸检索正畸矫正和疗效模拟系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8265351B2 (en) * 2006-05-05 2012-09-11 Parham Aarabi Method, system and computer program product for automatic and semi-automatic modification of digital images of faces
CN107123160A (zh) * 2017-05-02 2017-09-01 成都通甲优博科技有限责任公司 基于三维立体图像的模拟整容系统、方法及移动终端
CN107122727A (zh) * 2017-04-20 2017-09-01 北京旷视科技有限公司 用于脸部整形的方法、装置及系统
CN108447017A (zh) * 2018-05-31 2018-08-24 Oppo广东移动通信有限公司 人脸虚拟整容方法和装置
CN108765273A (zh) * 2018-05-31 2018-11-06 Oppo广东移动通信有限公司 人脸拍照的虚拟整容方法和装置
CN109189967A (zh) * 2018-08-24 2019-01-11 微云（武汉）科技有限公司 一种基于人脸识别的整容方案推荐方法、装置和存储介质

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2728982A1 (fr) * 1994-12-29 1996-07-05 Jean Marc Robin Reconnaissance automatique des traits caracteristiques du visage et simulation d'une image esthetique d'un objectif (visage) reel
CN106652015B (zh) * 2015-10-30 2020-10-30 深圳超多维光电子有限公司 一种虚拟人物头像生成方法及装置
CN105938627B (zh) * 2016-04-12 2020-03-31 湖南拓视觉信息技术有限公司 用于人脸虚拟整形的处理方法和系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8265351B2 (en) * 2006-05-05 2012-09-11 Parham Aarabi Method, system and computer program product for automatic and semi-automatic modification of digital images of faces
CN107122727A (zh) * 2017-04-20 2017-09-01 北京旷视科技有限公司 用于脸部整形的方法、装置及系统
CN107123160A (zh) * 2017-05-02 2017-09-01 成都通甲优博科技有限责任公司 基于三维立体图像的模拟整容系统、方法及移动终端
CN108447017A (zh) * 2018-05-31 2018-08-24 Oppo广东移动通信有限公司 人脸虚拟整容方法和装置
CN108765273A (zh) * 2018-05-31 2018-11-06 Oppo广东移动通信有限公司 人脸拍照的虚拟整容方法和装置
CN109189967A (zh) * 2018-08-24 2019-01-11 微云（武汉）科技有限公司 一种基于人脸识别的整容方案推荐方法、装置和存储介质

Also Published As

Publication number Publication date
CN111353931A (zh) 2020-06-30
CN111353931B (zh) 2023-10-03

Similar Documents

Publication Publication Date Title
US10979624B2 (en) Methods and devices for establishing photographing template database and providing photographing recommendation information
US9367756B2 (en) Selection of representative images
CN109310196B (zh) 化妆辅助装置以及化妆辅助方法
WO2020019904A1 (fr) Procédé et appareil de traitement d'image, dispositif informatique et support de stockage
TW202046249A (zh) 虛擬頭像生成方法及裝置、儲存介質
US20120007859A1 (en) Method and apparatus for generating face animation in computer system
US11461384B2 (en) Facial images retrieval system
JP2009064423A (ja) メイクアップシミュレーションシステム、メイクアップシミュレーション装置、メイクアップシミュレーション方法およびメイクアップシミュレーションプログラム
CN110866139A (zh) 一种化妆处理方法、装置及设备
WO2020135287A1 (fr) Procédé de traitement d'informations de simulation de chirurgie plastique, terminal de simulation de chirurgie plastique et terminal de service de chirurgie plastique
WO2023010796A1 (fr) Procédé de traitement d'image et appareil associé
WO2020135286A1 (fr) Procédé et système de simulation de mise en forme, support de stockage lisible et dispositif
KR102594093B1 (ko) 딥러닝 기술을 활용한 피부과 시술 추천 시스템 및 방법
Barroso et al. Periocular recognition: how much facial expressions affect performance?
CN112995520B (zh) 一种证件照快速拍摄方法、系统和可读存储介质
KR102330833B1 (ko) 성형 큐레이션 서비스 방법
CN111370100A (zh) 基于云端服务器的整容推荐方法及系统
KR101507410B1 (ko) 모바일 단말의 라이브 메이크업 촬영 방법 및 장치
JP2014149841A (ja) 美容カウンセリング方法
CN114333018A (zh) 整形信息推荐方法、装置及电子设备
KR101382172B1 (ko) 얼굴 영상의 계층적 특징 분류 시스템 및 그 방법
CN111444979A (zh) 一种整容方案推荐方法、云端设备及存储介质
CN113902790B (zh) 美容指导方法、装置、电子设备和计算机可读存储介质
TW202122040A (zh) 臉部肌肉狀態分析與評價方法
CN113076779A (zh) 整形模拟匹配方法、系统、可读存储介质和设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19904968

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19904968

Country of ref document: EP

Kind code of ref document: A1