CN111353931A - Shaping simulation method, shaping simulation system, readable storage medium and device - Google Patents

Shaping simulation method, shaping simulation system, readable storage medium and device Download PDF

Info

Publication number
CN111353931A
CN111353931A CN201811581506.0A CN201811581506A CN111353931A CN 111353931 A CN111353931 A CN 111353931A CN 201811581506 A CN201811581506 A CN 201811581506A CN 111353931 A CN111353931 A CN 111353931A
Authority
CN
China
Prior art keywords
image
face
data
face feature
reshaping
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811581506.0A
Other languages
Chinese (zh)
Other versions
CN111353931B (en
Inventor
黄庆武
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huang Qingwu Plastic Doctor Group Shenzhen Co ltd
Original Assignee
Huang Qingwu Plastic Doctor Group Shenzhen Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huang Qingwu Plastic Doctor Group Shenzhen Co ltd filed Critical Huang Qingwu Plastic Doctor Group Shenzhen Co ltd
Priority to CN201811581506.0A priority Critical patent/CN111353931B/en
Priority to PCT/CN2019/127251 priority patent/WO2020135286A1/en
Publication of CN111353931A publication Critical patent/CN111353931A/en
Application granted granted Critical
Publication of CN111353931B publication Critical patent/CN111353931B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/18Image warping, e.g. rearranging pixels individually
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/04Context-preserving transformations, e.g. by using an importance map
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)

Abstract

The invention relates to a shaping simulation method, a shaping simulation system, a readable storage medium and a device, which belong to the technical field of image processing, and are used for acquiring an original image of an object to be shaped, and performing face recognition on the original image to obtain face characteristic data; matching analysis is carried out on the face feature data and a preset reshaping face feature database to obtain a face feature adjustment value; and carrying out analog adjustment on the original image according to the face characteristic adjustment value to obtain a reshaping analog image. The face feature adjustment value obtained by matching the face feature data with the data of the reshaping face feature database better meets the reshaping requirement for the simulation adjustment of the original image, can obtain a reshaping simulation effect which is relatively close to reality and is more visual, and improves the preoperative reference effect of the reshaping simulation image.

Description

Shaping simulation method, shaping simulation system, readable storage medium and device
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a method, a system, a readable storage medium, and a device for shaping simulation.
Background
With the continuous improvement of the social living standard, more and more beauty workers are required, and the rapid development of the medical and beauty industry is promoted. A user can perform image processing on the self-photographing through various image processing software and tools so as to achieve an effect of shaping simulation, and daily life is enriched. A user using image processing software often performs image stretching processing, such as eye enlargement, chin stretching, face thinning, nose and head stretching, on eyes, nose, face, chin (chin) and the like in an image through software, and a conventional image processing method generally performs part feature extraction on a static original image of the user and then applies simple image blurring calculation processing to change a certain feature point of the image.
Disclosure of Invention
Based on this, it is necessary to provide a shaping simulation method, system, readable storage medium and device for solving the problem that the conventional image processing method has difficulty in having a pre-operation reference function for shaping.
A method of shaping simulation comprising the steps of:
acquiring an original image of an object to be reshaped, and performing face recognition on the original image to acquire face characteristic data of the object to be reshaped;
matching analysis is carried out on the face feature data and a preset reshaping face feature database to obtain a face feature adjustment value;
and carrying out analog adjustment on the original image according to the face characteristic adjustment value to obtain a reshaping analog image.
According to the reshaping simulation method, an original image of an object to be reshaped is obtained, and face recognition is performed on the original image to obtain face feature data; matching analysis is carried out on the face feature data and a preset reshaping face feature database to obtain a face feature adjustment value; and carrying out analog adjustment on the original image according to the face characteristic adjustment value to obtain a reshaping analog image. The face feature adjustment value obtained by matching the face feature data with the data of the reshaping face feature database better meets the reshaping requirement for the simulation adjustment of the original image, can obtain a reshaping simulation effect which is relatively close to reality and is more visual, and improves the preoperative reference effect of the reshaping simulation image.
In one embodiment, the step of obtaining an original image of an object to be reshaped and performing face recognition on the original image comprises the following steps:
acquiring a front image and a plurality of side images of an object to be shaped, and carrying out face recognition on the front image and the side images.
In one embodiment, the step of obtaining the face feature data of the object to be reshaped comprises the following steps:
acquiring face region characteristic points of an object to be shaped, partitioning a face according to the face region characteristic points, and acquiring characteristic data of each partition and contour data of the face; wherein each partition comprises eyes, a nose, a mouth, a face and a chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions.
In one embodiment, the step of performing matching analysis on the face feature data and a preset reshaped face feature database includes the following steps:
searching matched data in a shaping face feature database according to the face feature data, wherein the similarity between the matched data and the face feature data is greater than or equal to a preset value;
the step of obtaining the face feature adjustment value further comprises the following steps:
and acquiring a ratio of the face feature data to the matching data, and acquiring a face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1.
In one embodiment, the step of performing matching analysis on the face feature data and a preset reshaped face feature database includes the following steps:
receiving a first selection instruction, and selecting a first target partition in each partition according to the first selection instruction;
selecting a sub-database from the reshaping face feature database according to the feature data of other partitions except the first target partition, wherein the face feature data in the sub-database is matched with the feature data of other partitions except the first target partition;
and performing matching analysis on the characteristic data of the first target partition and the sub-database.
In one embodiment, the shaping simulation method further comprises the following steps:
receiving a modification instruction, and finely adjusting feature data of the full-shape simulation image according to the modification instruction;
or, the first target partition is selected from the partitions again according to the modification instruction.
In one embodiment, the shaping simulation method further comprises the following steps:
receiving a trigger instruction aiming at a second target partition, and selecting a plurality of candidate partition images from a shaping human face feature database according to the trigger instruction, wherein the partition type of each partition image is the same as that of the second target partition;
displaying each subarea image, receiving a second selection instruction, and selecting a target subarea image from each subarea image according to the second selection instruction;
and fusing the target subarea image to the position corresponding to the second target subarea in the original image.
In one embodiment, the step of fusing the target partition image to the position of the original image corresponding to the second target partition comprises the steps of:
and acquiring the image size, position and color data of the second target subarea, adjusting the target subarea image according to the image size, position and color data, replacing the part of the original image corresponding to the second target subarea with the adjusted image, and performing fuzzy processing on the butt joint edge of the adjusted image and the original image.
In one embodiment, the shaping simulation method further comprises the following steps:
and sending the processed image to a shaping server through a server, receiving modification opinion data returned by the shaping server, and feeding back processing information of the modification opinion data.
A reshaping simulation system comprising:
the image recognition unit is used for acquiring an original image of the object to be reshaped, performing face recognition on the original image and acquiring face characteristic data of the object to be reshaped;
the image analysis unit is used for carrying out matching analysis on the face feature data and a preset reshaping face feature database to obtain a face feature adjustment value;
and the image adjusting unit is used for performing analog adjustment on the original image according to the face characteristic adjusting value to obtain a shaping analog image.
According to the reshaping simulation system, the image recognition unit acquires an original image of an object to be reshaped, and performs face recognition on the original image to obtain face feature data; the image analysis unit performs matching analysis on the face feature data and a preset reshaping face feature database to obtain a face feature adjustment value; and the image adjusting unit performs analog adjustment on the original image according to the face characteristic adjusting value to obtain a shaping analog image. The face feature adjustment value obtained by matching the face feature data with the data of the reshaping face feature database better meets the reshaping requirement for the simulation adjustment of the original image, can obtain a reshaping simulation effect which is relatively close to reality and is more visual, and improves the preoperative reference effect of the reshaping simulation image.
In one embodiment, the image recognition unit acquires a front image and a plurality of side images of the object to be reshaped, and performs face recognition on the front image and the plurality of side images.
In one embodiment, the image recognition unit acquires face region feature points of an object to be reshaped, partitions the face according to the face region feature points, and acquires feature data of each partition and contour data of the face; wherein each partition comprises eyes, a nose, a mouth, a face and a chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions.
In one embodiment, the image analysis unit searches a reshaped face feature database for matching data according to the face feature data, wherein the similarity between the matching data and the face feature data is greater than or equal to a preset value;
the image analysis unit obtains the ratio of the face feature data to the matching data, and obtains a face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1.
In one embodiment, the image analysis unit receives a first selection instruction, and selects a first target partition from the partitions according to the first selection instruction; selecting a sub-database from the shaping face feature database according to the feature data of other partitions except the first target partition, and performing matching analysis on the feature data of the first target partition and the sub-database; and the face feature data in the sub-database is matched with the feature data of other partitions except the first target partition.
In one embodiment, the reshaping simulation system further comprises an image modification unit, which is used for receiving a modification instruction and performing characteristic data fine adjustment on the reshaping simulation image according to the modification instruction; or, the first target partition is selected from the partitions again according to the modification instruction.
In one embodiment, the reshaping simulation system further comprises an image combination unit, configured to receive a trigger instruction for a second target partition, and select a plurality of candidate partition images from the reshaping face feature database according to the trigger instruction, where the partition type of each partition image is the same as the partition type of the second target partition;
the image combination unit is also used for displaying each subarea image, receiving a second selection instruction and selecting a target subarea image from each subarea image according to the second selection instruction;
the image combination unit is also used for fusing the target subarea image to the position of the original image corresponding to the second target subarea.
In one embodiment, the image combination unit obtains the image size, the position and the color data of the second target partition, adjusts the target partition image according to the image size, the position and the color data, replaces the part of the original image corresponding to the second target partition with the adjusted image, and performs the blurring processing on the joint edge of the adjusted image and the original image.
In one embodiment, the shaping simulation system further includes a data interaction unit, which is used for sending the processed image to the shaping server through the server, receiving modification opinion data returned by the shaping server, and feeding back processing information of the modification opinion data.
A readable storage medium having stored thereon an executable program which, when executed by a processor, performs the steps of the above-described reshaping simulation method.
The readable storage medium can realize that a face feature adjustment value is obtained through matching of the face feature data and the data of the reshaping face feature database through the stored executable program, the simulation adjustment of the original image is more in line with the reshaping requirement, a reshaping simulation effect which is relatively close to reality and more visual can be obtained, and the preoperative reference effect of the reshaping simulation image is improved.
A shaping simulation device comprises a memory and a processor, wherein the memory stores an executable program, and the processor executes the executable program to realize the steps of the shaping simulation method.
According to the reshaping simulation equipment, the executable program is run on the processor, so that the face feature adjustment value can be obtained through the matching of the face feature data and the data of the reshaping face feature database, the simulation adjustment of the original image is more in line with the reshaping requirement, a reshaping simulation effect which is relatively close to reality and more visual can be obtained, and the preoperative reference effect of the reshaping simulation image is improved.
Drawings
FIG. 1 is a diagram of an application scenario of a shaping simulation method in one embodiment;
FIG. 2 is a flow diagram of a method of shaping simulation in one embodiment;
FIG. 3 is an interaction diagram of a shaping simulation method in one embodiment;
FIG. 4 is a schematic diagram of the structure of the shaping simulation system in one embodiment;
FIG. 5 is a schematic diagram of the structure of a shaping simulation system in another embodiment;
FIG. 6 is a schematic diagram of a shaping simulation system according to yet another embodiment;
FIG. 7 is a schematic structural diagram of a shaping simulation system in a further embodiment;
FIG. 8 is a simplified flow chart of a specific application of the shaping simulation method in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the detailed description and specific examples, while indicating the scope of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention. It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings.
It should be noted that the term "first \ second" referred to in the embodiments of the present invention only distinguishes similar objects, and does not represent a specific ordering for the objects, and it should be understood that "first \ second" may exchange a specific order or sequence when allowed. It should be understood that "first \ second" distinct objects may be interchanged under appropriate circumstances such that embodiments of the invention described herein may be practiced in sequences other than those illustrated or described herein.
The shaping simulation method provided by the application can be applied to an application environment shown in fig. 1, and the mobile device can acquire an original image of an object to be shaped (i.e. a user), and perform face recognition on the original image to obtain face feature data; matching analysis is carried out on the face feature data and a preset reshaping face feature database to obtain a face feature adjustment value; and carrying out analog adjustment on the original image according to the face characteristic adjustment value to obtain a reshaping analog image. The mobile device may be any device having functions of acquiring an image of a user and processing the image, such as a personal computer, a notebook computer, a palm computer, a smart phone, a tablet computer, a portable wearable device, and the like.
Fig. 2 is a schematic flow chart of a shaping simulation method according to an embodiment of the present invention. The shaping simulation method in this embodiment includes the steps of:
step S110: acquiring an original image of an object to be reshaped, and performing face recognition on the original image to acquire face characteristic data of the object to be reshaped;
in this step, the original image may be obtained by shooting with a camera of the electronic device, or by scanning; the characteristics of the human face in the original image can be analyzed during human face recognition, and then human face characteristic data can be obtained;
step S120: matching analysis is carried out on the face feature data and a preset reshaping face feature database to obtain a face feature adjustment value;
in this step, the face feature database is a preset collection of face feature material data commonly used for reshaping, and the feature difference between the face feature data and the reshaped face can be obtained through matching analysis of actual face feature data and data in the face feature database;
step S130: carrying out analog adjustment on the original image according to the face characteristic adjustment value to obtain a shaping analog image;
in this step, when performing analog adjustment according to the face feature adjustment value, the face feature data is mainly adjusted, and image deformation processing may be performed based on the face feature points.
In the embodiment, an original image of an object to be shaped is obtained, and face recognition is performed on the original image to obtain face characteristic data; matching analysis is carried out on the face feature data and a preset reshaping face feature database to obtain a face feature adjustment value; and carrying out analog adjustment on the original image according to the face characteristic adjustment value to obtain a reshaping analog image. The face feature adjustment value obtained by matching the face feature data with the data of the reshaping face feature database better meets the reshaping requirement for the simulation adjustment of the original image, can obtain a reshaping simulation effect which is relatively close to reality and is more visual, and improves the preoperative reference effect of the reshaping simulation image.
It should be noted that, when performing matching analysis on the face feature data and a preset reshaped face feature database, an image face analysis report may be generated, a reshaping suggestion based on a face feature adjustment value is given in the report, after receiving the confirmation information, automatic analog adjustment is performed on the original image, and after completion, a reshaping suggestion report is given, including specific reshaping part, reshaping mode, and reshaping effect description information.
Further, diffusion, sharpening and deformation algorithms can be used for processing the image during analog adjustment.
Furthermore, when the original image of the object to be reshaped is obtained, a shooting area, such as a shooting area with a shape similar to the face, can be defined, and when the face of the object to be reshaped enters the shooting area, the shooting is carried out, so that the obtained original image is the required face image, thereby reducing the time for face recognition and improving the accuracy of the recognition; in addition, when an original image of the object to be shaped is obtained, the brightness during shooting is sensed, and if the brightness is smaller than a preset brightness value, a flash lamp is started or insufficient brightness is prompted; when the face recognition is carried out, the makeup on the face can be detected, the shaping simulation is carried out after the cleaning is prompted, and if the face is detected to have accessories, the removal of the accessories is prompted, such as glasses, false eyelashes, nose nails and the like.
In one embodiment, the step of obtaining an original image of an object to be reshaped and performing face recognition on the original image comprises the following steps:
acquiring a front image and a plurality of side images of an object to be shaped, and carrying out face recognition on the front image and the side images.
In the embodiment, a plurality of images of the object to be reshaped can be acquired, including the front image and the side image, and the front image and the side images are images obtained from different angles, so that the influences of illumination, angles and the like can be reduced on the basis, and the face recognition is more accurate.
Specifically, in actual operation, a front image of the object to be reshaped and two side images of two side surfaces at an angle of 45 degrees may be obtained.
Furthermore, after the front image and the side image are obtained, a 3D original image model can be constructed according to the front image and the side image, and accurate face recognition is carried out by utilizing a 3D model algorithm.
In one embodiment, the step of obtaining the face feature data of the object to be reshaped comprises the steps of:
acquiring face region characteristic points of an object to be shaped, partitioning a face according to the face region characteristic points, and acquiring characteristic data of each partition and contour data of the face; wherein each partition comprises eyes, a nose, a mouth, a face and a chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions.
In this embodiment, after face recognition, feature points of a face region may be obtained, the feature points of different regions on the face are distributed differently, the face region may be partitioned by using the feature points of the face region, so as to obtain feature data of regions such as eyes, a nose, a mouth, a face, and a chin and contour data of the face, where the feature data includes position data of a current face region and relative position data between the current face region and other regions, so as to perform analog shaping on different regions of the face.
Specifically, the characteristic regions on the face may include forehead, eyes, eyebrows, eyelids, nose bridge, nose wings, cheeks, mouth, chin, and the like, and also include face shape data such as the whole face contour, and the characteristic regions may construct different characteristic points to realize division of characteristic regions of the face.
Furthermore, besides the face area division according to the face recognition result, point positions can be manually set for selection, for example, an area selection instruction is received, a designated area is selected on the face of the original image, the feature data of the designated area is obtained, and the flexibility of the shaping simulation is improved.
Further, the face area is partitioned, and after the feature data of the partitioned area is matched and analyzed with a preset reshaping face feature database, a partitioned area with suggested reshaping can be obtained, and a face feature adjustment value of the partitioned area is obtained.
In one embodiment, the step of performing matching analysis on the face feature data and a preset reshaped face feature database comprises the following steps:
searching matched data in a shaping face feature database according to the face feature data, wherein the similarity between the matched data and the face feature data is greater than or equal to a preset value;
the step of obtaining the face feature adjustment value further comprises the following steps:
and acquiring the ratio of the face feature data to the matching data in the reshaped face feature database, and acquiring a face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1.
In this embodiment, matching data may be determined by using the similarity between the face feature data and the data in the reshaped face feature database, after performing similarity matching analysis on the face feature data and the reshaped face feature database, matching data matching the face feature data after image analysis may be obtained in the reshaped face feature database, but the matching data is different from the face feature data after image analysis, a ratio of data of specific feature points between the face feature data and the reshaped face feature database is calculated, the ratio is used as a limit of an adjustment value, the face feature adjustment value is set between the ratio and a value 1, and after performing analog adjustment on an image by using the face feature adjustment value, the face feature data in the image may be approximated to the data in the reshaped face database, thereby achieving a reshaping simulation effect.
Further, the face feature adjustment value may be dynamic data, and is dynamically adjusted between the ratio and the value 1 according to the needs of the object to be shaped.
In one embodiment, the step of performing matching analysis on the face feature data and a preset reshaped face feature database comprises the following steps:
receiving a first selection instruction, and selecting a first target partition in each partition according to the first selection instruction;
selecting a sub-database from the reshaping face feature database according to the feature data of other partitions except the first target partition, wherein the face feature data in the sub-database is matched with the feature data of other partitions except the first target partition;
and performing matching analysis on the characteristic data of the first target partition and the sub-database.
In this embodiment, the first target partition may be selected through the first selection instruction, and the sub-database may be selected in the shaping face feature database according to feature data of other partitions, and since the face feature data in the sub-database is matched with feature data of other partitions other than the first target partition, when performing matching analysis on the feature data of the first target partition and the sub-database, the obtained feature adjustment value of the first target partition may coordinate the first target partition with the other partitions, thereby improving overall coordination when performing shaping simulation on a single partition part.
In one embodiment, the shaping simulation method further comprises the steps of:
receiving a modification instruction, and finely adjusting feature data of the full-shape simulation image according to the modification instruction;
or, the first target partition is selected from the partitions again according to the modification instruction.
In this embodiment, after the image is subjected to analog adjustment according to the face feature adjustment value to obtain a reshaped analog image, the reshaped analog image may not meet the requirements of the object to be reshaped, and at this time, a modification instruction may be received, and feature data fine adjustment is performed according to the modification instruction to make the feature data fine-tune meet the specific requirements of the object to be reshaped; or, the shaping simulation of the current first target partition does not meet the requirement of the object to be shaped, and a new first target partition can be reselected for shaping simulation, so that the simulation shaping can be adjusted according to the requirement of the object to be shaped.
In one embodiment, the shaping simulation method further comprises the steps of:
receiving a trigger instruction aiming at a second target partition, and selecting a plurality of candidate partition images from a shaping human face feature database according to the trigger instruction, wherein the partition type of each partition image is the same as that of the second target partition;
displaying each subarea image, receiving a second selection instruction, and selecting a target subarea image from each subarea image according to the second selection instruction;
and fusing the target subarea image to the position corresponding to the second target subarea in the original image.
In this embodiment, a second target partition may be selected and triggered, a plurality of candidate partition images having the same type as the second target partition are selected from the face feature database for reshaping, the partition images are displayed for selection of an object to be reshaped, and after the object to be reshaped selects a target partition image through a second selection instruction, the target partition images are fused into the original image, so that the object to be reshaped autonomously selects reshaping content and the effect of a reshaping simulation image is displayed.
Specifically, the second target partition may be a forehead, eyes, eyebrows, a nose, a mouth, a chin, or the like, for example, the eye portion is selected as the second target partition, eye images of different shapes may be selected from the face shaping feature database and displayed for selection of the object to be shaped, and the selected new eye image is fused to the original image of the object to be shaped after the determination to form the shaping simulation image.
In one embodiment, the step of fusing the target partition image to the original image at a location corresponding to the second target partition comprises the steps of:
and acquiring the image size, position and color data of the second target subarea, adjusting the target subarea image according to the image size, position and color data, replacing the part of the original image corresponding to the second target subarea with the adjusted image, and performing fuzzy processing on the butt joint edge of the adjusted image and the original image.
In this embodiment, the second target partition is a part of the original image, and has attributes such as image size, position, color, and the like, and the target partition image is adjusted according to data such as image size, position, color, and the like, so that the target partition image can be coordinated with the original image.
It should be noted that after the fusion and the blurring processing are performed, another shaping analog image can be obtained, which is different from the shaping analog image obtained by performing analog adjustment on the original image according to the face feature adjustment value; after the fusion and the fuzzy processing are carried out, a modification instruction can be received, and the characteristic data fine adjustment is carried out on the obtained image according to the modification instruction; or, the second target partition is selected from the partitions again according to the modification instruction.
In one embodiment, the shaping simulation method further comprises the steps of:
and sending the processed image to a shaping server through a server, receiving modification opinion data returned by the shaping server, and feeding back processing information of the modification opinion data.
In this embodiment, after the image is obtained through processing, the image can be sent to the shaping server through the server, and the shaping server can obtain and return modification opinion data of the image; the sending end can feed back corresponding processing information according to the modification opinion data, and the images can be further adjusted and modified through the interactive mode.
It should be noted that the processed image may be a reshaped analog image obtained by performing analog adjustment according to the face feature adjustment value, or an image obtained by selecting different partitions and performing fusion processing.
Specifically, the above processing procedure may be applied to a consultation terminal device at a user side, the reshaping service end may be set at a receiving terminal at a reshaping doctor side, the consultation terminal of the user sends the reshaping simulated image to the receiving terminal of the reshaping doctor, the doctor is invited to adjust the reshaping simulated image and give a modification suggestion, the receiving terminal returns the modification suggestion data, and an interaction schematic diagram is shown in fig. 3.
Furthermore, the original image of the object to be shaped can be directly sent to the shaping server through the server, the modification opinion data returned by the shaping server is received, and the processing information of the modification opinion data is fed back.
According to the above shaping simulation method, an embodiment of the shaping simulation system according to the present invention is further provided, and the following describes an embodiment of the shaping simulation system according to the present invention in detail.
Fig. 4 is a schematic structural diagram of a shaping simulation system according to an embodiment of the present invention. The shaping simulation system in this embodiment includes:
the image recognition unit 210 is configured to acquire an original image of an object to be reshaped, perform face recognition on the original image, and acquire face feature data of the object to be reshaped;
an image analysis unit 220, configured to perform matching analysis on the face feature data and a preset reshaped face feature database, to obtain a face feature adjustment value;
and the image adjusting unit 230 performs analog adjustment on the original image according to the face characteristic adjustment value to obtain a reshaped analog image.
In this embodiment, the image recognition unit 210 obtains an original image of an object to be reshaped, and performs face recognition on the original image to obtain face feature data; the image analysis unit 220 performs matching analysis on the face feature data and a preset reshaped face feature database to obtain a face feature adjustment value; the image adjusting unit 230 performs analog adjustment on the original image according to the face feature adjustment value to obtain a reshaped analog image. The face feature adjustment value obtained by matching the face feature data with the data of the reshaping face feature database better meets the reshaping requirement for the simulation adjustment of the original image, can obtain a reshaping simulation effect which is relatively close to reality and is more visual, and improves the preoperative reference effect of the reshaping simulation image.
In one embodiment, the image recognition unit 210 obtains a front image and a plurality of side images of the object to be reshaped, and performs face recognition on the front image and the plurality of side images.
In one embodiment, the image recognition unit 210 obtains face region feature points of the object to be reshaped, partitions the face according to the face region feature points, and obtains feature data of each partition and contour data of the face; wherein each partition comprises eyes, a nose, a mouth, a face and a chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions.
In one embodiment, the image analysis unit 220 searches the reshaped face feature database for matching data according to the face feature data, wherein the similarity between the matching data and the face feature data is greater than or equal to a preset value;
the image analysis unit 220 obtains a ratio of the face feature data to the matching data, and obtains a face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value of 1.
In one embodiment, the image analysis unit 220 receives a first selection instruction, and selects a first target partition from the partitions according to the first selection instruction; selecting a sub-database from the shaping face feature database according to the feature data of other partitions except the first target partition, and performing matching analysis on the feature data of the first target partition and the sub-database; and the face feature data in the sub-database is matched with the feature data of other partitions except the first target partition.
In one embodiment, as shown in fig. 5, the reshaping simulation system further includes an image modification unit 240 for receiving a modification instruction, and performing fine feature data adjustment on the reshaping simulation image according to the modification instruction; or, the first target partition is selected from the partitions again according to the modification instruction.
In one embodiment, as shown in fig. 6, the shaping simulation system further includes an image combination unit 250, configured to receive a trigger instruction for a second target partition, and select a plurality of candidate partition images in the shaping face feature database according to the trigger instruction, where the partition type of each partition image is the same as the partition type of the second target partition;
the image combination unit 250 is further configured to display each of the partition images, receive a second selection instruction, and select a target partition image from each of the partition images according to the second selection instruction;
the image combination unit 250 is further configured to fuse the target partition image to a position in the original image corresponding to the second target partition.
In one embodiment, the image combining unit 250 obtains the image size, the position and the color data of the second target partition, adjusts the target partition image according to the image size, the position and the color data, replaces the portion of the original image corresponding to the second target partition with the adjusted image, and performs the blurring processing on the joint edge of the adjusted image and the original image.
In one embodiment, as shown in fig. 7, the shaping simulation system further includes a data interaction unit 270, configured to send the shaping simulation image to the shaping server via the server, receive modification opinion data returned by the shaping server, and feed back processing information of the modification opinion data.
The shaping simulation system of the present invention corresponds to the shaping simulation method of the present invention, and the technical features and advantages thereof described in the embodiments of the shaping simulation method are applicable to the embodiments of the shaping simulation system.
A readable storage medium having stored thereon an executable program which, when executed by a processor, performs the steps of the above-described reshaping simulation method.
The readable storage medium can realize that a face feature adjustment value is obtained through matching of the face feature data and the data of the reshaping face feature database through the stored executable program, the simulation adjustment of the original image is more in line with the reshaping requirement, a reshaping simulation effect which is relatively close to reality and more visual can be obtained, and the preoperative reference effect of the reshaping simulation image is improved.
A shaping simulation device comprises a memory and a processor, wherein the memory stores an executable program, and the processor executes the executable program to realize the steps of the shaping simulation method.
According to the reshaping simulation equipment, the executable program is run on the processor, so that the face feature adjustment value can be obtained through the matching of the face feature data and the data of the reshaping face feature database, the simulation adjustment of the original image is more in line with the reshaping requirement, a reshaping simulation effect which is relatively close to reality and more visual can be obtained, and the preoperative reference effect of the reshaping simulation image is improved.
According to the reshaping simulation equipment, the executable program is operated on the processor, the face feature adjustment value is obtained through the matching of the face feature data and the data of the reshaping face feature database, the simulation adjustment of the original image is more in line with the reshaping requirement, a reshaping simulation effect which is relatively close to reality and more visual can be obtained, and the preoperative reference effect of the reshaping simulation image is improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, and the program may be stored in a non-volatile computer readable storage medium, for example, in the embodiments, the program may be stored in a storage medium of a computer system and executed by at least one processor in the computer system, so as to implement the processes of the embodiments including the shaping simulation method described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
In one embodiment, the shaping simulation device further comprises a shaping server device.
In one embodiment, the reshaping simulation method may be applied to a mobile device, which may be a personal computer, a notebook computer, a palm computer, a smart phone, a tablet computer, a portable wearable device, and the like.
A flow diagram of the shaping simulation method is shown in fig. 8. Specifically, a user can scan or shoot a face through electronic equipment such as a mobile phone, a tablet personal computer and a camera, upload three face images (front face and two side faces (45 degrees)) of different faces and establish a 3D original image model. Then face recognition is carried out on an original image model of a user, each part of the face is partitioned into a forehead, an eye (a single eye including eyes and eyebrows), a nose (a nose and a nose wing), a chin, a face (two cheeks) and other partitions (the partition of the part is selected by manually setting point positions by the user), a face data calculation algorithm is adopted, facial features of the user are analyzed and compared with a preset standard value to obtain a face analysis report, the user can carry out automatic shaping simulation according to suggestions in the analysis report, a shaping suggestion report is obtained after the face analysis is completed, and the image and the report formed through simulation can be stored by the user to serve as certain shaping reference. Simultaneously, a user can analyze and replace a single face part into various part images in a reshaping face database so as to obtain a reshaping simulation image, can obtain adjustment data after analysis to adjust the face image of the user so as to obtain a reshaping simulation image, can also replace the part image, can select the part independently by the user, selects part images of the same type from the reshaping face database for the user to select, fuses the selected part images into the face image of the user after the user determines the required part images, performs simulation processing on the butt joint position so as to obtain another reshaping simulation image, if the effect of reshaping simulation is not satisfactory, the user can perform image processing on the single part by using a fine adjustment function, or reselects the part for reshaping simulation, and finally performs corresponding reshaping simulation processing on the original image by recalculating and mixing the standard value designed by the system, the final shaping simulation image is obtained, the user can send the simulation effect image to an online shaping doctor for point-to-point consultation through an online consultation service module (namely a data interaction module), and the online shaping doctor can perform fine adjustment or match each part again on the basis of the simulation image, so that the optimal shaping simulation image is obtained; the method comprises the steps that a plastic doctor provides plastic suggestions on line, and analog data of a client can be modified, so that plastic analog images which are felt by two parties are obtained, then the user can store the analog images and can print the 3D analog images, the images can be stored in a database of a plastic service end of the doctor, and when the next user line finds out a doctor for a face diagnosis, the doctor can call the data as a face diagnosis basis, so that the communication time of the two parties is shortened; the image can be shared to friends through instant messaging software such as WeChat and QQ through a sharing function, compared with the traditional plastic simulation technology, the fuzzy image processing can be simply carried out, the medical and beauty professional technology cannot be fused, the operation time of a user is reduced, the plastic simulation efficiency and the plastic simulation specialty are improved, and particularly when the image is applied to a client face examination link after the medical and beauty operation, the user can be intuitively enabled to obtain an effect simulation image after the operation in advance.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
Those skilled in the art will appreciate that all or part of the steps in the method for implementing the above embodiments may be implemented by a program instructing the relevant hardware. The program may be stored in a computer-readable storage medium. Which when executed comprises the steps of the method described above. The storage medium includes: ROM/RAM, magnetic disk, optical disk, etc.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (12)

1. A method of shaping simulation, comprising the steps of:
acquiring an original image of an object to be reshaped, and performing face recognition on the original image to acquire face feature data of the object to be reshaped;
matching and analyzing the face feature data and a preset reshaping face feature database to obtain a face feature adjustment value;
and carrying out analog adjustment on the original image according to the face characteristic adjustment value to obtain a shaping analog image.
2. The reshaping simulation method of claim 1, wherein the step of obtaining an original image of an object to be reshaped and performing face recognition on the original image comprises the steps of:
the method comprises the steps of obtaining a front image and a plurality of side images of an object to be shaped, and carrying out face recognition on the front image and the side images.
3. The reshaping simulation method of claim 1, wherein the step of obtaining the facial feature data of the object to be reshaped comprises the steps of:
acquiring the face region characteristic points of the object to be shaped, partitioning the face according to the face region characteristic points, and acquiring characteristic data of each partition and contour data of the face; wherein each of the sections includes an eye, a nose, a mouth, a face, and a chin, and the feature data includes position data of the current section and relative position data between the current section and the other sections.
4. The reshaping simulation method of claim 1, wherein the step of performing matching analysis on the face feature data and a preset reshaping face feature database comprises the following steps:
searching matched data in the reshaping face feature database according to the face feature data, wherein the similarity between the matched data and the face feature data is greater than or equal to a preset value;
the step of obtaining the face feature adjustment value further comprises the following steps:
and acquiring a ratio of the face feature data to the matching data, and acquiring the face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1.
5. The reshaping simulation method of claim 3, wherein the step of performing matching analysis on the face feature data and a preset reshaping face feature database comprises the following steps:
receiving a first selection instruction, and selecting a first target partition in each partition according to the first selection instruction;
selecting a sub-database from the reshaping face feature database according to feature data of other partitions except the first target partition, wherein the face feature data in the sub-database is matched with the feature data of other partitions except the first target partition;
and performing matching analysis on the characteristic data of the first target partition and the sub-database.
6. The reshaping simulation method of claim 5, further comprising the steps of:
receiving a modification instruction, and performing characteristic data fine adjustment on the shaping simulation image according to the modification instruction;
or, the first target partition is selected from the partitions again according to the modification instruction.
7. The reshaping simulation method of claim 3, further comprising the steps of:
receiving a trigger instruction aiming at a second target partition, and selecting a plurality of candidate partition images from the reshaped face feature database according to the trigger instruction, wherein the partition type of each partition image is the same as that of the second target partition;
displaying each subarea image, receiving a second selection instruction, and selecting a target subarea image from each subarea image according to the second selection instruction;
and fusing the target subarea image to the position corresponding to the second target subarea in the original image.
8. The reshaping simulation method of claim 7, wherein the step of fusing the target partition image to a position in the original image corresponding to the second target partition comprises the steps of:
acquiring the image size, the position and the color data of the second target subarea, adjusting the target subarea image according to the image size, the position and the color data, replacing the part, corresponding to the second target subarea, in the original image with the adjusted image, and performing fuzzy processing on the joint edge of the adjusted image and the original image.
9. The shaping simulation method according to any one of claims 1 to 8, further comprising the steps of:
and sending the processed image to a shaping server through a server, receiving modification opinion data returned by the shaping server, and feeding back processing information of the modification opinion data.
10. A reshaping simulation system, comprising:
the image identification unit is used for acquiring an original image of an object to be reshaped, carrying out face identification on the original image and acquiring face characteristic data of the object to be reshaped;
the image analysis unit is used for carrying out matching analysis on the face feature data and a preset reshaping face feature database to obtain a face feature adjustment value;
and the image adjusting unit is used for performing analog adjustment on the original image according to the face characteristic adjusting value to obtain a shaping analog image.
11. A readable storage medium having stored thereon an executable program, wherein the executable program, when executed by a processor, performs the steps of the reshaping simulation method of any one of claims 1 to 7.
12. A shaping simulation device comprising a memory and a processor, the memory storing an executable program, wherein the processor implements the steps of the shaping simulation method of any one of claims 1 to 7 when executing the executable program.
CN201811581506.0A 2018-12-24 2018-12-24 Shaping simulation method, system, readable storage medium and apparatus Active CN111353931B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201811581506.0A CN111353931B (en) 2018-12-24 2018-12-24 Shaping simulation method, system, readable storage medium and apparatus
PCT/CN2019/127251 WO2020135286A1 (en) 2018-12-24 2019-12-22 Shaping simulation method and system, readable storage medium and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811581506.0A CN111353931B (en) 2018-12-24 2018-12-24 Shaping simulation method, system, readable storage medium and apparatus

Publications (2)

Publication Number Publication Date
CN111353931A true CN111353931A (en) 2020-06-30
CN111353931B CN111353931B (en) 2023-10-03

Family

ID=71126289

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811581506.0A Active CN111353931B (en) 2018-12-24 2018-12-24 Shaping simulation method, system, readable storage medium and apparatus

Country Status (2)

Country Link
CN (1) CN111353931B (en)
WO (1) WO2020135286A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114494601A (en) * 2022-02-09 2022-05-13 南京医科大学附属口腔医院 Three-dimensional face retrieval orthodontic correction and curative effect simulation system based on face images

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996021201A1 (en) * 1994-12-29 1996-07-11 Robin Jean Marc Automatic recognition of characteristic features and simulation of an aesthetic image of a real objective such as a face
CN105938627A (en) * 2016-04-12 2016-09-14 湖南拓视觉信息技术有限公司 Processing method and system for virtual plastic processing on face
CN106652015A (en) * 2015-10-30 2017-05-10 深圳超多维光电子有限公司 Virtual figure head portrait generation method and apparatus
CN107123160A (en) * 2017-05-02 2017-09-01 成都通甲优博科技有限责任公司 Simulation lift face system, method and mobile terminal based on three-dimensional image
CN108447017A (en) * 2018-05-31 2018-08-24 Oppo广东移动通信有限公司 Face virtual face-lifting method and device
CN108765273A (en) * 2018-05-31 2018-11-06 Oppo广东移动通信有限公司 The virtual lift face method and apparatus that face is taken pictures

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8265351B2 (en) * 2006-05-05 2012-09-11 Parham Aarabi Method, system and computer program product for automatic and semi-automatic modification of digital images of faces
CN107122727B (en) * 2017-04-20 2020-03-13 北京旷视科技有限公司 Method, device and system for face shaping
CN109189967A (en) * 2018-08-24 2019-01-11 微云(武汉)科技有限公司 A kind of lift face proposal recommending method, device and storage medium based on recognition of face

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996021201A1 (en) * 1994-12-29 1996-07-11 Robin Jean Marc Automatic recognition of characteristic features and simulation of an aesthetic image of a real objective such as a face
CN106652015A (en) * 2015-10-30 2017-05-10 深圳超多维光电子有限公司 Virtual figure head portrait generation method and apparatus
CN105938627A (en) * 2016-04-12 2016-09-14 湖南拓视觉信息技术有限公司 Processing method and system for virtual plastic processing on face
CN107123160A (en) * 2017-05-02 2017-09-01 成都通甲优博科技有限责任公司 Simulation lift face system, method and mobile terminal based on three-dimensional image
CN108447017A (en) * 2018-05-31 2018-08-24 Oppo广东移动通信有限公司 Face virtual face-lifting method and device
CN108765273A (en) * 2018-05-31 2018-11-06 Oppo广东移动通信有限公司 The virtual lift face method and apparatus that face is taken pictures

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114494601A (en) * 2022-02-09 2022-05-13 南京医科大学附属口腔医院 Three-dimensional face retrieval orthodontic correction and curative effect simulation system based on face images
CN114494601B (en) * 2022-02-09 2024-03-08 南京医科大学附属口腔医院 Three-dimensional face retrieval orthodontic correction and curative effect simulation system based on face image

Also Published As

Publication number Publication date
WO2020135286A1 (en) 2020-07-02
CN111353931B (en) 2023-10-03

Similar Documents

Publication Publication Date Title
US10617301B2 (en) Information processing device and information processing method
KR101733512B1 (en) Virtual experience system based on facial feature and method therefore
US20170169501A1 (en) Method and system for evaluating fitness between wearer and eyeglasses
KR20200132833A (en) Virtual avatar generation method and apparatus, and storage medium
US20210334998A1 (en) Image processing method, apparatus, device and medium for locating center of target object region
JP2009064423A (en) Makeup simulation system, makeup simulation device, makeup simulation method, and makeup simulation program
CN110674664A (en) Visual attention recognition method and system, storage medium and processor
KR102455966B1 (en) Mediating Apparatus, Method and Computer Readable Recording Medium Thereof
CN111783511A (en) Beauty treatment method, device, terminal and storage medium
CN108021308A (en) Image processing method, device and terminal
US11461384B2 (en) Facial images retrieval system
CN110866139A (en) Cosmetic treatment method, device and equipment
KR102325829B1 (en) Recommendation method for face-wearing products and device therefor
CN111353931B (en) Shaping simulation method, system, readable storage medium and apparatus
CN113076778A (en) Method, system, readable storage medium and apparatus for reshaping analog image
US11398024B2 (en) Information processing apparatus, information processing method, and non-transitory storage medium
CN113487670A (en) Cosmetic mirror and state adjusting method
CN111354478B (en) Shaping simulation information processing method, shaping simulation terminal and shaping service terminal
US20200211294A1 (en) Information processing apparatus, information processing method, and non-transitory storage medium
KR101507410B1 (en) Live make-up photograpy method and apparatus of mobile terminal
CN110750154A (en) Display control method, system, device, equipment and storage medium
JP5782540B2 (en) Beauty counseling method
CN111354478A (en) Shaping simulation information processing method, shaping simulation terminal and shaping service terminal
CN114333018A (en) Shaping information recommendation method and device and electronic equipment
CN113076779A (en) Shaping simulation matching method, shaping simulation matching system, readable storage medium and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant