CN111354478B - Shaping simulation information processing method, shaping simulation terminal and shaping service terminal - Google Patents
Shaping simulation information processing method, shaping simulation terminal and shaping service terminal Download PDFInfo
- Publication number
- CN111354478B CN111354478B CN201811581508.XA CN201811581508A CN111354478B CN 111354478 B CN111354478 B CN 111354478B CN 201811581508 A CN201811581508 A CN 201811581508A CN 111354478 B CN111354478 B CN 111354478B
- Authority
- CN
- China
- Prior art keywords
- shaping
- image
- face
- data
- face feature
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000007493 shaping process Methods 0.000 title claims abstract description 518
- 238000004088 simulation Methods 0.000 title claims abstract description 216
- 230000010365 information processing Effects 0.000 title claims abstract description 60
- 238000003672 processing method Methods 0.000 title claims abstract description 59
- 230000004048 modification Effects 0.000 claims abstract description 71
- 238000012986 modification Methods 0.000 claims abstract description 71
- 230000003993 interaction Effects 0.000 claims abstract description 22
- 238000005192 partition Methods 0.000 claims description 181
- 230000006854 communication Effects 0.000 claims description 31
- 238000004891 communication Methods 0.000 claims description 30
- 238000004458 analytical method Methods 0.000 claims description 29
- 230000001815 facial effect Effects 0.000 claims description 26
- 210000001508 eye Anatomy 0.000 claims description 19
- 238000012545 processing Methods 0.000 claims description 14
- 238000000638 solvent extraction Methods 0.000 claims description 7
- 238000005034 decoration Methods 0.000 claims description 6
- 210000001503 joint Anatomy 0.000 claims description 5
- 230000000694 effects Effects 0.000 abstract description 74
- 230000000007 visual effect Effects 0.000 abstract description 13
- 210000001331 nose Anatomy 0.000 description 18
- 238000000034 method Methods 0.000 description 16
- 238000002316 cosmetic surgery Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 6
- 210000000214 mouth Anatomy 0.000 description 6
- 210000000887 face Anatomy 0.000 description 5
- 210000004709 eyebrow Anatomy 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 210000000744 eyelid Anatomy 0.000 description 3
- 210000001061 forehead Anatomy 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 210000000697 sensory organ Anatomy 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000010191 image analysis Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 230000002980 postoperative effect Effects 0.000 description 2
- 241000083547 Columella Species 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 239000002537 cosmetic Substances 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 210000000720 eyelash Anatomy 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 210000000216 zygoma Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H80/00—ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Public Health (AREA)
- Primary Health Care (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Epidemiology (AREA)
- Theoretical Computer Science (AREA)
- Pathology (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Architecture (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Biomedical Technology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Processing Or Creating Images (AREA)
- Image Processing (AREA)
Abstract
The invention relates to a shaping simulation information processing method, a shaping simulation terminal and a shaping service terminal, which belong to the technical field of shaping images, and are used for acquiring a first image containing a human face, sending the first image to the shaping service terminal, wherein the shaping service terminal can be arranged at a shaping doctor side, and after receiving the first image, the shaping service terminal can receive a first modification instruction so as to adjust the first image and obtain and return a second image; the shaping object side can receive feedback comments of the second image, the feedback comments are sent to the shaping service terminal, information interaction of the shaping image between the shaping object side and the shaping doctor side is achieved, the shaping simulation effect image is determined rapidly, the shaping requirement is met, the relatively real and visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
Description
Technical Field
The present invention relates to the field of shaping image technologies, and in particular, to a shaping analog information processing method, a shaping analog terminal, and a shaping service terminal.
Background
Along with the continuous improvement of the social life level, more and more people are required to be helped, and the high-speed development of the medical and aesthetic industry is promoted.
Traditional preplastic communication scenarios are typically: scene 1: the customer holds the favorite photo to watch the doctor, and expresses to the doctor: requiring doctor to integrate certain part into five sense organs in the photo; the disadvantages are: the five sense organs in the photo are arranged on the face of the customer, whether the facial features are the most suitable for the matching of the five sense organs of the customer or whether the customer's own will really like, because no visual simulation diagram exists before the operation, a misunderstanding area is easy to generate, and the dispute is buried a remark suggestive of later developments in a story, etc. for the postoperative customer. Scene 2: the method comprises the steps that a shaping doctor obtains a digital simulation original image of a shaping object by utilizing a three-dimensional imaging technology, gives shaping comments to the original image of a user according to a professional shaping technology, adjusts and modifies the original image, and performs image stretching treatment on eyes, noses, faces, chin (chin) and the like in the image, such as eye enlargement (double eyelid widening), chin stretching, face thinning, nose stretching, face lifting and the like, so as to obtain an effect image of shaping simulation for reference of the shaping object; the disadvantages are: the image formed by the technology has a certain distance from the sense of reality, and a certain skill is required for modifying the operation image, so that a doctor or a customer can hardly quickly adjust the image to a desired form in the mind of the doctor or the customer, and the communication scene is not smooth enough and takes a long time.
Disclosure of Invention
Based on this, it is necessary to provide a shaping simulation information processing method, a shaping simulation terminal and a shaping service terminal for the conventional pre-shaping communication process, for the problem that there is no pre-operation simulation image in the scene 1, and for the fact that the simulation image accurately expressing the shaping will of the customer and the suggestion of the shaping doctor cannot be obtained quickly in the scene 2.
A shaping analog information processing method comprises the following steps:
Acquiring a first image containing a human face, and sending the first image to a shaping service terminal through a server;
receiving a second image returned by the shaping service terminal through the server, wherein the second image is an image obtained by the shaping service terminal after adjusting the first image according to the received first modification instruction;
and receiving the feedback opinion aiming at the second image, and sending the feedback opinion to the shaping service terminal through the server.
According to the shaping simulation information processing method, the shaping simulation information processing method can be applied to a shaping object side, a first image containing a human face is obtained, the first image is sent to a shaping service terminal, the shaping service terminal can be arranged at a shaping doctor side, after receiving the first image, the shaping service terminal can receive a first modification instruction, so that the first image is adjusted, and a second image is obtained and returned; the shaping object side can receive feedback comments of the second image, the feedback comments are sent to the shaping service terminal, information interaction of the shaping image between the shaping object side and the shaping doctor side is achieved, the shaping simulation effect image is determined rapidly, the shaping requirement is met, the relatively real and visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
In one embodiment, the first image comprises an original image or a shaped analog image of the object to be shaped.
In one embodiment, the shaping analog information processing method further includes the steps of:
and acquiring and displaying information of a plurality of shaping doctors, receiving a first selection instruction, selecting information of a target shaping doctor according to the first selection instruction, and establishing communication connection with the shaping service terminal through a server, wherein the information of the target shaping doctor is associated with the shaping service terminal.
In one embodiment, the shaping analog information processing method further includes the steps of:
and displaying the communication window, and carrying out information interaction with the shaping service terminal through the communication window.
In one embodiment, the step of acquiring a first image including a face includes the steps of:
the method comprises the steps of obtaining an original image of an object to be shaped, sending the original image to a server, receiving a face characteristic adjustment value returned by the server, and performing simulation adjustment on the original image according to the face characteristic adjustment value to obtain a shaping simulation image;
The method comprises the steps that a server carries out face recognition on an original image to obtain face feature data of an object to be shaped; and carrying out matching analysis on the face characteristic data and a preset shaping face characteristic database to obtain a face characteristic adjustment value.
In one embodiment, the step of obtaining an original image of the object to be shaped comprises the steps of:
Acquiring a front image and a plurality of side images of an object to be shaped.
In one embodiment, the step of acquiring facial feature data of the object to be shaped includes the steps of:
Acquiring facial region feature points of an object to be shaped, partitioning the face according to the facial region feature points, and acquiring feature data of each partition and outline data of the face; each partition comprises eyes, noses, mouths, faces and chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions.
In one embodiment, the step of performing matching analysis on the face feature data and a preset reshaped face feature database includes the steps of:
Comparing the face characteristic data with a face characteristic preset value, determining the face type, acquiring a first sub-database matched with the face type from the shaping face characteristic database, and searching matching data in the first sub-database according to the face characteristic data, wherein the similarity between the matching data and the face characteristic data is larger than or equal to the preset value;
the step of obtaining the face feature adjustment value further includes the steps of:
and acquiring the ratio of the face characteristic data to the matching data, and acquiring a face characteristic adjustment value according to the ratio, wherein the face characteristic adjustment value is between the ratio and a numerical value 1.
In one embodiment, the shaping analog information processing method further includes the steps of:
Receiving a second selection instruction, wherein the second selection instruction is used for selecting a first target partition in each partition;
the server selects a second sub-database from the shaping face feature database according to the feature data of the other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; the face characteristic data in the second sub-database are matched with the characteristic data of other partitions except the first target partition.
In one embodiment, the shaping analog information processing method further includes the steps of:
Receiving a second modification instruction, and performing characteristic data fine adjustment on the shaping simulation image according to the second modification instruction;
Or alternatively
And receiving a third modification instruction, wherein the third modification instruction is used for re-selecting the first target partition from the partitions.
In one embodiment, the shaping analog information processing method further includes the steps of:
Receiving a triggering instruction aiming at a second target partition, wherein the triggering instruction is used for selecting a plurality of alternative partition images from the shaping face feature database, and the partition type of each partition image is the same as that of the second target partition;
displaying each partition image and receiving a third selection instruction, wherein the third selection instruction is used for selecting a target partition image from each partition image;
and fusing the target partition image to the position corresponding to the second target partition in the original image.
In one embodiment, the step of fusing the target partition image to a location in the original image corresponding to the second target partition comprises the steps of:
And acquiring the image size, position and color data of the second target partition, adjusting the image of the target partition according to the image size, position and color data, replacing the part corresponding to the second target partition in the original image with the adjusted image, and carrying out fuzzy processing on the butt joint edge of the adjusted image and the original image.
In one embodiment, the shaping analog information processing method further includes the steps of:
if the feedback opinion is information representing agreement, a three-dimensional image is constructed and displayed according to the second image.
In one embodiment, the shaping analog information processing method further includes the steps of:
And receiving a decoration instruction, and decorating the three-dimensional image according to the decoration instruction to obtain a final image and displaying the final image.
The shaping simulation terminal is used for acquiring a first image containing a human face and sending the first image to the shaping service terminal through the server; receiving a second image returned by the shaping service terminal through the server, receiving feedback comments aiming at the second image, and sending the feedback comments to the shaping service terminal through the server; the second image is an image obtained after the shaping service terminal adjusts the first image according to the received modification instruction.
According to the shaping simulation terminal, the shaping simulation terminal can be applied to a shaping object side, the shaping simulation terminal acquires a first image containing a human face, the first image is sent to the shaping service terminal, the shaping service terminal can be arranged at a shaping doctor side, after receiving the first image, the shaping service terminal can receive a first modification instruction, so that the first image is adjusted, and a second image is obtained and returned to the shaping simulation terminal; the shaping simulation terminal can receive feedback comments of the second image, send the feedback comments to the shaping service terminal, realize information interaction of the shaping image between the shaping object side and the shaping doctor side, quickly determine the shaping simulation effect image, better meet the shaping requirement, obtain a relatively real and visual shaping simulation effect, and improve the preoperative reference effect of the shaping simulation effect image.
A shaping analog information processing method comprises the following steps:
Receiving a first image containing a face; wherein the first image is sent by the shaping analog terminal through the server;
Receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to the shaping simulation terminal through the server;
receiving feedback comments for the second image; wherein, the feedback opinion is sent by the shaping service terminal through the server;
and if the feedback opinion is information representing agreement, saving the second image.
According to the shaping simulation information processing method, the method can be applied to a shaping doctor side, a first image containing a human face and sent by a shaping simulation terminal is received, and then a first modification instruction can be received, so that the first image is adjusted, and a second image is obtained and returned to the shaping simulation terminal; the feedback opinion aiming at the second image can be received from the shaping simulation terminal, when the feedback opinion represents the agreed information, the second image is stored, the second image can be used as a shaping simulation effect image, the information interaction of the shaping image between the shaping object side and the shaping doctor side is realized, the shaping simulation effect image is determined more quickly, the shaping requirement is met more, the relatively real and more visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
A shaping service terminal for receiving a first image including a face; receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to the shaping simulation terminal through the server; receiving feedback comments for the second image; if the feedback opinion is information representing agreement, a second image is stored; wherein the first image and the feedback opinion are sent by the shaping analog terminal via the server.
According to the shaping service terminal, the shaping service terminal can be applied to a shaping doctor side, the shaping service terminal receives a first image which is sent by the shaping simulation terminal and contains a human face, and then can receive a first modification instruction, so that the first image is adjusted, and a second image is obtained and returned to the shaping simulation terminal; the shaping simulation terminal sends feedback comments aiming at the second image to the shaping service terminal, when the feedback comments represent agreeing information, the shaping service terminal stores the second image, the second image can be used as a shaping simulation effect image, information interaction of the shaping image between the shaping object side and the shaping doctor side is realized, the shaping simulation effect image is determined more quickly, the shaping requirement is met, a relatively real and more visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
Drawings
FIG. 1 is an application scenario diagram of a shaping analog information processing method in one embodiment;
FIG. 2 is a flow diagram of a method of shaping analog information processing in one embodiment;
FIG. 3 is a flow chart of a shaping analog information processing method in another embodiment;
FIG. 4 is an interactive schematic diagram of a shaping analog information processing method in one embodiment;
FIG. 5 is a flow diagram of a particular application of the shaping analog information processing method in one embodiment.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the detailed description is presented by way of example only and is not intended to limit the scope of the invention. It should be further noted that, for convenience of description, only some, but not all of the matters related to the present invention are shown in the accompanying drawings.
It should be noted that, the term "first\second" related to the embodiment of the present invention is merely to distinguish similar objects, and does not represent a specific order for the objects, it is to be understood that "first\second" may interchange a specific order or precedence where allowed. It is to be understood that the "first\second" distinguishing aspects may be interchanged where appropriate to enable embodiments of the invention described herein to be implemented in sequences other than those illustrated or described.
The shaping simulation information processing method provided by the application can be applied to an application environment shown in fig. 1, an object to be shaped (namely a user) uses a shaping simulation terminal to acquire a first image containing a human face, the first image is sent to a shaping service terminal used by a shaping doctor through a server, the shaping doctor can apply a first modification instruction to the shaping service terminal to adjust the first image to obtain a second image, the second image is sent to the shaping simulation terminal, the object to be shaped can input feedback comments aiming at the second image in the shaping simulation terminal, and the shaping simulation terminal can send the feedback comments to the shaping service terminal for reference by the shaping doctor, so that a final shaping simulation effect image is determined. The shaping analog terminal and the shaping service terminal can be various devices with functions of acquiring images and processing the images, such as personal computers, notebook computers, palm computers, smart phones, tablet computers, portable wearable devices and the like.
Referring to fig. 2, a flow chart of a shaping analog information processing method according to an embodiment of the invention is shown. The shaping analog information processing method in this embodiment includes the steps of:
Step S110: acquiring a first image containing a human face, and sending the first image to a shaping service terminal through a server;
in the step, the first image contains a face image to be shaped, and a communication link is arranged between the server and the shaping service terminal;
Step S120: receiving a second image returned by the shaping service terminal through the server, wherein the second image is an image obtained by the shaping service terminal after adjusting the first image according to the received first modification instruction;
in the step, the shaping service terminal is positioned at the side of the shaping doctor, the shaping doctor can input a first modification instruction into the shaping service terminal according to own professions and experiences, and adjust and modify the first image according to the first modification instruction to obtain and return a second image;
Step S130: and receiving the feedback opinion aiming at the second image, and sending the feedback opinion to the shaping service terminal through the server.
In this step, the feedback opinion for the second image may be information representing consent, or may be other modification opinions, and if other modification opinions are the other modification opinions, the modified second image may be received again, and the feedback opinion may be used to determine the final shaping simulation effect image.
In this embodiment, the shaping simulation information processing method may be applied to the shaping object side, obtain a first image including a face, send the first image to the shaping service terminal, the shaping service terminal may be set on the shaping doctor side, and after receiving the first image, the shaping service terminal may receive a first modification instruction, so as to adjust the first image, and obtain and return to the second image; the shaping object side can receive feedback comments of the second image, the feedback comments are sent to the shaping service terminal, information interaction of the shaping image between the shaping object side and the shaping doctor side is achieved, the shaping simulation effect image is determined rapidly, the shaping requirement is met, the relatively real and visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
In one embodiment, the first image comprises an original image or a shaped analog image of the object to be shaped.
In this embodiment, the first image may be an original image of the object to be shaped, and the original image is sent to the shaping service terminal, so that the shaping doctor directly modifies the original image to obtain a professional shaping simulation effect diagram; or the shaping analog image adjusted by the user is sent to the shaping service terminal, so that the shaping doctor can adjust the shaping analog image, and the shaping analog image has better effect.
In one embodiment, the shaping analog information processing method further includes the steps of:
and acquiring and displaying information of a plurality of shaping doctors, receiving a first selection instruction, selecting information of a target shaping doctor according to the first selection instruction, and establishing communication connection with the shaping service terminal through a server, wherein the information of the target shaping doctor is associated with the shaping service terminal.
In this embodiment, before the first image is sent, communication connection with the shaping service terminal needs to be established, and because different shaping doctors have different shaping service terminals, information of a plurality of shaping doctors can be given to the user first, information of a target shaping doctor intended by the user is selected through the first selection instruction, and communication connection is established with the shaping service terminal corresponding to the information of the target shaping doctor, so as to meet the needs of the user.
In one embodiment, the shaping analog information processing method further includes the steps of:
and displaying the communication window, and carrying out information interaction with the shaping service terminal through the communication window.
In this embodiment, on the basis of establishing communication connection with the shaping service terminal, a communication window may be displayed, and information interaction is performed between the communication window and the shaping service terminal, so as to implement communication with the shaping doctor, so that the shaping doctor can know the specific requirements of the user on shaping, and thus, the shaping simulation effect image can be obtained more quickly.
In one embodiment, the step of acquiring a first image comprising a face comprises the steps of:
the method comprises the steps of obtaining an original image of an object to be shaped, sending the original image to a server, receiving a face characteristic adjustment value returned by the server, and performing simulation adjustment on the original image according to the face characteristic adjustment value to obtain a shaping simulation image;
The method comprises the steps that a server carries out face recognition on an original image to obtain face feature data of an object to be shaped; and carrying out matching analysis on the face characteristic data and a preset shaping face characteristic database to obtain a face characteristic adjustment value.
In the embodiment, an original image of an object to be shaped is obtained, the original image is sent to a server for face recognition to obtain face feature data, matching analysis is carried out on the face feature data and a preset shaping face feature database, and a face feature adjustment value is obtained and returned; and carrying out simulation adjustment on the original image according to the received face characteristic adjustment value to obtain a shaping simulation image. The face characteristic adjustment value obtained by matching the face characteristic data with the data of the shaping face characteristic database is more in line with the shaping requirement on the simulation adjustment of the original image, so that a relatively real and more visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation image is improved.
It should be noted that, the original image may be obtained by shooting with a camera of the electronic device, or may be obtained by scanning; the characteristics of the face in the original image can be analyzed during face recognition, so that face characteristic data are obtained; the shaping face feature database is a preset set of face feature material data commonly used for shaping, the feature difference between the face feature data and the shaping face can be obtained through the matching analysis of the actual face feature data and the data of the shaping face feature database, the face feature adjustment value can be obtained according to the difference, the feature difference can be reduced by the face feature adjustment value, the face in the adjusted image is approximated to the shaping face, and the shaping simulation effect is realized; when the simulation adjustment is performed according to the face feature adjustment value, the face feature data is mainly adjusted, and the image deformation processing can be performed based on the face feature points.
In addition, when the server performs matching analysis on the face feature data and a preset shaping face feature database, an image face analysis report can be generated and returned; and (3) giving a shaping suggestion based on the face characteristic adjustment value in the report, automatically performing simulation adjustment on the original image after receiving confirmation information modified according to the shaping suggestion, and giving a shaping suggestion report after the completion, wherein the shaping suggestion report comprises specific shaping parts, shaping modes and shaping effect description information.
Further, diffusion, sharpening, morphing algorithms may be used to process the image when performing the analog adjustment.
Furthermore, when the original image of the object to be shaped is obtained, a shooting area, such as a shooting area similar to the shape of the face, can be defined, and shooting is performed when the face of the object to be shaped enters the shooting area, so that the obtained original image is the required face image, the face recognition time can be shortened, and the recognition accuracy can be improved; in addition, when an original image of an object to be shaped is acquired, sensing brightness during shooting, and if the brightness is smaller than a preset brightness value, starting a flash lamp or prompting that the brightness is insufficient; when face recognition is carried out, the face recognition device can also detect the makeup on the face, prompt cleaning and then carry out shaping simulation, and if the face is detected to have accessories, prompt to take down the accessories, such as glasses, false eyelashes, nose nails and the like.
In one embodiment, the step of obtaining an original image of the object to be shaped comprises the steps of:
Acquiring a front image and a plurality of side images of an object to be shaped.
In this embodiment, a plurality of images of the object to be shaped may be acquired, including a front image and a side image, where the front image and the side images are images obtained from different angles, and on the basis of this, the influence of illumination, angles, and the like may be reduced, so that face recognition is more accurate.
Specifically, in actual operation, a front image and two side images of the object to be shaped at 45-degree angles may be acquired.
Further, after the front image and the side image are obtained, the server builds a 3D original image model based on the front image and the side image, and accurate face recognition is performed by using a 3D model algorithm.
In one embodiment, the step of acquiring face feature data of the object to be shaped comprises the steps of:
Acquiring facial region feature points of an object to be shaped, partitioning the face according to the facial region feature points, and acquiring feature data of each partition and outline data of the face; each partition comprises eyes, noses, mouths, faces and chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions.
In this embodiment, after face recognition, feature points of a face region may be obtained, and feature points of different regions on the face may be distributed differently, and the face region may be partitioned by using the feature points of the face region, so as to obtain feature data of regions such as eyes, nose, mouth, face, chin, and contour data of the face, where the feature data includes position data of a current face region and relative position data between the current face region and other regions, so as to perform simulated shaping on the different regions of the face.
Specifically, the characteristic region on the face may include forehead, eyes, eyebrows, eyelids, nose bridge, nose wings, cheek, mouth, chin (chin) and the like, and further includes facial shape data such as overall facial contour, different characteristic points may be constructed in the characteristic region to realize division of the face characteristic region, when the characteristic data is obtained, not only the data of the characteristic region, but also the position data of the characteristic region and the relative position data with other characteristic regions, and the color, brightness and other data of the characteristic region, and the coordination of the simulation effect can be improved by integrating the data during shaping simulation.
Furthermore, in addition to the face region partitioning according to the face recognition result, the point positions can be manually set for selection, for example, a region selection instruction is received, a designated region is selected on the face of the original image, the characteristic data of the designated region is obtained, and the flexibility of shaping simulation is improved.
Further, the facial region is partitioned, and after the characteristic data of the partitioned region is matched and analyzed with a preset shaping facial characteristic database, a partitioned region which suggests shaping can be obtained, and a facial characteristic adjustment value of the partitioned region is obtained.
In one embodiment, the step of performing a matching analysis on the face feature data and a preset reshaped face feature database includes the steps of:
Comparing the face characteristic data with a face characteristic preset value, determining the face type, acquiring a first sub-database matched with the face type from the shaping face characteristic database, and searching matching data in the first sub-database according to the face characteristic data, wherein the similarity between the matching data and the face characteristic data is larger than or equal to the preset value;
the step of obtaining the face feature adjustment value further includes the steps of:
And obtaining the ratio of the face feature data to the matching data in the shaping face feature database, and obtaining a face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a numerical value of 1.
In this embodiment, a face type is determined by using a preset face feature value, a first sub-database matched with the face type is selected, the similarity between the face feature data and data in the first sub-database can be used to determine matching data, after similarity matching analysis is performed on the face feature data and the shaping face feature database, matching data matched with the face feature data after image analysis can be obtained in the shaping face feature database, but the matching data is different from the face feature data after image analysis, the ratio of the data of specific feature points of the two is calculated, the ratio is used as the limit of an adjustment value, the face feature adjustment value is set between the ratio and a numerical value 1, and after simulation adjustment is performed on the image by using the face feature adjustment value, the face feature data in the image and the data in the shaping face database can be approximated to realize a simulation effect of shaping.
Further, the face feature adjustment value may be dynamic data, and is dynamically adjusted between the ratio and the value 1 according to the requirement of the object to be shaped.
In one embodiment, the shaping analog information processing method further includes the steps of:
Receiving a second selection instruction, wherein the second selection instruction is used for selecting a first target partition in each partition;
the server selects a second sub-database from the shaping face feature database according to the feature data of the other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; the face characteristic data in the second sub-database are matched with the characteristic data of other partitions except the first target partition.
In this embodiment, the first target partition may be selected through the second selection instruction, and the second sub-database is selected according to the feature data of other partitions in the shaping face feature database, and because the face feature data in the second sub-database is matched with the feature data of other partitions except the first target partition, when the feature data of the first target partition is matched with the feature data of the second sub-database, the obtained feature adjustment value of the first target partition can coordinate the first target partition with other partitions, so that the overall coordination when shaping simulation is performed on a single partition part is improved.
After receiving the second selection instruction, the second selection instruction is sent to the server to determine the first target partition, after matching analysis is performed on the feature data of the first target partition and the second sub-database, the server may return the feature adjustment value of the first target partition, and perform simulation adjustment on the original image by using the feature adjustment value of the first target partition to obtain the shaping simulation image.
In one embodiment, the shaping analog information processing method further includes the steps of:
Receiving a second modification instruction, and performing characteristic data fine adjustment on the shaping simulation image according to the second modification instruction;
Or alternatively
And receiving a third modification instruction, wherein the third modification instruction is used for re-selecting the first target partition from the partitions.
In this embodiment, after the image is subjected to simulation adjustment according to the face feature adjustment value to obtain a shaped simulated image, the shaped simulated image may not meet the requirement of the object to be shaped, and at this time, a second modification instruction may be received, and feature data fine adjustment is performed according to the second modification instruction, so that the shaped simulated image meets the specific requirement of the object to be shaped; or the shaping simulation of the current first target partition does not meet the requirement of the object to be shaped, a third modification instruction can be received, the third modification instruction is sent to the server, and a new first target partition is selected again for shaping simulation according to the third modification instruction, so that the simulation shaping can be adjusted according to the requirement of the object to be shaped.
In one embodiment, the shaping analog information processing method further includes the steps of:
Receiving a triggering instruction aiming at a second target partition, wherein the triggering instruction is used for selecting a plurality of alternative partition images from the shaping face feature database, and the partition type of each partition image is the same as that of the second target partition;
displaying each partition image and receiving a third selection instruction, wherein the third selection instruction is used for selecting a target partition image from each partition image;
and fusing the target partition image to the position corresponding to the second target partition in the original image.
In this embodiment, the second target partition may be selected and triggered, multiple candidate partition images with the same type as the second target partition are selected in the shaping face feature database, the partition images are displayed for the object to be shaped to select, and after the object to be shaped selects the target partition image through the third selection instruction, the target partition image is fused into the original image, so as to achieve the effect that the object to be shaped autonomously selects the shaping content, and the shaping simulation image is displayed.
Specifically, the second target partition may be a forehead, eyes, eyebrows, nose, mouth, chin (chin) and other parts, for example, an eye part is selected as the second target partition, eye images with different shapes may be selected in the shaping face feature database and displayed, the object to be shaped is selected, and after the determination, the selected new eye image is fused into the original image of the object to be shaped to form the shaping simulation image.
In one embodiment, the step of fusing the target partition image to the original image at a location corresponding to the second target partition comprises the steps of:
And acquiring the image size, position and color data of the second target partition, adjusting the image of the target partition according to the image size, position and color data, replacing the part corresponding to the second target partition in the original image with the adjusted image, and carrying out fuzzy processing on the butt joint edge of the adjusted image and the original image.
In this embodiment, the second target partition is a part of the original image, and has the properties of image size, position, color, and the like, and the target partition image is adjusted according to the data of the image size, position, color, and the like, so that the target partition image and the original image can be coordinated, in addition, the adjusted butt joint edge of the image and the original image is subjected to blurring processing, so that the finally obtained image can be prevented from being displayed suddenly, and a good simulation effect is reflected.
After the fusion and blurring processing, another shaping simulation image can be obtained, which is different from the shaping simulation image obtained by performing simulation adjustment on the original image according to the face characteristic adjustment value; after fusion and blurring processing are carried out, a fourth modification instruction can be received, and characteristic data fine adjustment is carried out on the obtained image according to the fourth modification instruction; or re-selecting the second target partition from the partitions according to the fifth modification instruction.
In addition, the sent first image may be a shaping simulation image obtained by performing simulation adjustment according to the face feature adjustment value, or may be an image obtained by selecting different partitions to perform fusion processing.
In one embodiment, the shaping analog information processing method further includes the steps of:
if the feedback opinion is information representing agreement, a three-dimensional image is constructed and displayed according to the second image.
In this embodiment, if the feedback opinion indicates agreement, the second image may be used as the shaping simulation effect image, and a three-dimensional image may be constructed therefrom, so that the shaping simulation effect is more intuitively and clearly displayed from the perspective of three-dimensional stereo.
In one embodiment, the shaping analog information processing method further includes the steps of:
And receiving a decoration instruction, and decorating the three-dimensional image according to the decoration instruction to obtain a final image and displaying the final image.
In this embodiment, the shaping simulation effect image is mainly aimed at the face region, and the image of the whole head where the face is located is also relevant to the shaping simulation effect, and at this time, the three-dimensional image can be modified by using the modification instruction, so that the final image is more beautiful.
According to the shaping simulation information processing method, the embodiment of the invention further provides a shaping simulation terminal, and the embodiment of the shaping simulation terminal is described in detail below.
The shaping simulation terminal of one embodiment of the invention is used for acquiring a first image containing a human face and sending the first image to the shaping service terminal through a server; receiving a second image returned by the shaping service terminal through the server, receiving feedback comments aiming at the second image, and sending the feedback comments to the shaping service terminal through the server; the second image is an image obtained after the shaping service terminal adjusts the first image according to the received modification instruction.
In this embodiment, the shaping simulation terminal may be applied to the shaping object side, the shaping simulation terminal obtains a first image including a face, and sends the first image to the shaping service terminal, the shaping service terminal may be set at the shaping doctor side, and after receiving the first image, the shaping service terminal may receive a first modification instruction, so as to adjust the first image, and obtain and return a second image to the shaping simulation terminal; the shaping simulation terminal can receive feedback comments of the second image, send the feedback comments to the shaping service terminal, realize information interaction of the shaping image between the shaping object side and the shaping doctor side, quickly determine the shaping simulation effect image, better meet the shaping requirement, obtain a relatively real and visual shaping simulation effect, and improve the preoperative reference effect of the shaping simulation effect image.
In one embodiment, the first image comprises an original image or a shaped analog image of the object to be shaped.
In one embodiment, the shaping simulation terminal obtains and displays information of a plurality of shaping doctors, receives a first selection instruction, selects information of a target shaping doctor according to the first selection instruction, and establishes communication connection with the shaping service terminal through the server, wherein the information of the target shaping doctor is associated with the shaping service terminal.
In one embodiment, the shaping analog terminal displays a communication window, and performs information interaction with the shaping service terminal through the communication window.
In one embodiment, a shaping simulation terminal acquires an original image of an object to be shaped, sends the original image to a server, receives a face characteristic adjustment value returned by the server, and performs simulation adjustment on the original image according to the face characteristic adjustment value to obtain a shaping simulation image;
The method comprises the steps that a server carries out face recognition on an original image to obtain face feature data of an object to be shaped; and carrying out matching analysis on the face characteristic data and a preset shaping face characteristic database to obtain a face characteristic adjustment value.
In one embodiment, a shaping analog terminal acquires a front image and a plurality of side images of an object to be shaped.
In one embodiment, a server acquires facial region feature points of an object to be shaped, partitions the face according to the facial region feature points, and acquires feature data of each partition and contour data of the face; each partition comprises eyes, noses, mouths, faces and chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions.
In one embodiment, the server compares the face feature data with a face feature preset value, determines the face type, acquires a first sub-database matched with the face type from the reshaped face feature database, and searches the matching data in the first sub-database according to the face feature data, wherein the similarity between the matching data and the face feature data is larger than or equal to the preset value;
The server obtains the ratio of the face feature data to the matching data, and obtains a face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a numerical value 1.
In one embodiment, the shaping analog terminal receives a second selection instruction, where the second selection instruction is used to select a first target partition from the partitions;
the server selects a second sub-database from the shaping face feature database according to the feature data of the other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; the face characteristic data in the second sub-database are matched with the characteristic data of other partitions except the first target partition.
In one embodiment, the shaping simulation terminal receives a second modification instruction, and performs characteristic data fine adjustment on the shaping simulation image according to the second modification instruction;
Or alternatively
And the shaping simulation terminal receives a third modification instruction, wherein the third modification instruction is used for selecting the first target partition from the partitions again.
In one embodiment, the shaping simulation terminal receives a trigger instruction for a second target partition, wherein the trigger instruction is used for selecting a plurality of alternative partition images in the shaping face feature database, and the partition type of each partition image is the same as that of the second target partition;
the shaping simulation terminal displays each partition image and receives a third selection instruction, wherein the third selection instruction is used for selecting a target partition image from each partition image;
And the shaping simulation terminal fuses the target partition image to the position corresponding to the second target partition in the original image.
In one embodiment, the shaping simulation terminal acquires the image size, position and color data of the second target partition, adjusts the image of the target partition according to the image size, position and color data, replaces the part corresponding to the second target partition in the original image with the adjusted image, and performs blurring processing on the butt joint edge of the adjusted image and the original image.
In one embodiment, the shaping simulation terminal constructs and displays a three-dimensional image according to the second image when feedback opinion is information representing consent.
In one embodiment, the shaping simulation terminal receives a modification instruction, modifies the three-dimensional image according to the modification instruction, and obtains and displays a final image.
The shaping simulation terminal of the present invention corresponds to the shaping simulation information processing method of the present invention, and the technical features and the beneficial effects described in the embodiments of the shaping simulation information processing method are applicable to the embodiments of the shaping simulation terminal.
According to the shaping analog information processing method described above, the embodiment of the present invention also provides another shaping analog information processing method, and the embodiment of the other shaping analog information processing method of the present invention will be described in detail below.
Referring to fig. 3, a flow chart of a shaping analog information processing method according to an embodiment of the invention is shown. The shaping simulation information processing method in this embodiment includes the steps of:
step S210: receiving a first image containing a face; wherein the first image is sent by the shaping analog terminal through the server;
Step S220: receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to the shaping simulation terminal through the server;
Step S230: receiving feedback comments aiming at the second image, and if the feedback comments are information representing consent, storing the second image; wherein the feedback opinion is sent by the shaping service terminal via the server.
In this embodiment, the shaping simulation information processing method may be applied to a shaping doctor side, and may receive a first image including a face sent by a shaping simulation terminal, and then may receive a first modification instruction, so as to adjust the first image, and obtain and return a second image to the shaping simulation terminal; the feedback opinion aiming at the second image can be received from the shaping simulation terminal, when the feedback opinion represents the agreed information, the second image is stored, the second image can be used as a shaping simulation effect image, the information interaction of the shaping image between the shaping object side and the shaping doctor side is realized, the shaping simulation effect image is determined more quickly, the shaping requirement is met more, the relatively real and more visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
Further, the feedback opinion aiming at the second image can be information representing consent or other modification opinions, if the feedback opinion is other modification opinions, the first modification instruction can be received again to further modify the first image, and the feedback opinion can be used for determining the final shaping simulation effect image.
Further, after the shaping simulation effect image is obtained, the shaping simulation effect image may be stored locally, or the shaping simulation effect image may be transmitted to the shaping simulation terminal and stored in the shaping simulation terminal.
Further, when the first image is adjusted according to the first modification instruction, a subunit in a facial region in the first image may be adjusted, for example, the facial region is an eye, and the subunit may be an eye, eyelid, eyebrow, etc.; the facial region is nose, the subunits can be nose bridge, nose head, nose wing, nose columella, etc., the facial region is face, and the subunits can be cheek, cheekbone, etc.
In one embodiment, the shaping analog information processing method further includes the steps of:
and displaying the communication window, and carrying out information interaction with the shaping simulation terminal through the communication window.
In this embodiment, on the basis of establishing communication connection with the shaping simulation terminal, a communication window may be displayed, and information interaction is performed between the communication window and the shaping simulation terminal, so as to implement communication with the object to be shaped, so that the shaping doctor knows the specific requirement of the object to be shaped on shaping, and the shaping simulation effect image is obtained more quickly.
According to the shaping simulation information processing method, the embodiment of the invention further provides a shaping service terminal, and the embodiment of the shaping service terminal of the invention is described in detail below.
The shaping service terminal is used for receiving a first image containing a human face; receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to the shaping simulation terminal through the server; receiving feedback comments for the second image; if the feedback opinion is information representing agreement, a second image is stored; wherein the first image and the feedback opinion are sent by the shaping analog terminal via the server.
In this embodiment, the shaping service terminal may be applied to the shaping doctor side, and the shaping service terminal may receive the first image including the face sent by the shaping analog terminal, and then may receive the first modification instruction, so as to adjust the first image, and obtain and return the second image to the shaping analog terminal; the shaping simulation terminal sends feedback comments aiming at the second image to the shaping service terminal, when the feedback comments represent agreeing information, the shaping service terminal stores the second image, the second image can be used as a shaping simulation effect image, information interaction of the shaping image between the shaping object side and the shaping doctor side is realized, the shaping simulation effect image is determined more quickly, the shaping requirement is met, a relatively real and more visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
In one embodiment, the shaping service terminal displays a communication window, and performs information interaction with the shaping simulation terminal through the communication window.
The shaping service terminal of the present invention corresponds to the shaping analog information processing method, and the technical features and the beneficial effects described in the embodiments of the shaping analog information processing method are applicable to the embodiments of the shaping service terminal.
A readable storage medium having stored thereon an executable program which when executed by a processor performs the steps of the shaping analog information processing method described above.
According to the readable storage medium, through the stored executable program, the information interaction of the shaping image between the shaping object side and the shaping doctor side can be realized, the shaping simulation effect image can be rapidly determined, the shaping requirement is met, the relatively real and visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
The shaping simulation device comprises a shaping simulation terminal and a shaping service terminal, wherein the shaping simulation terminal acquires a first image containing a human face and sends the first image to the shaping service terminal through a server; the shaping service terminal receives the first modification instruction, adjusts the first image according to the first modification instruction, obtains a second image, and sends the second image to the shaping simulation terminal through the server; the shaping simulation terminal receives the feedback opinion aiming at the second image and sends the feedback opinion to the shaping service terminal through the server; and the shaping service terminal obtains and stores the shaping simulation effect image according to the feedback opinion.
According to the shaping simulation equipment, through information interaction between the shaping simulation terminal and the shaping service terminal, information interaction of the shaping image between the shaping object side and the shaping doctor side can be realized, the shaping simulation effect image can be determined rapidly, the shaping requirement is met, the relatively real and visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
In one embodiment, the shaping simulation device further comprises a server.
Those skilled in the art will appreciate that all or a portion of the processes implementing the methods of the embodiments described above may be implemented by computer programs instructing the relevant hardware, and the programs may be stored on a non-volatile computer readable storage medium, as in the examples, in a storage medium of a computer system and executed by at least one processor in the computer system to implement the processes including the embodiments of the shaping analog information processing method described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random-access Memory (Random Access Memory, RAM), or the like.
Specifically, the shaping simulation information processing method can be applied to a shaping simulation terminal at a user side and a shaping service terminal at a shaping doctor side, the shaping simulation terminal sends a shaping simulation image to the shaping service terminal, invites the shaping doctor to adjust the shaping simulation image and give a modification suggestion, and the shaping service terminal returns modification suggestion data, wherein an interaction schematic diagram is shown in fig. 4.
Furthermore, the original image of the object to be shaped can be directly sent to the shaping server through the server, the modification opinion data returned by the shaping server is received, and the processing information of the modification opinion data is fed back.
In one embodiment, the shaping analog terminal and the shaping service terminal may be personal computers, notebook computers, palm computers, smart phones, tablet computers, portable wearable devices, and the like.
The flow diagram of the shaping simulation information processing method is shown in fig. 5. Specifically, a user can scan or shoot a face through electronic equipment such as a mobile phone, a tablet personal computer, a camera and the like, upload three face images (two face images and two side images (45 degrees)) with different faces, and establish a 3D original image model. Then, face recognition is carried out on an original image model of a user, each part of the face is partitioned into forehead, eyes (monocular, including eyes and eyebrows), nose (nose, nose wings), lower jaw, face (two cheeks) and the like (the part partition is selected by manually setting points by the user), facial features of the user are analyzed through a face type data calculation algorithm, and preset standard values are compared to obtain a face analysis report, the user can carry out automatic shaping simulation according to suggestions in the analysis report, a shaping suggestion report is obtained after the completion, and the user can save images and reports formed through simulation as a certain shaping reference. Meanwhile, a user can analyze and replace a single face part into various part images in a shaping face database so as to obtain a shaping simulation image, the face image of the user can be adjusted by adjusting data obtained after analysis so as to obtain a shaping simulation image, the part images can be replaced, the user can independently select parts, the part images of the same type are selected from the shaping face database for selection by the user, after the user determines the required part images, the selected part images are fused into the face image of the user, the docking position is subjected to simulation processing so as to obtain another shaping simulation image, if the effect of shaping simulation is unsatisfactory, the user can use a fine tuning function to carry out image processing on the single part or reselect the part to carry out shaping simulation, finally, the original image is subjected to corresponding shaping simulation processing by recalculating and mixing standard values designed by a system so as to obtain a final shaping simulation image, the simulation effect image can be sent to an online shaping doctor through an online shaping service module (namely a data interaction module) to carry out point-to-point consultation on the online shaping doctor, and the online shaping doctor can carry out fine tuning or re-matching on each part on the basis of the simulation image so as to obtain the best shaping simulation image; the shaping doctor provides shaping advice online and can modify the simulation data of the client so as to obtain a shaping simulation image which is perceived by both sides, then the user can save the simulation image and can print the 3D simulation image, the image can be saved in a database of a shaping server of the doctor, and when the doctor looks for the next time under the line of the user, the doctor can call out the data as the basis of the face diagnosis, so that the communication time of both sides is reduced; the plastic doctor can take the plastic surgery as a reference for implementing plastic surgery, clients can share the plastic surgery to friends through instant messaging software such as WeChat, QQ and the like through sharing functions, compared with the traditional plastic simulation technology, the plastic surgery simulation method has the advantages that fuzzy image processing can only be simply carried out, medical and cosmetic professional technology cannot be fused, the operation time of the users is shortened, the plastic simulation efficiency and the professional performance are improved, and the plastic surgery simulation method is particularly applied to a client face diagnosis link after medical and cosmetic surgery, and can enable the users to obtain postoperative effect simulation images more intuitively in advance.
In addition, the scheme of the embodiment of the invention can also be provided with an organization service terminal of a third party such as a hospital, after a plastic doctor obtains a final plastic simulation image, configuration requirement information of plastic surgery can be sent to the organization service terminal, and after a worker of the third party such as the hospital prepares the arrangement content of the plastic surgery, specific plastic travel information is respectively sent to the plastic simulation terminal of an object to be shaped and the plastic service terminal of the plastic doctor, so that the plastic surgery can be arranged smoothly.
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
Those of ordinary skill in the art will appreciate that all or a portion of the steps in implementing the methods of the embodiments described above may be implemented by programming instructions associated with hardware. The program may be stored in a computer readable storage medium. The program, when executed, comprises the steps of the method described above. The storage medium includes: ROM/RAM, magnetic disks, optical disks, etc.
The above examples illustrate only a few embodiments of the invention, which are described in detail and are not to be construed as limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.
Claims (12)
1. A shaping analog information processing method is characterized by comprising the following steps:
Acquiring a first image containing a human face, and sending the first image to a shaping service terminal through a server, wherein the first image comprises an original image or a shaping simulation image of an object to be shaped, and acquiring the shaping simulation image comprises: acquiring an original image of an object to be shaped, transmitting the original image to the server, receiving a face characteristic adjustment value returned by the server, and performing simulation adjustment on the original image according to the face characteristic adjustment value to obtain the shaping simulation image; the server performs face recognition on the original image to acquire face feature data of the object to be shaped; carrying out matching analysis on the face feature data and a preset shaping face feature database to obtain the face feature adjustment value;
The step of obtaining the face characteristic data of the object to be shaped comprises the following steps: acquiring facial region characteristic points of the object to be shaped, partitioning the face according to the facial region characteristic points, and acquiring characteristic data of each partition and outline data of the face; wherein each partition comprises eyes, a nose, a mouth, a face and a chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions;
the step of carrying out matching analysis on the face feature data and a preset shaping face feature database comprises the following steps:
Comparing the face feature data with a face feature preset value, determining a face type, acquiring a first sub-database matched with the face type from the shaping face feature database, and searching matching data in the first sub-database according to the face feature data, wherein the similarity between the matching data and the face feature data is larger than or equal to the preset value; the step of obtaining the face feature adjustment value further comprises the following steps: acquiring a ratio of the face feature data to the matching data, and acquiring the face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1;
The face feature adjustment value obtaining step comprises the steps of receiving a second selection instruction, wherein the second selection instruction is used for selecting a first target partition in each partition;
The server selects a second sub-database from the shaping face feature database according to the feature data of the other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; the face characteristic data in the second sub-database are matched with the characteristic data of other partitions except the first target partition;
Receiving a second image returned by the shaping service terminal through the server, wherein the second image is an image obtained by the shaping service terminal after adjusting the first image according to the received first modification instruction;
And receiving feedback comments aiming at the second image, and sending the feedback comments to the shaping service terminal through the server.
2. The shaping analog information processing method according to claim 1, further comprising the step of:
And acquiring and displaying information of a plurality of shaping doctors, receiving a first selection instruction, selecting information of a target shaping doctor according to the first selection instruction, and establishing communication connection with the shaping service terminal through the server, wherein the information of the target shaping doctor is associated with the shaping service terminal.
3. The shaping analog information processing method according to claim 2, further comprising the step of:
And displaying a communication window, and carrying out information interaction with the shaping service terminal through the communication window.
4. The shaping simulation information processing method according to claim 1, wherein the step of acquiring an original image of the object to be shaped comprises the steps of:
and acquiring a front image and a plurality of side images of the object to be shaped.
5. The shaping analog information processing method according to claim 1, further comprising the step of:
receiving a second modification instruction, and performing characteristic data fine adjustment on the shaping simulation image according to the second modification instruction;
Or alternatively
And receiving a third modification instruction, wherein the third modification instruction is used for re-selecting the first target partition in each partition.
6. The shaping analog information processing method according to claim 1, further comprising the step of:
Receiving a trigger instruction aiming at a second target partition, wherein the trigger instruction is used for selecting a plurality of alternative partition images from the shaping face feature database, and the partition type of each partition image is the same as that of the second target partition;
Displaying each partition image and receiving a third selection instruction, wherein the third selection instruction is used for selecting a target partition image from each partition image;
And fusing the target partition image to a position corresponding to the second target partition in the original image.
7. The shaping simulation information processing method according to claim 6, wherein the step of fusing the target partition image to a position corresponding to the second target partition in the original image includes the steps of:
And acquiring the image size, position and color data of the second target partition, adjusting the image of the target partition according to the image size, position and color data, replacing the part corresponding to the second target partition in the original image with the adjusted image, and carrying out fuzzy processing on the butt joint edge of the adjusted image and the original image.
8. The shaping analog information processing method according to any one of claims 1 to 7, characterized by further comprising the steps of:
and if the feedback opinion is information representing agreement, constructing a three-dimensional image according to the second image and displaying the three-dimensional image.
9. The shaping analog information processing method according to claim 8, further comprising the step of:
and receiving a decoration instruction, and decorating the three-dimensional image according to the decoration instruction to obtain a final image and displaying the final image.
10. The shaping simulation terminal is characterized by being used for acquiring a first image containing a human face and sending the first image to a shaping service terminal through a server; wherein the first image includes an original image or a shaping analog image of an object to be shaped, and acquiring the shaping analog image includes: acquiring an original image of an object to be shaped, transmitting the original image to the server, receiving a face characteristic adjustment value returned by the server, and performing simulation adjustment on the original image according to the face characteristic adjustment value to obtain the shaping simulation image; the server performs face recognition on the original image to acquire face feature data of the object to be shaped; carrying out matching analysis on the face feature data and a preset shaping face feature database to obtain the face feature adjustment value;
The step of obtaining the face characteristic data of the object to be shaped comprises the following steps: acquiring facial region characteristic points of the object to be shaped, partitioning the face according to the facial region characteristic points, and acquiring characteristic data of each partition and outline data of the face; wherein each partition comprises eyes, a nose, a mouth, a face and a chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions;
the step of carrying out matching analysis on the face feature data and a preset shaping face feature database comprises the following steps:
Comparing the face feature data with a face feature preset value, determining a face type, acquiring a first sub-database matched with the face type from the shaping face feature database, and searching matching data in the first sub-database according to the face feature data, wherein the similarity between the matching data and the face feature data is larger than or equal to the preset value; the step of obtaining the face feature adjustment value further comprises the following steps: acquiring a ratio of the face feature data to the matching data, and acquiring the face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1;
The face feature adjustment value obtaining step comprises the steps of receiving a second selection instruction, wherein the second selection instruction is used for selecting a first target partition in each partition;
The server selects a second sub-database from the shaping face feature database according to the feature data of the other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; the face characteristic data in the second sub-database are matched with the characteristic data of other partitions except the first target partition;
Receiving a second image returned by the shaping service terminal through the server, receiving feedback comments aiming at the second image, and sending the feedback comments to the shaping service terminal through the server; the second image is an image obtained after the shaping service terminal adjusts the first image according to the received modification instruction.
11. A shaping analog information processing method is characterized by comprising the following steps:
Receiving a first image containing a face; wherein the first image is sent by the shaping analog terminal through the server;
wherein the first image includes an original image or a shaping analog image of an object to be shaped, and acquiring the shaping analog image includes: acquiring an original image of an object to be shaped, transmitting the original image to the server, receiving a face characteristic adjustment value returned by the server, and performing simulation adjustment on the original image according to the face characteristic adjustment value to obtain the shaping simulation image; the server performs face recognition on the original image to acquire face feature data of the object to be shaped; carrying out matching analysis on the face feature data and a preset shaping face feature database to obtain the face feature adjustment value;
The step of obtaining the face characteristic data of the object to be shaped comprises the following steps: acquiring facial region characteristic points of the object to be shaped, partitioning the face according to the facial region characteristic points, and acquiring characteristic data of each partition and outline data of the face; wherein each partition comprises eyes, a nose, a mouth, a face and a chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions;
the step of carrying out matching analysis on the face feature data and a preset shaping face feature database comprises the following steps:
Comparing the face feature data with a face feature preset value, determining a face type, acquiring a first sub-database matched with the face type from the shaping face feature database, and searching matching data in the first sub-database according to the face feature data, wherein the similarity between the matching data and the face feature data is larger than or equal to the preset value; the step of obtaining the face feature adjustment value further comprises the following steps: acquiring a ratio of the face feature data to the matching data, and acquiring the face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1;
The face feature adjustment value obtaining step comprises the steps of receiving a second selection instruction, wherein the second selection instruction is used for selecting a first target partition in each partition;
The server selects a second sub-database from the shaping face feature database according to the feature data of the other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; the face characteristic data in the second sub-database are matched with the characteristic data of other partitions except the first target partition;
Receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to the shaping simulation terminal through the server;
Receiving feedback comments for the second image; wherein, the feedback opinion is sent by the shaping service terminal through the server;
and if the feedback opinion is information representing agreement, storing the second image.
12. A shaping service terminal, wherein the shaping service terminal is configured to receive a first image including a face;
Wherein the first image includes an original image or a shaping analog image of an object to be shaped, and acquiring the shaping analog image includes: acquiring an original image of an object to be shaped, sending the original image to a server, receiving a face characteristic adjustment value returned by the server, and performing simulation adjustment on the original image according to the face characteristic adjustment value to obtain the shaping simulation image; the server performs face recognition on the original image to acquire face feature data of the object to be shaped; carrying out matching analysis on the face feature data and a preset shaping face feature database to obtain the face feature adjustment value;
The step of obtaining the face characteristic data of the object to be shaped comprises the following steps: acquiring facial region characteristic points of the object to be shaped, partitioning the face according to the facial region characteristic points, and acquiring characteristic data of each partition and outline data of the face; wherein each partition comprises eyes, a nose, a mouth, a face and a chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions;
the step of carrying out matching analysis on the face feature data and a preset shaping face feature database comprises the following steps:
Comparing the face feature data with a face feature preset value, determining a face type, acquiring a first sub-database matched with the face type from the shaping face feature database, and searching matching data in the first sub-database according to the face feature data, wherein the similarity between the matching data and the face feature data is larger than or equal to the preset value; the step of obtaining the face feature adjustment value further comprises the following steps: acquiring a ratio of the face feature data to the matching data, and acquiring the face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1;
The face feature adjustment value obtaining step comprises the steps of receiving a second selection instruction, wherein the second selection instruction is used for selecting a first target partition in each partition;
The server selects a second sub-database from the shaping face feature database according to the feature data of the other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; the face characteristic data in the second sub-database are matched with the characteristic data of other partitions except the first target partition;
Receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to a shaping simulation terminal through the server; receiving feedback comments for the second image; if the feedback opinion is information representing agreement, the second image is saved; wherein the first image and the feedback opinion are sent by the shaping analog terminal via a server.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811581508.XA CN111354478B (en) | 2018-12-24 | 2018-12-24 | Shaping simulation information processing method, shaping simulation terminal and shaping service terminal |
| PCT/CN2019/127252 WO2020135287A1 (en) | 2018-12-24 | 2019-12-22 | Plastic surgery simulation information processing method, plastic surgery simulation terminal and plastic surgery service terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811581508.XA CN111354478B (en) | 2018-12-24 | 2018-12-24 | Shaping simulation information processing method, shaping simulation terminal and shaping service terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111354478A CN111354478A (en) | 2020-06-30 |
| CN111354478B true CN111354478B (en) | 2024-07-12 |
Family
ID=71126349
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811581508.XA Active CN111354478B (en) | 2018-12-24 | 2018-12-24 | Shaping simulation information processing method, shaping simulation terminal and shaping service terminal |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111354478B (en) |
| WO (1) | WO2020135287A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114333018A (en) * | 2021-12-29 | 2022-04-12 | 北京百度网讯科技有限公司 | Shaping information recommendation method and device and electronic equipment |
| CN115375899A (en) * | 2022-08-24 | 2022-11-22 | 北京京东乾石科技有限公司 | Point cloud semantic segmentation network training method, point cloud semantic segmentation method and point cloud semantic segmentation device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107123160A (en) * | 2017-05-02 | 2017-09-01 | 成都通甲优博科技有限责任公司 | Simulation lift face system, method and mobile terminal based on three-dimensional image |
| CN107122727A (en) * | 2017-04-20 | 2017-09-01 | 北京旷视科技有限公司 | Method, apparatus and system for face's shaping |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020064302A1 (en) * | 2000-04-10 | 2002-05-30 | Massengill R. Kemp | Virtual cosmetic autosurgery via telemedicine |
| US8620038B2 (en) * | 2006-05-05 | 2013-12-31 | Parham Aarabi | Method, system and computer program product for automatic and semi-automatic modification of digital images of faces |
| US20100142755A1 (en) * | 2008-11-26 | 2010-06-10 | Perfect Shape Cosmetics, Inc. | Method, System, and Computer Program Product for Providing Cosmetic Application Instructions Using Arc Lines |
| CN102254151B (en) * | 2011-06-16 | 2013-01-16 | 清华大学 | Driver fatigue detection method based on face video analysis |
| CN102254180B (en) * | 2011-06-28 | 2014-07-09 | 北京交通大学 | Geometrical feature-based human face aesthetics analyzing method |
| KR102294927B1 (en) * | 2014-03-31 | 2021-08-30 | 트라이큐빅스 인크. | Sns . |
| CN106934073A (en) * | 2017-05-02 | 2017-07-07 | 成都通甲优博科技有限责任公司 | Face comparison system, method and mobile terminal based on three-dimensional image |
| CN107578465A (en) * | 2017-07-27 | 2018-01-12 | 深圳先进技术研究院 | A kind of method and system of simulation shows human body shaping effect |
-
2018
- 2018-12-24 CN CN201811581508.XA patent/CN111354478B/en active Active
-
2019
- 2019-12-22 WO PCT/CN2019/127252 patent/WO2020135287A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107122727A (en) * | 2017-04-20 | 2017-09-01 | 北京旷视科技有限公司 | Method, apparatus and system for face's shaping |
| CN107123160A (en) * | 2017-05-02 | 2017-09-01 | 成都通甲优博科技有限责任公司 | Simulation lift face system, method and mobile terminal based on three-dimensional image |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020135287A1 (en) | 2020-07-02 |
| CN111354478A (en) | 2020-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210192858A1 (en) | Electronic device for generating image including 3d avatar reflecting face motion through 3d avatar corresponding to face and method of operating same | |
| US10607372B2 (en) | Cosmetic information providing system, cosmetic information providing apparatus, cosmetic information providing method, and program | |
| EP3182362A1 (en) | Method and sytem for evaluating fitness between eyeglasses wearer and eyeglasses worn thereby | |
| CN110148191B (en) | Video virtual expression generation method and device and computer readable storage medium | |
| CN109857311A (en) | Generate method, apparatus, terminal and the storage medium of human face three-dimensional model | |
| KR102455966B1 (en) | Mediating Apparatus, Method and Computer Readable Recording Medium Thereof | |
| US11776187B2 (en) | Digital makeup artist | |
| CN111354478B (en) | Shaping simulation information processing method, shaping simulation terminal and shaping service terminal | |
| US11830129B2 (en) | Object relighting using neural networks | |
| US11380037B2 (en) | Method and apparatus for generating virtual operating object, storage medium, and electronic device | |
| EP4315265A1 (en) | True size eyewear experience in real-time | |
| CN105095917A (en) | Image processing method, device and terminal | |
| WO2022257766A1 (en) | Image processing method and apparatus, device, and medium | |
| US11812183B2 (en) | Information processing device and program | |
| CN115861575A (en) | Commodity virtual trial effect display method and electronic equipment | |
| CN111353931B (en) | Shaping simulation method, system, readable storage medium and apparatus | |
| KR101507410B1 (en) | Live make-up photograpy method and apparatus of mobile terminal | |
| US20210217074A1 (en) | Systems and methods for providing a style recommendation | |
| CN111370100A (en) | Face-lifting recommendation method and system based on cloud server | |
| CN114333018A (en) | Shaping information recommendation method and device and electronic equipment | |
| CN114021022A (en) | Dressing information acquisition method and device, vehicle and storage medium | |
| CN111444979A (en) | Face-lifting scheme recommendation method, cloud device and storage medium | |
| CN112785490A (en) | Image processing method and device and electronic equipment | |
| CN113076779A (en) | Shaping simulation matching method, shaping simulation matching system, readable storage medium and device | |
| CN113902790B (en) | Beauty guidance method, device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |