CN111354478A - Shaping simulation information processing method, shaping simulation terminal and shaping service terminal - Google Patents

Shaping simulation information processing method, shaping simulation terminal and shaping service terminal Download PDF

Info

Publication number
CN111354478A
CN111354478A CN201811581508.XA CN201811581508A CN111354478A CN 111354478 A CN111354478 A CN 111354478A CN 201811581508 A CN201811581508 A CN 201811581508A CN 111354478 A CN111354478 A CN 111354478A
Authority
CN
China
Prior art keywords
image
shaping
reshaping
face
simulation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811581508.XA
Other languages
Chinese (zh)
Other versions
CN111354478B (en
Inventor
黄庆武
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huang Qingwu Plastic Doctor Group Shenzhen Co ltd
Original Assignee
Huang Qingwu Plastic Doctor Group Shenzhen Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huang Qingwu Plastic Doctor Group Shenzhen Co ltd filed Critical Huang Qingwu Plastic Doctor Group Shenzhen Co ltd
Priority to CN201811581508.XA priority Critical patent/CN111354478B/en
Priority claimed from CN201811581508.XA external-priority patent/CN111354478B/en
Priority to PCT/CN2019/127252 priority patent/WO2020135287A1/en
Publication of CN111354478A publication Critical patent/CN111354478A/en
Application granted granted Critical
Publication of CN111354478B publication Critical patent/CN111354478B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H80/00—ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Epidemiology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Physics & Mathematics (AREA)
  • Public Health (AREA)
  • Theoretical Computer Science (AREA)
  • Primary Health Care (AREA)
  • Physics & Mathematics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Computer Hardware Design (AREA)
  • Radiology & Medical Imaging (AREA)
  • Pathology (AREA)
  • Multimedia (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Biomedical Technology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)

Abstract

The invention relates to a shaping simulation information processing method, a shaping simulation terminal and a shaping service terminal, belonging to the technical field of shaping images, wherein a first image containing a human face is obtained and sent to the shaping service terminal, the shaping service terminal can be arranged at a shaping doctor side, and the shaping service terminal can receive a first modification instruction after receiving the first image so as to adjust the first image and obtain and return a second image; one side of the reshaping object can receive the feedback suggestion of the second image and send the feedback suggestion to the reshaping service terminal, so that the information interaction of the reshaping image between the side of the reshaping object and the side of a reshaping doctor is realized, the reshaping simulation effect image is determined relatively quickly, the reshaping requirement is met better, a relatively real and more visual reshaping simulation effect can be obtained, and the preoperative reference effect of the reshaping simulation effect image is improved.

Description

Shaping simulation information processing method, shaping simulation terminal and shaping service terminal
Technical Field
The present invention relates to the field of a shaping image technology, and in particular, to a shaping simulation information processing method, a shaping simulation terminal, and a shaping service terminal.
Background
With the continuous improvement of the social living standard, more and more beauty workers are required, and the rapid development of the medical and beauty industry is promoted.
The traditional preoperative communication scenario for plastic surgery is generally as follows: scene 1: the customer holds the favorite photo for the doctor to see, and expresses to the doctor: require the doctor to integrate a certain part of the doctor into the five sense organs in the picture; the disadvantages are that: the shape of the five sense organs in the picture is arranged on the face of a customer, whether the picture is the most suitable for matching the five sense organs of the customer or whether the customer really likes the picture or not is judged, because an intuitive simulated picture is not arranged before the operation, a recognition error area is easily generated, and the picture is buried for a post-operation customer to complain about disputes. Scene 2: a plastic doctor obtains a digital simulation original image of a plastic object by using a three-dimensional imaging technology, gives a plastic suggestion to the original image of a user according to a professional plastic technology, adjusts and modifies the original image, and performs image stretching processing on eyes, a nose, a face, a chin (chin) and the like in the image, such as eye enlargement (double-eyelid widening), chin stretching, face thinning, nose stretching, face lifting and the like, so as to obtain a plastic simulation effect image for the plastic object to refer to; the disadvantages are that: the image formed by the technology has a certain distance from the reality, and certain skill is needed for operating the image modification, so that doctors and customers cannot easily and quickly modify the image into the desired form in mind, and the communication scene is not smooth enough and takes a long time.
Disclosure of Invention
Therefore, it is necessary to provide a shaping simulation information processing method, a shaping simulation terminal, and a shaping service terminal for solving the problems that no preoperative simulation image exists in the scene 1 and a simulation diagram accurately expressing the shaping intention of a customer and the suggestion of a shaping doctor cannot be quickly obtained in the scene 2 in the conventional shaping preoperative communication process.
A shaping analog information processing method comprises the following steps:
acquiring a first image containing a human face, and sending the first image to a reshaping service terminal through a server;
receiving a second image returned by the reshaping service terminal through the server, wherein the second image is obtained after the reshaping service terminal adjusts the first image according to the received first modification instruction;
and receiving a feedback opinion aiming at the second image, and sending the feedback opinion to the shaping service terminal through the server.
According to the reshaping simulation information processing method, the method can be applied to a reshaping object side, a first image containing a human face is obtained, the first image is sent to a reshaping service terminal, the reshaping service terminal can be arranged at a reshaping doctor side, and the reshaping service terminal can receive a first modification instruction after receiving the first image, so that the first image is adjusted, and a second image is obtained and returned; one side of the reshaping object can receive the feedback suggestion of the second image and send the feedback suggestion to the reshaping service terminal, so that the information interaction of the reshaping image between the side of the reshaping object and the side of a reshaping doctor is realized, the reshaping simulation effect image is determined relatively quickly, the reshaping requirement is met better, a relatively real and more visual reshaping simulation effect can be obtained, and the preoperative reference effect of the reshaping simulation effect image is improved.
In one embodiment, the first image comprises an original image or a reshaped analog image of the object to be reshaped.
In one embodiment, the method for processing the reshaped analog information further includes the steps of:
the method comprises the steps of obtaining and displaying information of a plurality of plastic doctors, receiving a first selection instruction, selecting information of a target plastic doctor according to the first selection instruction, and establishing communication connection with a plastic service terminal through a server, wherein the information of the target plastic doctor is associated with the plastic service terminal.
In one embodiment, the method for processing the reshaped analog information further includes the steps of:
and displaying the communication window, and performing information interaction with the shaping service terminal through the communication window.
In one embodiment, the step of acquiring a first image containing a human face comprises the steps of:
acquiring an original image of an object to be reshaped, sending the original image to a server, receiving a face feature adjustment value returned by the server, and performing analog adjustment on the original image according to the face feature adjustment value to obtain a reshaped analog image;
the method comprises the following steps that a server carries out face recognition on an original image to obtain face feature data of an object to be shaped; and performing matching analysis on the face characteristic data and a preset reshaping face characteristic database to obtain a face characteristic adjustment value.
In one embodiment, the step of obtaining an original image of the object to be reshaped comprises the steps of:
the front image and the multiple side images of the object to be reshaped are obtained.
In one embodiment, the step of obtaining the face feature data of the object to be reshaped comprises the following steps:
acquiring face region characteristic points of an object to be shaped, partitioning a face according to the face region characteristic points, and acquiring characteristic data of each partition and contour data of the face; wherein each partition comprises eyes, a nose, a mouth, a face and a chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions.
In one embodiment, the step of performing matching analysis on the face feature data and a preset reshaped face feature database includes the following steps:
comparing the face feature data with a face feature preset value to determine a face type, acquiring a first sub-database matched with the face type from a shaping face feature database, and searching matching data in the first sub-database according to the face feature data, wherein the similarity between the matching data and the face feature data is greater than or equal to the preset value;
the step of obtaining the face feature adjustment value further comprises the following steps:
and acquiring a ratio of the face feature data to the matching data, and acquiring a face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1.
In one embodiment, the method for processing the reshaped analog information further includes the steps of:
receiving a second selection instruction, wherein the second selection instruction is used for selecting the first target partition in each partition;
the server selects a second sub-database from the shaping face feature database according to the feature data of other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; and the face feature data in the second sub-database is matched with the feature data of other partitions except the first target partition.
In one embodiment, the method for processing the reshaped analog information further includes the steps of:
receiving a second modification instruction, and performing characteristic data fine adjustment on the shaping simulation image according to the second modification instruction;
alternatively, the first and second electrodes may be,
and receiving a third modification instruction, wherein the third modification instruction is used for re-selecting the first target partition in each partition.
In one embodiment, the method for processing the reshaped analog information further includes the steps of:
receiving a triggering instruction aiming at a second target partition, wherein the triggering instruction is used for selecting a plurality of candidate partition images in a reshaping human face feature database, and the partition type of each partition image is the same as that of the second target partition;
displaying each subarea image, and receiving a third selection instruction, wherein the third selection instruction is used for selecting a target subarea image from each subarea image;
and fusing the target subarea image to the position corresponding to the second target subarea in the original image.
In one embodiment, the step of fusing the target partition image to the position of the original image corresponding to the second target partition comprises the steps of:
and acquiring the image size, position and color data of the second target subarea, adjusting the target subarea image according to the image size, position and color data, replacing the part of the original image corresponding to the second target subarea with the adjusted image, and performing fuzzy processing on the butt joint edge of the adjusted image and the original image.
In one embodiment, the method for processing the reshaped analog information further includes the steps of:
and if the feedback opinions are information representing agreement, constructing and displaying a three-dimensional image according to the second image.
In one embodiment, the method for processing the reshaped analog information further includes the steps of:
and receiving a modification instruction, modifying the three-dimensional image according to the modification instruction, and obtaining and displaying a final image.
A shaping simulation terminal is used for acquiring a first image containing a human face and sending the first image to a shaping service terminal through a server; receiving a second image returned by the reshaping service terminal through the server, receiving a feedback opinion aiming at the second image, and sending the feedback opinion to the reshaping service terminal through the server; and the second image is obtained by adjusting the first image by the shaping service terminal according to the received modification instruction.
The shaping simulation terminal can be applied to a shaping object side, the shaping simulation terminal obtains a first image containing a human face and sends the first image to a shaping service terminal, the shaping service terminal can be arranged on a shaping doctor side, and the shaping service terminal can receive a first modification instruction after receiving the first image so as to adjust the first image and obtain and return a second image to the shaping simulation terminal; the shaping simulation terminal can receive feedback opinions of the second image and send the feedback opinions to the shaping service terminal, information interaction of the shaping image between the shaping object side and the shaping doctor side is achieved, the shaping simulation effect image is determined rapidly, the requirement of shaping is met better, a relatively close to reality and a more visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
A shaping analog information processing method comprises the following steps:
receiving a first image containing a human face; wherein, the first image is sent by the shaping analog terminal through the server;
receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to a shaping simulation terminal through a server;
receiving a feedback opinion for the second image; wherein, the feedback opinion is sent by the shaping service terminal through the server;
and if the feedback opinion is information representing agreement, saving the second image.
According to the reshaping simulation information processing method, the method can be applied to a reshaping doctor side, a first image containing a human face and sent by a reshaping simulation terminal is received, then a first modification instruction can be received, the first image is adjusted, and a second image is obtained and returned to the reshaping simulation terminal; the feedback opinions aiming at the second image can be received from the reshaping simulation terminal, when the feedback opinions represent agreed information, the second image is stored and can be used as a reshaping simulation effect image, information interaction between a reshaping object side and a reshaping doctor side on the reshaping image is achieved, the reshaping simulation effect image is determined relatively quickly, the reshaping requirement is met better, a reshaping simulation effect which is relatively close to reality and more visual can be obtained, and the preoperative reference effect of the reshaping simulation effect image is improved.
A shaping service terminal is used for receiving a first image containing a human face; receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to a shaping simulation terminal through a server; receiving a feedback opinion for the second image; if the feedback opinions are information representing agreement, storing the second image; wherein the first image and the feedback opinions are transmitted by the shaping simulation terminal through the server.
According to the reshaping service terminal, the reshaping service terminal can be applied to a reshaping doctor side, receives a first image containing a human face sent by a reshaping simulation terminal, and then can receive a first modification instruction, so that the first image is adjusted, and a second image is obtained and returned to the reshaping simulation terminal; the shaping simulation terminal sends feedback opinions aiming at the second image to the shaping service terminal, when the feedback opinions represent agreed information, the shaping service terminal stores the second image, the second image can be used as a shaping simulation effect image, information interaction between a shaping object side and a shaping doctor side on the shaping image is achieved, the shaping simulation effect image is determined relatively quickly, the requirements of shaping are met better, a relatively real and more visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
Drawings
FIG. 1 is a diagram of an application scenario of a method for shaping simulation information processing in one embodiment;
FIG. 2 is a flow diagram of a method for shaping analog information processing in one embodiment;
FIG. 3 is a flow chart of a method for processing reshaped analog information in another embodiment;
FIG. 4 is an interaction diagram of a method for shaping analog information processing according to an embodiment;
FIG. 5 is a diagram illustrating a flow chart of an exemplary implementation of a method for processing shaped analog information.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the detailed description and specific examples, while indicating the scope of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention. It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings.
It should be noted that the term "first \ second" referred to in the embodiments of the present invention only distinguishes similar objects, and does not represent a specific ordering for the objects, and it should be understood that "first \ second" may exchange a specific order or sequence when allowed. It should be understood that "first \ second" distinct objects may be interchanged under appropriate circumstances such that embodiments of the invention described herein may be practiced in sequences other than those illustrated or described herein.
The shaping simulation information processing method provided by the application can be applied to an application environment shown in fig. 1, an object to be shaped (i.e. a user) uses a shaping simulation terminal to obtain a first image containing a human face, the first image is sent to a shaping service terminal used by a shaping doctor through a server, the shaping doctor can apply a first modification instruction to the shaping service terminal to adjust the first image to obtain a second image, the second image is sent to the shaping simulation terminal, the object to be shaped can input a feedback suggestion aiming at the second image in the shaping simulation terminal, and the shaping simulation terminal can send the feedback suggestion to the shaping service terminal for the shaping doctor to refer to, so that a final shaping simulation effect image is determined. The shaping simulation terminal and the shaping service terminal can be various devices with the functions of obtaining images and processing the images, such as a personal computer, a notebook computer, a palm computer, a smart phone, a tablet computer, a portable wearable device and the like.
Fig. 2 is a schematic flow chart of a shaping simulation information processing method according to an embodiment of the present invention. The shaping analog information processing method in this embodiment includes the steps of:
step S110: acquiring a first image containing a human face, and sending the first image to a reshaping service terminal through a server;
in the step, the first image comprises a face image to be reshaped, and a communication link is arranged between the server and the reshaping service terminal;
step S120: receiving a second image returned by the reshaping service terminal through the server, wherein the second image is obtained after the reshaping service terminal adjusts the first image according to the received first modification instruction;
in the step, the reshaping service terminal is positioned at the side of a reshaping doctor, the reshaping doctor can input a first modification instruction in the reshaping service terminal according to the specialty and experience of the doctor, and adjust and modify the first image according to the first modification instruction to obtain and return a second image;
step S130: and receiving a feedback opinion aiming at the second image, and sending the feedback opinion to the shaping service terminal through the server.
In this step, the feedback opinions of the second image may be information representing agreement or other modification opinions, and if the feedback opinions are other modification opinions, the modified second image may be received again, and the final shaping simulation effect image may be determined by using the feedback opinions.
In this embodiment, the method for processing the reshaping simulation information may be applied to a side of a reshaping object, obtain a first image including a human face, send the first image to a reshaping service terminal, the reshaping service terminal may be set at a side of a reshaping doctor, and the reshaping service terminal may receive a first modification instruction after receiving the first image, so as to adjust the first image, and obtain and return a second image; one side of the reshaping object can receive the feedback suggestion of the second image and send the feedback suggestion to the reshaping service terminal, so that the information interaction of the reshaping image between the side of the reshaping object and the side of a reshaping doctor is realized, the reshaping simulation effect image is determined relatively quickly, the reshaping requirement is met better, a relatively real and more visual reshaping simulation effect can be obtained, and the preoperative reference effect of the reshaping simulation effect image is improved.
In one embodiment, the first image comprises an original image or a reshaped analog image of the object to be reshaped.
In this embodiment, the first image may be an original image of an object to be reshaped, and the original image is sent to a reshaping service terminal, so that a reshaping doctor directly modifies the original image to obtain a professional reshaping simulation effect diagram; or the shaping simulation image adjusted by the user is sent to the shaping service terminal, so that the shaping doctor can adjust the shaping simulation image, and the effect of the shaping simulation image is better.
In one embodiment, the method for processing shaped analog information further comprises the steps of:
the method comprises the steps of obtaining and displaying information of a plurality of plastic doctors, receiving a first selection instruction, selecting information of a target plastic doctor according to the first selection instruction, and establishing communication connection with a plastic service terminal through a server, wherein the information of the target plastic doctor is associated with the plastic service terminal.
In this embodiment, before sending the first image, a communication connection with a shaping service terminal needs to be established first, and since different shaping doctors have different shaping service terminals, information of a plurality of shaping doctors may be sent to a user first, information of a target shaping doctor desired by the user is selected through the first selection instruction, and a communication connection is established with the shaping service terminal corresponding to the information of the target shaping doctor, so as to meet the needs of the user.
In one embodiment, the method for processing shaped analog information further comprises the steps of:
and displaying the communication window, and performing information interaction with the shaping service terminal through the communication window.
In this embodiment, on the basis of establishing communication connection with the shaping service terminal, a communication window can be displayed, and information interaction is performed with the shaping service terminal through the communication window, so that communication with a shaping doctor is realized, and the shaping doctor can know the specific requirements of the user on shaping, so as to obtain the shaping simulation effect image more quickly.
In one embodiment, the step of acquiring a first image containing a human face comprises the steps of:
acquiring an original image of an object to be reshaped, sending the original image to a server, receiving a face feature adjustment value returned by the server, and performing analog adjustment on the original image according to the face feature adjustment value to obtain a reshaped analog image;
the method comprises the following steps that a server carries out face recognition on an original image to obtain face feature data of an object to be shaped; and performing matching analysis on the face characteristic data and a preset reshaping face characteristic database to obtain a face characteristic adjustment value.
In the embodiment, an original image of an object to be reshaped is acquired, the original image is sent to a server for face recognition to obtain face characteristic data, the face characteristic data is matched and analyzed with a preset reshaping face characteristic database to acquire a face characteristic adjustment value, and the face characteristic adjustment value is returned; and carrying out analog adjustment on the original image according to the received face characteristic adjustment value to obtain a reshaping analog image. The face feature adjustment value obtained by matching the face feature data with the data of the reshaping face feature database better meets the reshaping requirement for the simulation adjustment of the original image, can obtain a reshaping simulation effect which is relatively close to reality and is more visual, and improves the preoperative reference effect of the reshaping simulation image.
It should be noted that the original image may be obtained by shooting with a camera of the electronic device, or by scanning; the characteristics of the human face in the original image can be analyzed during human face recognition, and then human face characteristic data can be obtained; the shaping face feature database is a preset collection of face feature material data commonly used for shaping, the feature difference between the face feature data and the shaping face can be obtained through the matching analysis of the actual face feature data and the data of the shaping face feature database, a face feature adjustment value can be obtained according to the difference, the face feature adjustment value can reduce the feature difference, so that the face in the adjusted image is close to the shaping face, and the effect of shaping simulation is realized; when analog adjustment is performed according to the face feature adjustment value, the face feature data is mainly adjusted, and image deformation processing can be performed based on the face feature points.
In addition, when the server performs matching analysis on the face feature data and a preset reshaped face feature database, an image face analysis report can be generated and returned; and giving a shaping suggestion based on the face feature adjustment value in the report, performing automatic analog adjustment on the original image after receiving confirmation information modified according to the shaping suggestion, and giving a shaping suggestion report including specific shaping parts, shaping modes and shaping effect description information after finishing the automatic analog adjustment.
Further, diffusion, sharpening and deformation algorithms can be used for processing the image during analog adjustment.
Furthermore, when the original image of the object to be reshaped is obtained, a shooting area, such as a shooting area with a shape similar to the face, can be defined, and when the face of the object to be reshaped enters the shooting area, the shooting is carried out, so that the obtained original image is the required face image, thereby reducing the time for face recognition and improving the accuracy of the recognition; in addition, when an original image of the object to be shaped is obtained, the brightness during shooting is sensed, and if the brightness is smaller than a preset brightness value, a flash lamp is started or insufficient brightness is prompted; when the face recognition is carried out, the makeup on the face can be detected, the shaping simulation is carried out after the cleaning is prompted, and if the face is detected to have accessories, the removal of the accessories is prompted, such as glasses, false eyelashes, nose nails and the like.
In one embodiment, the step of obtaining an original image of the object to be reshaped comprises the steps of:
the front image and the multiple side images of the object to be reshaped are obtained.
In the embodiment, a plurality of images of the object to be reshaped can be acquired, including the front image and the side image, and the front image and the side images are images obtained from different angles, so that the influences of illumination, angles and the like can be reduced on the basis, and the face recognition is more accurate.
Specifically, in actual operation, a front image of the object to be reshaped and two side images of two side surfaces at an angle of 45 degrees may be obtained.
Further, after the front image and the side image are obtained, the server constructs a 3D original image model according to the front image and the side image, and accurate face recognition is carried out by using a 3D model algorithm.
In one embodiment, the step of obtaining the face feature data of the object to be reshaped comprises the steps of:
acquiring face region characteristic points of an object to be shaped, partitioning a face according to the face region characteristic points, and acquiring characteristic data of each partition and contour data of the face; wherein each partition comprises eyes, a nose, a mouth, a face and a chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions.
In this embodiment, after face recognition, feature points of a face region may be obtained, the feature points of different regions on the face are distributed differently, the face region may be partitioned by using the feature points of the face region, so as to obtain feature data of regions such as eyes, a nose, a mouth, a face, and a chin and contour data of the face, where the feature data includes position data of a current face region and relative position data between the current face region and other regions, so as to perform analog shaping on different regions of the face.
Specifically, the characteristic regions on the face may include forehead, eyes, eyebrows, eyelids, nose bridge, nose wings, cheeks, mouth, chin (chin), and the like, and also include face shape data such as the whole face contour, and the characteristic regions may construct different characteristic points to realize division of characteristic region parts of the face.
Furthermore, besides the face area division according to the face recognition result, point positions can be manually set for selection, for example, an area selection instruction is received, a designated area is selected on the face of the original image, the feature data of the designated area is obtained, and the flexibility of the shaping simulation is improved.
Further, the face area is partitioned, and after the feature data of the partitioned area is matched and analyzed with a preset reshaping face feature database, a partitioned area with suggested reshaping can be obtained, and a face feature adjustment value of the partitioned area is obtained.
In one embodiment, the step of performing matching analysis on the face feature data and a preset reshaped face feature database comprises the following steps:
comparing the face feature data with a face feature preset value to determine a face type, acquiring a first sub-database matched with the face type from a shaping face feature database, and searching matching data in the first sub-database according to the face feature data, wherein the similarity between the matching data and the face feature data is greater than or equal to the preset value;
the step of obtaining the face feature adjustment value further comprises the following steps:
and acquiring the ratio of the face feature data to the matching data in the reshaped face feature database, and acquiring a face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1.
In this embodiment, a face type is determined by using a preset value of face features, a first sub-database matched with the face type is selected, the similarity of the facial feature data to the data in the first sub-database may be used to determine matching data, after the similarity matching analysis is carried out on the face feature data and the reshaped face feature database, the matching data matched with the face feature data after the image analysis can be obtained in the reshaped face feature database, but different from the human face feature data after image analysis, the ratio of the data of the specific feature points of the human face feature data and the human face feature data is calculated, the ratio is used as the limit of an adjustment value, the human face feature adjustment value is set between the ratio and a numerical value 1, after the image is subjected to analog adjustment by using the human face feature adjustment value, the face feature data in the image can be approximated to the data in the face shaping database, and the simulation effect of shaping is realized.
Further, the face feature adjustment value may be dynamic data, and is dynamically adjusted between the ratio and the value 1 according to the needs of the object to be shaped.
In one embodiment, the method for processing shaped analog information further comprises the steps of:
receiving a second selection instruction, wherein the second selection instruction is used for selecting the first target partition in each partition;
the server selects a second sub-database from the shaping face feature database according to the feature data of other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; and the face feature data in the second sub-database is matched with the feature data of other partitions except the first target partition.
In this embodiment, the first target partition may be selected through the second selection instruction, and the second sub-database may be selected in the shaping face feature database according to feature data of other partitions, and since the face feature data in the second sub-database is matched with feature data of other partitions other than the first target partition, when performing matching analysis on the feature data of the first target partition and the second sub-database, the obtained feature adjustment value of the first target partition may coordinate the first target partition with other partitions, so as to improve overall harmony when performing shaping simulation on a single partition part.
It should be noted that, after receiving the second selection instruction, the second selection instruction is sent to the server to determine the first target partition, and after performing matching analysis on the feature data of the first target partition and the second sub-database, the server may return a feature adjustment value of the first target partition, and perform analog adjustment on the original image by using the feature adjustment value of the first target partition to obtain a shaped analog image.
In one embodiment, the method for processing shaped analog information further comprises the steps of:
receiving a second modification instruction, and performing characteristic data fine adjustment on the shaping simulation image according to the second modification instruction;
alternatively, the first and second electrodes may be,
and receiving a third modification instruction, wherein the third modification instruction is used for re-selecting the first target partition in each partition.
In this embodiment, after the image is subjected to analog adjustment according to the face feature adjustment value to obtain a reshaped analog image, the reshaped analog image may not meet the requirements of the object to be reshaped, and at this time, a second modification instruction may be received, and feature data fine adjustment is performed according to the second modification instruction to make the second modification instruction meet the specific requirements of the object to be reshaped; or, the shaping simulation of the current first target partition does not meet the requirement of the object to be shaped, a third modification instruction can be received, the third modification instruction is sent to the server, and a new first target partition is reselected according to the third modification instruction to carry out shaping simulation, so that the simulated shaping can be adjusted according to the requirement of the object to be shaped.
In one embodiment, the method for processing shaped analog information further comprises the steps of:
receiving a triggering instruction aiming at a second target partition, wherein the triggering instruction is used for selecting a plurality of candidate partition images in a reshaping human face feature database, and the partition type of each partition image is the same as that of the second target partition;
displaying each subarea image, and receiving a third selection instruction, wherein the third selection instruction is used for selecting a target subarea image from each subarea image;
and fusing the target subarea image to the position corresponding to the second target subarea in the original image.
In this embodiment, a second target partition may be selected and triggered, a plurality of candidate partition images of the same type as the second target partition are selected from the face feature database for reshaping, the partition images are displayed for selection of an object to be reshaped, and after the object to be reshaped selects a target partition image through a third selection instruction, the target partition images are fused into the original image, so that the object to be reshaped autonomously selects reshaping content and the effect of a reshaping simulation image is displayed.
Specifically, the second target partition may be a forehead, eyes, eyebrows, a nose, a mouth, a chin (chin), and the like, for example, an eye portion is selected as the second target partition, eye images of different shapes may be selected and displayed in the face shaping feature database for selection by the object to be shaped, and the selected new eye image is fused into the original image of the object to be shaped after the determination to form the shaping simulation image.
In one embodiment, the step of fusing the target partition image to the original image at a location corresponding to the second target partition comprises the steps of:
and acquiring the image size, position and color data of the second target subarea, adjusting the target subarea image according to the image size, position and color data, replacing the part of the original image corresponding to the second target subarea with the adjusted image, and performing fuzzy processing on the butt joint edge of the adjusted image and the original image.
In this embodiment, the second target partition is a part of the original image, and has attributes such as image size, position, color, and the like, and the target partition image is adjusted according to data such as image size, position, color, and the like, so that the target partition image can be coordinated with the original image.
It should be noted that after the fusion and the blurring processing are performed, another shaping analog image can be obtained, which is different from the shaping analog image obtained by performing analog adjustment on the original image according to the face feature adjustment value; after the fusion and the fuzzy processing are carried out, a fourth modification instruction can be received, and characteristic data fine adjustment is carried out on the obtained image according to the fourth modification instruction; or, the second target partition is selected from the partitions again according to the fifth modification instruction.
In addition, the sent first image may be a reshaped analog image obtained by performing analog adjustment according to the face feature adjustment value, or an image obtained by selecting different partitions for fusion processing.
In one embodiment, the method for processing shaped analog information further comprises the steps of:
and if the feedback opinions are information representing agreement, constructing and displaying a three-dimensional image according to the second image.
In this embodiment, if the feedback opinion indicates agreement, the second image may be used as the shaping simulation effect image, and a three-dimensional image may be constructed in this way, so that the shaping simulation effect may be displayed more intuitively and clearly from the perspective of three-dimensional stereo.
In one embodiment, the method for processing shaped analog information further comprises the steps of:
and receiving a modification instruction, modifying the three-dimensional image according to the modification instruction, and obtaining and displaying a final image.
In this embodiment, the shaping simulation effect image mainly aims at the face region, and the image of the whole head where the face is located is also related to the shaping simulation effect, and at this time, the three-dimensional image can be modified by using a modification instruction, so that the final image is more beautiful.
According to the above-mentioned shaping analog information processing method, an embodiment of the present invention further provides a shaping analog terminal, and the following describes in detail an embodiment of the shaping analog terminal of the present invention.
The shaping simulation terminal is used for acquiring a first image containing a human face and sending the first image to a shaping service terminal through a server; receiving a second image returned by the reshaping service terminal through the server, receiving a feedback opinion aiming at the second image, and sending the feedback opinion to the reshaping service terminal through the server; and the second image is obtained by adjusting the first image by the shaping service terminal according to the received modification instruction.
In this embodiment, the shaping simulation terminal may be applied to a shaping object side, the shaping simulation terminal obtains a first image including a human face, and sends the first image to the shaping service terminal, the shaping service terminal may be set at a shaping doctor side, and the shaping service terminal may receive a first modification instruction after receiving the first image, so as to adjust the first image, and obtain and return a second image to the shaping simulation terminal; the shaping simulation terminal can receive feedback opinions of the second image and send the feedback opinions to the shaping service terminal, information interaction of the shaping image between the shaping object side and the shaping doctor side is achieved, the shaping simulation effect image is determined rapidly, the requirement of shaping is met better, a relatively close to reality and a more visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
In one embodiment, the first image comprises an original image or a reshaped analog image of the object to be reshaped.
In one embodiment, the shaping simulation terminal acquires and displays information of a plurality of shaping doctors, receives a first selection instruction, selects information of a target shaping doctor according to the first selection instruction, and establishes a communication connection with the shaping service terminal through a server, wherein the information of the target shaping doctor is associated with the shaping service terminal.
In one embodiment, the shaping simulation terminal displays a communication window, and performs information interaction with the shaping service terminal through the communication window.
In one embodiment, a shaping simulation terminal acquires an original image of an object to be shaped, sends the original image to a server, receives a face characteristic adjustment value returned by the server, and performs simulation adjustment on the original image according to the face characteristic adjustment value to obtain a shaping simulation image;
the method comprises the following steps that a server carries out face recognition on an original image to obtain face feature data of an object to be shaped; and performing matching analysis on the face characteristic data and a preset reshaping face characteristic database to obtain a face characteristic adjustment value.
In one embodiment, the shaping analog terminal acquires a front image and a plurality of side images of an object to be shaped.
In one embodiment, a server acquires face region characteristic points of an object to be shaped, partitions a face according to the face region characteristic points, and acquires characteristic data of each partition and contour data of the face; wherein each partition comprises eyes, a nose, a mouth, a face and a chin, and the characteristic data comprises position data of the current partition and relative position data between the current partition and other partitions.
In one embodiment, the server compares the face feature data with a preset face feature value to determine a face type, obtains a first sub-database matched with the face type from a shaping face feature database, and searches matching data in the first sub-database according to the face feature data, wherein the similarity between the matching data and the face feature data is greater than or equal to the preset value;
the server obtains the ratio of the face feature data to the matching data, and obtains a face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1.
In one embodiment, the shaping analog terminal receives a second selection instruction, and the second selection instruction is used for selecting a first target partition in each partition;
the server selects a second sub-database from the shaping face feature database according to the feature data of other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; and the face feature data in the second sub-database is matched with the feature data of other partitions except the first target partition.
In one embodiment, the shaping simulation terminal receives a second modification instruction, and performs characteristic data fine adjustment on the shaping simulation image according to the second modification instruction;
alternatively, the first and second electrodes may be,
and the shaping analog terminal receives a third modification instruction, and the third modification instruction is used for re-selecting the first target partition in each partition.
In one embodiment, the shaping simulation terminal receives a trigger instruction for a second target partition, wherein the trigger instruction is used for selecting a plurality of candidate partition images in a shaping face feature database, and the partition type of each partition image is the same as that of the second target partition;
the shaping simulation terminal displays each subarea image and receives a third selection instruction, wherein the third selection instruction is used for selecting a target subarea image from each subarea image;
and the shaping simulation terminal fuses the target subarea image to the position of the original image corresponding to the second target subarea.
In one embodiment, the shaping simulation terminal acquires image size, position and color data of the second target partition, adjusts the target partition image according to the image size, position and color data, replaces a part corresponding to the second target partition in the original image with the adjusted image, and performs fuzzy processing on a butt joint edge of the adjusted image and the original image.
In one embodiment, the shaping simulation terminal constructs a three-dimensional image from the second image and displays the three-dimensional image when the feedback is information representing agreement.
In one embodiment, the shaping simulation terminal receives the modification instruction, modifies the three-dimensional image according to the modification instruction, and obtains and displays a final image.
The shaping analog terminal of the present invention corresponds to the shaping analog information processing method of the present invention, and the technical features and advantages thereof described in the above embodiments of the shaping analog information processing method are applicable to the embodiments of the shaping analog terminal.
According to the above-mentioned method for processing the reshaped analog information, another method for processing the reshaped analog information is provided in the embodiments of the present invention, and the following describes in detail another embodiment of the method for processing the reshaped analog information according to the present invention.
Fig. 3 is a schematic flow chart of a shaping simulation information processing method according to an embodiment of the present invention. The shaping analog information processing method in the embodiment comprises the following steps:
step S210: receiving a first image containing a human face; wherein, the first image is sent by the shaping analog terminal through the server;
step S220: receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to a shaping simulation terminal through a server;
step S230: receiving a feedback opinion aiming at the second image, and if the feedback opinion is information representing agreement, saving the second image; wherein, the feedback opinion is sent by the shaping service terminal through the server.
In this embodiment, the method for processing the reshaping simulation information may be applied to a reshaping doctor side, and receive a first image containing a human face sent by a reshaping simulation terminal, and then receive a first modification instruction, so as to adjust the first image, obtain and return a second image to the reshaping simulation terminal; the feedback opinions aiming at the second image can be received from the reshaping simulation terminal, when the feedback opinions represent agreed information, the second image is stored and can be used as a reshaping simulation effect image, information interaction between a reshaping object side and a reshaping doctor side on the reshaping image is achieved, the reshaping simulation effect image is determined relatively quickly, the reshaping requirement is met better, a reshaping simulation effect which is relatively close to reality and more visual can be obtained, and the preoperative reference effect of the reshaping simulation effect image is improved.
Further, the feedback opinions of the second image may be information representing consent or other modification opinions, and if the feedback opinions are other modification opinions, the first modification instruction may be received again to further modify the first image, and the final shaping simulation effect image may be determined by using the feedback opinions.
Further, after the shaping simulation effect image is obtained, the shaping simulation effect image can be stored locally, or the shaping simulation effect image can be sent to the shaping simulation terminal and stored in the shaping simulation terminal.
Further, when the first image is adjusted according to the first modification instruction, the sub-units in the face partition in the first image may be adjusted, for example, the face partition is an eye, and the sub-units may be an eye, an eyelid, an eyebrow, or the like; the face partition is a nose, the subunits can be nose bridges, nose heads, nose wings, columella nasi and the like, the face partition is a face, and the subunits can be cheeks, cheekbones and the like.
In one embodiment, the method for processing shaped analog information further comprises the steps of:
and displaying the communication window, and performing information interaction with the shaping simulation terminal through the communication window.
In this embodiment, on the basis of establishing communication connection with the shaping simulation terminal, a communication window can be displayed, and information interaction is performed with the shaping simulation terminal through the communication window, so that communication and communication with an object to be shaped are realized, and a shaping doctor can know the specific requirements of the object to be shaped on shaping, so as to obtain an image with a shaping simulation effect more quickly.
According to the above-mentioned shaping simulation information processing method, an embodiment of the present invention further provides a shaping service terminal, and the following describes in detail an embodiment of the shaping service terminal of the present invention.
The shaping service terminal of one embodiment of the invention is used for receiving a first image containing a human face; receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to a shaping simulation terminal through a server; receiving a feedback opinion for the second image; if the feedback opinions are information representing agreement, storing the second image; wherein the first image and the feedback opinions are transmitted by the shaping simulation terminal through the server.
In this embodiment, the reshaping service terminal may be applied to a reshaping doctor side, and the reshaping service terminal receives a first image containing a human face sent by the reshaping analog terminal, and then may receive a first modification instruction, so as to adjust the first image, and obtain and return a second image to the reshaping analog terminal; the shaping simulation terminal sends feedback opinions aiming at the second image to the shaping service terminal, when the feedback opinions represent agreed information, the shaping service terminal stores the second image, the second image can be used as a shaping simulation effect image, information interaction between a shaping object side and a shaping doctor side on the shaping image is achieved, the shaping simulation effect image is determined relatively quickly, the requirements of shaping are met better, a relatively real and more visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
In one embodiment, the shaping service terminal displays a communication window, and performs information interaction with the shaping simulation terminal through the communication window.
The shaping service terminal of the present invention corresponds to the shaping simulation information processing method, and the technical features and the advantageous effects thereof described in the embodiment of the shaping simulation information processing method are applicable to the embodiment of the shaping service terminal.
A readable storage medium, on which an executable program is stored, which when executed by a processor implements the steps of the above-described method of shaping analog information processing.
According to the readable storage medium, the information interaction of the reshaping image between the reshaping object side and the reshaping doctor side can be realized through the stored executable program, the reshaping simulation effect image can be determined relatively quickly, the reshaping requirement can be met better, a reshaping simulation effect which is relatively close to reality and more visual can be obtained, and the preoperative reference effect of the reshaping simulation effect image can be improved.
A shaping simulation device comprises a shaping simulation terminal and a shaping service terminal, wherein the shaping simulation terminal acquires a first image containing a human face and sends the first image to the shaping service terminal through a server; the shaping service terminal receives the first modification instruction, adjusts the first image according to the first modification instruction to obtain a second image, and sends the second image to the shaping simulation terminal through the server; the shaping simulation terminal receives a feedback opinion aiming at the second image and sends the feedback opinion to the shaping service terminal through the server; and the shaping service terminal obtains and stores the shaping simulation effect image according to the feedback opinion.
According to the shaping simulation equipment, through information interaction between the shaping simulation terminal and the shaping service terminal, information interaction between a shaping object side and a shaping doctor side on a shaping image can be achieved, a shaping simulation effect image is determined relatively quickly, the requirement of shaping is met more, a relatively near-real and more visual shaping simulation effect can be obtained, and the preoperative reference effect of the shaping simulation effect image is improved.
In one embodiment, the shaping simulation device further comprises a server.
It will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, and the program may be stored in a non-volatile computer readable storage medium, for example, in the embodiments, the program may be stored in a storage medium of a computer system and executed by at least one processor in the computer system, so as to implement the processes of the embodiments including the method of shaping analog information processing as described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Specifically, the method for processing the reshaping simulation information can be applied to a reshaping simulation terminal at a user side and a reshaping service terminal at a reshaping doctor side, the reshaping simulation terminal sends the reshaping simulation image to the reshaping service terminal, the reshaping simulation image is invited to be adjusted by the reshaping doctor and modification opinions are given, the reshaping service terminal returns modification opinion data, and an interaction schematic diagram is shown in fig. 4.
Furthermore, the original image of the object to be shaped can be directly sent to the shaping server through the server, the modification opinion data returned by the shaping server is received, and the processing information of the modification opinion data is fed back.
In one embodiment, the reshaping analog terminal and the reshaping service terminal may be a personal computer, a notebook computer, a palm computer, a smart phone, a tablet computer, a portable wearable device, and the like.
A flow chart of the shaping simulation information processing method is shown in fig. 5. Specifically, a user can scan or shoot a face through electronic equipment such as a mobile phone, a tablet personal computer and a camera, upload three face images (front face and two side faces (45 degrees)) of different faces and establish a 3D original image model. Then, face recognition is carried out on an original image model of a user, each part of the face is partitioned into partitions such as a forehead, an eye (a single eye including eyes and eyebrows), a nose (a nose and a nose wing), a lower jaw, a face (two cheeks) and the like (the partition of the part is selected by manually setting point positions by the user), facial features of the user are analyzed through a face data calculation algorithm and compared with a preset standard value to obtain a face analysis report, the user can carry out automatic shaping simulation according to suggestions in the analysis report, a shaping suggestion report is obtained after the face analysis is completed, and the image and the report formed through simulation can be stored by the user to serve as certain shaping reference. Simultaneously, a user can analyze and replace a single face part into various part images in a reshaping face database so as to obtain a reshaping simulation image, can obtain adjustment data after analysis to adjust the face image of the user so as to obtain a reshaping simulation image, can also replace the part image, can select the part independently by the user, selects part images of the same type from the reshaping face database for the user to select, fuses the selected part images into the face image of the user after the user determines the required part images, performs simulation processing on the butt joint position so as to obtain another reshaping simulation image, if the effect of reshaping simulation is not satisfactory, the user can perform image processing on the single part by using a fine adjustment function, or reselects the part for reshaping simulation, and finally performs corresponding reshaping simulation processing on the original image by recalculating and mixing the standard value designed by the system, the final shaping simulation image is obtained, the user can send the simulation effect image to an online shaping doctor for point-to-point consultation through an online consultation service module (namely a data interaction module), and the online shaping doctor can perform fine adjustment or match each part again on the basis of the simulation image, so that the optimal shaping simulation image is obtained; the method comprises the steps that a plastic doctor provides plastic suggestions on line, and analog data of a client can be modified, so that plastic analog images which are felt by two parties are obtained, then the user can store the analog images and can print the 3D analog images, the images can be stored in a database of a plastic service end of the doctor, and when the next user line finds out a doctor for a face diagnosis, the doctor can call the data as a face diagnosis basis, so that the communication time of the two parties is shortened; the method has the advantages that a plastic doctor can be used as a reference for implementing plastic surgery, a client can also share friends through instant messaging software such as WeChat and QQ through a sharing function, compared with the traditional plastic simulation technology, fuzzy image processing can be simply carried out, medical and cosmetic professional technologies cannot be integrated, the operation time of a user is shortened, the efficiency and the specialty of the plastic simulation are improved, and particularly, when the method is applied to a client face-examination link after the medical and cosmetic surgery, the user can obtain postoperative effect simulation images in advance more intuitively.
In addition, the scheme of the embodiment of the invention can also be provided with a mechanism service terminal of a third party such as a hospital, the configuration requirement information of the plastic surgery can be sent to the mechanism service terminal after a plastic doctor obtains a final plastic simulation image, and the specific plastic travel information is respectively sent to the plastic simulation terminal of the object to be shaped and the plastic service terminal of the plastic doctor after a staff of the third party such as the hospital allocates the arrangement content of the plastic surgery, so that the plastic surgery can be smoothly arranged.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
Those skilled in the art will appreciate that all or part of the steps in the method for implementing the above embodiments may be implemented by a program instructing the relevant hardware. The program may be stored in a computer-readable storage medium. Which when executed comprises the steps of the method described above. The storage medium includes: ROM/RAM, magnetic disk, optical disk, etc.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (17)

1. A method for processing reshaping analog information, comprising the steps of:
acquiring a first image containing a human face, and sending the first image to a reshaping service terminal through a server;
receiving a second image returned by the reshaping service terminal through the server, wherein the second image is obtained after the reshaping service terminal adjusts the first image according to a received first modification instruction;
and receiving a feedback opinion aiming at the second image, and sending the feedback opinion to the shaping service terminal through the server.
2. The reshaping analog information processing method of claim 1, wherein the first image comprises an original image or a reshaping analog image of an object to be reshaped.
3. The method of shaping analog information processing according to claim 2, further comprising the steps of:
the method comprises the steps of obtaining and displaying information of a plurality of plastic doctors, receiving a first selection instruction, selecting information of a target plastic doctor according to the first selection instruction, and establishing communication connection with the plastic service terminal through the server, wherein the information of the target plastic doctor is associated with the plastic service terminal.
4. The method of claim 3, further comprising the steps of:
and displaying a communication window, and performing information interaction with the shaping service terminal through the communication window.
5. The reshaping analog information processing method of claim 2, wherein the step of obtaining the first image including a human face comprises the steps of:
acquiring an original image of an object to be reshaped, sending the original image to the server, receiving a face feature adjustment value returned by the server, and performing analog adjustment on the original image according to the face feature adjustment value to obtain a reshaped analog image;
the server carries out face recognition on the original image to acquire face feature data of the object to be reshaped; and matching and analyzing the face feature data and a preset reshaping face feature database to obtain a face feature adjustment value.
6. The reshaping analog information processing method of claim 5, wherein the step of obtaining an original image of an object to be reshaped comprises the steps of:
and acquiring a front image and a plurality of side images of the object to be shaped.
7. The reshaping simulation information processing method according to claim 5, wherein the step of obtaining the face feature data of the object to be reshaped comprises the steps of:
acquiring the face region characteristic points of the object to be shaped, partitioning the face according to the face region characteristic points, and acquiring characteristic data of each partition and contour data of the face; wherein each of the sections includes an eye, a nose, a mouth, a face, and a chin, and the feature data includes position data of the current section and relative position data between the current section and the other sections.
8. The reshaping simulation information processing method of claim 5, wherein the step of performing matching analysis on the face feature data and a preset reshaping face feature database comprises the steps of:
comparing the face feature data with a preset face feature value to determine a face type, acquiring a first sub-database matched with the face type from the reshaping face feature database, and searching matched data from the first sub-database according to the face feature data, wherein the similarity between the matched data and the face feature data is greater than or equal to a preset value;
the step of obtaining the face feature adjustment value further comprises the following steps:
and acquiring a ratio of the face feature data to the matching data, and acquiring the face feature adjustment value according to the ratio, wherein the face feature adjustment value is between the ratio and a value 1.
9. The method of shaping analog information processing according to claim 7, further comprising the steps of:
receiving a second selection instruction, wherein the second selection instruction is used for selecting a first target partition from the partitions;
the server selects a second sub-database from the shaping face feature database according to the feature data of other partitions except the first target partition, and performs matching analysis on the feature data of the first target partition and the second sub-database; and the face feature data in the second sub-database is matched with the feature data of other partitions except the first target partition.
10. The method of shaping analog information processing according to claim 9, further comprising the steps of:
receiving a second modification instruction, and finely adjusting the feature data of the reshaped analog image according to the second modification instruction;
alternatively, the first and second electrodes may be,
and receiving a third modification instruction, wherein the third modification instruction is used for re-selecting the first target partition in each partition.
11. The method of shaping analog information processing according to claim 7, further comprising the steps of:
receiving a trigger instruction aiming at a second target partition, wherein the trigger instruction is used for selecting a plurality of candidate partition images in the reshaped human face feature database, and the partition type of each partition image is the same as that of the second target partition;
displaying each subarea image, and receiving a third selecting instruction, wherein the third selecting instruction is used for selecting a target subarea image from each subarea image;
and fusing the target subarea image to the position corresponding to the second target subarea in the original image.
12. The reshaping simulation information processing method according to claim 11, wherein the step of fusing the target partition image to a position in the original image corresponding to the second target partition comprises the steps of:
acquiring the image size, the position and the color data of the second target subarea, adjusting the target subarea image according to the image size, the position and the color data, replacing the part, corresponding to the second target subarea, in the original image with the adjusted image, and performing fuzzy processing on the joint edge of the adjusted image and the original image.
13. The method of any of claims 1 to 12, further comprising the steps of:
and if the feedback opinions are information representing agreement, constructing and displaying a three-dimensional image according to the second image.
14. The method of claim 13, further comprising the steps of:
and receiving a modification instruction, and modifying the three-dimensional image according to the modification instruction to obtain a final image and display the final image.
15. A shaping simulation terminal is characterized in that the shaping simulation terminal is used for acquiring a first image containing a human face and sending the first image to a shaping service terminal through a server; receiving a second image returned by the reshaping service terminal through the server, receiving a feedback opinion aiming at the second image, and sending the feedback opinion to the reshaping service terminal through the server; and the second image is obtained by adjusting the first image by the shaping service terminal according to the received modification instruction.
16. A method for processing reshaping analog information, comprising the steps of:
receiving a first image containing a human face; wherein, the first image is sent by a shaping analog terminal through a server;
receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to the shaping simulation terminal through the server;
receiving a feedback opinion with respect to the second image; wherein the feedback opinions are sent by the shaping service terminal through the server;
and if the feedback opinions are information representing agreement, storing the second image.
17. A reshaping service terminal, wherein the reshaping service terminal is configured to receive a first image comprising a human face; receiving a first modification instruction, adjusting the first image according to the first modification instruction to obtain a second image, and sending the second image to the shaping simulation terminal through the server; receiving a feedback opinion with respect to the second image; if the feedback opinions are information representing agreement, the second image is stored; wherein the first image and the feedback opinions are transmitted by a shaping analog terminal through a server.
CN201811581508.XA 2018-12-24 2018-12-24 Shaping simulation information processing method, shaping simulation terminal and shaping service terminal Active CN111354478B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201811581508.XA CN111354478B (en) 2018-12-24 Shaping simulation information processing method, shaping simulation terminal and shaping service terminal
PCT/CN2019/127252 WO2020135287A1 (en) 2018-12-24 2019-12-22 Plastic surgery simulation information processing method, plastic surgery simulation terminal and plastic surgery service terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811581508.XA CN111354478B (en) 2018-12-24 Shaping simulation information processing method, shaping simulation terminal and shaping service terminal

Publications (2)

Publication Number Publication Date
CN111354478A true CN111354478A (en) 2020-06-30
CN111354478B CN111354478B (en) 2024-07-12

Family

ID=

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024040954A1 (en) * 2022-08-24 2024-02-29 北京京东乾石科技有限公司 Point cloud semantic segmentation network training method, and point cloud semantic segmentation method and apparatus

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020064302A1 (en) * 2000-04-10 2002-05-30 Massengill R. Kemp Virtual cosmetic autosurgery via telemedicine
US20120299945A1 (en) * 2006-05-05 2012-11-29 Parham Aarabi Method, system and computer program product for automatic and semi-automatic modificatoin of digital images of faces
US20150272691A1 (en) * 2014-03-31 2015-10-01 Tricubics Inc. Method and apparatus for providing virtual plastic surgery sns service
CN106934073A (en) * 2017-05-02 2017-07-07 成都通甲优博科技有限责任公司 Face comparison system, method and mobile terminal based on three-dimensional image
CN107123160A (en) * 2017-05-02 2017-09-01 成都通甲优博科技有限责任公司 Simulation lift face system, method and mobile terminal based on three-dimensional image
CN107122727A (en) * 2017-04-20 2017-09-01 北京旷视科技有限公司 Method, apparatus and system for face's shaping
CN107578465A (en) * 2017-07-27 2018-01-12 深圳先进技术研究院 A kind of method and system of simulation shows human body shaping effect

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020064302A1 (en) * 2000-04-10 2002-05-30 Massengill R. Kemp Virtual cosmetic autosurgery via telemedicine
US20120299945A1 (en) * 2006-05-05 2012-11-29 Parham Aarabi Method, system and computer program product for automatic and semi-automatic modificatoin of digital images of faces
US20150272691A1 (en) * 2014-03-31 2015-10-01 Tricubics Inc. Method and apparatus for providing virtual plastic surgery sns service
CN107122727A (en) * 2017-04-20 2017-09-01 北京旷视科技有限公司 Method, apparatus and system for face's shaping
CN106934073A (en) * 2017-05-02 2017-07-07 成都通甲优博科技有限责任公司 Face comparison system, method and mobile terminal based on three-dimensional image
CN107123160A (en) * 2017-05-02 2017-09-01 成都通甲优博科技有限责任公司 Simulation lift face system, method and mobile terminal based on three-dimensional image
CN107578465A (en) * 2017-07-27 2018-01-12 深圳先进技术研究院 A kind of method and system of simulation shows human body shaping effect

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024040954A1 (en) * 2022-08-24 2024-02-29 北京京东乾石科技有限公司 Point cloud semantic segmentation network training method, and point cloud semantic segmentation method and apparatus

Also Published As

Publication number Publication date
WO2020135287A1 (en) 2020-07-02

Similar Documents

Publication Publication Date Title
RU2668408C2 (en) Devices, systems and methods of virtualising mirror
US10607372B2 (en) Cosmetic information providing system, cosmetic information providing apparatus, cosmetic information providing method, and program
KR101733512B1 (en) Virtual experience system based on facial feature and method therefore
US20170169501A1 (en) Method and system for evaluating fitness between wearer and eyeglasses
US10911695B2 (en) Information processing apparatus, information processing method, and computer program product
KR102455966B1 (en) Mediating Apparatus, Method and Computer Readable Recording Medium Thereof
JP2009064423A (en) Makeup simulation system, makeup simulation device, makeup simulation method, and makeup simulation program
US11776187B2 (en) Digital makeup artist
CN110866139A (en) Cosmetic treatment method, device and equipment
KR102325829B1 (en) Recommendation method for face-wearing products and device therefor
WO2022257766A1 (en) Image processing method and apparatus, device, and medium
KR101827998B1 (en) Virtual experience system based on facial feature and method therefore
KR20210017287A (en) System and method for recommending color of cosmetic product by sharing information with influencer
CN111353931B (en) Shaping simulation method, system, readable storage medium and apparatus
US11812183B2 (en) Information processing device and program
KR102330833B1 (en) cosmetic curation service method
CN111354478B (en) Shaping simulation information processing method, shaping simulation terminal and shaping service terminal
CN111354478A (en) Shaping simulation information processing method, shaping simulation terminal and shaping service terminal
CN113076778A (en) Method, system, readable storage medium and apparatus for reshaping analog image
KR101507410B1 (en) Live make-up photograpy method and apparatus of mobile terminal
CN110750154A (en) Display control method, system, device, equipment and storage medium
CN114333018A (en) Shaping information recommendation method and device and electronic equipment
JP2024500224A (en) Method and apparatus for hair styling analysis
CN113076779A (en) Shaping simulation matching method, shaping simulation matching system, readable storage medium and device
CN111444979A (en) Face-lifting scheme recommendation method, cloud device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant