KR102486197B1 - 3d face scanning method, apparatus and system - Google Patents

Abstract

According to an embodiment, a 3D face scanning apparatus acquires first scan data which is acquired by scanning a user face in a 3D manner at the time before a procedure, generates a first face model using the first scan data, acquires second scan data which is obtained by scanning the user face in the 3D manner at the time after the procedure, generates a second face model using the second scan data, compares the first face model and the second face model, based on the comparison result, generates a change value in the user face according to the procedure, compares the facial change value with a preset target value, when the facial change value reaches the target value, transmits a face scan image including the first face model and the second face model and the facial change value to a user terminal of a user, when the facial change value does not reach the target value, extracts a region in which the facial change value did not reach the target value, and transmits the face scan image, the facial change value, and an additional treatment proposal message suggesting additional treatment for the extracted region to the user terminal. The present invention can provide the face scan image to the user by applying color to a face region according to the facial change value.

Description

3D face scanning method, apparatus and system {3D FACE SCANNING METHOD, APPARATUS AND SYSTEM}

The embodiments below relate to a technique for providing a 3D face scanning method.

As the number of people taking care of their appearance increases, the number of people undergoing cosmetic procedures is also increasing. The existing method of providing beauty care results to customers to compare before and after the procedure is a method of comparing before and after by drawing the shape of the customer's face using a plaster mold, and the plaster mold method was universally used. However, in the existing method, various problems such as deformation of gypsum over time, low reliability due to manual work, and the need to work directly on the human body have occurred.

Therefore, it is required to develop a technology for a three-dimensional face scan method capable of providing cosmetic results within a short period of time while enabling precise measurement.

Republic of Korea Patent Publication No. 10-2021-0156796 (published on December 27, 2021) Republic of Korea Patent Registration No. 10-1930851 (2018.12.19 announcement) Republic of Korea Patent Registration No. 10-1510312 (2015.04.10 announcement) Republic of Korea Patent Registration No. 10-2434038 (Announced on August 19, 2022)

Embodiments are intended to provide a 3D face scanning method.

In the embodiments, the user's face before and after the procedure is scanned in 3D, and a face model is created to generate a change value of the user's face.

Embodiments attempt to provide a user with a face scan image by applying color to a face part according to a face change value according to a procedure.

According to one embodiment, a method performed by an apparatus includes: obtaining first scan data obtained by scanning a user's face in three dimensions at a point before a procedure; generating a first face model using the first scan data; obtaining second scan data obtained by scanning the user's face in 3D at the point of view after the procedure; generating a second face model using the second scan data; comparing the first face model and the second face model; based on the comparison result, generating a face change value of the user according to the procedure; comparing the face change value with a preset target value; transmitting a face scan image including the first face model and the second face model and the face change value to a user terminal of the user when the face change value reaches the target value; extracting a region where the face change value does not reach the target value when the face change value does not reach the target value; and transmitting an additional treatment suggestion message suggesting an additional treatment for the face scan image, the face change value, and the extracted region to the user terminal.

The step of generating the user's face change value includes extracting a front image and a side image of the user's face from the face scan image, including the forehead, philtrum, left eye tip, and right eye tip of the front image. Creating a frontal reference point and calculating a frontal surface distance between the frontal reference points from the frontal image, comparing the frontal surface distance at a time point before and after the procedure to generate a front face change value, Creating side surface reference points including the tip of the forehead, the tip of the lower chin, the cheekbones, and the tips of both chins of the side image, and calculating the lateral surface distance between the side reference points from the side image, before the procedure and after the procedure Comparing the lateral surface distance at the viewpoint to generate a lateral facial change value, separating the face region based on the lateral reference point, calculating the area of the separated region, the time before the procedure and the above generating a face area change value by comparing areas at a point in time after the procedure; and generating a face change value of the user by combining the front face change value, the side face change value, and the face area change value. can include

Transmitting the face scan image and the face change value to the user terminal may include comparing the face change value with a preset first reference value, and a region having a face change value equal to or greater than the first reference value has the best effect. Determining the face change value as the part, displaying the face change value of the best effect part in the face scan image, and applying a first color to the best effect part, if the face change value is less than the first reference value, the Comparing a face change value with a preset second reference value, determining a region having a face change value equal to or greater than the second reference value as a basic effect region, and determining a face change value of the basic effect region in the face scan image. displaying and applying a second color to the basic effect part, determining a part where the face change value is less than the second reference value as an ineffective part, and the face change value of the non-effect part in the face scan image. displaying and applying a third color to the ineffective part, and face change values according to the determination of the best effect part, the basic effect part, and the ineffective part, and the first color to the third color and transmitting the applied face scan image to the user terminal.

In the method performed by the device, further comprising determining whether an additional treatment is required for the ineffective region, wherein the step of determining whether an additional treatment is required for the ineffective region comprises symmetrical treatment of the ineffective region. Calculating the degree, comparing the degree of symmetry of the ineffective part with a preset reference degree, determining that additional treatment of the ineffective part is not required when the degree of symmetry of the ineffective part is equal to or greater than the reference degree Step of applying a first brightness to an ineffective part of the face scan image determined not to require additional treatment, and transmitting the face scan image to which the first brightness is applied to the user terminal; If the degree of symmetry is less than the reference degree, determining that the ineffective part requires additional treatment, and applying a second brightness to the ineffective part determined to require the additional treatment in the face scan image, 2 may include transmitting the face scan image to which the brightness is applied to the user terminal.

A method performed by the device, comprising: calculating a difference value between a face change value and a target value for an ineffective portion where the face change value does not reach the target value; setting an additional treatment intensity of the ineffective part in proportion to the difference value; The method may further include transmitting an additional treatment guide message including the non-effective region and the additional treatment intensity to the user terminal.

In the method performed by the device, collecting the face change value for a specific face part during a preset reference period, and extracting the number of times set as the best effective part and the non-effective part for the specific face part. ; Calculating a first value by applying a first weight to the number of times set as the most effective part; calculating a second value by applying a second weight greater than the first weight to the number of times set as the ineffective portion; and calculating a management index of the specific facial part by summing the first numerical value and the second numerical value.

In the step of transmitting the face scan image corresponding to the ineffective part information to the user terminal, based on the management index, the ratio of the face scan image for the specific face part to the size to be displayed on the screen of the user terminal. generating; and transmitting the face scan image to which the generated ratio is applied to the user terminal.

An apparatus according to an embodiment may be combined with hardware and controlled by a computer program stored in a medium to execute any one of the methods described above.

Embodiments may provide a 3D face scanning method.

Embodiments may scan the user's face before and after the procedure in 3D, and create a face model to generate the change value of the user's face.

In the embodiments, a face scan image may be provided to a user by applying color to a face part according to a face change value according to a procedure.

1 is a diagram for explaining the configuration of a system according to an embodiment.
2 is a flowchart illustrating a process of 3D face scanning according to an embodiment.
3 is a flowchart illustrating a process of generating a change value of a user's face according to an exemplary embodiment.
4 is a flowchart illustrating a process of transmitting a face scan image and a face change value to a user terminal according to an exemplary embodiment.
5 is a flowchart illustrating a process of determining whether an additional treatment is required for an ineffective area according to an embodiment.
6 is a flowchart illustrating a process of setting an additional treatment intensity according to an embodiment.
7 is a flowchart illustrating a process of generating a ratio to a size to be displayed on a screen of a user terminal based on a management index according to an embodiment.
8 is an exemplary diagram of a configuration of a device according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, since various changes can be made to the embodiments, the scope of the patent application is not limited or limited by these embodiments. It should be understood that all changes, equivalents or substitutes to the embodiments are included within the scope of rights.

Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only, and may be modified and implemented in various forms. Therefore, the embodiments are not limited to the specific disclosed form, and the scope of the present specification includes changes, equivalents, or substitutes included in the technical spirit.

Although terms such as first or second may be used to describe various components, such terms should only be construed for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element.

It should be understood that when an element is referred to as being “connected” to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle.

Terms used in the examples are used only for descriptive purposes and should not be construed as limiting. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the embodiment belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present application, they should not be interpreted in an ideal or excessively formal meaning. don't

In addition, in the description with reference to the accompanying drawings, the same reference numerals are given to the same components regardless of reference numerals, and overlapping descriptions thereof will be omitted. In describing the embodiment, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the embodiment, the detailed description will be omitted.

The embodiments may be implemented in various types of products such as personal computers, laptop computers, tablet computers, smart phones, televisions, smart home appliances, intelligent vehicles, kiosks, and wearable devices.

1 is a diagram for explaining the configuration of a system according to an embodiment.

A system according to an embodiment may include a user terminal 10 and a device 30 capable of communicating with each other through a communication network.

First, a communication network may be configured regardless of its communication mode, such as wired or wireless, and may be implemented in various forms so that communication between servers and communication between servers and terminals is performed.

The user terminal 10 may be a terminal used by a user whose face is to be scanned according to the present invention. The user terminal 10 may be a desktop computer, a laptop computer, a tablet, a smart phone, or the like. For example, as shown in FIG. 1 , the user terminal 10 may be a smart phone, and may be employed differently depending on embodiments.

The user terminal 10 may be configured to perform all or part of an arithmetic function, a storage/reference function, an input/output function, and a control function of a typical computer. The user terminal 10 may be configured to communicate with the device 30 by wire or wireless.

The user terminal 10 uses the device 30 to access a web page operated by a service provider or organization, or an application developed and distributed by a service provider or organization using the device 30 can be installed The user terminal 10 may interwork with the device 30 through a web page or application.

The user terminal 10 may access the device 30 through a web page or application provided by the device 30 .

Singular expressions in the claims may be understood to include the plural. For example, a user in a claim may refer to one user or more than one user.

The device 30 may be a server owned by a person or organization that provides services using the device 30, may be a cloud server, or may be a peer-to-peer (p2p) set of distributed nodes. may be The device 30 may be configured to perform all or part of an arithmetic function, a storage/reference function, an input/output function, and a control function of a typical computer.

The device 30 may be configured to communicate with the user terminal 10 by wire or wirelessly, control the operation of the user terminal 10, and control which information is to be displayed on the screen of the user terminal 10. .

Meanwhile, for convenience of description, only the user terminal 10 is illustrated in FIG. 1 , but the number of terminals may vary according to embodiments. As long as the processing capacity of the device 30 permits, the number of terminals is not particularly limited.

According to one embodiment, a database may be provided in the device 30, but is not limited thereto, and the database may be configured separately from the device 30. Apparatus 30 may include a number of artificial neural networks for performing machine learning algorithms.

2 is a flowchart illustrating a process of 3D face scanning according to an embodiment.

Referring to FIG. 2 , first, in step S201, the device 30 may obtain first scan data obtained by scanning the user's face in 3D before the procedure.

The device 30 may scan the user's face in 3D before the procedure using at least one camera. In this case, when the user's face is photographed using a plurality of cameras, the device 30 scans the user's face from various angles, thereby shortening the time required to scan the user's face.

In this case, the first scan data may include an image of the user's face taken before the procedure, a reference point of the face, a length between the reference points, and a color of the face.

In this case, face images of the user's face photographed from different directions may be obtained by changing the location of the camera while the user's face is fixed, or by changing the direction of the user's face while the camera is fixed. .

In step S202, the device 30 may generate a first face model using the first scan data.

The apparatus 30 may match an image of the user's face taken at a point before the procedure from the first scan data, and image the matched image.

According to an embodiment, the apparatus 30 may extract reference points and match the extracted reference points to generate a first face model that is a 3D face model of the user before the procedure. In this case, the reference points may include a frontal reference point including the forehead, the middle of the philtrum, the tips of the left and right eyes, and the side reference points including the tip of the forehead, the tip of the lower chin, the cheekbones, and the tips of both chins.

In this case, the image processing may include a process of correcting the color of the user's face and a process of modifying the 3D face model with respect to the extracted reference points.

In step S203, the device 30 may acquire second scan data obtained by scanning the user's face in 3D at the point of view after the procedure.

The device 30 may scan the user's face in 3D at the point of view after the procedure using at least one camera. In this case, when the user's face is photographed using a plurality of cameras, the device 30 scans the user's face from various angles, thereby shortening the time required to scan the user's face.

In this case, the second scan data may include an image of the user's face taken at the point of view after the procedure, a reference point of the face, a length between the reference points, and a color of the face.

In this case, face images of the user's face photographed from different directions may be obtained by changing the location of the camera while the user's face is fixed, or by changing the direction of the user's face while the camera is fixed. .

In step S204, the device 30 may generate a second face model using the second scan data.

The device 30 may match an image of the user's face captured at the postoperative point of view from the second scan data, and image the matched image. In this case, the image processing may include a process of correcting the color of the user's face and a process of modifying the 3D face model with respect to the extracted reference points.

According to one embodiment, the device 30 may extract reference points and match the extracted reference points to generate a second face model, which is a 3D face model of the user at the point of view after the procedure. In this case, the reference points may include a frontal reference point including the forehead, the middle of the philtrum, the tips of the left and right eyes, and the side reference points including the tip of the forehead, the tip of the lower chin, the cheekbones, and the tips of both chins.

In step S205, the device 30 may compare the first face model and the second face model.

In step S206, the device 30 may generate a change value of the user's face according to the procedure based on the comparison result. At this time, a detailed description of the process of generating the user's face change value will be described later with reference to FIG. 3 .

In step S207, the device 30 may compare the face change value with a preset target value. In this case, the preset target value may be set differently according to embodiments.

In step S208, when the face change value reaches the target value, the device 30 may transmit the face scan image and the face change value to the user terminal 10 of the user. In this case, the face scan image may include a first face model and a second face model.

In step S209, if the face change value does not reach the target value, the device 30 may extract a part where the face change value does not reach the target value.

In step S210 , the device 30 may transmit an additional treatment suggestion message suggesting an additional treatment for the facial scan image, the face change value, and the extracted part to the user terminal 10 .

3 is a flowchart illustrating a process of generating a change value of a user's face according to an exemplary embodiment.

Referring to FIG. 3 , in step S301 , the device 30 may extract a front image and a side image of the user's face from the face scan image.

In this case, the front image and side image of the user's face may include a front image before the procedure, a side image before the procedure, a front image after the procedure, and a side image after the procedure.

In step S302, the device 30 may generate a front reference point of the front image, and calculate a front surface distance between the front reference points from the front image. In this case, the front reference point may include the middle of the forehead, the philtrum, the tip of the left eye, and the tip of the right eye.

For example, the device 30 may calculate the front surface distance including the surface distance between the tips of the left eye and the tip of the right eye before and after the procedure, the surface distance between the eyebrows and the philtrum, and the like.

In step S303, the device 30 may generate a frontal face change value by comparing the frontal surface distance at the time point before and after the procedure.

For example, the device 30 compares the surface distance between the tips of the left eye and the tip of the right eye before the procedure and the surface distance between the tips of the left eye and the right eye at the time point after the procedure, and at the time before the procedure A front face change value may be generated by calculating the difference between the surface distance between the ends of the left eye and the tip of the right eye and the surface distance between the tips of the left eye and the right eye at the time point after the procedure.

For example, the device 30 compares the surface distance between the eyebrows and the philtrum before the procedure with the surface distance between the eyebrows and the philtrum after the procedure, and compares the surface distance between the eyebrows and the philtrum before the procedure. A frontal face change value may be generated by calculating a difference value of the surface distance between the forehead and the philtrum at the point of time and after the procedure.

In step S304, the device 30 may generate side reference points of the side image, and calculate a side surface distance between the side reference points from the side image. In this case, the side reference point may include the tip of the forehead, the tip of the lower chin, the cheekbones, and the tips of both chins.

For example, the device 30 may include a surface distance between the tips of both chins before and after the procedure, a surface distance between the tip of the forehead and the tip of the lower jaw, a surface distance between the cheekbones and the tip of the forehead, and the like. distance can be calculated.

In step S305, the device 30 may generate a lateral face change value by comparing distances of the lateral surface at a time point before and after the procedure.

For example, the device 30 compares the surface distance between the jaw tips before the procedure and the surface distance between the jaw tips after the procedure, and compares the surface distance between the jaw tips before the procedure. The lateral face change value can be generated by calculating the difference between the distance and the surface distance between the tips of both chins at the time point after the procedure.

For example, the device 30 compares the surface distance between the tip of the forehead and the tip of the lower jaw before the procedure and the surface distance between the tip of the forehead and the tip of the lower jaw at the point after the procedure, and compares the surface distance between the tip of the forehead and the tip of the lower jaw before the procedure. A side face change value may be generated by calculating a difference value between the surface distance between the tip of the forehead and the tip of the lower jaw and the surface distance between the tip of the forehead and the tip of the lower jaw at the time point after the procedure.

For example, the device 30 compares the surface distance between the cheekbones and the tip of the forehead before the procedure and the surface distance between the cheekbones and the tip of the forehead after the procedure, and compares the surface distance between the cheekbones and the tip of the forehead before the procedure. A lateral face change value may be generated by calculating a difference between the surface distance of and the surface distance between the cheekbones and the tip of the forehead at the time point after the procedure.

In step S306, the device 30 may separate face regions based on the side reference points.

According to one embodiment, the device 30 may separate facial regions by drawing parallel lines based on side reference points of the tip of the forehead, the tip of the lower chin, the cheekbones, and the tips of both chins.

The device 30 may divide the face region into regions from the forehead to the cheekbones, from the cheekbones to both chin tips, and from both chin tips to the lower chin.

In step S307, the device 30 may calculate the area of the separated region.

According to an embodiment, the device 30 may calculate the area of each of the separated regions from the forehead to the cheekbones, from the cheekbones to both chin tips, and from both chin tips to the lower chin tip.

In step S308, the device 30 may generate a face area change value by comparing the areas at the time points before and after the procedure.

In step S309, the device 30 may generate the user's face change value by combining the front face change value, the side face change value, and the face area change value.

4 is a flowchart illustrating a process of transmitting a face scan image and a face change value to a user terminal according to an exemplary embodiment.

Referring to FIG. 4 , first, in step S401, the device 30 may compare a face change value with a preset first reference value. In this case, the first reference value may be set differently according to embodiments.

In step S402, the device 30 may determine a region having a facial change value greater than or equal to a first reference value as the most effective region.

In step S403, the device 30 may display the face change value of the best effect part in the face scan image, and apply a first color to the best effect part.

For example, the device 30 may apply a red color to the most effective region in the face scan image.

In step S404, when the face change value is less than the first reference value, the device 30 may compare the face change value with a preset second reference value. In this case, the second reference value may be set differently according to embodiments.

In step S405, the device 30 may determine a region having a facial change value greater than or equal to a second reference value as a basic effect region.

In step S406, the device 30 may display the face change value of the basic effect part in the face scan image and apply a second color to the basic effect part.

For example, the device 30 may apply yellow color to the basic effect area in the face scan image.

In step S407, the device 30 may determine a region having a facial change value less than the second reference value as an ineffective region.

In step S408, the device 30 may display the face change value of the ineffective part in the face scan image and apply a third color to the ineffective part.

For example, the device 30 may apply blue color to non-effect areas in the face scan image.

In step S409, the device 30 may transmit, to the user terminal 10, a facial scan image to which face change values and first to third colors are applied according to the determination of the best effective part, the basic effective part, and the non-effective part. .

5 is a flowchart illustrating a process of determining whether an additional treatment is required for an ineffective area according to an embodiment.

Referring to FIG. 5 , first in step S501, the device 30 may calculate the degree of symmetry of the ineffective part.

For example, when the non-effect part is a cheekbone, the degree of symmetry of the non-effect part may be calculated by comparing at least one of the size, length, area, and color of both cheekbones of the user's face.

In step S502, the device 30 may compare the degree of symmetry of the ineffective part with a preset reference degree. In this case, the reference degree may be set differently according to embodiments.

In step S503, if the degree of symmetry of the ineffective area is greater than or equal to the reference level, the device 30 may determine that no additional treatment is required for the ineffective area.

In step S504, the device 30 may apply a first brightness to an ineffective part of the face scan image that does not require additional treatment, and transmit the face scan image to which the first brightness is applied to the user terminal 10. .

That is, the device 30 determines that additional treatment is not required for the non-effect area where the degree of symmetry of the ineffective area is equal to or greater than the reference level, and transmits a face scan image to which the first brightness is applied to the ineffective area to the user terminal 10. can be sent to

In step S505, if the degree of symmetry of the ineffective area is less than the reference level, the device 30 may determine that additional treatment is required for the ineffective area.

In step S506, the device 30 may apply a second brightness to an ineffective part of the face scan image determined to require additional treatment, and transmit the face scan image to which the second brightness is applied to the user terminal 10.

That is, the device 30 determines that additional treatment is required for the non-effective area where the degree of symmetry of the ineffective area is less than the reference level, and transmits the face scan image to the user terminal 10 by applying the second brightness to the ineffective area. can transmit

6 is a flowchart illustrating a process of setting an additional treatment intensity according to an embodiment.

Referring to FIG. 6 , first, in step S601 , the apparatus 30 may calculate a difference value between a face change value and a target value for an ineffective part where the face change value does not reach the target value.

In step S602, the device 30 may set the additional treatment intensity of the ineffective part in proportion to the difference value.

According to one embodiment, the device 30 may set the additional treatment intensity of the ineffective part as the difference between the face change value and the target value for the ineffective part increases, and the face change value for the ineffective part. As the difference between the target value and the smaller value is smaller, the additional treatment intensity of the non-effective part can be set weakly.

In step S603, the device 30 may transmit an additional treatment guide message including an ineffective area and additional treatment intensity to the user terminal 10.

7 is a flowchart illustrating a process of generating a ratio to a size to be displayed on a screen of a user terminal based on a management index according to an embodiment.

Referring to FIG. 7 , in step S701, the device 30 may collect face change values for a specific face part during a preset reference period. In this case, the reference period may be set differently according to embodiments. For example, when the reference period is 30 days, the device 30 may collect face change values for a specific face part for 30 days.

In step S702, the device 30 may extract the number of times set as the most effective and non-effective parts for a specific facial part during the reference period.

For example, if the reference period is 30 days, the device 30 may extract the number of times set as the most effective and non-effective parts for a specific face part for 30 days.

In step S703, the device 30 may calculate a first value by applying a first weight to the number of times set as the most effective part.

In step S704, the device 30 may calculate a second value by applying a second weight to the number of times set as ineffective parts. In this case, the second weight may be set higher than the first weight.

In step S705, the device 30 may calculate a management index for a specific facial part by summing the first value and the second value.

In step S706 , the device 30 may generate a ratio of a face scan image for a specific face part to a size to be displayed on the screen of the user terminal 10 based on the management index.

According to an embodiment, the device 30 may set the ratio of the face scan image to the size to be displayed on the screen of the user terminal 10 higher as the management index for a specific face part increases.

For example, when the management index for the first part is 30 points and the management index for the second part is 70 points, the device 30 displays the face scan image of the first part on the screen of the user terminal 10. The ratio to the size to be displayed on the screen of the user terminal 10 and the ratio to the size to be displayed on the screen of the user terminal 10 may be set to 30% and the ratio to 70%.

In step S707, the device 30 may transmit the face scan image to which the generated ratio is applied to the user terminal 10.

For example, when the ratio generated for the first part is 30% and the ratio generated for the second part is 70%, the device 30 transmits face scan images to which the generated ratios are respectively applied to the user terminal 10 ) can be transmitted.

8 is an exemplary diagram of a configuration of a device according to an embodiment.

Device 30 according to one embodiment includes a processor 31 and a memory 32 . Device 30 according to an embodiment may be the above-described server or terminal. The processor 31 may include at least one device described above with reference to FIGS. 1 to 7 or may perform at least one method described above with reference to FIGS. 1 to 7 . The memory 32 may store information related to the above method or store a program in which the above method is implemented. Memory 32 may be volatile memory or non-volatile memory.

The processor 31 may execute a program and control the device 30 . Program codes executed by the processor 31 may be stored in the memory 32 . The device 30 may be connected to an external device (eg, a personal computer or network) through an input/output device (not shown) and exchange data.

The embodiments described above may be implemented as hardware components, software components, and/or a combination of hardware components and software components. For example, the devices, methods and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate (FPGA). array), programmable logic units (PLUs), microprocessors, or any other device capable of executing and responding to instructions. A processing device may run an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of software. For convenience of understanding, there are cases in which one processing device is used, but those skilled in the art will understand that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it can include. For example, a processing device may include a plurality of processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the embodiment or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Software may include a computer program, code, instructions, or a combination of one or more of the foregoing, which configures a processing device to operate as desired or processes independently or collectively. The device can be commanded. Software and/or data may be any tangible machine, component, physical device, virtual equipment, computer storage medium or device, intended to be interpreted by or provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed on networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

As described above, although the embodiments have been described with limited drawings, those skilled in the art can apply various technical modifications and variations based on the above. For example, the described techniques may be performed in an order different from the method described, and/or components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

Claims (3)

In the method performed by the device,
Obtaining first scan data obtained by scanning a user's face in three dimensions at a time point before the procedure;
generating a first face model using the first scan data;
obtaining second scan data obtained by scanning the user's face in 3D at the point of view after the procedure;
generating a second face model using the second scan data;
comparing the first face model and the second face model;
based on the comparison result, generating a face change value of the user according to the procedure;
comparing the face change value with a preset target value;
transmitting a face scan image including the first face model and the second face model and the face change value to a user terminal of the user when the face change value reaches the target value;
extracting a region where the face change value does not reach the target value when the face change value does not reach the target value; and
Transmitting an additional treatment suggestion message for suggesting an additional treatment for the face scan image, the face change value, and the extracted region to the user terminal;
including,
Transmitting the face scan image and the face change value to the user terminal,
Comparing the face change value with a preset first reference value;
Determining a region where the face change value is equal to or greater than the first reference value as the most effective region;
Displaying a face change value of the best effect part in the face scan image and applying a first color to the best effect part;
Comparing the face change value with a preset second reference value when the face change value is less than the first reference value;
Determining a region where the face change value is equal to or greater than the second reference value as a basic effect region;
displaying a face change value of the basic effect part in the face scan image and applying a second color to the basic effect part;
Determining a region where the face change value is less than the second reference value as an ineffective region;
displaying a face change value of the non-effect part in the face scan image and applying a third color to the non-effect part; and
Transmitting, to the user terminal, a face change value according to the determination of the best effect part, the basic effect part, and the non-effect part, and a face scan image to which the first color to the third color are applied.
including,
calculating a difference value between the face change value and the target value for an ineffective part where the face change value does not reach the target value;
setting an additional treatment intensity of the ineffective part in proportion to the difference value;
Transmitting an additional treatment guide message including the ineffective area and the additional treatment intensity to the user terminal
Including more,
Further comprising: determining whether additional treatment is required for the ineffective area;
The step of determining whether additional treatment is required for the ineffective area,
Calculating the degree of symmetry of the ineffective area;
Comparing the degree of symmetry of the ineffective part with a preset reference degree;
If the degree of symmetry of the ineffective area is equal to or greater than the reference level, determining that no additional treatment is required for the ineffective area;
Applying a first brightness to an ineffective part of the face scan image that is determined not to require the additional treatment, and transmitting the face scan image to which the first brightness is applied to the user terminal;
If the degree of symmetry of the ineffective area is less than the reference level, determining that additional treatment is required for the ineffective area, and
Applying a second brightness to an ineffective part determined to require the additional treatment in the face scan image, and transmitting the face scan image to which the second brightness is applied to the user terminal.
containing
3D face scanning method. According to claim 1,
The step of generating the user's face change value,
Extracting a front image and a side image of the user's face from the face scan image;
generating a frontal reference point including the middle of the forehead, the middle of the philtrum, the tips of the left eye and the tip of the right eye of the frontal image, and calculating a frontal surface distance between the frontal reference points from the frontal image;
Comparing the frontal surface distance at the time point before the procedure and the time point after the procedure to generate a front face change value;
generating side surface reference points including the tip of the forehead, the tip of the lower chin, the cheekbones, and the tips of both chins of the side image, and calculating the side surface distance between the side reference points from the side image;
Comparing the side surface distances at the time before the procedure and the time after the procedure to generate a side face change value;
Separating a face region based on the side reference point;
Calculating the area of the separated region;
Comparing the area at the time point before the procedure and the time point after the procedure to generate a face area change value, and
generating a face change value of the user by combining the front face change value, the side face change value, and the face area change value;
containing
3D face scanning method. delete

Images