KR102181134B1 - 3-dimensional face measuring apparatus - Google Patents

Abstract

It relates to a 3D facial image acquisition device that photographs a user's face periphery by a camera moving mechanism. In one embodiment, an RGB-D camera fastened to the camera moving mechanism; And a camera moving mechanism for moving the camera according to a predetermined path concavely in a direction perpendicular to the ground and in a direction of the user's face.

Description

3D face measurement device{3-DIMENSIONAL FACE MEASURING APPARATUS}

Related to the facial measurement device. More specifically, it relates to an apparatus and method for measuring a user's face in three dimensions.

Various methods of 3D imaging apparatuses are being developed. The most common 3D image capturing device generates 3D images by fusing images acquired using an RGB camera and a depth camera.

In the 3D imaging apparatus, blind spots may occur depending on the photographing path, and measurement time may be long. Development of a photographing apparatus having the most appropriate path for photographing and acquiring a 3D facial image is required.

Korean Patent Application Laid-Open No. 10-2014-0077751 (published on June 24, 2014) proposes an apparatus for scanning a three-dimensional face. The present invention relates to a 3D face scanning device that increases mobility by reducing the volume during movement.

According to an embodiment, there is provided a 3D facial image acquisition apparatus for photographing a user's face around a face by a camera moving device, comprising: an RGB-D camera coupled to the camera moving device; And a camera moving mechanism for moving the camera according to a predetermined path in a direction perpendicular to the ground and concave in a direction of the user's face.

According to another embodiment, the camera moving mechanism may include: a rail formed at one side perpendicular to the ground and a concave side at the other side toward the user's face; A sliding part fastened to the rail and moving up and down; A camera fastening part moving along the rail; A spring hinge connecting the sliding part and the camera fastening part and allowing the camera fastening part to move in close contact with the rail; And a bearing disposed between the camera fastening part and the rail to reduce friction.

According to another embodiment, the camera moving device is provided with a 3D facial image acquisition apparatus further including a pivot moving unit that pivots the rail around the user's face.

According to another embodiment of claim 3, wherein the camera moving mechanism starts from the center of the user's face and moves in a right chin direction, a right chin to a right forehead, a right forehead to a left chin, and a left chin. It may be a 3D facial image acquisition device that moves the camera toward the left forehead and from the left forehead toward the center of the face.

In addition, the path moving from the right forehead to the left chin may be a 3D facial image acquisition device passing through the center of the user's face.

According to another embodiment, the camera moving mechanism may start from the center of the user's face and move toward the left chin, from the left chin to the left forehead, from the left forehead to the right chin, and from the right chin to the right forehead, A 3D facial image acquisition device is provided that moves the camera from the right forehead toward the center of the face.

In this case, the path moving from the left forehead to the right chin may be a 3D facial image acquisition device passing through the center of the user's face.

According to one side, there is provided a camera moving mechanism used in an apparatus for capturing a 3D facial image for photographing around a user's face, comprising: a rail having an upper portion perpendicular to the ground and a lower portion concave toward the user's face; A sliding part fastened to the rail and moving up and down; And a camera moving mechanism including a camera fastening part moving along the rail is provided.

According to another aspect, there is also provided a camera moving mechanism further comprising a pivot moving part for pivoting the rail around the user's face.

According to another aspect, a camera moving mechanism further includes a spring hinge connecting the sliding part and the camera fastening part, and allowing the camera fastening part to move in close contact with the rail.

According to the other side, it may further include a bearing disposed between the camera fastening part and the rail to reduce friction.

According to an embodiment, the camera fastening part is provided with a camera moving mechanism that vertically moves along the rail up to the height of the user's chin, and moves concavely in the direction of the user's face from below the height of the user's chin.

1 is a diagram illustrating an overall configuration of an apparatus for acquiring a 3D facial image according to an embodiment.
2 illustrates a scan radius when the apparatus for obtaining a 3D facial image according to an exemplary embodiment moves up and down.
3 is a diagram illustrating a difference between scanning the same area with and without a curved portion according to an exemplary embodiment.
4 illustrates a scan path of an apparatus for obtaining a 3D facial image according to an exemplary embodiment.
5 illustrates a turning path of an apparatus for acquiring a 3D facial image according to an exemplary embodiment.
6 illustrates an image acquired by an apparatus for obtaining a 3D facial image according to an exemplary embodiment.
7 illustrates another image acquired by the apparatus for obtaining a 3D facial image according to an exemplary embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, the scope of the rights is not limited or limited by these embodiments. The same reference numerals shown in each drawing indicate the same members.

The terms used in the description below have been selected as general and universal in the related technical field, but there may be other terms depending on the development and/or change of technology, customs, and preferences of technicians. Therefore, terms used in the following description should not be understood as limiting the technical idea, but should be understood as exemplary terms for describing embodiments.

In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, detailed meanings will be described in the corresponding description. Therefore, terms used in the following description should be understood based on the meaning of the term and the contents throughout the specification, not just the name of the term.

1 is a diagram illustrating an overall configuration of an apparatus for acquiring a 3D facial image according to an exemplary embodiment. A 3D facial image acquisition device that photographs a user's face around the face by a camera moving device according to an embodiment may include an RGB-D camera 160 and a camera moving device.

The camera 160 may include both a general RGB camera and a depth camera capable of capturing a depth image, and may acquire 3D image information of a face. Specifically, by photographing the front and side surfaces of the face, 3D image information on the face may be obtained in the widest possible range.

The camera moving mechanism raises and lowers the camera in a vertical direction according to a photographing trajectory around the user's face, and rotates a vertical axis around the user to take a picture around the user's face. Ascending and descending in the vertical direction moves along the rails, and the user-centered orbit may move along a separate orbital movement track. A 3D face diagnosis apparatus for acquiring 3D image information including face depth information over the front and side surfaces of the face according to the movement trajectory is illustrated in FIG. 1. This is only exemplary, and various embodiments that can be modified from the standpoint of a person skilled in the art are possible.

More specifically, the camera moving mechanism may include a rail 110, a sliding part 120, a camera fastening part 130, a spring hinge 140, and a bearing 150.

The rail 110 is formed so that one side is perpendicular to the ground and the other side is concave in the direction of the user's face. A sliding part 120 is fastened to the rail 110 so that it can vertically move by a motor. The upper part of the rail 110 is configured in a vertical direction to the ground so that the user's face can be photographed from the front, but the lower part is a curved part in the direction of the user's face in order to properly photograph the user's chin and neck regions without a blind spot. Have. That is, the lower portion of the rail 110 may be concave toward the user's face.

The sliding part 120 is fastened to the rail and moves up and down, and may be connected to the camera fastening part 130 through a spring hinge 140. Illustratively, but not limited to, an RGB-D camera may be fastened to the camera fastening part 130. In order to adjust the direction in which the camera fastening part 130 looks at the user's face, the lower portion of the rail 110 is formed in a curved surface.

The camera fastening part 130 moves along the rail and is connected to the sliding part 120 by a spring hinge 140. The spring hinge 140 serves to move the camera fastening part in close contact with the rail.

Finally, the bearing 150 is disposed between the camera fastening part 130 and the rail 110 to reduce friction. That is, it is configured in the shape of a wheel so that the camera fastening part can move smoothly along the rail. According to one embodiment, the bearing 150 may be a ring bearing, and according to another embodiment, the bearing 150 may be a ball bearing.

As a result, the 3D facial image acquisition apparatus according to an embodiment allows the camera fastening portion to which the camera is fastened to move along the J-shaped rail 110 to appropriately photograph the user's face area, the lower chin, and the neck area. do. When the camera and the camera fastening part move only in the direction perpendicular to the ground, the vertical size of the 3D facial image acquisition device becomes too large, so the size of the device can be reduced by giving a curved surface to the lower part of the rail in a J-shape. There is.

In one embodiment, since the J-shaped rail is photographed without a blind spot inside the chin, the curved portion may be started based on the user's lower pipe. For example, an I-shaped rail is configured to be perpendicular to the ground up to the user's lip region, and a curved portion starts from the region under the lip to capture the chin region.

This is only exemplary, and a method of configuring the height of the camera movement mechanism to be adjusted according to the user's height, face size, and face length is also possible. According to another embodiment, when the length of the user's face is long, the length of a region formed perpendicular to the ground among the J-shaped rails may be formed to be longer. However, it is not necessarily formed to be adjustable in length, and may have the most efficient straight and curved lengths that can be applied to various face sizes of people.

2 illustrates a scan radius when the apparatus for obtaining a 3D facial image according to an exemplary embodiment moves up and down. 210 is a scanning radius when the apparatus for obtaining a 3D facial image according to an embodiment photographs a user's face from the front. And 220 denotes a scanning radius when a user's face is photographed from a little lower when the camera fastening part of the 3D facial image acquisition device moves a certain distance downward along the rail. Finally, reference numeral 230 shows a scan radius for photographing a user's face from the bottom when the camera fastening part of the 3D facial image acquisition device moves as far down the rail as possible.

In the case of photographing from the front, since it is a spherical protruding from the forehead above the user's face to the crown region, there is no significant problem or a blind spot even when photographing from the front.

On the other hand, in the user's lower canal area, the jaw protrudes and the portion connected to the neck is concave, so when shooting from the front, a blind spot is likely to occur.

Therefore, it is possible to shoot without a blind spot in the area under the chin by taking pictures from the bottom to the top along the J-shaped rail path like 220. Similarly, when shooting from the maximum end of the rail path as shown in 230, it is possible to shoot to the deepest area.

3 is a diagram illustrating a difference between scanning the same area with and without a curved portion according to an exemplary embodiment. That is, in FIG. 3, when the user's face is photographed with the 3D facial image acquisition device according to an embodiment, the difference between the curved portion 310 and the absence 320 of the lower rail is expressed so that it is easy to understand. .

First, as a 3D facial image acquisition apparatus according to an exemplary embodiment of the present application, in the case of photographing through a curved portion, an area under the chin can be photographed without a blind spot without the camera falling below the reference line.

On the other hand, in the case of an I-shaped rail that is constructed only in the vertical direction perpendicular to the ground and does not have a curved part, it must go down considerably below the reference line. In addition, it is difficult to shoot the area under the chin without a blind spot unless the angle of the camera is adjusted upward. Therefore, in the case of the I-shaped rail, a long rail is required in the vertical direction to photograph the area under the chin without a blind spot, and a separate device for adjusting the angle of the camera is required. However, in the case of using the J-shaped rail including the curved portion of the present application, the size of the 3D facial image acquisition device can be reduced, and the entire user's face including the area under the chin without blind spots can be photographed without a separate camera angle adjustment device. It is possible.

In more detail, when considering the user's jaw structure, when a lower jaw area is to be photographed without a blind spot, the moving range of the vertically moving sliding portion varies depending on the presence or absence of the curved portion. In order to photograph points A3, 4, and 5, if there is no curved part 320, the sliding part S1 must move a considerable distance in the direction of the ground. On the other hand, when there is a curved portion 310, the moving distance in the ground direction may be reduced by the curved portion, so that the size of the 3D facial image photographing apparatus may be reduced.

The gain according to the difference in the moving path with and without the curved part corresponds to the difference between Area1 and Area2. That is, the difference between the moving distance of the sliding unit when there is a curved portion and the moving distance of the sliding unit when there is no curved portion corresponds to Area1-Area2 because the upper area gains as much as Area2, but the lower area gains as much as Area1.

4 illustrates a scan path of an apparatus for obtaining a 3D facial image according to an exemplary embodiment. The scan path 420 of the apparatus for acquiring a 3D facial image according to an embodiment is rotated and photographed in an eight-shaped shape, starting from the central portion 410 of the user's face, that is, the nose.

Specifically, the first photographing starts from the central face 410, and then the right chin direction, the right chin to the right forehead, the right forehead to the left chin, the left chin to the left, and the left forehead again. You can shoot in the direction of 410).

In particular, in the case of photographing from the center of the face 410 to the right chin and from the left forehead to the right chin, the chin area can be photographed without a blind spot by the J-shaped rail described above.

According to another embodiment, it is possible to start from the central portion of the face 410 toward the left chin. Starting the eight-shaped path laid down in the same direction from the center of the face 410 to the left chin can be easily modified by those of ordinary skill in the art.

In the case of performing photographing with an eight-shaped path lying down according to an embodiment, there is an effect that photographing can be performed without a blind spot in the jaw area with the shortest path.

5 illustrates a turning path of an apparatus for acquiring a 3D facial image according to an exemplary embodiment. The apparatus for acquiring a 3D facial image according to an embodiment may include a camera moving device 510, and may further include a turning moving unit 520 that rotates the rail around the user's face 530. .

The pivoting moving unit 520 rotates the camera moving device 510 around the user's face so that a side area of the user's face can be photographed. Specifically, it includes a curved rail curved in the direction of the user's face 530 and the camera moving mechanism 510 may be moved along the curved rail.

As a result, a photographing path is formed in the vertical direction along the J-shaped rail of the camera moving mechanism 510, and a photographing path is formed that rotates along the curved rail. As the camera and the camera fastening unit move along the two paths, the user's face 530 may be photographed without a blind spot in the chin area.

The apparatus for obtaining a 3D facial image according to an exemplary embodiment acquires a 3D facial image while an RGB-D camera fastened to the above-described camera movement device photographs the user's face.

6 illustrates an image acquired by an apparatus for obtaining a 3D facial image according to an exemplary embodiment. 6A is an image under the chin obtained by a 3D facial image acquisition device capable of moving only in a vertical linear direction without a path formed concave in the user's face direction. Meanwhile, FIG. 6B illustrates an image under the chin obtained by the apparatus for acquiring a 3D facial image according to an exemplary embodiment including a path formed concave in a user's face direction.

When comparing FIGS. 6A and 6B, when a photograph is taken using only a straight path in the vertical direction, a blind spot area 610 that is not accurately measured under the chin occurs, but a path formed concave in the face direction according to an embodiment In the case of including, the blind spot area 610 does not occur.

7 illustrates a side jaw image acquired by an apparatus for acquiring a 3D facial image according to an exemplary embodiment. As in FIG. 6, FIG. 7A is an image of the side of the chin obtained by a 3D facial image acquisition device capable of moving only in a vertical straight line without a path formed concave in the user's face direction. 7B illustrates an image of a side of a chin obtained by the apparatus for acquiring a 3D facial image according to an exemplary embodiment including a path formed concave in a user's face direction.

When comparing FIGS. 7A and 7B, when a photograph is taken using only a straight path in the vertical direction, a region that is not accurately measured occurs under the chin. If it is not accurately measured, an area 710 such as an image that is abnormally protruded under the chin may be generated as an example. In the case of the apparatus for acquiring a 3D facial image including a path concave in the face direction according to an exemplary embodiment, the area 710 such as the protruding image does not occur.

The apparatus described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It can be implemented using one or more general purpose computers or special purpose computers, such as a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to operate as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodyed in a transmitted signal wave. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

Although the embodiments have been described by the limited drawings, various modifications and variations are possible from the above description to those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and claims and equivalents fall within the scope of the claims to be described later.

Claims (12)

In the 3D facial image acquisition device for photographing around a user's face by a camera moving mechanism,
A camera fastened to the camera moving mechanism; And
A camera moving mechanism that moves the camera along a predetermined path
Including,
The camera moving mechanism,
A J-shaped rail having an upper portion perpendicular to the ground so that the user's face can be photographed from the front, and a lower portion having a curved portion in the user's face direction to photograph the user's chin and neck regions; And
A pivot moving part for turning the J-shaped rail around the user's face along a curved rail curved in the direction of the user's face
Including,
The camera,
The user's face is photographed without a blind spot in the jaw area while moving to a first photographing path formed in the vertical direction along the J-shaped rail and a second photographing path that rotates along the curved rail.
3D facial image acquisition device. The method of claim 1,
The camera moving mechanism,
A sliding part fastened to the J-shaped rail and moving up and down;
A camera fastening part moving along the J-shaped rail;
A spring hinge connecting the sliding part and the camera fastening part, and allowing the camera fastening part to move in close contact with the J-shaped rail; And
A bearing disposed between the camera fastening part and the J-shaped rail to reduce friction
3D facial image acquisition device further comprising. delete The method of claim 1,
The camera moving mechanism,
Starting from the center of the user's face, moving the camera from the right chin to the right forehead, from the right to the left chin, from the left chin to the left forehead, and from the left forehead to the center of the face
3D facial image acquisition device. The method of claim 4,
The path from the right forehead to the left chin is,
Passing through the center of the user's face
3D facial image acquisition device. The method of claim 1,
The camera moving mechanism,
Starting from the center of the user's face, moving the camera from the left chin to the left forehead, from the left to the right chin, from the right chin to the right forehead, and from the right forehead to the center of the face
3D facial image acquisition device. The method of claim 6,
The path moving from the left forehead to the right chin is,
Passing through the center of the user's face
3D facial image acquisition device. delete delete delete delete delete

Images