WO2024098321A1

WO2024098321A1 - 3d structured light full-face imaging apparatus combined with optical reflection imaging

Info

Publication number: WO2024098321A1
Application number: PCT/CN2022/131098
Authority: WO
Inventors: 郑炜钢; 方俊平; 钱之川; 余旭光
Original assignee: 杭州小肤科技有限公司
Priority date: 2022-11-10
Filing date: 2022-11-10
Publication date: 2024-05-16

Abstract

The present invention relates to a 3D structured light full-face imaging apparatus combined with optical reflection imaging. The solution comprises a head placement area, a 3D structured light rotation module and a plurality of optical reflecting mirrors, wherein the 3D structured light rotation module is located at a middle position in front of the head placement area, and can be driven by a rotating shaft, so as to rotate with itself as an axis; and the optical reflecting mirrors are arranged around the 3D structured light rotation module. The present solution has a high image precision, and can obtain more accurate facial depth information, thereby providing a good reference for aesthetic medicine and cosmetic surgery; moreover, the present solution has a simple structure, and has a lower cost compared with a structure having a plurality of camera modules.

Description

A 3D structured light full-face imaging device combined with optical reflection imaging

Technical Field

The invention relates to a face imaging modeling device, and in particular to a 3D structured light full face imaging device combined with optical reflection imaging.

Background technique

With the continuous progress of the times and society, people are paying more and more attention to their skin and other appearance features, so the demand for understanding their skin condition is becoming stronger and stronger. In the fields of medical beauty, such as skin care product recommendations and skin quality analysis, people usually have to conduct certain tests and analyses on the skin condition of the whole face, and then formulate corresponding strategies based on the analysis results. The skin is tested by using analytical instruments, and suitable skin care products are recommended based on the test results, or corresponding skin care strategies are formulated. Among them, the skin detector is an instrument used to detect the skin. It is equipped with professional detection software to help consumers intuitively and quickly understand the health status of their skin. It has a beautiful interface and practical functions. It should also have several major analysis modules and can accurately analyze the skin oil, moisture, spots, pores, and skin age. The moisture data is directly obtained by obtaining the water data under the skin stratum corneum, and the data accuracy is high.

However, most skin detectors currently on the market use a single camera to detect the skin, and can only capture facial images from one angle at a time. If facial images from different angles need to be captured, the head must be rotated manually. This can easily lead to problems such as customer misoperation, missed shots, inaccurate shooting angle positioning, and large data deviations when repeated shots. In addition, the images captured by existing full-face detection and analysis instruments are basically two-dimensional graphics, and the images cannot be rotated in three dimensions, resulting in inaccurate contour analysis.

In summary, there is an urgent need for a 3D structured light full-face imaging device combined with optical reflective imaging that can meet the growing needs of consumers.

Summary of the invention

The purpose of the present invention is to provide a 3D structured light full-face imaging device combined with optical reflection imaging in order to solve the above problems existing in the prior art.

In order to achieve the above-mentioned invention object, the present invention adopts the following technical scheme: a 3D structured light full-face imaging device combined with optical reflection imaging comprises a head placement area, a 3D structured light rotation module and a plurality of optical reflectors; the 3D structured light rotation module is located in the center in front of the head placement area, and can rotate with itself as the axis through a rotating shaft drive; the optical reflectors are arranged around the 3D structured light rotation module; the optical reflectors are arranged vertically and are divided into a first reflector, a second reflector, a third reflector and a fourth reflector, which are respectively located at the head The positions of -45 degrees, -15 degrees, 15 degrees and 45 degrees of the face in the shelf area; the connecting line between the center of the 3D structured light rotation module and the center of the head shelf area is taken as the 0 degree line, the first reflector and the fourth reflector are respectively located at the left front position and the right front position of the head shelf area, the second reflector and the third reflector are respectively located at the left front position and the right front position of the 3D structured light rotation module; the third reflector and the second reflector are mirror-set with the 0 degree line as the center line and are perpendicular to each other, and the fourth reflector and the first reflector are mirror-set with the 0 degree line as the center line and are parallel to each other;

When the rotation axis rotates to -45 degrees, the 3D structured light rotation module can face and correspond to the first reflector, and obtain -45 degree face data from the first reflector;

When the axis rotates to -105 degrees, the 3D structured light rotation module can face and correspond to the second reflector, and obtain -15 degree face data from the second reflector;

When the shaft rotates to 105 degrees, the 3D structured light rotation module can face and correspond to the third reflector, and obtain 15-degree face data from the third reflector;

When the rotating shaft is rotated to 45 degrees, the 3D structured light rotation module can face and correspond to the fourth reflector, and obtain 45-degree facial data from the fourth reflector.

Working principle and beneficial effects: 1. In the prior art, when photographing a face, either the face needs to move by itself, or the face needs to be photographed by adding a side camera or a mobile camera mechanism. The former does not provide a good user experience, and the latter requires more costs, especially the mobile mechanism is large in size and takes a long time to rotate, which will take a long time. This solution overcomes the above shortcomings, drives the 3D structured light rotation module to rotate through the shaft, and photographs the face image on each optical reflector respectively, thereby generating a complete face model, which has the advantages of simple structure, easy operation, short shooting time and good user experience;

2. The rotation of the 3D structured light rotation module is driven by the shaft. It can be directly driven by a motor, which is easy to control and does not require additional positioning devices and sensors. It only needs to control the rotation angle or number of turns of the motor to easily realize the rotation positioning of the shaft. Even if there is inaccurate positioning, the synthesis algorithm of the 3D structured light rotation module itself can be used to remove duplicate point clouds, which can ensure that each optical reflector can display a complete head portrait without image loss, thereby ensuring the quality of the face model.

Furthermore, the reflectivity of each optical reflector is greater than or equal to 90%. Optical reflectors with a reflectivity of more than 90% can provide better collected images for the 3D structured light rotation module, significantly improving the quality of its final face model.

Furthermore, the rotating shaft drives the 3D structured light rotating module to turn to the first reflector, the second reflector, the third reflector, and the fourth reflector in sequence. In this solution, it is only necessary to rotate the rotating shaft in sequence, that is, the rotating shaft rotates clockwise or counterclockwise, and finally returns to the initial position. Each rotation can be positioned by the motor, and the motor can be controlled to stop and perform shooting operations. The control is convenient and the implementation difficulty is low.

Furthermore, the rotation axis is driven by a motor to perform initial rotation angle positioning, and the rotation axis is secondary positioned through the overlapping points in the point cloud of the 3D structured light rotation module. This solution can collect multiple accurate facial images at various angles through two positionings, thereby ensuring that a facial model that meets quality requirements can be synthesized.

Furthermore, the 3D structured light rotation module at least includes an RGB camera and a structured light camera, and the face model is established by the RGB camera and the structured light camera.

Furthermore, the head rest area is provided with a chin rest. This solution can conveniently fix the user's head, provide a good user experience, and enable the user's head to always be at an optimal height, thereby generating a complete face model.

Furthermore, it also includes a light shield and a lighting lamp arranged in the light shield, and the light shield shields the head rest area, the 3D structured light rotation module and the plurality of optical reflectors. This solution can effectively avoid the influence of external light sources, and the lighting lamp turned on inside can be turned on as needed.

Furthermore, when the 3D structured light rotating module is shooting, the lighting lamp is turned off. This setting is mainly to avoid the lighting lamp from affecting the shooting.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic structural diagram of an embodiment of the present invention;

FIG2 is a schematic diagram of the first use state of the present invention;

FIG3 is a second schematic diagram of the present invention in use;

FIG. 4 is a schematic diagram of an image generated by the present invention.

[Corrected 18.01.2023 in accordance with Article 91]
FIG. 5 is a schematic diagram of an image formed by the present invention.

In the figure, 1. head rest area; 2. 3D structured light rotation module; 3. chin rest; 4. user; 5. shaft; 6. motor; 7. light shield; 8. lighting; 9. first reflector; 10. second reflector; 11. third reflector; 12. fourth reflector; 13. forehead rest.

Detailed ways

The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field belong to the scope of protection of the present invention.

Those skilled in the art should understand that, in the disclosure of the present invention, the orientation or position relationship indicated by the terms "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc. are based on the orientation or position relationship shown in the drawings, which are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation. Therefore, the above terms should not be understood as limiting the present invention.

For ease of understanding, let's first explain the principle of 3D structured light: The basic principle of 3D structured light technology is to project light with certain structural characteristics onto the object being photographed through a near-infrared laser, and then collect it with a special infrared camera. This light with a certain structure will collect different image phase information due to different depth areas of the object being photographed, and then the change in this structure will be converted into depth information through the calculation unit to obtain the three-dimensional structure. In simple terms, the three-dimensional structure of the object being photographed is obtained by optical means, and then the obtained information is applied more deeply.

A depth image, also called a distance image, refers to an image that uses the distance (depth) value from the image collector to each point in the scene as the pixel value.

Point cloud: When a laser beam hits the surface of an object, the reflected laser will carry information such as direction and distance. If the laser beam is scanned along a certain trajectory, the reflected laser point information will be recorded while scanning. Since the scanning is extremely precise, a large number of laser points can be obtained, thus forming a laser point cloud. Point cloud data is discrete data obtained by scanning and sampling the surface of a real object.

Depth images can be calculated into point cloud data after coordinate transformation; point cloud data with rules and necessary information can be inversely calculated into depth images. The two can be transformed into each other under certain conditions.

So far, this solution has been creatively improved based on the 3D structured light rotating module 2 integrating the above-mentioned technology to form a device as shown in Figures 1-3. This 3D structured light full-face imaging device combined with optical reflection imaging includes a head rest area 1, a 3D structured light rotating module 2 and a plurality of optical reflectors, wherein the head rest area 1 is provided with a chin rest 3 that matches the chin of the human face, and a latex pad or other soft cushion can be installed on the chin rest 3, and it can be replaced by itself for easy disinfection. When in use, the chin rest 3 of the user 4 is on the chin rest 3, and the 3D structured light rotating module 2 is installed on the rotating shaft 5, and at least includes an RGB camera and a structured light camera. The face model is established by using the RGB camera and the structured light camera. The specific principle is the existing technology and will not be repeated here.

In this embodiment, the 3D structured light rotating module 2 and the multiple optical reflectors can be height-adjustable. The height adjustment method can be a common manual adjustment structure or an electric adjustment structure, so as to be suitable for various human faces.

Specifically, the 3D structured light rotating module 2 is located in the center in front of the head rest area 1, and can rotate with itself as the axis through the drive of the rotating shaft 5. The rotating shaft 5 is driven by a common stepper motor 6 or a servo motor 6, and the motor 6 is controlled by a common computer device. The 3D structured light rotating module 2 is also controlled by the computer device to generate a face model on the computer device.

Specifically, the optical reflector is arranged around the 3D structured light rotating module 2 to reflect the light emitted by the 3D structured light rotating module 2. The optical reflector is a commercially available product and is mounted on an external fixed bracket by means of screws, glue, etc. The fixed bracket is not shown in the attached figure.

Preferably, the reflectivity of each optical reflector is greater than or equal to 90%. Optical reflectors with a reflectivity of more than 90% can provide better collected images for the 3D structured light rotation module 2, significantly improving the quality of its final face model.

In this embodiment, a light shield 7 and a lighting lamp 8 disposed in the light shield 7 are also included, and the light shield 7 is used to shield the head rest area 1, the 3D structured light rotating module 2 and a plurality of optical reflectors, wherein the light shield 7 can be a common black cloth, which can be directly covered on the device, or a cover made of other opaque materials, as shown in FIG1 , and the device is made into a semi-enclosed structure, exposing only an opening for the human head to enter, and a forehead support 13 for supporting the user's forehead, and when the 3D structured light rotating module 2 is shooting, the lighting lamp 8 is turned off. This is mainly to avoid the influence of the lighting lamp 8 on the shooting. This solution can effectively avoid the influence of external light sources, and the internally turned on lighting lamp 8 can be turned on as needed.

Preferably, there are four optical reflectors, which correspond to the positions of -45 degrees, -15 degrees, 15 degrees and 45 degrees of the face of the head resting area 1, respectively. The optical reflectors are divided into a first reflector 9, a second reflector 10, a third reflector 11 and a fourth reflector 12. The connecting line between the 3D structured light rotation module 2 and the head resting area 1 is the 0 degree line. The first reflector 9 and the fourth reflector 12 are respectively located at the left front position and the right front position of the head resting area 1, and the second reflector 10 and the third reflector 11 are respectively located at the left front position and the right front position of the 3D structured light rotation module 2; the third reflector 11 and the second reflector 10 are mirrored with the 0 degree line as the center line and are perpendicular to each other, and the fourth reflector 12 and the first reflector 9 are mirrored with the 0 degree line as the center line and are parallel to each other. This solution can quickly locate the position of each reflector, which is convenient for the installation of each reflector. As shown in FIG3 , the installation angles of the reflector are -90 degrees, -45 degrees, 45 degrees and 90 degrees, and the angles that the motor 6 needs to rotate are -45 degrees, -105 degrees, 105 degrees and 45 degrees, respectively. When the motor 6 rotates to -45 degrees, the 3D structured light rotation module 2 can face and correspond to the first reflector 9, and obtain -45 degree face data from the first reflector 9;

When the motor 6 rotates to -105 degrees, the 3D structured light rotation module 2 can face and correspond to the second reflector 10, and obtain -15 degree face data from the second reflector 10;

When the motor 6 rotates to 105 degrees, the 3D structured light rotation module 2 can face and correspond to the third reflector 11, and obtain 15-degree face data from the third reflector 11;

When the motor 6 rotates to 45 degrees, the 3D structured light rotation module 2 can face and correspond to the fourth reflector 12 , and obtain 45-degree face data from the fourth reflector 12 .

Therefore, when in use, the shaft 5 drives the 3D structured light rotating module 2 to turn to the first reflector 9, the second reflector 10, the third reflector 11, and the fourth reflector 12 in sequence, and the shaft 5 is started to rotate to the -45 degree position, and the RGB light, PL, and UV light of the 3D structured light rotating module 2 are turned on in sequence to take pictures, and a group of pictures and corresponding depth data information are obtained, and then the shaft 5 is rotated to the -105 degree, 105 degree and 45 degree positions, and the RGB light, PL, and UV light are turned on in sequence to take pictures, and three different groups of pictures and corresponding depth data information are obtained respectively, and the lighting lamp 8 is turned off when taking pictures. In this solution, it is only necessary to rotate the shaft 5 in sequence, that is, the shaft 5 rotates clockwise or counterclockwise, and finally returns to the initial position. Each rotation can be positioned by the motor 6, and the motor 6 can also be controlled to stop and perform shooting operations. The control is convenient and the implementation difficulty is low.

The rotating shaft 5 is driven by the motor 6 to perform the initial rotation angle positioning, and the rotating shaft 5 is positioned twice by the overlapping points in the point cloud of the 3D structured light rotation module 2, that is, the overlapping points are filtered out to achieve the splicing of multiple images. This scheme can collect multiple accurate images of the face at various angles through two positionings, so as to ensure that a face model that meets the quality requirements can be synthesized. See Figure 4, 1-4 represent the images collected on the first reflector 9, the second reflector 10, the third reflector 11, and the fourth reflector 12, respectively, and the middle is the merged and rendered image. The original image is a color image with more facial details. The generated face model can be used for the analysis of facial skin, such as the depth of wrinkles, the size of acne, etc.

The parts not described in detail in the present invention are prior art, so the present invention does not describe them in detail.

It is to be understood that the term "one" should be understood as "at least one" or "one or more", that is, in one embodiment, the number of an element may be one, while in another embodiment, the number of the element may be multiple, and the term "one" should not be understood as a limitation on the quantity.

Although the terminology such as head rest area 1, 3D structured light rotating module 2, chin rest 3, user 4, rotating shaft 5, motor 6, light shield 7, lighting lamp 8, first reflector 9, second reflector 10, third reflector 11, fourth reflector 12, forehead rest 13 is used more frequently in this article, the possibility of using other terms is not excluded. The use of these terms is only for more convenient description and explanation of the essence of the present invention; interpreting them as any additional limitation is contrary to the spirit of the present invention.

The present invention is not limited to the above-mentioned optimal implementation mode. Anyone can derive other various forms of products under the inspiration of the present invention. However, no matter what changes are made in the shape or structure, all technical solutions that are the same or similar to those of the present application fall within the protection scope of the present invention.

Claims

A 3D structured light full-face imaging device combined with optical reflective imaging, characterized in that it includes a head rest area, a 3D structured light rotating module and a plurality of optical reflectors; the 3D structured light rotating module is located in the center of the front of the head rest area, and can rotate with itself as the axis through the driving of a rotating shaft; the optical reflectors are arranged around the 3D structured light rotating module; the optical reflectors are arranged vertically, and are divided into a first reflector, a second reflector, a third reflector and a fourth reflector, which correspond to the positions of -45 degrees, -15 degrees, 15 degrees and 45 degrees of the face of the person in the head rest area respectively; with the connecting line between the center of the 3D structured light rotating module and the center of the head rest area as the 0 degree line, the first reflector and the fourth reflector are respectively located at the left front position and the right front position of the head rest area, and the second reflector and the third reflector are respectively located at the left front position and the right front position of the 3D structured light rotating module; the third reflector and the second reflector are mirror-set with the 0 degree line as the center line and are perpendicular to each other, and the fourth reflector and the first reflector are mirror-set with the 0 degree line as the center line and are parallel to each other;

When the rotation axis rotates to -45 degrees, the 3D structured light rotation module can face and correspond to the first reflector, and obtain -45 degree face data from the first reflector;

When the axis rotates to -105 degrees, the 3D structured light rotation module can face and correspond to the second reflector, and obtain -15 degree face data from the second reflector;

When the shaft rotates to 105 degrees, the 3D structured light rotation module can face and correspond to the third reflector, and obtain 15-degree face data from the third reflector;

When the rotating shaft is rotated to 45 degrees, the 3D structured light rotation module can face and correspond to the fourth reflector, and obtain 45-degree facial data from the fourth reflector.
The 3D structured light full-face imaging device combined with optical reflective imaging according to claim 1, characterized in that the reflectivity of each of the optical reflectors is greater than or equal to 90%.
According to the 3D structured light full-face imaging device combined with optical reflective imaging according to claim 1, it is characterized in that the rotating shaft drives the 3D structured light rotation module to turn to the first reflector, the second reflector, the third reflector, and the fourth reflector in sequence.
According to a 3D structured light full-face imaging device combined with optical reflective imaging as described in claim 3, it is characterized in that the rotating shaft is driven by a motor to perform initial positioning of the rotation angle, and the secondary positioning of the rotating shaft is achieved through the overlapping points in the point cloud of the 3D structured light rotation module.
According to a 3D structured light full-face imaging device combined with optical reflective imaging according to claim 1, it is characterized in that the 3D structured light rotation module comprises at least an RGB camera and a structured light camera.
A 3D structured light full-face imaging device combined with optical reflective imaging according to any one of claims 1-5, characterized in that the head rest area is provided with a chin rest.
According to claim 6, a 3D structured light full-face imaging device combined with optical reflective imaging is characterized in that it also includes a light shield and a lighting lamp arranged in the light shield, and the light shield shields the head rest area, the 3D structured light rotation module and the multiple optical reflectors.
According to the 3D structured light full-face imaging device combined with optical reflective imaging according to claim 7, it is characterized in that when the 3D structured light rotation module is shooting, the lighting lamp is turned off.