CN213072921U - Multi-region image acquisition equipment, 3D information comparison and matching object generation device - Google Patents

Abstract

The utility model provides a multizone image acquisition equipment, 3D information contrast, supporting thing generate device, wherein multizone image acquisition equipment: comprises m image acquisition devices, and is used for acquiring the images of the following images: acquiring a 1 st group of images of a 1 st area of the target object through relative movement of an acquisition area of the 1 st image acquisition device and the 1 st area of the target object; by analogy, acquiring the nth group of images of the nth region of the target object by the relative motion of the acquisition region of the mth image acquisition device and the nth region of the target object, wherein m is more than or equal to 1, and n is more than or equal to 2; for the first time, 3D acquisition is noticed and proposed for different areas of the same object, so that 3D information of the object can be obtained more accurately.

Description

Multi-region image acquisition equipment, 3D information comparison and matching object generation device

Technical Field

The utility model relates to a data acquisition and measurement technical field, in particular to utilize the picture to carry out target object 3D and gather and measure technical field.

Background

Many 3D acquisition and measurement devices are currently mainly used for a specific person, a part of a person, an object or a part of an object, for example, existing 3D devices are used for face 3D information acquisition, iris 3D information acquisition, or hand 3D information acquisition. However, the information collected in this way is limited, and only one 3D feature of the target object can be reflected.

There are of course some schemes where a single 3D acquisition device is used to acquire 3D information for different regions of the object multiple times. For example, 3D information acquisition of the face and then 3D information acquisition of the iris is performed by using a 3D acquisition device. However, the requirements for the 3D acquisition device are different for different regions of the object. For example, when the human face is acquired in 3D, the information within 180 degrees with the head as the axis needs to be acquired, and the iris 3D acquisition only needs to acquire the information with a very small angle; a visible light camera is generally used for a face 3D acquisition camera, and an infrared camera is needed for iris 3D acquisition; the requirements of the face 3D acquisition and the iris 3D acquisition on lens depth of field, lens type and the like are different. That is, due to the different characteristics of different regions of the target object, if a single 3D capturing device is used in a mixed manner, the capturing effect is poor, and even a 3D image cannot be synthesized.

In other solutions, it is claimed that the information of face and iris can be acquired simultaneously, and a plurality of acquisition cameras are also provided, but in practice, no special acquisition camera related device is designed specially for face and iris, and the essence of the method is consistent with the above solutions, and the acquisition is performed by using a general acquisition device.

Still other schemes may be used to collect different objects for different sizes of objects. However, the acquisition objects of the scheme are different objects and are not different areas in the same object. The acquisition of different objects requires the object to be replaced or the acquisition equipment to be moved during the acquisition process. And the target does not need to be replaced aiming at the acquisition of different areas of the same target, and the acquisition equipment is moved, so that the use is more convenient.

In addition, some traditional schemes can acquire 2D information of the face and the iris at the same time, but because the 2D information is acquired by a single picture essentially, and the 3D information relates to complex steps of acquiring a plurality of pictures, selecting a proper picture, splicing the pictures, synthesizing the 3D and the like, the requirements of the acquisition are greatly different from those of the 2D acquisition (for example, the 2D acquisition does not need to consider the problem of acquisition range, only the picture needs to include a required area, the 3D face acquisition range is 180 degrees, and the 3D iris acquisition only needs to be 15-30 degrees). Therefore, for a solution which is easy to think and solve for 2D acquisition, the solution is not easy to think and solve for 3D acquisition, and simple handling and simple combination cannot be achieved.

At present, a technical scheme for acquiring 3D information of different areas of the same target object according to the 3D characteristics of the different areas does not exist.

SUMMERY OF THE UTILITY MODEL

In view of the above, the present invention has been made to provide a multi-region image capturing apparatus that overcomes or at least partially solves the above-mentioned problems.

The utility model provides a multi-area image acquisition device, which comprises m image acquisition devices,

the acquisition area of the 1 st image acquisition device and the 1 st area of the target object move relatively to acquire the 1 st group of images of the 1 st area of the target object;

in the same way, the acquisition area of the mth image acquisition device and the nth area of the target object move relatively to acquire the nth group of images of the nth area of the target object, wherein m is more than or equal to 1, and n is more than or equal to 2;

the system further comprises a processing unit, a processing unit and a display unit, wherein the processing unit is used for obtaining the 3D information of the target object according to at least 3 of the plurality of images;

the device also comprises a measuring unit used for measuring the geometric dimension according to the 3D information of the corresponding area of the target object.

The utility model also provides a multi-area image acquisition device, which comprises m image acquisition devices,

the acquisition area of the 1 st image acquisition device and the 1 st area of the target object move relatively to acquire the 1 st group of images of the 1 st area of the target object;

in this way, the acquisition area of the mth image acquisition device and the nth area of the target object move relatively to acquire the nth group of images of the nth area of the target object, wherein m is more than or equal to 1, and n is more than or equal to 2.

The utility model also provides a multi-area image acquisition device, which comprises m image acquisition devices,

the acquisition area of the 1 st image acquisition device and the 1 st area of the target object move relatively to acquire the 1 st group of images of the 1 st area of the target object;

in the same way, the acquisition area of the mth image acquisition device and the nth area of the target object move relatively to acquire the nth group of images of the nth area of the target object, wherein m is more than or equal to 1, and n is more than or equal to 2;

and the processing unit is used for obtaining the 3D information of the target object according to at least 3 of the plurality of images.

Optionally, at least two of the regions comprise overlapping portions.

Optionally, at least two of the regions do not include an overlapping portion.

Optionally, the relative movement is generated by relative movement of the image acquisition device and the target object, or the relative movement is generated by optical scanning of the image acquisition device.

Optionally, a plurality of image capturing devices are mounted to the movement device.

Optionally, each image capturing device is respectively mounted on a different motion device.

Optionally, the movement device is a translation device, a rotation device or a combination thereof.

Optionally, the corresponding image capturing device has different optical characteristics according to different characteristics of different regions of the target object.

Optionally, the different characteristics of the different regions of the object include: one or more of the size of the region, the distance of the target object region from the corresponding image acquisition device, and the longitudinal depth of the region.

Optionally, in the relative movement process, two adjacent positions of each image acquisition device when acquiring an image at least satisfy the following conditions:

H*(1-cosb)＝L*sin2b；

a＝m*b；

0<m<0.8；

wherein L is the distance between the image acquisition device and the target object, H is the actual size of the target object in the acquired image, a is the included angle of the optical axes of the two adjacent position image acquisition devices, and m is a coefficient.

Optionally, in the relative movement process, when each image acquisition device acquires an image, adjacent three positions satisfy that at least a portion representing the same region of the target object exists in the three images acquired at the corresponding positions.

The utility model also provides a multizone 3D information compares device: the multi-region image acquisition device is included.

The utility model also provides a supporting thing of target generates device: and generating a matching object matched with the corresponding area of the target by utilizing the 3D information of at least one area obtained by the multi-area image acquisition equipment.

Practical novel invention and technical effect

1. For the first time, 3D acquisition is noticed and proposed for different areas of the same object, so that 3D information of the object can be obtained more accurately.

2. Aiming at different 3D characteristics of different areas of the same target object, respective special 3D acquisition units are designed, and acquisition is more accurate.

3. The guide rail or the rotating shaft is used for driving the camera, so that the camera is prevented from being used too many times, the cost is saved, and the volume is reduced.

4. Through a plurality of special 3D acquisition units corresponding to different areas, a plurality of 3D information of the target object can be acquired at one time, and the acquisition speed is improved.

5. By utilizing the rotation-reset process of the acquisition unit, when a single 3D acquisition unit is used, two areas can be acquired at one time, and the acquisition efficiency is higher.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

fig. 1 shows a schematic diagram of a specific implementation of a multi-region image capture device according to an embodiment of the present invention;

FIG. 2 illustrates a schematic diagram of one embodiment of a single track multi-zone image capture device in accordance with the present invention;

FIG. 3 shows a schematic diagram of one embodiment of a multi-zone image capture device employing an optical scanning apparatus in accordance with the present invention;

description of reference numerals:

101 face orbit, 102 iris orbit, 103 orbit, 201 face image acquisition unit, 201 iris image acquisition unit, 2011 face camera, 2021 iris camera, 2012 face motion platform, 2022 iris motion platform, 100 processing unit, 401 face optical scanning device, 402 iris optical scanning device, 4011 face light deflection unit, 4021 iris light deflection unit.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

Example 1

In order to solve the above technical problem, an embodiment of the present invention provides a multi-region image capturing device. Please refer to fig. 1, which specifically includes: the system comprises a face track 101, an iris track 102, a face image acquisition unit 201, an iris image acquisition unit 202 and a processing unit 100. Servo motors (not shown in the figure) are further included, and the face image acquisition unit 201 and the iris image acquisition unit 202 can be driven to move on the corresponding tracks 101 and 102.

The facial image capturing unit 201 includes a facial camera 2011 and, in some cases, a facial motion platform 2012, wherein the motion platform may be an one-axis motion platform, a two-axis motion platform, a three-axis motion platform, a four-axis motion platform, a five-axis motion platform, or a six-axis motion platform. The motion platform may drive the face camera 2011 for translation and/or rotation functions. The iris image capturing unit 202 includes an iris camera 2021, and in some cases, may further include an iris motion platform 2022, wherein the motion platform may be an one-axis motion platform, a two-axis motion platform, a three-axis motion platform, a four-axis motion platform, a five-axis motion platform, or a six-axis motion platform. The motion platform may drive the iris camera 2021 to perform translation and/or rotation functions.

The processing unit 100 controls the corresponding servo motor to drive the face image acquisition unit 201, and the iris image acquisition unit 202 moves on the respective rails 101 and 102, so that the face camera 2011 can rotate 180 degrees around the head of the human body, and a plurality of images of the head of the human body are shot; so that the iris camera 2021 can make a 90 ° rotation around the human eye to capture multiple images of the human iris. The face camera 2011 is also capable of rotating around the human head at any angle, e.g., 45 °, 90 °, 270 °, 360 °, depending on the actual 3D acquisition needs. Meanwhile, according to the requirement of collecting the iris, the iris information of one eye can be collected, and two eyes can also be collected. If only one eye is collected, the eye can be rotated by about 20 degrees. Meanwhile, it can be understood that the angle of rotation of the camera is related to the size of the target area, the distance from the camera to the target area, the focal length of the camera and the like. These parameters can be input and defined in advance, and the processing unit 100 controls the rotation angle of the corresponding camera after calculation. In addition, the starting point and the ending point can be identified according to the characteristics of the acquisition region, and the camera is controlled to take pictures between the starting point and the ending point. For example, the eye corner position can be recognized, and the photographing is started when the camera picture moves to the eye corner position, and the photographing is stopped when the camera picture leaves the other eye corner position. In addition, the shooting time of the camera can be not controlled, the shooting can be started at the starting point of the track, and the shooting can be stopped at the end point of the track.

The processing unit 100 receives a set of images transmitted by the face camera 2011 and the iris camera 2021, respectively, and screens out a plurality of images of the face and a plurality of images of the iris from the set of images, respectively. Then, the 3D face image is synthesized by using the plurality of face images, and the 3D iris image is synthesized by using the plurality of iris images. The synthesis method may use a method of image stitching based on adjacent image feature points, or may use other methods.

The multi-region 3D information acquisition method comprises the following steps:

and determining the range of the camera to be acquired according to the position, the transverse size and the depth size of the region to be acquired of the target object. For example, when 3D information of a face and an iris is collected, the angle range of face collection is 0-180 degrees, and the single iris collection range is about 80-100 degrees. And determining the actual rotation angle of the camera according to the distance between the camera and the target area, the focal length of the camera and other parameters by combining the ranges.

The processing unit 100 controls the corresponding servo motor to drive the face image acquisition unit 201, and the iris image acquisition unit 202 moves on the respective rails 101 and 102, so that the face camera 2011 can rotate 180 degrees around the head of the human body, and the iris camera 2021 can rotate 90 degrees around the eyes of the human body; meanwhile, during the movement, the processing unit 100 controls the shutters of the face camera 2011 and the iris camera 2021, thereby capturing a plurality of images of the human head and a plurality of images of the human iris. The rails 101 and 102 are arranged in parallel up and down.

The above-mentioned rotation and shutter can be performed simultaneously, that is, the shutter is controlled to take a picture without interrupting the rotation process of the face image capturing unit 201 or the iris image capturing unit 202.

Or stopping after the face image acquisition unit 201 or the iris image acquisition unit 202 rotates to a certain position, controlling the shutter to take a picture, and continuing the rotation process after the picture taking is finished. Namely, the shutter is continuously controlled to be interrupted to take a picture during the rotation process.

The processing unit 100 receives the two sets of images transmitted by the camera face 2011 and the iris 2021, respectively, and screens out a plurality of images of the face and a plurality of images of the iris from the face image set and the iris image set, respectively.

Then, a plurality of images of the face are used to synthesize a 3D image of the face, and a plurality of images of the iris are used to synthesize a 3D image of the iris.

The synthesis method may use a method of image stitching based on adjacent image feature points, or may use other methods.

The image splicing method comprises the following steps:

(1) processing the image sums respectively, and extracting respective feature points; features of the respective Feature points in the plurality of images may be described using a Scale-Invariant Feature Transform (SIFT) Feature descriptor. The SIFT feature descriptor has 128 feature description vectors, can describe 128 aspects of features of any feature point in direction and scale, and remarkably improves the accuracy of feature description, and meanwhile, the feature descriptor has spatial independence.

(2) And respectively generating feature point cloud data of the human face features and feature point cloud data of the iris features on the basis of the extracted multiple images and respective feature points. The method specifically comprises the following steps:

(2-1) matching the feature points of the multiple pictures according to the features of the feature points of each image in the multiple extracted images to establish a matched facial feature point data set; matching the feature points of the multiple images according to the features of the feature points of each image in the multiple extracted images 3012, and establishing a matched iris feature point data set;

and (2-2) calculating the relative position of the camera relative to the characteristic point on the space of each position according to the optical information of the camera and different positions of the camera when the plurality of images are acquired, and calculating the space depth information of the characteristic point in the plurality of images according to the relative position. Similarly, spatial depth information of feature points in a plurality of images can be calculated. The calculation may be by beam adjustment.

Calculating spatial depth information of the feature points may include: the spatial position information and the color information, that is, may be an X-axis coordinate of the feature point at a spatial position, a Y-axis coordinate of the feature point at a spatial position, a Z-axis coordinate of the feature point at a spatial position, a value of an R channel of the color information of the feature point, a value of a G channel of the color information of the feature point, a value of a B channel of the color information of the feature point, a value of an Alpha channel of the color information of the feature point, or the like. In this way, the generated feature point cloud data includes spatial position information and color information of the feature points, and the format of the feature point cloud data may be as follows:

X1 Y1 Z1 R1 G1 B1 A1

X2 Y2 Z2 R2 G2 B2 A2

……

Xn Yn Zn Rn Gn Bn An

wherein Xn represents the X-axis coordinate of the feature point at the spatial position; yn represents the Y-axis coordinate of the feature point at the spatial position; zn represents the Z-axis coordinate of the characteristic point at the space position; rn represents a value of an R channel of color information of the feature point; gn represents a value of a G channel of color information of the feature point; bn represents the value of the B channel of the color information of the feature point; an represents the value of the Alpha channel of the color information of the feature point.

And (2-3) generating feature point cloud data of the face and iris features according to the feature point data sets matched with the plurality of images and the spatial depth information of the feature points.

And (2-4) constructing a 3D model of the face and the iris according to the characteristic point cloud data so as to realize the acquisition of the 3D point cloud data of the face and the iris.

And (2-5) attaching the acquired color and texture of the target object to the point cloud data to form a 3D image of the face and the iris.

Wherein, the 3D image can be synthesized by using all the images in a group of images, and the image with higher quality can be selected from the images for synthesis.

The above-mentioned stitching method is only a limited example, and is not limited thereto, and all methods for generating a three-dimensional image from a plurality of multi-angle two-dimensional images may be used.

In the above method, the face image capturing unit 201 and the iris image capturing unit 202 both use one camera to complete the capturing of a plurality of images at different angles by the relative movement with the face and the iris.

The acquisition position during the relative movement is determined by the position of the image acquisition device 201 when the image of the target object is acquired, and the adjacent two positions at least satisfy the following conditions:

H*(1-cosb)＝L*sin2b；

a＝m*b；

0<m<1.5；

where L is the distance from the image capture device to the target object, typically the distance from the image capture device in the first position to the area directly opposite the captured target object, and m is a coefficient.

H is the actual size of the object in the captured image, which is typically a picture taken by the image capture device 201 in the first position, where the object has a true geometric size (not the size in the picture), and the size is measured along the direction from the first position to the second position. E.g., the first position and the second position are in a horizontally displaced relationship, then the dimension is measured along a horizontal cross direction of the target. For example, if the leftmost end of the target object that can be displayed in the picture is a and the rightmost end is B, the linear distance from a to B on the target object is measured and is H. The measurement method can calculate the actual distance by combining the focal length of the camera lens according to the A, B distance in the picture, and can also mark A, B on the target object and directly measure the AB linear distance by using other measurement means.

and a is an included angle of optical axes of the two adjacent position image acquisition devices.

m is a coefficient.

Because the size of the object and the concave-convex condition are different, the value of a can not be limited by a strict formula, and the value needs to be limited according to experience. According to a number of experiments, m may be within 1.5, but preferably may be within 0.8. Specific experimental data are seen in the following table:

target object	Value of m	Synthetic effect	Rate of synthesis
				Human head	0.1、0.2、0.3、0.4	Is very good	>90％
Human head	0.5、0.6	Good taste	>85％
				Human head	0.7、0.8	Is better	>80％
Human head	0.9、1.0	In general	>70％
				Human head	1.0、1.1、1.2	In general	>60％
Human head	1.2、1.3、1.4、1.5	Are synthesized relevantly	>50％
				Human head	1.6、1.7	Is difficult to synthesize	<40％

After the target and the image acquisition device 201 are determined, the value of a can be calculated according to the above empirical formula, and the parameter of the virtual matrix, i.e. the position relationship between the matrix points, can be determined according to the value of a.

In a general case, the virtual matrix is a one-dimensional matrix, for example, a plurality of matrix points (acquisition positions) are arranged in a horizontal direction. However, when some target objects are large, a two-dimensional matrix is required, and two positions adjacent in the vertical direction also satisfy the above-described a-value condition.

In some cases, even according to the above empirical formula, the value a is not easy to be determined in some cases, and in this case, the matrix parameters need to be adjusted according to the experiment, which is as follows: calculating a prediction matrix parameter a according to the formula, and controlling the camera to move to a corresponding matrix point according to the matrix parameter, for example, the camera takes a picture P1 at a position W1, and takes a picture P2 after moving to a position W2, at this time, comparing whether there is a portion representing the same region of the object in the pictures P1 and P2, i.e., P1 ≈ P2 is not empty (for example, the portion includes a human eye angle at the same time, but the shooting angle is different), if not, readjusting the value a, moving to the position W2', and repeating the comparison step. If P1 n P2 is not empty, the camera continues to be moved to the W3 position according to the a value (adjusted or unadjusted), picture P3 is taken, and again a comparison is made as to whether there is a portion of picture P1, picture P2, and picture P3 that represents the same area as the target, i.e., P1 n P2 n P3 is not empty. And synthesizing 3D by using a plurality of pictures, testing the 3D synthesis effect, and meeting the requirements of 3D information acquisition and measurement. That is, the structure of the matrix is determined by the positions of the image capturing device 201 when capturing a plurality of images, and the adjacent three positions satisfy that at least a portion representing the same region of the object exists in all of the three images captured at the corresponding positions.

The prior art mainly promotes the synthesis effect through hardware upgrading and strict calibration, and no suggestion in the prior art can ensure the effect and stability of 3D synthesis through changing the angle position when the camera shoots, and no specific optimized condition exists. The invention firstly proposes the optimization of the angle position of the camera during photographing to ensure the effect and the stability of 3D synthesis, and proposes the optimal experience condition (as above) required to be met by the camera position through repeated tests, thereby greatly improving the effect of 3D synthesis and the stability of the synthesized image. This is also one of the points of the present invention.

The above embodiment may also be provided with a third track and a third image capturing unit, a fourth track and a fourth image capturing unit, etc. for capturing nose 3D information, tooth 3D information, etc. The specific structure and control method are similar to those described above and are not described in detail. It can be understood that the number of the tracks and the number of the acquisition units can be set according to requirements, and different areas can be acquired correspondingly. Meanwhile, the track can be linear or curved, and is selected according to the general outline of the region to be measured of the target object.

Different cameras are needed due to different 3D characteristics of different parts of the human body. For example, the human face has more concave-convex parts, and the camera needs to have certain depth of field to ensure that the shot image is clear; the iris can avoid interference only by adopting an infrared camera, and 3D information of the iris can be better reflected; meanwhile, the degree of the unevenness of the iris is far less than that of the face, and the iris can be clearer only by using a macro lens.

(1) Zoom lens

After the camera shoots the target object, the proportion of the target object in the camera picture is estimated and compared with a preset value. Zooming is required to be either too large or too small. The zooming method may be: the image acquisition device is moved in the radial direction of the image acquisition device by using an additional displacement device, so that the image acquisition device can be close to or far away from the target object, and the proportion of the target object in the picture is kept basically unchanged at each matrix point.

And the distance measuring device is also included, and can measure the real-time distance (object distance) from the image acquisition device to the object. The camera position can be determined by tabulating the relational data of the object distance, the ratio of the target object in the picture and the focal length, and determining the size of the object distance according to the focal length and the ratio of the target object in the picture.

In some cases, the ratio of the target object in the picture can be kept constant by adjusting the focal length when the target object or the area of the target object changes relative to the camera at different matrix points.

Meanwhile, the depth difference of different areas of some objects is large, such as the plait of a girl, and the head of the object is obviously protruded. The depth of field requirements for the camera are high if the direct shot is taken (the applicant has first noticed the problem). At this time, the processing unit 100 controls the motion platforms 2012 and 2022 to move, and when a certain region of the target object protrudes relative to the camera, the motion platforms drive the camera to move away from the target object; when a certain area of the target object is recessed relative to the camera, the moving platform drives the camera to be close to the target object, so that the distance between the camera and different target areas of the human body is basically kept unchanged. This is one of the inventions of the present invention.

(2) Automatic focusing

In the 3D acquisition process, the distance measuring device measures the distance (object distance) h (x) from the camera to the object in real time, and sends the measurement result to the processing unit 100, the processing unit 100 looks up the object distance-focal length table, finds the corresponding focal length value, sends a focusing signal to the camera, and controls the camera ultrasonic motor to drive the lens to move for rapid focusing. Therefore, the rapid focusing can be realized without adjusting the position of the image acquisition device or greatly adjusting the focal length of the lens of the image acquisition device, and the clear picture shot by the image acquisition device is ensured. This is one of the inventions of the present invention. Of course, focusing may be performed by using an image contrast comparison method, in addition to the distance measurement method.

In the existing system, the focusing of the camera can only be performed at the beginning stage, and the camera performs a series of photographing with a fixed focal length in the whole rotation process. In this way, when the unevenness of the target object is large, the acquired image may be unclear. The existing system does not recognize the problem of 3D acquisition of the object with large concave-convex part and does not try to solve the problem. The main reason is that the existing cameras capable of automatic optical focusing are all focused before shooting, the automatic focusing is realized by pressing a shutter key, and the camera is difficult to rotate and focus at the same time, which is determined by the inherent control method of the camera. The existing cameras are designed for shooting two-dimensional pictures, the camera does not have the requirement of frequent focusing, the automatic focusing is realized by a shutter key, and no protocol and/or interface can realize external software to control focusing. In addition, the existing focusing needs a complete focusing strategy due to uncertain target objects, so that the speed is very low, the customer experience is influenced, and the existing focusing is not suitable for 3D acquisition. The distance measuring device measures the distance h (x) from the camera to an object in real time, sends the measurement result to the processing unit 100, the processing unit 100 looks up the object distance-focal length table to find a corresponding focal length value, sends a focusing signal to the camera, and controls the ultrasonic motor of the camera to drive the lens to move for rapid focusing. Therefore, the rapid focusing can be realized without adjusting the position of the image acquisition device or greatly adjusting the focal length of the lens of the image acquisition device, and the clear picture shot by the image acquisition device is ensured. This is one of the inventions of the present invention. Of course, focusing may be performed by using an image contrast comparison method, in addition to the distance measurement method. The system directly sends focusing starting signals to the camera processing unit 100 through external software, starts an internal focusing program of the processing unit 100, thereby realizing focusing of the lens of the face camera 2011 and the iris camera 2021, realizing multiple times of automatic focusing in the rotation process of the face camera 2011 and the iris camera 2021, and ensuring clear shot images. This is one of the inventions of the present invention. And simultaneously, the utility model discloses according to the relatively definite characteristics of target object, the optimization strategy of focusing, it is faster to focus the speed, just can satisfy the demand that 3D gathered.

(3) Camera and lens selection

The optical parameters of the camera may be selected in dependence on one or more of the target object characteristics, the size of the region to be captured, the distance of the target object region from the corresponding image capture device, and the longitudinal depth of the region.

For example, the iris is suitably captured using an infrared lens, an infrared camera, and a macro lens, for example, having a focal length of 100mm, is suitably used due to its small size. And the lens with the focal length of 20mm is used for face collection, and the lens with the focal length of 18-55 mm is used for furniture collection.

Example 2

On the premise of similar structure, please refer to fig. 2, only one rail 103, the face image capturing unit 201, and the iris image capturing unit 202 may be disposed on the rail 103. The face image acquisition unit 201 and the iris image acquisition unit 202 may rotate along the orbit in sequence. For example, the face image acquisition unit 201 and the iris image acquisition unit 202 are arranged side by side in the left-right direction, the face image acquisition unit 201 and the iris image acquisition unit 202 sequentially rotate from left to right along the track, and when the iris image acquisition unit 202 and the face image acquisition unit 201 sequentially rotate from right to left along the track during resetting. Alternatively, the face image capturing unit 201 and the iris image capturing unit 202 may be disposed side by side up and down, and rotate from left to right along the track.

Example 3

On the premise that other structures are similar, only one rail 103 and one image acquisition unit 203 can be arranged, and the acquisition unit can acquire the object areas which are required to be similar. For example, when acquiring 3D information of two hands (belonging to different areas of the same object), the two hands may be placed in the scanning area, the image acquisition unit sequentially takes a plurality of pictures of each hand along the orbital rotation, and then the processing unit 100 is used to respectively synthesize 3D images of the left and right hands. A similar approach can be used for both irises. A similar method can be used for both ears of the antique vase.

Example 4

The track can be replaced by a rotating device under the premise of similar structure. Namely, the image capturing unit is installed on the rotating device, and the processing unit 100 can control the rotating device to rotate to drive the image capturing unit to rotate, so that the image capturing device can capture multiple images of a certain area on the target object from different angles. For example, the rotating device drives the image acquisition device to rotate along the left eye to acquire a plurality of left-eye pictures, and continues to rotate to acquire a plurality of right-eye pictures, and after the two groups of pictures are transmitted to the processing unit 100, the processing unit 100 respectively synthesizes a left iris 3D image and a right iris 3D image. By the same token, left foot, right foot, or left hand, right hand 3D images may be acquired. Since this approach does not require a rail, the volume is smaller. This is also one of the points of the invention.

Example 5

On the premise of similar other structures, the acquisition device can replace the track with a mechanical arm. The image acquisition unit is mounted on the mechanical arm, and the multiple mechanical arms are controlled to respectively drive the multiple cameras to shoot different areas of the object.

Example 6

Referring to fig. 3, the image capturing device includes a face image capturing unit 201, an iris image capturing unit 202, a face optical scanning device 401, and an iris optical scanning device 402, so that the capturing regions of the image capturing devices 201, 202 and the target object move relatively when the image capturing devices 201, 202 are not moved or rotated.

The face optical scanning device 401 and the iris optical scanning device 402 further include a face light deflecting unit 4011 and an iris light deflecting unit 4021. Optionally, the light deflection unit is driven by the light deflection driving unit, the physical position of the image acquisition device is not changed, that is, the image acquisition device is not moved or rotated, the acquisition area of the camera is changed to a certain extent through the light deflection unit to realize that the target object and the acquisition area are changed, and in the process, the light deflection units 4011 and 4021 can be driven by the light deflection driving unit to enable light in different directions to enter the image acquisition device. The light deflection driving unit may be a driving device that controls the linear motion or rotation of the light deflection units 4011, 4021. The light deflection driving unit and the camera are both connected with the control terminal, and the control terminal is used for controlling the rotating shaft driving device to drive and shoot by the camera.

The control terminal can be selected from a processing unit, a computer, a remote control center and the like.

The image acquisition device can be replaced by other image acquisition devices such as a video camera, a CCD (charge coupled device), an infrared camera and the like. Meanwhile, the image acquisition device is fixed on the mounting platform, and the position is fixed without change.

The light deflection driving unit can be selected from a brushless motor, a high-precision stepping motor, an angle encoder, a rotating motor and the like.

The light deflection units 4011 and 4021 are mirrors, it can be understood that one or more mirrors may be provided according to measurement requirements, and the light deflection driving unit may be correspondingly provided with one or more mirrors and controls the angle of the plane mirror to change so that light in different directions enters the image acquisition device;

the light deflection units 4011 and 4021 are lens groups, one or more lenses can be arranged in each lens group, one or more light deflection driving units can be correspondingly arranged, and the angles of the plane mirrors are controlled to change, so that light rays in different directions enter the image acquisition device;

the light deflection units 4011 and 4021 comprise a light deflection unit rotating body and a plurality of light deflection unit sub-lenses of different specifications, the rotating axis of the light deflection unit rotating body is parallel to the central axis of the lens of the image acquisition device and deviates a certain distance, so that light rays in different directions enter the image acquisition device after passing through the light deflection unit sub-lenses arranged on the circumference of the front end of the light deflection unit rotating body, and the light deflection driving unit controls the light deflection unit rotating body to rotate. It can be understood that the light beam deflection unit sub-lenses with different specifications can be replaced by different slightly angle-changing reflectors;

the light deflection units 4011, 4021 include polygon mirrors.

The utility model discloses well target object can be an entity object, also can be a plurality of object components.

The 3D information of the object includes a 3D image, a 3D point cloud, a 3D mesh, local 3D features, 3D dimensions and all parameters with 3D features of the object.

The utility model discloses the so-called 3D, three-dimensional mean have XYZ three direction information, especially have degree of depth information, and only two-dimensional plane information has essential difference. It is also fundamentally different from some definitions, called 3D, panoramic, holographic, three-dimensional, but actually only comprising two-dimensional information, in particular not depth information.

The collection area of the present invention is the range that the image collection device (e.g., camera) can take.

The utility model provides an image acquisition device can be CCD, CMOS, camera, industry camera, monitor, camera, cell-phone, flat board, notebook, mobile terminal, wearable equipment, intelligent glasses, intelligent wrist-watch, intelligent bracelet and have all equipment of image acquisition function.

In the above embodiments, the image capturing unit is moved to obtain a plurality of pictures at different angles, and it can be understood that the image capturing unit may also be moved or rotated to obtain the pictures at different angles in a plurality of regions of the target, so that a 3D image of the target corresponding to the plurality of regions can be generated.

The solution of the above embodiment can be used to acquire 3D images of more regions as well. For example, 3D images of a human face, an iris, a nose and teeth can be simultaneously acquired by adding tracks, and 3D images of the whole human body, hands, feet, a head and an abdomen can be simultaneously acquired. That is, the scheme of the invention can acquire 3D information of a plurality of regions of the same object, and the regions can be in an inclusion relationship (such as the face and the nose; the whole human body and the head), an overlapping relationship (such as the palm front part and the palm root which are overlapped with each other), an independent relationship (such as the left hand and the right hand), and the overlapping relationship and the inclusion relationship can be collectively called as an overlapping relationship. That is to say, the invention can collect the 3D information of the target object from the whole and a plurality of local parts, so that the information acquisition is more comprehensive and accurate. The method is more accurate in subsequent comparison or design by using 3D information.

One camera can be used for shooting one area, one camera can be used for shooting a plurality of areas, and the two modes can be combined to form the corresponding relation between the m cameras and the n areas.

The 3D information of multiple regions of the target obtained in the above embodiments can be used for comparison, for example, for identification of identity. Firstly, the scheme of the invention is utilized to acquire the 3D information of the face and the iris of the human body, and the information is stored in a server as standard data. When the system is used, for example, when the system needs to perform identity authentication to perform operations such as payment and door opening, the 3D acquisition device can be used for acquiring and acquiring the 3D information of the face and the iris of the human body again, the acquired information is compared with standard data, and if the comparison is successful, the next action is allowed. It can be understood that the comparison can also be used for identifying fixed assets such as antiques and artworks, namely, the 3D information of a plurality of areas of the antiques and the artworks is firstly acquired as standard data, when the identification is needed, the 3D information of the plurality of areas is acquired again and compared with the standard data, and the authenticity is identified.

The 3D information of multiple regions of the target object obtained in the above embodiments can be used to design, produce, and manufacture a kit for the target object. For example, 3D data of the head of a human body is obtained, and a more suitable hat can be designed and manufactured for the human body; the human head data and the 3D eye data are obtained, and suitable glasses can be designed and manufactured for the human body.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.

The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It will be appreciated by those skilled in the art that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components of a visible light camera based biometric four-dimensional data acquisition apparatus according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Thus, it should be appreciated by those skilled in the art that while a number of exemplary embodiments of the invention have been illustrated and described in detail herein, many other variations or modifications consistent with the principles of the invention may be directly determined or derived from the disclosure of the present invention without departing from the spirit and scope of the invention. Accordingly, the scope of the invention should be understood and interpreted to cover all such other variations or modifications.

Claims (11)

1. A multi-region image capture device, characterized by: comprises m image acquisition devices, a plurality of image acquisition devices,

the acquisition area of the 1 st image acquisition device and the 1 st area of the target object move relatively to acquire the 1 st group of images of the 1 st area of the target object;

in the same way, the acquisition area of the mth image acquisition device and the nth area of the target object move relatively to acquire the nth group of images of the nth area of the target object, wherein m is more than or equal to 1, and n is more than or equal to 2;

the plurality of image acquisition devices are arranged on the movement device; each image acquisition device is respectively arranged on different motion devices;

the installation of the plurality of image acquisition devices in the movement device specifically comprises: the system comprises a face track, an iris track, a face image acquisition unit, an iris image acquisition unit and a processing unit; the face image acquisition unit and the iris image acquisition unit can be driven to move on the corresponding tracks.

2. The multi-region image acquisition device of claim 1, wherein: at least two of the regions include overlapping portions.

3. The multi-region image acquisition device of claim 1, wherein: at least two of the regions do not include an overlapping portion.

4. The multi-region image acquisition device of claim 1, wherein: the relative movement is generated by the relative movement of the image acquisition device and the target object, or the relative movement is generated by the optical scanning of the image acquisition device.

5. The multi-region image acquisition device of claim 1, wherein: the movement device is a translation device, a rotation device or a combination thereof.

6. The multi-region image acquisition device of claim 1, wherein: the corresponding image acquisition device has different optical characteristics according to different characteristics of different areas of the target object.

7. The multi-region image acquisition device of claim 6, wherein: the different characteristics of the different regions of the object include: one or more of the size of the region, the distance of the target object region from the corresponding image acquisition device, and the longitudinal depth of the region.

8. The multi-region image acquisition device of claim 1, wherein: in the relative movement process, the adjacent two positions of each image acquisition device when acquiring images at least meet the following conditions:

H*(1-cosb)＝L*sin2b；

a＝m*b；

0<m<0.8；

wherein L is the distance between the image acquisition device and the target object, H is the actual size of the target object in the acquired image, a is the included angle of the optical axes of the two adjacent position image acquisition devices, and m is a coefficient.

9. The multi-region image acquisition device of claim 1, wherein: in the relative movement process, when each image acquisition device acquires an image, the adjacent three positions meet the condition that at least parts of the three images acquired at the corresponding positions represent the same area of the target object.

10. The utility model provides a 3D information compares device which characterized in that: comprising a multi-region image acquisition device according to any of the claims 1-9.

11. A kit generating device, comprising: generating a matching object matched with a corresponding area of the target by using the at least one area 3D information obtained by the multi-area image acquisition equipment of any one of claims 1 to 9.

Images