WO2019223449A1

WO2019223449A1 - Image acquisition device, image acquisition method, electronic device, and imaging apparatus

Info

Publication number: WO2019223449A1
Application number: PCT/CN2019/082459
Authority: WO
Inventors: 王曙光
Original assignee: 印象认知（北京）科技有限公司
Priority date: 2018-05-25
Filing date: 2019-04-12
Publication date: 2019-11-28

Abstract

Disclosed in the embodiments of the present invention are an image acquisition device, an image acquisition method, an electronic device, and an imaging apparatus. The image acquisition device comprises a light-blocking film, at least two first imaging holes located in the light-blocking film and used for pinhole imaging, and an image sensor located at one side of the light-blocking film. Light emitted from a target object is directed to the image sensor by means of the first imaging holes, the at least two first imaging holes are used for obtaining at least two images of the target object, and a 3D model of the target object is established according to the at least two images. According to the embodiments of the present invention, image acquisition is performed by means of pinhole imaging, instead of using a camera occupying a large area in the prior art, and because the area occupied by imaging holes for pinhole imaging is much less than that occupied by the camera, the use area can be greatly reduced, and thus, when being applied to terminal devices such as a mobile phone, a larger area can be provided to the screen, and a higher screen-to-body ratio is provided.

Description

Image acquisition equipment, image acquisition method, electronic equipment and imaging device

This application claims the priority of a Chinese patent application filed on May 25, 2018 with the State Administration of China, with the application number 201810515528.0 and the invention name "An Image Acquisition Device and Image Acquisition Method", and November 02, 2018 The priority of a Chinese patent application filed with the State Council of the People's Republic of China on the Japanese Patent Application No. 201811302715.7 and the invention name is "Image Acquisition Equipment, Image Acquisition Method, Electronic Equipment and Imaging Device", the entire contents of which are incorporated herein by reference.

Technical field

Embodiments of the present invention relate to the field of image acquisition technologies, and in particular, to an image acquisition device and an image acquisition method.

Background technique

At present, in order to greatly increase the display area of a mobile phone, a bangs screen as shown in FIG. 1 may be used. The front camera 11, the speaker 12, and the ambient light sensor (not shown in FIG. 1) on the mobile phone are all arranged at the fringe part 1. The peripheral positions other than the fringe part 1 can be designed with a narrow border or a borderless design.

For a mobile phone using face recognition technology, the existing technology is to set an infrared light source 13 and an infrared camera 14 required for facial image collection at the fringe portion 1. And in order to realize 3D face recognition, two infrared cameras 14 need to be provided. The infrared camera 14 has a larger diameter, which will increase the area of the fringe part 1 and affect the visual experience of the user.

Summary of the Invention

An embodiment of the present invention provides an image acquisition device to solve the problem that an infrared camera on an existing image acquisition device takes up space.

In a first aspect, an embodiment of the present invention provides an image acquisition device, including a light blocking film, at least two first imaging holes in the light blocking film used for small hole imaging, and a light blocking film located in the light blocking film. Side image sensor, the light emitted by the target is directed toward the image sensor through the first imaging hole, and the at least two first imaging holes are used to obtain at least two images of the target, according to the at least two The image creates a 3D model of the target.

Further, the image acquisition device further includes an infrared light source, the infrared light source is used to irradiate the target and generate reflected light, and the reflected light is directed toward the image sensor through the first imaging hole according to a small-hole imaging principle. And imaging.

Further, the image acquisition device further includes a display screen, and the display screen faces the target.

Further, the first imaging hole is located in a non-display area of the display screen, and the non-display area includes a frame portion and a fringe portion of the image acquisition device.

Further, the first imaging hole is located in a display area of the display screen, and the display screen is provided with a light transmitting hole corresponding to the first imaging hole, and the light emitted by the target passes through the light transmitting in order. The hole and the first imaging hole are directed toward the image sensor.

Further, the display screen includes a light-emitting board, a light-emitting unit is provided on the light-emitting board, the light-transmitting holes are disposed in the light-emitting board, and the first imaging holes correspond to the light-transmitting holes one by one, Each of the light transmitting holes occupies a position of a light emitting unit or a position of a pixel.

Further, a cavity corresponding to the first imaging hole is provided in the image sensor, and a photosensitive portion is provided at the bottom of the cavity.

Further, a convex lens is provided on a side of the first imaging hole near the image sensor, and the convex lens shrinks a light spot formed by light emitted from each point on the target after passing through the first imaging hole. And form a smaller image spot on the image sensor.

Further, each of the first imaging holes is used to acquire a complete image of a target.

Further, the diameter of the first imaging hole is 5 micrometers to 100 micrometers.

Further, a distance between the centers of each two of the first imaging holes is 1 mm to 100 mm.

Further, a distance between the first imaging hole and a photosensitive portion of the image sensor is 1 mm to 4 mm.

Further, the first imaging hole is suitable for acquiring an image of a target object that is 5 cm to 100 cm away from the first imaging hole.

Further, the light blocking film is further provided with a second imaging hole for small hole imaging, and the first imaging hole and the second imaging hole are used to acquire images of different targets.

Further, the second imaging hole is used to collect a fingerprint image.

Further, the first imaging hole and the second imaging hole share an image sensor.

Further, the first imaging hole and the second imaging hole on the light blocking film are obtained by photolithography using the same layer of photolithographic mask.

In a second aspect, an embodiment of the present invention further includes an image acquisition method, including:

Use at least two imaging holes to acquire an image of a target object through a small hole imaging principle, and each of the imaging holes corresponds to an image of the target object;

A 3D model is established based on images corresponding to the at least two imaging holes.

Further, the step of acquiring an image of a target object through the small hole imaging principle by using at least two imaging holes includes:

The infrared object is irradiated, and an infrared image of the target is acquired by using the at least two imaging holes through a small-hole imaging principle.

Further, the method further includes:

A convex lens is provided behind each of the imaging holes to constrain the light path, so that the diameter of the spot imaged at each point on the target is reduced.

Further, the image includes a face image and an image for motion capture, the face image is for establishing a 3D face model, and the image for motion capture is used to obtain a 3D motion model.

According to a third aspect, an embodiment of the present invention further provides an electronic device, including the image acquisition device described in the first aspect.

According to a fourth aspect, an embodiment of the present invention further provides an imaging device, which includes an imaging hole for imaging a small hole, and a convex lens on one side of the imaging hole, where the convex lens passes light emitted from each point on the target through The light spot formed after the imaging hole shrinks again and forms a smaller image spot.

According to a fifth aspect, an embodiment of the present invention further provides an image acquisition device, including a light blocking film and an image sensor located on one side of the light blocking film. The light blocking film is provided with a first for imaging a small hole. An imaging hole, where the light emitted by the target is directed to the image sensor through the first imaging hole, and the first imaging hole is used to obtain an image of the target.

In the embodiment of the present invention, a small-hole imaging method is used instead of the camera in the prior art to occupy a large area for image acquisition. Because the imaging hole area used for small hole imaging is much smaller than the camera, it can greatly reduce the use area, so when applied to terminal devices such as mobile phones, it can provide a larger area to the screen and provide a higher screen Proportion.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to explain the technical solution of the embodiments of the present invention more clearly, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, the premise of not paying creative labor is obvious. Next, other drawings can also be obtained based on these drawings.

FIG. 1 is a schematic structural diagram of a Liu Haiping in the prior art; FIG.

2 is a schematic cross-sectional view of an image acquisition device according to an embodiment of the present invention;

3 is a schematic cross-sectional view of another image acquisition device according to an embodiment of the present invention;

4 is a schematic plan view of an image acquisition device according to an embodiment of the present invention;

5 is an exploded schematic diagram of an image acquisition device according to an embodiment of the present invention;

6 is a schematic cross-sectional view of another image acquisition device according to an embodiment of the present invention;

7 is a schematic plan view of a light-emitting board in an image acquisition device according to an embodiment of the present invention;

8 is a schematic diagram showing a positional relationship between a point on a target and an imaging hole;

FIG. 9 is a light path diagram of a light spot formed on a target after passing through an imaging hole;

FIG. 10 is a light path diagram of a spot formed on a target after passing through an imaging hole and a convex lens;

FIG. 11 is a light path diagram of a spot formed on a target after passing through an imaging hole and a convex lens;

FIG. 12 is a light path diagram of a spot formed on a target after passing through an imaging hole and a convex lens having a short focal length;

13 is a schematic cross-sectional view of another image acquisition device according to an embodiment of the present invention;

14 is a schematic cross-sectional view of another image acquisition device according to an embodiment of the present invention;

15 is a schematic plan view of an image acquisition device according to an embodiment of the present invention;

16 is a schematic plan view of a light blocking film in an image acquisition device according to an embodiment of the present invention;

17 is a schematic plan view of a light-emitting board in an image acquisition device according to an embodiment of the present invention;

18 is a schematic flowchart of an image acquisition method according to an embodiment of the present invention;

19 is a schematic cross-sectional view of another image acquisition device according to an embodiment of the present invention;

20 is a schematic cross-sectional view of another image acquisition device according to an embodiment of the present invention;

FIG. 21 is a schematic cross-sectional view of another image acquisition device according to an embodiment of the present invention.

Among them, 1. bangs; 11. front camera; 12. speaker; 13. infrared light source; 14. infrared camera; 2. light blocking film; 21. first imaging hole; 22; second imaging hole; 3. image Sensor; 31. Cavity; 32. Photosensitive part; 4. Light-emitting board; 41. Light-transmitting hole; 42; Light-emitting unit; 43, Circuit network; 5. Convex lens; A. Point on target; B. Imaging hole; C, light spot; C 'like spot.

Detailed ways

In order to make the foregoing objects, features, and advantages of the present invention more comprehensible, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

An inventive concept of the present invention is to use a small-hole imaging method instead of using a camera occupying a relatively large area in the prior art to perform image acquisition. Because the imaging hole area used for small hole imaging is much smaller than the camera, it can greatly reduce the use area, so when applied to terminal devices such as mobile phones, it can provide a larger area to the screen and provide a higher screen Proportion.

As shown in FIG. 2, an image acquisition device provided by an embodiment of the present invention includes a light blocking film 2, at least two first imaging holes 21 for imaging a small hole in the light blocking film 2, and the light blocking film For the image sensor 3 on the side of the film 2, light is emitted toward the image sensor 3 through the first imaging hole 21. The at least two first imaging holes 21 are used to obtain at least two images of the same target object, and a 3D model of the target object is established according to the principle of parallax. Each first imaging hole 21 can collect a complete image of a target object, for example, can be used to collect a complete human face. Based on the collected face images, a 3D face model can be established for face recognition. An image for motion capture may also be acquired using the first imaging hole 21. According to at least two images of the same target, the spatial position of the target is restored according to the principle of parallax, and the spatial position is tracked to obtain the target's motion trajectory, thereby completing motion capture. Motion capture can be applied in the fields of animation production, gait analysis, biomechanics, ergonomics and other fields.

The existing camera uses the lens imaging principle to collect images. Compared with lens imaging, small-hole imaging does not require focusing and takes up a smaller area. However, in general, the image resolution obtained by pinhole imaging will be lower than that of lens imaging, and the total energy of the captured light will also be lower than that of lens. Therefore, the pinhole imaging method is more suitable for scenes that do not require high resolution and contrast, such as face recognition or motion capture. The requirements for face recognition are far lower than the requirements for selfies. Generally speaking, lens cameras for selfies are more suitable.

Based on the foregoing inventive concept, in another implementation manner, referring to FIG. 19, an image acquisition device is provided, which includes a light blocking film 2 and an image sensor 3 located on one side of the light blocking film 2. There is a first imaging hole 21 for small hole imaging. The light emitted by the target is directed toward the image sensor 3 through the first imaging hole 21, and the first imaging hole 21 is used to obtain an image of the target.

Compared with the former image acquisition device, the difference between the image acquisition device in this implementation manner and the following is that only one first imaging hole is opened in the light blocking film. Since only one imaging hole is opened, the image sensor accordingly only captures an image of a target object, and a 3D model of the target object is not established.

Compared with opening a first imaging hole in the light blocking film, opening a plurality of first imaging holes has various beneficial effects. First, when multiple first imaging holes are opened, the image sensor can correspondingly capture images of multiple targets, thereby using the images of the multiple targets to build a 3D model of the target based on the principle of parallax to present to the user The 3D effect of the target. Second, the opening of multiple first imaging holes can increase the total amount of incoming light and increase the brightness of the image collected by the image sensor. Third, opening multiple first imaging holes is beneficial to improving the resolution of the acquired image. Fourth, opening a plurality of first imaging holes is beneficial to widen the angle of view of the images collected by the image sensor.

The image acquisition device may also be provided with an infrared light source 13 for emitting infrared rays, such as an infrared lamp, or an infrared fill light. In a dark environment, the infrared light source 13 can be turned on. When an image of the target is collected, the infrared light source 13 illuminates the target. The target reflects infrared light to generate reflected light. The reflected light passes through the first imaging hole 21 according to the principle of small hole imaging. It shoots at the image sensor 3 and forms an image, thereby acquiring an infrared image. In addition, infrared rays emitted by the target itself can also be radiated to the image sensor 3 through the first imaging hole 21 to acquire an infrared image.

As shown in FIG. 2 or FIG. 19, a cavity 31 corresponding to the first imaging hole 21 is provided in the image sensor 3, and a photosensitive portion 32 is provided at the bottom of the cavity 31. The arrangement of the cavity 31 may be as shown in FIG. 2 or FIG. 19, and all the first imaging holes 21 correspond to one cavity 31. In order to save the area of the sensing part, as shown in FIG. 3, the first imaging holes 21 and the cavity 31 may correspond one-to-one.

The image acquisition device can be applied to any electronic device that requires image acquisition. These electronic devices can be provided with a display screen or not. When the image acquisition device is applied to an electronic device provided with a display screen, the image acquisition device further includes a display screen. Generally speaking, the display screen faces the user's face. When the user's face is the target, the display screen is also facing the target. In the prior art, the plane on which the display screen is located often includes a display area and a non-display area. For example, the non-display area includes a frame portion and / or a fringe portion 1. A light-emitting board 4 is provided in a display area of the display screen, and the light-emitting board 4 is composed of a light-emitting unit. By controlling the light-emitting unit to emit light, various patterns can be displayed.

The first imaging hole 21 may be located in a non-display area on a plane where the display screen is located, and it is described below that the first imaging hole 21 is located in the fringe portion 1. As shown in FIGS. 4 and 5, the bangs part 1 of the display screen is located in the non-display area. The bangs part 1 is provided with a first imaging hole 21 for small hole imaging, and an image sensor 3 is disposed below the first imaging hole 21. To accept the image of the target through the pinhole imaging principle. The infrared light source 13 may be provided on the fringe portion 1.

Since the embodiment of the present invention uses the principle of small hole imaging to collect an image of a target, the diameter of the imaging hole used for small hole imaging is smaller than the diameter of the camera, so the imaging hole of the embodiment of the present invention can occupy a small space.

The first imaging hole 21 may also be located in a display area of a display screen. In this embodiment, a light transmitting hole 41 corresponding to the first imaging hole 21 is provided in the display screen, and light passes through the light transmitting hole 41 in sequence. The first imaging hole 21 is directed toward the image sensor 3. The light transmitting hole 41 may be located in the light emitting plate 4. As shown in FIG. 6, FIG. 7 and FIG. 20, the light-emitting board 4 may be an organic light-emitting diode (OLED) light-emitting board. The OLED light-emitting board is provided with a plurality of light-emitting units 42. Each (for example, three for each of red, green, and blue) light-emitting units 42 corresponds to one pixel, and the color of light emitted by each pixel on the light-emitting board 4 can be controlled to display a corresponding pattern. The first imaging holes 21 correspond to the light transmitting holes 41 one by one, and each of the light transmitting holes 41 occupies a position of a light emitting unit 42. That is, the light-emitting unit 42 may not be provided at the position of the light-transmitting hole 41. The light transmitting hole 41 may be a through hole or filled with a transparent material. When the light-transmitting hole 41 has a larger area than one light-emitting unit 42, more light-emitting units 42 may be occupied. In the embodiment of the present invention, the number of the light-emitting units 42 occupied by the light-transmissive holes 41 may be specifically limited according to the size of the light-transmissive holes and the size of the position occupied by one light-emitting unit 42. The number is not necessarily. As for a display screen generally used for human eyes, the pixel size is around 50 microns, so it is sufficient to cut out one pixel to form a light-transmissive hole 41, that is, a light-transmissive hole 41 can occupy only one pixel The location of the point.

When the first imaging hole is located in the non-display area of the display screen, because the non-display area is generally located at the edge of the display screen, the space below is limited, and larger components or electronic equipment parts cannot be installed, such as a relatively large camera Wait. When the first imaging hole is located in the display area of the display screen, the space below is relatively large, and relatively large-sized components or parts that could not be installed can be installed.

As shown in FIG. 7, the light-emitting board 4 further includes a circuit network 43 that drives each light-emitting unit 42. In this embodiment, when the light-transmitting hole 41 occupies a position of a light-emitting unit 42, the light-emitting unit 42 is not provided at the position of the light-transmitting hole 41, and there is no need to control the circuit of the light-emitting unit 42, so any light can be emitted. The unit 42 and a portion where the circuit controls the unit 42 are provided as light transmitting holes 41.

In the embodiment of the present invention, a diameter of the first imaging hole 21 may be 5 μm to 50 μm. The distance between the centers of each two of the first imaging holes 21 may be 1 mm to 100 mm. The distance between the first imaging hole 21 and the photosensitive portion 32 of the image sensor 3 may be 1 mm to 4 mm, that is, the depth of the cavity 31 in the image sensor 3 may be 1 mm to 4 mm. . The first imaging hole 21 and the image sensor 3 provided in this way may be suitable for collecting a face image of 5-100 cm from the first imaging hole 21 or the screen.

In the pinhole imaging method used in the present invention, the larger the aperture of the imaging hole, the larger the light energy received, but the sharpness will also decrease. As shown in Figures 8 and 9, the light emitted by point A on the target will pass through the imaging hole B and become a light spot C that is larger than the imaging hole B. The larger the aperture of the imaging hole B, the more light spot C is formed The larger the image, the less clear it will be. If the imaging hole B is small, less light energy is obtained and it is difficult to image. In addition, when the imaging hole is small, the diffraction of light will also become serious, which will also reduce the sharpness of the image. The imaging hole B is a hole for imaging a small hole.

In order to solve this problem, the present invention also proposes an idea. As shown in FIG. 10, a convex lens 5 is added after the imaging hole B, and the light emitted by the point A on the target is formed after passing through the imaging hole B. The light spot shrinks again to become a smaller image spot C ', thereby improving the sharpness of the image. Both surfaces of the convex lens 5 may be curved surfaces. In actual production, a layer of glass or other transparent medium may be provided behind the imaging hole B. At this time, as shown in FIG. 11, the convex lens may be set as a plano-convex lens, that is, one side is a flat surface, the other side is a curved surface, and the flat side is pasted It is easy to install and install on glass or transparent media.

It is worth noting that not all convex lenses increase sharpness. As shown in FIG. 12, if the focal length of the convex lens 5 is too short, the light will diverge after converging. At this time, the image spot C 'may instead become larger, thereby reducing the sharpness. In general, if the distance between the center of the convex lens 5 and the light receiving part of the image sensor is L, the focal length of the convex lens 5 is set between 2L and L / 2 to reduce the image spot and improve sharpness. If the focal length is greater than 2L, it can still have an effect, but the effect will be reduced. In general, the focal length is best when set to L.

In the embodiment of the present invention, as shown in FIGS. 13 and 21, a convex lens 5 may be provided on a side of the first imaging hole 21 near the image sensor 3, and the convex lens 5 emits each point on the target. The light spot formed by the light passing through the first imaging hole 21 shrinks again, and a smaller image spot is formed on the image sensor 3. The convex lens 5 can constrain the light path, reduce the diameter of the spot imaged by each point on the target, and improve the resolution of the image. As shown in FIGS. 13 and 21, both surfaces of the convex lens 5 may be curved surfaces, or as shown in FIG. 14, one surface is a flat surface and the other surface is a curved surface. The convex lens is a microlens, and the diameter can be 10 micrometers to 1000 micrometers. In a specific implementation, the focal length of the convex lens 5 may be half to infinity of the image distance of the small hole imaging. The image distance of the small hole imaging can also be said to be the depth of the cavity. Preferably, the focal length of the convex lens 5 is equal to the image distance of the small hole imaging. The focal length of the convex lens 5 may be 100 micrometers to 1 millimeter.

If the target is a human face and the first imaging hole 21 is located on a terminal device, such as a mobile phone, a typical value is like this:

The distance between the human face and the first imaging hole 21 is 20 cm to 40 cm, and the distance between the first imaging hole 21 and the photosensitive portion 32 of the image sensor 3 is 1 mm.

At this time, the convex lens 5 can be close to the first imaging hole 21, and the focal length of the convex lens 5 can be set to 1 mm, so that the light emitted by each point on the human face can be approximately regarded as parallel light after passing through the small hole. Therefore, it will focus on the focus, that is, on the light-sensitive portion 32. This will get better or best sharpness.

Preferably, the axis of the convex lens 5 may pass through the center of the first imaging hole, and the convex lens 5 may be close to the first imaging hole 21 or may be spaced at a certain distance. When the convex lens 5 is close to the first imaging hole 21, the center of the convex lens 5 and the center of the first imaging hole 21 can be approximately considered.

On the other hand, the distance between the center of the convex lens 5 and various points on the light-receiving portion 32 varies, and is generally not completely the same, but the focal length of the convex lens 5 is not easy to change after it is set. When selecting the focal length of the convex lens 5, the focal length may be selected based on the positions of the points on the most frequently used or most important light-sensing part 32. Generally speaking, the light-sensing part closest to the center of the imaging hole is the most important.

The distance between the centers of each two of the first imaging holes 21 is 1 mm to 100 mm, which is a common distance. In a specific implementation, the distance between the centers of each two first imaging holes 21 The distance can be larger than 100 millimeters. The larger the distance is, the larger the parallax of the image collected by each first imaging hole 21 is, which is more helpful for establishing a 3D model of the target. For example, as shown in FIG. 15, the two first imaging holes 21 are respectively located on the left and right sides of the display screen. In the same way, the two first imaging holes 21 may be respectively located on the upper and lower sides of the display screen. When the distance between the first imaging holes 21 is large, each first imaging hole 21 may correspond to a different image sensor 3.

As shown in FIG. 16, when the first imaging hole 21 is located in the display area, a second imaging hole 22 for imaging a small hole may be further provided in the light blocking film 2, the first imaging hole 21 and the second imaging hole 21 The imaging holes 22 have different diameters and are used to acquire images of different targets. The second imaging hole 22 can be used to collect a fingerprint image. The first imaging hole 21 and the second imaging hole 22 share the image sensor 3, thereby simplifying the structure and reducing the manufacturing cost of the image sensor 3. The diameter of the second imaging hole 22 may be 5 micrometers to 50 micrometers. The fingerprint required for collecting fingerprints is higher than that required for collecting faces, so in general, smaller holes are needed. However, if you have a very precise image sensor, you can use the same small holes to capture faces and fingerprints.

As shown in FIG. 17, the light-emitting board 4 is provided with a light-transmitting hole 41 corresponding to the second imaging hole 22. Since the light-transmitting hole 41 corresponding to the second imaging hole 22 is larger than the light-transmitting hole corresponding to the first imaging hole 21 41 is small, and the circuit network 43 separates the light-emitting board 4 into multiple light-transmitting areas, so the light-transmitting hole 41 corresponding to the second imaging hole 22 can be provided in the light-transmitting area, and the light-emitting unit 42 and the circuit network 43 will not be damaged. . The light used for collecting fingerprints can be shot into the image sensor 3 through the light transmitting hole 41 and the second imaging hole 22 in this order. The transparent hole 41 corresponding to the second imaging hole 22 may be a through hole or filled with a transparent material.

When the first imaging hole and the second imaging hole are opened in the light blocking film, a photolithography process can be used to achieve the same. Generally, if an imaging hole is opened, a lithographic mask is usually used. If multiple imaging holes with different sizes need to be opened, multiple layers of photolithographic masks will be used to complete them. In the solution of the present application, the first imaging hole and the second imaging hole with different diameters may be opened, and a photolithographic mask may be adopted. That is, a layer of lithographic mask has the purpose of opening a plurality of imaging holes with different diameters at the same time, thereby saving preparation costs.

A plurality of second imaging holes 22 may be provided in the light blocking film 2, and the second imaging holes 22 may be arranged in an array. The image sensor 3 is provided with a cavity 31 corresponding to the second imaging hole 22, and a photosensitive portion 32 is provided at the bottom of the cavity 31. The depth of the cavity 31 corresponding to the second imaging hole 22 may be different from the depth of the cavity 31 corresponding to the first imaging hole 21. All the second imaging holes 22 may correspond to one cavity 31, or each second imaging hole 22 corresponds to one cavity 31, that is, the second imaging holes 22 correspond to the cavity 31 one-to-one.

The set of the first imaging hole 21 and the set of the second imaging hole 22 may be located in different regions of the light blocking film 2. The second imaging hole 22 may also be disposed around the first imaging hole 21. The arrangement of the second imaging holes 22 is specifically limited.

It should be understood that the foregoing descriptions of the structures or components such as the first imaging hole, the image sensor, the display screen, the light transmission hole, the convex lens, and the second imaging hole are mainly based on the image acquisition device of multiple first imaging holes as an example. To describe, but these structures are also applicable to an image acquisition device having only one first imaging hole.

As shown in FIG. 18, an embodiment of the present invention further provides an image acquisition method. The method may include:

Step 1801: Use at least two imaging holes to acquire an image of a target object through a small hole imaging principle, and each of the imaging holes corresponds to an image of the target object.

In a specific implementation, infrared irradiation can be turned on, the target is irradiated with infrared, and an infrared image of the target is acquired by using the at least two imaging holes through the principle of small hole imaging.

A convex lens may be provided after each of the imaging holes to constrain the light path, so that the diameter of the spot imaged at each point on the target is reduced.

Step 1802: Establish a 3D model according to the images corresponding to the at least two imaging holes.

The image includes a face image and an image for motion capture, the face image is used to build a 3D face model, and the image for motion capture is used to obtain a 3D motion model.

The image acquisition method provided in this embodiment is applied to the foregoing image acquisition device. For the specific process and description of the image acquisition method, reference may be made to the description of the image acquisition device described above, and the image acquisition method is not described in detail here.

An embodiment of the present invention further provides an electronic device including the image acquisition device as described above. The electronic device may include a mobile phone, a tablet computer, a smart bracelet, a video camera, a Personal Digital Assistant (PDA), and the like.

Based on the aforementioned inventive concept of using a small hole imaging method instead of using a camera occupying a large area in the prior art, and the aforementioned inventive concept of adding a convex lens after the imaging hole to improve the sharpness of the image, another aspect of the present application is In an implementation manner, an imaging device is provided. Please refer to FIG. 10 and FIG. 11. The imaging device includes an imaging hole B for small hole imaging, and a convex lens 5 on the side of the imaging hole B. The convex lens 5 passes light emitted from each point on the target through the imaging hole. The spot formed after B shrinks again and forms a smaller image spot C '.

That is, for a point A on the object on the other side of the imaging hole B, the light emitted by it passes through the imaging hole B to form a light spot. The convex lens 5 shrinks this light spot to form a spot smaller than the light spot. Like spot C '.

By adopting the imaging device, the light spot formed by each point of the entire target object is shrunk, and the resolution of the obtained target object image is accordingly improved.

Optionally, the imaging device may be applied to a smart terminal, such as a wearable device, a mobile phone, a tablet computer, a personal computer (PC), etc., as a component of an image acquisition device or an image acquisition device.

Optionally, the smart terminal includes a display screen, the display screen is disposed on the other side of the imaging hole, and the display screen is provided with a light transmitting hole corresponding to the imaging hole; The light emitted by the dots passes through the light transmitting hole and the imaging hole in order to form the light spot. The light spot can be contracted by a convex lens on the side of the imaging hole to form a smaller image spot.

Optionally, the display screen includes a light-emitting board, the light-emitting board is provided with a light-emitting unit, the light-transmitting hole is disposed in the light-emitting board, and the light-transmitting hole occupies a position of a light-emitting unit or occupies a pixel The location of the point.

In this implementation manner, the imaging hole may refer to the related description of the first imaging hole in the foregoing embodiment, and the convex lens, the display screen, and the light transmitting hole may also refer to the related description in the foregoing embodiment, and details are not described herein again.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention, but not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still Modifications to the technical solutions described in the foregoing embodiments, or equivalent replacements of some of the technical features thereof; and these modifications or replacements do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

An image acquisition device, comprising a light blocking film, at least two first imaging holes in the light blocking film used for small hole imaging, and an image sensor on one side of the light blocking film, and a target The light emitted by the object is directed to the image sensor through the first imaging hole, and the at least two first imaging holes are used to obtain at least two images of the target, and a 3D of the target is established based on the at least two images model.
The image acquisition device according to claim 1, further comprising an infrared light source for irradiating a target and generating reflected light, the reflected light passing through the first imaging according to a pinhole imaging principle A hole is shot toward the image sensor and imaged.
The image acquisition device according to claim 1, wherein the image acquisition device further comprises a display screen, the display screen facing the target.
The image acquisition device according to claim 3, wherein the first imaging hole is located in a non-display area of the display screen, and the non-display area includes a frame portion and a bangs portion of the image acquisition device.
The image acquisition device according to claim 3, wherein the first imaging hole is located in a display area of the display screen, and the display screen is provided with a light transmitting hole corresponding to the first imaging hole , The light emitted by the target passes through the light-transmitting hole and the first imaging hole in order to hit the image sensor.
The image acquisition device according to claim 5, wherein the display screen comprises a light-emitting board, the light-emitting board is provided with a light-emitting unit, the light-transmitting hole is provided in the light-emitting board, and the first The imaging holes are in one-to-one correspondence with the light-transmitting holes, and each light-transmitting hole occupies a position of a light-emitting unit or a position of a pixel.
The image acquisition device according to claim 1, wherein a cavity corresponding to the first imaging hole is provided in the image sensor, and a photosensitive portion is provided at the bottom of the cavity.
The image acquisition device according to claim 1, wherein a convex lens is provided on a side of the first imaging hole near the image sensor, and the convex lens passes light emitted from each point on the target through The light spot formed after the first imaging hole shrinks again, and a smaller image spot is formed on the image sensor.
The image acquisition device according to claim 1, wherein each of the first imaging holes is used to acquire a complete image of a target object.
The image acquisition device according to claim 1, wherein a diameter of the first imaging hole is 5 micrometers to 100 micrometers.
The image acquisition device according to claim 1, wherein a distance between the centers of each two of the first imaging holes is 1 mm to 100 mm.
The image acquisition device according to claim 7, wherein a distance between the first imaging hole and a photosensitive portion of the image sensor is 1 mm to 4 mm.
The image acquisition device according to claim 1, wherein the first imaging hole is adapted to acquire an image of a target object that is 5 cm to 100 cm away from the first imaging hole.
The image acquisition device according to claim 1, wherein the light blocking film is further provided with a second imaging hole for imaging a small hole, and the first imaging hole and the second imaging hole are used for acquisition Images of different targets.
The image acquisition device according to claim 14, wherein the second imaging hole is used to acquire a fingerprint image.
The image acquisition device according to claim 14, wherein the first imaging hole and the second imaging hole share an image sensor.
The image acquisition device according to claim 14, wherein the first imaging hole and the second imaging hole in the light blocking film are obtained by photolithography using a same layer of photolithographic mask.
An image acquisition method, comprising:

Use at least two imaging holes to acquire an image of a target object through a small hole imaging principle, and each of the imaging holes corresponds to an image of the target object;

A 3D model is established based on images corresponding to the at least two imaging holes.
The method according to claim 18, wherein the acquiring an image of a target object by using at least two imaging holes through a pinhole imaging principle comprises:

The infrared object is irradiated, and an infrared image of the target is acquired by using the at least two imaging holes through a small-hole imaging principle.
The method of claim 18, further comprising:

A convex lens is provided behind each of the imaging holes to constrain the light path, so that the diameter of the spot imaged at each point on the target is reduced.
The method according to claim 18, wherein the image comprises a face image and an image for motion capture, the face image is used for establishing a 3D face model, and the image for motion capture is used for To get 3D motion model.
An electronic device, comprising the image acquisition device according to any one of claims 1-17.
An imaging device is characterized by comprising an imaging hole for imaging a small hole and a convex lens on one side of the imaging hole, the convex lens forming light emitted from each point on a target after passing through the imaging hole The light spot shrinks again and forms a smaller image spot.
The imaging device according to claim 23, wherein the imaging device is applied to a smart terminal.
The imaging device according to claim 23 or 24, wherein the smart terminal comprises a display screen, the display screen is disposed on the other side of the imaging hole, and the display screen is provided corresponding to the imaging hole A light transmitting hole; light emitted from each point on the target passes through the light transmitting hole and the imaging hole in order to form the light spot.
The imaging device according to claim 25, wherein the display screen comprises a light-emitting board, the light-emitting board is provided with a light-emitting unit, the light-transmitting hole is provided in the light-emitting board, and the light-transmitting hole Occupies a position of a light-emitting unit or a position of a pixel.
An image acquisition device, comprising a light blocking film and an image sensor located on one side of the light blocking film, the light blocking film is provided with a first imaging hole for small hole imaging, and a target emits The light rays are directed to the image sensor through the first imaging hole, and the first imaging hole is used to obtain an image of the target.
The image acquisition device according to claim 27, wherein the image acquisition device further comprises a display screen, and the display screen is disposed on the other side of the light blocking film; The light-transmitting hole corresponding to the first imaging hole, and the light emitted by the target passes through the light-transmitting hole and the first imaging hole in order to strike the image sensor.
The image acquisition device according to claim 28, wherein the display screen comprises a light-emitting board, the light-emitting board is provided with a light-emitting unit, the light-transmitting hole is provided in the light-emitting board, and the light-transmitting The hole occupies the position of a light-emitting unit or the position of a pixel.
The image acquisition device according to any one of claims 27 to 29, wherein a convex lens is provided on a side of the first imaging hole near the image sensor; The spot formed by the emitted light after passing through the first imaging hole shrinks again, and a smaller image spot is formed on the image sensor.