WO2024051214A1

WO2024051214A1 - Three-dimensional image collection apparatus and method, and related device

Info

Publication number: WO2024051214A1
Application number: PCT/CN2023/095972
Authority: WO
Inventors: 陈宇宸; 宋碧薇; 闫云飞
Original assignee: 华为技术有限公司
Priority date: 2022-09-09
Filing date: 2023-05-24
Publication date: 2024-03-14
Also published as: CN117706858A

Abstract

A three-dimensional image collection apparatus (100) and method, and a related device, which are used for collecting a three-dimensional image while improving the pixel utilization rate of an image sensor (200). A first lens group (101) of the three-dimensional image collection apparatus (100) is used for transmitting, to a light deflection module (104), a first light beam (111) reflected by an object (110) to be photographed. A second lens group (102) is used for transmitting, to the light deflection module (104), a second light beam (112) reflected by said object (110). The light deflection module (104) is used for deflecting the transmission direction of the first light beam (111), and splitting the first light beam (111) into a plurality of first light sub-beams (201, 202), and the light deflection module (104) is further used for deflecting the transmission direction of the second light beam (112), and splitting the second light beam (112) into a plurality of second light sub-beams (211, 212), wherein each first light sub-beam (201, 202) is transmitted to a first imaging area of the image sensor (200), each second light sub-beam (211, 212) is transmitted to a second imaging area of the image sensor (200), and there is a second imaging area between any two adjacent first imaging areas.

Description

A three-dimensional image acquisition device, related equipment and method

This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on September 9, 2022, with application number 202211103778.6 and the application title "A three-dimensional image acquisition device, related equipment and methods", the entire content of which is incorporated by reference. incorporated in this application.

Technical field

The present application relates to the field of stereoscopic display technology, and in particular, to a three-dimensional image acquisition device, related equipment and methods.

Background technique

Because human eyes are a certain distance apart, when looking at specific things, the viewing angles of the image seen with the left eye and the image seen with the right eye are different. In this way, the two images with different viewing angles are synthesized in the brain. A three-dimensional (3D) image will be formed.

Existing 3D shooting systems include a left eye signal light collection system and a right eye signal light collection system. The left eye signal light collection system and the right eye signal light collection system simulate human eyes, collecting left eye signal light and right eye signal light respectively. The image sensor obtains a 3D image by imaging the left eye signal light and the right eye signal light.

The left eye signal light and the right eye signal light are incident on both sides of the image sensor respectively. Between the coverage range of the left eye signal light on the image sensor and the coverage range of the right eye signal light on the image sensor, there are pixels that are not covered by the signal light. Pixels not covered by signal light are not used for 3D imaging, resulting in a waste of image sensor pixels.

Contents of the invention

Embodiments of the present application provide a three-dimensional image acquisition device, related equipment and methods, which are used to realize the acquisition of three-dimensional images while improving the pixel utilization rate of the image sensor.

The first aspect of the embodiment of the present application provides a three-dimensional image acquisition device. The three-dimensional image acquisition device includes a first lens group, a second lens group and a light deflection module; the first lens group The second lens group is used to transmit the first light beam reflected by the object to be photographed to the light deflection module; the second lens group is used to transmit the second light beam reflected by the object to be photographed to the light deflection module; the light deflection module The module is used to deflect the transmission direction of the first light beam and branch out multiple first sub-beams. The optical deflection module is also used to deflect the transmission direction of the second light beam and branch out multiple second sub-beams. , each of the first sub-beams is incident on the first imaging area of the image sensor, each of the second sub-beams is incident on the second imaging area of the image sensor, two adjacent first sub-beams at any position The second imaging area is included between the imaging areas.

Using the three-dimensional image acquisition device shown in this aspect, the image sensor can form a three-dimensional image based on the imaging of multiple first sub-beams and the imaging of multiple second sub-beams. Due to the deflection effect of the light deflection module on the transmission direction of the first light beam and the transmission direction of the second light beam, the multiple first sub-beams output by the light deflection module are respectively incident on multiple first imaging areas of the image sensor. And the multiple second sub-beams output by the light deflection module are respectively incident on multiple second imaging areas of the image sensor. area. A plurality of first imaging areas and a plurality of second imaging areas are arranged in an interleaved manner. Due to the deflection effect of the light deflection module on the transmission directions of the first light beam and the second light beam, the number of pixels not used for imaging in the image sensor is reduced, and the utilization rate of the pixels included in the image sensor is improved.

Based on the first aspect, in an optional implementation, the first light beam is incident on the light deflection module at a first incident angle, and the second light beam is incident on the light deflection module at a second incident angle, and the The first angle of incidence is different from the second angle of incidence.

Using this implementation method, when the first incident angle and the second incident angle are different, it is effectively ensured that the plurality of first imaging regions and the plurality of second imaging regions are arranged in an interleaved manner.

Based on the first aspect, in an optional implementation manner, the first incident angle and the second incident angle are positive and negative opposite.

Using this implementation method, when the positive and negative of the first incident angle and the second incident angle are different, it is effectively ensured that multiple first sub-beams are respectively incident on multiple first imaging areas of the image sensor, and light deflection is ensured. The multiple second sub-beams output by the module are respectively incident on multiple second imaging areas of the image sensor.

Based on the first aspect, in an optional implementation, the image sensor includes a plurality of the first imaging areas, and/or the image sensor includes a plurality of the second imaging areas.

With this implementation, the interleaved arrangement of multiple first imaging areas and multiple second imaging areas improves the utilization of pixels included in the image sensor.

Based on the first aspect, in an optional implementation, the light deflection module includes a plurality of sub-deflection modules, the image sensor includes a pixel array; the target sub-deflection module corresponds to the target first imaging area and the target second imaging area, The target sub-deflection module is one of the plurality of sub-modules, the target first imaging area is one of a plurality of the first imaging areas, and the target second imaging area is a plurality of the second imaging areas. One of the imaging areas, the target first imaging area and the target second imaging area are adjacent; the first sub-beam emitted from the target sub-deflection module enters the target first imaging area, from The second sub-beam emitted from the target sub-deflection module is incident on the target second imaging area, the target first imaging area includes at least one column of pixels of the pixel array, and the target second imaging area includes the At least one column of pixels in the pixel array.

This implementation method ensures that the first imaging area and the second imaging area of the image sensor can be arranged in an interleaved manner, thereby improving the utilization of pixels included in the image sensor.

Based on the first aspect, in an optional implementation, the target first imaging area includes pixels in the i-th column of the pixel array, and the target second imaging area includes the i+1th column of the pixel array. Pixel, the i is any natural number not less than 1.

Using this implementation method, it is possible to ensure that the first sub-beam is incident on odd-numbered columns of pixels in the pixel array, and it is also ensured that the second sub-beam is incident on even-numbered columns of pixels in the pixel array, ensuring that the first imaging area and the second sub-beam are incident on the first sub-beam. The second imaging areas where the light beams are incident are arranged in an interleaved manner.

Based on the first aspect, in an optional implementation manner, the forward projection of the target sub-deflection module coincides with the forward projection of the pixels in the i-th column and the pixels in the i+1th column.

Using this implementation method reduces the number of pixels in the image sensor that are not used for imaging, ensuring the utilization of the pixels of the image sensor.

Based on the first aspect, in an optional implementation manner, the forward projection of the target sub-deflection module is located in the coverage area of the forward projection of the pixels in the i-th column and the forward projection of the pixels in the i+1th column in the pixel array. Inside.

Using this implementation method ensures that the image sensor can successfully image the first sub-beam and the second sub-beam.

Based on the first aspect, in an optional implementation, the three-dimensional image acquisition device further includes a driving device, the driving device is connected to the first lens group and/or the second lens group, and the driving device Device is used to change the first distance between the first lens group and the second lens group.

Using this implementation method, the first distance between the first lens group and the second lens group can be adjusted, ensuring the stereoscopic effect of the collected three-dimensional image.

Based on the first aspect, in an optional implementation, the driving device is used to change the first distance according to the second distance between the three-dimensional image acquisition device and the object to be photographed, wherein the There is a positive correlation between the second distance and the first distance.

Using this implementation method, the length of the first distance is changed based on the second distance between the three-dimensional image acquisition device and the object to be photographed, thereby ensuring that the three-dimensional image acquisition device can successfully capture the object to be photographed and at the same time improving the quality of the collected three-dimensional image. Three-dimensional effect.

Based on the first aspect, in an optional implementation, the first lens group includes a first lens group and a first reflector group, and the second lens group includes a second lens group and a second reflector group; The first lens group is used to transmit the first light beam reflected by the object to be photographed to the first mirror group; the second lens group is used to transmit the third light beam reflected by the object to be photographed. The two light beams are transmitted to the second reflecting mirror group; the first reflecting mirror group is used to reflect the first light beam to the light deflection module; the second reflecting mirror group is used to reflect to the light deflection module the second beam.

Using this implementation method ensures that the first beam and the second beam can be successfully transmitted to the light deflection module, thereby ensuring that the three-dimensional image acquisition device can successfully capture the object to be photographed.

Based on the first aspect, in an optional implementation, the three-dimensional image acquisition device is used to connect to an electronic device, the electronic device includes an imaging lens group and the image sensor, and the three-dimensional image acquisition device further includes a A relay lens group between the light deflection module and the imaging lens group, the relay lens group is used to transmit the first sub-beam to the first imaging area, the relay lens group also For transmitting the second sub-beam to the second imaging area.

Using this implementation method, the electronic device can obtain the three-dimensional image through the three-dimensional image acquisition device without the need to configure a three-dimensional camera.

Based on the first aspect, in an optional implementation, the ratio of the equivalent focal length of the relay lens group to the equivalent focal length of the imaging lens group is equal to the forward projection of the light deflection module and the image sensor The ratio of the orthographic projection.

Using this implementation method, the first sub-beam and the second sub-beam can be expanded or contracted, effectively ensuring that the image sensor of the electronic device successfully captures the object to be photographed, thereby ensuring the clarity of the captured three-dimensional image. and the utilization of the pixels of the image sensor.

The second aspect of the embodiment of the present application provides a three-dimensional image acquisition method. The method is applied to a three-dimensional image acquisition device. The three-dimensional image acquisition device includes a first lens group, a second lens group and a light deflection module. The method The method includes: transmitting the first light beam reflected by the object to be photographed to the light deflection module through the first lens group; transmitting the second light beam reflected by the object to be photographed to the light deflection module through the second lens group; The optical deflection module is used to deflect the transmission direction of the first light beam and branch out multiple first sub-beams; the optical deflection module is used to deflect the transmission direction of the second light beam and branch out multiple second sub-beams. Light beam, each of the first sub-beams is incident on the first imaging area of the image sensor, each of the second sub-beams is incident on the second imaging area of the image sensor, two adjacent adjacent ones at any position Between an imaging area, the second imaging area is included.

For description of the beneficial effects in this aspect, please refer to the first aspect, and details will not be repeated.

Based on the second aspect, in an optional implementation manner, transmitting the first light beam reflected by the object to be photographed through the first lens group to the light deflection module includes: transmitting the first light beam reflected by the first lens group through the first lens group. The first light beam is incident on the light deflection module at a first incident angle; and transmitting the second light beam reflected by the object to be photographed to the light deflection module through the second lens group includes: using the second lens group The second light beam is incident on the light deflection module at a second incident angle, and the first incident angle is different from the second incident angle.

Based on the second aspect, in an optional implementation, the light deflection module includes a plurality of sub-deflection modules, and the light deflection module deflects the transmission direction of the first light beam and branches out multiple first light beams. The sub-beam includes: passing the first sub-beam into the target first imaging area through a target sub-deflection module, the target sub-deflection module corresponds to the target first imaging area, and the target sub-deflection module is the plurality of sub-modules. In one of the above, the target first imaging area is one of a plurality of the first imaging areas, and the target first imaging area includes at least one column of pixels of the image sensor pixel array; the light deflection is The module deflects the transmission direction of the second light beam and splits out multiple second sub-beams including: passing the second sub-beam into the second target imaging area through the target sub-deflection module, and the target sub-deflection module corresponds to The target second imaging area is one of a plurality of second imaging areas, the target second imaging area includes at least one column of pixels of the pixel array, and the target first The imaging area is adjacent to the target second imaging area.

Based on the second aspect, in an optional implementation, the target first imaging area includes pixels in the i-th column of the pixel array, and the target second imaging area includes the i+1th column of the pixel array. Pixel, the i is any natural number not less than 1.

Based on the second aspect, in an optional implementation, the three-dimensional image acquisition device further includes a driving device that transmits the first light beam reflected by the object to be photographed through the first lens group to the light deflection module Previously, the method further included: changing the first distance between the first lens group and the second lens group through the driving device.

Based on the second aspect, in an optional implementation, changing the first distance between the first lens group and the second lens group through the driving device includes: according to the three-dimensional image acquisition device The first distance is changed by the driving device as to the second distance to the object to be photographed, wherein there is a positive correlation between the second distance and the first distance.

Based on the second aspect, in an optional implementation, the three-dimensional image acquisition device is used to connect to an electronic device, the electronic device includes an imaging lens group and the image sensor, and the three-dimensional image acquisition device further includes a The relay lens group between the light deflection module and the imaging lens group. After the light deflection module deflects the transmission direction of the first beam and separates multiple first sub-beams, the The method also includes: transmitting the first sub-beam to the first imaging area through the relay lens group; deflecting the transmission direction of the second light beam through the light deflection module, and branching out multiple channels After the second sub-beam, the method further includes: transmitting the second sub-beam to the second imaging area through the relay lens group.

The third aspect of the embodiments of the present application provides a three-dimensional image capturing device. The three-dimensional image capturing device includes an image sensor, a processor, and a three-dimensional image acquisition device as described in any one of the first aspects; the image sensor is used to Acquire a first viewing angle image according to the multiple first sub-beams incident on the first imaging area; the image sensor is configured to acquire a first viewing angle image based on the multiple second sub-beams incident on the second imaging area. Two-view image; the processor is configured to obtain a three-dimensional image according to the first-view image and the second-view image.

The fourth aspect of the embodiment of the present application provides a three-dimensional image viewing device, including a display module and a third party as described above The three-dimensional image capturing device shown above; the three-dimensional image capturing device is used to send the three-dimensional image to the display module; the display module is used to obtain multiple first outgoing light beams according to the first viewing angle image , and is also used to obtain multiple channels of second outgoing light beams according to the second viewing angle image; the display module is also used to transmit the multiple channels of first outgoing beams to the first viewing angle viewing area in the space, and to the space. The second viewing angle viewing area transmits the multiple second output light beams, and the first viewing angle viewing area is different from the second viewing angle viewing area.

Based on the fourth aspect, in an optional implementation, the display module includes a display screen and a light projection module; the display screen is used to display the three-dimensional image; the light projection module is used to project the display The three-dimensional image displayed on the screen is used to obtain the multiple first outgoing beams and the multiple second outgoing beams.

Description of the drawings

Figure 1a is an example diagram of the overall structure of a three-dimensional image acquisition device provided by an embodiment of the present application;

Figure 1b is a first example diagram of a three-dimensional image acquisition device provided by an embodiment of the present application;

Figure 1c is an example diagram of the field of view of the first lens group and the field of view of the second lens group provided by the embodiment of the present application;

Figure 2a is a first structural example diagram of a light deflection module and an image sensor provided by an embodiment of the present application;

Figure 2b is a second example diagram of the object to be photographed by the three-dimensional image acquisition device provided by the embodiment of the present application;

Figure 3 is a structural example diagram of a first embodiment of a three-dimensional image acquisition device provided by an embodiment of the present application;

Figure 4a is a second structural example diagram of a light deflection module and an image sensor provided by an embodiment of the present application;

Figure 4b is a second example diagram of the object to be photographed by the three-dimensional image acquisition device provided by the embodiment of the present application;

Figure 5 is an example of orthographic projection of a lenticular lens, pixels in the i-th column and pixels in the i+1-th column provided by the embodiment of the present application;

Figure 6a is a first example diagram of the first sub-beam and the second sub-beam incident on the pixel array provided by the embodiment of the present application;

Figure 6b is a second example diagram of the first sub-beam and the second sub-beam incident on the pixel array provided by the embodiment of the present application;

Figure 7a is a structural example diagram of the second embodiment of the three-dimensional image acquisition device provided by the embodiment of the present application;

Figure 7b is a third example diagram of the first sub-beam and the second sub-beam incident on the pixel array provided by the embodiment of the present application;

Figure 7c is a fourth example diagram of the first sub-beam and the second sub-beam incident on the pixel array provided by the embodiment of the present application;

Figure 8a is a third example diagram of a three-dimensional image acquisition device provided by an embodiment of the present application;

Figure 8b is an example diagram of the first distance of the three-dimensional image acquisition device provided by the embodiment of the present application;

Figure 9 is a fourth example diagram of a three-dimensional image acquisition device provided by an embodiment of the present application;

Figure 10 is an example diagram of a three-dimensional image capturing device provided by an embodiment of the present application;

Figure 11a is a first structural example diagram of a three-dimensional image viewing device provided by an embodiment of the present application;

Figure 11b is a first structural example diagram of a three-dimensional image viewing device provided by an embodiment of the present application;

Figure 12 is a flow chart of the first execution steps of the three-dimensional image acquisition method provided by the embodiment of the present application;

Figure 13 is a flow chart of the second execution steps of the three-dimensional image acquisition method provided by the embodiment of the present application;

Figure 14 is a flow chart of the third execution steps of the three-dimensional image acquisition method provided by the embodiment of the present application;

Figure 15 is a flow chart of the fourth execution steps of the three-dimensional image acquisition method provided by the embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts fall within the scope of protection of the present invention.

This application provides a three-dimensional image acquisition device based on stereoscopic display technology. Stereoscopic display technology is based on binocular parallax theory. Binocular parallax theory means that human eyes can observe three-dimensional information of the objective world because when humans observe objects with binocular eyes, the same object produces left-eye view images and right-eye view images with different parallaxes in the left and right eyes respectively. . The human brain constructs a three-dimensional image from a left-eye view image and a right-eye view image. Moreover, the three-dimensional image acquisition device can realize 3D naked-eye display. 3D naked-eye display refers to taking advantage of the parallax characteristics of human eyes. Without any auxiliary equipment (such as 3D glasses, helmets, etc.), you can directly watch the left-eye view image and the right-eye view image to obtain a spatial image. , realistic stereoscopic images with depth.

Figure 1a is an example diagram of the overall structure of a three-dimensional image acquisition device provided by an embodiment of the present application. Figure 1b is a first example diagram of a three-dimensional image acquisition device provided by an embodiment of the present application. The three-dimensional image acquisition device 100 shown in this embodiment includes a first lens group 101, a second lens group 102 and a light deflection module 104.

The acquisition device body 103 of the three-dimensional image acquisition device 100 shown in this embodiment is used to fix the first lens group 101 and the second lens group 102. The first lens group 101 is used to transmit the first light beam 111 reflected by the object 110 to be photographed to the light deflection module 104 . The second lens group 102 is used to transmit the second light beam 112 reflected by the same object 110 to the light deflection module 104 . After the transmission direction of the first light beam 111 is deflected by the light deflection module 104, a left-eye view image is formed on the image sensor. After the transmission direction of the second light beam 112 is deflected by the light deflection module 104, a right-eye view image is formed on the image sensor. The three-dimensional image acquisition device 100 shown in this embodiment may include the image sensor, or the three-dimensional image acquisition device 100 may not include the image sensor, which is not limited in this embodiment. The light deflection module 104 shown in this embodiment is an optical device capable of deflecting the transmission direction of a light beam. For example, the light deflection module 104 can be a lenticular lens array. The lenticular lens array 400 can also be called a lenticular grating. As another example, the light deflection module 104 may also be a liquid crystal array. The three-dimensional image acquisition device can use an electric field to control the arrangement state of the liquid crystals included in the liquid crystal array to achieve deflection of the first light beam transmission direction and to achieve deflection of the second light beam transmission direction.

The first lens group 101 shown in this embodiment is used to form the first light beam 111 into a real image on the image sensor, and the second lens group 102 is used to form the second light beam 112 into a real image on the image sensor. The image sensor can be a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS). The following describes the conditions for how the first lens group 101 ensures that the object 110 to be photographed forms a real image on the image sensor, and how the second lens group 102 ensures that the object 110 to be photographed forms a real image on the image sensor:

Condition 1: Figure 1c is an example diagram of the field of view of the first lens group and the field of view of the second lens group provided by the embodiment of the present application. There is an overlapping area 131 between the field of view of the first lens group 101 and the field of view of the second lens group 102 . The object to be photographed 110 is located in the overlapping area 131 to ensure that the first light beam 111 reflected by the object to be photographed 110 can be successfully reflected to the first lens group 101 and also to ensure that the second light beam 112 reflected by the object to be photographed 110 can be successfully reflected. Reflected to the second lens group 102, thereby ensuring that the first light beam 111 and the second light beam 112 can respectively form a left eye view image and a right eye view image. Among them, the field of view can also be called field of view (FOV). Taking the field of view of the first lens group 101 as an example, with the first lens group 101 as the vertex, the angle formed by the two edge light rays that can pass through the first lens group 101 is called the field of view 132 . It can be understood that the size of the field of view 132 of the first lens group 101 determines the field of view range of the first lens group 101 . For the description of the field of view 133 of the second lens group 102, please refer to the description of the field of view 132 of the first lens group 101, and details will not be described again.

Condition 2: The object distance between the object to be photographed 110 and the first lens group 101 is greater than 2 times the focal length of the first lens group 101, and the image of the object 110 to be photographed on the image sensor is at 1 times the focal length of the first lens group 101 and 2 times the focal length to ensure that the first light beam 111 reflected by the object 110 to be photographed can form a real image on the image sensor. Similarly, the object distance between the object 110 to be photographed and the second lens group 102 is greater than 2 times the focal length of the second lens group 102 , and the image of the object 110 to be photographed on the image sensor is at 1 times the focal length of the second lens group 102 and 2 times the focal length to ensure that the second light beam 112 reflected by the object 110 to be photographed can form a real image on the image sensor.

The transmission direction of the first light beam 111 emitted from the first lens group 101 is deflected by the light deflection module 104 and divided into a plurality of first sub-beams. The multiple first sub-beams emitted from the light deflection module 104 are incident on the image sensor. Similarly, the transmission direction of the second light beam 112 emitted from the second lens group 102 is deflected by the light deflection module 104 and divided into multiple second sub-beams. The multiple second sub-beams emitted from the light deflection module 104 are incident on the image sensor.

Figure 2a is a first structural example of a light deflection module and an image sensor provided by an embodiment of the present application. The image sensor 200 is configured to receive a plurality of deflected first sub-beams and a plurality of second sub-beams from the light deflection module 104 . Image sensor 200 includes an array of pixels. The pixel array of the image sensor 200 converts the received multiple first sub-beams and the multiple second sub-beams into electrical signals. The pixel array can form a left-eye view image based on the electrical signals converted by the multiple first sub-beams. The pixel array can form a right-eye view image based on the electrical signals converted by the multiple second sub-beams.

The three-dimensional image acquisition device shown in this embodiment can focus multiple first sub-beams and multiple second sub-beams onto the pixel array of the image sensor 200, and the position where the multiple first sub-beams are incident on the pixel array and the positions at which the multiple second sub-beams are incident on the pixel array are arranged in a mutually interspersed manner. Specifically, the optical deflection module 104 shown in this embodiment can deflect the transmission directions of the output multiple first sub-beams, and deflect the transmission directions of the multiple output second sub-beams to ensure that the multiple first sub-beams are The positions where the light beam is incident on the pixel array and the positions where the multiple second sub-beams are incident on the pixel array are arranged in an interleaved manner.

The pixel array of the image sensor 200 includes a plurality of first imaging areas and a plurality of second imaging areas. As shown in Figure 2a, the pixel array includes multiple columns of pixels arranged along the direction Y. The first imaging area is at least one column of pixels in the pixel array. The second imaging area is at least one column of pixels in the pixel array. The first imaging area and the second imaging area do not overlap with each other. For example, the first imaging area includes a column of pixels in a pixel array. The second imaging area includes another column of pixels in the pixel array. Referring to the example shown in Figure 2b, Figure 2b is a second example diagram of the object to be photographed captured by the three-dimensional image acquisition device provided by the embodiment of the present application. The pixel array of image sensor 200 is arranged in the XY plane. Along direction Z, the light deflection module 104 is located above the pixel array of the image sensor 200 to ensure that the first sub-beam and the second sub-beam deflected by the light deflection module 104 can be successfully transmitted to the pixel array. Direction Z is perpendicular to the XY plane.

The pixel array includes 10 columns of pixels. Among them, the first column of pixels 231, the third column of pixels 233, the fifth column of pixels 235, the seventh column of pixels 237 and the ninth column of pixels 239 are respectively the first imaging areas. The second column of pixels 232, the fourth column of pixels 234, the sixth column of pixels 236, the eighth column of pixels 238 and the tenth column of pixels 240 are second imaging areas respectively. It can be understood that in the pixel array shown in this example, the first imaging area is an odd-numbered column of pixels included in the pixel array. The second imaging area is an even-numbered column of pixels included in the pixel array. For another example, the first imaging area includes multiple columns of pixels adjacent to each other in the pixel array. The second imaging area includes a plurality of columns of pixels adjacent to each other in the pixel array. This embodiment does not limit the number of columns of the pixel array included in each first imaging area and the number of columns of the pixel array included in each second imaging area.

It should be noted that this embodiment does not limit the arrangement of the first imaging area and the second imaging area in the pixel array. It is determined that as long as at least one second imaging area is included between two adjacent first imaging areas at any position, so that multiple first imaging areas and multiple second imaging areas in the pixel array are interspersed. The way of arrangement.

In this embodiment, each first sub-beam emitted from the light deflection module 104 is transmitted to the first imaging area. Each second sub-beam emitted from the light deflection module 104 is transmitted to the second imaging area. The first imaging area of the image sensor 200 includes pixels that convert the first sub-beam into an electrical signal for forming a left eye view image. The second imaging area of the image sensor 200 includes pixels that convert the second sub-beam into electrical signals for forming a right eye view image. The electrical signal for forming the three-dimensional image is acquired based on the electrical signal for forming the left eye view image and the electrical signal for forming the right eye view image. When the display screen obtains the electrical signal used to form a three-dimensional image, the display screen can display the three-dimensional image.

Using the three-dimensional image acquisition device shown in this embodiment, due to the deflection effect of the optical deflection module 104 on the transmission direction of the first beam and the transmission direction of the second beam, the multiple first sub-beam incident images output by the optical deflection module 104 are A plurality of first imaging areas of the sensor. And the multiple second sub-beams output by the light deflection module 104 are incident on multiple second imaging areas of the image sensor. A plurality of first imaging areas and a plurality of second imaging areas are arranged in an interleaved manner. Due to the deflection effect of the light deflection module on the transmission directions of the first light beam and the second light beam, the number of pixels not used for imaging in the image sensor is reduced, and the utilization rate of the pixels included in the image sensor is improved.

Continue to refer to FIG. 2b for a detailed description of the arrangement of the first imaging area and the second imaging area shown in this embodiment. Each first sub-beam emitted from the light deflection module 104 is transmitted to a first imaging area, and different first sub-beams are transmitted to different first imaging areas. Similarly, each second sub-beam emitted from the light deflection module 104 is transmitted to a second imaging area, and different second sub-beams are transmitted to different second imaging areas. The first imaging area of the image sensor 200 includes pixels that convert the first sub-beam into an electrical signal for forming a left eye view image. The second imaging area of the image sensor 200 includes pixels that convert the second sub-beam into electrical signals for forming a right eye view image. Specifically, a first sub-beam 201 output by the light deflection module 104 is transmitted to the first column of pixels 231. The second sub-beam 211 output by the optical deflection module 104 is transmitted to the second column of pixels 232, and so on. The first sub-beam 202 output by the optical deflection module 104 is transmitted to the ninth column of pixels 239. The optical deflection module 104 The output second sub-beam 212 is transmitted to the tenth column of pixels 240 . The first column of pixels 231 , the third column of pixels 233 , the fifth column of pixels 235 , the seventh column of pixels 237 and the ninth column of pixels 239 convert the received first sub-beam into electrical energy for forming the left eye view image 221 Signal. The second column of pixels 232 , the fourth column of pixels 234 , the sixth column of pixels 236 , the eighth column of pixels 238 and the tenth column of pixels 240 convert the received second sub-beam into a pixel for forming the right eye view image 222 electric signal.

The optional structure of the three-dimensional image acquisition device provided by this embodiment will be described with reference to FIG. 3 , where FIG. 3 is an example structural diagram of the first embodiment of the three-dimensional image acquisition device provided by this embodiment of the application. The first lens group shown in this embodiment includes a first lens group and a first reflecting mirror group. This embodiment takes the first lens group including the first lens 301 as an example. This embodiment does not limit the number of lenses included in the first lens group. Specifically, in this example, the first lens 301 is a convex lens. The first mirror group includes one or more mirrors. For example, the first reflecting mirror group includes a first reflecting mirror 302 and a second reflecting mirror 303 . The first light beam 331 emitted from the first lens 301 is sequentially reflected by the first reflecting mirror 302 and the second reflecting mirror 303 and then transmitted to the light deflection module 321 . The transmission direction of the first light beam 331 is deflected by the light deflection module 321 and can form a real image on the image sensor 322 . In this embodiment, a three-dimensional image acquisition device including the image sensor 322 is used as an example. This embodiment does not limit the number of reflectors included in the first reflector group. In this embodiment, the first reflector group includes one or more reflectors as an example. In other examples, the first reflecting mirror group may be a reflecting prism having one or more reflecting surfaces. The first light beam 331 emitted from the first lens 301 is sequentially reflected by the reflective surface of the reflective prism to be successfully transmitted to the light deflection module 321 . This embodiment does not limit the structure of the reflective surface. For example, the reflective surface may have a planar structure, or a reflective surface. The shooting surface can be a curved surface, etc. In this embodiment, the first lens group includes the first mirror group as an example. In other examples, the first lens group may only include the first lens group. The first light beam emitted by the first lens group can be directly transmitted to the light deflection module 321 without being reflected by the first mirror group.

The second lens group shown in this embodiment includes a second lens group and a second reflecting mirror group. For the description of the second lens group and the second mirror group, please refer to the description of the first lens group and the first mirror group, and details will not be repeated. It can be understood that through reflection from the second mirror group, the second light beam 332 can be successfully transmitted to the light deflection module 321 .

In this embodiment, the first light beam 331 emitted from the first reflector group is transmitted to the optical path between the light deflection modules 321, and a focusing lens group 320 is also included. The focusing lens group 320 may include one or more lenses to focus the first light beam 331 emitted from the first reflecting mirror group to the light deflection module 321 . The second light beam 332 emitted from the second reflecting mirror group is transmitted to the optical path between the light deflection modules 321, which also includes the focusing lens group 320. The second light beam 332 emitted from the second reflecting mirror group is focused to the light deflection module 321 .

The specific structure of the light deflection module will be described below. FIG. 4a is a second structural example of the light deflection module and the image sensor provided by the embodiment of the present application. The light deflection module shown in this embodiment includes multiple sub-deflection modules. The same sub-deflection module is used to deflect the first light beam to the first imaging area and is also used to deflect the second light beam to the second imaging area. In this embodiment, the light deflection module is a lenticular lens array 400 as an example. In this embodiment, the pixel array of the image sensor 322 is arranged in multiple columns along the direction Y. The lenticular lens array 400 includes a plurality of lenticular lenses, and the plurality of lenticular lenses are also arranged in parallel along the direction Y. In order to enable the multiple first sub-beams and the multiple second sub-beams output by the lenticular lens array 400 to be focused on the image sensor 322, along the direction Z, the distance between the image sensor 322 and the lenticular lens array 400 is equal to the lenticular lens array 400. the focal length.

As shown in FIG. 4 b , FIG. 4 b is a second example diagram of the object to be photographed by the three-dimensional image acquisition device provided by the embodiment of the present application. The lenticular lens array 400 includes a plurality of lenticular lenses arranged periodically. Specifically, each lenticular lens is configured to receive the first light beam 331 from the first lens group 101 (for example, the light beam corresponding to the dotted line shown in Figure 4b) and the second light beam 332 from the second lens group 102 (such as The solid line shown in Figure 4b corresponds to the light incident surface 411 of the light beam (for example). The cross section of the light incident surface 411 of each cylindrical lens in the YZ plane is an arc-shaped cylindrical surface. The lenticular lens array 400 shown in this embodiment uses the deflection effect of each lenticular lens to deflect the transmission direction of the first beam 331, then transmits the first sub-beam to the first imaging area of the image sensor 322, and deflects the second beam 332. After passing the transmission direction, the second sub-beam is transmitted to the second imaging area of the image sensor 322 .

In order for each cylindrical lens to deflect the light beam transmission direction, the thickness of each cylindrical lens is largest at the center and gradually decreases toward both ends. Therefore, each lenticular lens is actually a convex lens with the light incident surface 411 being a cylindrical surface. It can be understood that the curvature of the light incident surface 411 of each lenticular lens has a positive correlation with the focal length of the lenticular lens. That is, the greater the curvature of the light incident surface 411 of each lenticular lens is, the greater the focal length of the lenticular lens is. Each lenticular lens has a light exit surface 412 . The first sub-beam and the second sub-beam deflected by the lenticular lens are emitted from the light exit surface 412 of the lenticular lens to be transmitted to the image sensor 322 .

This embodiment takes the example shown in FIG. 2b as an example, that is, each first imaging area includes a column of pixels of the image sensor, and each second imaging area includes a column of pixels of the image sensor. Then, in the pixel array included in the image sensor, , the orthographic projection of a lenticular lens coincides with the orthographic projection of the i-th column pixels and the i+1-th column pixels of the image sensor pixel array. Wherein, the i is any natural number not less than 1. See FIG. 5 , which is an example of orthographic projection of a lenticular lens, pixels in the i-th column, and pixels in the i+1-th column provided by an embodiment of the present application.

Referring to the orthographic projection example 511, taking the lenticular lens 431 as an example, the lenticular lens 431 is projected separately, so as to The lenticular lens 431 has a first orthographic projection 501 on the projection surface 500 . The lenticular lens 431 may be the first lenticular lens included in the lenticular lens array. The projection plane 500 is parallel to the plane XY. Specifically, the lenticular lens 431 is projected through projection lines that are parallel to each other and perpendicular to the plane XY, so as to obtain the first orthographic projection 501 of the lenticular lens 431 on the projection surface 500 .

Referring to the orthographic projection example 512, when the value of i is 1, the first column of pixels 231 and the second column of pixels 232 of the pixel array are projected separately, so that the first column of pixels 231 is on the projection surface 500 With second orthographic projection 502. The second column of pixels 232 of the pixel array has a third orthographic projection 503 on the projection plane 500 . For the description of the pixel array, please refer to the description of Figure 2a and Figure 2b, and details will not be repeated. For instructions on obtaining the second orthographic projection 502 and obtaining the third orthographic projection 503, please refer to the instructions on obtaining the first orthographic projection 501, which will not be described again.

Referring to the orthographic projection example 513, if the lenticular lens 431 and the first column of pixels 231 and the second column of pixels 232 of the pixel array are projected at the same time, then the first orthographic projection 501 of the lenticular lens 431 will be the same as the second orthographic projection 502 and the second orthographic projection 502. The three orthographic projections 503 coincide. It can be understood that the first orthographic projection 501 of the lenticular lens 431 coincides with the second orthographic projection 502 and the third orthographic projection 503 means that along the direction Y, the width of the first orthographic projection 501 is equal to the width of the second orthographic projection 502 and the third orthographic projection 501 . The sum of the widths of the three orthographic projections 503. Along direction X, the length of the first orthographic projection 501 is equal to the sum of the lengths of the second orthographic projection 502 and the third orthographic projection 503 .

In this embodiment, the first orthographic projection 501 of the lenticular lens 431 coincides with the second orthographic projection 502 and the third orthographic projection 503 as an example. In other examples, the first orthographic projection of the lenticular lens 431 may be located at the pixel. Within the coverage area of the second orthographic projection of the pixels in the i-th column and the third orthographic projection of the pixels in the i+1-th column in the array. The fact that the first orthographic projection is within the coverage range of the second orthographic projection and the third orthographic projection means that along the direction Y, the width of the first orthographic projection is greater than the sum of the width of the second orthographic projection and the width of the third orthographic projection. Along the direction Successfully imaged on the i+1th column pixel.

Based on the three-dimensional image acquisition device shown in this embodiment, the clarity of the left eye view image and the right eye view image acquired by the image sensor can be improved. That is, the first sub-beam obtained by deflecting the transmission direction of the first light beam is incident on the odd-numbered pixels of the pixel array, and the second sub-beam obtained by deflecting the transmission direction of the second light beam is incident on the even-numbered pixels of the pixel array.

In this embodiment, the pixel array includes multiple columns of pixels arranged along the direction Y. For example, the lenticular lens array includes multiple columns of lenticular lenses arranged along the direction Y. In other examples, the pixel array may also include multiple columns of pixels arranged along the direction X. And the lenticular lens array includes multiple columns of lenticular lenses arranged along the direction , it can be arranged in multiple columns.

The process of illustrating the first sub-beam and the second sub-beam incident on the pixel array will be described with reference to Figure 6a. Figure 6a shows the first method of the first sub-beam and the second sub-beam incident on the pixel array provided by the embodiment of the present application. sample graph.

The lenticular lens 431 receives the first light beam 331 and the second light beam 332 . The cylindrical lens 431 deflects the transmission direction of the first beam 331 and splits the first sub-beam 601. The cylindrical lens 431 deflects the transmission direction of the second beam 332 and splits the second sub-beam 602. In this example, the light exit surface of the lenticular lens 431 is bonded to the first column of pixels 231 and the second column of pixels 232 of the pixel array. The first sub-beam 601 in this example is incident on the first column of pixels 231 (ie, the first imaging area). The second sub-beam 602 is incident on the second column of pixels 232 (ie, the second imaging area). It can be understood that in the example shown in FIG. 6a, the first imaging area is an odd-numbered column of pixels included in the pixel array. The second imaging area is an even-numbered column of pixels included in the pixel array.

The first light beam 331 is incident on the lenticular lens 431 at a first incident angle, and the second light beam 332 is incident on the lenticular lens 431 at a second incident angle, and the first incident angle is different from the second incident angle. At the first angle of incidence not Under the same second incident angle, it is ensured that the first sub-beam 601 is incident on the first column of pixels 231 and the second sub-beam 602 is guaranteed to be incident on the second column of pixels 232. The first incident angle is an acute angle between the first beam 331 and the direction 600 of the vertical pixel array. It can be understood that the direction 600 of the vertical pixel array is the direction Z shown in FIG. 6a. The second incident angle is an acute angle between the second beam 332 and the direction 600 of the vertical pixel array.

Specifically, the first light beam 331 is incident on the lenticular lens 431 in a clockwise direction relative to the direction 600 perpendicular to the pixel array. The second light beam 332 is incident on the direction of incidence of the lenticular lens 431 and is incident counterclockwise relative to the direction 600 of the vertical pixel array. If the angle of incidence of the lenticular lens 431 in the clockwise direction is a positive angle and the angle of incidence of the lenticular lens 431 in the counterclockwise direction is a negative angle, then the first incident angle shown in this embodiment is a positive angle. The second angle of incidence is a negative angle. It can be understood that the positive and negative directions of the first incident angle and the second incident angle are opposite, which also means that the first incident angle is different from the second incident angle. The relationship between the absolute value of the first incident angle and the absolute value of the second incident angle is not limited. For example, the absolute value of the first incident angle shown in this embodiment is equal to the absolute value of the second incident angle. For another example, the absolute value of the first incident angle is smaller than the absolute value of the second incident angle. For another example, the absolute value of the first incident angle is greater than the absolute value of the second incident angle. It can be understood that the absolute value of the first incident angle shown in this embodiment is any angle less than 90 degrees, and the absolute value of the second incident angle is any angle less than 90 degrees. For a description of the deflection process of other lenticular lenses included in the lenticular lens array, please refer to the description of the deflection of the lenticular lens 431, and details will not be described again.

When the first incident angle is different from the second incident angle, through the deflection of the cylindrical lens array, the first light beam can be deflected and then incident on the odd-numbered rows of pixels of the pixel array, and the second beam can be deflected and then incident on the pixels. Even column pixels of the array. This ensures that crosstalk between the first sub-beam and the second sub-beam is effectively avoided when the first sub-beam and the second sub-beam are sent to different columns of pixels.

The arrangement of the first imaging area and the second imaging area of the image sensor shown in this embodiment can also be seen in Figure 6b, where Figure 6b shows the first sub-beam and the second sub-beam incident on the pixel provided by the embodiment of the present application. A second example of an array. The lenticular lens 611 shown in this example corresponds to four columns of pixels of the image sensor, such as the first column of pixels 631, the second column of pixels 632, the third column of pixels 633, and the fourth column of pixels 634. The first imaging area includes a first column of pixels 631 and a second column of pixels 632. The second imaging area includes a third column of pixels 633 and a fourth column of pixels 634. The lenticular lens 611 receives the first light beam 331 and the second light beam 332 . The cylindrical lens 431 deflects a portion of the transmission direction of the first beam 331 and separates the first sub-beam 612 . The first sub-beam 612 is incident on the first column of pixels 631 in the first imaging area. The cylindrical lens 431 deflects the transmission direction of another part of the first beam 331 and separates the first sub-beam 613. The first sub-beam 613 is incident on the second column of pixels 632 in the first imaging area. The cylindrical lens 611 deflects a portion of the transmission direction of the second beam 332 and separates the second sub-beam 614. The second sub-beam 614 is incident on the third column of pixels 633 in the second imaging area. The cylindrical lens 611 deflects the transmission direction of another part of the second beam 332 and separates the second sub-beam 615. The second sub-beam 615 is incident on the fourth column of pixels 634 in the second imaging area. Figures 6a and 6b are only examples of the first imaging area and the second imaging area, and are not limited, as long as each lenticular lens corresponds to the adjacent first imaging area and the second imaging area.

The above embodiment takes the positive and negative differences between the first incident angle and the second incident angle as an example. Then, the first lens group 101 and the second lens group 102 are located on both sides perpendicular to the direction of the light deflection module 321 . For example, taking the direction perpendicular to the light deflection module 321 as the symmetry axis, the first lens group 101 and the second lens group 102 are located on both sides of the symmetry axis. The structure of the three-dimensional image acquisition device shown in this embodiment can also be seen in Figure 7a, where Figure 7a is an example structural diagram of the second embodiment of the three-dimensional image acquisition device provided by the embodiment of the present application. The three-dimensional image acquisition device shown in this embodiment includes a first lens group 741, a second lens group 742, a light deflection module 745 and an image sensor 746. For specific descriptions of each device, please refer to the corresponding description in Figure 3, and will not be described in detail. . The first lens group 741 and the second lens group 742 shown in this embodiment are located perpendicular to the light Same side as deflection module 745 direction. As shown in FIG. 7a , the first lens group 741 and the second lens group 742 are located on the left side perpendicular to the direction of the light deflection module 745 . In other examples, the first lens group 741 and the second lens group 742 are located on the left side perpendicular to the direction of the light deflection module 745 . The right side of the direction of the deflection module 745 is not specifically limited, as long as the first light beam 741 reflected by the object to be photographed can be transmitted to the light deflection module 745, and the second light beam 744 reflected by the object to be photographed can be transmitted to the light deflection module 745. .

In the example where the first lens group 741 and the second lens group 742 are located on the left side perpendicular to the direction of the light deflection module 745, the first light beam 743 and the second light beam 744 are incident in a counterclockwise deflection direction relative to the direction of the vertical pixel array. Light deflection module 745. That is, in the example shown in Figure 7a, both the first incident angle and the second incident angle are negative angles. In other examples, both the first incident angle and the second incident angle may be positive angles. Since the first lens group 741 and the second lens group 742 shown in this embodiment are located on the same side perpendicular to the direction of the light deflection module 745, there is no need to make the first lens group 741 and the second lens group 742 symmetrically arranged on the light deflection module 745. On both sides, the integration of the three-dimensional image acquisition device is improved.

When the first incident angle and the second incident angle are of the same sign, the orthographic projection of a lenticular lens is the same as the orthographic projection of the i-th column pixels and the i+1-th column pixels in the pixel array, as described The orthographic projection of the pixels in the i+2th column coincides with the orthographic projection of the pixels in the i+3th column, and i is a natural number not less than 1. Optionally, the orthographic projection of the lenticular lens may be located at the orthographic projection of the pixels in the i-th column, the orthographic projection of the pixels in the i+1th column, the orthographic projection of the pixels in the i+2th column and all the orthographic projections of the pixels in the i+2th column in the pixel array. It is within the coverage of the orthographic projection of the pixels in the i+3th column. For specific instructions, please refer to the corresponding instructions in Figure 5. The details will not be repeated.

The process of the first sub-beam and the second sub-beam incident on the pixel array will be described with reference to FIG. 7b. Among them, FIG. 7b is a third example diagram of the first sub-beam and the second sub-beam incident on the pixel array provided by the embodiment of the present application.

The lenticular lens 431 receives the first light beam and the second light beam. For the description of the lenticular lens 431, please refer to the corresponding description in Fig. 6a, and details will not be repeated. The lenticular lens 431 shown in this embodiment corresponds to four columns of pixels in the pixel array, that is, the lenticular lens 431 corresponds to the first column of pixels 711, the second column of pixels 712, the third column of pixels 713, and the fourth column of pixels 714 of the pixel array. The cylindrical lens 431 deflects the transmission direction of the first beam 701 and separates the first sub-beam 703. The cylindrical lens 431 deflects the transmission direction of the second beam 702 and splits the second sub-beam 704. As shown in FIG. 7b , the first incident angle and the second incident angle are both positive angles. In this embodiment, the first incident angle of the first beam 701 incident on the cylindrical lens 431 is greater than the incident angle of the second beam 702 incident on the cylindrical lens 431 . Second angle of incidence. For descriptions of the first incident angle and the second incident angle, please refer to the corresponding description in Figure 6a, and details will not be repeated. When the first incident angle of the first light beam 701 entering the lenticular lens 431 is greater than the second incident angle of the second light beam 702 entering the lenticular lens 431 , the lenticular lens 431 will deflect the first sub-beam 703 at a greater deflection angle than the lenticular lens 431 The deflection angle of the second sub-beam 704 is deflected such that the first sub-beam 703 is incident on the first column of pixels 711 of the pixel array, and the second sub-beam 704 is incident on the second column of pixels 712 of the pixel array. In other examples, when the first incident angle of the first beam incident on the lenticular lens is smaller than the second incident angle of the second beam incident on the lenticular lens, the deflection angle of the first sub-beam deflected by the lenticular lens is smaller than the deflection angle of the first sub-beam deflected by the lenticular lens. The deflection angles of the two sub-beams are such that the first sub-beam is incident on the second column of pixels in the pixel array, and the second sub-beam is incident on the first column of pixels in the pixel array.

Continue to refer to Figure 7c, which is a fourth example diagram of the first sub-beam and the second sub-beam incident on the pixel array provided by the embodiment of the present application. The lenticular lens 431 receives the first light beam and the second light beam. For the description of the lenticular lens 431, please refer to the corresponding description in Fig. 6a, and details will not be repeated. The lenticular lens 431 shown in this embodiment corresponds to four columns of pixels in the pixel array, that is, the lenticular lens 431 corresponds to the first column of pixels 711, the second column of pixels 712, the third column of pixels 713, and the fourth column of pixels 714 of the pixel array. The cylindrical lens 431 deflects the transmission direction of the first beam 731 and separates the first sub-beam 732. The cylindrical lens 431 deflects the transmission direction of the second beam 733 and splits the second sub-beam 734. As shown in FIG. 7c , the first incident angle and the second incident angle are both negative angles as an example. In this embodiment, the first incident light beam 731 is also incident on the cylindrical lens 431 . The absolute value of the angle is greater than the absolute value of the second incident angle of the second light beam 733 incident on the lenticular lens 431 . For descriptions of the first incident angle and the second incident angle, please refer to the corresponding description in Figure 6a, and details will not be repeated. The first beam 731 is deflected by the cylindrical lens 431 and split into a first sub-beam 732. The second beam 733 is deflected by the cylindrical lens 431 and split into a second sub-beam 734. The lenticular lens 431 deflects the first sub-beam 732 at a deflection angle greater than the deflection angle of the second sub-beam 734 , so that the first sub-beam 732 is incident on the fourth column of pixels 714 of the pixel array, and the second sub-beam 734 is incident on the pixel array. The third column of pixels is 713. In other examples, if the absolute value of the first incident angle is less than the absolute value of the second incident angle, the deflection angle of the first sub-beam deflected by the cylindrical lens 431 is smaller than the deflection angle of the second sub-beam, causing the first sub-beam to be incident. The third column of pixels 713 of the pixel array, and the second sub-beam is incident on the fourth column of pixels 714 of the pixel array.

In the above embodiment, the light deflection module is a lenticular lens array as an example. In other examples, the light deflection module can also be a liquid crystal array. The liquid crystal array achieves deflection of the first beam transmission direction and deflection of the second beam transmission direction. For a description of the specific deflection process, please refer to Deflection of the First Beam Transmission Direction and Deflection of the Second Beam Transmission Direction by the Cylindrical Lens Array Explanation without going into details.

The three-dimensional image acquisition device shown in Figure 8a is capable of changing the baseline length. Among them, FIG. 8a is a third example diagram of a three-dimensional image acquisition device provided by an embodiment of the present application. The three-dimensional image acquisition device 800 shown in this embodiment includes a first lens group 804, a second lens group 805, and a light deflection module 806. For detailed description, please refer to the corresponding description in Figure 1b, and details will not be described again.

The three-dimensional image acquisition device 800 shown in this embodiment also includes a driving device 810, which is connected to at least one of the first lens group 804 and the second lens group 805. In this embodiment, it is taken as an example that the driving device 810 is connected to the first lens group 804 and the second lens group 805 at the same time. The driving device 810 changes the baseline of the three-dimensional image acquisition device by changing the first distance between the first lens group 804 and the second lens group 805 . Wherein, when the first lens group 804 can successfully receive the first light beam 807 reflected by the object 802 to be photographed and the second lens group 805 can successfully receive the second light beam 803 reflected by the object 802 to be photographed, the first lens group 804 can successfully receive the first light beam 807 reflected by the object 802 to be photographed. The baseline length (ie, the first distance) between 804 and the second lens group 805 has a positive correlation with the stereoscopic effect of the three-dimensional image. For instructions on how the three-dimensional image acquisition device 800 acquires a three-dimensional image based on the first beam 807 and the second beam 803, please refer to the description of the above embodiments, and no further details will be given. It can be understood that the longer the baseline length is, the stronger the stereoscopic effect of the three-dimensional image is. Similarly, the shorter the baseline length is, the worse the stereoscopic effect of the three-dimensional image is.

This embodiment does not limit the implementation type of the driving device 810, as long as the driving device 810 can drive the position of at least one of the first lens group 804 and the second lens group 805 to change the first lens group 804 and the second lens group 804. The baseline length between groups 805 is enough. For example, the driving device 810 may be an electric drive type, a hydraulic drive type, a mechanical drive type, or the like.

The first distance is described with reference to FIG. 8 b , where FIG. 8 b is an example diagram of the first distance of the three-dimensional image acquisition device provided by an embodiment of the present application. The first lens group includes a first lens 301, and the second lens group includes a second lens 304. The baseline length shown in this embodiment is the distance between the center point of the first lens 301 and the center point of the second lens 304 . If the first lens group includes multiple lenses and the second lens group includes multiple lenses, then the baseline length is the distance between the equivalent center point of the first lens group and the equivalent center point of the second lens group. That is, the driving device 810 can change the baseline length by driving the position of at least one of the first lens group and the second lens group.

It should be clear that when the driving device 810 changes the position of at least one of the first lens group and the second lens group, it is also necessary to ensure that the first reflecting mirror group can successfully transmit the first light beam to the light deflection module, and to ensure that The second reflector group can successfully transmit the second light beam to the light deflection module. Optional, if the relative positions of the first lens group and the first mirror group are fixed to form the first lens group. The second lens group and the second mirror group are relatively positioned to form a second lens group. Then, the driving device 810 can change the baseline length by driving the position of at least one of the first lens group and the second lens group.

In this embodiment, the baseline length can be changed based on the second distance between the three-dimensional image acquisition device and the object to be photographed, thereby ensuring that the three-dimensional image acquisition device can successfully capture the object to be photographed and at the same time improving the stereoscopic effect of the collected three-dimensional image. . To this end, it is necessary to ensure that there is a positive correlation between the second distance between the three-dimensional image acquisition device and the object to be photographed and the length of the baseline. It can be understood that if the second distance is increased, the three-dimensional image acquisition device can increase the baseline length. Similarly, if the second distance is reduced, the three-dimensional image acquisition device can reduce the baseline length.

The second distance may be the distance between the first lens group and the object to be photographed. The distance between the first lens 301 and the object to be photographed is shown in FIG. 8b. If the first lens group includes multiple lenses, the second distance may be the distance between the equivalent center point of the first lens group and the object to be photographed. For another example, the second distance is the distance between the second lens group and the object to be photographed. The distance between the second lens 302 and the object to be photographed is shown in FIG. 8b. If the second lens group includes multiple lenses, the second distance may be the distance between the equivalent center point of the second lens group and the object to be photographed. For another example, the second distance is the distance between the center point between the first lens group and the second lens group and the object to be photographed. If both the first lens group and the second lens group include multiple lenses, the second distance is the center point of the line connecting the equivalent center point of the first lens group and the equivalent center point of the second lens group and the distance to be photographed The distance between objects. Optionally, the three-dimensional image acquisition device may further include a distance detector, which is used to detect the second distance between the three-dimensional image acquisition device and the object to be photographed. The distance detector is connected to the driving device 810 so that the driving device 810 can correspondingly adjust the baseline length according to the second distance detected by the distance detector.

Figure 9 is a fourth example diagram of a three-dimensional image acquisition device provided by an embodiment of the present application. The three-dimensional image acquisition device shown in this embodiment does not need to be provided with an image sensor, but instead reuses the sensor of the electronic device. Specifically, the three-dimensional image acquisition device 900 includes a first lens group, a second lens group, and a light deflection module 901. For specific descriptions of the first lens group, the second lens group, and the light deflection module 901, please refer to the above embodiments. , no details will be given. The three-dimensional image acquisition device 900 shown in this embodiment also includes a relay lens group 902. The relay lens group 902 includes one or more relay lenses. The electronic device 910 used to generate a three-dimensional image may be any mobile or portable electronic device, including but not limited to a smart phone, a mobile computer or a tablet computer. The electronic device 910 includes an imaging lens group 912 and an image sensor 911 .

In order to ensure that the first sub-beam 903 deflected by the light deflection module 901 and the second sub-beam 904 deflected by the light deflection module 901 in the transmission direction can form a real image on the image sensor 911 included in the electronic device 910, this embodiment The light deflection module 901 shown is located at the front equivalent focus of the relay lens group 902. The rear equivalent focus of the relay lens group 902 coincides with the front equivalent focus of the imaging lens group 912 . The image sensor 911 is located at the rear equivalent focus of the imaging lens group 912 .

It can be understood that the three-dimensional image acquisition device shown in this embodiment can use multiple first sub-beams to form a left-eye view image on the image sensor included in the electronic device. The three-dimensional image acquisition device can also use multiple second sub-beams to form a right-eye view image on the image sensor included in the electronic device. The electronic device can obtain a 3D image based on the left eye view image and the right eye view image. It can be seen that without the electronic device being equipped with a 3D camera, the 3D image can be acquired through the three-dimensional image acquisition device.

In the three-dimensional image acquisition device shown in this embodiment, in the XY plane, the orthographic projection of the image sensor 911 is located within the coverage of the orthographic projection of the light deflection module 901, and the orthographic projection of the light deflection module 901 is larger than the orthographic projection of the image sensor 911. In the case of projection, part of the first sub-beam and the second sub-beam emitted by the light deflection module 901 will be incident outside the surface of the image sensor 911 . The first sub-beam and the second sub-beam incident outside the surface of the image sensor 911 cannot be imaged on the image sensor 911, resulting in a decrease in the definition of the 3D image formed on the image sensor 911. If at XY level In-plane, if the orthographic projection of the light deflection module 901 is smaller than the orthographic projection of the image sensor 911, then the first sub-beam and the second sub-beam emitted from the light deflection module 901 will only be incident on some pixels of the image sensor 911 , resulting in a waste of 911 pixels of the image sensor.

For this reason, the ratio of the equivalent focal length of the relay lens group 902 to the equivalent focal length of the imaging lens group 912 shown in this embodiment is equal to the ratio of the orthographic projection of the light deflection module 901 to the orthographic projection of the image sensor 911 . Then, when the front projection of the light deflection module 901 is larger than the front projection of the image sensor 911, the relay lens group 902 and the imaging lens group 912 can condense the multiple first sub-beams used to form the left eye view image. and narrowing the multiple second sub-beams used to form the right eye view image to ensure the clarity of the 3D image formed on the image sensor 911. When the front projection of the light deflection module 901 is smaller than the front projection of the image sensor 911, the relay lens group 902 and the imaging lens group 912 can expand and expand the multiple first sub-beams used to form the left eye view image. The multiple second sub-beams used to form the right eye view image are beam expanded to ensure the utilization of pixels of the image sensor 911 .

Figure 10 is an example diagram of a three-dimensional image capturing device provided by an embodiment of the present application. The three-dimensional image capturing device shown in this embodiment can capture 3D images. The three-dimensional image capturing device shown in this embodiment can be a 3D camera, a smart phone, a laptop, a tablet, a wearable device, etc.

The three-dimensional image capturing device 1000 shown in this embodiment includes a first lens group 1001, a second lens group 1002, a light conversion module 1003 and an image sensor 1004. For specific instructions, please refer to the above embodiments, and details will not be described again. The three-dimensional image capturing device 1000 shown in this embodiment also includes an image sensor 1004, an analog to digital converter (A/D) 1005, and an image processor 1006 connected in sequence. The image sensor 1004 is configured to convert multiple first sub-beams into first analog electrical signals. The first analog electrical signal is used to acquire a first perspective image (such as a left eye view image). The image sensor 1004 is also used to convert the multiple second sub-beams into a second analog electrical signal (such as a right eye view image). In this example, the first perspective image is a left eye view image, and the second perspective image is a right eye view image. In other examples, the first perspective image can also be a left eye view image, and the second perspective image is a right eye view image. The view image is not specifically limited in this embodiment. The A/D1005 is used to convert the first analog electrical signal into a first digital electrical signal. The A/D1005 is used to convert the second analog electrical signal into a second digital electrical signal. The image processor 1006 is used to acquire a 3D image signal according to the first digital electrical signal and the second digital electrical signal. Optionally, if the three-dimensional image capturing device 1000 shown in this embodiment also includes a display screen 1007, the image processor 1006 is used to send a 3D image signal to the display screen 1007. The display screen 1007 displays a 3D image according to the 3D image signal.

The A/D 1005 and image processor 1006 shown in this embodiment can be implemented by one or more processors. The processor can be one or more graphics processing unit (GPU), field-programmable gate array (FPGA), application specific integrated circuit (ASIC), system chip (system on chip, SoC), central processor unit (CPU), network processor (NP), digital signal processing circuit (digital signal processor, DSP), microcontroller unit (MCU), Programmable logic device (PLD) or other integrated chips, or any combination of the above chips or processors, etc.

The display screen 1007 can be a liquid crystal display (LCD) or an organic light-emitting diode (OLED).

The structure of the three-dimensional image viewing device provided by the embodiment of the present application will be described with reference to FIG. 11a. FIG. 11a is a first structural example diagram of the three-dimensional image viewing device provided by the embodiment of the present application.

The three-dimensional image viewing device shown in this embodiment includes a three-dimensional image capturing device 1141. The three-dimensional image capturing device The specific description of 1141 is shown in Figure 10, and the details will not be repeated. The three-dimensional image display device shown in this embodiment also includes a display module 1142 connected to the three-dimensional image capturing device 1141. Wherein, the three-dimensional image capturing device 1141 is used to send three-dimensional images to the display module 1142. The display module 1142 is configured to acquire multiple first exit light beams according to the first viewing angle image of the three-dimensional image. For example, the first perspective image may be a left eye view image. The display module 1142 is also configured to acquire multiple second exit light beams according to the second viewing angle image of the three-dimensional image. For example, the second perspective image may be a right eye view image. The display module 1142 is also used to transmit the multiple first output beams to the first viewing area in the space, and to transmit the multiple second output beams to the second viewing area in the space. The first viewing area is different from the second viewing area. The multiple first outgoing light beams transmitted to the first viewing area and the multiple second outgoing light beams transmitted to the second viewing area can form a 3D image.

The specific structure of the three-dimensional image viewing device will be described with reference to Figure 11b. Figure 11b is a second structural example diagram of the three-dimensional image viewing device provided by the embodiment of the present application.

Specifically, the display module 1142 shown in this embodiment includes a display screen 1007 and a light projection module. Wherein, the display screen 1007 includes a pixel array. When the pixel array of the image sensor includes multiple pixels arranged in multiple columns along the Y direction, the display screen 1007 shown in this embodiment also includes the pixel array arranged in multiple columns along the Y direction. It can be understood that the multiple pixels included in the display screen 1007 and the multiple pixels included in the image sensor are arranged in multiple columns along the same direction.

This embodiment takes the structure of the image sensor as shown in FIG. 4b as an example. In the pixel array of the image sensor, the pixels in the odd-numbered columns are the first imaging area, and the pixels in the even-numbered columns are the second imaging area. Then, in the pixel array of the display screen 1007, the odd-numbered columns of pixels are used to display the first perspective image (such as the left eye view image) acquired in the first imaging area. In the pixel array of the display screen 1007, the even-numbered columns of pixels are used to display the second perspective image (such as the right eye view image) acquired in the second imaging area.

For example, the first column of pixels 231, the third column of pixels 233, the fifth column of pixels 235, the seventh column of pixels 237, and the ninth column of pixels 239 in the pixel array of the image sensor are respectively the first imaging areas. When the first perspective image is a left-eye view image, the first column of pixels 231 is used to obtain the first left-eye sub-image, the third column of pixels 233 is used to obtain the second left-eye sub-image, and the fifth column of pixels 235 is used to obtain the second left-eye sub-image. To obtain the third left-eye sub-image, the seventh column of pixels 237 is used to obtain the fourth left-eye sub-image, and the ninth column of pixels 239 is used to obtain the fifth left-eye sub-image. The first left-eye sub-image, the second left-eye sub-image, the third left-eye sub-image, the fourth left-eye sub-image and the fifth left-eye sub-image can be spliced to form a left-eye view image.

Then, the first column of pixels 1101 of the display screen 1007 is used to display the first left-eye sub-image. The third column of pixels 1103 of the display screen 1007 is used to display the second left-eye sub-image. The fifth column of pixels 1105 of the display screen 1007 is used to display the third left-eye sub-image. The seventh column of pixels 1107 of the display screen 1007 is used to display the fourth left-eye sub-image. The ninth column of pixels 1109 of the display screen 1007 is used to display the fifth left-eye sub-image.

Similarly, the second column of pixels 232, the fourth column of pixels 234, the sixth column of pixels 236, the eighth column of pixels 238 and the tenth column of pixels 240 of the image sensor are the second imaging area. When the second perspective image is a right-eye view image, the second column of pixels 232 is used to obtain the first right-eye sub-image. The fourth column of pixels 234 is used to obtain the second right eye sub-image. The sixth column of pixels 236 is used to obtain the third right eye sub-image. The eighth column of pixels 238 is used to obtain the fourth right eye sub-image. The tenth column of pixels 240 is used to obtain the fifth right eye sub-image. The first right eye sub-image, the second right eye sub-image, the third right eye sub-image, the fourth right eye sub-image and the fifth right eye sub-image can be spliced to form a right eye view image.

Then, the second column of pixels 1102 of the display screen 1007 is used to display the first right-eye sub-image. The fourth column of pixels 1104 of the display screen 1007 is used to display the second right-eye sub-image. The sixth column of pixels 1106 of the display screen 1007 is used to display the third right-eye sub-image. The eighth column of pixels 1108 of the display screen 1007 is used to display the fourth right-eye sub-image. Display screen 1007 Ten columns of pixels 1110 are used to display the fifth right eye sub-image.

The three-dimensional image viewing device shown in this embodiment also includes a light projection module. The light projection module shown in this embodiment may be a lenticular lens array or a liquid crystal array. In this embodiment, the light projection module is a lenticular lens array 1120 as an example. The lenticular lens array 1120 has a light incident surface facing the display screen 1007 . The light exit surface of the lenticular lens array 1120 is away from the display screen 1007 . For a specific description of the lenticular lens array 1120 shown in this embodiment, please refer to the description shown in FIG. 4a and will not be described again.

The distance between the display screen 1007 and the lenticular lens array 1120 is equal to the focal length of the lenticular lens array 1120 . When the multiple pixels included in the image sensor and the multiple pixels included in the display screen 1007 are arranged in multiple columns along the direction Y, the multiple lenticular lenses included in the lenticular lens array 1120 are also arranged along the direction Y. Multiple. As shown in this embodiment, the lenticular lens array 1120 includes five lenticular lenses as an example. The first lenticular lens corresponds to the first column of pixels 1101 and the second column of pixels 1102 of the display screen 1007, and so on. The last column of the lenticular lens array 1120 One lenticular lens corresponds to the ninth column of pixels 1109 and the tenth column of pixels 1110 of the display screen 1007. For specific description, please refer to Figure 4b and Figure 5. Each lenticular lens corresponds to the odd column of pixels and the even column of pixels of the image sensor. Explanation without going into details.

The lenticular lens array 1120 projects the image displayed by the odd-numbered rows of pixels of the display screen 1007 to emit the first outgoing light beam. The lenticular lens array 1120 projects the image displayed by the pixels in the even columns of the display screen 1007 to emit the second outgoing light beam. For example, the first lenticular lens 1121 included in the lenticular lens array 1120 projects the first left-eye sub-image displayed by the first column of pixels 1101 of the display screen 1007 to obtain the first exit light beam. The lenticular lens 1121 also projects the first right-eye sub-image displayed by the second column of pixels 1102 of the display screen 1007 to obtain the second outgoing light beam. The lenticular lens 1121 emits a first beam and a second beam in different directions, so that the first beam is transmitted to the first viewing area 1131 in space, and the second beam is transmitted to the second viewing area in space. 1132. The first viewing area 1131 and the second viewing area 1132 are located at different positions in space. For a description of how other lenticular lenses included in the lenticular lens array emit the first outgoing beam and the second outgoing beam, please refer to the description of the lenticular lens 1121, and details will not be described again.

The left eye of the viewer can view the left eye view image formed by the multiple first outgoing light beams in the first viewing area 1131 . The viewer's right eye can view the right eye view image formed by the multiple second outgoing light beams in the second viewing area 1132 . It can be understood that the viewer can only view the left-eye view images displayed in the odd-numbered columns of the display screen in the first viewing area 1131 . The viewer can only view the right-eye view images displayed in the even-numbered columns of the display screen in the second perspective viewing area 1132 . Then, the left-eye view image and the right-eye view image synthesize a realistic three-dimensional image with space and depth in the viewer's mind.

Using the three-dimensional image viewing device shown in this embodiment, the viewer can successfully view the three-dimensional image. Moreover, the light projection module will not block the display screen, ensuring the brightness and clarity of the three-dimensional image viewed by the viewer.

Figure 12 is a flow chart of the first execution steps of the three-dimensional image acquisition method provided by the embodiment of the present application. The execution subject of the method shown in this embodiment is a three-dimensional image acquisition device.

Step 1201: The first lens group transmits the first light beam reflected by the object to be photographed to the light deflection module.

Step 1202: The second lens group transmits the second light beam reflected by the object to be photographed to the light deflection module.

Step 1203: The optical deflection module deflects the transmission direction of the first beam and branches out multiple first sub-beams.

Step 1204: The optical deflection module deflects the transmission direction of the second beam and branches out multiple second sub-beams.

For descriptions of the execution process and beneficial effects of steps 1201 to 1204 shown in this embodiment, please refer to the descriptions shown in Figure 1a, Figure 1b, Figure 1c, Figure 2a and Figure 2b, and details will not be described again.

The specific process of deflecting the first beam and the second beam by the light deflection module is explained with reference to Figure 13, where Figure 13 is the A flow chart of the second execution steps of the three-dimensional image acquisition method provided by the application embodiment.

Step 1301: The first lens group transmits the first light beam reflected by the object to be photographed to the light deflection module.

Step 1302: The second lens group transmits the second light beam reflected by the object to be photographed to the light deflection module.

For an explanation of the execution process of steps 1301 to 1302 shown in this embodiment, please refer to the corresponding steps 1201 to 1202 in Figure 12 , and the specific execution process will not be described again.

Step 1303: The target sub-deflection module deflects the transmission direction of the first light beam so that the first sub-light beam is incident on the i-th column of pixels in the pixel array.

Step 1304: The target sub-deflection module deflects the transmission direction of the second light beam so that the second sub-light beam is incident on the i+1th column pixel of the pixel array.

The optical deflection module shown in this embodiment includes multiple sub-deflection modules. The target sub-deflection module shown in steps 1303 to 1304 in this embodiment is any sub-deflection module included in the optical deflection module. For example, if the light deflection module is a lenticular lens array, then the target sub-deflection module is a lenticular lens included in the lenticular lens array. For a description of the execution process of steps 1303 to 1304 shown in this embodiment, as well as a description of the beneficial effects of this embodiment, please refer to the description of Figure 4a, Figure 4b, Figure 5 and Figure 6a, and the details will not be repeated.

Using the method shown in this embodiment, a target sub-deflection module can transmit the first sub-beam to the pixels in the i-th column of the pixel array and the second sub-beam to the pixels in the i+1-th column of the pixel array, reducing the image quality. The number of pixels on the sensor that are not used for imaging increases the utilization of the pixels included in the image sensor.

Figure 14 is a flow chart of the third execution steps of the three-dimensional image acquisition method provided by the embodiment of the present application.

Step 1401: The driving device changes the first distance between the first lens group and the second lens group.

For an explanation of the execution process of step 1401 shown in this embodiment, please refer to the embodiment shown in Figure 8a, and details will not be described again.

Step 1402: The first lens group transmits the first light beam reflected by the object to be photographed to the light deflection module.

Step 1403: The second lens group transmits the second light beam reflected by the object to be photographed to the light deflection module.

Step 1404: The optical deflection module deflects the transmission direction of the first beam and branches out multiple first sub-beams.

Step 1405: The optical deflection module deflects the transmission direction of the second beam and branches out multiple second sub-beams.

For a description of the execution process of step 1402 to step 1405 shown in this embodiment, as well as a description of the beneficial effects shown in this embodiment, please refer to the corresponding execution process of step 1202 to step 1204 in Figure 12, and details will not be described again.

Step 1501: The first lens group transmits the first light beam reflected by the object to be photographed to the light deflection module.

Step 1502: The second lens group transmits the second light beam reflected by the object to be photographed to the light deflection module.

Step 1503: The optical deflection module deflects the transmission direction of the first beam and branches out multiple first sub-beams.

Step 1504: The optical deflection module deflects the transmission direction of the second beam and branches out multiple second sub-beams.

For description of the execution process of steps 1501 to 1504 shown in this embodiment, please refer to the corresponding description of steps 1201 to 1204 in Figure 12 , and details will not be described again.

Step 1505: The relay lens group transmits the first sub-beam to the first imaging area.

Step 1506: The relay lens group transmits the second sub-beam to the second imaging area.

For a description of the execution process of steps 1505 to 1506 shown in this embodiment, as well as a description of the beneficial effects, please refer to the corresponding description in Figure 9 , and the specific execution process will not be described again.

As mentioned above, the above embodiments are only used to illustrate the technical solution of the present invention, but not to limit it; although referring to the above The above embodiments have described the present invention in detail. Those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent substitutions for some of the technical features; and these modifications or Substitution does not deviate from the essence of the corresponding technical solution from the spirit and scope of the technical solution of each embodiment of the present invention.

Claims

A three-dimensional image acquisition device, characterized in that the three-dimensional image acquisition device includes a first lens group, a second lens group and a light deflection module;

The first lens group is used to transmit the first light beam reflected by the object to be photographed to the light deflection module;

The second lens group is used to transmit the second light beam reflected by the object to be photographed to the light deflection module;

The optical deflection module is used to deflect the transmission direction of the first light beam and branch out multiple first sub-beams. The optical deflection module is also used to deflect the transmission direction of the second light beam and branch out multiple first sub-beams. Second sub-beams, each of the first sub-beams is incident on the first imaging area of the image sensor, each of the second sub-beams is incident on the second imaging area of the image sensor, two adjacent ones at any position The second imaging area is included between the first imaging areas.
The three-dimensional image acquisition device according to claim 1, wherein the first light beam enters the light deflection module at a first incident angle, and the second light beam enters the light deflection module at a second incident angle, The first angle of incidence is different from the second angle of incidence.
The three-dimensional image acquisition device according to claim 2, wherein the first incident angle and the second incident angle are opposite in positive and negative directions.
The three-dimensional image acquisition device according to any one of claims 1 to 3, wherein the image sensor includes a plurality of first imaging areas and a plurality of second imaging areas.
The three-dimensional image acquisition device according to claim 4, wherein the light deflection module includes a plurality of sub-deflection modules, the image sensor includes a pixel array; the target sub-deflection module corresponds to the first target imaging area and the second target imaging area. area, the target sub-deflection module is one of the plurality of sub-modules, the target first imaging area is one of a plurality of the first imaging areas, and the target second imaging area is a plurality of the One of the second imaging areas, the target first imaging area and the target second imaging area are adjacent;

The first sub-beam emitted from the target sub-deflection module is incident on the first target imaging area, and the second sub-beam emitted from the target sub-deflection module is incident on the second target imaging area. The target first imaging area includes at least one column of pixels of the pixel array, and the target second imaging area includes at least one column of pixels of the pixel array.
The three-dimensional image acquisition device according to claim 5, wherein the target first imaging area includes the i-th column of pixels of the pixel array, and the target second imaging area includes the i+th column of the pixel array. 1 column of pixels, i is any natural number not less than 1.
The three-dimensional image acquisition device according to claim 6, wherein the orthographic projection of the target sub-deflection module coincides with the orthographic projection of the i-th column pixels and the i+1-th column pixels.
The three-dimensional image acquisition device according to claim 6, wherein the forward projection of the target sub-deflection module is located between the forward projection of the pixels in the i-th column and the forward projection of the pixels in the i+1th column in the pixel array. within coverage.
The three-dimensional image acquisition device according to any one of claims 1 to 8, characterized in that the three-dimensional image acquisition device further includes a driving device, and the driving device is connected with the first lens group and/or the second lens group. The lens group is connected, and the driving device is used to change the first distance between the first lens group and the second lens group.
The three-dimensional image acquisition device according to claim 9, wherein the driving device is used to change the first distance according to the second distance between the three-dimensional image acquisition device and the object to be photographed, wherein, There is a positive correlation between the second distance and the first distance.
The three-dimensional image acquisition device according to any one of claims 1 to 10, wherein the first lens The group includes a first lens group and a first mirror group, the second lens group includes a second lens group and a second mirror group;

The first lens group is used to transmit the first light beam reflected by the object to be photographed to the first mirror group;

The second lens group is used to transmit the second light beam reflected by the object to be photographed to the second mirror group;

The first reflector group is used to reflect the first light beam toward the light deflection module;

The second reflecting mirror group is used to reflect the second light beam toward the light deflection module.
The three-dimensional image acquisition device according to any one of claims 1 to 11, characterized in that the three-dimensional image acquisition device is used to connect to an electronic device, the electronic device includes an imaging lens group and the image sensor, The three-dimensional image acquisition device further includes a relay lens group located between the light deflection module and the imaging lens group, the relay lens group is used to transmit the first sub-beam to the first imaging area, The relay lens group is also used to transmit the second sub-beam to the second imaging area.
The three-dimensional image acquisition device according to claim 12, characterized in that the ratio of the equivalent focal length of the relay lens group to the equivalent focal length of the imaging lens group is equal to the forward projection of the light deflection module and the The ratio of the image sensor's orthographic projection.
A three-dimensional image acquisition method, characterized in that the method is applied to a three-dimensional image acquisition device, the three-dimensional image acquisition device includes a first lens group, a second lens group and a light deflection module, the method includes:

transmit the first light beam reflected by the object to be photographed to the light deflection module through the first lens group;

transmit the second light beam reflected by the object to be photographed to the light deflection module through the second lens group;

Deflect the transmission direction of the first beam through the light deflection module and branch out multiple first sub-beams;

The light deflection module deflects the transmission direction of the second beam and branches out multiple second sub-beams. Each of the first sub-beams is incident on the first imaging area of the image sensor. Each of the second sub-beams is incident on the first imaging area of the image sensor. The sub-beam is incident on the second imaging area of the image sensor, between two adjacent first imaging areas at any position, including the second imaging area.
The method of claim 14, wherein transmitting the first light beam reflected by the object to be photographed through the first lens group to the light deflection module includes:

The first light beam is incident on the light deflection module at a first incident angle through the first lens group;

Transmitting the second light beam reflected by the object to be photographed to the light deflection module through the second lens group includes:

The second light beam is incident on the light deflection module at a second incident angle through the second lens group, and the first incident angle is different from the second incident angle.
The method according to claim 14 or 15, wherein the light deflection module includes a plurality of sub-deflection modules, the image sensor includes a plurality of the first imaging areas and a plurality of the second imaging areas; Deflecting the transmission direction of the first beam through the light deflection module and branching out multiple first sub-beams includes:

The first sub-beam is incident on the target first imaging area through a target sub-deflection module, the target sub-deflection module corresponds to the target first imaging area, and the target sub-deflection module is one of the plurality of sub-modules, The target first imaging area is one of a plurality of first imaging areas, and the target first imaging area includes at least one column of pixels of the image sensor pixel array;

Deflecting the transmission direction of the second beam through the light deflection module and branching out multiple second sub-beams includes:

The second sub-beam is incident on the target second imaging area through the target sub-deflection module. The target sub-deflection module corresponds to the target second imaging area. The target second imaging area is a plurality of the second target imaging areas. One of the imaging areas, the target second imaging area includes at least one column of pixels of the pixel array, and the target first imaging area and the target second imaging area are adjacent.
The method of claim 16, wherein the target first imaging area includes pixels in the i-th column of the pixel array, and the target second imaging area includes pixels in the i+1th column of the pixel array. , the i is any natural number not less than 1.
The method according to any one of claims 14 to 17, characterized in that the three-dimensional image acquisition device further includes a driving device that transmits the first light beam reflected by the object to be photographed through the first lens group to the Before describing the light deflection module, the method further includes:

The first distance between the first lens group and the second lens group is changed by the driving device.
The method of claim 18, wherein changing the first distance between the first lens group and the second lens group through the driving device includes:

The first distance is changed by the driving device according to the second distance between the three-dimensional image acquisition device and the object to be photographed, wherein there is a positive correlation between the second distance and the first distance. .
The method according to any one of claims 14 to 19, characterized in that the three-dimensional image acquisition device is used to connect to an electronic device, the electronic device includes an imaging lens group and the image sensor, and the three-dimensional image acquisition device The device also includes a relay lens group located between the light deflection module and the imaging lens group. The light deflection module deflects the transmission direction of the first beam and separates multiple first sub-beams. Afterwards, the method further includes:

transmit the first sub-beam to the first imaging area through the relay lens group;

After the light deflection module deflects the transmission direction of the second beam and separates multiple second sub-beams, the method further includes:

The second sub-beam is transmitted to the second imaging area through the relay lens group.
A three-dimensional image capturing device, characterized in that the three-dimensional image capturing device includes an image sensor, a processor, and a three-dimensional image acquisition device as claimed in any one of claims 1 to 13;

The image sensor is configured to acquire a first viewing angle image according to the multiple first sub-beams incident on the first imaging area;

The image sensor is configured to acquire a second viewing angle image according to the multiple second sub-beams incident on the second imaging area;

The processor is configured to acquire a three-dimensional image according to the first perspective image and the second perspective image.
A three-dimensional image viewing device, characterized by comprising a display module and a three-dimensional image shooting device as claimed in claim 21;

The three-dimensional image capturing device is used to send the three-dimensional image to the display module;

The display module is used to obtain multiple first outgoing light beams according to the first viewing angle image, and is also used to obtain multiple second outgoing light beams based on the second viewing angle image;

The display module is also used to transmit the plurality of first output beams to the first viewing area in the space, and to transmit the plurality of second output beams to the second viewing area in the space. The viewing area of one viewing angle is different from the viewing area of the second viewing angle.
The three-dimensional image viewing device according to claim 22, wherein the display module includes a display screen and a light projection module;

The display screen is used to display the three-dimensional image;

The light projection module is used to project the three-dimensional image displayed on the display screen and obtain the multiple first outgoing beams and the multiple second outgoing beams.