EP3894925A1

EP3894925A1 - Multi-channel imaging apparatus and an apparatus comprising a multi-aperture imaging apparatus

Info

Publication number: EP3894925A1
Application number: EP19813525.3A
Authority: EP
Inventors: Frank Wippermann; Jacques DUPARRÉ
Original assignee: Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Current assignee: Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Priority date: 2018-12-10
Filing date: 2019-12-03
Publication date: 2021-10-20
Also published as: CN113227867A; TWI742480B; TW202024718A; DE102018222830A1; CN113227867B; WO2020120230A1; JP7285931B2; JP2022512354A; US20210281819A1; KR20210095679A; US11611736B2

Abstract

A multi-aperture imaging apparatus comprises an image sensor, an array of optical channels disposed next to one another, each optical channel comprising an optical unit for imaging at least a partial field of view of an overall field of view onto an image sensor region of the image sensor, a beam deflection device for deflecting a beam path of the optical channels, the beam deflection device having a first beam deflection region that is effective for a first wavelength range of electromagnetic radiation passing through the optical channel and a second beam deflection region that is effective for a second wavelength range, differing from the first wavelength range, of the electromagnetic radiation passing through the optical channels.

Description

Multi-channel imaging device and device with a multi-aperture imaging device

description

The present invention relates to a multi-channel imaging device and to a device with a multi-channel imaging device. The present invention further relates to a portable device having a multi-aperture imaging device.

Conventional cameras transmit the entire field of view in one channel and are limited in their miniaturization. In mobile devices such as smartphones, two cameras are used, which are oriented in and against the direction of the surface normal of the display.

Accordingly, it would be desirable to have a concept that enables miniaturized devices for capturing an entire field of view while ensuring high image quality.

The object of the present invention is therefore to create a multi-aperture imaging device which enables a high degree of image information while at the same time requiring little space for the multi-aperture imaging device.

This object is achieved by the subject matter of the independent claims.

A key concept of the present invention is to have recognized that the above object can be achieved in that a high degree of image information can be obtained by recording the overall field of view in different wavelength ranges, which means a small number of recording channels and thus small sizes and low costs enables.

According to one embodiment, a multi-aperture imaging device comprises an image sensor; an array of optical channels arranged next to one another, each optical channel comprising an optical system for imaging at least a partial field of view of an overall field of view onto an image sensor region of the image sensor. The multi-aperture imaging device has a beam deflection device for deflecting a beam path the optical channels, the beam deflecting device having a first beam deflecting region which is effective for a first wavelength range of electromagnetic radiation passing through the optical channel; and has a second beam deflection area which is effective for a second wavelength range of the electromagnetic radiation which passes through the optical channel and which is different from the first wavelength range. The advantage of this is that images can be captured in different wavelength ranges with the same camera or the same channels.

According to one exemplary embodiment, the multi-aperture imaging device is designed to capture a first image of the entire field of view using the first beam deflection region with the image sensor, so that the first image is based on the first wavelength range; and to capture a second image of the entire field of view using the second beam deflection region with the image sensor, so that the second image is based on the second wavelength region.

According to one exemplary embodiment, the multi-aperture imaging device is designed to determine a depth map for the first exposure using the second exposure. This enables depth information to be obtained regarding the entire field of view.

According to one exemplary embodiment, the first beam deflection area is arranged on a first side of the beam deflection device and the second beam deflection area is arranged on a second side opposite to the first side, and the beam deflection device is designed such that the first side faces the image sensor for acquiring a first image of the total field of view is arranged, and for capturing a second image of the total field of view the second side is arranged facing the image sensor.

According to one exemplary embodiment, a first side of the beam deflection device has a coating that differs from a second, opposite side, in order to be effective in the first or second wavelength range.

According to one embodiment, the beam deflection device is designed to reflect the first wavelength range when effective in the first wavelength range and to at least partially absorb different wavelength ranges thereof beers and / or wherein the beam deflection device is designed to reflect the second wavelength range when effective in the second wavelength range and to absorb at least partially different wavelength ranges therefrom. This enables a reduction or avoidance of false light in the pictures and thus a high image quality.

According to one embodiment, the overall field of view is a first overall field of view, and the multi-aperture imaging device has a first line of sight for capturing the first overall field of view and a second line of sight towards a second overall field of view. The multi-aperture imaging device is designed to capture a third image of the second overall field of view using the first beam deflection region with the image sensor, so that the third image is based on the first wavelength range; and to acquire a fourth image of the second total field of view using the second beam deflection region with the image sensor, so that the fourth image is based on the second wavelength region. Both total, possibly spatially spaced, fields of view can thus be recorded in both wavelength ranges.

According to one exemplary embodiment, the first overall field of view and the second overall field of view are arranged along different main directions of the multi-aperture imaging device, and the beam deflection regions deflect the beam path alternately in the direction of the first overall field of view and the second overall field of view and alternately with the first beam deflection region and the second beam deflection region when a progressive rotary movement is carried out around. This can be an implemented or theoretical consideration of the sequence of movements. Exemplary embodiments provide in particular that a shortest path and therefore a shortest actuating time are implemented in order to change a position or position of the beam deflection device, so that the beam deflection device can be moved in different directions.

According to one exemplary embodiment, the beam deflection device is designed to have an angle of incidence of 45 ° ± 10 ° of the first beam deflection region with respect to the image sensor in order to obtain a first image of the overall field of view and to have an angle of incidence of 45 ° ± 10 ° of the second in order to obtain a second image of the overall field of view To have beam deflection area with respect to the image sensor. This angle of attack enables the beam path to be deflected by approximately 90 ° and to a small extent Size of the multi-aperture imaging device, since the small thickness of the multi-aperture imaging device can be used to advantage.

According to one embodiment, the multi-aperture imaging device is designed to capture the entire field of view through at least two partial fields of view and to capture at least one of the partial fields of view through at least a first optical channel and a second optical channel. This enables the occlusion effects to be avoided or reduced.

According to one exemplary embodiment, the multi-aperture imaging device is designed to segment the total field of view into exactly two partial facial fields and to capture exactly one of the partial field of view through a first optical channel and a second optical channel. This enables the occlusion to be reduced or avoided and, at the same time, a small number of optical channels, which enables a small size and / or low costs.

According to one exemplary embodiment, the first optical channel and the second optical channel are spaced apart by at least one further optical channel in the array. This enables the occlusion effects to be avoided or reduced. In particular with a symmetrical arrangement of the optical channels receiving the partial field of view around a further optical channel, occlusion effects can be reduced or avoided. E.g. a first partial field of view is taken up by channels to the left and right of the channel which receives a second partial field of view, in particular when the total field of view is divided into exactly two partial fields of view along a vertical direction or perpendicular to a direction along which the optical channels in the array are more optical Channels can be arranged, the line extension direction.

According to one exemplary embodiment, the beam deflection device is formed as an array of facets, each optical channel being assigned to a facet, and each of the facets having the first beam deflection area and the second beam deflection area. This enables facet-specific or even channel-specific setting of a divergence in the deflected optical channels, so that the set proportion of divergence does not have to be set in the optical channels or the optics themselves. According to one exemplary embodiment, the facets of the array of facets are formed as reflectors that are reflective on both sides and plane-parallel on both sides. This enables simple design of the facets.

According to one exemplary embodiment, the image sensor regions are designed for image generation in the first wavelength region and for image generation in the second wavelength region. This enables a space-saving design of the image sensor.

According to one exemplary embodiment, pixels of the image sensor areas are designed for image generation in the first wavelength range and at least partially for image generation in the second wavelength range. This can be done, for example, by arranging appropriate filters and / or by integrating or substituting appropriately configured photo cells in groups of photo cells, for example a Bayer pattern.

According to one exemplary embodiment, the first wavelength range comprises a visible spectrum and the second wavelength range comprises an infrared spectrum, in particular a near infrared spectrum. This enables the multi-aperture imaging device to be designed in such a way that additional image information can be obtained by means of the infrared spectrum.

According to one exemplary embodiment, the multi-aperture imaging device furthermore has an illumination device which is designed to emit a temporal or spatial illumination pattern with a third wavelength range which at least partially corresponds to the second wavelength range. This enables targeted illumination of the entire field of view with light of the second wavelength range, so that the arrangement of further illumination sources for this wavelength range can be dispensed with.

According to one embodiment, the multi-aperture imaging device is designed to capture the entire field of view, at least stereoscope. This enables an additional increase in the image information obtained.

According to one exemplary embodiment, the beam deflection device is designed to block or attenuate the second wavelength region with the first beam deflection region and to block or attenuate the first wavelength region with the second beam deflection region. This enables the wavelength ranges to be isolated the deflection, so that only light strikes the image sensor for use in the desired recording.

According to one exemplary embodiment, a device comprises a multi-aperture imaging device according to the invention and is designed to generate a depth map of the overall field of view.

According to one embodiment, the device does not have an additional infrared camera.

According to one exemplary embodiment, the device is designed to record the entire field of view from a perspective and to provide no stereoscopic image of the overall field of view. This embodiment is particularly advantageous with the generation of depth information based on the different wavelength ranges, which enable additional imaging modules to be saved for stereoscopic purposes.

Further advantageous embodiments are the subject of the dependent claims.

Preferred embodiments of the present invention are explained below with reference to the accompanying drawings. Show it:

Figure 1 is a schematic perspective view of a device according to an embodiment.

2 shows a schematic view of a main side of a device according to a further exemplary embodiment;

3a shows a beam deflecting device and a state of diaphragms in a first

Operating state according to an embodiment;

3b shows the beam deflection device and the diaphragms in a second operating state;

4a shows a schematic view of the beam deflection device according to an exemplary embodiment, which comprises a plurality of beam deflection regions; 4b shows a schematic view of the beam deflection device according to an alternative configuration to FIG. 4a and according to an exemplary embodiment;

4c-h an advantageous embodiment of a beam deflection device of an imaging device according to an embodiment.

5a shows a schematic perspective view of an imaging device according to an exemplary embodiment;

5b shows a schematic perspective view of a multi-aperture imaging device according to an exemplary embodiment, which has an illumination device which is designed to emit a temporal or spatial illumination pattern;

FIG. 5c shows a schematic side sectional view of a modified imaging device, in which the beam deflection device can be rotated between a first position of the first operating state and a second position;

6a is a schematic view of an overall field of view, which comprises four overlapping partial fields of view;

FIG. 6b shows a division of the total field of view that is changed to FIG. 6a, in which a

Partial field of view is recorded twice and partial fields of view are arranged alongside one another in a first direction;

Fig. 6c a changed to Fig. 6a distribution of the total field of view, in which a

Partial field of view is recorded twice and partial fields of view are arranged side by side along a second direction;

7a shows a schematic perspective view of a device which comprises two multi-aperture imaging devices for stereoscopic imaging of an entire field of view, according to an exemplary embodiment;

Fig. 7b. 1 shows a schematic perspective view of a device which comprises two multi-aperture imaging devices, according to an exemplary embodiment, which is designed to create the depth information instead of a stereoscopic image from the image in one of the wavelength ranges;

7c shows a schematic perspective view of a preferred embodiment of a multi-aperture imaging device according to an exemplary embodiment, which has a single viewing direction;

8 shows a schematic structure comprising a first multi-aperture imaging device and a second multi-aperture imaging device with a common image sensor;

9a-d are schematic views of a multi-aperture imaging device according to one

Embodiment that uses different wavelength ranges; and

10 shows a schematic graph of a sensitivity of an image sensor region of the image sensor of the multi-aperture imaging device over the wavelengths of a first and second wavelength region according to an exemplary embodiment.

Before exemplary embodiments of the present invention are explained in more detail below with reference to the drawings, it is pointed out that identical, functionally identical or equivalent elements, objects and / or structures in the different figures are provided with the same reference numerals, so that they are shown in different exemplary embodiments Description of these elements is interchangeable or can be applied to each other.

The following exemplary embodiments relate to the use of different wavelength ranges for imaging on an image sensor. The wavelength relates to electromagnetic radiation, especially light. An example of different wavelength ranges is, for example, the use of visible light, for example in a wavelength range from approximately 380 nm to approximately 650 nm. A wavelength range that differs from this can, for example, be an ultraviolet spectrum with wavelengths of less than 380 nm and / or an infrared Spectrum with wavelengths of more than 700 nm, approximately from approximately 1,000 nm to approximately 1,000 pm, in particular a near infrared spectrum with wavelengths in a range from approximately 700 nm or 780 nm to approximately 3 pm. The first and the second wavelength range have wavelengths that are at least partially different from one another on. According to one embodiment, the wavelength ranges have no overlaps. According to an alternative exemplary embodiment, the wavelength ranges have an overlap, which is, however, only partial, so that there are wavelengths in both ranges that enable a differentiation.

Exemplary embodiments explained below relate to beam deflection regions of a beam deflection device. A beam deflection area can be a surface area or an area of an object that is configured to deflect a beam path at least in a specific wavelength range. This can be a sequence of at least one applied layer, for example dielectric but also electrically conductive layers, which provide or set a reflectivity. It can be an electrically passive or active property.

In the exemplary embodiments described below, reference is made to main sides and secondary sides of a device. A main page of a device may be understood to be the embodiment described herein as the side of a housing or the device that has a large or a large dimension compared to other sides. For example, although this is not intended to be limiting, a first main page may refer to a front side and a second main page may indicate a back side. Side pages can be understood to mean pages or surfaces that connect the main pages to one another.

Although the exemplary embodiments described below relate to portable devices, the aspects set forth can easily be transferred to other mobile or immobile devices. It goes without saying that the described portable devices can be installed in other devices, for example in vehicles. Furthermore, the housing of a device can be designed so that it is not portable. Therefore, the exemplary embodiments described below are not intended to be limited to portable devices, but can relate to any implementation of a device.

1 shows a schematic perspective view of a portable device 10 according to an exemplary embodiment. The portable device 10 comprises a housing 12 with a first transparent area 14a and a second transparent area 14b. For example, the housing 12 can be formed from an opaque plastic, a metal or the like. The transparent areas 14a and / or 14b can be made in one piece with the housing 12 may be formed or be formed in several pieces. The transparent areas 14a and / or 14b can be recesses in the housing 12, for example. Alternatively, a transparent material can be arranged in a region of the cutouts or the transparent regions 14a and / or 14b. Transparent materials of the transparen ^¬ th portions 14a and / or 14b of electromagnetic radiation may be at least in a wavelength range to be transparent for an imaging device, in particular a Multiaperturabbildungsvorrichtung 16 and an image sensor of the same is susceptible. This means that the transparent regions 14a and / or 14b can be partially or completely opaque in different wavelength ranges. For example, the imaging device 16 can be designed to detect a first and a second wavelength range, for example to detect a visible wavelength range and an at least partially different wavelength range.

The imaging device or multi-aperture imaging device 16 is arranged inside the housing 12. The imaging device 16 comprises a beam deflecting device 18 and an image capturing device 19. The image capturing device 19 can comprise two or more optical channels, each having one or more optics for changing (such as bundling, focusing or scattering) an optical path of the imaging device 16 and an image sensor. Optics can be disjoint or undivided or channel-specific with respect to different optical channels. Alternatively, however, it is also possible for the optics to have elements which act jointly for two, more or all optical channels, for example a common converging lens, a common filter or the like combined with a channel-specific lens.

For example, the image acquisition device 19 can have one or more image sensors, the associated beam paths of which are directed through one or more optical channels onto the beam deflection device 18 and deflected by the latter. As described in connection with FIG. 6a, the at least two optical channels can be deflected such that they capture overlapping partial visual fields (partial object areas) of an overall visual field (overall object area). The imaging device 16 can be referred to as a multi-aperture imaging device. Each image sensor area of the image sensor can be assigned to an optical channel. A constructional gap can be arranged between adjacent image sensor areas or the image sensor areas can be different image sensors or parts be implemented thereof, but it is alternatively or additionally also possible that be ^¬ neighboring image sensing areas directly adjoin each other and are separated from the reading of the image sensor of each other.

The portable device 10 has a first operating state and a second operating state. The operating state can be correlated with a slope, position or orientation of the beam deflection device 18. This can relate to which wavelength range is deflected by the beam deflection device 16 by using pages with different effectiveness for the deflection. Alternatively or additionally, two different operating states can be related to the direction in which the beam path is deflected. In the exemplary multi-aperture imaging device 16, for example, 4 operating states could exist, two for two different viewing directions and two for the different wavelength ranges. One reason for this is that the beam deflection device 16 has a first beam deflection area which is effective for the first wavelength range of electromagnetic radiation passing through the optical channel; and has a second beam deflection region which is effective for the second wavelength region of the electromagnetic radiation which passes through the optical channels and which is different from the first wavelength region.

With regard to the viewing directions, in the first operating state the beam deflection device 18 can deflect the beam path 22 of the imaging device 16 such that it runs through the first transparent region 14a, as is indicated by the beam path 22a. In the second operating state, the beam deflection device 18 can be designed to deflect the beam path 22 of the imaging device 16 such that it runs through the second transparent region 14b, as is indicated by the beam path 22b. This can also be understood to mean that the beam deflection device 18 directs the beam path 22 through one of the transparent regions 14a and / or 14b at a time and based on the operating state. Based on the operating state, a position of a visual field (object area), which is captured by the imaging device 16, can be arranged to be variable in space.

The first beam deflection area effective for the first wavelength range and the second beam deflection area effective for the second wavelength range can be used alternately to deflect the beam paths of the optical channels or the beam path 22. This makes it possible to steer that part of the spectrum in the direction of the image sensor for which the beam deflection area is effective. E.g. can he Strahlumlenkbereich have a band-pass functionality and those Wellenlän ^¬ gene regions deflect, ie, reflecting, for the band-pass functionality, is designed while other wavelength ranges suppressed, are filtered out or at least greatly attenuated, such as by at least 20 dB, at least 40 dB, or at least 60 dB.

The beam deflection areas can be arranged on the same side of the beam deflection device 18, which offers advantages in the case of beam deflection devices that can be displaced in translation. Alternatively or additionally, different beam deflection areas can also be arranged on different sides of the beam deflection device 18, which can alternately face the image sensor based on a rotational movement of the beam deflection device 18. An angle of attack can be arbitrary. However, it is advantageous to use an angle of approximately 45 ° when using two possibly opposite viewing directions of the multi-aperture imaging device 16, so that a rotational movement of 90 ° is sufficient to change the viewing direction. On the other hand, with just one viewing direction, a further degree of freedom can be selected.

By alternately turning different beam deflection areas, the total field of view of the respective line of sight can be captured with wavelength ranges that are different from one another, in that the multi-aperture imaging device is designed to capture a first image of the entire field of view using the first beam deflection region with the image sensor, so that the first image is based on the first wavelength range; and to capture a second image of the entire field of view using the second beam deflection region with the image sensor, so that the second image is based on the second wavelength region. For example, a wavelength range that is not visible to the human eye can be used to obtain additional image information, such as depth maps.

The portable device 10 may include a first bezel 24a and a second bezel 24b. The diaphragm 24a is arranged in a region of the transparent region 14a and is designed to optically at least partially close the transparent region 14a in a closed state of the diaphragm 24a. According to one exemplary embodiment, the diaphragm 24a is designed to completely or at least 50%, 90% or at least 99% of the surface of the transparent region 14a be closed off the transparent region 14a in the closed state. The diaphragm 24b is designed to close the transparent area 14b in the same or similar manner as described for the diaphragm 24a in connection with the transparent area 14a. By doing In the first operating state, in which the beam deflection device 18 deflects the beam path 22 to the beam path 22a, the diaphragm 24b can at least partially optically close the transparent area 14b, so that the transparent area 14b causes false light to a small extent or possibly not into the interior of the housing 12 occurs. This enables a slight influence on the recording of the visual field in the first operating state by the false light entering through the aperture 14b. In the second operating state, in which, for example, the beam path 22b emerges from the housing 12, the diaphragm 24a can at least partially optically close the transparent region 14a. In simple terms, the diaphragms 24a and / or 24b can be designed such that they close transparent areas 14a and 14b in such a way that this false light occurs from unwanted directions (in which, for example, the detected visual field is not arranged) to a small extent or does not occur. The diaphragms 24a and 24b can be formed continuously and can be arranged with respect to all optical channels of the imaging device 16. This means that the diaphragms 24a and 24b can be used by all optical channels of the multi-aperture imaging device based on the respective operating state. According to one embodiment, no individual round diaphragms are arranged for each optical channel, but instead an aperture 24a or 24b is used, which is used by all optical channels. The diaphragms 24a and / or 24b can be shaped following a polygon, for example rectangular, oval, round or elliptical.

Switching between the first and the second operating state can comprise, for example, a movement of the beam deflection device 18 based on a translatory movement 26 and / or based on a rotary movement 28.

The diaphragms 24a and / or 24b can be designed, for example, as a mechanical diaphragm. Alternatively, the diaphragms 24a and / or 24b can be designed as an electrochromic diaphragm. This enables a small number of mechanically moving parts. Furthermore, an embodiment of the diaphragms 24a and / or 24b as an electrochromic diaphragm enables the transparent areas 14a and / or 14b to be opened and / or closed silently, as well as a good embodiment that can be integrated into the optics of the portable device 10. For example, the diaphragms 24a and / or 24b can be designed such that they are hardly or not perceived by a user in a closed state, since there are few visual differences from the housing 12. The housing 12 can be formed flat. For example, the main sides 13a and / o ^¬ the 13b may be arranged in parallel, in the space in an x / y-plane, or a plane. Secondary sides or secondary surfaces 15a and / or 15b between the main sides 13a and 13b can be arranged obliquely or perpendicularly in space, the main sides 13a and / or 13b and / or the secondary sides 15a and / or 15b can be curved or flat. An expansion of the housing 12 along a first housing direction z between the main sides 13a and 13b, for example parallel or antiparallel to a surface normal of a display of the portable device 10, may be slight if it is combined with further dimensions of the housing 12 along further dimensions, ie along a Direction of extension of the main side 13a and / or 13b is compared. The minor sides 15a and 15b can be parallel or anti-parallel to the surface normal of a display. The main sides 13a and / or 13b can be arranged perpendicular to a surface normal of a display of the portable device 10 in space. For example, an extension of the housing along the x direction and / or the y direction can have at least three times, at least five times or at least seven times an extension of the housing 12 along the first extension z. The expansion of the housing z can be understood in a simplifying manner, but without restricting effect, as the thickness or depth of the housing 12.

2 shows a schematic view of a main side of a portable device 20 according to an embodiment. The portable device may include device 10. The portable device 20 may include a display 33, such as a screen or display. For example, the device 20 can be a portable communication device, such as a mobile phone (smartphone), a tablet computer, a mobile music player, a monitor or screen device, which has the imaging device 16. The transparent region 14a and / or the transparent region 14b can be arranged in a region of the housing 12 in which the display 33 is arranged. This means that the diaphragm 24a and / or 24b can be arranged in a region of the display 33. For example, the transparent area 14a and / or 14b and / or the panel 24a or 24b can be covered by the display 33. In an area of the display 33 in which the diaphragm 24a and / or 24b is arranged, information from the display can be displayed at least temporarily. The presentation of the information can be any operation of the portable device 20. For example, a viewfinder function can be represented on the display 33, in which a field of view can be represented which is generated by the imaging device inside the Housing 12 is scanned or detected. As an alternative or in addition, images that have already been captured or any other information can be ^displayed . In simple words, the transparent area 14a and / or the aperture 24a may be hidden from the display 33 so that the transparent portion 14a and / or the aperture 24a during a Be ^¬ drive 20 of the portable device hardly or not perceptible.

The transparent regions 14a and 14b can each be arranged in at least one main side 13a of the housing 12 and / or in an opposite main side. In simple words, the housing 12 can have a transparent area at the front and a transparent area at the rear. In this regard, it should be noted that the terms front and back can be arbitrarily replaced by other terms, such as left and right, top and bottom or the like, without restricting the exemplary embodiments described here. According to further exemplary embodiments, the transparent regions 14a and / or 14b can be arranged on a secondary side. The transparent areas can be arranged as desired and / or depending on the directions in which the beam paths of the optical channels can be deflected.

In the area of the transparent area 14a or the aperture 24a, the display 33 can be designed, for example, to be temporarily deactivated during the acquisition of an image with the imaging device or to increase the transparency of the display 33 out of the housing 12. Alternatively, the display 33 can also remain active in this area, for example if the display 33 emits no or hardly any electromagnetic radiation in a relevant wavelength range into the interior of the portable device 20 or the housing 12 or towards the imaging device 16.

3a shows the beam deflection device 18 and a state of the multi-aperture imaging device, which is associated, for example, with an operating state of the first aperture 24a and the second aperture 24b. The beam deflection device 18, for example, deflects the beam path 22 with a beam deflection region 18A, which is only shown in FIG. 3b, in such a way that it runs as a beam path 22a through the transparent region 14a. The aperture 24b can at least partially close the transparent region 14b at times, so that false light penetrates to a small or no extent into the interior of the housing of the portable device through the transparent region 14b.

3b shows the beam deflecting device 18, the aperture 24a and the aperture 24b in a second operating state, the beam deflecting device 18 being executed, for example the rotary movement 28 has a different viewing direction by 90 °. However, the beam deflecting device directs now the beam path with a Strahiumlenkbereich 18B to which is effective for the second wavelength range, so that detection of a can in view ^¬ direction of the beam path 22b arranged overall field of view at the second wavelength range effected.

With a rotation of the beam deflection device by a further 90 ° and thus 180 ° compared to the original state, the first viewing direction shown in FIG. 3a would be taken up again, but under the influence of the beam deflection area 18B. Although it is also possible to acquire only one overall field of view, for example by only providing the line of sight 22a or 22b at any angle, a larger number of overall fields of view, for example 2, 3 or more, can thus also be acquired.

The beam deflection device 18 can deflect the beam path 22 such that it runs as a beam path 22b through the transparent area 14b, while the diaphragm 24a optically at least partially closes the transparent areas 14a. In the second operating state, the diaphragm 24b can have an at least partially or completely open state. The open state can refer to a transparency of the panel. E.g. For example, an electrochromic diaphragm can be called open or closed, depending on a control state, without moving mechanical components. A diaphragm 24b designed as an electrochromic diaphragm can be partially or completely transparent at least temporarily during the second operating state for a wavelength range to be detected by the imaging device. In the first operating state, as shown in FIG. 3a, the aperture 24b can be partially or completely non-transparent or opaque for this wavelength range. Switching between the first operating state according to FIG. 3a and the second operating state according to FIG. 3b can be based on the rotational movement 28 of the deflection device 18 and / or based on a translatory movement, as described in connection with FIGS. 4a and 4b, and are preserved or include at least one of these movements.

4a shows a schematic view of the beam deflecting device 18, which comprises a plurality of beam deflecting elements 32a-h. For example, the imaging device can comprise a plurality or a plurality of optical channels, for example two, four or a greater number. For example, the imaging device has four optical channels on that beam deflecting device 18, a number of ray deflection 32a-h ge ^¬ Mäss a number of optical channels multiplied by a number of operating states between which the beam deflecting device 18 or the portable device is switchable environmentally include. For example, the ray deflection 32a and 32e ei ^¬ nem first optical channel can be assigned, wherein the beam deflector 32a the beam path of the first optical channel in the first operating state and the beam deflection element 32e the beam path of the first optical channel in the first operating state deflects. In the same way, the beam deflecting elements 32b and 32f, 32c and 32g or 32d and 32h can be assigned to further optical channels.

The beam deflection device can be translationally movable along the translatory movement direction 26 and / or can be moved back and forth between a first position and a second position of the beam deflection device 18 with respect to the optical channels of the imaging device in order to switch between the first operating state and the second operating state. A distance 34 over which the beam deflection device 18 is moved between the first position and the second position can correspond to at least a distance between four optical channels of the imaging device. The beam deflection device 18 can have a block-wise sorting of the beam deflection elements 32a-h. E.g. The beam deflection elements 32a-d can be designed to deflect the beam paths of the imaging device in a first viewing direction towards a first field of view, wherein each optical channel can be assigned to a partial field of view of the overall field of view. The beam deflecting elements 32e-h can be designed to deflect the beam paths of the imaging device in a second viewing direction towards a second field of view, wherein each optical channel can be assigned to a partial field of view of the overall field of view. According to further exemplary embodiments, it is possible for beam paths of at least two optical channels to be deflected by a beam deflecting element, so that a number of beam deflecting elements of the beam deflecting device 18 can be smaller.

The beam deflecting elements 32a-h can be, for example, regions of the beam deflecting device 18 which are curved differently from one another or flat facets of a facet mirror. For example, the beam deflecting device 18 can be understood as an array of facets and / or deflecting elements 32a-h which are inclined at different angles to one another, so that beam paths of optical channels striking the beam deflecting device 18 into partial fields of view of the field of view of the first th operating state and beam paths striking deflecting elements 32e-h and deflected by them into different partial fields of view of a field of view of the second operating state.

FIG. 4b shows a schematic view of the beam deflection device 18 according to a configuration that is different from the configuration according to FIG. 4a. 4a can be understood as a block-wise sorting of the beam deflection elements 32a-h based on an operating state, the configuration according to FIG. 4b can be understood as a channel-wise sorting of the beam deflection elements 32a-h based on a sequence of the optical channels of the imaging device . The beam deflection elements 32a and 32e assigned to the first optical channel can be arranged adjacent to one another. Analogously, the beam deflection elements 32b and 32f, 32c and 32g or 32d and 32h, which can be assigned to the optical channels 2, 3 or 4, can be arranged adjacent to one another. For example, if the optical channels of the imaging device are at a sufficiently large distance from one another, a distance 34 ′ over which the beam deflection device 18 is moved in order to be moved back and forth between the first position and the second position may be less than the distance 34, for example a quarter or a half thereof. This enables an additionally reduced design of the imaging device and / or the portable device.

The beam deflection elements can also provide different types of beam deflection areas, so that a pure assignment to optical channels is provided, so that a first optical channel is deflected, for example, by deflection either with the beam deflection element 32a in the first wavelength range or by deflection with the beam deflection element 32e in the second wavelength range.

The rotational movement can be combined with the translatory movement. It is conceivable, for example, that a translatory movement switches between the wavelength ranges, i. that is, the different beam deflecting elements 32a-h are arranged on a common side of the beam deflecting device 18, a design that is reflective on both sides making it possible to switch the viewing direction or vice versa.

4c-h, advantageous configurations of the beam deflection device 18 are described. The designs show a number of advantages, individually or in any combination with each other are executable, but should not have a restrictive effect.

FIG. 4c shows a schematic side sectional view of a beam deflecting element 32, as can be used for a beam deflecting device described here, such as the beam deflecting device 18 of FIGS. 4a or 4b. The beam deflecting element 32 can have a polygonal cross-section. Although a triangular cross section is shown, it can also be any other polygon. As an alternative or in addition, the cross section can also have at least one curved surface, it being possible, in particular in the case of reflecting surfaces, for an embodiment which is at least sectionally flat to avoid imaging errors. Beam deflection regions with different effective wavelengths can be arranged on different and opposite main sides 35a and 35b.

The beam deflecting element 32 has, for example, a first side 35a, a second side 35b and a third side 35c. At least two sides, for example sides 35a and 35b, are reflective, so that the beam deflecting element 32 is reflective on both sides. The sides 35a and 35b can be main sides of the beam deflecting element 32, that is to say sides whose area is larger than the side 35c.

In other words, the beam deflecting element 32 can be wedge-shaped and reflective on both sides. A further surface can be arranged opposite the surface 35c, that is to say between the surfaces 35a and 35b, but this is considerably smaller than the surface 35c. In other words, in such a case the wedge formed by the surfaces 35a, 35b and 35c does not run to an arbitrary point, but is provided with a surface on the pointed side and is therefore truncated.

4d shows a schematic side sectional view of the beam deflecting element 32, in which a suspension or a displacement axis 37 of the beam deflecting element 32 is described. The displacement axis 37, about which the beam deflection element 32 can be moved in the beam deflection device 18 in a rotational and / or translatory manner, can be displaced eccentrically with respect to a centroid 43 of the cross section. The center of area can alternatively also be a point which describes the half-dimension of the beam deflecting element 32 along a thickness direction 45 and along a direction 47 perpendicular thereto. The displacement axis can, for example, remain unchanged along a thickness direction 45 and have any offset in a direction perpendicular to it. Alternatively, an offset along the thickness direction 45 is also conceivable. The displacement can, for example, take place in such a way that when the beam deflecting element 32 rotates about the displacement axis 37, a higher adjustment path is obtained than when rotating about the surface center of gravity 43. Thus, the displacement by which the displacement axis 37 can move The edge between the sides 35a and 35b moved during a rotation is increased at the same rotation angle compared to a rotation around the center of gravity 43. The beam deflecting element 32 is preferably arranged such that the edge, that is to say the pointed side of the wedge-shaped cross section, faces the image sensor between the sides 35a and 35b. A small other side 35a or 35b can thus deflect the beam path of the optical channels by slight rotational movements. It is clear here that the rotation can be carried out in such a way that a space requirement of the beam deflection device along the thickness direction 45 is small, since a movement of the beam deflection element 32 such that a main side is perpendicular to the image sensor is not necessary.

The side 35c can also be referred to as the secondary side or the rear side. A plurality of beam deflection elements can be connected to one another in such a way that a connecting element is arranged on the side 35c, or runs through the cross section of the beam deflection elements, that is to say is arranged in the interior of the beam deflection elements, for example in the region of the displacement axis 37. In particular, the retaining element can do so be arranged so that it is not or only to a small extent, i.e. i.e., a maximum of 50%, a maximum of 30% or a maximum of 10% protrudes beyond the beam deflecting element 32 along the direction 45, so that the holding element does not increase or determine the extent of the overall structure along the direction 45. The extension in the thickness direction 45 can alternatively be determined by the lenses of the optical channels, i. H. these have the dimension defining the minimum of the thickness.

The beam deflecting element 32 can be formed from glass, ceramic, glass ceramic, plastic, metal or a combination of these materials and / or other materials.

In other words, the beam deflecting element 32 can be arranged such that the tip, ie the edge between the main sides 35a and 35b, faces the image sensor. The beam deflecting elements can be held in such a way that they only take place on the back or inside the beam deflecting elements, ie the main sides are not covered. A common holding or connecting element can extend over the rear side 35c. The axis of rotation of the trap arm 32 can be arranged eccentrically.

4e shows a schematic perspective view of a multi-aperture imaging device 40 which comprises an image sensor 36 and a single-line array 38 of optical channels 42a-d arranged next to one another. The beam deflection device 18 comprises a number of beam deflection elements 32a-d, which can correspond to the number of optical channels. Alternatively, a smaller number of beam deflecting elements can be arranged, for example if at least one beam deflecting element is used by two optical channels. Alternatively, a higher number can also be arranged, for example if the deflection direction of the beam deflection device 18 is switched by a translational movement, as is described in connection with FIGS. 4a and 4b. Each beam deflection element 32a-d can be assigned to an optical channel 42a-d. The beam steering elements 32a-d can be formed as a plurality of elements 32 according to FIGS. 4c and 4d. Alternatively, at least two, several or all of the beam deflecting elements 32a-d can be formed in one piece with one another.

4f shows a schematic side sectional view of the beam deflecting element 32, the cross section of which is formed as a free-form surface. Thus, the side 35c can have a cutout 49 which enables a holding element to be fastened, the cutout 49 also being able to be formed as a projecting element, for example as a tongue of a tongue and groove system. The cross section also has a fourth side 35d, which has a smaller surface area than the main sides 35a and 35b and connects the same to one another.

4g shows a schematic side sectional view of a first beam deflecting element 32a and a second beam deflecting element 32b lying behind in the direction of illustration. The cutouts 49a and 49b can be arranged such that they are essentially congruent, so that an arrangement of a connecting element in the cutouts is made possible.

4h shows a schematic perspective view of the beam deflecting device 18, which comprises, for example, four beam deflecting elements 32a-d which are connected to a connecting element 51. The connecting element can be usable in order to be translationally and / or rotationally movable by an actuator. The connecting element 51 can be formed in one piece and over an extension direction, for example the y direction in FIG. 4e, run on or in the Strahiumlenketementen 32a-d. Alternatively, the connecting element 51 can also be connected only to at least one side of the beam deflection device 18, for example if the beam deflection elements 32a-d are formed in one piece. Alternatively, a connection to an actuator and / or a connection of the beam deflecting elements 32a-d can also be made in any other way, for example by means of gluing, wringing or soldering.

5a shows a schematic perspective view of the imaging device 16. The imaging device 16 comprises the beam deflection device 18, an image sensor 36 and a single-line array 38 of optical channels 42a-cf arranged next to one another. Each optical channel 42a-d can have optics that are designed to optically influence beam paths 22-1 to 22-4 of the imaging device 16. The optics can be channel-specific or have common components for groups of two or more optical channels.

The image sensor 36 can comprise image sensor areas 44a-d, wherein the beam paths 22-1 to 22-4 of the optical channels 22a-d can each strike an image sensor area 44a-d. In simple terms, an optical channel 22a-d and / or a beam path 22-1 to 22-4 can be assigned to each image sensor area 44a-d. The beam deflection device 18 can be designed to deflect the beam paths 22-1 to 22-4 in different directions and / or deflect different wavelengths, for example, based on different operating states of the portable device and / or on different positions of the beam deflection device 18 in connection with FIGS. 1, 2, 3a, 3b, 4a-h. This means that the imaging device 16 can be formed as a multi-aperture imaging device 40 or can comprise this.

The image sensor areas 44a-d can, for example, each be formed from a chip that comprises a corresponding pixel array, wherein the image sensor areas can be mounted on a common substrate or a common circuit board. Alternatively, it would of course also be possible for the image sensor regions 44a-d to be formed in each case from a part of a common pixel array which extends continuously over the image sensor regions 44a-d, the common pixel array being formed, for example, on a single chip. For example, only the pixel values of the common pixel array in the image sensor areas 44a-d are then read out. Different mixtures of these alternatives are of course also possible, such as the presence of one Chips for two or more channels and a further chip for still other channels or the like. In the case of a plurality of chips of the image sensor 36, these can be mounted, for example, on one or more boards, such as, for example, all together or in groups or the like.

The single-line array 38 can have a carrier 39, on which optics 41a-d of the optical channels are arranged. The carrier 39 can be passed by the optical beam paths 22-1 to 22-4 used for the imaging in the individual optical channels. The optical channels of the multi-aperture imaging device can traverse the carrier 39 between the black-light deflection device 18 and an image sensor 36. The carrier 39 can keep a relative position between the optics 41 a-d stable. The carrier 39 can be made transparent and comprise, for example, a glass material and / or a polymer material. The optics 41a-d can be arranged on at least one surface of the carrier 39. This enables a small dimension of the carrier 39 and therefore of the one-line array 38 along a direction parallel to the image sensor 36 and perpendicular to the line extension direction 56, since the optics 41a-d can be dispensed with in a peripheral region thereof. According to exemplary embodiments, the carrier 39 is not or only insignificant along the direction parallel to a main side of the field sensor 36 and perpendicular to the line stretching direction 56, i. i.e., at most 20%, at most 10% or at most 5%, larger than a corresponding dimension of the optics 41a-d.

The beam deflection device can be designed in such a way that in the first position and in the second stiffening it deflects the beam path 22-1 to 22-4 of each optical channel 42a-d in a different direction from one another. This means that the deflected beam paths 22-1 to 22-4 can have an angle to one another, as is described in connection with FIG. 6a. The optical channels 16a-d can be arranged in at least one row along a row extension direction 56. The array 38 can be formed as a multi-line array comprising at least two lines or as a single-line array comprising (exactly) one line of optical channels. The optical channels can be directed by the beam deflecting device 18 to variable visual fields based on a set viewing direction. The optical channels can be at an angle to one another within a viewing direction, so that the optical channels are directed into the highest partially overlapping partial visual fields of the overall visual field become. The different angles of the optical channels can be obtained based on the optics of the optical channels and / or based on a different deflection of the optical channels on the beam deflection device 18.

The imaging device 16 can comprise an actuator 48a, which is, for example, part of an optical image stabilizer 46a and / or can be used to change the position or position of the beam deflection device 18. The optical image stabilizer 46 can be designed to enable optical image stabilization of an image captured by the image sensor 36. For this purpose, the actuator 48a can be designed to generate a rotational movement 52 of the beam deflection device 18. The rotational movement 52 can take place about an axis of rotation 54, the axis of rotation 54 of the beam deflecting device 18 being able to be arranged in a central region of the beam deflecting device 18 or apart therefrom. The rotational movement 52 can be superimposed on the rotational movement 28 or the translatory movement 26 for switching the beam deflection device between a first and a second position or operating state. If the beam deflection device 18 is translationally movable, the translatory movement 26 can be arranged in space parallel to a line extension direction 56 of the one-line array 38. The line extension direction 56 can refer to a direction along which the optical channels 42a-d are arranged next to one another. Based on the rotational movement 52, an optical image stabilization can be obtained along a first image axis 58, possibly perpendicular to the line extension direction 56.

As an alternative or in addition, the optical image stabilizer 46 can comprise an actuator 48b, which is designed to translate the single-line array 38 along the line extension direction 56. Based on the translational movement of the one-line array 38 along the line extension direction 56, an optical image stabilization along a second image axis 62 can be obtained, possibly parallel to the line extension direction 56 or parallel to the direction of movement of the one-line array 38. The actuators 48a and 48b can be formed, for example, as a piezoelectric actuator, pneumatic actuator, hydraulic actuator, direct current motor, stepper motor, thermal actuator, electrostatic actuator, electrostrictive actuator and / or magnetostrictive actuator. The actuators 48a and 48b can be formed identically or differently from one another. As an alternative, an actuator can also be arranged, which is designed to move the beam deflection device 18 in a rotary manner and the single-line array 38 in a translatory manner. For example, the axis of rotation 54 can be parallel to the line extension direction 56. The rotational movement 52 about the axis of rotation 54 can lead to a small installation space requirement of the imaging device 16 along a direction parallel to the image axis 58, so that the portable device, which comprises the imaging device 16 inside a housing, can also have a small dimension. In simple terms, the portable device can have a flat housing.

The translatory movement 26 can, for example, be carried out parallel or substantially parallel to an extension of a main side 13a and / or 13b of the device 10, so that an additional installation space that may be required for switching the beam deflection device between operating states can be carried out along the line extension direction 56 can be arranged and / or there is no need to provide installation space along a thickness direction of the device. The actuators 48a and / or 48b can be arranged along the line extension direction and / or perpendicularly thereto, parallel to an extension direction from main sides of the housing of the device. In simple terms, this can be described in such a way that actuators for shadowing between operating states and / or actuators of the optical image stabilizer can be arranged next to, in front of and behind an extension between the image sensor, the one-line array 38 and the beam deflecting device 18, with an arrangement above and / or below is omitted in order to keep the overall height of the imaging device 16 low. This means that actuators for switching the operating state and / or the optical image stabilizer can be arranged in a plane in which the image sensor 36, the single-line array 38 and the beam deflection device 18 are arranged.

According to further exemplary embodiments, the actuator 48b and / or other actuators can be designed to change a distance between the image sensor 36 and the single-line array 38 or the optics of the optical channels. For this purpose, the actuator 48b can be designed, for example, to move the single-line array 38 and / or the image sensor 36 relative to one another along a beam path of the beam paths 22-1 to 22-4 or perpendicular to the line extension direction 56 in order to focus the image of the To change the field of view and / or to obtain an auto focus function.

The imaging device 16 can have a focus device that is designed to change the focus of the imaging device. The focus device can be designed to provide a relative movement between the single-row array 38 and the image sensor 36. The focus device can be designed to perform the relative movement by executing a movement of the movement which is simultaneous to the relative movement Execute beam deflector 18. E.g. For example, the actuator 48b or another actuator can be designed to keep a distance between the single-line array 38 and the beam deflection device 18 at least essentially constant or, if no additional actuator is used, at least essentially, if necessary, exactly constant, that is, the beam deflection device 18 to move to an extent such as the single-line array 38. In cameras that do not have a beam deflection device, an implementation of a focus function can lead to an increased dimension (thickness) of the device.

Based on the beam deflection device, this can take place without an additional dimension along a dimension parallel to a main side of the image sensor 36 and perpendicular to the line extension direction 56 (for example a thickness) of the multi-aperture imaging device, since an installation space that enables the movement can be arranged perpendicularly to it. Based on a constant distance between the one-line array 38 and the beam deflection device 18, a beam deflection can be maintained in a set (possibly optimal) state. In simple terms, the imaging device 16 can have a focus device for changing a focus. The focus device can be designed to provide a relative movement (focusing movement) between at least one optics 41a-d of the optical channels of the multi-aperture imaging device 16 and the image sensor 36. The focus device can have an actuator for providing the relative movement, for example the actuator 48b and / or 48a. The beam deflection device 18 can be moved simultaneously with the focusing movement by appropriate design or use, possibly using a further actuator. This means that a distance between the single-line array 38 and the beam deflecting device remains unchanged and / or that the beam deflecting device 18 is moved simultaneously or with a time delay to the same or comparable extent as the focusing movement, so that at least at one point in time the field of view is captured by the Multi-aperture imaging device is unchanged compared to a distance before a change in focus.

The imaging device 16 comprises a control device 53, which is designed to receive image information from the image sensor 36. For this purpose, an image of the total field of view is evaluated, which is evaluated by deflecting the beam paths 22-1 to 22- 4 of the optical channels 42a to 42d with the first beam deflection area, and a corresponding, ie, corresponding image is evaluated, which is obtained by deflecting the beam paths 22- 1 to 22-4 of the optical channels 42a to 42d with the second beam deflection area is obtained, the order of the first and second imaging being arbitrary.

The control device 53 can generate two overall images of the acquired total field of view, for example using methods for stitching, wherein a first overall image is based on the first wavelength range and a second overall image is based on the second wavelength range.

The control device can be designed to determine a depth map for the first exposure using the second exposure, for example based on a wavelength range that is not visible to humans, such as an infrared range, in particular a near infrared range (NIR). For this purpose, the control device can be designed, for example, to evaluate a pattern visible in the second wavelength range. For example, a predefined pattern, for example a dot pattern in the NIR wavelength range in the direction of the overall field of view, can be emitted and a distortion of the pattern can be evaluated in the second image or image. The distortion can be correlated with depth information. The control device 53 can be designed to provide the depth map by evaluating the depth information. As an alternative or in addition to the spatial information of a pattern, temporal information can also be evaluated, for example with knowledge of a temporal variance of the pattern.

The lighting source can be designed to emit the temporal and / or spatial lighting pattern with a third wavelength range that completely or partially encompasses the second wavelength range, so that the third wavelength range at least partially corresponds to the second wavelength range. This includes that a partial reflection of the wavelengths of the emitted pattern represents a sufficient source for the second wavelength range arriving at the image sensor and also includes wavelength shifts or partial reflections, for example based on absorptions. The second wavelength range and the third wavelength range may also be congruent.

As described in connection with FIG. 1, the deflected beam paths of the optical channels can run through a transparent area of a housing of the device, wherein an aperture can be arranged in the transparent area. In at least one operating state of the device, one in a region of the trans- Parent area arranged visually at least partially close this so that the ßiende is effective for two, a plurality or all optical channels, ie, has the at least partially closed state. In another operating state, the diaphragm can have an open state for the two, the plurality or all of the optical channels. This means that the diaphragms can be effective for at least two optical channels of the multi-aperture imaging device. In the first operating state, the diaphragm 24b can optically at least partially close the transparent region 14b for the two, the plurality or all optical channels. In the second operating state, the aperture 24a can optically at least partially close the transparent region 14a for the two, the plurality or all optical channels.

5b shows a schematic perspective view of the multi-aperture imaging device 16 according to an exemplary embodiment, in which the array 38 has, for example, two optical channels which comprise optics 41a-b, any higher number being possible, for example three, four, five or more . One of the optical channels 41a and 41b is designed to capture a partial field of view 64a or 64b of a total field of view 60. The partial fields of view 64a and 64b overlap with one another and together form the overall facial field 60.

The multi-aperture imaging device 16 comprises an illumination device 55, which is designed to emit a temporal or spatial illumination pattern 55a, in particular in the direction of the overall field of view 60. The illumination pattern 55a can comprise a third wavelength range, which at least partially overlaps or corresponds to the second wavelength range that a deflection of the beam paths using the second beam deflection region hits the pattern distorted in the overall field of view on the image sensor and can be evaluated by the control device 53.

FIG. 5 c shows a schematic side sectional view of a modified imaging device 16 ′, in which the beam deflection device 18 can be moved between a first position Pos1 of the first operating state and a second position Pos2 of the second operating state based on a rotational movement 52 ′ about the axis of rotation 54. In the first operating state, the imaging device 16 'can have a first viewing direction 57a. In the second operating state, the imaging device 16 ′ can have a first viewing direction 57b. Main pages 59a and 59b of the beam deflection device 18 can be formed reflectively as a mirror and / or as facet elements. During a switchover between the operating states, the beam deflection device 18 can be switchable between a center position 61, so that a distance between parallel planes 63a and 63b, which can describe a minimum dimension of the imaging device 16 'along a normal direction of the planes 63a and 63b, can be described by the dimensions of the Image sensor 36, the array 38 is not influenced by a movement of the beam deflection device 18. The rotational movement 52 can be superimposed on the rotational movement 28. Put simply, a superimposition of switching and optical image stabilization can be implemented.

Actuators of the multi-aperture imaging device can be arranged such that it is at least partially arranged between two planes 63a and 63b, which are spanned by the sides of a cuboid. The sides of the cuboid can be aligned parallel to one another and parallel to the line extension direction of the array and part of the beam path of the optical channels between the image sensor and the beam deflection device. The volume of the cuboid is minimal and nevertheless includes the image sensor, the array and the beam deflection device and their operational movements.

A thickness direction of the multi-aperture imaging device can be arranged normal to the planes 63a and / or 63b. The actuators can have a dimension or extension parallel to the thickness direction. A portion of at most 50%, at most 30% or at most 10% of the dimension can protrude from an area between levels 63a and 63b beyond level 63a and / or 63b or protrude from the area. The actuators thus protrude, for example, at most insignificantly level 63a and / or 63b. According to exemplary embodiments, the actuators do not protrude beyond levels 63a and / or 63b. The advantage of this is that an expansion of the multi-aperture imaging device along the thickness direction is not increased by the actuators.

A volume of the multi-aperture imaging device can have a small or minimal installation space between the planes 63a and 63b. Along the lateral sides or directions of extent of the planes 63a and / or 63b, an installation space of the multi-aperture imaging device can be large or arbitrarily large. The volume of the virtual cuboid is influenced, for example, by an arrangement of the image sensor 36, the array 38 and the beam deflecting device, the arrangement of these components being described in accordance with the The exemplary embodiments can be such that the installation space of these components along the direction perpendicular to the planes and therefore the distance between the planes 63a and 63b to one another is small or minimal. Compared to other arrangements of the components, the volume and / or the distance between other sides of the virtual cuboid can be increased.

FIG. 6a shows a schematic view of an overall field of view 60, which comprises four overlapping partial fields of view 64a-d. The partial fields of view 64a-d are arranged, for example, along two directions H and V in the object area, which for example, but not restrictively, can denote a horizontal direction and a vertical direction. Any other directional arrangement is possible. 5a, for example, the beam path 22-1 towards the partial field of view 64a, the beam path 22-2 towards the partial field of view 64b, the beam path 22-3 towards the partial field of view 64c and / or the beam path 22-4 towards the Field of view 64d can be directed. Although an assignment between beam paths 22-1 to 22-4 to the partial visual fields 64a-d is arbitrary, it becomes clear that starting from the beam deflection device 18, the beam paths 22-1 to 22-4 are directed in different directions from one another. Although the total field of view 60 is detected in the exemplary embodiment described by means of four optical channels which detect the partial field of view 64a-d, the total field of view 60 can also be captured by any other number of partial field of view greater than 1, i.e. at least 2, at least 3, at least five, at least seven or more.

FIG. 6b shows a division of the total field of view 60, which is also possible and has been changed from FIG. 6a and is captured, for example, by only two partial fields of view 64a and 64b. The partial facial fields 64a and 64b can, for example, be arranged along the direction V or, as shown in FIG. 6c, along the direction H and overlap with one another in order to enable effective image merging. The partial fields of view are only shown with different sizes for better differentiation, even if this can mean a corresponding optional implementation.

An assignment of the partial visual fields 64a and 64b to the optical channels and a relative alignment of the array 14 can in principle be arbitrary. A direction along which the partial visual fields are arranged, for example V in FIG. 6b or H in FIG. 6c, can be arranged as desired in relation to the line extension direction 56 of the array 14. An arrangement such that the line extension direction 56 and the direction along which the partial fields of view are arranged are advantageous at least within a tolerance range of ± 25 °, ± 15 ° or ± 5 ° are arranged perpendicular to each other, preferably perpendicular to each other. 6b, the line extension direction 56 is arranged parallel to the direction H arranged perpendicular to V, for example. 6c, the line extension direction 56 is also rotated in accordance with the arrangement of the partial visual fields 64a and 64b rotated with respect to FIG. 6b, so that the line extension direction 56 is parallel to V or within the specified tolerance range perpendicular to H. The optical channels 42a c and the image sensor areas 44a-c could thus overlap in the representation plane of FIG. 6c or be congruent within the tolerance range and are shown offset from one another for the sake of illustration.

Multi-aperture imaging devices in accordance with exemplary embodiments can be designed to capture the entire field of view 60 through at least two partial fields of view 64a-b. At least one of the partial facial fields, other than single-field partial fields, such as the partial field of view 64b or the partial fields of view according to the explanations for FIG. 6a, can be captured by at least a first optical channel 42a and a second optical channel 42c. E.g. the total field of view can be segmented into exactly two partial fields of view 64a and 64b. Exactly one of the partial fields of view, for example the partial field of view 64a, can be detected by two optical channels 42a and 42c. Other partial fields of view can be captured through one channel.

For this purpose, multi-aperture imaging devices according to exemplary embodiments provide for the use of exactly two optical channels in order to image the two partial visual fields 64a and 64b in the respective wavelength range or in both wavelength ranges. There is the possibility that in the overlap region with such a configuration there are occlusions or occlusion effects, which means that instead of a double detection of a visual field arranged behind an object, only one viewing angle is detected. To reduce or avoid such effects, some exemplary embodiments provide for capturing at least one of the partial facial fields 64a and / or 64b with a further optical channel 42a-c, so that at least this channel 42a-c is captured several times, in particular twice. A different number of partial fields of view recorded twice and / or a different number of partial fields of view and / or a different number of optical channels is also possible.

As shown in FIGS. 6b and 6c, optical channels 42a and 42c and / or image sensor areas 44a and 44c can be used for multiple detection of a partial facial field. des 64 be arranged symmetrically around an optical channel 42b for detecting the other partial field of view, be spaced apart from one another in the array 14 by at least one optical channel 42b directed at another partial field of view and / or have an enlarged or maximum distance from one another within the array, to allow some degree of disparity.

7a shows a schematic perspective view of a device 70i, which comprises a first multi-aperture imaging device 16a and a second multi-aperture imaging device 16b, and is designed to stereoscopically capture the entire field of view 60 with the multi-aperture imaging devices. The overall field of view 60 is arranged, for example, on a main side 13b facing away from the main side 13a. For example, the multi-aperture imaging devices 16a and 16b can capture the entire field of view 60 through transparent areas 14a and 14c, respectively, with diaphragms 24a and 24c arranged in the main side 13b being at least partially transparent. Apertures 24b and 24d arranged in the main side 13a can at least partially optically close transparent areas 14b and 14d, respectively, so that an amount of false light from a side facing the main side 13a, which can falsify the images of the multi-aperture imaging devices 16a and / or 16b, is at least reduced is. Although the multi-aperture imaging devices 16a and 16b are shown spaced apart from one another, the multi-aperture imaging devices 16a and 16b can also be spatially adjacent or combined. E.g. The single-line arrays of the imaging devices 16a and 16b can be arranged side by side or parallel to one another. The single-line arrays can form lines to one another, with each multi-aperture imaging device 16a and 16b having a single-line array. The imaging devices 16a and 16b can have a common beam deflection device and / or a common carrier 39 and / or a common image sensor 36.

The transparent areas 14a-d can additionally be equipped with a switchable diaphragm 24a-d, which covers the optical structure in the case of non-use. The aperture 24a-d can comprise a mechanically moving part. The movement of the mechanically moved part can take place using an actuator, as described for example for the actuators 48a and 48b. As an alternative or in addition, the diaphragm can be electrically controllable and comprise an electrochromic layer or an electrochromic layer sequence. According to an embodiment preferred in FIG. 7b, a device 702 is configured similarly to device 70i, but is designed such that the depth information instead of a stereoscopic image creates a recording from the recording in one of the wavelength ranges, for example by evaluating a pattern distortion in a non-visible one Wavelength range. According to this preferred embodiment, the device 70 is configured and configured, for example, with only a single imaging device 18 in order to record the entire field of view from a perspective, namely that of the imaging device 16, and to record no stereoscopic images of the overall field of view.

The device 70 can also be designed in accordance with the preferred embodiment in order to provide or generate a depth map of the overall field of view, for example by evaluating a pattern distortion in one of the detected wavelength ranges, for example by the control device 53 or a calculation device of the device 70 or the device set up for this purpose Imaging device 16.

The device 70 can be implemented without an additional infrared camera that complements or expands the imaging device 16, since such functionality is already implemented in the imaging device 16, possibly including the lighting device 55.

According to another preferred embodiment shown in FIG. 7c, the imaging device 16 of a device 70a is designed to have only one viewing direction compared to the devices 70i and 702, so that an arrangement of a corresponding viewing window in other directions and the anyway optional diaphragms can be dispensed with .

By evaluating the two wavelength ranges, the devices 7O2 and 7O3 can also be designed to create a depth map of the overall field of view.

FIG. 8 shows a schematic structure comprising a first multi-aperture imaging device 16a and a second multi-aperture imaging device 16b, as can be arranged, for example, in the imaging system 70i. The multi-aperture imaging devices 16a and 16b can be formed in whole or in part as a common multi-aperture imaging device. The single-line arrays 38a and 38b form a common line. The image sensors 36a and 36b can be on a common substrate or on a common circuit carrier such as a common circuit board or a common one Flexboard mounted. Alternatively, the image sensors 36a and 36b can also comprise substrates that are different from one another. Various mixtures of these alternatives are of course also possible, such as multi-aperture imaging devices comprising a common image sensor, a common array and / or a common beam deflection device 18 and further multi-aperture imaging devices which have separate components. An advantage of a common image sensor, a common single-line array and / or a common beam deflection device is that a movement of a respective component can be obtained with great precision by actuating a small amount of actuators, and synchronization between actuators can be reduced or avoided. Furthermore, high thermal stability can be obtained. Alternatively or additionally, further multi-aperture imaging devices can have a common array, a common image sensor and / or a common beam deflection device. By arranging at least one further group of imaging optical channels, any number of which can be implemented, the multi-aperture imaging device can be designed to capture the entire field of view at least stereoscope.

It was pointed out earlier that the beam paths or optical axes can be directed in different directions from the beam deflection device. This can be obtained by deflecting the beam paths during a deflection on the beam deflection device and / or by means of the optics in a manner different from parallelism. The beam paths or optical axes can deviate from parallelism before or without beam deflection. In the following, this fact is described by the fact that the channels can be provided with a kind of preliminary divergent. With this preliminary divergence of the optical axes, it would be possible, for example, that not all facet inclinations differ from facets of the beam deflection device, but that some groups of channels, for example, have the facets with the same inclination or are directed onto them. The latter can then be formed in one piece or continuously merging into one another, quasi as a facet, which is assigned to this group of channels adjacent in the direction of line extension. The divergence of the optical axes of these channels could then originate from the divergence of these optical axes, as is achieved by a lateral offset between optical centers of the optics of the optical channels and image sensor regions of the channels. The pre-divergence could be limited to one level, for example. For example, the optical axes could run in a common plane before or without beam deflection, but divergent in this plane, and the Facets only cause an additional divergence in the other transverse plane, i.e. they are all inclined parallel to the line extension direction and against each other only differently to the aforementioned common plane of the optical axes, here again several facets can have the same inclination or a group of channels together could be assigned, the optical axes of which, for example, already differ in pairs in the aforementioned common plane of the optical axes before or without beam deflection. To simplify matters, the optics can allow (pre) divergence of the beam paths along a first (image) direction and the beam deflection device can allow a divergence of the beam paths along a second (image) direction.

The aforementioned possible pre-divergence can be achieved, for example, by the optical centers of the optics lying on a straight line along the line extension direction, while the centers of the image sensor areas from the projection of the optical centers along the normal of the plane of the image sensor areas onto points on a straight line in are arranged differently from the image sensor plane, for example at points which deviate from the points on the aforementioned straight line in the image sensor plane channel-specifically along the line extension direction and / or along the direction perpendicular to both the line extension direction and the image sensor normal. Alternatively, preliminary divergence can be achieved by the centers of the image sensors lying on a straight line along the line extension direction, while the centers of the optics from the projection of the optical centers of the image sensors along the normal of the plane of the optical centers of the optics onto points on a straight line in are arranged differently at the optic center level, such as at points that are channel-specific from the points on the aforementioned straight line in the optic center level! along the line extension direction and / or along the direction perpendicular to both the line extension direction and the normal of the optics center plane. It is preferred if the aforementioned channel-specific deviation from the respective projection only extends in the direction of line extension, that is to say the optical axes are only in a common plane and are blown away with a pre-divergence. Both optical centers and image sensor area centers then lie on a straight line parallel to the line extension direction, but with different intermediate distances. In contrast, a lateral offset between lenses and image sensors in a vertical lateral direction to the line extension direction led to an increase in the overall height. A pure in-plane offset in the direction of line extension does not change the overall height, but it does possibly fewer facets and / or the facets only have a tilt in an angular orientation, which simplifies the structure. For example, neighboring optical ones can be used

Have optical axes running in the common plane, in each case cross-eyed, that is to say provided with a preliminary DSvergence. A facet can be arranged with respect to a group of optical channels, inclined only in one direction and parallel to the direction of line extension.

Furthermore, it could be provided that some optical channels are assigned to the same partial field of view, e.g. for the purpose of super resolution or to increase the resolution with which the corresponding partial field of view is scanned through these channels. The optical channels within such a group would then run parallel, for example before beam deflection, and would be deflected by a facet onto a partial field of view. Advantageously, pixel images of the image sensor of one channel of a group would lie in intermediate positions between images of the pixels of the image sensor of another channel of this group.

For example, it would also be conceivable without super-resolution purposes, but only for stereoscopic purposes, in which a group of immediately adjacent channels in the direction of line extension with their partial fields of view completely cover the entire field of view, and that a further group of channels directly adjacent to one another completely cover the overall field of view.

The above exemplary embodiments can thus be implemented in the form of a multi-aperture imaging device and / or a device comprising such a multi-aperture imaging device, with a single-line channel arrangement, each channel transmitting a partial field of view of an overall field of view and the partial fields of view partially overlapping. A setup with several such multi-aperture imaging devices for stereo trio, quattro etc. setups for 3D image recording is possible. The plurality of modules can be designed as a continuous line. The connected line could use identical actuators and a common beam deflecting element. One or more reinforcing substrates possibly present in the beam path can extend over the entire line, which can form a stereo, trio, quattro structure. Super resolution methods can be used, with several channels mapping the same partial image areas. The optical axes can also run divergent without a beam deflection device, so that fewer facets on the beam deflection device. steering unit are required. The facets then advantageously have only one angle component. The image sensor can be in one piece, have only one coherent pixel matrix or several interrupted ones. The image sensor can be composed of many partial sensors which are arranged next to one another on a printed circuit board, for example. An autofocus drive can be designed such that the beam deflecting element is moved synchronously with the optics or is stationary.

In principle, any number of sub-modules comprising image sensor (s), imaging optics (s) and mirror array (s) can be arranged. Sub-modules can also be constructed as a system. The sub-modules or systems can be installed in a housing, such as a smartphone. The systems can be arranged in one or more rows and / or rows and at any location. For example, two imaging devices 16 can be arranged in the housing 12 in order to enable stereoscopic detection of a visual field.

According to further exemplary embodiments, the device 70 comprises further multi-aperture imaging devices 16, so that the overall field of view 60 can be scanned with more than two multi-aperture imaging devices. This enables a number of partially overlapping channels which, due to their viewing directions adapted to each channel, record the entire field. For a stereoscopic or higher order detection of the total field of view, at least one further arrangement of channels according to the exemplary embodiments described here and / or the described arrangement of channels can be arranged, which can be formed as exactly one line or as separate modules. This means that the single-line array can be arranged in multiple lines with a further line, wherein the further line of optical channels can be assigned to a further multi-aperture imaging device. The optical channels of the further line can also record overlapping partial areas and together cover the entire field of view. This enables a stereo, trio, quattro, etc. structure to be obtained from array cameras, which consist of channels which partially overlap and cover the entire field of view within their sub-grouping.

In other words, multi-aperture cameras with a linear channel arrangement can comprise a plurality of optical channels which are arranged next to one another and each transmit parts of the overall field of view. According to exemplary embodiments, a mirror (beam deflection device) can advantageously be arranged in front of the imaging lenses, which mirror can be used for beam deflection and for reducing the overall height of the device In combination with a channel-by-channel mirror, such as a facet mirror, where the facets can be flat or arbitrarily curved or provided with a free-form surface, it can be advantageous to construct the imaging optics of the channels essentially identically, whereas the viewing directions of the channels can be the individual facets of the mirror array are influenced or predetermined. In combination with a flat (evenly formed) mirror, the imaging optics of the channels can be designed or shaped differently, so that there are different viewing directions. The deflecting mirror (beam deflecting device) can be rotatably mounted, the axis of rotation being perpendicular to the optical channels, ie parallel to the line extension direction of the channels. The deflecting mirror can be reflective on both sides, whereby metallic or dielectric layers or layer sequences can be arranged in order to obtain a reflectivity. Rotation or translational displacement of the mirror can be carried out in an analog or bistable or multiply stable manner. It can be understood to be stable if a force has to be applied to move along a predicted direction, wherein falling below the force can result in the beam deflecting device stopping or returning.

The analog rotation (rotation movement 52) can be used for a one-dimensional adaptation of the image position, which can be understood as optical image stabilization. For example, a movement of only a few degrees can be sufficient, for example s 15 °, ^ 10 ° or £ 1 °. The bistable or multiple stable rotation of the mirror can be used to switch the viewing direction of the camera. For example, you can switch between the viewing directions in front of, next to and behind the display. Analog and bistable / multi-stable movements or positions can be combined, ie overlaid. For example, the exemplary embodiments described here can be used to replace solutions in portable devices, such as smartphones, which use two cameras with different viewing directions forwards and backwards, by a structure which comprises only one imaging device. In contrast to known solutions, the structure can be distinguished, for example, by the fact that the viewing window in the housing for the cameras with the viewing direction to the front and to the rear is arranged in the same position, ie opposite in the upper or lower housing cover. Areas of these housing covers, which are arranged for the beam passage, can be transparent and, in the case of the use of visible light, can consist of or include glass and / or polymers. Although exemplary embodiments described above are described in such a way that the device has a first and a second operating state, further operating states can be arranged according to further exemplary embodiments for detecting further, ie at least a third, field of view.

In the following, particularly advantageous embodiments of multi-aperture imaging devices are described with reference to FIGS. 9a-d, which can be used on their own or as part of a device according to the invention, such as device 70i, 702 and / or 70a.

The side sectional views shown relate, for example, to the respective facets of a faceted beam deflection device. The beam deflection device can be formed, for example, as an array of facets. A facet can be assigned to each optical channel, wherein each facet can deflect one or more optical channels. Each of the facets can have a corresponding first beam deflection area and second beam deflection area. As shown in FIGS. 4c-4f, the facets of the array of facets can be formed as reflective mirrors on both sides. The wedge shape shown in FIGS. 4c-4f can enable a small overall height, in particular when using only one viewing direction or when combining a rotary movement with a translational movement to switch between the four positions of the beam deflection direction used for recording two viewing directions and the use of two wavelength ranges . For this purpose, the beam deflection device can be moved such that the front edge of the facet is moved slightly up and down for alternate deflection with different sides, without the surface normal of the sides 35a and 35b being parallel to a surface normal of the image sensor.

In return, a simple and / or small ßau size along the line extension direction of the array can be obtained by the beam deflection device being rotatably supported by 90 ° or more, for example approximately 180 ° or even 360 °. For example, the four positions mentioned can be obtained by a purely rotary movement, so that additional facets and / or a translatory movement can be dispensed with. This also enables a simple configuration of the facets as plane-parallel mirrors, for example as a single plane-parallel mirror with adjustment of the divergence of the beam paths by means of the optics and / or as mutually inclined or tilted plane-parallel facets which adjust the divergence in whole or in part. 9a shows a schematic side sectional view of a multi-aperture imaging device 90 according to an exemplary embodiment, in which opposite sides 18A and 1 SB are designed to deflect an optical path 22 in such a way that on the sides 18A and

18B, filtering takes place with respect to the reflected wavelength. The beam deflection device is shown in a first position, in which the side 18A faces the image sensor 36.

The beam deflection device 18A has a first beam deflection area, which is formed, for example, on the side 18A and which is effective for a first wavelength range of electromagnetic radiation passing through the optical channel, for example the visible wavelength range. The beam deflecting device has a second beam deflecting region 18B, which is, for example, for a second wavelength range, such as ultraviolet (UV) infrared (IR) or near infrared (NIR), which is different from the first wavelength range and which is effective through electromagnetic radiation passing through the optical channel.

The wavelength ranges can be disjoint, but can also partially overlap as long as they are at least partially different and thus enable different image information to be obtained.

This enables images of different wavelength ranges to be obtained by means of the image sensor 36, so that, for example, the second image can be used to create a depth map for the first image, in particular in combination with a coded (N) IR pattern which is transmitted through device 90 is transmitted.

9a shows the beam deflection device 18 in a first position. The beam steering device can be designed in order to obtain a first angle of view of the entire field of view, an angle of attack ai of the first beam fume deflection region 18A with respect to the

45 ° image sensor within a tolerance range of ± 10 ° ± 5 ° or ± 2 °. E.g. page 18A completely provides the corresponding first beam deflection area and page 18B completely provides the corresponding second beam deflection area, so that the terms are used synonymously here. However, the beam steering areas can only cover part of the side,

9b shows the beam deflecting device 18 in a second position, in which the side 18B faces the image sensor, so that the side 18B is effective, for example around NIR. Redirect light. E.g. the beam deflection can be rotated 180 ° from the ers ^¬ th position 18th The beam deflecting region 18A can be arranged on a first side of the beam deflecting device 18 and the second beam deflecting region 18B can be arranged on a second side which is arranged opposite the first side. The beam deflecting device 18 can be designed as a whole or in the individual beam deflecting elements such that the first side is arranged facing the image sensor for capturing a first image of the total field of view, and the second side is arranged facing the image sensor for capturing a second image of the total field of view. A rotary and / or translatory movement can be used to change the sides facing the image sensor.

A plane-parallel configuration of the beam deflection device or the facet thereof enables the facet or beam deflection device 18, in order to obtain a second image of the total facial field, for example using the second wavelength range, to set an angle of incidence a _{2 of} the second beam deflection area 18B with respect to the image sensor of 45 ° within a tolerance range of ± 10 ° ± 5 ° or ± 2 °. The tolerance ranges can compensate, for example, that beam deflection elements have a slightly different angle of attack of 45 °, which results from an inclination or tilting of different facets of the beam deflection device 18 relative to one another, so that the individual facets or deflection regions are obtained in an average of approximately 45 ° deviate from this due to the individual inclination.

The beam deflection regions 18A and 18B can be obtained by coatings which are configured differently from one another and which are either reflective or non-reflective in the first or second wavelength range.

Exemplary embodiments provide that a corresponding coating with one or more layers is provided on the sides of the beam deflection device 18 in order to produce the beam deflection regions 18A and 18B. These layers can have, for example, one or more dielectric layers, the layer thickness of which can be adapted to the angle of incidence of the beam deflection device.

Since, depending on the selected operating mode or the desired wavelength range just for the recording, portions of wavelength ranges, in particular of the respective other wavelength range, can strike the beam deflection device 18, some embodiments have a range for absorbing certain wavelengths, such as a volume absorber or the like. The area can be covered by the coating, so that, for example, some wavelengths are reflected first and non-reflected, for example transmitted, wavelength areas are absorbed. For example, when the first wavelength range is recorded, the corresponding wavelengths can be reflected by the coating, while other wavelengths, for example at least undesired parts of the second wavelength range, can be transmitted, ie transmitted, by these layers. The area for absorption arranged behind the coating can absorb these portions in order to avoid or at least reduce the image in the multi-aperture imaging device thereby being adversely affected. A complementary device for absorbing unwanted parts of the first wavelength range, which is effective when the second beam deflection region 18B is used for beam deflection, can be arranged on the second side.

9c shows the beam deflecting device 18 in an optional third position, in which the side 18A is again facing the image sensor, but the inclination is selected such that the beam paths are deflected in the direction of a second overall field of view, for example the first overall field of view 9a and 9b.

9d shows the beam deflection device in an optional fourth position, in which the side 18B again faces the image sensor, so that the side 18B is effective, for example in order to deflect from the second overall field of view in the direction of the image sensor 36.

The additional positions according to FIG. 9c and FIG. 9d for the acquisition of the second total field of view enable the second overall field of view to be recorded using the first beam deflection region 18A with the image sensor, so that this recording is based on the first wavelength range. In addition, the second overall field of view can be imaged with a further image, specifically using the beam deflection region 18B with the image sensor, so that this image is based on the second wavelength range.

The two overall fields of view can be arranged along different main directions of the multi-aperture imaging device, for example along opposite directions, that is, along approximately 180 ° different directions. The beam deflection areas can, for example, be carried out along a progressive rotational movement 9a-d, the beam path alternately in the direction of the first overall field of view and the second overall field of view and alternately with the first beam deflection region 18A and the second beam deflection region

Redirect 18B. This can be a possible but not absolutely necessary sequence of movements. Rather, the direction of rotation can always be selected, for example, which enables a shortest and / or fastest change of position, so that it is possible to switch between the positions in any order, in particular in the case of detection of a third overall field of view along a third direction and / or in an arrangement of the total fields of view at an angle not equal to 180 °.

The angles of FIGS. 9a-9d can be approached in any order, approximately in each case approximately 45 °.

Instead of or in combination with the described rotary displacement, a translational displacement of the beam deflection device can also be implemented.

To obtain images, image information or images with different wavelength information, pixels of the image sensor can be designed to be effective for both wavelength ranges and / or cells with different sensitivity can be arranged spatially adjacent, so that at least the image sensor range is sensitive to both wavelength ranges .

E.g. The image sensor areas can be designed for image generation in the first wavelength range and for image generation in the second wavelength range. For example, CMOS pixels can be sensitive in the visual and NIR range at the same time, the overlying color filter array ("CFA" - in the visual typically in a Bayer arrangement) can be depending on the color (red, green, blue; or magenta, cyan, yellow / yellow) but also contain "filter pixels", only some of which also transmit the NIR and only partially, but that is sufficient. Alternatively or additionally, in a cell arrangement, for example in the extended Bayer pattern, individual cells can be replaced or implemented by cells that are only sensitive in the NIR,

E.g. For example, pixels of the image sensor areas can be configured for image generation in the first wavelength range and for image generation in the second wavelength range. The invention thus relates to a beam deflection device in facetVISION architecture with different configurations of the mirror front and mirror rear sides, wherein facetVISION is related to the multi-aperture imaging devices described herein.

A key idea is to design the deflecting mirror so that it has different functionalities on the front and rear.

This applies in particular to reflectivity, in particular spectral reflectivity (ie depending on the incident wavelengths), in particular the 1st side reflects the visual spectral range (visual - VIS) at the desired beam deflection angle, but not the near infrared (NIR) and the 2nd Side reflects NIR under the desired beam deflection, but not VIS, all of this, for example through differently configured dielectric layer systems on the 1st and 2nd mirror sides.

This enables that

• The same camera can "simultaneously" or very quickly in succession - only by

Mirror switching, can be used as a VIS or NIR camera.

• The mirror no longer necessarily has a wedge shape, but is a simple plane-parallel plate. 180 ° rotation used for mirror switching VIS / NIR. Any negative installation space implications in the rotating area of the mirror can be cured by opening and closing cover glasses at the location of the windows (through openings of the device).

• The camera can be constructed with a one-sided viewing direction ("World" or "Selfie"), mirror switching (180 °) then only serves to change the recorded spectral range. But can still allow front and rear viewing directions. Then e.g. in 90 ° turning steps of the mirror: Welt-Vf S, Selfie-NIR, Weit-NIR, Selfie-VIS.

• Of course, combination with visual field division and image stitching (e.g. 2 channels).

• Also possible as a dual camera version to generate a disparity-based depth map for image stitching (eg 4 channels). However, this is not necessary (and therefore channel-saving and therefore considerably cost-saving), because:

• Can now combine the above arrangement with structured or coded lighting (à la Kinect) in the NIR (camera can now also see in a mirror position in the NIR) and can use it to generate a depth map, which is necessary for image stitching of the VIS image. All this with only two channels of the field of view, the special mirror and only with the addition of the NIR dot pattern projector, without an additional NIR camera.

• The goal of reducing from 4 to 2 channels was achieved, even without adding an additional NIR camera (would be the 3rd optical channel), only an additional NIR projector is required

• Cost reduction while maintaining the overall height advantage, only through alternative generation of the depth map, which is partly integrated into the system itself

10 shows a schematic graph of a sensitivity E of an image sensor region of the image sensor of the multi-aperture imaging device over the wavelengths l of wavelength regions 66 and 68, for example the sensitivity of one or more of the image sensor regions 44a-d. The image sensor areas can be configured for image generation in the first wavelength range 66 and for image generation in the second wavelength range 68. The first wavelength range 66 is arranged, for example, between a first lower wavelength Ai and a first upper wavelength hz, with A _} <h _z . The second wavelength range 68 is arranged, for example, between a second lower wavelength l ₃ and a second upper wavelength l ₄ , with l ₃ <l. Although FIG. 10 is shown such that the second wavelength range 68 has longer wavelengths than the first wavelength range 66, it is also possible for the second wavelength range 68 to have smaller wavelengths than the first wavelength range 66. The wavelength ranges 66 and 68 can overlap with one another , but can also be spaced apart from one another by an intermediate region 72.

The image sensor area can be designed to generate image data at least in the wavelength areas 66 and 68, which means that it has, at least in the wavelength areas 66 and 68, a sensitivity Ei which is increased compared to a sensitivity Eo in which the image sensor area does not, for example Image data or image signals generated because it is insensitive to these wavelengths.

The beam deflection can be carried out selectively for the wavelength ranges 66 and 68, so that wavelengths outside the respective wavelength range for which the beam deflection range is currently effective are attenuated or filtered out, it being sufficient that at least the wavelengths are suppressed or attenuated which are arranged in the complementary wavelength range. This means that, for example, a wavelength range for which the image sensor is insensitive can also be deflected by the beam deflection region 18A and / or 18B. In simple terms, the image sensor area can also be designed for imaging outside the wavelength ranges 66 and 68.

E.g. the image sensor area can have a plurality of pixels, i. i.e., pixels (picture element). Each pixel can consist of at least one, preferably several imaging, i.e. H. photosensitive, sensor cells. These can be arranged freely or according to a pattern, for example a Bayer pattern. A sensitivity of the image sensor area for the second wavelength area 68 can be obtained, for example, by a first subset of pixels being sensitive to the first wavelength area 66 and a second subset of other pixels being sensitive to the second wavelength area 68. Depending on the desired resolution of the first and / or second image, a pixel of the first subset can be interlaced with one another and alternately, i. i.e., 1: 1, or in some other ratio. Alternatively or additionally, it is possible for one, several or all of the sensor cells of a pixel to be sensitive to the first and second wavelength ranges 66 and 68. Alternatively or additionally, it is also possible to change the pattern of the sensor cells for the first wavelength range 66 in such a way that sensitive sensor lines for the second wavelength range 68 are added and / or to replace sensor cells from the pattern. Pixels of the image sensor areas can thus be designed for image generation in the first wavelength range 66 and / or at least partially for image generation in the second wavelength range 68.

Although some aspects have been described in connection with a device, it is understood that these aspects also represent a description of the corresponding method, so that a block or a component of a device is also to be understood as a corresponding method step or as a feature of a method step. Analogously, aspects that have been described in connection with or as a method step also represent a description of a corresponding block or details or feature of a corresponding device.

The above-described embodiments are merely illustrative of the principles of the present invention. It is to be understood that modifications and variations in the arrangements and details described herein will occur to those skilled in the art. will shine. Therefore, it is intended that the invention be limited only by the scope of the following claims and not by the specific details presented with the description and explanation of the embodiments herein.

Claims

1. A multi-aperture imaging device comprising: an image sensor (36); an array (38) of optical channels (42a-d) arranged next to one another, each optical channel (42a-d) having an optical system for imaging at least one partial field of view (64a-d) of an overall field of view (60) onto an image sensor area (46a-d) of the image sensor (36), a beam deflecting device (18) for deflecting a beam path of the optical channels (42a-d), the beam deflecting device (18) having a first beam deflecting area (18A) which is used for a first wavelength range (66) by the optical Channel (42a-d) running electromagnetic radiation is effective; and has a second beam deflection region (18B) which is effective for a second wavelength region (68), different from the first wavelength region (66), of the electromagnetic radiation passing through the optical channels (42a-d).

2. Multi-aperture imaging device according to claim 1, which is designed to capture a first image of the entire field of view (60) using the first beam deflection region (18A) with the image sensor (36), so that the first image is based on the first wavelength length region (66) ; and to acquire a second image of the entire field of view (60) using the second beam deflection region (18B) with the image sensor (36), so that the second image is based on the second wavelength region (68).

3. Multi-aperture imaging device according to claim 2, which is designed to determine a depth map for the first image using the second image.

4. Multi-aperture imaging device according to one of the preceding claims, wherein the first beam deflection region (18A) on a first side of the beam deflection device (18) and the second beam deflection region (18B) on a second, the first

The opposite side is arranged, and the beam deflecting device (18) is designed such that the first side is arranged facing the image sensor (36) for capturing a first image of the overall field of view (60), and for capturing a second image of the overall field of view (60 ) the second side is arranged facing the image sensor (36).

5. Multi-aperture imaging device according to one of the preceding claims, wherein a first side of the beam deflecting device (18) has a different coating from a second, opposite side, in order to be effective in the first and second wavelength range (66, 68).

6. Multi-aperture imaging device according to one of the preceding claims, in which the beam deflection device (18) is designed to reflect the first wavelength range (66) when effective in the first wavelength range (66) and at least partially absorb different wavelength ranges and / or wherein the beam deflection device (18) is designed to reflect the second wavelength range (68) when effective in the second wavelength range (68) and to absorb at least partially different wavelength ranges therefrom.

7. Multi-aperture imaging device according to one of the preceding claims, in which the overall field of view (60) is a first overall field of view, and which has a first direction of view for capturing the first overall field of view and a second direction of view towards a second overall field of view; wherein the multi-aperture imaging device is designed to acquire a third image of the second overall field of view using the first beam deflection region (18A) with the image sensor (36), so that the third image is based on the first wavelength region (66); and to acquire a fourth image of the second total field of view using the second beam deflection region (18B) with the image sensor (36), so that the fourth image is based on the second wavelength region (68).

8. Multi-aperture imaging device according to one of the preceding claims, in which the first overall field of view and the second overall field of view are arranged along different main directions of the multi-aperture imaging device, and the beam deflection regions (18A-B) alternately in the direction of the first overall field of view and the direction when performing a progressive rotational movement second overall field of view and alternately deflected with the first beam deflection area (18A) and the second beam deflection area (18B).

9. Multiaperturabbiidungsvorrichtung according to any one of the preceding claims, wherein the beam deflection device (18) is designed to obtain a first image of the total field of view (60) an angle of attack (ai) of 45 ° ± 10 ° of the first beam deflection area (18A) with respect to the image sensor (36) and in order to obtain a second image of the total field of view (60) an angle of attack (a ₂ ) of 45 ° ± 10 ° of the second beam deflection area (18B) with respect to the image sensor (36).

10. Multi-aperture imaging device according to one of the preceding claims, which is designed to capture the entire field of view (60) by at least two partial fields of view (64a-d) and by at least one of the partial fields of view (64a-b) by at least a first optical channel (42a) and to detect a second optical channel (42c).

11. Multi-aperture imaging device according to claim 10, which is designed to segment the total field of view into exactly two partial fields of view (64a-b) and to exactly one of the partial fields of view (64a) through a first optical channel (42a) and a second optical channel ( 42c).

12. Multi-aperture imaging device according to claim 10 or 11, wherein the first optical channel! (42a) and the second optical channel! (42c) are spaced apart by at least one further optical channel (42b) in the array (14).

13. Multi-aperture imaging device according to one of the preceding claims, in which the beam deflection device (18) is formed as an array of facets (32), each optical channel (42a-d) being associated with a facet (32), and each of the facets with the first beam deflection region (18A) and the second beam deflection region (18B).

14. Multiaperturabbildungsvorricbtung according to claim 13, wherein the facets (32) of the array of facets are formed on both sides reflective plane-parallel mirrors.

15. Multi-aperture imaging device according to one of the preceding claims, in which the image sensor regions (46a-d) are designed for image generation in the first wavelength region (66) and for image generation in the second wavelength region (68).

16. Multi-aperture imaging device according to claim 15, in which pixels of the image sensor regions (46a-d) are designed for image generation in the first wavelength region (66) and at least partially for image generation in the second wavelength region (68).

17. Multi-aperture imaging device according to one of the preceding claims, in which the first wavelength range (66) comprises a visible spectrum and in which the second wavelength range (68) comprises an infrared spectrum, in particular a near (infrared spectrum),

18. Multi-aperture imaging device according to one of the preceding claims, further comprising an illumination device (55) which is designed to emit a temporal or spatial illumination pattern (55a) with a third wavelength range which at least partially corresponds to the second wavelength range (68).

19. Multi-aperture imaging device according to one of the preceding claims, which is designed to capture the entire field of view (60) at least stereoscope.

20. Multi-aperture imaging device according to one of the preceding claims, in which the beam deflection device (18) is designed to block or attenuate the second wavelength range (68) with the first beam deflection region (18A) and to use the second beam deflection region (68) 18B) to block or attenuate the first wavelength range (66).

21. Device with a multi-aperture imaging device according to one of the preceding claims, which is designed to generate a depth map of the overall field of view (60).

22. The apparatus of claim 21, which has no additional infrared camera.

23. The device according to claim 21 or 22, which is designed to record the entire field of view (60) from a perspective and which does not stiffen the stereoscopic image of the overall field of view (60).