DE102016117151B4 - Method and apparatus for synchronizing automatic exposure between chromatic pixels and panchromatic pixels in a camera system - Google Patents

Abstract

A method (900) comprising: determining (930) a first exposure for different chromatic pixels that detect light of different colors; detecting (940) an illumination type of the scene; determining (950) an exposure ratio between the chromatic pixels and panchromatic pixels based on the illumination type of the scene; determining (960) a second exposure for the panchromatic pixels detecting panchromatic light, the first exposure being different from the second exposure based on the exposure ratio between the chromatic pixels and the panchromatic pixels; and capturing (970) at least one image of the scene using the first exposure for the different chromatic pixels and the second exposure for the panchromatic pixels.

Description

BACKGROUND

area

The present invention relates to an automatic exposure algorithm in imaging devices such as digital cameras. In particular, the invention relates to a method and apparatus for synchronizing automatic exposure between chromatic pixels and panchromatic pixels in a camera system.

introduction

the EP 2 677 732 A2 describes a method, an apparatus and a computer program product for recording videos using a color image sensor and a panchromatic sensor. A first set of frames is captured by the color image sensor and a second set of frames is captured by the panchromatic sensor. Since panchromatic sensors are more sensitive to light than chromatic sensors, more frames can be recorded with the panchromatic sensor in the same exposure time than with the chromatic sensor. Thus, the number of frames in the second set is greater than the frames in the first set. It is further described how the frames can be aligned.

Digital cameras are very popular for taking photos of friends, family, children, for vacation photos and for taking pictures of flowers and landscapes and other scenes. To improve the image quality, some cameras now work with panchromatic pixels such as colorless pixels (clear pixels) together with chromatic pixels such as red, green and blue (RGB pixels). In single or multiple camera systems, the spectral sensitivity of chromatic pixels is less than that of panchromatic pixels. This means that the light received at the same exposure time differs between chromatic pixels and panchromatic pixels without adjusting the exposure of the different types of pixels. Disadvantageously, such a difference in exposure leads to underexposed chromatic pixels and / or overexposed panchromatic pixels. For example, when the exposure of a scene is adjusted for the chromatic pixels, the panchromatic pixels are overexposed, and when an exposure of a scene is adjusted for the panchromatic pixels, the chromatic pixels are underexposed.

What is needed, therefore, is a method and apparatus for synchronizing automatic exposure between chromatic pixels and panchromatic pixels in a camera system.

For this purpose, the method and the device are proposed according to the independent claims. Advantageous embodiments of the invention are the subject of the dependent claims.

Figure list

• 1 ist eine Beispieldarstellung eines Systems gemäß einer möglichen Ausführungsform;
• 2 ist eine Beispieldarstellung eines Simulationsmodells für Licht, das an einer Kameraeinheit empfangen wird, gemäß einer möglichen Ausführungsform;
• 3 zeigt ein Beispieldiagramm einer Spektralempfindlichkeit einer Beleuchtungsart wie beispielsweise Sonnenlicht, gemäß einer möglichen Ausführungsform;
• 4 zeigt ein Beispieldiagramm einer Spektralempfindlichkeit eines roten, grünen, blauen und eines farblosen Pixel gemäß einer möglichen Ausführungsform;
• 5 zeigt ein Beispieldiagramm einer Durchlässigkeitskurve eines IR-Sperrfilters gemäß einer möglichen Ausführungsform;
• 6 ist eine Beispieldarstellung eines Simulationsmodells für Licht, das an einem Dual-Kamerasystem mit einer ersten Kameraeinheit und einer zweiten Kameraeinheit empfangen wird, gemäß einer möglichen Ausführungsform;
• 7 zeigt ein Beispieldiagramm von Spektralempfindlichkeiten von Leuchtdioden-(LED)-Blitzlichtern an fünf Telefonen gemäß einer möglichen Ausführungsform;
• 8 ist eine Beispieldarstellung eines Simulationsmodells für Licht, das an einer 2x2-Array-Kameraeinheit empfangen wird, gemäß einer möglichen Ausführungsform;
• 9 ist ein Beispiel-Flussdiagramm zur Darstellung des Betriebs einer Kameravorrichtung gemäß einer möglichen Ausführungsform; und
• 10 zeigt ein Beispiel-Blockdiagramm einer Vorrichtung gemäß einer möglichen Ausführungsform.

With the aid of specific embodiments shown in the accompanying drawings, the description below explains how the advantages and features of the present invention are achieved. In the drawings, only exemplary embodiments, which do not restrict the scope of protection of the present invention, are shown.

• 1 Figure 3 is an example representation of a system according to one possible embodiment;
• 2 Figure 3 is an example representation of a simulation model for light received at a camera unit, according to a possible embodiment;
• 3 FIG. 11 shows an example diagram of a spectral sensitivity of a type of illumination such as sunlight, for example, according to a possible embodiment; FIG.
• 4th shows an example diagram of a spectral sensitivity of a red, green, blue and a colorless pixel according to a possible embodiment;
• 5 FIG. 10 shows an example diagram of a transmission curve of an IR cut filter according to a possible embodiment; FIG.
• 6th is an example representation of a simulation model for light that is received on a dual camera system with a first camera unit and a second camera unit, according to a possible embodiment;
• 7th Figure 3 shows an example diagram of spectral sensitivities of light emitting diode (LED) flashes on five telephones according to one possible embodiment;
• 8th Figure 3 is an example illustration of a simulation model for light received at a 2x2 array camera unit, according to one possible embodiment;
• 9 Figure 13 is an example flow chart illustrating the operation of a camera device in accordance with one possible embodiment; and
• 10 shows an example block diagram of a device according to a possible embodiment.

DETAILED DESCRIPTION

Embodiments of the present invention provide a method and apparatus for synchronizing automatic exposure between chromatic pixels and panchromatic pixels in a camera system. According to one possible embodiment, a first exposure can be determined for different chromatic pixels that detect light of different colors. A type of lighting of a scene can be recorded. An exposure ratio between the chromatic pixels and the panchromatic pixels can be determined based on the type of exposure of the scene. A second exposure can be determined for the panchromatic pixels that capture the panchromatic light. Based on the exposure ratio between the chromatic pixels and the panchromatic pixels with respect to an exposure type of a scene, the first exposure may differ from the second exposure. At least one image of the scene can then be recorded by using the first exposure for the different chromatic pixels and the second exposure for the panchromatic pixels at the same time.

Embodiments can synchronize exposure between panchromatic pixels and chromatic pixels. For example, embodiments may employ an exposure synchronization algorithm between panchromatic pixels and chromatic pixels to avoid overexposure of panchromatic pixels and / or underexposure of chromatic pixels. Such embodiments can work with a modern sensor, for example with a complementary metal oxide semiconductor sensor (CMOS sensor), which can set two different exposure times on two groups of pixels of the same sensor.

1 is an example representation of a system 100 according to a possible embodiment. The system 100 can be a device 110 and a scene 170 which is illuminated by a light source such as a lamp. The device 110 Can be a compact camera, a digital single-lens reflex (DSLR) camera, a mirrorless camera, a smartphone, a mobile phone, a selective call receiver, a gaming device, a digital receiver, a portable device, a wrist watch, a camcorder, a tablet computer, a personal Be a computer or other device that may contain a camera unit. For example, the device 100 at least one camera unit 120 , a control unit 150 with exposure synchronization logic and a memory 160 contain. The control unit 150 may be a processor, an image signal processor, a separate processor and an image processing pipeline module, software, hardware, a unit, multiple units, or any other control unit capable of controlling operations in a device with at least one camera unit. The camera unit 120 can be a lens 130 and a sensor 140 contain. The sensor 140 may be a charge coupled device (CCD) sensor, a CMOS sensor, an n-type metal oxide semiconductor (NMOS) sensor, or any other sensor that can capture an image. The sensor 140 can be chromatic pixels 142 and panchromatic pixels 144 contain. The chromatic pixels may include red, green, and blue (RGB) pixels, as shown, or other types of chromatic pixels such as cyan pixels, yellow pixels, green pixels, magenta pixels (CYGM pixels), or other chromatic pixels. The panchromatic pixels can be colorless pixels (clear pixels) that can capture all visible light. For illustration purposes only one group is a combination of chromatic pixels 142 and panchromatic pixels 144 shown. It should be understood, however, that the sensor 140 Can contain millions of pixels.

In operation can for the different chromatic pixels 142 that capture light of different colors, take a first exposure 152 to be determined. A second exposure 154 can for the panchromatic pixels 144 that detect panchromatic light. Based on a Exposure ratio between the chromatic pixels 142 and the panchromatic pixels 144 In relation to the lighting type of the scene, the first exposure can vary 152 from the second exposure 154 differentiate. The exposure ratio can be based on the type of light source 180 based that the scene 170 illuminated. There can be at least one picture of the scene 170 with the first exposure 152 for the different chromatic pixels 142 and with the second exposure 154 for the different panchromatic pixels 144 be included.

According to a possible embodiment, received light can be measured with regard to different types of lighting. For example, an automatic white balance (AWB) algorithm in the control unit 150 such as, for example, an image signal processing unit can detect the type of lighting such as the type of light source of a scene. Thereafter, an exposure ratio between the chromatic pixels and the panchromatic pixels for the lighting type can be calculated in advance or in real time. An exposure table for the chromatic pixels can be made to work with an automatic exposure algorithm for the chromatic pixels, and an exposure table for the panchromatic pixels can be made to work with an automatic exposure algorithm for the panchromatic pixels. An exposure ratio table described in the embodiments can eliminate an exposure table either for the chromatic pixels or for the panchromatic pixels. If the automatic exposure algorithm and chromatic pixel exposure table are used to find the optimal exposure per scene, the exposure ratio table can be used to infer the panchromatic pixel exposure. If the automatic exposure algorithm and panchromatic pixel exposure table are used to find the optimal exposure per scene, the exposure ratio table can be used to infer the chromatic pixel exposure. An exposure ratio table can be for panchromatic pixels or for chromatic pixels in memory 160 be saved. Alternatively, the exposure ratio can be set by exposure ratio generation logic in the control unit 150 generated in real time and used for the exposure of the panchromatic pixels or chromatic pixels.

The exposure ratio can be used following various strategies. According to one strategy, the same sensor gain can be set on both the panchromatic pixels and the chromatic pixels. Then the exposure time of the chromatic pixels and the exposure time of the panchromatic pixels can satisfy the exposure ratio. In general, the exposure time of chromatic pixels can be longer than the exposure time of panchromatic pixels. According to a further strategy, the same exposure time can be set both on the panchromatic pixels and on the chromatic pixels. Then the sensor gain of the chromatic pixels and the sensor gain of the panchromatic pixels can satisfy the exposure ratio. In general, the sensor gain of chromatic pixels can be higher than the sensor gain of panchromatic pixels. Other strategies may include sensing exposure based on aperture size and other factors affecting exposure.

The same notion can be extended to a multiple camera system with different apertures. The received light per camera can be calculated with regard to its pixel types and its aperture (F-number) for each type of lighting. An exposure ratio can then be generated in order to determine the exposure of the panchromatic pixels on the basis of the chromatic pixels or, conversely, of the chromatic pixels on the basis of the panchromatic pixels.

2 is an example representation of a simulation model 200 for light that is on a camera unit 210 such as the camera unit 120 is received, according to one possible embodiment. The camera unit 210 can an infrared cut filter (IR cut filter) 212 , a red, green, blue and colorless pixel matrix (RGBC pixel matrix) 214 and a sensor 216 contain. The camera unit 210 and / or a device such as the device 110 who have favourited the camera unit 210 may contain other elements, such as the lens 130 , the control unit 150 and the memory 160 . The RGBC pixel matrix 214 is shown separately, but can also be part of the sensor 216 and when the pixel matrix and sensor are combined, the RGBC pixel matrix 214 and the sensor 216 as an RGBC sensor 218 to be viewed as. A colorless pixel (C-pixel) can be equivalent to a panchromatic pixel. The RGBC pixel matrix 230 can also be another pixel matrix containing chromatic and panchromatic pixels. The simulation model 200 may comprise a lighting means, for example a light source 220 and a subject 230 , e.g. a subject in a scene.

3 is an example diagram 300 a spectral sensitivity of a type of lighting, for example sunlight, according to a possible embodiment. 4th is an example diagram 400 a spectral sensitivity of red, green, blue and colorless (panchromatic) pixels, such as in an RGBC sensor, in other sensors and / or in several sensors, according to a possible embodiment. The diagram 400 can increase the spectral sensitivity of red pixels 410 , the spectral sensitivity of green pixels 420 , the spectral sensitivity of blue pixels 430 and the spectral sensitivity of colorless such as panchromatic pixels 440 contain. 5 is an example diagram 500 a transmission curve of an IR cut filter according to a possible embodiment.

$$w_G=\frac{1}{4};$$

$$w_B=\frac{1}{4};$$

und $$w_C=\frac{1}{4}.$$

With this special RGBC sensor 218 the percentage of red, green, blue and colorless pixels per frame can result in the following respective weighting numbers: $$w_{\mathrm{R.}}=\frac{1}{\mathrm{4th}};$$

$$w_G=\frac{1}{\mathrm{4th}};$$

$$w_{\mathrm{B.}}=\frac{1}{\mathrm{4th}};$$

and $$w_{\mathrm{C.}}=\frac{1}{\mathrm{4th}}.$$

berechnet werden, wobei die Werte jedes Multiplikanden unter den Kurven 440, 500 und 300 jeweils gleich dem Y-Achsen-Wert pro bestimmter Wellenlänge sein können. Zum Beispiel kann für jeden Datenpunkt bei gleicher Wellenlänge ein Produkt der Spektralempfindlichkeit eines Farblos-Kanals, der Spektralempfindlichkeit eines Leuchtmittels (Illuminant) und des Durchlässigkeitsgrads (%) eines IR-Sperrfilters berechnet werden. S1_Clear ist dann die Summed Area dieser Produkt-Kurve bezogen auf die Wellenlänge.To calculate the light that is received at the panchromatic pixels, such as, for example, the colorless pixels (clear pixels), a panchromatic signal S1_Clear based on the formula $$\left(\text{Clear Pixels}\right)\times \left(\text{IR}\right)\times \left(\text{Illuminant}\right)$$

can be calculated with the values of each multiplicand under the curves 440 , 500 and 300 each can be equal to the Y-axis value per particular wavelength. For example, a product of the spectral sensitivity of a colorless channel, the spectral sensitivity of an illuminant and the transmittance (%) of an IR cut filter can be calculated for each data point at the same wavelength. S1_Clear is then the summed area of this product curve related to the wavelength.

The light received at the panchromatic pixels (C), Light_clear, can then be determined by multiplying the signal S1_clear by the weighting percentage w _c : $$\text{Light}\_\text{clear}=\text{S.}1\_\text{Clear}\times {\text{w}}_{\text{c}}.$$

erste chromatische Signale S1_R, S1_G und S1_B für jede Art von chromatischen Pixeln ähnlich wie das für das Signal S1_clear berechnete Produktfeld und jeweils unter Verwendung der Kurven 410, 420 und 430 für die chromatischen Pixel berechnet werden. Zum Beispiel kann für jeden Datenpunkt bei gleicher Wellenlänge ein Produkt von Spektralempfindlichkeiten eines Farbkanals, eines Leuchtmittels und eines Durchlässigkeitsgrads (%) eines IR-Sperrfilters berechnet werden. S1_R kann dann der summierte Bereich (Summed Area) der Produkt-Kurve des Rot-Kanals bezogen auf die Wellenlänge sein. S1_G kann der summierte Bereich der Produkt-Kurve des Grün-Kanals bezogen auf die Wellenlänge sein. S1_B kann der summierte Bereich der Produkt-Kurve des Bed-Kanals bezogen auf die Wellenlänge sein.To calculate the light that is received at the chromatic pixels, you can use the formula $$\left(\text{R.},\text{G},\text{B.}\right)\times \left(\text{IR}\right)\times \left(\text{Illuminant}\right)$$

first chromatic signals S1_R, S1_G and S1_B for each type of chromatic pixels similar to the product field calculated for the signal S1_clear and in each case using the curves 410 , 420 and 430 for the chromatic pixels. For example, a product of the spectral sensitivities of a color channel, a light source and a transmittance (%) of an IR cut filter can be calculated for each data point at the same wavelength. S1_R can then be the summed area of the product curve of the red channel based on the wavelength. S1_G can be the summed area of the product curve of the green channel related to the wavelength. S1_B can be the summed area of the product curve of the Bed channel related to the wavelength.

Then the light Light_rgb received at the chromatic pixels (RGB) can be determined by multiplying each signal by its respective weighting percentage and adding the results: $$\text{Light}\_\text{rgb}=\text{S.}1\_\text{R.}\times {\text{w}}_{\text{R.}}+\text{S.}1\_\text{G}\times {\text{w}}_{\text{G}}+\text{S.}1\_\text{B.}\times {\text{w}}_{\text{B.}}.$$

The exposure ratio between chromatic pixels and panchromatic pixels can then be Light_clear / Light_rgb. For example, if the sensor gain is set the same for both groups of pixels, then: $$\begin{array}{l}\left[\text{Exposure Time of Chromatic Pixels}\right]\times \text{Light}\_\text{rgb}\\ =\left[\text{Exposure Time of Panchromatic Pixels}\right]\times \text{Light}\_\text{clear}.\end{array}$$

If the exposure time is set the same for both groups of pixels, the following applies: $$\begin{array}{l}\left[\text{Sensor Gain of Chromatic Pixels}\right]\times \text{Light}\_\text{rgb}\\ =\left[\text{Sensor Gain of Panchromatic Pixels}\right]\times \text{Light}\_\text{clear}.\end{array}$$

6th is an example representation of a simulation model 600 for light that is connected to a dual camera system with a first camera unit 610 and a second camera unit 640 is received, each of which can be part of the device, for example the device 110 , according to one possible embodiment. The first camera unit 610 can an infrared cut filter (IR cut filter) 612 , a Bayer pixel matrix red, green and blue (RGB) 614 and a sensor 616 contain. The RGB pixel matrix 614 is shown separately, but can also be part of the sensor, and when the matrix and sensor are combined, the RGB pixel matrix 614 and the sensor 616 than an RGB Bayer sensor 618 to be viewed as. The second camera unit can be an infrared cut filter (IR cut filter) 642 , a clear microlens 644 and a sensor 646 contain. The colorless microlens 644 is shown separately, but can be part of the sensor, and when the microlens and sensor are combined, the colorless microlens 644 and the sensor 646 as a panchromatic sensor 648 to be viewed as. The camera units 610 and 640 and / or a device such as the device 110 with the camera units 610 and 640 may contain other elements, such as the lens 130 , the control unit 150 and the memory 160 . The simulation model 600 can also be a light source 620 such as a light source and a subject 630 such as a subject in a scene.

To make this dual camera system more general, the two camera units 610 and 640 different apertures (F-numbers) and different pixel sizes, what the exposure of the sensors 618 and 648 can affect. The F-number of the camera unit 610 with the RGB Bayer sensor 618 let F # _rgb, and the F-number of the camera unit 640 with the panchromatic sensor 648 let F # _clear. The unit pixel area of the camera unit 610 with the RGB Bayer sensor 618 let Unit_Pixel_Area_rgb, and be the unit pixel area of the camera unit 640 with the panchromatic sensor 648 be Unit_Pixel_Area_clear.

$$w_{G\_R}=\frac{1}{8};$$

$$w_{G\_B}=\frac{1}{8};$$

$$w_B=\frac{1}{8};$$

und $$w_C=\frac{1}{2}.$$

In this dual camera system, the percentage of (R, Gr, Gb, B, C) pixels for two full images (a Bayer image and a clear image) can have the following weighting numbers: $$w_{\mathrm{R.}}=\frac{1}{\mathrm{8th}};$$

$$w_{G\_\mathrm{R.}}=\frac{1}{\mathrm{8th}};$$

$$w_{G\_\mathrm{B.}}=\frac{1}{\mathrm{8th}};$$

$$w_{\mathrm{B.}}=\frac{1}{\mathrm{8th}};$$

and $$w_{\mathrm{C.}}=\frac{1}{2}.$$

berechnet werden. Für jeden Datenpunkt bei gleicher Wellenlänge kann ein Produkt von Spektralempfindlichkeiten des Farblos-Kanals und des Leuchtmittels und der Durchlässigkeit (%) des IR-Sperrfilters berechnet werden. S1_Clear kann dann der summierte Bereich dieser Produkt-Kurve bezogen auf die Wellenlänge sein.To calculate the light that is received at the panchromatic, for example colorless, pixels, a panchromatic signal S1_Clear can first be based on the formula $$\left(\text{Clear Pixels}\right)\times \left(\text{IR}\right)\times \left(\text{Illuminant}\right)$$

be calculated. For each data point at the same wavelength, a product of the spectral sensitivities of the colorless channel and the illuminant and the transmittance (%) of the IR cut filter can be calculated. S1_Clear can then be the summed area of this product curve related to the wavelength.

The light Light_clear received at the panchromatic pixels (C) can be determined by multiplying the signal S1_clear by the weighting percentage w _c and dividing the unit pixel area Unit_Pixel_Area_clear by the aperture (F number F # _clear) squared: $$\text{Light}\_\text{clear}=\text{S.}1\_\text{Clear}\times {\text{w}}_{\text{c}}\times 1/\left(\text{F.}\#\_\text{clear}2\right)\times \text{Unit}\_\text{pixel}\_\text{Area}\_\text{clear}.$$

berechnet werden.To calculate the light that is received at the chromatic pixels, first chromatic signals S1_R, S1_Gr, S1_Gb and S1_B for each type of chromatic pixels can be based on the formula $$\left(\text{R.},\text{Size},\text{Gb},\text{B.}\right)\times \left(\text{IR}\right)\times \left(\text{Illuminant}\right)$$

be calculated.

For example, a product of the spectral sensitivities of a color channel, a light source and a transmittance (%) of an IR cut filter can be calculated for each data point at the same wavelength. S1_R can then be the summed area of the product curve of the red channel related to the wavelength. S1_Gr can be the summed area of the product curve of the Gr channel (green pixels shared the same row with red pixels) related to the wavelength. S1_Gb can be the summed area of the product curve of the Gb channel (green pixels shared the same row with the blue pixels) related to the wavelength. S1_B can be the summed area of the product curve of the Bed channel related to the wavelength.

The light that is received at the chromatic pixels (RGB) Light_rgb can then be determined by multiplying each signal by its respective weighting percentage, adding the results and dividing the result with Unit_Pixel_Area_rgb by the aperture (F number F # _egb ) is multiplied by the square. $$\begin{array}{l}\text{Light}\_\text{rgb}=\left(\text{S.}1\_\text{R.}\times {\text{w}}_{\text{R.}}+\text{S.}1\_{\text{G}}_{\text{r}}\times {\text{w}}_{{\text{G}}_{\text{r}}}+\text{S.}1\_{\text{G}}_{\text{b}}\times {\text{w}}_{{\text{G}}_{\text{b}}}+\text{S.}1\_\text{B.}\times {\text{w}}_{\text{B.}}\right)\times \\ 1/\left(\text{F.}\#\_\text{rgb}2\right)\times \text{Unit}\_\text{pixel}\_\text{Area}\_\text{rgb}.\end{array}$$

The exposure ratio between chromatic pixels and panchromatic pixels can then be Light_clear / Light_rgb. For example, if the sensor gain is set the same for both groups of pixels: $$\begin{array}{l}\left[\text{Exposure Time of RGB Bayer Sensor}\right]\times \text{Light}\_\text{rgb}\\ =\left[\text{Exposure Time of Panchromatic Sensor}\right]\times \text{Light}\_\text{clear}.\end{array}$$

In diesen Fällen kann die Sensorverstärkung (sensor gain) äquivalent sein zu der Verstärkung der Pixel in der vorhergehenden Ausführungsform.For example, if the exposure time is set the same for both groups of pixels: $$\begin{array}{l}\left[\text{Sensor Gain of RGB Bayer Sensor}\right]\times \text{Light}\_\text{rgb}\\ =\left[\text{Sensor Gain of Panchromatic Pixels}\right]\times \text{Light}\_\text{clear}.\end{array}$$

In these cases, the sensor gain may be equivalent to the gain of the pixels in the previous embodiment.

In summary, the first camera unit 610 , for example a first camera, a lens 130 and a sensor 140 with the chromatic pixels 142 contain. The sensor 140 the first camera unit 610 can detect different color light at different chromatic pixels and can capture a first image of the scene at the different chromatic pixels with the first exposure for the different chromatic pixels. The second camera unit 640 , for example a second camera, can be a lens 130 and a sensor 140 with the panchromatic pixels 144 exhibit. The sensor 140 the second camera can capture panchromatic light at panchromatic pixels and can simultaneously record a second image of the scene at the panchromatic pixels with the second exposure value for the panchromatic pixels. The second exposure may be different from the first exposure based on an exposure ratio.

7th shows an example diagram 700 for displaying the spectral sensitivities of LED flashlights on five telephones according to one possible embodiment. According to this implementation of a dual camera system, the camera unit 610 and the camera unit 640 have the same aperture (F number) to demonstrate the calculation of a single LED flash mode with correlated color temperature (CCT) in which a flash is the light source 620 is. When using the single CCT LED flash mode, the spectral sensitivities of the light source 620 can be set for all recordings. Therefore, the exposure ratio per camera system can be determined by using such a flash mode.

$$w_{G\_R}=\frac{1}{8};$$

$$w_{G\_B}=\frac{1}{8};$$

$$w_B=\frac{1}{8};$$

und $$w_C=\frac{1}{2}.$$

In this dual camera system, the percentage of (R, Gr, Gb, B, C) pixels for two full images (a Bayer image and a clear image) can have the following weighting numbers: $$w_{\mathrm{R.}}=\frac{1}{\mathrm{8th}};$$

$$w_{G\_\mathrm{R.}}=\frac{1}{\mathrm{8th}};$$

$$w_{G\_\mathrm{B.}}=\frac{1}{\mathrm{8th}};$$

$$w_{\mathrm{B.}}=\frac{1}{\mathrm{8th}};$$

and $$w_{\mathrm{C.}}=\frac{1}{2}.$$

berechnet werden.To calculate the light that is received at the panchromatic pixels such as, for example, colorless pixels, a panchromatic signal S1_Clear can first be based on the formula $$\left(\text{Clear Pixels}\right)\times \left(\text{IR}\right)\times \left(\text{Illuminant}\right)$$

be calculated.

For each data point at the same wavelength, a product of the spectral sensitivities of the colorless channel and the illuminant and the transmittance (%) of the IR cut filter can be calculated. S1_Clear can then be the summed area of this product curve related to the wavelength.

The light received at the panchromatic pixels (C), Light_clear, can then be determined by multiplying the signal S1_clear by the weighting _{percentage w c} and Unit_Pixel_Area_clear: $$\text{Light}\_\text{clear}=\text{S.}1\_\text{Clear}\times {\text{w}}_{\text{c}}\times \text{Unit}\_\text{pixel}\_\text{Area}\_\text{clear}.$$

berechnet werden.To calculate the light that is received at the chromatic pixels, first chromatic signals S1_R, S1_Gr, S1_Gb and S1_B for each type of chromatic pixels can be based on the formula $$\left(\text{R.}\text{, Gr}\text{, Gb}\text{, B}\right)\times \left(\text{IR}\right)\times \left(\text{Illuminant}\right)$$

be calculated.

For example, a product of the spectral sensitivities of a color channel, a light source and a transmittance (%) of an IR cut filter can be calculated for each data point at the same wavelength. S1_R can then be the summed area of the product curve of the red channel related to the wavelength. S1_Gr can be the summed area of the product curve of the Gr channel (green pixels shared a row with red pixels) related to the wavelength. S1_Gb can be the summed area of the product curve of the Gb channel (green pixels shared a row with blue pixels) related to the wavelength. S1_B can be the summed area of the product curve of the Bed channel related to the wavelength.

Then the light received at the chromatic pixels (RGB) Light_rgb can be determined by multiplying each signal by its respective weight percentage, adding the results and multiplying the result by Unit_Pixel_Area_rgb: $$\begin{array}{l}\text{Light}\_\text{rgb}=\left(\text{S.}1\_\text{R.}\times {\text{w}}_{\text{R.}}+\text{S.}1\_{\text{G}}_{\text{r}}\times {\text{w}}_{\text{Size}}+\text{S.}1\_{\text{G}}_{\text{b}}\times {\text{w}}_{\text{Gb}}+\text{S.}1\_\text{B.}\times {\text{w}}_{\text{B.}}\right)\times \\ \text{Unit}\_\text{pixel}\_\text{Area}\_\text{rgb}.\end{array}$$

The exposure ratio between chromatic pixels and panchromatic pixels can then be Light_clear / Light_rgb. For example, if the sensor gain is set the same for both groups of pixels: $$\begin{array}{l}\left[\text{Exposure Time of RGB Bayer Sensor}\right]\times \text{Light}\_\text{rgb}\\ =\left[\text{Exposure Time of Panchromatic Sensor}\right]\times \text{Light}\_\text{clear}.\end{array}$$

If the exposure time is set the same for both groups of pixels, the following applies: $$\begin{array}{l}\left[\text{Sensor Gain of RGB Bayer Sensor}\right]\times \text{Light}\_\text{rgb}\\ =\left[\text{Sensor Gain of Panchromatic Sensor}\right]\times \text{Light}\_\text{clear}.\end{array}$$

In a dual CCT LED flash mode, the spectral sensitivity of a dual LED light source can vary with the scene light source together with the dual LED light source. Therefore the exposure ratio can vary per scene. If a dual CCT LED flashlight is selected, spectral sensitivities can be measured on different CCTs and the exposure ratio per CCT can be stored in a look-up table (LUT).

8th is an example representation of a simulation model 800 for light received at a 2x2 array camera unit, according to a possible embodiment. The camera unit 810 can an infrared cut filter (IR cut filter) 812 , a color filter 814 and a sensor 816 contain. The camera unit 810 and / or a device such as the device 110 who have favourited the camera unit 810 may contain other elements, such as the lens 130 , the control unit 150 and the memory 160 . The color filter 814 can from the sensor 816 be separated. Alternatively, you can use the color filter 814 and the sensor 816 as a combined component of sensor and RGBC filters 818 to be viewed as. A pixel on the sensor, behind the colorless filter, is a colorless (C) pixel, which can be equivalent to a panchromatic pixel. In the case of a 2x2 array camera unit 810, the sensor can 816 be divided into quadrants, with the pixels in a given quadrant being passed through one of the R, G, B or C filters in the color filter 814 Can receive light. The simulation model 800 can also be a light source 820 include, for example, a light source, and a subject 830 , for example a subject in a scene.

$$w_G=\frac{1}{4};$$

$$w_B=\frac{1}{4};$$

und $$w_C=\frac{1}{4}.$$

With the combined component of sensor and RGBC filters 818 in the 2x2 camera unit 810, the percentage of (R, G, B, C) pixels per frame can give the following weighting numbers: $$w_{\mathrm{R.}}=\frac{1}{\mathrm{4th}};$$

$$w_G=\frac{1}{\mathrm{4th}};$$

$$w_{\mathrm{B.}}=\frac{1}{\mathrm{4th}};$$

and $$w_{\mathrm{C.}}=\frac{1}{\mathrm{4th}}.$$

zunächst ein panchromatisches Signal S1_clear berechnet werden.To calculate the light that is received at the panchromatic pixels such as the colorless pixels, the formula $$\left(\text{Clear Pixels}\right)\times \left(\text{IR}\right)\times \left(\text{Illuminant}\right)$$

first a panchromatic signal S1_clear is calculated.

For example, a product of the spectral sensitivity of a colorless channel, the spectral sensitivity of a light source and the transmittance (%) of an IR cut filter can be calculated for each data point at the same wavelength. S1_Clear can then be the summed area of this product curve related to the wavelength.

The light Light_clear received at the panchromatic pixels (C) can then be determined by multiplying the signal S1_clear by the weighting percentage w _c : $$\text{Light}\_\text{clear}=\text{S.}1\_\text{Clear}\times {\text{w}}_{\text{c}}.$$

erste chromatische Signale S1_R, S1_G und S1_B für jede Art von chromatischen Pixeln berechnet werden.To calculate the light that is received at the chromatic pixels, you can use the formula $$\left(\text{R.},\text{G},\text{B.}\right)\times \left(\text{IR}\right)\times \left(\text{Illuminant}\right)$$

first chromatic signals S1_R, S1_G and S1_B are calculated for each type of chromatic pixels.

For example, a product of the spectral sensitivities of a color channel, a light source and a transmittance (%) of an IR cut filter can be calculated for each data point at the same wavelength. S1_R can then be the summed area of the product curve of the red channel related to the wavelength. S1_G can be the summed area of the product curve of the green channel related to the wavelength. S1_B can be the summed area of the product curve of the Bed channel related to the wavelength.

The light Light_rgb received at the chromatic pixels (RGB) can then be determined by multiplying each signal by its respective weighting percentage and adding the results: $$\text{Light}\_\text{rgb}=\text{S.}1\_\text{R.}\times {\text{w}}_{\text{R.}}+\text{S.}1\_\text{G}\times {\text{w}}_{\text{G}}+\text{S.}1\_\text{B.}\times {\text{w}}_{\text{B.}}.$$

The exposure ratio between chromatic pixels and panchromatic pixels can then be Light_clear / Light_rgb. For example, if the sensor gain is set the same for both groups of pixels, then: $$\begin{array}{l}\left[\text{Exposure Time of Chromatic Pixels}\right]\times \text{Light}\_\text{rgb}\\ =\left[\text{Exposure Time of Panchromatic Pixels}\right]\times \text{Light}\_\text{clear}.\end{array}$$

If the exposure time is set the same for both groups of pixels, the following applies: $$\begin{array}{l}\left[\text{Sensor Gain of Chromatic Pixels}\right]\times \text{Light}\_\text{rgb}\\ =\left[\text{Sensor Gain of Panchromatic Pixels}\right]\times \text{Light}\_\text{clear}.\end{array}$$

There are variants of the 4-color filter camera system used in the simulation model 800 is shown. In a variant, four color filters can each be used on four individual sensors. In this variant, one camera can record images from four cameras with one of the four sensors for each color channel of the RGBC channels. Another variation may include a camera system that has more than four individual sensors, at least one for each color channel of RGBC. For example 4x4, 5x4, 4x5, 5x5 or more sensors can be used. Such a multiple sensor system is in the U.S. Patent No. 8,514,491 described.

According to one possible embodiment, a LUT can be created for implementation on a camera product. For example, after camera module specifications have been determined, the spectral sensitivity of sensor channels such as R, G, B, colorless / panchromatic and a transmission curve of the IR cut filter are known. The spectral sensitivities of different types of lighting can be generated by a computer simulator. A LUT table can then be created against the lighting type for each camera system and stored in memory. A LUT table can be provided in the following form, for example: Table 1: LUT for exposure ratio versus type of lighting CCT / lighting type Exposure ratio 2300K / candlelight a 2800K / tungsten halogen b 4100K / fluorescent c 5000K / daylight d 6500K / daylight cloudy e 7500K / shade f

The types of lighting given in the table above may be approximate types of lighting that may vary depending on the lighting type model. The exposure ratios (a, b, c, d, e and f) are given as variables, and the actual values are determined according to the embodiments described herein. The table can also contain more or fewer variants of CCT / lighting types and corresponding lighting conditions. If the automatic exposure algorithm and the chromatic pixel exposure table are used to find the optimal exposure for each scene, this exposure ratio table can be used can be established such that the exposure for the panchromatic pixels is found based on the known exposure of chromatic pixels. When the automatic exposure algorithm and exposure table are used to find the optimal exposure for each scene, this exposure ratio table can be constructed so that the exposure for the chromatic pixels is found based on the known exposure of panchromatic pixels. Alternatively, a camera system can spontaneously generate the exposure conditions in real time.

During real-time processing in a camera system, one only has to wait until the automatic exposure algorithm converges on a group of pixels (chromatic or panchromatic). For example, if the automatic exposure algorithm per single shot converges on the chromatic pixels first, the exposure time and the sensor gain of chromatic pixels can be set by the exposure table and / or the automatic exposure algorithm of chromatic pixels. The exposure time and the sensor gain of panchromatic pixels can be set by the exposure ratio for the type of exposure of the scene (determined by an automatic white balance algorithm) according to the LUT. As mentioned above, the exposure ratio can also be determined in real time.

9 is an example flowchart 900 to illustrate the operation of a camera device such as the device 110 according to one embodiment. The sequence in the flowchart begins at item 910. At item 920, several preview images can be recorded. At 930, an algorithm for automatic exposure of chromatic pixels may converge on the plurality of preview images, and that algorithm and an exposure table may determine a first exposure for chromatic pixels. For example, a first exposure can be determined for different chromatic pixels that capture light of different colors. The exposure can be based on a detection state of the camera, for example on a first detection state. The exposure can be based on the exposure time, the aperture size, the pixel sensitivity and other factors influencing the exposure. At item 940, a type of lighting can be determined for a scene to be recorded. For example, the type of lighting for the scene can be determined using an automatic white balance algorithm or can be set by a user.

At 950, based on the type of lighting for the scene, an exposure ratio between chromatic pixels and panchromatic pixels can be determined. The exposure ratio can be determined by calculation, by retrieving it from a table or in some other way. The determination ratio can be based on a ratio between the received light of the various chromatic pixels and the received light of the panchromatic pixels for a given type of illumination. In addition, the exposure ratio can be based on a ratio between weighted received light of the various chromatic pixels and a weighted received light of the panchromatic pixels for a given type of illumination. The weighting can be based on a percentage of the number of pixels of each color of the chromatic pixels used for the image and a percentage of the number of panchromatic pixels. Furthermore, the received light from pixels can be based on a summed area of a product curve of a spectral sensitivity of a color channel of pixels, on a spectral sensitivity of a given type of illumination and on the transmission of an infrared cut-off filter.

At 960, a second exposure can be determined for panchromatic pixels that capture panchromatic light. Based on the exposure ratio between chromatic pixels and panchromatic pixels, the first exposure may be different from the second exposure. According to one possible implementation, the first exposure can provide a higher exposure for the various chromatic pixels than for the panchromatic pixels. For example, the first exposure may have a longer exposure time for the different chromatic pixels, a higher sensor sensitivity for the different chromatic pixels, a larger aperture for the different chromatic pixels, or otherwise a higher exposure for the different chromatic pixels than the second exposure for the panchromatic pixels provide based on the exposure ratio and reciprocally for the first exposure with respect to the second exposure. The first exposure can be determined prior to the second exposure and the exposure ratio can be used to determine the second exposure based on the first exposure. Alternatively, the second exposure can be determined prior to the first exposure and the exposure ratio can be used to determine the first exposure based on the second exposure.

According to one possible embodiment, when determining the exposure for the pixels, the same sensor gain can be set for the different chromatic pixels as for the panchromatic pixels. Thereafter, the exposure time of the chromatic pixels based on the first exposure and the exposure time of the panchromatic pixels based on the second exposure or the first exposure can be alternately set based on the second exposure. According to a further implementation, when determining the exposure for the pixels, the same exposure time can be set for the various chromatic pixels as for the panchromatic pixels. The sensor gain of the chromatic pixels can then be adjusted based on the first exposure and the sensor gain of the panchromatic pixels can be adjusted based on the second exposure or alternately the first exposure can be adjusted based on the second exposure. In other possible implementations, various combinations of sensor gain, exposure time, aperture size, and other factors can be used to adjust the exposure of the chromatic pixels and the panchromatic pixels.

At 970, at least one image of a scene can be captured, the first exposure being used for the various chromatic pixels and the second exposure being used for the panchromatic pixels. According to one possible implementation, the different chromatic pixels and the panchromatic pixels can be on the same sensor or in the same camera. According to another implementation, the different chromatic pixels may be in a different camera or on a different sensor than the panchromatic pixels and even in different cameras or on different sensors than different chromatic pixels. For example, the various chromatic pixels may be those on a first sensor in a first camera and the panchromatic pixels may be those on a second sensor in a second camera. The acquisition of at least one image can then include the acquisition of a first image using the different chromatic pixels on the first sensor in the first camera with the first exposure and the acquisition of a second image using the panchromatic pixels on the second sensor in the second camera or vice versa. The first and the second image can then be combined to form the at least one image.

At item 980 an output image can be generated. For example, an image signal processor (ISP) can process the chromatic and panchromatic pixels to generate an output image. At item 990 the image can be output. The image output can take place via a transceiver, for example to a display, to a memory, to a printer or to another device and / or otherwise. At item 995 the sequence in the flowchart 900 end up.

It goes without saying that regardless of the specific steps depicted in the figures, depending on the embodiment, a variety of additional or different steps can be performed and that one or more of the specific steps can be rearranged, repeated or omitted entirely, depending on the embodiment. Steps that have been carried out can also be repeated continuously or continuously while other steps are being carried out at the same time. Furthermore, different steps can be performed by different elements or in a single element of the described embodiments.

10 Figure 3 is an example block diagram of an apparatus 1000 such as the device 110 , according to one possible embodiment. The device 1000 can be a housing 1010 , a control unit 1020 in the case 1010 , an audio input and output circuit 1030 that came with the control unit 1020 connected, one to the control unit 1020 connected display 1040 , one with the control unit 1020 associated transceiver 1050 , one with the transceiver 1050 connected antenna 1055 , one with the control unit 1020 connected user interface 1060 , one with the control unit 1020 connected memory and one with the control unit 1020 connected network interface 1080 include. Likewise, the device 1000 at least one camera 1090 such as the camera unit 120 , the camera unit 210 who have favourited camera units 610 and 640 , the camera unit 810 and / or another camera or camera unit. The camera 1090 can be a lens 1092 and a sensor 1094 contain. Depending on the implementation of the device 1000 For example, as a single camera compared to a smartphone, the device does not necessarily require all of the elements shown. The device can carry out the methods described in all of the embodiments.

the display 1400 may include multiple displays and may be a viewfinder, liquid crystal display (LCD), light emitting diode (LED) display, plasma display, projection display, touch screen, LED flash, or other device, or a combination of devices that display information and / or emit light. The transceiver 1050 may comprise a transmitter and / or a receiver. The audio input and output circuitry 1030 may include a microphone, speaker, transducer, or other audio input and output circuitry. The user interface 1060 may include a keyboard, keyboard, buttons, touchpad, joystick, touchscreen display, other additional display, or other means for creating an interface between a user and an electronic device. The network interface 1080 can be a Universal Serial Bus (USB) port, an Ethernet port, an infrared transceiver, an IEEE 13910 Port, WLAN transceiver, or other interface that can connect a device to a network, device, or computer for the transmission and reception of data communication signals. The memory 1070 may include random access memory, read-only memory, optical memory, flash memory, removable memory, hard drive, cache, or other memory that can be connected to a wireless communication device.

In the device 1000 or in the control unit 1020 may be implemented for Microsoft Windows ^®, UNIX ^® or Linux ^®, Android ™ or another operating system, an operating system. The operating software for the device or the device can be written in any programming language, for example in C, C ++, Java or Visual Basic. The application software can also run on an application framework or an application framework structure such as a Java® framework, a NET® framework or another application framework. The software and / or the operating system can be in the memory 1070 or at another location in the device 1000 be saved. The device 1000 or the control unit 1020 can also use hardware to perform the operations described. For example, the control unit 1020 be a programmable processor. The described embodiments can also be applied to a general-purpose computer or a special-purpose computer, a programmed microprocessor or microprocessor, integrated peripheral circuit elements, an application-specific integrated circuit or another integrated circuit, electronic hardware / logic circuits such as a circuit with discrete elements, a programmable logic element such as a programmable logic array, a field-programmable gate array or the like can be implemented. In general, the control unit can 1020 any control device or processor device or devices capable of operating a wireless communication device and implementing the described embodiments. As further examples, the control unit may include a processor, an image signal processor, automatic exposure synchronization logic, software, hardware, and / or other controller capable of performing operations described in the embodiments.

When in operation, the sensor can 1094 the at least one camera 1090 Perceive or detect light of different colors at different chromatic pixels and panchromatic light at panchromatic pixels, for example. The panchromatic pixels and the chromatic pixels can be pixels on the same sensor in one camera unit or pixels on separate sensors in separate camera units. The control unit 1020 may detect an illumination type of a scene, and may determine an exposure ratio between the chromatic pixels and the panchromatic pixels based on the type of illumination of the scene.

The control unit 1020 may determine a first exposure for different chromatic pixels and a second exposure for the panchromatic pixels. Based on the exposure ratio between the chromatic pixels and the panchromatic pixels, the first exposure may be different from the second exposure. The first exposure can provide a higher exposure for the various chromatic pixels than for the panchromatic pixels.

The exposure ratio may be based on a ratio between the received light of the various chromatic pixels and the received light of the panchromatic pixels for a given type of lighting. The exposure ratio may further be based on a ratio between the weighted received light of the various chromatic pixels and a weighted received light of the panchromatic pixels for a given type of illumination. The weighting can be based on the percentage of the number of pixels of each color of the chromatic pixels used for the image and a percentage of the number of panchromatic pixels. The received light from pixels may be based on the summed area of a product curve of a spectral sensitivity of a color channel of pixels, on a spectral sensitivity of a given type of illumination, and on a transmittance of an infrared cut filter. According to one possible implementation, the control unit can 1020 set the same sensor gain of the chromatic pixels as the panchromatic pixels, can set the exposure time of the chromatic pixels based on the first exposure, and can set the exposure time of the panchromatic pixels based on the second exposure based on the first exposure. According to a further possible implementation, the control unit 1020 set the same exposure time of the chromatic pixels and the panchromatic pixels, can adjust the sensor gain of the chromatic pixels based on the first exposure, and can adjust the sensor gain of the panchromatic pixels based on the second exposure based on the first exposure. The control unit can 1020 adjust the sensor gain, exposure time, aperture size, or another exposure component of the panchromatic pixels first and then adjust the other respective exposure component of the chromatic pixels based on the exposure component of the panchromatic pixels based on the exposure ratio.

The at least one camera 1090 can capture at least one image of a scene using the first exposure for the different chromatic pixels and the second exposure for the panchromatic pixels at the same time. The control unit 1090 may combine the first and second images to generate at least one image. The control unit 1090 this at least one image can be sent to the display, for example 1040 , to the memory 1070 , via the network interface 1080 for example to a printer or via the transceiver 1050 output and / or can output this at least one image in another way.

The present method can be performed on a programmed processor. The controls, flowcharts and modules can, however, also be used on a general-purpose or special purpose computer, a programmed microprocessor or microprocessor and on integrated peripheral circuit elements, on an integrated circuit, an electronic hardware or logic circuit such as a discrete circuit element, a programmable logic module or the like implemented. In general, any device that contains a finite state machine that can implement the flowcharts shown in the figures can be used to implement the processor functions of the present description.

Certain embodiments have been described above. However, those skilled in the art will recognize that numerous alternatives, modifications, and variations are possible. For example, various components of the embodiments can be exchanged, added, or substituted in the other embodiments. Likewise, not all of the elements shown in a respective figure are necessary for the operation of the embodiment described. For example, one of ordinary skill in the art would be able to make and utilize the teachings of the invention simply by using the elements of the independent claims. Accordingly, the foregoing embodiments of the invention are illustrative in nature and not restrictive. Various changes are possible without departing from the inventive concept.

In the present description, the terms “first”, “second” and the like were only used to distinguish a unit or an action from a further unit or further action, even if a such relationship or order between units or actions does not actually exist or is necessary. The term “a of” followed by a list means that there are one, some, or all, but not necessarily all, of the items in the list. The terms “comprises”, “comprising” or other forms of the same are intended to express that a process, a method, an object or a device in which the listed element is included does not exclusively include these elements, but also other or further elements May include items not specifically listed. If “an” element is mentioned, this does not mean that the process, method, object or device that comprises this element does not also contain other identical elements. Likewise, the term “a further or a further or a further” means at least one second or more elements. The terms “containing” and “having” used in the description have the meaning of “comprising”. Furthermore, the explanations in the “Background” section are based on the inventor's own findings regarding the context of some embodiments at the time of filing and on the recognition of problems with existing technologies and / or problems or difficulties in the context of the inventor's own work.

Claims (22)

A method (900) comprising: determining (930) a first exposure for different chromatic pixels that detect different color light; detecting (940) an illumination type of the scene; determining (950) an exposure ratio between the chromatic pixels and panchromatic pixels based on the type of illumination of the scene; determining (960) a second exposure for the panchromatic pixels detecting panchromatic light, the first exposure being different from the second exposure based on the exposure ratio between the chromatic pixels and the panchromatic pixels; and capturing (970) at least one image of the scene using the first exposure for the various chromatic pixels and the second exposure for the panchromatic pixels. Method (900) according to Claim 1 wherein the first exposure provides a higher exposure for the various chromatic pixels than for the panchromatic pixels. Method (900) according to Claim 1 or Claim 2 wherein the exposure ratio is based on a ratio between the received light of the various chromatic pixels and the received light of the panchromatic pixels for a given type of illumination. Method (900) according to Claim 3 wherein the exposure ratio is based on a ratio between weighted received light of the various chromatic pixels and a weighted received light of the panchromatic pixels for a given lighting type, the weighting being based on a percentage of the number of pixels of each color of the chromatic pixels used for the image and based on a percentage of the number of panchromatic pixels. Method (900) according to one of the Claims 1 until 4th wherein the received light of pixels is based on a summed area of a product curve of a spectral sensitivity of a color channel of pixels, a spectral sensitivity of a given type of illumination and a transmittance of an infrared cut filter. Method (900) according to one of the Claims 1 until 5 , further comprising: setting the same sensor gain for the different chromatic pixels as for the panchromatic pixels; adjusting the exposure time for the chromatic pixels based on the first exposure; and adjusting the exposure time for the panchromatic pixels based on the second exposure. Method (900) according to one of the Claims 1 until 6th , further comprising: setting the same exposure time for the different chromatic pixels as for the panchromatic pixels; adjusting the sensor gain of the chromatic pixels based on the first exposure; and adjusting the sensor gain of the panchromatic pixels based on the second exposure. Method (900) according to one of the Claims 1 until 7th wherein the different chromatic pixels are those on a first sensor in a first camera, the panchromatic pixels are those on a second sensor in a second camera, and wherein capturing at least one image involves capturing a first image using the different chromatic pixels on the first sensor in the first camera with the first exposure and at the same moment capturing a second image using the panchromatic pixels on the second sensor in the second camera. Method (900) according to Claim 8 , further comprising composing the first image and the second image to generate at least one image. Method (900) according to one of the Claims 1 until 7th , where the panchromatic pixels and the chromatic pixels are those on the same sensor in a camera. Method (900) according to one of the Claims 1 until 10 , further comprising outputting at least one image. Apparatus (1000) comprising: at least one camera unit (1090) with an objective (1092) and a sensor (1094), the sensor of the at least one camera unit (1090) being effective for the detection of light of different colors at different chromatic pixels and of panchromatic light on panchromatic pixels; and a control unit (1020), which is operatively connected to the at least one camera (1090), the control unit (1020) being effective for: detecting a type of illumination of a scene, determining an exposure ratio between the chromatic pixels and the panchromatic pixels based on the lighting type of the scene and determining a first exposure for the various chromatic pixels and a second illumination for the panchromatic pixels, the first exposure differing from the second exposure based on the exposure ratio between the chromatic pixels and the panchromatic pixels, wherein the at least one camera (1090) captures an image of the scene using simultaneously the first exposure for the various chromatic pixels and the second exposure for the panchromatic pixels. Device (1000) according to Claim 12 wherein the first exposure provides a higher exposure for the various chromatic pixels than for panchromatic pixels. Device (1000) according to Claim 12 or Claim 13 wherein the exposure ratio is based on a ratio between the received light of the various chromatic pixels and the received light of the panchromatic pixels for a given type of illumination. Device (1000) according to Claim 14 wherein the exposure ratio is based on a ratio between weighted received light of the various chromatic pixels and a weighted received light of the panchromatic pixels for a given lighting type, the weighting being based on a percentage of the number of pixels of each color of the chromatic pixels used for the image and based on a percentage of the number of panchromatic pixels. Device (1000) according to one of the Claims 12 until 15th wherein the received light of pixels is based on a summed area of a product curve of a spectral sensitivity of a color channel of pixels, a spectral sensitivity of a given type of illumination and a transmittance of an infrared cut filter. Device (1000) according to one of the Claims 12 until 16 wherein the control unit is effective for setting the same sensor gain of the chromatic pixels as the panchromatic pixels, for setting the exposure time of the chromatic pixels based on the first exposure and for setting the exposure time of the panchromatic pixels based on the second exposure. Device (1000) according to one of the Claims 12 until 17th wherein the control unit is effective for setting the same exposure time of the chromatic pixels and the panchromatic pixels, for setting the sensor gain of the chromatic pixels based on the first exposure and for setting the sensor gain of the panchromatic pixels based on the second exposure. Device (1000) according to one of the Claims 12 until 18th wherein the at least one camera (1090) comprises: a first camera with a first lens and a first sensor, wherein the first sensor is effective for detecting light of different colors at different chromatic pixels and is effective for capturing a first image of the scene at the different chromatic pixels using the first exposure for the chromatic pixels; and a second camera having a second objective and a second sensor, wherein the second sensor is effective for detecting panchromatic light at panchromatic pixels and is effective for capturing a second image of the scene using the second exposure for the panchromatic pixels. Device (1000) according to Claim 19 wherein the controller (1020) is configured to compose the first and second images to generate at least one image. Device (1000) according to one of the Claims 12 until 18th wherein the panchromatic pixels and the chromatic pixels are those on the same sensor in one camera unit. Device according to one of the Claims 12 until 21 wherein the control unit (1020) is configured to output the at least one image.

Images