CN117203974A - Apparatus and method for providing high dynamic range image - Google Patents

Apparatus and method for providing high dynamic range image Download PDF

Info

Publication number
CN117203974A
CN117203974A CN202180096364.2A CN202180096364A CN117203974A CN 117203974 A CN117203974 A CN 117203974A CN 202180096364 A CN202180096364 A CN 202180096364A CN 117203974 A CN117203974 A CN 117203974A
Authority
CN
China
Prior art keywords
sub
block
color filter
pixel
color
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180096364.2A
Other languages
Chinese (zh)
Inventor
萨穆·科斯基宁
米科·穆基
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN117203974A publication Critical patent/CN117203974A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/46Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by combining or binning pixels
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/133Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing panchromatic light, e.g. filters passing white light

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

The invention relates to a radiation detection device comprising an array of pixels superimposed with a color filter array, wherein each pixel comprises one or more pixel portions. The pixel array includes one or more pixel blocks. Each block comprises at least four sub-blocks of pixels, each sub-block of pixels being superimposed with a white filter and a color filter of the same respective color. For each sub-block, all pixel portions superimposed with white filters are associated with a first merge group. For each sub-block, all pixel portions superimposed with color filters are associated with a second merge group, wherein in each sub-block, the positions of the pixel portions associated with the second merge group are arranged in a merge group pattern that is point-symmetrical with respect to the geometric center of the respective sub-block.

Description

Apparatus and method for providing high dynamic range image
Technical Field
The present invention relates to wavelength sensitive detection of radiation. In particular, the invention proposes a radiation detection device and a corresponding method for operating the radiation detection device. The apparatus includes an array of pixels overlaid with a novel color filter array.
Background
Image quality is affected by a number of factors, but sharpness and amount of detail are important parameters of image quality in particular. In addition, the size of noise also affects image quality. These parameters are all affected by the color filter array (color filter array, CFA) mode of the image sensor for capturing the image and subsequent image processing.
The well known bayer pattern has been the most popular CFA pattern in cameras. Recently, the so-called four bayer pattern has been proposed and put into practice. However, the four bayer pattern performs poorly in terms of definition and detail in the full resolution pattern, as compared to the normal bayer pattern. In some devices, the so-called non mode is also used.
The bayer pattern consists of a repetition of the same 2x2 pixel groups of the image sensor, and is superimposed with color filters. These groups include 2 pixels with green filters superimposed, 1 pixel with red filters superimposed and 1 pixel with blue filters superimposed. The inclusion of 2 green pixels is to obtain better sharpness. The use of a green element that is twice as many as the red or blue element helps to mimic the physiology of the human eye.
The four-fold bayer CFA pattern consists of a repetition of 4x4 pixels of an image sensor, and four sets of color filters are superimposed. Each group consists of 2x2, i.e. 4 pixels, wherein all pixels within a group are superimposed with color filters of the same color. The four groups include 8 pixels with green color filters superimposed, 4 pixels with red color filters superimposed, and 4 pixels with blue color filters superimposed.
Pixel binning describes combining information detected by pixels of an image sensor into one group (e.g., combining 4 pixels superimposed with a red color filter into one pixel). Merging pixels according to the four bayer CFA pattern consisting of smaller pixels will produce an effective color detection pattern similar to the normal bayer pattern with larger pixels. However, under very dark conditions, a sensor with larger pixels will produce a brighter image than a sensor of the same size with smaller pixels.
The non bayer CFA pattern consists of a repetition of 6x6 pixels of an image sensor, superimposed with four sets of color filters. Each group consists of 3x3, i.e. 9 pixels, wherein all pixels within a group are superimposed with color filters of the same color. The four groups include 18 pixels with green color filters superimposed, 9 pixels with red color filters superimposed, and 9 pixels with blue color filters superimposed.
The so-called RGBJ (red, green, blue, jade) filters in CFA mode generally produce better color performance than the use of one red, one blue and two green filters in CFA mode.
The use of a radiation detection system comprising two cameras can increase the overall sensitivity of the detection device while also collecting wavelength sensitive information. Thus, pixels in one camera are superimposed by white filters and pixels in the other camera are superimposed by color filters. However, this approach requires registering images from different cameras.
Furthermore, there are separate pixels in some sensors, currently used to improve auto-focus.
Disclosure of Invention
In view of the above, embodiments of the present invention aim to provide an improved CFA mode and an efficient color detection mode, i.e. a merge mode. In particular, it is an object to obtain improved color performance and improved sensitivity without the need for a multi-camera system.
Furthermore, embodiments of the present invention aim to provide a point symmetric CFA and merging mode comprising pixels superimposed with white filters to increase sensitivity while also balancing merging gravity. At the same time, these embodiments aim to balance color channel sensitivity, align the combined outputs, and enable independent adjustment of exposure times for different combinations/groups in the same pixel sub-block of the image sensor. In other words, these embodiments aim to improve color performance and sensitivity without the need for a multi-camera system.
These and other objects are achieved by embodiments of the invention described in the appended independent claims. Advantageous implementations of the embodiments are further defined in the dependent claims.
Specifically, CFA mode and merge mode according to embodiments of the invention combine some or all of the following benefits:
-increasing the sensitivity by using pixels superimposed with white filters;
no phase shift after combining, i.e. the combined gravity forces may be balanced, or the center of gravity of each color channel may be the same and at constant intervals;
color channel sensitivity can be balanced (average white balance compensation gain near 1);
the combined outputs may form a plurality of frames that can be fully aligned;
an easier high dynamic range capture, i.e. using short exposure times and long exposure times for the same color channels in the same image sensor is possible without compromising the benefits of no phase shift after combining.
A first aspect of the invention provides a radiation detection device comprising an array of pixels superimposed with a color filter array, wherein each pixel in the array of pixels comprises one or more pixel portions, each pixel portion being superimposed with one color filter of the color filter array, each color filter being of the red, blue, green or white filter type of the respective color. The pixel array includes one or more pixel blocks, each pixel block superimposed with the same pattern of color filters of the color filter array. Each block comprises at least four sub-blocks of pixels, each of which is superimposed with a filter of the white filter type and a filter of the same respective color, red, blue or green filter type. For each sub-block, all pixel portions superimposed with color filters of the white color filter type are associated with a first merging group; wherein for each sub-block all pixel portions superimposed with color filters of the red, blue or green color filter type are associated with a second merging group; wherein, in each sub-block, the positions of the pixel portions associated with the second merge group are arranged in a merge group pattern that is point-symmetrical with respect to the geometric center of the corresponding sub-block; wherein the merge group pattern is the same in each block; wherein the color filter without color filter or without wavelength selectivity is a color filter of the white color filter type.
From the above, the merging gravity of each merging group can be balanced, since the spatial average of the calculated point-symmetric merging group pattern is equal to the geometric center of the sub-blocks and the merging groups. Furthermore, the white filter type color filter improves the overall sensitivity compared to using only a color filter.
If the discrete size of the pixel portion results in a spatial average that is not perfectly aligned with the geometric center of the sub-block in both dimensions, but is perfectly aligned with the geometric center of the sub-block in only one dimension, the combined weights of the combined group or sub-group may still be considered balanced. For example, if in a sub-block of 3x3 pixels, the center left and center right pixels are located in the second merge group and the remaining pixels are located in the first merge group, the spatial average of the second merge group will be equal to the vertical line through the geometric center of the sub-block, rather than an infinite small point in the geometric center. For balancing of the merging forces, it is beneficial to use only merging groups and/or merging subgroups with corresponding spatial average values that are perfectly aligned with the geometric center of the sub-blocks. For example, if in a sub-block of 3x3 pixels, the corner pixels and center pixels are located in the second merge group, while the remaining pixels are located in the first merge group, the spatial average of the second merge group will be perfectly aligned with the geometric center of the sub-block.
It is worth noting that each sub-block comprises exactly two different color filter types, since each sub-block comprises a first combined set and a second combined set. Furthermore, different combined sub-groups in a sub-block may comprise the same type of color filters, but may also comprise different colors of color filters.
In addition, various sub-block structures may be used. The sub-block may include NxM pixels, where N and M are positive integers. For example, sub-blocks of 1x2, 3x3, 4x4, 2x3, or 3x4 pixels may be used.
In addition, various block structures may be used. One block may include N 'xM' sub-blocks, where N 'and M' are positive integers and the product of N 'and M' is greater than 3. For example, blocks of 3x3, 4x4, 2x3, or 3x4 sub-blocks may be used. In particular, a block including 2x2 sub-blocks may be used. Other block structures where the product of N 'and M' is less than 4 may also be used.
In another implementation form of the first aspect, each block comprises four sub-blocks of the pixel. Two sub-blocks in each pixel block include the green color filter type color filter, one sub-block in each pixel block includes the red color filter type color filter, and one sub-block in each pixel block includes the blue color filter type color filter.
In another implementation form of the first aspect, the sub-blocks in each block are arranged in a grid of 2x2 sub-blocks; the two sub-blocks including the green color filter type color filters are diagonally arranged in the grid.
Accordingly, when each sub-block is associated with a color filter of the sub-block, a bayer pattern of the sub-block may be formed. For example, if each sub-block is combined into one hypothetical pixel, the resulting four hypothetical pixels are superimposed with the corresponding color filters of the corresponding sub-block to form a bayer pattern. If each respective merged combination is merged together, the resulting merged output represents four pixels superimposed with color filters and four pixels superimposed with white filters, wherein the four pixels superimposed with color filters form a bayer pattern. Thus, even though the underlying CFA patterns may have different or more complex patterns, the data may be processed using a standard bayer demosaicing algorithm.
In another implementation form of the first aspect, the upper left sub-block comprises a color filter of a green color filter type of the first color; the lower right sub-block includes a color filter of a green color filter type of the second color; the upper right sub-block includes a red filter type of color filter; the lower left sub-block includes a color filter of the blue filter type of color.
Thus, the above-mentioned position is relative to the geometric center of the block comprising the grid of 2x2 sub-blocks. Two sub-blocks are located in the upper half of the block and two sub-blocks are located in the lower half of the block. Also, two sub-blocks are located in the left half of the block and two sub-blocks are located in the right half of the block.
Similar block modes, i.e. merge group mode, merge subgroup mode and CFA mode, may also be used, e.g. rotated or flipped versions of the above modes.
In another implementation form of the first aspect, each second merging group comprises one merging sub-group or each second merging group comprises two merging sub-groups; wherein, in each sub-block, the positions of the pixel portions associated with each merging sub-group are arranged in a merging sub-group pattern that is point-symmetrical with respect to the geometric center of the corresponding sub-block; wherein the merge subgroup pattern is the same in each block.
Thus, the combined gravity of each combined group and each combined sub-group is balanced. In other words, all merging modes, i.e. all merging group modes and merging sub-group modes, are point symmetric with respect to the geometric center of the corresponding sub-block.
In another implementation form of the first aspect, each merging sub-group in each sub-block in a block corresponds to one merging sub-group in each other sub-block in the same block, and each first merging group in a sub-block corresponds to a first merging group in each other sub-block in the same block; wherein, all the first merging groups and merging sub-groups corresponding to each other are grouped into corresponding merging frames for processing.
In another implementation form of the first aspect, the apparatus comprises a processor for jointly processing each of the merged frames.
Thus, for each block there is one merge frame for the first merge group and one or more merge frames equal to the number of merge subgroups in each sub-block. Each merged frame may consist of a merged output/merged sub/group equal to the number of sub-blocks in a block. For example, if a block includes four sub-blocks forming a grid of 2x2 sub-blocks, the merged frame consists of 2x2 merged outputs, and the merged frames associated with the merged sub-groups may be processed with a standard bayer demosaicing algorithm, even though the underlying CFA pattern may have a different or more complex pattern. In other words, the merged frames may be perfectly aligned by the bayer demosaicing algorithm.
In another implementation form of the first aspect, each combining sub-group corresponds to radiation of a wavelength range that depends on a color filter passband of a color filter type that superimposes colors of pixel portions of the respective combining sub-group.
For example, an orange filter of the red filter type typically has a passband in the wavelength range 590-625 nm. The combined subgroup superimposed with an orange filter of this red filter type corresponds correspondingly to radiation in the wavelength range 590-625 nm.
In another implementation form of the first aspect, in each sub-block of the block, the total sensitivity to radiation of the first respective corresponding wavelength range of the merged sub-group is approximately equal to the total sensitivity to radiation of the second respective corresponding wavelength range of each respective corresponding merged sub-group in other sub-blocks of the block.
Thus, the total sensitivity of each respective corresponding wavelength range of each combined output in the same combined frame is approximately equal. Thus, each combined output of the same combined frame may be compared equally, even though each combined output may correspond to a different wavelength range. Thus, the color channel sensitivity is balanced. However, the combined group superimposed with the white color filter may have a different overall sensitivity than the corresponding first combined group in the same block. This is not important because these first merged groups only pass intensity information, but not wavelength information.
In another implementation form of the first aspect, the total sensitivity of the combined subgroup superimposed with the color filters of the color filter type to radiation of the respective wavelength range is the product of: sensitivity to radiation of a corresponding wavelength range of the color filters of the color filter type superimposed with the pixel portions of the merged subgroup, and a combined effective surface area of the pixel portions of the merged subgroup.
Thus, the total sensitivity of the combined subgroup describes the total power detected by the combined subgroup relative to the total incident power of the respective wavelength range. Assuming equal intensities and wavelengths of the incident radiation across the combined sub-group, the overall sensitivity increases linearly with increasing effective surface area of the pixel portion. Furthermore, the overall sensitivity is linearly dependent on the amount of radiation of the respective wavelength range transmitted by each color filter. It is noted that all the color filters in each of the combining groups and the combining sub-groups have the same color and type.
In another implementation form of the first aspect, each merged subgroup and the pixel portion of each first merged subgroup in each sub-block of the block is for collecting radiation having a different first exposure time than the other merged subgroups and/or the further first merged groups in the respective sub-blocks, wherein each respective corresponding merged subgroup and the pixel portion of each respective corresponding first merged group in the other sub-blocks of the block is for collecting radiation having the same first exposure time.
For example, in a sub-block of the block, a first combined set may collect radiation having a first exposure time, a first combined subset may collect radiation having a second exposure time, and a second combined subset may collect radiation having a third exposure time. Thus, the first combined set, the first combined subset and the second combined subset in the other sub-blocks of the block may collect radiation having the respective same first, second and third exposure times. Thus, the three combined frames of a block may each be based on a different exposure time. Thus, different exposure times may be used while still having aligned merged frames. In particular, the combined set superimposed with the white color filter may use different exposure times, as its overall sensitivity is typically greater.
In another implementation form of the first aspect, at least one merge group forms a disjoint cross pattern in each block.
In another implementation form of the first aspect, in each sub-block, the pixel array comprising all pixel portions in the respective sub-block has a rectangular shape.
In another implementation form of the first aspect, at least one of the blocks comprises a smaller surface area of the pixel portion superimposed with the white color filter than another of the sub-blocks.
Thus, at least one sub-block includes different merge groups and merge group modes than other sub-blocks in the same block.
In another implementation form of the first aspect, each pixel portion is half the size or the same size of a pixel in the pixel array.
Thus, two half-pixels of the same pixel may be grouped into different merge groups and merge subgroups. Thus, flexibility in adjusting the effective surface area in the merge group and the merge subgroup is increased. Thus, channel sensitivity can be more accurately balanced.
In another implementation form of the first aspect, each block comprises a pixel array of 9x9 pixels, the pixel array comprising four sub-blocks, each sub-block comprising a pixel array of 3x3 pixels.
In another implementation form of the first aspect, the upper left sub-block includes: a first merge subset comprising top center and bottom center pixels; a second merge subset including a right half of the center left pixel and a left half of the center right pixel. The lower right sub-block includes: a first merge subset comprising top center and bottom center pixels; a second merge subgroup comprising a center left pixel and a center right pixel. The lower left sub-block includes: a first merge subset comprising corner pixels; a second merge subset, including the center pixel. The upper right sub-block includes: a first merge subset comprising corner pixels; a second merge subset, including the center pixel. The remaining pixel portions in each sub-block are separately grouped into a first merge group.
Similar implementations may be used. For example, each pixel portion has an implementation of the same size as the pixel, wherein the upper left sub-block second merge sub-group includes a center left pixel and a center right pixel. As another example, a corresponding implementation may be used in which each second merge group consists of only one merge subgroup. As another example, a corresponding rotated or flipped version of the implementation may be used.
In another implementation form of the first aspect, in each block, all first merging sub-groups correspond to each other, all second merging sub-groups correspond to each other, and all first merging sub-groups correspond to each other.
In another implementation form of the first aspect, the apparatus comprises a processor or an analog merge module for merging together pixel portions of a same merge group and/or merge sub-group.
If the merged frames represent a bayer pattern, a bayer demosaicing algorithm may be applied to process some of the merged frames. Therefore, the color of the color filter overlapping the corresponding combination sub/group is regarded as the color of the combination output. For example, if four merged outputs of the four merged sub/groups form a merged frame, the merged frame may form a bayer pattern according to the color of each merged output.
In one implementation form of the first aspect, each of the red, green and blue filter types is a filter type of a respective color comprising a respective red, green or blue color component having a largest magnitude compared to the other color components; wherein each color filter type of the corresponding color comprising two components of the same maximum magnitude is a color filter type of one of the two components arranged in descending order according to the following hierarchical structure: red, blue, green, red.
Colors may be defined according to an RGB color model, wherein three color components of red, green and blue are combined with corresponding magnitudes to form a color. For example, the color of an orange filter approximately includes color components of 75% red in magnitude, 25% green in magnitude, and 0% blue in magnitude. Thus, in this case, the color filter is of the orange red color filter type, since the component with the largest magnitude is the red component. In another example, the color of the yellow filter approximately includes color components of 50% in magnitude for red, 50% in magnitude for green, and 0% in magnitude for blue. Thus, the color filter is a yellow, green color filter type, since the components with the largest magnitudes are the red and green components, the hierarchical structure listed above defines that the green component is prioritized in this case. In the case where the magnitudes of all three color components are approximately the same, the color filter is of the white filter type, since the resulting color filter is substantially wavelength-selective.
For red, green and blue color components, the wavelengths of the color components may be approximately in the range of 625-700nm, 500-565nm and 450-485nm, respectively. Typical examples of wavelengths of the color components are 650nm, 550nm and 450nm for red, green and blue color components, respectively. Other reddish, greenish and bluish colors may also be suitable candidates for the color component.
A second aspect of the invention provides a method for operating a radiation detection device, characterized in that the device comprises an array of pixels superimposed with a color filter array, wherein each pixel in the array of pixels comprises one or more pixel portions, each pixel portion being superimposed with one color filter of the color filter array, each color filter being of the red, blue, green or white color filter type of the respective color. The pixel array includes one or more pixel blocks, each pixel block superimposed with the same pattern of color filters of the color filter array. Each block comprises four sub-blocks of pixels, each sub-block of pixels being superimposed with a filter of the white filter type and a filter of the same respective color red, blue or green filter type. The method comprises the following steps: for each sub-block, associating with a first merging group all pixel portions superimposed with filters of said white filter type; for each sub-block, associating with a second merging group all pixel portions superimposed with color filters of said red, blue or green color filter type; wherein, in each sub-block, the positions of the pixel portions associated with the second merge group are arranged in a merge group pattern that is point-symmetrical with respect to the geometric center of the corresponding sub-block; wherein the merge group pattern is the same in each block; wherein the color filter without color filter or without wavelength selectivity is a color filter of the white color filter type.
In another implementation form of the second aspect, each block comprises four sub-blocks of the pixel. Two sub-blocks in each pixel block include the green color filter type color filter, one sub-block in each pixel block includes the red color filter type color filter, and one sub-block in each pixel block includes the blue color filter type color filter.
In another implementation form of the second aspect, the sub-blocks in each block are arranged in a grid of 2x2 sub-blocks; the two sub-blocks including the green color filter type color filters are diagonally arranged in the grid.
In another implementation form of the second aspect, the upper left sub-block comprises a color filter of a green color filter type of the first color; the lower right sub-block includes a color filter of a green color filter type of the second color; the upper right sub-block includes a red filter type of color filter; the lower left sub-block includes a color filter of the blue filter type of color.
In another implementation form of the second aspect, the method comprises: dividing each second merging group into one merging sub-group or dividing each second merging group into two merging sub-groups; wherein, in each sub-block, the positions of the pixel portions associated with each merging sub-group are arranged in a merging sub-group pattern that is point-symmetrical with respect to the geometric center of the corresponding sub-block; wherein the merge subgroup pattern is the same in each block.
In another implementation form of the second aspect, each merging sub-group of each sub-block in a block is arranged to correspond to one merging sub-group of each other sub-block in the same block, and each first merging group of sub-blocks is arranged to correspond to a first merging group of each other sub-block in the same block; wherein, all the first merging groups and merging sub-groups corresponding to each other are grouped into corresponding merging frames for processing.
In another implementation form of the second aspect, the apparatus comprises a processor, the method comprising jointly processing each of the merged frames.
In another implementation form of the second aspect, each of the merging sub-groups is arranged to correspond to radiation of a wavelength range that depends on a color filter passband of a color filter type that superimposes colors of the pixel portions of the corresponding merging sub-group.
In another implementation form of the second aspect, in each sub-block of the block, the total sensitivity to radiation of the first respective corresponding wavelength range of the merged sub-group is approximately equal to the total sensitivity to radiation of the second respective corresponding wavelength range of each respective corresponding merged sub-group in the other sub-blocks of the block.
In another implementation form of the second aspect, the total sensitivity of the combined subgroup superimposed with the color filters of the color filter type to radiation of the respective wavelength range is the product of: sensitivity to radiation of a corresponding wavelength range of the color filters of the color filter type superimposed with the pixel portions of the merged subgroup, and a combined effective surface area of the pixel portions of the merged subgroup.
In another implementation form of the second aspect, each merged subgroup and the pixel portion of each first merged subgroup in each sub-block of the block are used for collecting radiation having a different first exposure time than the other merged subgroups and/or the further first merged groups in the respective sub-blocks, wherein each respective corresponding merged subgroup and the pixel portion of each respective corresponding first merged group in the other sub-blocks of the block are used for collecting radiation having the same first exposure time.
In another implementation form of the second aspect, at least one merge group forms a disjoint cross pattern in each block.
In another implementation form of the second aspect, in each sub-block, the pixel array comprising all pixel portions in the respective sub-block has a rectangular shape.
In another implementation form of the second aspect, at least one of the blocks comprises a smaller surface area of the pixel portion superimposed with the white color filter than another of the sub-blocks.
In another implementation form of the second aspect, each pixel portion is half the size or the same size of a pixel in the pixel array.
In another implementation form of the second aspect, each block comprises a pixel array of 9x9 pixels, the pixel array comprising four sub-blocks, each sub-block comprising a pixel array of 3x3 pixels.
In another implementation form of the second aspect, the upper left sub-block includes: a first merge subset comprising top center and bottom center pixels; a second merge subset including a right half of the center left pixel and a left half of the center right pixel. The lower right sub-block includes: a first merge subset comprising top center and bottom center pixels; a second merge subgroup comprising a center left pixel and a center right pixel. The lower left sub-block includes: a first merge subset comprising corner pixels; a second merge subset, including the center pixel. The upper right sub-block includes: a first merge subset comprising corner pixels; a second merge subset, including the center pixel. The remaining pixel portions in each sub-block are separately grouped into a first merge group.
In another implementation form of the second aspect, in each block, all the first merging sub-groups are set to correspond to each other, all the second merging sub-groups are set to correspond to each other, and all the first merging sub-groups are set to correspond to each other.
In another implementation form of the second aspect, the apparatus comprises a processor or an analog merge module, the method comprising merging together pixel portions of the same merge group and/or merge sub-group.
In one implementation form of the second aspect, each of the red, green and blue filter types is a filter type of a respective color comprising a respective red, green or blue color component having a maximum magnitude compared to the other color components; wherein each color filter type of the corresponding color comprising two components of the same maximum magnitude is a color filter type of one of the two components arranged in descending order according to the following hierarchical structure: red, blue, green, red.
The method according to the second aspect and its implementation forms achieves the same advantages and effects as the device according to the first aspect and its corresponding implementation forms.
It should be noted that all the devices, elements, units and means described in the present invention may be implemented in software or hardware elements or any type of combination thereof. All steps performed by the various entities described in the present invention and functions to be performed by the various entities described are intended to mean that the respective entities are adapted to or for performing the respective steps and functions. Although in the following description of specific embodiments, specific functions or steps performed by external entities are not reflected in the description of specific detailed elements of the entity performing the specific steps or functions, it should be clear to a skilled person that these methods and functions may be implemented by corresponding hardware or software elements or any combination thereof.
Drawings
The various aspects described above and the manner of attaining them will be elucidated with reference to the accompanying drawings, wherein:
FIG. 1 illustrates an apparatus according to one example of the invention;
FIG. 2 (a) illustrates an exemplary pixel block including four sub-blocks according to one example of the invention;
FIG. 2 (b) shows a sub-block comprising two merge groups and two merge subgroups according to one example of the invention;
FIG. 3 (a) shows three color components according to one example of the invention;
fig. 3 (b) shows six different exemplary colors of color filters according to one example of the invention, and to which color filter type the corresponding color filter will belong;
FIG. 4 (a) shows an exemplary pixel block including a half-pixel sized pixel portion and two merged subgroups in accordance with an example of the present invention;
fig. 4 (b) shows a corresponding merged frame according to one example of the present invention;
FIG. 5 illustrates an exemplary pixel array including a plurality of pixel blocks and an exemplary CFA mode according to an example of the present invention;
FIG. 6 (a) shows an exemplary pixel block including two merged groups in each sub-block according to one example of the invention;
Fig. 6 (b) shows a corresponding merged frame according to one example of the present invention;
FIG. 7 (a) shows an exemplary pixel block including two merged subgroups in each sub-block according to an example of the present invention;
fig. 7 (b) shows a corresponding merged frame according to one example of the present invention;
FIG. 8 (a) shows an exemplary pixel block including two merged subgroups in each sub-block according to an example of the present invention;
fig. 8 (b) shows a corresponding merged frame according to one example of the present invention;
FIG. 9 (a) illustrates an exemplary pixel block including one merged subgroup in each sub-block according to one example of the present invention;
fig. 9 (b) shows a corresponding merged frame according to one example of the present invention;
FIG. 10 illustrates a plurality of exemplary pixel blocks with respective exemplary CFA modes and merge modes according to an example of the present invention;
FIG. 11 illustrates a plurality of exemplary pixel blocks with respective exemplary CFA modes and merge modes according to an example of the present invention;
FIG. 12 illustrates an apparatus according to one example of the invention;
FIG. 13 illustrates an apparatus according to one example of the invention;
Fig. 14 illustrates a method according to one example of the invention.
Detailed Description
Fig. 1 shows a radiation detection apparatus 100 according to an embodiment of the invention. The device 100 comprises a pixel array 101 (an exemplary pixel array is shown here), the pixel array 101 comprising at least one pixel block 108 (an exemplary pixel block 108 is shown). Pixels 103 of pixel array 101 are superimposed with CFA102 (an exemplary CFA102 is shown), where CFA102 includes a plurality of different color filters 105. Specifically, each pixel 103 includes one or more pixel portions 104, wherein each pixel portion 104 is superimposed with one color filter 105 of the CFA 102. Each color filter 105 is a red 106a, blue 106b, green 106c or white 106d color filter type 106 of the respective color 107.
At least a portion of the incident radiation power may be attenuated by CFA102, CFA102 being located on top of pixel 103 of pixel array 101 such that it is located between the incident radiation and pixel 103. The pixels 103 of the pixel array 101 detect the (remaining) radiation transmitted through the CFA 102. Since the color filters of CFA102 can attenuate radiation according to the wavelength of the radiation, device 100 can collect wavelength sensitive intensity information of the incident radiation.
In general, each block 108 of pixel array 101 comprises at least four sub-blocks 109 of pixels 103, each sub-block of pixels 103 being superimposed with a filter 105 of white filter type 109d and a filter of the same respective color 107 of red 106a, blue 106b or green 106c filter type 106. For each sub-block 109a, 109b, 109c, 109d, all pixel portions 104 superimposed with the color filters 105 of the white color filter type 106d are associated with a first merge group 110. For each sub-block 109a, 109b, 109c, 109d, all pixel portions 104 superimposed with color filters of the red, blue or green color filter types 106a, 106b, 106c are associated with a second merge group 111. In each sub-block 109a, 109b, 109c, 109d, the positions of the pixel portions 104 associated with the second merge group 111 are arranged in a merge group pattern 112 point-symmetrical with respect to the geometric center 121 of the respective sub-block 109a, 109b, 109c, 109 d.
Fig. 2 (a) shows an exemplary block 108 of pixels 103 according to an embodiment of the invention. Block 108 includes four sub-blocks 109, each sub-block 109 including 3x3 pixels 103. The pixel block 108 includes a pixel portion 104 having the same size as the pixel 103 and a pixel portion 104 having half the size of the pixel 103. The pixel array 101 may include pixel portions 104 of various sizes, such as one third or one fourth of the pixels 103. The size of the pixel portion 104 cannot be larger than the size of the pixel 103. The split pixels 104 in the upper left sub-block 109d may be implemented using a dual PD (photodiode) structure. It is known that there are separate pixels in the current sensor, but currently only for auto-focusing, not for balancing channel sensitivity.
Each pixel portion 104 is superimposed with a color filter 105. The device 100 may include four types 106 of color filters: a white 106d type, a green 106c type, a red 106a type, and a blue 106b type. All color filters 105 in the same sub-block 109 of the same type 106 have the same color 107. The color filters 105 of the same type 106 but located in different sub-blocks 109 may or may not have different colors 107. The exemplary block 108 in fig. 2 comprises two sub-blocks 109, each sub-block 109 comprising a color filter of the green color filter type 106 c. The upper left sub-block 109d includes a green filter 107d of the green filter type 106c, and the lower right sub-block 109c includes a jade filter 107c of the green filter type 106 c. Block 108 also includes an upper right sub-block 109a that includes a red filter 107a of red filter type 106 a. Block 108 also includes a lower left sub-block 109b that includes blue color filter 107b of blue color filter type 106 b. All four sub-blocks 109 comprise white filters of the white filter type 106 d.
Fig. 2 (b) shows an upper right sub-block 109a of the exemplary block 108 of fig. 2 (a). The geometric center 121 of the sub-block 109 is located at the center of the center pixel 103. The differently shaped sub-blocks 109, e.g. sub-blocks 109 of 2x2 pixels 103, may have a geometric center 121 of the sub-block 109 between the pixels 103.
Fig. 3 (a) shows three color components 113a, 113b, 113c according to an embodiment of the invention. The three color components may be red 113a, green 113b, and blue 113c. The colors and color components are defined with reference to the RGB (red, green, blue) color model, wherein the components 113 are combined into a color 107 according to their respective magnitudes. For example, the yellow color includes a red color component 113a of 50% in magnitude, a green color component 113c of 50% in magnitude, and a blue color component 113b of 0% in magnitude. If the red color component 113a has the largest magnitude compared to the blue 113b and green 113c color components, the filter of color 107 is, for example, a red filter type 106a. Thus, the color filter 105 has a type 106 and a color 107, wherein the type 106 is different from the color 107. For example, there may be a color filter 105 of a green color filter type 106c of a jade color 107c and a color filter 105 of a green color filter type 106c of a green color 107 d.
The exemplary colors 107a, 107b, 107d depicted in fig. 3 (a) include a red color component 113a of 100% in magnitude, a blue color component 113b of 100% in magnitude, and a green color component 113c of 100% in magnitude, respectively, and are therefore identical to the colors 107 of the respective color components 113a, 113b, 113c. In contrast, the colors 107c and 107e depicted in fig. 3 (b) include a mixture of a plurality of color components 113. It is noted that the color filters 105 of colors 107d and 107c have the same color filter type 106c, and the color filters 105 of colors 107a and 107e have the same color filter type 106a.
For example, if the red 113a and green 113c components are combined into the color 107 of the color filter 105 at the same magnitude, a hierarchy may be used to specify which color filters 105 are of which type. Since the yellow color 107 includes red 113a and green 113c color components having the same magnitude, it will be blurred if the color filter 105 of the yellow color 107 is considered as a green 106c or red 106a color filter type. For example, arranged in descending order according to the hierarchy: red 113a, blue 113b, green 113c, red 113a, yellow filter 105 will have a green filter type 106c, since green 113c is directly to the left of red 113a in the hierarchy. Furthermore, the color filters 105 of the magenta (50% r and 50% b) color 107 will have a red filter type 106a, since the red 113a is directly to the left of the blue 113b in the hierarchy.
Fig. 3 (b) shows six different exemplary colors 107 of the color filters 105, and what the corresponding color filter 105 will be of the color filter type 106. The color filter 105 of the white filter type 106d may be a color filter 105 without wavelength selectivity. Specifically, the absence of the color filter 105 is considered to be the color filter 105 using the white color filter type 106d, since there will be no wavelength selective attenuation.
Fig. 4 (a) shows the same exemplary pixel block 108 as fig. 2 (a). Fig. 4 (a) further outlines the merge groups 110, 111 and merge sub-group 114. In each sub-block 109, all pixel portions 104 superimposed with color filters 105 of the same type 106 are grouped into the same respective merging group 110, 111. In each sub-block 109, all pixel portions 104 superimposed with the color filters 105 of the white color filter type 106d are grouped into a first merging group 110. In each sub-block 109, all pixel portions 104 superimposed with the color filters 105 of the red 106a, green 106c or blue 106b color filter types are grouped into respective second combination groups 111. Each second merge group 111 may or may not be further divided into merge subgroups 114. There may be one or more merge subsets 119, 120 in each sub-block 109. The exemplary block in fig. 4 (a) includes a first merge subgroup 110, a first merge subgroup 119, and a second merge subgroup 120. Thereby, the second combining group 111 is divided into a first combining sub-group 119 and a second combining sub-group 120.
It is noted that the pixel portions 104 located in different sub-blocks 109 are typically not in the same merge group 110, 111. Each merge group 110, 111 and each merge sub-group 114 typically includes only pixels 103 of a single sub-block 109. However, all first merging groups 110, all first merging sub-groups 119, and all second merging sub-groups 120 correspond to respective other first merging groups 110, first merging sub-groups 119, and second merging sub-groups 120 of other sub-blocks. If block 108 includes more or fewer merge subsets 114, the correspondence is adjusted accordingly.
The corresponding merge groups 110, 111 and/or merge sub-groups 114 may be grouped into merge frames 118. As each pixel portion 104 is merged according to its merge group 110, 111 or merge subgroup 114, the merge frame 118 represents a merge output 122. Each of the combined outputs 122 may be grouped with other corresponding combined outputs 122, and thus may form a combined frame 118.
The exemplary block 108 depicted in fig. 4 (a) may be merged into the three merged frames 118a, 118b, 118c depicted in fig. 4 (b), because each sub-block 109a, 109b, 109c, 109d comprises three merged sub-groups together, namely one first merged group 110, one first merged sub-group 119, and one second merged sub-group 120. Since block 108 includes four sub-blocks 109, each of the merged frames 118a, 118b, 118c includes four merged outputs 122. Thus, the twelve combined outputs 122 of block 108 form three combined frames 118a, 118b, 118c, each comprising four combined outputs 122, wherein each combined output 122 represents a first combined group 110 or combined subgroup 119, 120. Two of the merged frames 118a, 118b form a bayer pattern from the color filters 105 superimposed with the pixel portions 104 of the respective merged sub/groups 110, 111, 114. Since the merged frame 118 represents a bayer pattern, a standard bayer demosaicing algorithm may be used to process the plurality of merged frames 118 into a color image. It is noted that the combined frame 118 comprising the combined output 122 of all the first combined groups 110a, 110b, 110c, 110d does not represent a bayer pattern, because the pixel portion 104 of each first combined group 110a, 110b, 110c, 110d is superimposed with the color filter 105 of the white filter type 106 d. Different implementations of the device 100 may include different exemplary blocks 108, the blocks 108 including different numbers of merged frames 108 and merged outputs 122, depending on the number of sub-blocks 109 and the merged sub/groups 110, 111, 114 of blocks.
Fig. 4 (b) shows a merged frame 118 corresponding to the exemplary pixel block 108 shown in fig. 4 (a).
Fig. 5 illustrates an exemplary pixel array 101 including a plurality of blocks 108 of pixels 103 and an exemplary CFA102 pattern according to an embodiment of the invention. Pixel array 101 may include one or more pixel blocks 108, where each pixel block 108 is identical to each other pixel block 108 in the same pixel array 101 in terms of CFA102 mode, merge group mode 112, and merge subgroup mode 115. Different implementations of the device 100 may include pixel blocks 108 of different CFA102 modes, merge group modes 112, and merge subgroup modes 115. However, the pixel blocks 108 of the same pixel array 101 are identical. A plurality of candidate pixel blocks 108 for such alternative implementations are depicted in fig. 10, according to an embodiment of the invention. Notably, fig. 5 shows an exemplary pixel array 101 comprising four pixel blocks 108, wherein each pixel block 108 is a pixel block 108 as shown in fig. 4 (a).
Fig. 6 (a) shows an exemplary pixel block 108 comprising two merged groups 110, 111 according to an embodiment of the invention. Block 108 includes four sub-blocks 109, each sub-block 109 including 3x3 pixels 103 similar to those in the non pixel array. The CFA102 mode includes a filter 105 of a white filter type 106d and a filter 105 of the respective red 107a, blue 107b, green 107d and jade 107c colors. The two sub-blocks 109 comprise color filters 105 of a green color filter type 106c of the respective green 107d and jade 107c colors. In general, the CFA102 mode of the color filter 105 comprising two different colors 107 of the green color filter type 106c achieves better color performance. However, a simplified version comprising two sub-blocks 109 may be used, said sub-blocks 109 comprising color filters 105 of a green color filter type 106c having the same color 107 d. The other two sub-blocks comprise red 107a and blue 107b filters 105 of the red 106a and blue 106b filter type, respectively. All four sub-blocks 109 further comprise a color filter 105 of the white filter type 106 d.
Each sub-block 109 includes a first merge group 110 and a second merge group 111. Thus, the block comprises four first merging groups 110a, 110b, 110c, 110d and four second merging groups 111a, 111b, 111c, 111d, wherein each first merging group 110 corresponds to each other and each second merging group 111 corresponds to each other. Each first merging group 110 comprises pixels 103 superimposed with the color filters 105 of the white color filter type 106d of the respective sub-block 109, and each second merging group 111 comprises pixels 103 superimposed with the color filters 105 of the other color filter types 106a, 106b, 106c of the respective sub-block 109. Therefore, all the pixel portions 104 superimposed with the color filters 105 of the different colors 107 are individually combined.
The second merge group 120 in each sub-block forms a non-intersecting cross-merge group pattern 112, including a center pixel 103 and corner pixels 103. The first merge group 110 in each sub-block 109 forms a disjoint cross-merge group pattern 112 in each sub-block 109, comprising the remaining pixels 103. Thus, the merging gravity of each merging group 110, 111 is balanced, because the merging group pattern 112 is point symmetric with respect to the geometric center 121 of the corresponding sub-block 109. In other words, the center point of each merge group 110, 111 is located in the geometric center 121 of the corresponding sub-block 109. Thus, the combined gravity/phase shift is optimal.
Since the plurality of pixels 103 are superimposed with the color filter 105 of the white color filter type 106d, the sensitivity of the block 108 to radiation can be increased compared to the prior art. The color filter 105 of the white filter type 106d attenuates less radiation because it transmits radiation of all wavelengths approximately equally. The channel sensitivity of the block 108 may or may not be balanced. In particular, it may be unbalanced in that the color filters 105 of different colors 107 attenuate the radiation of the respective corresponding wavelength ranges by different amounts. For example, the green 107d color filter 105 generally attenuates green 107d radiation less than blue 107b color filter 105 attenuates blue 107b radiation. Further, the pixels 103 of the first merge group 110 may have a different exposure time than the pixels 103 of the second merge group 111.
Fig. 6 (b) shows a corresponding merged frame 118 according to the exemplary pixel block 108 shown in fig. 6 (a). Since there are a total of two merge groups 110, 111 and zero/one merge subgroup 114 in each sub-block 109, the pixel 103 may be merged into two merge frames 118, with the bottom merge frame 118a representing the bayer pattern and the top merge frame 118c not including color information.
Fig. 7 (a) shows an exemplary block 108 of pixels 103 according to an embodiment of the invention, which comprises two merged sub-groups 119, 120 in each sub-block 109. Block 108 is identical to block 108 shown in fig. 6 (a), except that each second merging group 111 is divided into two merging sub-groups 119, 120, wherein each first merging sub-group 119 comprises a center pixel 103 and each second merging sub-group 120 comprises a corner pixel 103, respectively. Furthermore, the pixels 103 of the two combined sub-groups 119, 120 may collect radiation with different exposure times. For example, all pixels 103 of the first binning sub-group 119 may collect radiation having a first short exposure time and all pixels 103 of the second binning sub-group 120 may collect radiation having a second long exposure time. Furthermore, all pixels 103 of the first combined set 110 may collect radiation having a different third exposure time.
Fig. 7 (b) shows a corresponding merged frame 118 of the exemplary pixel block 108 shown in fig. 7 (a). Since there are a total of three merged sub-groups per sub-block 109, namely one first merged group 110, one first merged sub-group 119 and one second merged sub-group 120, the pixel 103 may be merged into three merged frames 118a, 118b, 118c, wherein two merged frames 118a, 118b comprise color information. Since the pixels 103 of the two merged sub-groups 119, 120 may collect radiation with different exposure times, the two merged frames 118a, 118b comprising color information may represent different exposure times. Thus, for the same color channel, there may be a short exposure time and a long exposure time in the same sensor, making high dynamic range capture easier.
Fig. 8 (a) shows an exemplary pixel block 108 comprising two merged subgroups 119, 120 in each sub-block 109, according to an embodiment of the invention. Block 108 is the same as block 108 shown in fig. 7 (a), except for the CFA102 mode of two sub-blocks 109c, 109d of color filter 105 (i.e., an upper left 109d sub-block and a lower right 109c sub-block) that include a green color filter type 106 c. The center and corner pixels 103 are superimposed with the color filters 105 of the white color filter type 106d, and the remaining pixels 105 are superimposed with the color filters 105 of the green color filter type 106c of the corresponding sub-block 109. Thus, the two sub-blocks 109c, 109d comprise four pixels 105 superimposed with color filters 106a, 106b, 106c, wherein each of the other sub-blocks 109a, 109b in block 108 comprises five pixels 105 superimposed with color 106a, 106b, 106c filters 105.
To obtain the best channel balance, the color channel sensitivity (assuming a typical light source) is the same after combining. The channel sensitivity of the block 108 shown in fig. 8 (a) may or may not be balanced. In particular, it may be balanced in that the color filter 105 of the green color filter type 106c generally attenuates radiation of the respective wavelength range less than the color filters 105 of the other color filter types 106a, 106 b. In each of the two sub-blocks 109c, 109d, fewer pixels 103 are superimposed with the color filters 105 of the green color filter type 106 c. Thus, the effective surface area of the radiation-collecting pixel 103 is reduced and the overall sensitivity to radiation of the corresponding wavelength range of each of the two sub-blocks 109c, 109d is reduced. Thus, the total sensitivity of the radiation of the respective corresponding wavelength ranges of the two sub-blocks 109c, 109d may be more equal to the total sensitivity of the radiation of the respective corresponding wavelength ranges of the other sub-blocks 109a, 109b, i.e. the color channel sensitivity may be kept balanced.
Fig. 8 (b) shows a corresponding merged frame 118 according to the exemplary pixel block 108 shown in fig. 8 (a).
However, the number of full pixels 103 superimposed with color filters 105 in the corresponding 3x3 pixel 103 sub-block 109, 106a, 106b, 106c, is as follows: red=5, green=3, blue=5, and jade=4, then it can be calculated that the channel sensitivities will be balanced or very similar. Two CFA 102 modes supporting this are shown in fig. 2 (a) and 9 (a).
Fig. 9 (a) shows an exemplary pixel block 108 including one merge subgroup 119, according to an embodiment of the present invention. The block 108 is identical to the block 108 shown in fig. 8 (a) except for the CFA pattern in the upper left sub-block 109d, and each sub-block 109 includes only one merge sub-group 119. In the upper left sub-block 109d, the center right, center, and center left pixels 103 are superimposed with the color filters 105 of the green color filter type 106c, and the remaining pixels 105 are superimposed with the color filters 105 of the white color filter type 106 d. Thus, the CFA 102 mode and the combined sub/group mode 112, 115 are point symmetric, while the channel sensitivity is balanced according to the above requirements, since only three total pixels 103 in total are superimposed with the green 107d color filter 105.
The pixel block 108 shown in fig. 2 (a), 4, and 5 includes four half pixels 104 in the upper left sub-block 109 d. The block 108 is the same as the block 108 shown in fig. 8 (a), except that in the upper left sub-block 109d, the center left pixel and the center right pixel 103 are replaced with two half pixels 104, respectively. The right half 104 of the center left pixel 103 and the left half 104 of the center right pixel 103 are superimposed with the color filter 105 of the green color filter type 106c, and the other two halves 104 are superimposed with the color filter 105 of the white color filter type 106 d. Thus, the CFA 102 mode and the combined sub/group mode 112, 115 are point symmetric, while the channel sensitivity is balanced according to the above requirements, since only three total pixels 103 in total are superimposed with the green 107d color filter 105.
Fig. 10 and 11 illustrate a plurality of exemplary blocks 108 of pixels 103 having respective exemplary CFA 102 modes and merge modes 123 in accordance with an embodiment of the invention. Exemplary block 108 of pixels 103 illustrates some of the CFA 102 pattern, merge group pattern 112, merge subgroup pattern 115, pixel portion 104, pixel sub-block 109, number of pixels 103, and number of pixel sub-blocks 109 that may be used in block 109 of pixel array 101 of device 100. A combination of some of the features of the different exemplary blocks 108 may be used. For example, according to an embodiment of the invention, the color 107 of one exemplary block 108 may be combined with the CFA 102 pattern, the merge group 112, and/or the merge subgroup pattern 115 of another exemplary block 108 to represent another pixel block 108. Further, variations of the exemplary pixel block 108 according to embodiments of the invention may be used.
The device 100 may comprise a processor 200 as shown in fig. 12 or an analog merge module 201 as shown in fig. 13 for merging together the pixel portions 104 of the same merge group 110, 111 or merge sub-group 114. The pixel portions 104 may be combined together in a digital or analog manner. In particular, analog binning may include adding the collected charge of the pixel portion 103 to the same binning sub-groups 110, 111, 114.
The apparatus 100 may also include a processor 300 as shown in fig. 12 and 13 for jointly processing each of the merged frames 118. A color image representing the incident radiation may be created by processing the combined frame 118 of one or more blocks 108, as the information contained in the combined frame 118 depends on the wavelength and intensity of the incident radiation.
In general, processors 200 and/or 300 may be used to perform, conduct, or initiate various operations of device 100 described herein. The processors 200, 300 may include hardware and/or may be controlled by software. The hardware may include analog circuits or digital circuits, or both analog and digital circuits. The digital circuitry may include components such as application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), digital signal processors (digital signal processor, DSP), or multi-purpose processors. The device 100 may also include memory circuitry that stores one or more instructions executable by the processors 200, 300, particularly under the control of software. For example, the memory circuit may include a non-transitory storage medium storing executable software code that, when executed by the processors 200, 300, results in performing various operations of the device 100. In one embodiment, the device 100 may include one or more processors 200, 300 and a non-transitory memory connected to the one or more processors 200, 300. The non-transitory memory may carry executable program code that, when executed by the one or more processors 200, 300, causes the apparatus 100 to perform, carry out, or initiate the operations or methods described herein.
Fig. 14 shows a method 1000 according to an embodiment of the invention. Method 1000 may be performed by device 100. The method 1000 comprises a step 1001 of associating, for each sub-block 109, all pixel portions 104 superimposed with the color filters 105 of the white color filter type 106d with the first merging group 110. Furthermore, the method 1000 comprises a step 1002 of associating, for each sub-block 109, all pixel portions 104 superimposed with color filters 105 of the red 106a, blue 106b or green 106c color filter type with the second merging group 111.
The invention has been described in connection with various embodiments as an example and implementations. However, other variations to the claimed subject matter can be understood and effected by those skilled in the art in practicing the claimed subject matter, from a study of the drawings, the invention, and the independent claims. In the claims and in the description, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. A single element or other unit may fulfill the functions of several entities or items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Claims (21)

1. A radiation detection device (100), characterized in that the radiation detection device (100) comprises an array of pixels (101) superimposed with a color filter array (102), wherein each pixel (103) in the array of pixels (101) comprises one or more pixel portions (104), each pixel portion (104) being superimposed with one color filter (105) of the color filter array (102), each color filter (105) being of a red (106 a), blue (106 b), green (106 c) or white (106 d) filter type (106) of a respective color (107);
wherein the pixel array comprises one or more pixel blocks (108), each pixel (103) block (108) being superimposed with a color filter (105) of the same mode of the color filter array (102);
wherein each block (108) comprises at least four sub-blocks (109) of pixels (103), each sub-block (109 a, 109b, 109c, 109 d) of pixels (103) being superimposed with a color filter (105) of a white color filter type (109 d) and a color filter of the same respective color (107) of red (106 a), blue (106 b) or green (106 c) color filter type (106);
wherein, for each sub-block (109 a, 109b, 109c, 109 d), all pixel portions (104) superimposed with color filters (105) of the white color filter type (106 d) are associated with a first merging group (110);
Wherein for each sub-block (109 a, 109b, 109c, 109 d) all pixel portions (104) superimposed with the color filters of the red, blue or green color filter type (106 a, 106b, 106 c) are associated with a second merging group (111);
wherein in each sub-block (109 a, 109b, 109c, 109 d) the positions of the pixel portions (104) associated with the second merge group (111) are arranged in a merge group pattern (112) point-symmetrical with respect to the geometric center (121) of the respective sub-block (109 a, 109b, 109c, 109 d);
wherein the merge group pattern (112) is the same in each block (108);
wherein the color filter (105) without color filter or without wavelength selectivity is a color filter (105) of the white color filter type (106 d).
2. The radiation detection apparatus (100) according to claim 1, wherein:
wherein each block (108) comprises four sub-blocks (109) of the pixels (103);
wherein two sub-blocks (109) of each pixel block (108) comprise color filters (105) of the green color filter type (106 c), one sub-block (109) of each pixel block (108) comprises color filters (105) of the red color filter type (106 a), and one sub-block of each pixel block (108) comprises color filters (105) of the blue color filter type (106 b).
3. The radiation detection apparatus (100) according to claim 2, wherein:
wherein the sub-blocks (109) in each block (108) are arranged in a grid of 2x2 sub-blocks;
the two sub-blocks of color filters (105) comprising the green color filter type (106 c) are diagonally arranged in the grid.
4. The radiation detection apparatus (100) according to claim 3, wherein:
wherein the upper left sub-block (109 d) comprises a color filter (105) of a green color filter type (106 c) of the first color (107 d);
the lower right sub-block (109 c) comprises a color filter (105) of a green color filter type (106 c) of a second color (107 c);
the upper right sub-block (109 a) comprises a red filter type color filter (105) of color (107 a);
the lower left sub-block (109 b) comprises a blue filter type color filter (105) of color (107 b).
5. The radiation detection apparatus (100) according to any one of the preceding claims, wherein:
wherein each second merging group (111) comprises one merging sub-group (114) or each second merging group (111) comprises two merging sub-groups (114);
wherein, in each sub-block, the locations of the pixel portions associated with each merging sub-group (114) are arranged in a merging sub-group pattern (115) point-symmetrical with respect to the geometric center 121 of the respective sub-block (109);
Wherein the merge subgroup pattern (115) is the same in each block.
6. The radiation detection apparatus (100) according to claim 5, wherein:
wherein each merging sub-group (114) of each sub-block (109) in a block (108) corresponds to one merging sub-group (114) of each other sub-block (109) in the same block (108), and each first merging group (110) of sub-blocks (109) corresponds to a first merging group (110) of each other sub-block (109) in the same block (108);
wherein all mutually corresponding first merging groups (110) and merging sub-groups (114) are grouped into respective merging frames (118) for processing.
7. The radiation detection apparatus (100) according to claim 6, wherein:
a processor (300) is included for jointly processing each of the merged frames (118).
8. The radiation detection apparatus (100) according to claim 6 or 7, wherein:
wherein each merging sub-group (114) corresponds to radiation of a wavelength range that depends on a color filter (105) passband of a color filter type (106) that superimposes colors (107) of the pixel portions (104) of the corresponding merging sub-group (114).
9. The radiation detection apparatus (100) according to claim 8, wherein:
Wherein in each sub-block (109) of the block (108) the total sensitivity of the radiation of the first respective corresponding wavelength range of the sub-group (114) is combined
Is approximately equal to the total sensitivity of radiation of the second respective corresponding wavelength range of each respective corresponding combined subgroup (114) of the other sub-blocks (109) of the block (108).
10. The radiation detection apparatus (100) according to claim 9, wherein:
wherein the total sensitivity of the combined subgroup (114) superimposed with the color filters (105) of the color filter type (106) of the color (107) to radiation of the respective wavelength range is the product of: -sensitivity to radiation of a respective wavelength range of the color filters (105) of the color filter type (106) superimposed with the pixel portions (104) of the merging sub-group (114), and-combined effective surface area of the pixel portions (104) of the merging sub-group (114).
11. The radiation detection apparatus (100) according to any one of claims 6 to 10, wherein:
wherein each merged subgroup (114) and the pixel portion (104) of each first merged group (110) in each sub-block (109) of the block (108) are for collecting radiation having a different first exposure time than the other merged subgroups (114) and/or the further first merged groups (110) in the respective sub-blocks (109), wherein each respective corresponding merged subgroup (114) and the pixel portion (104) of each respective corresponding first merged group (110) in the other sub-blocks (109) of the block (108) are for collecting radiation having the same first exposure time.
12. The radiation detection apparatus (100) according to any one of the preceding claims, wherein:
wherein in each block (108) at least one merge group (110, 111) forms a disjoint cross pattern.
13. The radiation detection apparatus (100) according to any one of the preceding claims, wherein:
wherein in each sub-block (109), the pixel array comprising all pixel portions (104) in said respective sub-block (109) has a rectangular shape.
14. The radiation detection apparatus (100) according to any one of the preceding claims, wherein:
wherein at least one sub-block (109) of the blocks (108) comprises a smaller surface area of the pixel portion (104) superimposed with the white filter (106 d) than another sub-block (109) of the blocks (108).
15. The radiation detection apparatus (100) according to any one of the preceding claims, wherein:
wherein each pixel portion (104) is half the size or the same size of a pixel (103) in the pixel array (101).
16. The radiation detection apparatus (100) according to any one of the preceding claims, wherein:
wherein each block (108) comprises a pixel array of 9x9 pixels (103), the pixel array comprising four sub-blocks (109 a, 109b, 109c, 109 d), each sub-block (109 a, 109b, 109c, 109 d) comprising a pixel array of 3x3 pixels (103).
17. The radiation detection apparatus (100) according to claim 16, wherein:
wherein the upper left sub-block (109 d) comprises:
a first merge subgroup (119 d) comprising top center and bottom center pixels;
a second merge subgroup (120 d) comprising a right half of the center left pixel and a left half of the center right pixel;
the lower right sub-block (109 c) includes:
a first merge subgroup (119 c) comprising top center and bottom center pixels;
a second merge subgroup (120 c) comprising a center left pixel and a center right pixel;
the lower left sub-block (109 b) comprises:
a first merging subgroup (119 b) comprising corner pixels;
a second merge subset (120 b) comprising a center pixel;
the upper right sub-block (109 a) includes:
a first merging subgroup (119 a) comprising corner pixels;
a second merge subset (120 a) comprising a center pixel;
wherein the remaining pixel portions in each sub-block (109) are grouped into a first merging group (110 a, 110b, 110c, 110 d), respectively.
18. The radiation detection apparatus (100) according to claim 17, wherein:
wherein in each block all first merging sub-groups (119 a, 119b, 119c, 119 d) correspond to each other, all second merging sub-groups (120 a, 120b, 120c, 120 d) correspond to each other, and all first merging groups (110 a, 110b, 110c, 110 d) correspond to each other.
19. The radiation detection apparatus (100) according to any one of the preceding claims, wherein:
comprises a processor (200) or an analog combination module (201) for combining together pixel portions (104) of the same combination group (110, 111) and/or combination subgroup (114).
20. The radiation detection apparatus (100) according to any one of the preceding claims, wherein:
wherein each of the red (106 a), green (106 c) and blue (106 b) filter types is a filter type of a respective color (107), the respective color (107) comprising a respective red (113 a), green (113 c) or blue (113 b) color component (113) having a largest magnitude compared to other color components;
wherein each color filter type (106) of a respective color (107) comprising two components (113) of the same maximum magnitude is a color filter type (106) of one of the two components arranged in descending order according to the hierarchy: red (113 a), blue (113 b), green (113 c), red (113 a).
21. A method (1000) for operating a radiation detection device (100), characterized by:
the device comprises a pixel array (101) superimposed with a color filter array (102), wherein each pixel (103) in the pixel array (101) comprises one or more pixel portions (104), each pixel portion (104) being superimposed with one color filter (105) of the color filter array (102), each color filter (105) being of the red (106 a), blue (106 b), green (106 c) or white (106 d) color filter type of the respective color (107);
Wherein the pixel array (101) comprises one or more blocks (108) of pixels (103), each block (103) of pixels (108) being superimposed with a color filter (105) of the same pattern of the color filter array (102);
wherein each block (108) comprises four sub-blocks (109) of pixels (103), each sub-block (109) of pixels (103) being superimposed with a filter (105) of a white filter type (106 d) and a filter (105) of the same respective color (107) red (106 a), blue (106 b) or green (106 c) filter type;
the method comprises the following steps:
-for each sub-block (109), associating (1001) with a first merging group (110) all pixel portions (104) superimposed with color filters (105) of said white color filter type (106 d);
for each sub-block, associating (1002) all pixel portions superimposed with filters of the red, blue or green filter type with a second merging group (111);
wherein in each sub-block (109 a, 109b, 109c, 109 d) the positions of the pixel portions (104) associated with the second merge group (111) are arranged in a merge group pattern (112) point-symmetrical with respect to the geometric center (121) of the respective sub-block (109 a, 109b, 109c, 109 d);
wherein the merge group pattern (112) is the same in each block (108);
Wherein the color filter (105) without color filter or without wavelength selectivity is a color filter (105) of the white color filter type (106 d).
CN202180096364.2A 2021-06-18 2021-06-18 Apparatus and method for providing high dynamic range image Pending CN117203974A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2021/066649 WO2022262997A1 (en) 2021-06-18 2021-06-18 A device and method for creating a high-dynamic range colour image

Publications (1)

Publication Number Publication Date
CN117203974A true CN117203974A (en) 2023-12-08

Family

ID=76695729

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180096364.2A Pending CN117203974A (en) 2021-06-18 2021-06-18 Apparatus and method for providing high dynamic range image

Country Status (2)

Country Link
CN (1) CN117203974A (en)
WO (1) WO2022262997A1 (en)

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8274715B2 (en) * 2005-07-28 2012-09-25 Omnivision Technologies, Inc. Processing color and panchromatic pixels
US7855740B2 (en) * 2007-07-20 2010-12-21 Eastman Kodak Company Multiple component readout of image sensor

Also Published As

Publication number Publication date
WO2022262997A1 (en) 2022-12-22

Similar Documents

Publication Publication Date Title
KR101441696B1 (en) Image sensor with improved light sensitivity
CN102484721B (en) Four-channel color filter array pattern
CN101233762B (en) Image sensor with improved lightsensitivity
US8922683B2 (en) Color imaging element and imaging apparatus
JP5054856B1 (en) Color image sensor
US9210387B2 (en) Color imaging element and imaging device
US20110032397A1 (en) Method and apparatus providing color interpolation in color filter arrays using edge detection and correction terms
US7456881B2 (en) Method and apparatus for producing Bayer color mosaic interpolation for imagers
EP2685711B1 (en) Color image pickup device
US10798311B2 (en) Methods and apparatus for reducing spatial flicker artifacts
JP2008524924A (en) Double lens imaging system and method
US9159758B2 (en) Color imaging element and imaging device
JP5345258B2 (en) Color image sensor
US6559886B1 (en) Video signal processing method and device
CN113676629B (en) Image sensor, image acquisition device, image processing method and image processor
JP5380629B2 (en) Color image sensor
CN110049296A (en) Image sensering device
US8982253B2 (en) Color imaging element
EP2800384A1 (en) Color imaging element
US20140307135A1 (en) Color imaging element
CN111567027A (en) Plenoptic imaging device with reduced optical crosstalk, corresponding method, computer program product, computer readable carrier medium and apparatus
CN112019823A (en) Filter array and image sensor
CN117203974A (en) Apparatus and method for providing high dynamic range image
EP3973696B1 (en) Color filter array apparatus
CN114584725A (en) Image sensor and imaging device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination