CN116017181A - Pixel arrangement method of linear array image sensor capable of improving resolution - Google Patents
Pixel arrangement method of linear array image sensor capable of improving resolution Download PDFInfo
- Publication number
- CN116017181A CN116017181A CN202211687419.XA CN202211687419A CN116017181A CN 116017181 A CN116017181 A CN 116017181A CN 202211687419 A CN202211687419 A CN 202211687419A CN 116017181 A CN116017181 A CN 116017181A
- Authority
- CN
- China
- Prior art keywords
- pixel
- image
- resolution
- standard
- mode
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
The application provides a pixel arrangement method of a linear array image sensor capable of improving resolution, which comprises the steps of constructing a pixel array of the linear array image sensor, wherein the pixel array comprises at least one group of pixel units, a first pixel group and a second pixel group which are closely arranged along a first direction in the plurality of groups of pixel units, wherein the first pixel group and the second pixel group are pixel queues formed by arranging rectangular pixels with the same number along a second direction, and the second direction is perpendicular to the first direction; the first pixel groups and the second pixel groups are staggered in the second direction; the first pixel groups in any two pixel units are aligned along the second direction; the working mode of the linear array image sensor responds to a mode instruction input by a user, wherein the mode instruction comprises one of a standard single line mode, a standard TDI mode, a standard HDR mode, a high-resolution single line mode, a high-resolution TDI mode and a high-resolution HDR mode, so that the problem that the linear array image sensor cannot consider multiple resolutions.
Description
Technical Field
The present disclosure relates to the field of image processing, and more particularly, to a pixel arrangement method of a linear array image sensor capable of improving resolution.
Background
The linear array image sensor is a solid-state device capable of converting electric signals into digital signals line by line, and the image sensor is a core device of a camera and can acquire image information. The time delay integral (TimeDelayIntegration, TDI) image sensor is an evolution of the line image sensor. The imaging mechanism of the time delay integral image sensor is to expose the pixels passing by the shot object row by row and accumulate the exposure structures, so that the problem of weak imaging signals caused by insufficient exposure time of the high-speed moving object is solved. The time delay integral image sensor can increase the effective exposure time and improve the signal-to-noise ratio of the image.
The array image sensor has the pixel arrangement mode of a single-row array, the number of pixels in the single-row array is the resolution of the sensor, and for application, finer pictures and higher detection precision can be obtained by higher resolution, so that the array image sensor with a time delay integration function is used, the pixel arrangement mode is that a plurality of arrays are aligned in parallel, and the TDI series is the sum of a plurality of single-row pixels.
However, the linear array image sensor with or without the time delay integration function has only one resolution, and cannot take into account various resolutions.
Disclosure of Invention
The application provides a pixel arrangement method of a linear array image sensor capable of improving resolution, which aims to solve the problem that the linear array image sensor has only one resolution and cannot give consideration to multiple resolutions.
In order to solve the above problems, the present application provides a pixel arrangement method of a line image sensor capable of improving resolution, the method comprising:
constructing a pixel array of the linear array image sensor, wherein the pixel array comprises at least one group of pixel units, a first pixel group and a second pixel group which are closely arranged along a first direction in a plurality of groups of pixel units, the first pixel group and the second pixel group are pixel queues formed by arranging rectangular pixels with the same number along a second direction, and the second direction is perpendicular to the first direction; the length of the pixel array along the second direction corresponds to the resolution of the linear array image sensor along the second direction, the length of the pixel array along the first direction corresponds to the resolution of the linear array image sensor along the first direction, and the first pixel groups and the second pixel groups are staggered in the second direction; the first pixel groups in any two pixel units are aligned along the second direction, and the second pixel groups in any two pixel units are aligned along the second direction;
the working mode of the linear array image sensor responds to a mode instruction input by a user, and corresponding image processing is carried out on an image to be processed by adopting the constructed pixel array to generate a target image; the mode instruction includes: standard single line mode, standard TDI mode, standard HDR mode, high resolution single line mode, high resolution TDI mode, high resolution HDR mode.
Optionally, the staggered distance between the first pixel group and the second pixel group in the second direction is 1/2 of the long-side distance of the rectangular pixels.
Optionally, when the mode instruction is a standard single line mode, the step of performing corresponding image processing on the image to be processed by using the constructed pixel array includes:
and generating a target image according to the standard image output by the first pixel group or the second pixel group, wherein the resolution of the standard image is the standard image resolution, and the pixel size of the image is the standard size.
Optionally, when the mode instruction is a standard TDI mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array includes:
and performing time delay integration TDI processing on the first pixel group and/or the second pixel group in at least one group of pixel units, and generating a target image according to an output standard TDI image, wherein the resolution of the standard TDI image is the standard image resolution, and the pixel size of the image is a standard size.
Optionally, when the mode instruction is a standard HDR mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array includes:
processing the first pixel group and/or the second pixel group in at least one group of pixel units for different time, outputting images with different brightness, fusing the images with different brightness, and generating a target image according to the output high dynamic range image, wherein the resolution of the high dynamic range image is the standard image resolution, and the pixel size of the high dynamic range image is the standard size.
Optionally, when the mode instruction is a high-resolution single-line mode, the step of performing corresponding image processing on the image to be processed by using the constructed pixel array includes:
and running a camera carrying the linear array image sensor at 2 times of line frequency, wherein the first pixel group corresponds to the second pixel group to generate a first standard image and a second standard image which are different from each other by 1/2 rectangular pixel in the second direction and the first direction, the first standard image and the second standard image are subjected to resolving or crossed arrangement to obtain a high-resolution image, a target image is generated according to the high-resolution image, the resolution of the high-resolution image is 2 times of that of the standard resolution, when the pixel size of the target image obtained through resolving is 1/2 of that of the standard image, and when the pixel size of the target image obtained through crossed arrangement is the standard size.
Optionally, when the mode instruction is a high resolution TDI mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array includes:
and performing time delay integration TDI processing on the at least two groups of high-resolution images, and generating a target image according to the output high-resolution TDI images.
Optionally, when the mode instruction is a high resolution HDR mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array includes:
and exposing the at least two groups of high-resolution images for different time, outputting the images with different brightness, fusing the images with different brightness, and generating a target image according to the output high-resolution high-dynamic range images.
Optionally, the image to be processed includes three pixel arrays, the initial positions of the three pixel arrays are aligned, and the three pixel arrays respectively correspond to the R, G, B three channels.
Optionally, the image to be processed includes two pixel arrays, where initial positions of the two pixel arrays are aligned, one pixel array corresponds to two channels in R, G, B, and the other pixel array corresponds to another channel except the first pixel array channel in R, G, B channels.
As can be seen from the above solution, the present application provides a pixel arrangement method of a line image sensor capable of improving resolution, the method comprising: constructing a pixel array of the linear array image sensor, wherein the pixel array comprises at least one group of pixel units, a first pixel group and a second pixel group which are closely arranged along a first direction in a plurality of groups of pixel units, the first pixel group and the second pixel group are pixel queues formed by arranging rectangular pixels with the same number along a second direction, and the second direction is perpendicular to the first direction; the length of the pixel array along the second direction corresponds to the resolution of the linear array image sensor along the second direction, the length of the pixel array along the first direction corresponds to the resolution of the linear array image sensor along the first direction, and the first pixel groups and the second pixel groups are staggered in the second direction; the first pixel groups in any two pixel units are aligned along the second direction, and the second pixel groups in any two pixel units are aligned along the second direction; the working mode of the linear array image sensor responds to a mode instruction input by a user, and corresponding image processing is carried out on an image to be processed by adopting the constructed pixel array to generate a target image; the mode instruction includes: standard single line mode, standard TDI mode, standard HDR mode, high resolution single line mode, high resolution TDI mode, high resolution HDR mode. The linear array image sensor solves the problem that the linear array image sensor has only one resolution and cannot give consideration to various resolutions.
Drawings
In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a schematic diagram of a pixel array of a pixel arrangement method of a linear array image sensor capable of improving resolution;
FIG. 2 is a schematic diagram of a standard single line pixel array;
FIG. 3 is a schematic diagram of a high resolution single line mode pixel array;
FIG. 4 is a schematic diagram of a high resolution single line mode pixel pair Ji Zhenlie;
FIG. 5 is a schematic diagram of a true trichromatic pixel array;
fig. 6 is a schematic diagram of a color two-line pixel array.
Illustration of:
100-pixel units, 101-first pixel groups, 102-second pixel groups, 103-rectangular pixels, 200-pixel arrays, 201-first pixel arrays, 202-second pixel arrays, 203-third pixel arrays.
Detailed Description
Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The embodiments described in the examples below do not represent all embodiments consistent with the present application. Merely as examples of systems and methods consistent with some aspects of the present application as detailed in the claims.
For ease of description, referring to fig. 1, the X direction represents a first direction of the present application, and the Y direction represents a second direction of the present application, where the first direction and the second direction are definitions given for ease of understanding, and are not specifically defined as directions.
The linear array image sensor is essentially a chip and mainly comprises: the pixel array (Bayer array or called photosensitive area array), time sequence control, analog signal processing, analog-to-digital conversion and other modules, wherein the pixel array occupies the largest area of the whole chip, consists of pixels which correspond to each pixel in each picture seen by people, and mainly serves to complete photoelectric conversion, convert photons into electrons, each pixel comprises a photosensitive area and a reading circuit, signals of each pixel are processed through analog signals, are subjected to analog-to-digital conversion by an ADC (analog-to-digital converter), and then are output to a digital processing module, and are converted into digital signals through the reading circuit, so that the process of digitizing a real scene is completed.
For applications, pursuing higher resolution is a future development trend, and higher resolution can obtain finer pictures and higher detection accuracy. According to the pixel arrangement mode of the current image sensor, most image sensors have only one resolution, and two resolutions cannot be simultaneously achieved.
In order to solve the above-mentioned problems, the present application provides a pixel arrangement method of a line image sensor capable of improving resolution, referring to fig. 1, which is a schematic diagram of a pixel arrangement method of a line image sensor capable of improving resolution, the method includes:
constructing a pixel array of a linear array image sensor, wherein the pixel array 200 comprises at least one group of pixel units, a first pixel group 101 and a second pixel group 102 which are closely arranged along a first direction in a plurality of groups of pixel units, the first pixel group 101 and the second pixel group 102 are pixel queues formed by arranging rectangular pixels 103 with the same number along a second direction, and the second direction is perpendicular to the first direction; the length of the pixel array along the second direction corresponds to the resolution of the linear array image sensor along the second direction, the length of the pixel array along the first direction corresponds to the resolution of the linear array image sensor along the first direction, and the first pixel groups and the second pixel groups are staggered in the second direction; the first pixel groups of any two pixel units are aligned along the second direction, and the second pixel groups of any two pixel units are aligned along the second direction.
The working mode of the linear array image sensor responds to a mode instruction input by a user, and the constructed pixel array 200 is adopted to execute corresponding image processing on an image to be processed to generate a target image; the mode instruction includes: standard single line mode, standard TDI mode, standard HDR mode, high resolution single line mode, high resolution TDI mode, high resolution HDR mode.
All mode instructions are applicable to black-and-white line array image sensors, true tri-color line array image sensors and color bi-line array image sensors.
It can be understood that, when the resolution of the image is higher, the number of the rectangular pixels 103 included is larger, and the image is clearer, so that in this embodiment, the resolution of the image is improved by providing a high-resolution single line mode, a high-resolution TDI mode and a high-resolution HDR mode, and the true tri-color mode and the color dual line mode can be combined with the high-resolution single line mode, the high-resolution TDI mode and the high-resolution HDR mode, so that the image can be performed according to the arrangement mode of the pixel array 200.
In some embodiments, the first pixel group 101 and the second pixel group 102 are staggered by a distance of 1/2 the long side distance of the rectangular pixels 103 in the second direction.
Specifically, for example: the physical size of the rectangular pixels 103 of the image sensor is Pixel, and the interlacing distance between the first Pixel group 101 and the second Pixel group 102 in the second direction is 1/2Pixel (see a in fig. 1), so that the resolution can be improved by 2 times according to the high resolution single line mode; in some embodiments, the interlacing distance between the first Pixel group 101 and the second Pixel group 102 in the second direction is 1/3 of the long side distance of the rectangular pixels 103, and then the interlacing distance is 1/3Pixel, so that the resolution can be improved by 3 times according to the high-resolution single line mode, and other values of interlacing distance can be set, that is, when the number of the rectangular pixels 103 which can be arranged in the Pixel array is greater, the resolution is also higher, for example, 1/4, 1/5, etc., the corresponding resolution can be improved by 4 times, 5 times, etc., but in the high-resolution single line mode, the data calculation is more complex, the requirement of the analog-to-digital conversion module is higher, the calculation is more complex, the conversion efficiency is affected, and the increase of the sensor pixels with the same size can lead to the reduction of the photosensitive area of the single rectangular pixels 300, the possibility of underexposure, the poor imaging quality and the noise becomes large under low illumination.
Referring to fig. 2, which is a schematic diagram of a standard single line pixel array, in some embodiments, when the mode instruction is a standard single line mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array 200 includes:
the target image is generated according to the standard image output by the first pixel group 101 or the second pixel group 102, the Resolution of the standard image is the standard image Resolution, namely Resolution, and the pixel size of the image is the standard size.
In some embodiments, when the mode instruction is a standard TDI mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array 200 comprises:
and performing time delay integration TDI processing on the first pixel group 101 and/or the second pixel group 102 in at least one group of pixel units 100, and generating a target image according to the output standard TDI image, wherein the Resolution of the standard TDI image is standard image Resolution, namely Resolution, and the pixel size of the image is standard size.
It should be noted that, the time delay integration (tdelayintegrationtdi) image sensor is an evolution of the line image sensor. The imaging mechanism of the time delay integral image sensor is to expose the pixels passing by the shot object row by row and accumulate the exposure structures, so that the problem of weak imaging signals caused by insufficient exposure time of the high-speed moving object is solved. The time delay integral image sensor can increase the effective exposure time and improve the signal-to-noise ratio of the image.
Specifically, an odd-line pixel group or an even-line pixel group is selected, for example: performing time delay integration processing on all odd-line pixel groups in the pixel array 200, and after the processing, aligning or not aligning the imaging results of the odd-line pixel groups and the even-line pixel groups, wherein when the imaging results are aligned, the main purpose is to eliminate the visual difference of 1/2 rectangular pixels 103, so as to achieve the maximum pixel group quantity; when the imaging results are not aligned, the visual difference of the 1/2 rectangular pixels 103 cannot be eliminated, the number of the pixel groups is 1/2 of that when aligned, and it can be understood that when the imaging results of the pixel groups in the odd-numbered row and the pixel groups in the even-numbered row are not aligned, the resolution is not affected, i.e. the length of the selected pixel group in the second direction.
In some embodiments, when the mode instruction is a standard HDR mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array 200 comprises:
the first pixel group 101 and/or the second pixel group 102 in at least one group of pixel units 100 are subjected to exposure processing in different time, images with different brightness are output, the images with different brightness are fused, a target image is generated according to the output high dynamic range image, the resolution of the high dynamic range image is standard image resolution, and the pixel size of the high dynamic range image is standard size.
Note that, HDR literally means high dynamic range (highdynamighdr), and dynamic range is one of five elements of high image quality, and the quality of an image directly relates to subjective perception of viewing. The higher the order, the greater the dynamic range if the dynamic range is understood to be the order of quantization.
Specifically, the first pixel group 101 and the second pixel group 102 are exposed at different times, that is, the shutter speed and the aperture size are controlled to be complementary, for example, in order to add more light, the images with different brightness can be output, at least 2 images with different brightness are fused, it is understood that the image fusion (ImageFusion) is to integrate two or more images into a new image by using a specific algorithm, and the fusion result can utilize the correlation of two (or more) images in time and space and the complementarity of information, so that the fused image has a more comprehensive and clear description on a scene, thereby being more beneficial to the recognition of human eyes and the automatic detection of machines. The image fusion method can be a spatial domain fusion method or a transform domain fusion method, and more other methods based on the two methods are adopted, and are not exemplified herein, and can be selected according to the use requirements.
Referring to fig. 3 and 4, fig. 3 is a schematic diagram of a high resolution single line mode pixel array; FIG. 4 is a schematic diagram of a high resolution single line mode pixel pair Ji Zhenlie; in some embodiments, when the mode instruction is a high resolution single line mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array 200 includes:
and (3) running a camera carrying the linear array image sensor at 2 times of line frequency, correspondingly generating a first standard image and a second standard image which are different from the first direction by 1/2 rectangular pixels in the second direction by the first pixel group and the second pixel group, obtaining a high-resolution image by resolving or intersecting the first standard image and the second standard image, generating a target image according to the high-resolution image, wherein the resolution of the high-resolution image is 2 times of the standard resolution, and when the pixel size of the target image obtained by resolving is 1/2 of the standard size, and when the pixel size of the target image obtained by intersecting the first standard image is the standard size.
Specifically, for at least two adjacent groups of pixel units 100, 2 times of line frequency operation can be set for the mounted line image sensor, and it should be noted that a certain relationship exists between the line frequency and the resolution: hf=vr×rr×k, wherein: hr represents horizontal resolution, vr represents vertical resolution, re represents auto-refresh rate, hf represents line frequency, and K is a constant value. The higher the line frequency, the greater the allowable display resolution variable range.
After the operation is finished, the image data with the difference of 1/2Pixel in the first direction and the second direction can be obtained, and the core of the solution is that the solution is realized through solving a multi-element one-time equation process, for example: d (1, 1) +d (1, 2) +d (2, 1) +d (2, 2) =l2 (1, 1), d (2, 2) +d (2, 3) +d (3, 3) -L1 (2, 2), wherein: the pixel values of both L1 and L2 are known, and d is solved.
Referring to fig. 3, the left side in fig. 3 represents two adjacent sets of pixel units 100, and also represents the gray value of the actually photographed image, and each rectangular pixel 103 represents a gray value, where: l1 denotes a first pixel group 101 coordinate in the first group of pixel units, L1 (1, 1) denotes a first rectangular pixel coordinate in the first pixel group 101, L2 (2, 1) denotes a first rectangular pixel coordinate in the second pixel group 102, L2 denotes a first pixel group 101 coordinate in the second group of pixel units, L2 (1, 1) denotes a first rectangular pixel coordinate in the first pixel group 101 in the second group of pixel units, L2 (2, 1) denotes a first rectangular pixel coordinate in the second pixel group 102 in the second group of pixel units, and R denotes the number of rectangular pixels 103 in the pixel groups; the right side of fig. 3 shows the Pixel unit after the solution, where d represents the first Pixel unit after the solution, d (1, 1) represents the first rectangular Pixel coordinate in the first Pixel group 101, d (2, 1) represents the first rectangular Pixel coordinate in the second Pixel group 102, and d (1,2R-1) represents the last but one rectangular Pixel coordinate in the first Pixel group 101, and as it is known from the figure, since the first direction and the second direction are different by 1/2Pixel, the size of the rectangular Pixel after the solution is 1/2 of the original rectangular Pixel, that is, the Pixel size is 1/2 of the original image, and the Resolution of the image is Resolution.
Referring to fig. 4, the left side of fig. 4 shows two adjacent Pixel units 100, and the right side shows the Pixel units 100 after the calculation, unlike fig. 3, after the gray values of the images captured on the left side are processed, the two Pixel units 100 are aligned in the second direction, that is, the positions captured on the two sides are identical, there is no case of a difference of 1/2Pixel, and rearrangement is performed, so that the Pixel unit 100 on the right side of fig. 4 is obtained, wherein the two Pixel units 100 are aligned in the second direction, so that the first rectangular Pixel coordinates of the first Pixel group are d (1, 1) and L1 (1, 1) at this time, since the data calculation process is not involved, only the cross arrangement is performed, the Pixel size is unchanged, and the Resolution is improved to Resolution by Resolution.
In some embodiments, when the mode instruction is a high resolution TDI mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array 200 comprises:
and performing time delay integration TDI processing on at least two groups of high-resolution images, and generating a target image according to the output high-resolution TDI images.
In some embodiments, when the mode instruction is a high resolution HDR mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array 200 comprises:
exposing at least two groups of high-resolution images for different time, outputting the images with different brightness, fusing the images with different brightness, and generating a target image according to the output high-resolution high-dynamic range images.
It should be noted that, for the color line image sensor, the color line image sensor has 3 channels, i.e. r\g\b, and RGB is the color representing three channels of red, green and blue; for a black-and-white linear array image sensor, only one channel exists, the gray scale is no color, all RGB color components are equal, and a 2D image recorded with brightness information becomes a gray scale image; if it is a gray image itself, its pixel value is its gray value, and if it is a color image, its gray value needs to be obtained by a function mapping. The gray image is obtained by transition of pure black and pure white, gray is obtained by adding white into black, and different gray values are obtained by mixing pure black and pure white according to different proportions.
Optionally, the image to be processed includes three pixel arrays 200, where starting positions of the three pixel arrays 200 are aligned, and the three pixel arrays 200 respectively correspond to the R, G, B three channels.
Specifically, referring to fig. 5, fig. 5 is a schematic diagram of a true trichromatic pixel array; for example: the first pixel array 201 is an R channel, i.e. the color of the rectangular pixel 103 is red, the second pixel array 202 is a G channel, i.e. the color of the rectangular pixel 103 is green, and the third pixel array 203 is a B channel, i.e. the color of the rectangular pixel 103 is blue, so long as it is ensured that all three pixel arrays 200 including RGB are present.
Optionally, the image to be processed includes two pixel arrays 200, where the starting positions of the two pixel arrays 200 are aligned, one pixel array 200 corresponds to two channels in R, G, B, and the other pixel array 200 corresponds to the other channel except the first pixel array channel in R, G, B channels.
Specifically, referring to fig. 6, fig. 6 is a schematic diagram of a color two-line pixel array; for example: the first pixel array includes R, B channels, the color of the first rectangular pixel in the first pixel array is red, and the color of the second rectangular pixel in the first pixel array is blue, that is, the color of the rectangular pixel 103 in the first pixel array is red and blue are alternately arranged, and the second pixel array includes G channels, and the color of the rectangular pixel 103 in the second pixel array is green; if the color of the first rectangular pixels in the first pixel array is blue and green, the color of the rectangular pixels 103 in the second pixel array is red.
In this embodiment, if the user command of the color line image sensor is a high-resolution single line mode, a high-resolution TDI mode, and a high-resolution HDR mode, the same processing as that of the black-and-white line image sensor on the pixel array 200 is required, the colors of the three channels (r\g\b) are aligned, and the shot target is ensured to be a uniform position, so that the first high-resolution image, the second high-resolution image, and the high-resolution high-dynamic range image of the color can be output, and the corresponding target image is generated. Regarding the generation of color images, which must acquire wavelengths as compared to gray scale images, there are many ways to collect wavelength information, such as: the color imaging system of the single sensor can be realized in other ways, and the description is omitted here.
As can be seen from the above, the present embodiment provides a pixel arrangement method of a linear array image sensor capable of improving resolution, the method comprising: constructing a pixel array of the linear array image sensor, wherein the pixel array comprises at least one group of pixel units, a first pixel group and a second pixel group which are closely arranged along a first direction in a plurality of groups of pixel units, the first pixel group and the second pixel group are pixel queues formed by arranging rectangular pixels with the same number along a second direction, and the second direction is perpendicular to the first direction; the length of the pixel array along the second direction corresponds to the resolution of the linear array image sensor along the second direction, the length of the pixel array along the first direction corresponds to the resolution of the linear array image sensor along the first direction, and the first pixel groups and the second pixel groups are staggered in the second direction; the first pixel groups in any two pixel units are aligned along the second direction, and the second pixel groups in any two pixel units are aligned along the second direction; the working mode of the linear array image sensor responds to a mode instruction input by a user, and corresponding image processing is carried out on an image to be processed by adopting the constructed pixel array to generate a target image; the mode instruction includes: standard single line mode, standard TDI mode, standard HDR mode, high resolution single line mode, high resolution TDI mode, high resolution HDR mode. The linear array image sensor solves the problem that the linear array image sensor has only one resolution and cannot give consideration to various resolutions.
The foregoing detailed description of the embodiments is merely illustrative of the general principles of the present application and should not be taken in any way as limiting the scope of the invention. Any other embodiments developed in accordance with the present application without inventive effort are within the scope of the present application for those skilled in the art.
Claims (10)
1. A method for pixel arrangement of a line image sensor with improved resolution, the method comprising:
constructing a pixel array of the linear array image sensor, wherein the pixel array comprises at least one group of pixel units, a first pixel group and a second pixel group which are closely arranged along a first direction in a plurality of groups of pixel units, the first pixel group and the second pixel group are pixel queues formed by arranging rectangular pixels with the same number along a second direction, and the second direction is perpendicular to the first direction; the length of the pixel array along the second direction corresponds to the resolution of the linear array image sensor along the second direction, the length of the pixel array along the first direction corresponds to the resolution of the linear array image sensor along the first direction, and the first pixel groups and the second pixel groups are staggered in the second direction; the first pixel groups in any two pixel units are aligned along the second direction, and the second pixel groups in any two pixel units are aligned along the second direction;
the working mode of the linear array image sensor responds to a mode instruction input by a user, and corresponding image processing is carried out on an image to be processed by adopting the constructed pixel array to generate a target image; the mode instruction includes: standard single line mode, standard TDI mode, standard HDR mode, high resolution single line mode, high resolution TDI mode, high resolution HDR mode.
2. The pixel arrangement method of claim 1, wherein the first pixel group and the second pixel group have a staggered distance of 1/2 of a long-side distance of rectangular pixels.
3. The pixel arrangement method of a line image sensor capable of improving resolution according to claim 2, wherein when the mode instruction is a standard single line mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array comprises:
and generating a target image according to the standard image output by the first pixel group or the second pixel group, wherein the resolution of the standard image is the standard image resolution, and the pixel size of the image is the standard size.
4. A pixel arrangement method of a line image sensor capable of improving resolution as claimed in claim 3, wherein when said mode instruction is a standard TDI mode, the step of performing corresponding image processing on said image to be processed using a constructed pixel array comprises:
and performing time delay integration TDI processing on the first pixel group and/or the second pixel group in at least one group of pixel units, and generating a target image according to an output standard TDI image, wherein the resolution of the standard TDI image is the standard image resolution, and the pixel size of the image is a standard size.
5. The pixel arrangement method of claim 4, wherein when the mode command is a standard HDR mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array comprises:
exposing the first pixel group and/or the second pixel group in at least one group of pixel units for different time, outputting images with different brightness, fusing the images with different brightness, and generating a target image according to the output high dynamic range image, wherein the resolution of the high dynamic range image is the standard image resolution, and the pixel size of the high dynamic range image is the standard size.
6. The pixel arrangement method of a line image sensor capable of improving resolution according to claim 2, wherein when the mode instruction is a high resolution single line mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array comprises:
and running a camera carrying the linear array image sensor at 2 times of line frequency, wherein the first pixel group corresponds to the second pixel group to generate a first standard image and a second standard image which are different from each other by 1/2 rectangular pixel in the second direction and the first direction, the first standard image and the second standard image are subjected to resolving or crossed arrangement to obtain a high-resolution image, a target image is generated according to the high-resolution image, the resolution of the high-resolution image is 2 times of that of the standard resolution, when the pixel size of the target image obtained through resolving is 1/2 of that of the standard image, and when the pixel size of the target image obtained through crossed arrangement is the standard size.
7. The pixel arrangement method of claim 6, wherein when the mode instruction is a high resolution TDI mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array comprises:
and performing time delay integration TDI processing on the at least two groups of high-resolution images, and generating a target image according to the output high-resolution TDI images.
8. The pixel arrangement method of claim 7, wherein when the mode instruction is a high resolution HDR mode, the step of performing corresponding image processing on the image to be processed using the constructed pixel array comprises:
and exposing the at least two groups of high-resolution images for different time, outputting the images with different brightness, fusing the images with different brightness, and generating a target image according to the output high-resolution high-dynamic range images.
9. The pixel arrangement method of a line image sensor for resolution enhancement according to any one of claims 1 to 8, wherein the image to be processed includes three pixel arrays, the starting positions of the three pixel arrays are aligned, and the three pixel arrays correspond to R, G, B channels, respectively.
10. The pixel arrangement method of any one of claims 1 to 8, wherein the image to be processed includes two pixel arrays, the initial positions of the two pixel arrays are aligned, one pixel array corresponds to two channels in R, G, B, and the other pixel array corresponds to the other channel of R, G, B channels except the first pixel array channel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211687419.XA CN116017181A (en) | 2022-12-27 | 2022-12-27 | Pixel arrangement method of linear array image sensor capable of improving resolution |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211687419.XA CN116017181A (en) | 2022-12-27 | 2022-12-27 | Pixel arrangement method of linear array image sensor capable of improving resolution |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116017181A true CN116017181A (en) | 2023-04-25 |
Family
ID=86020418
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211687419.XA Pending CN116017181A (en) | 2022-12-27 | 2022-12-27 | Pixel arrangement method of linear array image sensor capable of improving resolution |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116017181A (en) |
-
2022
- 2022-12-27 CN CN202211687419.XA patent/CN116017181A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021227250A1 (en) | Image sensor and electronic device | |
| US9609208B2 (en) | Image generation method, image generation apparatus, program, and storage medium | |
| EP2415254B1 (en) | Exposing pixel groups in producing digital images | |
| US12028610B2 (en) | Imaging device, image processing device, and electronic apparatus | |
| TWI386049B (en) | A solid-state imaging device, and a device using the solid-state imaging device | |
| US9438827B2 (en) | Imaging systems and methods for generating binned high-dynamic-range images | |
| JP5850680B2 (en) | Imaging apparatus and control method thereof | |
| US7646413B2 (en) | Imaging device for adding signals including same color component | |
| CN113170061B (en) | Image sensor, imaging device, electronic apparatus, image processing system, and signal processing method | |
| JP2013546249A (en) | Imaging system and imaging method using multi-aperture camera | |
| CN111201780B (en) | Imaging apparatus and method, and image processing apparatus and method | |
| US8111298B2 (en) | Imaging circuit and image pickup device | |
| JP2015185943A (en) | Microlens with filter array and solid state image sensor | |
| US20230007191A1 (en) | Image sensor, imaging apparatus, electronic device, image processing system, and signal processing method | |
| US20160205335A1 (en) | Solid-state imaging device | |
| WO2023124607A1 (en) | Image generation method and apparatus, electronic device, and computer-readable storage medium | |
| WO2023082766A1 (en) | Image sensor, camera module, electronic device, and image generation method and apparatus | |
| CN114584725A (en) | Image sensor and imaging device | |
| US9645290B2 (en) | Color filter array and solid-state image sensor | |
| CN116017181A (en) | Pixel arrangement method of linear array image sensor capable of improving resolution | |
| CN114666469B (en) | Image processing device, method and lens module with image processing device | |
| CN116349239A (en) | Color imaging system | |
| CN216873256U (en) | Image sensor for partially shielding phase focusing by shared micro-lens | |
| CN115988299A (en) | Image sensor sharing microlens to partially shield phase focusing and control method thereof | |
| JP2005117192A (en) | Drive method of solid-state imaging apparatus, and camera employing the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |