US20240031700A1 - Method for forming a digital image - Google Patents
Method for forming a digital image Download PDFInfo
- Publication number
- US20240031700A1 US20240031700A1 US18/032,375 US202218032375A US2024031700A1 US 20240031700 A1 US20240031700 A1 US 20240031700A1 US 202218032375 A US202218032375 A US 202218032375A US 2024031700 A1 US2024031700 A1 US 2024031700A1
- Authority
- US
- United States
- Prior art keywords
- ccd
- image
- ccd arrays
- arrays
- optical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 14
- 238000003491 array Methods 0.000 claims abstract description 63
- 230000003287 optical effect Effects 0.000 claims description 34
- 238000012805 post-processing Methods 0.000 claims description 7
- 230000007935 neutral effect Effects 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 4
- 238000001444 catalytic combustion detection Methods 0.000 description 8
- 230000035945 sensitivity Effects 0.000 description 7
- 101100115215 Caenorhabditis elegans cul-2 gene Proteins 0.000 description 6
- 238000009825 accumulation Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000009792 diffusion process Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000001816 cooling Methods 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/41—Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
- H04N25/75—Circuitry for providing, modifying or processing image signals from the pixel array
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
- H04N25/74—Circuitry for scanning or addressing the pixel array
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/14—Beam splitting or combining systems operating by reflection only
- G02B27/144—Beam splitting or combining systems operating by reflection only using partially transparent surfaces without spectral selectivity
Definitions
- the invention relates to television methods for generating an image.
- the invention is applicable in television systems for vehicle registration plate recognition and in iris identification systems. It is most relevant to use this invention when creating television systems with 4 K and 8 K UHD digital formats, as well as professional digital photo cameras for studio or artistic shooting with printing quality.
- CCD Charge Coupled Device
- the digital video equipment refers to digital photo and video cameras. It is known that that a reduction of pixel sizes does not always improve overall image quality [see Eisman, Katherine, Duggan, Sean, Gray Tim. A36 Encyclopedia of Digital Photography, 3rd ed.: Translated from English-M.: I.D. Williams”, 2011.-560 pp.: II.-parallel title in English, ISBN 978-5-8459-1724-9, p. 73 (Russian)]. Since small pixels are less sensitive to light, their signal must be amplified more and, consequently, a noise level in the resulting image increases.
- the prior art discloses a method for generating an image that has a gigapixel resolution [see Ferra.Ru, Gigapixel camera AWARE2 . . . , 21 Jun. 2012.].
- the image is generated using 98 photomodules. Each photomodule comprises a 14-megapixel sensor.
- the resulting black and white image is generated by computer-merging individual frames within 18 seconds.
- the above-described method suffers from the following disadvantages: high cost, high power consumption, the inability to pick up moving objects, and the need for cooling.
- RU 2158486 [21 Oct. 2000] discloses a method for scanning a color image and a device for its implementation. The method involves dividing the entire scanning field into elementary sections, scanning each section multiple times with a head that comprises a CCD array. Then, the video signal (v/s) resulted from several scans of each section is averaged to increase a signal-to-noise ratio (s/n).
- the image of the entire scanning field with an increased resolution is generated by electronically merging all elementary sections.
- the method disclosed in RU 2158486 suffers from the following disadvantages: the presence of an electromechanical assembly which worsens the operational reliability of the whole system, and the inability to pick up moving objects.
- RU 2143789 [27 Dec. 1999] discloses a method for generating high-definition television images in a camera based on conventional CCDs. The method involves receiving a v/s from CCD arrays operating in parallel, performing the simultaneous digitization, pre-processing and writing of the v/s to a memory, reading it at an increased clock rate, and performing the final processing of the v/s.
- RU 2143789 [27 Dec. 1999] also discloses a device for generating high-definition television images in a camera based on conventional CCDs.
- the device is designed as follows: an optical unit generates two images identical in optical parameters, and the images are then projected onto two CCDs such that two superimposed images are obtained. These images are shifted relative to each other: a horizontal shift is equal to half the distance between pixels, while a vertical shift is equal to half a line spacing.
- Video signals from the CCD arrays operating in a conventional scanning standard are simultaneously digitized, pre-processed and recorded in the memory, each in its own channel. Thus, an information field is created. The cells of the information field are filled with the processed signal and are arranged in a checkerboard pattern.
- the parallel-sequential reading of information from the memory is performed. Said reading is performed at a quadruple clock rate according to the principle “through the element/through the line”. There is a simple summation of the video signals v/s from both CCD arrays. Then, this information is subjected to final processing.
- a single technical result achieved when implementing the claimed group of inventions is an increase in the quality of a digital image by increasing its resolution by n times.
- the sensitivity of devices does not deteriorate and is determined by selected CCD arrays.
- a claimed method for generating a digital image using multiple CCDs consists in that the CCDs operate in a conventional scanning standard and in parallel. An optical image is simultaneously projected onto the CCD arrays. The CCD arrays are shifted relative to each other, and all video signals from the CCD arrays are simultaneously digitized, pre-processed, recorded in a memory, thereby creating an information field that is read at an increased clock rate and post-processed.
- the optical image is generated on an area equal to a sum of photosensitive areas of n CCD arrays, which is simultaneously projected via four channels onto all CCD arrays which are shifted relative to each other such that each of the CCD arrays generates a video signal from only one of n sectors of the given image.
- n m 2 , where m is the number of the CCD arrays both vertically and horizontally, starting from two. Moreover, the CCD arrays of one channel generates video signals from those sectors of the image that do not border on each other.
- the information field is read at a rate n times higher than the clock rate by sequentially and electronically combining the video signals from lines of the CCD arrays that convert adjacent sectors of the image horizontally but arranged in different channels, and by sequentially and electronically combining the video signals from frames of the CCD arrays that convert adjacent sectors of the image vertically but arranged in different channels.
- An apparatus for generating a digital image using multiple CCDs comprises an optical unit which includes a lens and a neutral translucent mirror optically coupled to the lens.
- the outputs of the optical unit are connected to the corresponding inputs of optical image-to-digital signal converters which comprise serially connected CCD, analog-digital converter (ADC), pre-processing unit, and memory unit.
- the outputs of the optical image-to-digital signal converters are connected through a switch to the input of a post-processing unit, the output of which is an output of the apparatus.
- the control inputs of the CCD, ADC, memory unit and switch are connected to the corresponding outputs of a control unit.
- the lens generates an optical image on an area equal to a sum of light-sensitive areas of n CCD arrays.
- Two neutral translucent mirrors are introduced into the optical unit, for which reason it is made with four outputs connected to the corresponding inputs of n optical image-to-digital signal converters, the outputs of the latter are connected with the inputs of the switch.
- the size of the photosensitive area is understood not as the entire area of the accumulation section of the CCD array, which determines a total resolution, but as the area that determines an effective resolution.
- the area that determines the effective resolution is limited by the line spacing of the CCD array vertically and by diffusion regions horizontally. In this case, the effective resolution is always slightly less than the total one, because the elements arranged at the edges of the crystal are more prone to defects. All information accumulated in the CCD arrays is simultaneously displayed at a low clock rate, digitized, pre-processed, and only that part of the information which relates to the light-sensitive areas is stored in the memory.
- four identical optical images provide a necessary and sufficient condition for generating a digital image using n identical CCD arrays.
- the CCD arrays are installed in the plane of the image such that the area defining the effective resolution coincides with the area of the corresponding sector of the image.
- the proposed technical solutions make it possible to improve the quality of a digital image by increasing its resolution by n times. At the same time, the sensitivity does not deteriorate and is determined by the selected CCD arrays.
- FIG. 1 shows a block diagram of an apparatus for generating a digital image using multiple CCDs.
- FIG. 2 shows a subject 6 to be imaged, a scheme for generating four identical images 16 , 17 , 18 , 19 , and the arrangement of accumulation sections 12 , 13 , 14 , 15 of corresponding CCD 1 , CCD 2 , CCD 3 , and CCD 4 in image data planes.
- FIG. 3 explains a principle of electronically combining the v/s of corresponding lines of the CCD 1 and the CCD 2 and the v/s of corresponding lines of the CCD 3 and the CCD 4 .
- FIG. 4 shows the arrangement of accumulation sections 20 , 21 , . . . 28 of corresponding CCD 5 , CCD 6 , . . . CCD 13 in optical image planes 16 , 17 , 18 and 19 .
- FIG. 5 explains a principle of electronically combining the v/s of corresponding lines of the CCD 5 , the CCD 9 and the CCD 6 , the v/s of corresponding lines of the CCD 11 , the CCD 13 and the CCD 12 , as well as the v/s of corresponding lines of the CCD 7 , the CCD 10 and the CCD 8 .
- An apparatus for generating a digital image using multiple CCDs comprises an optical unit (OU) 1 , the four outputs of which are connected to the inputs of n optical image-to-digital signal converters (OIDSCs) 2 , the outputs of which are connected through a switch (S) 3 to the input of a post-processing unit (PPU) 4 .
- the output 4 is the output of the apparatus.
- Control inputs 2 and 3 are connected to the corresponding outputs of a control unit (CU) 5 .
- the optical unit 1 generates an image on an area equal to the sum of photosensitive areas of n CCD arrays. This image is fed on four channels to the inputs of the n OIDSCs. All OIDSCs are denoted by the reference sign “2”, since they are identical and each of them consists of serially connected CCD, ADC, preprocessing unit and memory unit. All the elements of the block diagram of the apparatus ( FIG. 1 ) are known and industrially applicable. Moreover, digitized video signals, each in its channel, are balanced according to the levels of “black” and “white” with an accuracy of one least significant bit of quantization, subjected to desired special processing and recorded in the memory units. In the post-processing unit 4 , post-processing is carried out, including full aperture correction.
- a jug is selected as a subject 6 to be imaged ( FIG. 2 ).
- a lens (L) 7 generates an image on an area equal to the sum of light-sensitive areas of four CCD arrays.
- the image is converted by neutral translucent mirrors (TM) 8 , 9 and 10 into four congruent images 16 , 17 , 18 and 19 , which are simultaneously projected through the four channels onto accumulation sections 12 , 13 , 14 and 15 of corresponding CCD 1 , CCD 2 , CCD 3 and CCD 4 .
- the CCD arrays are shifted relative to each other such that each of them generates a v/s from only one of the four sectors of the given image.
- the CCD arrays are mounted in the planes of the image such that the boundaries of the sectors, which shown by means of the dashed line in FIG. 2 , pass along line spacings of the CCD arrays horizontally and along diffusion regions vertically.
- the sectors of the image must be the same and match in size with the photosensitive areas of the CCD arrays.
- the video signals from the CCD arrays operating in standard modes are simultaneously digitized, pre-processed and recorded in the memory of the corresponding OIDSCs 2 . This creates an information field. From the outputs of the OIDSCs 2 , the information field is read at a quadruple clock rate using the switch (S) 3 and the control unit (CU) and fed to the input of the post-processing unit (PPU) 4 .
- a digital Vis is generated, which corresponds to a high quality digital image. From FIG. 2 it follows that the spatial arrangement of the accumulation sections 12 , 13 , 14 and 15 of the corresponding CCD 1 , CCD 2 , CCD 3 and CCD 4 in the planes of the four images 16 , 17 , 18 and 19 makes it possible to generate the corresponding digital v/s.
- a horizontal digital v/s is generated by serially and electronically combining the video signals of the corresponding lines of the CCD 1 with the CCD 2 and the CCD 3 with the CCD 4 .
- a vertical digital v/s is generated by serially and electronically combining the video signals of the corresponding frames of the CCD 1 with the CCD 3 and the CCD 2 with the CCD 4 .
- These CCD arrays convert the adjacent sectors of the image, but are in different channels.
- the electronic combination of the video signals allows doubling the horizontal resolution and doubling the vertical resolution.
- the lines of the CCD arrays ( FIG. 3 ) comprise 16 light-sensitive elements in analog form.
- the image is converted to the digital v/s having a quadrupled resolution at the selected sensitivity of the CCD arrays used.
- a frame output time does not change. This means that the quality of the digital image has improved.
- the whole process of generating a digital image is essentially the same as discussed above.
- the difference lies in the fact that the lens (L) 7 generates the image on an area equal to the sum of the light-sensitive areas of nine CCD arrays, and the information field is read from the corresponding OIDSCs 2 at a rate nine times higher than the clock rate.
- FIG. 4 shows the arrangement of accumulation sections 20 , 21 , . . . 28 of corresponding CCD 5 , CCD 6 , . . . CCD 13 in the planes of four images 16 , 17 , 18 and 19 .
- the CCD arrays are shifted such that each of them generates a v/s from only one of the nine sectors of the given image. From FIG. 5 it can be seen that the CCD arrays of one channel generate the v/s from those sectors of the image which do not border on each other.
- the horizontal digital v/s is generated by sequentially and electronically combining the video signals of the corresponding lines of the CCD 5 with the CCD 9 and the CCD 6 , the video signals of the CCD 11 with the CCD 13 and the CCD 12 , as well as the video signals of the CCD 7 with the CCD 10 and the CCD 8 .
- the vertical digital v/s is generated by sequentially and electronically combining the video signals of the corresponding frames of the CCD 5 with the CCD 11 and the CCD 7 , the video signals of the CCD 9 with the CCD 13 and the CCD 10 , as well as the video signals of the CCD 6 with the CCD 12 and the CCD 8 .
- These CCD arrays convert the adjacent sectors of the image, but are in different channels. This increases the resolution per line by a factor of three and per frame by a factor of three.
- the lines of the CCD arrays ( FIG. 5 ) comprise ten light-sensitive elements in analog form.
- the optical image is converted into the digital v/s having a resolution increased by nine times at the selected sensitivity of the CCD arrays used. In this case, the frame output time does not change. This means that the quality of the digital image has improved.
- a single technical result achieved when implementing the claimed group of inventions is an increase in the quality of a digital image by increasing its resolution by n times.
- the sensitivity of the apparatus has not deteriorated and is determined by the selected CCD arrays.
- the maximum achievable quality of a digital image depends on the ability of an optical system to create an optical image of desired format in a focal plane.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Studio Devices (AREA)
Abstract
A technical solution is provided, which allows generating a high-quality digital image using multiple CCD arrays. More specifically, a lens generates an image on an area equal to the sum of photosensitive areas of n CCD arrays. The CCD arrays are shifted from one another. The image is projected via four channels onto all the CCD arrays such that each of said arrays generates a video signal from only one of n sectors of the image. The video signals from the CCD arrays, which operate on a conventional scanning standard and in parallel, are digitized, pre-processed and recorded in a memory from which they are read at a rate n times higher than a clock rate. A digital image is produced by electronically combining the video signals from the CCD arrays that convert adjacent sectors of the image, after which the video signal is post-processed.
Description
- The invention relates to television methods for generating an image. The invention is applicable in television systems for vehicle registration plate recognition and in iris identification systems. It is most relevant to use this invention when creating television systems with 4K and 8K UHD digital formats, as well as professional digital photo cameras for studio or artistic shooting with printing quality.
- An increase in the resolution of digital video equipment that uses Charge Coupled Device (CCD) arrays is provided at the cost of a decrease in its sensitivity. The digital video equipment refers to digital photo and video cameras. It is known that that a reduction of pixel sizes does not always improve overall image quality [see Eisman, Katherine, Duggan, Sean, Gray Tim. A36 Encyclopedia of Digital Photography, 3rd ed.: Translated from English-M.: I.D. Williams”, 2011.-560 pp.: II.-parallel title in English, ISBN 978-5-8459-1724-9, p. 73 (Russian)]. Since small pixels are less sensitive to light, their signal must be amplified more and, consequently, a noise level in the resulting image increases. There are aberration-free optical systems for large format. Therefore, to improve the quality of a digital image, it is necessary to have a CCD array with an area that can accommodate a maximum number of large pixels. However, the creation of CCD arrays having such dimensions and such parameters is associated with enormous costs. It is known that the world's first large-format digital camera LS 911, which has a 12-megapixel SMOS-
array 9×11 inches, costs 106 thousand dollars [see Large Sense L5911—the first large-format digital camera. Cameralabs.org. Largesense L5911.]. - The prior art discloses a method for generating an image that has a gigapixel resolution [see Ferra.Ru, Gigapixel camera AWARE2 . . . , 21 Jun. 2012.]. The image is generated using 98 photomodules. Each photomodule comprises a 14-megapixel sensor. The resulting black and white image is generated by computer-merging individual frames within 18 seconds.
- The above-described method suffers from the following disadvantages: high cost, high power consumption, the inability to pick up moving objects, and the need for cooling.
- RU 2158486 [21 Oct. 2000] discloses a method for scanning a color image and a device for its implementation. The method involves dividing the entire scanning field into elementary sections, scanning each section multiple times with a head that comprises a CCD array. Then, the video signal (v/s) resulted from several scans of each section is averaged to increase a signal-to-noise ratio (s/n).
- The image of the entire scanning field with an increased resolution is generated by electronically merging all elementary sections.
- The method disclosed in RU 2158486 suffers from the following disadvantages: the presence of an electromechanical assembly which worsens the operational reliability of the whole system, and the inability to pick up moving objects.
- RU 2143789 [27 Dec. 1999] discloses a method for generating high-definition television images in a camera based on conventional CCDs. The method involves receiving a v/s from CCD arrays operating in parallel, performing the simultaneous digitization, pre-processing and writing of the v/s to a memory, reading it at an increased clock rate, and performing the final processing of the v/s.
- RU 2143789 [27 Dec. 1999] also discloses a device for generating high-definition television images in a camera based on conventional CCDs. The device is designed as follows: an optical unit generates two images identical in optical parameters, and the images are then projected onto two CCDs such that two superimposed images are obtained. These images are shifted relative to each other: a horizontal shift is equal to half the distance between pixels, while a vertical shift is equal to half a line spacing. Video signals from the CCD arrays operating in a conventional scanning standard are simultaneously digitized, pre-processed and recorded in the memory, each in its own channel. Thus, an information field is created. The cells of the information field are filled with the processed signal and are arranged in a checkerboard pattern. To obtain a high-definition television image, the parallel-sequential reading of information from the memory is performed. Said reading is performed at a quadruple clock rate according to the principle “through the element/through the line”. There is a simple summation of the video signals v/s from both CCD arrays. Then, this information is subjected to final processing.
- The method and device disclosed in RU 2143789 suffer from the following disadvantages:
-
- the low quality of the television image, which is limited by HDTV parameters;
- the low quality of the television image due to the blurring of fine details and contours of the optical image.
- A single technical result achieved when implementing the claimed group of inventions is an increase in the quality of a digital image by increasing its resolution by n times. In this case, the sensitivity of devices does not deteriorate and is determined by selected CCD arrays.
- A claimed method for generating a digital image using multiple CCDs consists in that the CCDs operate in a conventional scanning standard and in parallel. An optical image is simultaneously projected onto the CCD arrays. The CCD arrays are shifted relative to each other, and all video signals from the CCD arrays are simultaneously digitized, pre-processed, recorded in a memory, thereby creating an information field that is read at an increased clock rate and post-processed.
- According to the invention, the optical image is generated on an area equal to a sum of photosensitive areas of n CCD arrays, which is simultaneously projected via four channels onto all CCD arrays which are shifted relative to each other such that each of the CCD arrays generates a video signal from only one of n sectors of the given image.
- The number n=m2, where m is the number of the CCD arrays both vertically and horizontally, starting from two. Moreover, the CCD arrays of one channel generates video signals from those sectors of the image that do not border on each other.
- The information field is read at a rate n times higher than the clock rate by sequentially and electronically combining the video signals from lines of the CCD arrays that convert adjacent sectors of the image horizontally but arranged in different channels, and by sequentially and electronically combining the video signals from frames of the CCD arrays that convert adjacent sectors of the image vertically but arranged in different channels.
- An apparatus for generating a digital image using multiple CCDs comprises an optical unit which includes a lens and a neutral translucent mirror optically coupled to the lens. The outputs of the optical unit are connected to the corresponding inputs of optical image-to-digital signal converters which comprise serially connected CCD, analog-digital converter (ADC), pre-processing unit, and memory unit. The outputs of the optical image-to-digital signal converters are connected through a switch to the input of a post-processing unit, the output of which is an output of the apparatus. The control inputs of the CCD, ADC, memory unit and switch are connected to the corresponding outputs of a control unit.
- According to the invention, the lens generates an optical image on an area equal to a sum of light-sensitive areas of n CCD arrays. Two neutral translucent mirrors are introduced into the optical unit, for which reason it is made with four outputs connected to the corresponding inputs of n optical image-to-digital signal converters, the outputs of the latter are connected with the inputs of the switch.
- The size of the photosensitive area is understood not as the entire area of the accumulation section of the CCD array, which determines a total resolution, but as the area that determines an effective resolution. The area that determines the effective resolution is limited by the line spacing of the CCD array vertically and by diffusion regions horizontally. In this case, the effective resolution is always slightly less than the total one, because the elements arranged at the edges of the crystal are more prone to defects. All information accumulated in the CCD arrays is simultaneously displayed at a low clock rate, digitized, pre-processed, and only that part of the information which relates to the light-sensitive areas is stored in the memory.
- According to the claimed group of inventions, four identical optical images provide a necessary and sufficient condition for generating a digital image using n identical CCD arrays. The CCD arrays are installed in the plane of the image such that the area defining the effective resolution coincides with the area of the corresponding sector of the image.
- By using the lens that generates the optical image of a desired format and the neutral translucent mirrors that project this image via the four channels on n CCD arrays (where each of the CCD arrays generates the video signal from only one of the n sectors of this image), it is possible to improve the quality of the digital image. This happens, among other things, due to the electronic combination of the video signals from the CCD arrays which convert the adjacent sectors of the image both horizontally and vertically.
- Thus, by selecting the CCD arrays with a certain pixel size (certain sensitivity), it is possible to increase their number until a desired resolution is obtained. When using this method, there is no need for a CCD array which can accommodate a maximum number of large pixels.
- The proposed technical solutions make it possible to improve the quality of a digital image by increasing its resolution by n times. At the same time, the sensitivity does not deteriorate and is determined by the selected CCD arrays.
-
FIG. 1 shows a block diagram of an apparatus for generating a digital image using multiple CCDs. -
FIG. 2 shows a subject 6 to be imaged, a scheme for generating fouridentical images accumulation sections corresponding CCD 1,CCD 2,CCD 3, andCCD 4 in image data planes. -
FIG. 3 explains a principle of electronically combining the v/s of corresponding lines of theCCD 1 and theCCD 2 and the v/s of corresponding lines of theCCD 3 and theCCD 4. -
FIG. 4 shows the arrangement ofaccumulation sections corresponding CCD 5,CCD 6, . . .CCD 13 in optical image planes 16, 17, 18 and 19. -
FIG. 5 explains a principle of electronically combining the v/s of corresponding lines of theCCD 5, theCCD 9 and theCCD 6, the v/s of corresponding lines of theCCD 11, theCCD 13 and theCCD 12, as well as the v/s of corresponding lines of theCCD 7, theCCD 10 and theCCD 8. - An apparatus for generating a digital image using multiple CCDs (
FIG. 1 ) comprises an optical unit (OU) 1, the four outputs of which are connected to the inputs of n optical image-to-digital signal converters (OIDSCs) 2, the outputs of which are connected through a switch (S) 3 to the input of a post-processing unit (PPU) 4. Theoutput 4 is the output of the apparatus.Control inputs - The
optical unit 1 generates an image on an area equal to the sum of photosensitive areas of n CCD arrays. This image is fed on four channels to the inputs of the n OIDSCs. All OIDSCs are denoted by the reference sign “2”, since they are identical and each of them consists of serially connected CCD, ADC, preprocessing unit and memory unit. All the elements of the block diagram of the apparatus (FIG. 1 ) are known and industrially applicable. Moreover, digitized video signals, each in its channel, are balanced according to the levels of “black” and “white” with an accuracy of one least significant bit of quantization, subjected to desired special processing and recorded in the memory units. In thepost-processing unit 4, post-processing is carried out, including full aperture correction. - Operation of the Apparatus at n=4
- A jug is selected as a subject 6 to be imaged (
FIG. 2 ). A lens (L) 7 generates an image on an area equal to the sum of light-sensitive areas of four CCD arrays. The image is converted by neutral translucent mirrors (TM) 8, 9 and 10 into fourcongruent images accumulation sections corresponding CCD 1,CCD 2,CCD 3 andCCD 4. - The CCD arrays are shifted relative to each other such that each of them generates a v/s from only one of the four sectors of the given image.
- The CCD arrays are mounted in the planes of the image such that the boundaries of the sectors, which shown by means of the dashed line in
FIG. 2 , pass along line spacings of the CCD arrays horizontally and along diffusion regions vertically. The sectors of the image must be the same and match in size with the photosensitive areas of the CCD arrays. The video signals from the CCD arrays operating in standard modes are simultaneously digitized, pre-processed and recorded in the memory of thecorresponding OIDSCs 2. This creates an information field. From the outputs of theOIDSCs 2, the information field is read at a quadruple clock rate using the switch (S) 3 and the control unit (CU) and fed to the input of the post-processing unit (PPU) 4. At theoutput 4, a digital Vis is generated, which corresponds to a high quality digital image. FromFIG. 2 it follows that the spatial arrangement of theaccumulation sections corresponding CCD 1,CCD 2,CCD 3 andCCD 4 in the planes of the fourimages - A horizontal digital v/s is generated by serially and electronically combining the video signals of the corresponding lines of the
CCD 1 with theCCD 2 and theCCD 3 with theCCD 4. A vertical digital v/s is generated by serially and electronically combining the video signals of the corresponding frames of theCCD 1 with theCCD 3 and theCCD 2 with theCCD 4. These CCD arrays convert the adjacent sectors of the image, but are in different channels. The electronic combination of the video signals allows doubling the horizontal resolution and doubling the vertical resolution. For clarity, the lines of the CCD arrays (FIG. 3 ) comprise 16 light-sensitive elements in analog form. - From the description of the graphic material, it follows that the image is converted to the digital v/s having a quadrupled resolution at the selected sensitivity of the CCD arrays used. In this case, a frame output time does not change. This means that the quality of the digital image has improved.
- Operation of the Apparatus at n=9
- In this case, the whole process of generating a digital image is essentially the same as discussed above. The difference lies in the fact that the lens (L) 7 generates the image on an area equal to the sum of the light-sensitive areas of nine CCD arrays, and the information field is read from the
corresponding OIDSCs 2 at a rate nine times higher than the clock rate. -
FIG. 4 shows the arrangement ofaccumulation sections corresponding CCD 5,CCD 6, . . .CCD 13 in the planes of fourimages FIG. 5 it can be seen that the CCD arrays of one channel generate the v/s from those sectors of the image which do not border on each other. - The horizontal digital v/s is generated by sequentially and electronically combining the video signals of the corresponding lines of the
CCD 5 with theCCD 9 and theCCD 6, the video signals of theCCD 11 with theCCD 13 and theCCD 12, as well as the video signals of theCCD 7 with theCCD 10 and theCCD 8. The vertical digital v/s is generated by sequentially and electronically combining the video signals of the corresponding frames of theCCD 5 with theCCD 11 and theCCD 7, the video signals of theCCD 9 with theCCD 13 and theCCD 10, as well as the video signals of theCCD 6 with theCCD 12 and theCCD 8. These CCD arrays convert the adjacent sectors of the image, but are in different channels. This increases the resolution per line by a factor of three and per frame by a factor of three. For clarity, the lines of the CCD arrays (FIG. 5 ) comprise ten light-sensitive elements in analog form. - From the description of the graphic material, it follows that the optical image is converted into the digital v/s having a resolution increased by nine times at the selected sensitivity of the CCD arrays used. In this case, the frame output time does not change. This means that the quality of the digital image has improved.
- A single technical result achieved when implementing the claimed group of inventions is an increase in the quality of a digital image by increasing its resolution by n times. At the same time, the sensitivity of the apparatus has not deteriorated and is determined by the selected CCD arrays. The maximum achievable quality of a digital image depends on the ability of an optical system to create an optical image of desired format in a focal plane.
Claims (2)
1. A method for generating a digital image using multiple Charge Coupled Device (CCD) arrays,
wherein the CCD arrays are caused to operate in a conventional scanning standard and in parallel, an optical image is projected simultaneously onto the CCD arrays, the CCD arrays are shifted relative to each other, all video signals from the CCD arrays are simultaneously digitized, pre-processed, recorded in a memory, thereby creating an information field that is read at an increased clock rate and post-processed;
wherein the optical image is generated on an area equal to a sum of photosensitive areas of n CCD arrays, the optical image is projected simultaneously via four channels onto the CCD arrays which are shifted relative to each other such that each of the CCD arrays generates a video signal from only one of n sectors of the image, n=m2, where m is a number of the CCD arrays both vertically and horizontally, starting from two;
wherein the CCD arrays of one channel generates video signals from those sectors of the image that do not border on each other, and the information field is read at a rate n times higher than the clock rate by sequentially and electronically combining the video signals from lines of the CCD arrays that convert adjacent sectors of the image horizontally but arranged in different channels, and by sequentially and electronically combining the video signals from frames of the CCD arrays that convert adjacent sectors of the image vertically but arranged in different channels.
2. An apparatus for generating a digital image using multiple Charge Coupled Device (CCD) arrays, comprising an optical unit which includes a lens and a neutral translucent mirror optically coupled to the lens;
wherein the optical unit has outputs connected to corresponding inputs of optical image-to-digital signal converters which comprise serially connected CCD, analog-digital converter (ADC), pre-processing unit, and memory unit;
wherein the optical image-to-digital signal converters have outputs connected through a switch to the input of a post-processing unit, the post-processing unit having an output that is an output of the apparatus;
wherein control inputs of the CCD, ADC, memory unit and switch are connected to corresponding outputs of a control unit;
wherein the lens is configured to generate an optical image on an area equal to a sum of light-sensitive areas of n CCD arrays,
wherein two neutral translucent mirrors are included into the optical unit, for which reason the optical unit has four outputs connected to corresponding inputs of n optical image-to-digital signal converters, the outputs of the n optical image-to-digital signal converters being connected with the inputs of the switch.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
RU2021112571A RU2769274C1 (en) | 2021-04-28 | 2021-04-28 | Method of forming digital image using several ccd and device for implementation thereof |
RU2021112571 | 2021-04-28 | ||
PCT/RU2021/000481 WO2022231465A1 (en) | 2021-04-28 | 2021-11-03 | Method for forming a digital image |
Publications (1)
Publication Number | Publication Date |
---|---|
US20240031700A1 true US20240031700A1 (en) | 2024-01-25 |
Family
ID=80248320
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/032,375 Active US11902683B1 (en) | 2021-04-28 | 2021-11-03 | Method for forming a digital image |
US18/032,375 Granted US20240031700A1 (en) | 2021-04-28 | 2022-11-03 | Method for forming a digital image |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/032,375 Active US11902683B1 (en) | 2021-04-28 | 2021-11-03 | Method for forming a digital image |
Country Status (4)
Country | Link |
---|---|
US (2) | US11902683B1 (en) |
JP (1) | JP2024516271A (en) |
RU (1) | RU2769274C1 (en) |
WO (1) | WO2022231465A1 (en) |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100283842A1 (en) * | 2007-04-19 | 2010-11-11 | Dvp Technologies Ltd. | Imaging system and method for use in monitoring a field of regard |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2737326B1 (en) * | 1995-07-28 | 1997-10-17 | Centre Nat Etd Spatiales | PROCESS FOR THE PROCESSING OR TRANSMISSION OF AN ACQUIRED IMAGE IN THE FORM OF A PIXEL MATRIX |
RU2143789C1 (en) * | 1998-01-23 | 1999-12-27 | Московское конструкторское бюро "Электрон" | Method of generation of high-resolution tv picture in camera on traditional charge-coupled devices and gear for its realization |
JP2006304154A (en) * | 2005-04-25 | 2006-11-02 | Nisco Kk | Television camera apparatus for inspecting reactor internals |
RU2428810C1 (en) * | 2010-06-11 | 2011-09-10 | Вячеслав Михайлович Смелков | Television camera for viewing in conditions of low illumination and/or low brightness of objects |
CN102752503B (en) * | 2012-07-09 | 2014-11-05 | 中国兵器工业第二0五研究所 | TV camera device with four spliced double-light-path CCDs (Charge Coupled Devices) |
US9491377B2 (en) * | 2013-08-07 | 2016-11-08 | Trimble Navigation Limited | Methods of extracting 4-band data from a single CCD; methods of generating 4×4 or 3×3 color correction matrices using a single CCD |
-
2021
- 2021-04-28 RU RU2021112571A patent/RU2769274C1/en active
- 2021-11-03 JP JP2023567038A patent/JP2024516271A/en active Pending
- 2021-11-03 US US18/032,375 patent/US11902683B1/en active Active
- 2021-11-03 WO PCT/RU2021/000481 patent/WO2022231465A1/en active Application Filing
-
2022
- 2022-11-03 US US18/032,375 patent/US20240031700A1/en active Granted
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100283842A1 (en) * | 2007-04-19 | 2010-11-11 | Dvp Technologies Ltd. | Imaging system and method for use in monitoring a field of regard |
Also Published As
Publication number | Publication date |
---|---|
US11902683B1 (en) | 2024-02-13 |
JP2024516271A (en) | 2024-04-12 |
RU2021112571A3 (en) | 2022-02-01 |
RU2769274C1 (en) | 2022-03-29 |
RU2021112571A (en) | 2021-09-13 |
WO2022231465A1 (en) | 2022-11-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US4967264A (en) | Color sequential optical offset image sampling system | |
US9681057B2 (en) | Exposure timing manipulation in a multi-lens camera | |
US20100066875A1 (en) | Imaging device for adding signals including same color component | |
JPH03502755A (en) | Photoelectric color image sensor | |
US5694165A (en) | High definition image taking apparatus having plural image sensors | |
JP2017216646A (en) | Imaging device, imaging apparatus and imaging signal processing method | |
JP3970185B2 (en) | Solid-state image sensor and digital camera | |
JP6525539B2 (en) | Imaging device and imaging device | |
JP2002064754A (en) | Method and device for extending effective dynamic range of image pickup device | |
US6429953B1 (en) | Super resolution scanning using color multiplexing of image capture devices | |
KR100215226B1 (en) | Imaging circuit | |
US5877807A (en) | Optoelectronic colored image converter | |
US20210203829A1 (en) | Imaging apparatus, exposure controlling method, program and imaging device | |
US11902683B1 (en) | Method for forming a digital image | |
US7230646B2 (en) | Single sensor electronic video camera technique with diagonally coupled pixels | |
JP2017216649A (en) | Imaging device, imaging apparatus and imaging signal processing method | |
JP3808610B2 (en) | Imaging device | |
JPH06292052A (en) | Still picture image pickup device | |
JP2006060766A (en) | Imaging apparatus and solid-state imaging device | |
JP7492345B2 (en) | Image pickup device and control method thereof, and image pickup apparatus and control method thereof | |
JP4630200B2 (en) | Solid-state imaging device and imaging apparatus | |
CN111050038B (en) | Reflective spatial coding high-resolution light field imaging device and method | |
JP4499387B2 (en) | Solid-state imaging device | |
JPH09186920A (en) | Image input device | |
KR20170091583A (en) | Mobile device with optical elements |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |