Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
  • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
  • H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
  • H04N25/445—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by skipping some contiguous pixels within the read portion of the array
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/60—Control of cameras or camera modules
  • H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
  • H04N25/70—SSIS architectures; Circuits associated therewith
  • H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
  • H04N25/711—Time delay and integration [TDI] registers; TDI shift registers

Definitions

• the present invention relates to an imaging method that is intended to be implemented from an aircraft or a spacecraft, as well as an imaging system that is adapted to implement such a method.
• the final image that is provided to the user is typically constructed by assigning in English) directly the intensity values that have been captured at the pixels of an image matrix that reproduces the matrix of photodetectors. All the photodetectors then correspond one by one to the pixels of the image matrix, and intensity values that have been captured by two adjacent photodetectors are assigned to two pixels that are also adjacent in the matrix of the final image.
• image capture mode in English
• the intensity values that are entered are assigned to the pixels of the matrix of the final image in a way that is adapted at each input mode.
• the final image is reconstructed by assigning pixels of different segments of the final image matrix, intensity values that have been captured at different times of the image.
• scene scanning by the camera system Such a push-broom acquisition mode is used in a scanner or a photocopier, for example.
• the push-broom mode is also used to photograph portions of the earth's surface from a satellite. In this case, the scanning of a portion of the terrestrial surface is achieved by scrolling the pointing direction of the optics.
• pixels adjacent to the final image still reproduce elementary areas of the photographed scene that are separated by the size of a photodetector, divided by the magnification of the optical image. shooting for conditions shots used.
• this separation distance between two elementary areas of the Earth's surface that are reproduced on neighboring pixels in the final image array is referred to as the ground-based resolution or sampling distance, and designated by GSD for "Ground Sampling Distance" in English.
• modulation transfer function commonly referred to as FTM. It is equal to the quotient of the contrast of a periodic modulation in the final image, by the real contrast of this modulation in the photographed scene.
• the value of the modulation transfer function decreases as the spatial frequency of the modulation increases.
• the value of the modulation transfer function is limited by several effects, among which an effect of the viewing optics and the effects of the photodetectors which are used. In particular, an increase in the diameter of the pupil of the shooting optics makes it possible to increase the modulation transfer function. Conversely, nonzero individual dimensions of photodetectors and possible crosstalk that occurs between neighboring photodetectors contribute to reducing the modulation transfer function.
• An object of the present invention is then to increase the modulation transfer function, with regard to the effects of photodetectors on the values of this function.
• Another object of the invention is to reduce the dimensions of the image optics, with constant values of the resolution and the modulation transfer function. Such a reduction in the dimensions of the optics is intended to reduce the cost of this optics, its size and mass. Consequently, it is also a question of reducing the dimensions of an aircraft or a spacecraft on which this optics is installed, as well as the costs of launching such a spacecraft.
• aims of the invention relate both to an acquisition mode in which an array of photodetectors is used to acquire the two-dimensional image information in a single exposure, an acquisition mode in which image lines are captured one by one, or a push-broom mode of acquisition.
• the final image that is provided by a method according to the invention is composed of intensity values which are respectively assigned to pixels of a matrix of this final image, this image matrix consisting of columns. adjacent and adjacent lines of pixels.
• the invention proposes an imaging method which comprises the following steps:
• this instrument comprising a shooting optics and at least one photodetector matrix which is arranged in a focal plane of the optical pickup views, this matrix of photodetectors being itself constituted of adjacent columns and adjacent lines of photodetectors;
• 121 construct the final image by assigning some of the intensity values that were captured in step 121 to the pixels of the final image array.
• the intensity values which are input at step 121 are restricted to a selection of one photodetector out of two along the columns and along the lines of the photodetector matrix, so as to constitute a surface selection of a four out of four photodetectors in this matrix of photodetectors;
• step / 3 / the pixels of the matrix of the final image to which the intensity values which have been input by the Selected photodetectors are adjacent to each other along the columns and lines of the final image matrix.
• two photodetectors that are used to capture intensity values rendered in the final image are separated by at least one other intermediate photodetector in the photodetector array.
• no crosstalk occurs between photodetectors whose intensity values are used for the final image.
• the limitation of the modulation transfer function due to the crosstalk between neighboring photodetectors is thus eliminated.
• the resolution in the focal plane of the shooting optics resulting from the size of each photodetector is twice as small as the resolution associated with each pixel in the image. final image.
• the matrix of photodetectors can be chosen with a step of photodetectors which is twice as small as in a method which does not use the invention.
• each photodetector individually, resulting from its non-zero dimensions, is then reduced.
• the collector surface of each photodetector causes a convolution operation by a window function that is narrower.
• the decrease in the individual size of the photodetectors also contributes to increasing the value of the modulation transfer function, at a constant value of the resolution of the final image. More precisely, the modulation transfer function is increased by a multiplying factor of approximately 0.90 / 0.64, for the spatial frequency which corresponds to the resolution of the final image.
• Step 121 of a method according to the invention may therefore consist in first selecting the photodetectors whose intensity values will be read, then read only these intensity values of the selected photodetectors.
• the intensity values that are captured by all the photodetectors can be read first as a whole, then only those that have been captured by those photodetectors that belong to the selection are used or stored. In other words, the selection of the photodetectors according to the invention can take place before or after the reading of the intensity values entered.
• the invention proposes an imaging method that comprises the following steps:
• the recording instrument on board the aircraft or the spacecraft, the instrument comprising the optics and at least one photodetector line which is arranged in the focal plane of the camera.
• this imaging optics, the line of photodetectors being itself constituted by photodetectors which are adjacent and aligned in a longitudinal direction;
• the intensity values that have been entered are restricted to a selection of one photodetector out of two along the longitudinal direction of the photodetector line, and the exposures are carried out so that the view of the scene is displaced in the focal plane by twice the width of the photodetectors measured perpendicularly to the longitudinal direction, between two exposures; and in step / 3 /, the pixels of the matrix of the final image to which the intensity values which have been inputted during the successive exposures by the selected photodetectors are assigned are adjacent to one another according to the columns and the lines of the final image matrix.
• the camera may comprise at least one mat of photodetectors having several lines of photodetectors which are adjacent parallel to the longitudinal direction, in the focal plane of the optics of shooting.
• These photodetector lines may belong to at least one matrix which is adapted to capture the radiation intensity values in step 121 according to a TDI type acquisition mode, for "time delay integration" in English.
• the image acquisition is carried out line by line, during a succession of exposure sequences of the matrix and simultaneous reading of the intensity values entered, these sequences being carried out each time the view of the scene is displaced in the focal plane by a distance equal to the individual width of the photodetector lines measured perpendicular to the longitudinal direction of the lines.
• the intensity values that are assigned to the pixels of the final image are restricted to one out of two photodetector selection in each row of the array, and to a sequence of matrix exposure and read intensity values entered in TDI mode every two sequences.
• the imaging methods according to the invention are particularly suitable for terrestrial imaging applications.
• the camera is embarked on board an aircraft or a satellite orbiting the Earth, and the scene is constituted by a surface portion of the Earth.
• the improvements in the modulation transfer function that result from the invention for the contribution of the photodetector crosstalk and that of the photodetector dimensions, can be used to reduce the size of the imaging optics.
• the camera can have a footprint and a mass that are reduced. Manufacturing savings from this instrument result, as well as reductions in the cost of an aircraft or satellite on board the instrument.
• the invention furthermore proposes imaging systems which are adapted to implement the methods characterized above, respectively for a mode of acquisition in a single exposure of the two-dimensional image information and for a mode of imaging. acquisition line by line, the latter possibly being of the TDI type.
• FIG. 1 is a perspective view of an imaging system that is adapted to implement a method according to the invention with a mode of acquisition in a single exposure of the two-dimensional image information;
• FIG. 2 schematically shows a correspondence between photodetectors and final image pixels
• FIG. 3 illustrates a variant of the implementation of FIG. 1
• FIG. 4 illustrates an application of the invention to an acquisition mode of the push-broom type
• FIGS. 5a and 5b illustrate an implementation of the invention with an acquisition mode of the TDI type
• FIG. 6 is a diagram comparing a sizing of a shooting optics using the invention and without using it.
• Figures 1 to 5a and 5b are diagrams of optical principles, so that the dimensions of the elements that are shown correspond neither to real dimensions nor to real size ratios.
• identical references which are indicated in different figures designate identical elements or which have identical functions.
• the numbers of columns and lines that are shown for the arrangement of photodetectors in the focal plane, as well as the numbers of columns and rows of the final image matrix do not correspond to actual implementations. of the invention but have been limited for clarity of the figures.
• FIG. 1 shows schematically a satellite S in orbit above the Earth, denoted T.
• the satellite S may be of the geostationary type, but not necessarily.
• a recording instrument 10 is embarked aboard the satellite S, to capture at least one image of a portion F of the surface of the Earth, which constitutes the photographed scene.
• the image data is transmitted by a transmitter 40 which is also embarked on board the satellite S, towards a terrestrial station U of a user of the captured image.
• the user station U comprises a receiver 50 of the data transmitted by the transmitter 40.
• the transmission mode of these image data between the transmitter 40 and the receiver 50 may be arbitrary, for example of the wave type. radio or laser signals.
• the camera 10 comprises, in a first mode of implementation of the invention:
• the shooting optics 1 may be a telescope of a type known before the invention. It is represented symbolically in the form of a convergent lens, without limitation with respect to its actual structure.
• the photodetector array 20 consists of adjacent columns and adjacent lines of the photodetectors 2, and each photodetector 2 is adapted to capture the intensity value of the radiation that it receives from an elementary zone ZE of the surface portion.
• This elementary zone ZE of the portion F is thus optically conjugated by the optics 1 with the corresponding photodetector 2.
• a steerable mirror 3 may be arranged on board the satellite S in front of the input of the optical camera 1, to orient the pointing direction DP of the optical lens 1 towards the terrestrial surface portion F.
• the steerable mirror 3 is not essential for the invention, and the pointing of the shooting optics 1 can be achieved alternately by using a steerable support for this optics on board the satellite S.
• This score can still be achieved suitably varying the attitude of the satellite S as a whole, in a manner known to those skilled in the art.
• the shooting optics 1 can be supported on board the satellite S with an orientation which is fixed with respect to the platform of the satellite.
• the control unit 30 controls in particular the reset, accumulation and reading operations of each photodetector 2 to obtain the value of the intensity of the radiation which is received by this photodetector at each exposure.
• An image reconstruction unit 60 assigns, or assigns, the intensity values that are captured by the photodetectors 2 to the pixels of a matrix of the final image that is provided to the user. This assignment is performed according to the coordinates of each photodetector 2 in the matrix 20, and the coordinates of each pixel in the matrix of the final image. In the usual way, the pixels to which the intensity values that have been input are assigned are adjacent to each other according to columns and lines of the final image matrix.
• the reconstruction unit 60 can be embarked on board the satellite S, in which case the data of the final image is transmitted by the transmitter 40 to the receiver 50. Alternatively and in accordance with Figure 1, the reconstruction unit 60 may be located on Earth. In this case, the data that is transmitted between the satellite S and the earth station U may be the intensity values that are captured by the photodetectors 2.
• control unit 30 is adapted to select a single photodetector 2 out of two along the columns and along the lines of the photodetector matrix 20, so as to constitute a surface selection of one photodetector out of four in the matrix of photodetectors 20. After exposure of the matrix 20 to the radiation that comes from the terrestrial surface portion F, the unit 30 controls a reading of the intensity values that have been captured by those of the photodetectors 2 which are selected .
• the operation of the image reconstruction unit 60 is then restricted to the intensity values that have been captured by the selected photodetectors, while affecting those intensity values inputted only by the selected photodetectors to pixels that are adjacent between them in the final image matrix.
• the camera 10 and the reconstruction unit 60 which is adapted for such operation together form the imaging system of the invention.
• FIG. 2 illustrates the assignment according to the invention of intensity values to the pixels of the final image.
• FIG. 2 represents the photodetector matrix 20.
• CDET collectively denotes the columns of this matrix of photodetectors 20, and L D AND denotes the lines thereof.
• the crosses indicate which photodetectors 2 of the matrix 20 are selected according to the invention.
• the right part of Figure 2 represents the pixel matrix of the final image that is provided to the user.
• This image matrix is designated globally by the reference IF, and PI denotes the individual pixels of the image matrix IF.
• CIF denotes the columns of pixels of the image matrix IF, and LIF denotes the rows of pixels of the same image matrix.
• the arrows show the assignment to the pixels PI of the image matrix IF, intensity values that are captured by the photodetectors 2 selected. Intensity values are thus assigned to all the pixels PI, these being adjacent to each other according to the columns C
• the selection ratio of the photodetectors 2 is one in two in each column CDE T and in each line LDET of the matrix 20, so as to obtain a surface selection ratio of one in four over the entire matrix 20.
• the matrix 20 of the photodetectors has twice as many columns and rows as the matrix of the final image IF. For this reason, the image that is formed in the focal plane PF is said to be oversampled with respect to the final image IF.
• the photodetector matrix 20 must comprise 1280 columns CDET of photodetectors and 960 lines LDE T of photodetectors.
• the invention consists in tightening the rows and columns of the matrix 20, removing one out of two in both directions.
• the resolution R of the final image IF that is to say the distance to the ground in the portion of terrestrial surface F which corresponds to the passage of a column or a line of pixels PI in the final image at the next column or pixel line is twice the resolution of the view which is formed in the focal plane PF on the photodetector matrix 20.
• x denotes the distances that correspond to this resolution R, on the matrix of photodetectors 20 and in the final image IF.
• the dimension of the sides of the elementary zone ZE is therefore R / 2.
• the intensity values that are used according to the invention for constructing the final image IF come from photodetectors 2 which are never adjacent to each other in the matrix 20, no crosstalk intervenes which could disturb these values.
• the size of the photodetectors 2 of the matrix 20 which is used to implement the invention is half that which would be used without the invention to obtain an identical resolution R of the final image IF with a correspondence one for one between the photodetectors of the matrix 20 and the pixels PI of the final image IF.
• This dimension of the photodetectors, which is reduced by the invention, improves the modulation transfer function, in a further way with respect to the suppression of inter-photodetector crosstalk.
• the intensity values that are captured by those of the photodetectors 2 that are not selected are not transmitted by the transmitter 40.
• the control unit 30 can be programmed so that these intensity values of the Non-selected photodetectors are not read at the end of each exposure of the matrix 20.
• FIG. 3 illustrates a variant of the invention when the matrix of photodetectors 20 is replaced by at least one, for example one, line of photodetectors 2 which are adjacent and aligned in a longitudinal direction denoted DL.
• a line of photodetectors may be constituted by an autonomous strip 21 of photodetectors.
• V designates the ground track of the satellite S as it moves on its orbit.
• the shooting optics 1 forms, on the strip 21, the image of a band of the terrestrial surface portion F.
• the references B ⁇ to B 3 denote bands which correspond to at three different times. They are shifted parallel to the trace V.
• the image of the terrestrial surface portion F is taken line by line, bringing together the images of the bands of the portion F which are captured during successive exposures.
• a photodetector 2 out of two is selected by the control unit 30 for all the exposures, along the direction DL, and the unit 30 further synchronizes the successive exposures of the bar 21 with the scrolling of the satellite S on the trace V. This synchronization is to trigger each exposure so that the ground strips Bi, B 2 , B 3l ... are successively offset parallel to the trace V by twice the individual width R / 2 of these bands.
• the image of the portion F in the focal plane PF is displaced perpendicularly to the direction DL by twice the width of the photodetectors 2 between two successive exposures, the width of the photodetectors 2 to be considered being also measured perpendicular to the direction DL
• the selection of one line in two in the photodetector matrix 20 of the embodiment of FIG. 1 is replaced by an appropriate frequency of the exposures with respect to the scrolling of the satellite S.
• the image reconstruction unit 60 then assigns to the pixels PI of the final image matrix IF these intensity values that have been entered during the successive exposures by the selected photodetectors 2.
• the pixels PI to which the intensity values that have been input by the selected photodetectors of the strip 21 are still located are still adjacent to one another according to the columns C [ F and the lines L
• two of the bands Bi,, B 3 , ... of the portion F which are acquired during different exposures are shifted by a distance to the ground which is equal to 2 n times the resolution R / 2 of the image.
• final IF, n being an integer, while each band has an individual width which is equal to R / 2.
• FIGS. 1 to 3 may be combined with a push-broom image acquisition mode.
• a push-broom image acquisition mode Such a mode of acquisition is supposed to be known, so that it is not necessary to recall the principle in detail.
• the main push-broom mode parameters are illustrated in Figure 4:
• V again designates the ground track of the displacement of the satellite S in its orbit, around the Earth denoted T;
• B is either the land surface portion F of Figure 1 or one of the bands B2, B3, ⁇ ⁇ ⁇ of Figure 3;
• w is the elementary swath size, corresponding to each exposure and to the length of the matrix 20 or of the bar 21, in the longitudinal direction DL;
• AC is the accessible corridor for shooting on the surface of the Earth T, which is obtained by varying the pointing direction DP perpendicular to the ground track V.
• the pointing direction DP can be varied between two successive exposures by changing the orientation of the mirror 3, or by switching the satellite S along its axis of rotation. But any other mode of variation of the pointing direction DP can be used alternately.
• Figures 5a and 5b illustrate an adaptation of the invention to the particular type of acquisition which is designated by TDI.
• the lower part of Figure 5a is an enlarged and schematic view of the TDI detector that is used. Items that have already been described and are not changed are not repeated.
• the matrix of photodetectors 20 is of the CCD-TDI type, for example with four adjacent lines of photodetectors 2, referenced 20a to 20d, and a transfer register, referenced 20z. Z denotes the reading output of the matrix 20.
• each line 20a-20d of the matrix 20 itself comprises 1280 photodetectors 2 which are adjacent in the longitudinal direction DL.
• the selection of the photodetectors 2 in the lines 20a-20d, identical for all the exposures, is the same as that described with reference to the left part of FIG. 2, but the reading of the intensity values which are captured by these selected photodetectors is carried out in accordance with the TDI acquisition mode.
• the intensity values that are assigned to the pixels PI of the final image matrix IF are sums of elementary intensity values that are captured during successive exposures by photodetectors offset perpendicularly to the direction DL.
• FIG. 5b shows how each intensity value is acquired perpendicularly to the direction DL, that is to say in the direction of the columns of the matrix 20.
• the positions of the matrix 20 with respect to the image of the portion of surface F in the focal plane PF are represented at successive instants T 0 + j tj, T 0 being an initial moment, t, being the integration time TDI and j being an integer successively equal to 1, 2, 3 , ...
• the image of the ground strip Bi is formed on the line 20d of photodetectors at the instant T 0 + tj, then on the line 20c at the instant T 0 + 2-tj, then on the line 20b at the instant T 0 + 3-tj, and finally on the line 20a at the instant T 0 +4 tj.
• the view of the scene F has moved in the focal plane PF perpendicular to the longitudinal direction DL by one time the individual width of the photodetector lines 20a-20d, also measured. perpendicular to the DL direction.
• the intensity values which are thus transferred to the transfer register 20z at times T 0 + 5 tj, T 0 + 7 tj, etc., that is to say at one integration time out of two, are then only retained and assigned to adjacent LIF lines in the final IF image. Furthermore, within each of these lines L iF , the intensity values that are assigned to the successive pixels PI result from a selection of one of two values that are delivered by the transfer register 20z to each sequence TDI playback.
• the shooting optics 1 may have a focal length that is greater than a focal length that would also produce the resolution R of the final image IF if this final image was composed of intensity values captured by adjacent photodetectors 2 in the focal plane PF, at constant size of the photodetectors.
• the focal length of the optics 1 can be increased compared to an imaging method as known before the invention.
• the input pupil of the optical optics can be sized for the resolution value which corresponds to twice the pitch of the photodetectors in the matrix 20 or the strip 21, instead of a single one. times the value of this photodetector step as is usually applied.
• the components of this optics must have dimensions that are compatible with the resolution of the final image IF , and with the desired values for the modulation transfer function.
• a diameter of each mirror of this optic is selected so that the entrance pupil causes a diffraction which does not reduce the resolution of the final image IF, nor the modulation transfer function.
• the dimensions of the optics 1 can be reduced, for example by a factor of 2.
• the price of the instrument Shooting is reduced accordingly, and its installation on board the aircraft or spacecraft is facilitated.
• the weight of the optics is also reduced, which is an important advantage for an instrument that is onboard a satellite, compared to the constraints that are related to the launch of the satellite.
• the invention makes it possible to reduce the spectrum aliasing effect, which is known as aliasing in English. This effect results from the sampling of the image by the photodetectors, and intervenes in the spatial frequency decomposition of this image.
• the diffraction that is produced by the optics of shooting causes low-pass filtering of the images.
• spatial frequencies This diffraction reduces the amplitudes of the spatial frequencies which are folded, to a greater extent than the non-folded frequencies.
• the invention further decreases the amplitudes of folded spatial frequencies, so that the effect of spectrum folding is even less important.
• Figure 6 is a diagram that compares the values of the function of modulation transfer, with identical resolution of the final image, for a final image that is acquired and reconstructed according to the invention (curve in solid lines) and without the invention (curve in dashed lines).
• Obtaining the final image without the invention corresponds to the reading of all the adjacent photodetectors which are located in the focal plane of the optics, and the assignment one by one of all the values of intensity read at the pixels of the final image.
• the diameter of the input pupil of the imaging optics is indicated on the abscissa, and the values of the modulation transfer function are indicated on the ordinate. This diagram shows in particular that for the value of 20% of the modulation transfer function, the diameter of the entrance pupil can be reduced from about 1700 mm to about 1050 mm.
• the invention makes it possible to reduce in a large proportion the size of the entrance pupil of the optical optics, at the same time as its focal length can be increased.
• This optic therefore has an opening which is greatly reduced, and the optical aberrations which are related to this opening, such as spherical aberration, coma and astigmatism, are reduced accordingly.
• this reduction of the opening facilitates the realization of the dioptric and catadioptric surfaces which constitute the camera, by reducing the necessary radii of curvature.
• the invention can be reproduced by adapting these modes of implementation in various ways, depending on each application of the imaging system.
• the invention can be implemented as well from any spacecraft, of the satellite or space probe type, or from any aircraft, of the type of exploration aircraft or unmanned aircraft, in particular .

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Transforming Light Signals Into Electric Signals (AREA)
• Image Input (AREA)
• Studio Devices (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=43242182

Family Applications (1)

Country Status (4)

Families Citing this family (3)

Family Cites Families (6)

• 2010
  • 2010-05-04 FR FR1053443A patent/FR2959904B1/fr active Active
• 2011
  • 2011-04-28 US US13/696,254 patent/US9413990B2/en active Active
  • 2011-04-28 WO PCT/FR2011/050978 patent/WO2011138542A1/fr active Application Filing
  • 2011-04-28 EP EP11723534A patent/EP2567538A1/de not_active Ceased

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events