CN112866574B - Reconfigurable array imaging method and device for software-defined satellite - Google Patents

Reconfigurable array imaging method and device for software-defined satellite Download PDF

Info

Publication number
CN112866574B
CN112866574B CN202110046703.8A CN202110046703A CN112866574B CN 112866574 B CN112866574 B CN 112866574B CN 202110046703 A CN202110046703 A CN 202110046703A CN 112866574 B CN112866574 B CN 112866574B
Authority
CN
China
Prior art keywords
multispectral
camera
panchromatic
image acquisition
cameras
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110046703.8A
Other languages
Chinese (zh)
Other versions
CN112866574A (en
Inventor
夏玉立
赵军锁
李济民
闫小盼
吕晓宁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Software of CAS
Original Assignee
Institute of Software of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Software of CAS filed Critical Institute of Software of CAS
Priority to CN202110046703.8A priority Critical patent/CN112866574B/en
Publication of CN112866574A publication Critical patent/CN112866574A/en
Application granted granted Critical
Publication of CN112866574B publication Critical patent/CN112866574B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/667Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/20Adaptations for transmission via a GHz frequency band, e.g. via satellite

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Astronomy & Astrophysics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)

Abstract

The application provides a reconfigurable array imaging method and device for a software-defined satellite, which are applied to an array remote sensing camera, wherein the array remote sensing camera consists of three panchromatic multispectral cameras and a high-resolution color camera, the three panchromatic multispectral cameras are arranged side by side, and the arrangement direction is vertical to the flight direction of the satellite; the spatial resolution of the three panchromatic multispectral cameras is the same, and the visual fields of the two adjacent panchromatic multispectral cameras are overlapped by one half; the three panchromatic multispectral cameras are plated with a panchromatic strip and a plurality of multispectral strips, and two sides of each strip are provided with an isolation strip; the view field of the high-resolution color camera is consistent with the view field of the panchromatic multispectral camera positioned in the middle in direction; the method comprises the following steps: and calling at least one camera corresponding to the target image acquisition mode in the array remote sensing cameras to acquire images according to the target image acquisition mode, and performing image processing on the acquired images according to the processing mode corresponding to the target image acquisition mode to obtain target remote sensing images.

Description

Reconfigurable array imaging method and device for software-defined satellite
Technical Field
The application relates to the technical field of remote sensing imaging, in particular to a reconfigurable array imaging method and device for a software-defined satellite.
Background
At present, as satellite technology is nearly mature, a land remote sensing system has observation capabilities of various means such as panchromatic, multispectral, infrared, synthetic aperture radar, video, noctilucence and the like, and the remote sensing system has high resolution, large breadth, intellectualization and small size, so that the remote sensing system is a long-term target and difficult problem for related researchers to improve and optimize the remote sensing system.
In the prior art, the remote sensing load function on the remote sensing satellite is independent and single, one remote sensing satellite is simultaneously provided with a plurality of multispectral cameras and panchromatic cameras with different resolutions, the cameras are independent, the performance improvement and development difficulty of the single remote sensing camera is high, and each remote sensing camera only realizes the remote sensing imaging function, so that serious resource waste is caused.
Disclosure of Invention
In view of this, an object of the present application is to provide a reconfigurable array imaging method and apparatus for a software-defined satellite, so as to solve the problem in the prior art how to achieve light weight of a remote sensing system.
In a first aspect, the embodiment of the application provides a reconfigurable array imaging method facing a software-defined satellite, which is applied to an array remote sensing camera, wherein the array remote sensing camera is composed of three panchromatic multispectral cameras and a high-resolution color camera, the three panchromatic multispectral cameras are arranged side by side, and the arrangement direction is perpendicular to the flight direction of the satellite; the three panchromatic multispectral cameras have the same spatial resolution, and the visual fields of two adjacent panchromatic multispectral cameras are overlapped by one half; the three panchromatic multispectral cameras are plated with a panchromatic strip and a plurality of multispectral strips, and two sides of each strip are provided with an isolation strip; the view field of the high-resolution color camera is consistent with the view field direction of the panchromatic multispectral camera positioned in the middle; the method comprises the following steps:
receiving an image acquisition instruction of a ground center;
analyzing the image acquisition instruction to obtain a target image acquisition mode; the image acquisition mode comprises any one of the following modes: the system comprises a wide-width imaging mode, a super-resolution imaging mode, a color multispectral fusion imaging mode and a color camera super-resolution imaging mode;
and calling at least one camera corresponding to the target image acquisition mode in the array remote sensing cameras to acquire images according to the target image acquisition mode, and processing the acquired images according to a processing mode corresponding to the target image acquisition mode to obtain target remote sensing images.
In some embodiments, when the target image acquisition mode is a wide imaging mode, the invoking, according to the target image acquisition mode, at least one camera corresponding to the target image acquisition mode in the array remote sensing camera to acquire an image, and performing image processing on the acquired image according to a processing mode corresponding to the target image acquisition mode to obtain a target remote sensing image includes:
calling the three panchromatic multispectral cameras to acquire images simultaneously;
and splicing the images collected by the three panchromatic multispectral cameras to obtain a target remote sensing image.
In some embodiments, when the target image acquisition mode is a super-resolution imaging mode, the invoking, according to the target image acquisition mode, at least one camera corresponding to the target image acquisition mode in the array remote sensing camera to acquire an image, and performing image processing on the acquired image according to a processing mode corresponding to the target image acquisition mode to obtain a target remote sensing image includes:
calling the three panchromatic multispectral cameras to acquire images simultaneously;
and performing super-resolution reconstruction processing on the images collected by the panchromatic multispectral cameras positioned in the middle position based on the images collected by the panchromatic multispectral cameras positioned at the two sides to obtain a target remote sensing image.
In some embodiments, when the target image acquisition mode is a color multispectral fusion imaging mode, the invoking at least one camera corresponding to the target image acquisition mode in the array remote sensing camera to perform image acquisition according to the target image acquisition mode, and performing image processing on the acquired image according to a processing mode corresponding to the target image acquisition mode to obtain a target remote sensing image includes:
calling the high-resolution color camera and the panchromatic multispectral camera positioned in the middle position to acquire images simultaneously;
and carrying out fusion processing on the image acquired by the high-resolution color camera and the image acquired by the panchromatic multispectral camera positioned in the middle position to obtain a target remote sensing image.
In some embodiments, when the target image acquisition mode is a color camera super-resolution imaging mode, the invoking at least one camera corresponding to the target image acquisition mode in the array remote sensing camera to acquire an image according to the target image acquisition mode, and performing image processing on the acquired image according to a processing mode corresponding to the target image acquisition mode to obtain a target remote sensing image includes:
calling the high-resolution color camera to acquire images with different frame frequencies for multiple times within preset time;
and performing super-resolution reconstruction processing on a plurality of images with different frame frequencies acquired by the high-resolution color camera to obtain a target remote sensing image.
In some embodiments, the three panchromatic multispectral cameras are plated with the same multispectral strip; or the panchromatic multispectral cameras at the two sides are plated with the same multispectral bands, and the panchromatic multispectral camera at the middle position is plated with multispectral bands different from the panchromatic multispectral cameras at the two sides.
In a second aspect, the embodiment of the application provides a reconfigurable array imaging device facing a software-defined satellite, which is applied to an array remote sensing camera, wherein the array remote sensing camera is composed of three panchromatic multispectral cameras and a high-resolution color camera, the three panchromatic multispectral cameras are arranged side by side, and the arrangement direction is perpendicular to the flight direction of the satellite; the three panchromatic multispectral cameras have the same spatial resolution, and the visual fields of the two adjacent panchromatic multispectral cameras are overlapped by one half; the three panchromatic multispectral cameras are plated with a panchromatic strip and a plurality of multispectral strips, and two sides of each strip are provided with an isolation strip; the view field of the high-resolution color camera is consistent with the view field direction of the panchromatic multispectral camera positioned in the middle; the device comprises:
the communication module is used for receiving an image acquisition instruction of the ground center;
the analysis module is used for analyzing the image acquisition instruction to obtain a target image acquisition mode; the image acquisition mode comprises any one of the following modes: the system comprises a wide-width imaging mode, a super-resolution imaging mode, a color multispectral fusion imaging mode and a color camera super-resolution imaging mode;
and the imaging module is used for calling at least one camera corresponding to the target image acquisition mode in the array remote sensing cameras to acquire images according to the target image acquisition mode, and processing the acquired images according to the processing mode corresponding to the target image acquisition mode to obtain the target remote sensing images.
In some embodiments, the three panchromatic multispectral cameras are plated with the same multispectral strip; or the panchromatic multispectral cameras at the two sides are plated with the same multispectral bands, and the panchromatic multispectral camera at the middle position is plated with multispectral bands different from the panchromatic multispectral cameras at the two sides.
In a third aspect, an embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the steps of the method in any one of the above first aspects when executing the computer program.
In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, performs the steps of the method in any one of the above first aspects.
According to the reconfigurable array imaging method for the software-defined satellite, the array remote sensing camera is called to acquire images according to at least one camera corresponding to a preset target image acquisition mode through the target image acquisition mode corresponding to an image acquisition command sent by a ground center, and the acquired images are processed through a processing mode corresponding to the target image acquisition mode to obtain the target remote sensing image. According to the reconfigurable array imaging method for the software-defined satellite, the four lower-configuration remote sensing cameras are functionally fused, the overall performance is improved, the high resolution, the large breadth and the light weight of the remote sensing system are realized, and the resource waste is reduced.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 is a schematic flowchart of a reconfigurable array imaging method for a software-defined satellite according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of a camera in an array remote sensing camera provided in an embodiment of the present application;
FIG. 3 is a schematic diagram of a panchromatic multispectral camera view field in an array remote sensing camera provided by an embodiment of the application;
fig. 4 is a schematic structural diagram of a coating film of a panchromatic multispectral camera according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a reconfigurable array imaging device facing a software-defined satellite according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides a reconfigurable array imaging method for a software-defined satellite, which is applied to an array remote sensing camera, wherein the array remote sensing camera consists of three panchromatic multispectral cameras and a high-resolution color camera, the three panchromatic multispectral cameras are arranged side by side, and the arrangement direction is vertical to the flight direction of the satellite; the spatial resolution of the three panchromatic multispectral cameras is the same, and the visual fields of the two adjacent panchromatic multispectral cameras are overlapped by one half; the three panchromatic multispectral cameras are plated with a panchromatic strip and a plurality of multispectral strips, and two sides of each strip are provided with an isolation strip; the view field of the high-resolution color camera is consistent with the view field of the panchromatic multispectral camera positioned in the middle in direction; as shown in fig. 1, the method comprises the following steps:
s101, receiving an image acquisition instruction of a ground center;
step S102, analyzing the image acquisition command to obtain a target image acquisition mode; the image acquisition mode comprises any one of the following modes: the system comprises a wide-width imaging mode, a super-resolution imaging mode, a color multispectral fusion imaging mode and a color camera super-resolution imaging mode;
and step S103, calling at least one camera corresponding to the target image acquisition mode in the array remote sensing camera to acquire images according to the target image acquisition mode, and performing image processing on the acquired images according to a processing mode corresponding to the target image acquisition mode to obtain target remote sensing images.
Specifically, the layout of the remote sensing camera array adopted in the embodiment of the application is shown in fig. 2 and consists of three panchromatic multispectral cameras and one high-resolution color camera which are arranged side by side.
The three panchromatic multispectral cameras have the same spatial resolution, and the arrangement direction is vertical to the satellite flight direction, namely the central points of the three panchromatic multispectral cameras are on the same straight line, and the straight line is vertical to the satellite flight direction.
The view fields of the three panchromatic multispectral cameras are shown in fig. 3, and the view field of the panchromatic multispectral camera in the middle position is respectively overlapped with the view fields of the panchromatic multispectral cameras in the two side positions by one half.
As shown in fig. 4, each panchromatic multispectral camera is coated with a coating composed of a panchromatic band and a plurality of multispectral bands, and in order to prevent spectrum aliasing, an isolation band is further arranged between the spectral bands, the isolation band is a black band, and parts of the black band are also left at two ends. The width of each spectral band may be selected according to spectral band settings to ensure energy. The number of multispectral bands may also be increased or decreased as desired, preferably the number of multispectral bands is 4.
The resolution of the high-resolution color camera is higher than that of the three panchromatic multispectral cameras. The field of view of the high resolution color camera is aligned with the temporal orientation of the mid-position panchromatic multispectral camera, and the imaging area of the high resolution color camera is contained within the imaging area of the mid-position panchromatic multispectral camera.
After a land remote sensing satellite loaded with the array remote sensing camera receives an image acquisition command from a ground center, the array remote sensing camera analyzes a target image acquisition mode to be used from the image acquisition command, and then generates a target remote sensing image according to an image acquisition strategy and an image processing strategy corresponding to the preset target image acquisition mode. The cameras and image processing operations used differ in different image acquisition modes.
In some embodiments, when the target image capturing mode is a wide imaging mode, the step S103, according to the target image capturing mode, invoking at least one camera corresponding to the target image capturing mode in the array remote sensing camera to perform image capturing, and performing image processing on the captured image according to a processing mode corresponding to the target image capturing mode to obtain a target remote sensing image, includes:
step 201, calling the three panchromatic multispectral cameras to acquire images simultaneously;
and 202, splicing the images collected by the three panchromatic multispectral cameras to obtain a target remote sensing image.
Specifically, the array remote sensing camera is provided with three panchromatic multispectral cameras side by side, and the view fields of the panchromatic multispectral cameras at the two sides are respectively overlapped with the view field of the panchromatic multispectral camera at the middle unknown by one half, so that the three panchromatic multispectral cameras can simultaneously acquire images and splice the images, and a remote sensing image with the width 2 times that of a single panchromatic multispectral camera can be obtained.
In some embodiments, when the target image capturing mode is the super-resolution imaging mode, the step S103, according to the target image capturing mode, of calling at least one camera corresponding to the target image capturing mode in the array remote sensing camera to capture an image, and performing image processing on the captured image according to a processing method corresponding to the target image capturing mode to obtain a target remote sensing image, includes:
step 203, calling the three panchromatic multispectral cameras to acquire images simultaneously;
and step 204, performing super-resolution reconstruction processing on the image collected by the panchromatic multispectral camera positioned in the middle position based on the images collected by the panchromatic multispectral cameras positioned at the two sides to obtain a target remote sensing image.
Specifically, the view field of the panchromatic multispectral camera at the middle position is overlapped with the view fields of the panchromatic multispectral cameras at the two side positions by one half respectively, so that the images acquired by the panchromatic multispectral cameras at the two side positions are respectively half of the images acquired by the panchromatic multispectral camera at the middle position for super-resolution reconstruction, and finally the super-resolution remote sensing image of the panchromatic multispectral camera at the middle position is obtained.
In some embodiments, when the target image collection mode is a color multispectral fusion imaging mode, the step S103, according to the target image collection mode, of calling at least one camera corresponding to the target image collection mode in the array remote sensing camera to collect an image, and performing image processing on the collected image according to a processing mode corresponding to the target image collection mode to obtain a target remote sensing image, includes:
step 205, calling the high-resolution color camera and the panchromatic multispectral camera located in the middle position to acquire images simultaneously;
and step 206, fusing the image acquired by the high-resolution color camera and the image acquired by the panchromatic multispectral camera positioned in the middle position to obtain a target remote sensing image.
Specifically, the high-resolution color camera has a high resolution, the imaging width is smaller than that of the panchromatic multispectral camera, and in the above array remote sensing camera, the imaging area of the high-resolution color camera is included in the imaging area of the panchromatic multispectral camera at the intermediate position, so that a color multispectral fusion image can be obtained by fusing the image collected by the high-resolution color camera and the image collected by the panchromatic multispectral camera at the intermediate position.
In some embodiments, when the target image capturing mode is a color camera super-resolution imaging mode, the step S103, according to the target image capturing mode, invoking at least one camera corresponding to the target image capturing mode in the array remote sensing camera to capture an image, and performing image processing on the captured image according to a processing mode corresponding to the target image capturing mode to obtain a target remote sensing image, includes:
step 207, calling the high-resolution color camera to acquire images with different frame rates for multiple times within a preset time;
and 208, performing super-resolution reconstruction processing on the plurality of images with different frame frequencies acquired by the high-resolution color camera to obtain a target remote sensing image.
Specifically, the high-resolution color camera can realize area-array imaging, the frame frequency of the high-resolution color camera can be adjusted, a plurality of images with different frame frequencies are obtained by continuously adjusting the frame frequency for a plurality of times and acquiring the images, and super-resolution imaging of the high-resolution color camera can be realized by performing super-resolution reconstruction based on the images.
In some embodiments, the three panchromatic multispectral cameras are plated with the same multispectral strip; or the panchromatic multispectral cameras at the two sides are plated with the same multispectral bands, and the panchromatic multispectral camera at the middle position is plated with multispectral bands different from the panchromatic multispectral cameras at the two sides.
Specifically, when the film coating of the panchromatic multispectral camera is carried out, three panchromatic multispectral cameras can be selected to select the same multispectral strip, and therefore multispectral spectral bands of imaging areas formed by the three panchromatic multispectral cameras are the same; the panchromatic multispectral camera in the middle can be selected to adopt completely different multispectral strips, an imaging area formed by the three panchromatic multispectral cameras is divided into three areas, and the imaging area corresponding to the panchromatic multispectral camera in the middle is overlapped with the panchromatic multispectral cameras on two sides, so that the area contains twice the number of multispectral spectral segments, and more choices are provided for image acquisition.
The embodiment of the application provides a reconfigurable array imaging device for a software-defined satellite, which is applied to an array remote sensing camera, wherein the array remote sensing camera consists of three panchromatic multispectral cameras and a high-resolution color camera, the three panchromatic multispectral cameras are arranged side by side, and the arrangement direction is vertical to the flight direction of the satellite; the spatial resolution of the three panchromatic multispectral cameras is the same, and the visual fields of the two adjacent panchromatic multispectral cameras are overlapped by one half; the three panchromatic multispectral cameras are plated with a panchromatic strip and a plurality of multispectral strips, and two sides of each strip are provided with an isolation strip; the view field of the high-resolution color camera is consistent with the view field of the panchromatic multispectral camera positioned in the middle in direction; as shown in fig. 5, the apparatus includes:
the communication module 30 is used for receiving an image acquisition instruction of the ground center;
the analysis module 31 is configured to analyze the image acquisition instruction to obtain a target image acquisition mode; the image acquisition mode includes any one of the following: the system comprises a wide-width imaging mode, a super-resolution imaging mode, a color multispectral fusion imaging mode and a color camera super-resolution imaging mode;
and the imaging module 32 is configured to call at least one camera corresponding to the target image acquisition mode in the array remote sensing camera according to the target image acquisition mode to perform image acquisition, and perform image processing on the acquired image according to a processing mode corresponding to the target image acquisition mode to obtain a target remote sensing image.
In some embodiments, the three panchromatic multispectral cameras are plated with the same multispectral strip; or the panchromatic multispectral cameras at the two sides are plated with the same multispectral bands, and the panchromatic multispectral camera at the middle position is plated with multispectral bands different from the panchromatic multispectral cameras at the two sides.
Corresponding to the reconfigurable array imaging method for the software-defined satellite in fig. 1, an embodiment of the present application further provides a computer device 400, as shown in fig. 6, the device includes a memory 401, a processor 402, and a computer program stored in the memory 401 and executable on the processor 402, where the processor 402 implements the reconfigurable array imaging method for the software-defined satellite when executing the computer program.
Specifically, the memory 401 and the processor 402 can be general memories and processors, which are not limited in this embodiment, and when the processor 402 runs a computer program stored in the memory 401, the reconfigurable array imaging method for software-defined satellites can be executed, so that the problem of how to achieve light weight of a remote sensing system in the prior art is solved.
Corresponding to the reconfigurable array imaging method for the software-defined satellite in fig. 1, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps of the reconfigurable array imaging method for the software-defined satellite.
Specifically, the storage medium can be a general storage medium, such as a mobile disk, a hard disk, and the like, and when a computer program on the storage medium is run, the method for imaging a reconfigurable array facing a software-defined satellite can be executed, so that the problem of how to realize light weight of a remote sensing system in the prior art is solved. According to the reconfigurable array imaging method for the software defined satellite, the four remote sensing cameras with lower configuration are functionally fused, the overall performance is improved, the high resolution, the large breadth and the light weight of the remote sensing system are realized, and therefore the resource waste is reduced.
In the embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other ways. The above-described apparatus embodiments are merely illustrative, and for example, the division of the units into only one type of logical function may be implemented in other ways, and for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed coupling or direct coupling or communication connection between each other may be through some communication interfaces, indirect coupling or communication connection between devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments provided in the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions may be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solutions of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus once an item is defined in one figure, it need not be further defined and explained in subsequent figures, and moreover, the terms "first", "second", "third", etc. are used merely to distinguish one description from another and are not to be construed as indicating or implying relative importance.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope disclosed in the present application; such modifications, changes or substitutions do not depart from the spirit and scope of the present disclosure, which should be construed in light of the above teachings. Are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (6)

1. A reconfigurable array imaging method facing a software-defined satellite is characterized by being applied to an array remote sensing camera, wherein the array remote sensing camera is composed of three panchromatic multispectral cameras and a high-resolution color camera, the three panchromatic multispectral cameras are arranged side by side, and the arrangement direction is vertical to the flight direction of the satellite; the three panchromatic multispectral cameras have the same spatial resolution, and the visual fields of the two adjacent panchromatic multispectral cameras are overlapped by one half; the visual field of the high-resolution color camera is consistent with the visual field direction of the panchromatic multispectral camera positioned in the middle, wherein each panchromatic multispectral camera is plated with a coating film consisting of a panchromatic strip and a plurality of multispectral strips for preventing spectrum aliasing, an isolation band is also arranged between the spectral strips, the isolation band is a black strip, and partial black strips are left at two ends; the method comprises the following steps:
receiving an image acquisition instruction of a ground center;
analyzing the image acquisition instruction to obtain a target image acquisition mode; the image acquisition mode comprises any one of the following modes: the system comprises a wide-width imaging mode, a super-resolution imaging mode, a color multispectral fusion imaging mode and a color camera super-resolution imaging mode;
calling at least one camera corresponding to the target image acquisition mode in the array remote sensing cameras to acquire images according to the target image acquisition mode, and processing the acquired images according to a processing mode corresponding to the target image acquisition mode to obtain target remote sensing images;
when the target image acquisition mode is a wide-width imaging mode, calling the three panchromatic multispectral cameras to acquire images simultaneously; splicing images collected by the three panchromatic multispectral cameras to obtain a target remote sensing image;
when the target image acquisition mode is a super-resolution imaging mode, calling the three panchromatic multispectral cameras to acquire images simultaneously; based on the images collected by the panchromatic multispectral cameras at the two sides, performing super-resolution reconstruction processing on the image collected by the panchromatic multispectral camera at the middle position to obtain a target remote sensing image;
when the target image acquisition mode is a color multispectral fusion imaging mode, calling the high-resolution color camera and a panchromatic multispectral camera positioned in the middle position to acquire images simultaneously; fusing the image collected by the high-resolution color camera and the image collected by the panchromatic multispectral camera positioned in the middle position to obtain a target remote sensing image;
when the target image acquisition mode is a color camera super-resolution imaging mode, calling the high-resolution color camera to acquire images with different frame frequencies for multiple times within preset time; and performing super-resolution reconstruction processing on a plurality of images with different frame frequencies acquired by the high-resolution color camera to obtain a target remote sensing image.
2. The method of claim 1, in which the three panchromatic multispectral cameras are plated with the same multispectral strip; or the panchromatic multispectral cameras at the two sides are plated with the same multispectral bands, and the panchromatic multispectral camera at the middle position is plated with multispectral bands different from the panchromatic multispectral cameras at the two sides.
3. The reconfigurable array imaging device is characterized by being applied to an array remote sensing camera, wherein the array remote sensing camera consists of three panchromatic multispectral cameras and a high-resolution color camera, the three panchromatic multispectral cameras are arranged side by side, and the arrangement direction of the three panchromatic multispectral cameras is vertical to the flight direction of a satellite; the three panchromatic multispectral cameras have the same spatial resolution, and the visual fields of the two adjacent panchromatic multispectral cameras are overlapped by one half; the visual field of the high-resolution color camera is consistent with the visual field direction of a panchromatic multispectral camera positioned in the middle, wherein each panchromatic multispectral camera is plated with a film consisting of a panchromatic strip and a plurality of multispectral strips for preventing the aliasing of frequency spectrums, an isolation band is also arranged between the spectral strips, the isolation band is a black strip, and partial black strips are reserved at two ends of the isolation band; the device includes:
the communication module is used for receiving an image acquisition instruction of the ground center;
the analysis module is used for analyzing the image acquisition instruction to obtain a target image acquisition mode; the image acquisition mode comprises any one of the following modes: the system comprises a wide-width imaging mode, a super-resolution imaging mode, a color multispectral fusion imaging mode and a color camera super-resolution imaging mode;
the imaging module is used for calling at least one camera corresponding to the target image acquisition mode in the array remote sensing camera to acquire images according to the target image acquisition mode and processing the acquired images according to the processing mode corresponding to the target image acquisition mode to obtain target remote sensing images;
when the target image acquisition mode is a wide-width imaging mode, calling the three panchromatic multispectral cameras to acquire images simultaneously; splicing images collected by the three panchromatic multispectral cameras to obtain a target remote sensing image;
when the target image acquisition mode is a super-resolution imaging mode, calling the three panchromatic multispectral cameras to acquire images simultaneously; based on the images collected by the panchromatic multispectral cameras at the two sides, performing super-resolution reconstruction processing on the image collected by the panchromatic multispectral camera at the middle position to obtain a target remote sensing image;
when the target image acquisition mode is a color multispectral fusion imaging mode, calling the high-resolution color camera and a panchromatic multispectral camera positioned in the middle position to acquire images simultaneously; fusing the image collected by the high-resolution color camera and the image collected by the panchromatic multispectral camera positioned in the middle position to obtain a target remote sensing image;
when the target image acquisition mode is a color camera super-resolution imaging mode, calling the high-resolution color camera to acquire images with different frame frequencies for multiple times within preset time; and performing super-resolution reconstruction processing on a plurality of images with different frame frequencies acquired by the high-resolution color camera to obtain a target remote sensing image.
4. The apparatus of claim 3, in which the three panchromatic multispectral cameras are plated with the same multispectral strip; or the panchromatic multispectral cameras at the two sides are plated with the same multispectral bands, and the panchromatic multispectral camera at the middle position is plated with multispectral bands different from the panchromatic multispectral cameras at the two sides.
5. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of the preceding claims 1-2 are implemented by the processor when executing the computer program.
6. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of the claims 1-2.
CN202110046703.8A 2021-01-14 2021-01-14 Reconfigurable array imaging method and device for software-defined satellite Active CN112866574B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110046703.8A CN112866574B (en) 2021-01-14 2021-01-14 Reconfigurable array imaging method and device for software-defined satellite

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110046703.8A CN112866574B (en) 2021-01-14 2021-01-14 Reconfigurable array imaging method and device for software-defined satellite

Publications (2)

Publication Number Publication Date
CN112866574A CN112866574A (en) 2021-05-28
CN112866574B true CN112866574B (en) 2022-12-23

Family

ID=76003697

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110046703.8A Active CN112866574B (en) 2021-01-14 2021-01-14 Reconfigurable array imaging method and device for software-defined satellite

Country Status (1)

Country Link
CN (1) CN112866574B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125216B (en) * 2021-10-27 2023-04-07 中国科学院软件研究所 Imaging system and imaging method for software defined satellite

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101646033A (en) * 2008-08-04 2010-02-10 株式会社东芝 Image processing apparatus and image processing method
CN108382608A (en) * 2018-01-31 2018-08-10 上海航天控制技术研究所 It is a kind of freely to reconstruct and the earth observation Nano satellite group system of synergistic observation
CN111536991A (en) * 2020-04-26 2020-08-14 哈尔滨工业大学 Remote sensing satellite multi-mode imaging load simulation device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9930316B2 (en) * 2013-08-16 2018-03-27 University Of New Brunswick Camera imaging systems and methods
CN108932708A (en) * 2018-06-13 2018-12-04 中国科学院光电研究院 Satellite-borne multispectral remote sensing image fusion method based on super-resolution enhancing
CN110516588B (en) * 2018-12-29 2023-04-18 长沙天仪空间科技研究院有限公司 Remote sensing satellite system
CN109946713A (en) * 2019-04-02 2019-06-28 上海微小卫星工程中心 A kind of restructural satellite system of distribution and remote sensing technique
US10909701B2 (en) * 2019-06-27 2021-02-02 The Chinese University Of Hong Kong Method for data acquisition and image processing for reconstructing a super-resolved image
CN111950877B (en) * 2020-07-31 2023-11-14 上海卫星工程研究所 Multi-star formation collaborative region imaging autonomous task planning method and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101646033A (en) * 2008-08-04 2010-02-10 株式会社东芝 Image processing apparatus and image processing method
CN108382608A (en) * 2018-01-31 2018-08-10 上海航天控制技术研究所 It is a kind of freely to reconstruct and the earth observation Nano satellite group system of synergistic observation
CN111536991A (en) * 2020-04-26 2020-08-14 哈尔滨工业大学 Remote sensing satellite multi-mode imaging load simulation device

Also Published As

Publication number Publication date
CN112866574A (en) 2021-05-28

Similar Documents

Publication Publication Date Title
US11493675B2 (en) Single-sensor hyperspectral imaging device
EP3830551B1 (en) A hybrid spectral imager
US8149400B2 (en) Coded aperture snapshot spectral imager and method therefor
CN112672054B (en) Focusing method and device and electronic equipment
US6295392B1 (en) Super resolution methods for electro-optical systems
Lu et al. Multiresolution imaging
CN110114645A (en) Hyper spectral Imaging when observed object is static
CN110114646A (en) The dynamic Hyper spectral Imaging of object in apparent motion
US9336570B2 (en) Demosaicking system and method for color array based multi-spectral sensors
CN106920221A (en) Take into account the exposure fusion method that Luminance Distribution and details are presented
CN112866574B (en) Reconfigurable array imaging method and device for software-defined satellite
EP3859657A1 (en) Image processing device, image processing method, and program
CN108184075A (en) For generating the method and apparatus of image
Zhou et al. Multiframe super resolution reconstruction method based on light field angular images
Kurihara et al. Unmanned Aerial Vehicle (UAV)-based hyperspectral imaging system for precision agriculture and forest management
Elwarfalli et al. Fifnet: A convolutional neural network for motion-based multiframe super-resolution using fusion of interpolated frames
CN112106346A (en) Image processing method, device, unmanned aerial vehicle, system and storage medium
CN110476412B (en) Information processing apparatus, information processing method, and storage medium
Spote et al. Joint demosaicing of colour and polarisation from filter arrays
CN114529488A (en) Image fusion method, device and equipment and storage medium
CN113674331A (en) Image alignment method and apparatus, electronic device, and computer-readable storage medium
KR20160071318A (en) High-resolution imaging devices using low-resolution sensors and compressive sensing exploiting joint sparsity
CN111854956A (en) Multispectral imaging system based on micro-lens array and image reconstruction method
CN113281282B (en) Image acquisition and reconstruction method, equipment and storage medium
WO2023193626A1 (en) Image sensor, imaging module, image collection device, and image processing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant