CN116701676A - Remote sensing satellite image data management method and related equipment - Google Patents
Remote sensing satellite image data management method and related equipment Download PDFInfo
- Publication number
- CN116701676A CN116701676A CN202211292581.1A CN202211292581A CN116701676A CN 116701676 A CN116701676 A CN 116701676A CN 202211292581 A CN202211292581 A CN 202211292581A CN 116701676 A CN116701676 A CN 116701676A
- Authority
- CN
- China
- Prior art keywords
- image data
- metadata
- remote sensing
- data
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000013523 data management Methods 0.000 title claims abstract description 21
- 238000006243 chemical reaction Methods 0.000 claims abstract description 22
- 230000000750 progressive effect Effects 0.000 claims abstract description 20
- 238000007726 management method Methods 0.000 claims abstract description 19
- 238000013507 mapping Methods 0.000 claims abstract description 16
- 230000011218 segmentation Effects 0.000 claims abstract description 14
- 238000005516 engineering process Methods 0.000 claims abstract description 11
- 238000012545 processing Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 8
- 230000000007 visual effect Effects 0.000 claims description 8
- 238000012216 screening Methods 0.000 claims description 7
- 230000006870 function Effects 0.000 claims description 4
- 238000012806 monitoring device Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims 1
- 230000008520 organization Effects 0.000 abstract description 7
- 230000008569 process Effects 0.000 abstract description 4
- 238000012300 Sequence Analysis Methods 0.000 abstract description 3
- 238000013500 data storage Methods 0.000 abstract description 3
- 238000012800 visualization Methods 0.000 abstract 1
- 238000004458 analytical method Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 2
- 230000008676 import Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/53—Querying
- G06F16/532—Query formulation, e.g. graphical querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/56—Information retrieval; Database structures therefor; File system structures therefor of still image data having vectorial format
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/13—Satellite images
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Library & Information Science (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Astronomy & Astrophysics (AREA)
- Remote Sensing (AREA)
- Multimedia (AREA)
- Image Processing (AREA)
Abstract
The embodiment of the application discloses a remote sensing satellite image data management method and related equipment, wherein the method comprises the following steps: acquiring metadata information and image data of remote sensing satellite image data, and importing the metadata information into a preset metadata base according to a preset metadata structure model, wherein the preset metadata base comprises a mapping relation between the metadata information and the image data, and the metadata information comprises a space coordinate reference system of the remote sensing satellite image data and a data format of the metadata; storing the image data in a space-time data set mode, and importing metadata information of data slices in the space-time data set into a preset metadata base, wherein the metadata information of the data slices is attached to metadata information of the remote sensing satellite image data; and acquiring the image data displayed in a progressive segmentation way according to a preset search condition. The multi-source remote sensing metadata is subjected to format conversion, unified storage and management of the multi-source remote sensing metadata are achieved, multi-source remote sensing data storage is achieved by means of a grid, data organization is convenient during time sequence analysis, retrieval is convenient, progressive segmented display of the image data is achieved through a paging technology, and the automatic and convenient visualization process of single-time-phase remote sensing image data of a target area according to page segmentation is achieved.
Description
Technical Field
The application relates to the technical field of remote sensing satellite image data management, in particular to a remote sensing satellite image data management method and related equipment.
Background
The remote sensing satellite image data comprises original image data, result data obtained by processing the original image data, and catalogues and metadata of satellite remote sensing data; image data of different spectral resolutions, different temporal resolutions, different terrestrial resolutions, and different satellites are also included. Along with the continuous development of remote sensing platforms and the continuous enrichment of remote sensing means, the scale of remote sensing image data is increased from an initial GB level to a TB level, even PB level is reached, and the types and formats of the data tend to be diversified. The expansion of the remote sensing image data size brings greater challenges to the capacity, performance and cost performance of the storage system. The remote sensing data has the characteristics of multiple dimensions such as space-time and the like, and the analysis and the processing of the remote sensing data set by utilizing the time and other dimensions have received more and more attention. The remote sensing data of different satellites have great differences in projection standards, storage formats and the like, so that the remote sensing data is difficult to manage, and the existing data acquisition and time sequence data organization analysis efficiency is not high.
Disclosure of Invention
In view of the above, the application provides a remote sensing satellite image data management method and related equipment, which are used for solving the problems that remote sensing data of different satellites in the prior art have larger difference and are inconvenient to manage uniformly. To achieve one or a part or all of the above or other objects, the present application provides a remote sensing satellite image data management method, comprising: acquiring metadata information and image data of remote sensing satellite image data, and importing the metadata information into a preset metadata base according to a preset metadata structure model, wherein the preset metadata base comprises a mapping relation between the metadata information and the image data, and the metadata information comprises a space coordinate reference system of the remote sensing satellite image data and a data format of the metadata;
storing the image data in a space-time data set mode, and importing metadata information of data slices in the space-time data set into a preset metadata base, wherein the metadata information of the data slices is attached to metadata information of the remote sensing satellite image data;
and acquiring target image data displayed in a progressive segmentation mode according to preset search conditions.
Optionally, the step of importing the metadata information into a preset metadata base according to a preset metadata structure model, where the metadata information includes a spatial coordinate reference system of the remote sensing satellite image data and a data format of the metadata includes:
acquiring a format conversion rule of a data format of the metadata and a target data format of the preset metadata structure model, and converting the data format of the metadata into metadata of the target data format based on the format conversion rule;
acquiring a coordinate conversion rule of a space coordinate reference system of the remote sensing satellite image data and a target space coordinate reference system of the preset metadata structure model, and converting the remote sensing satellite image data into remote sensing satellite image data under the target space coordinate reference system based on the coordinate conversion rule;
and importing the metadata in the target data format and the remote sensing satellite image data under the target space coordinate reference system into a preset metadata base.
Optionally, the step of importing the metadata in the target data format and the remote sensing satellite image data under the target space coordinate reference system into a preset metadata base includes:
and establishing a relational data table with a NoSQL field through the PostgreSQL to store the metadata in a target data format and the remote sensing satellite image data under a target space coordinate reference system, wherein the relational data table comprises the mapping relation between the metadata information and the image data.
Optionally, the step of storing the image data in a space-time data set, importing metadata information of a data slice in the space-time data set into a preset metadata base, where the metadata information of the data slice is attached to metadata information of the remote sensing satellite image data, includes:
dividing the image data based on spatial longitude and latitude, and storing a space-time data set of the image data;
acquiring metadata information of each data slice in the space-time data set;
and importing metadata information of the data slices in the space-time data set into a preset metadata database, wherein the metadata information of the data slices is attached to metadata information of the remote sensing satellite image data.
Optionally, the step of storing the image data in a space-time data set includes:
and carrying out storage management on the spatio-temporal data set according to a directory level by constructing a directory management layer, wherein the directory level comprises a main directory and a sub directory, the main directory and the metadata information are mapped with each other, the sub directory and the metadata information of the data slice are mapped with each other, and the directory management layer provides a cloud storage function.
Optionally, the step of obtaining the target image data displayed in a progressive segment according to a preset search condition includes:
a single full coverage search method of paging technology is adopted, and a search result set of the space-time data set of the target area is searched according to preset search conditions;
performing visual processing on the search result set by adopting a method of adding a layer to obtain initial image data of progressive segmented display;
and screening the initial image data according to preset conditions to obtain target image data meeting the preset conditions.
Optionally, the step of retrieving the retrieval result set of the space-time data set of the target area according to the preset retrieval condition by adopting the single full coverage retrieval method of the paging technology includes:
a single full coverage search method applying a paging technology obtains a search result set of a target area meeting business requirements;
acquiring a remote sensing image data fast view corresponding to the search result set according to page segmentation;
and taking the remote sensing image data fast view as a target retrieval result set.
In another aspect, the present application provides a remote sensing satellite image data management device, where the monitoring device includes:
the data acquisition module is used for acquiring metadata information and image data of the remote sensing satellite image data, and importing the metadata information into a preset metadata base according to a preset metadata structure model, wherein the preset metadata base comprises a mapping relation between the metadata information and the image data, and the metadata information comprises a space coordinate reference system of the remote sensing satellite image data and a data format of the metadata;
the storage module is used for storing the image data in a space-time data set mode, importing metadata information of data slices in the space-time data set into a preset metadata base, and attaching the metadata information of the data slices to the metadata information of the remote sensing satellite image data;
and the display module is used for acquiring the target image data displayed in a progressive and segmented mode according to the preset search condition.
In a third aspect, an embodiment of the present application provides an electronic device, including: the remote sensing satellite image data management system comprises a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, when the electronic device is running, the processor and the memory are communicated through the bus, and the machine-readable instructions are executed by the processor to perform the steps of the remote sensing satellite image data management method.
In a fourth aspect, embodiments of the present application provide a computer readable storage medium having a computer program stored thereon, the computer program when executed by a processor performing the steps of the remote sensing satellite image data management method as described above.
The implementation of the embodiment of the application has the following beneficial effects:
the method comprises the steps of obtaining metadata information and image data of remote sensing satellite image data, and importing the metadata information into a preset metadata base according to a preset metadata structure model, wherein the preset metadata base comprises a mapping relation between the metadata information and the image data, and the metadata information comprises a space coordinate reference system of the remote sensing satellite image data and a data format of the metadata; the format conversion is carried out on the multi-source remote sensing metadata, so that unified storage and management of the multi-source remote sensing metadata are realized; storing the image data in a space-time data set mode, and importing metadata information of data slices in the space-time data set into a preset metadata base, wherein the metadata information of the data slices is attached to metadata information of the remote sensing satellite image data; the data organization is more convenient when the time sequence analysis is carried out; and acquiring target image data displayed in a progressive segmentation way according to preset retrieval conditions, and realizing automatic and convenient visual processing of the single-phase remote sensing image data of the target area according to page segmentation.
Drawings
In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Wherein:
FIG. 1 is a flowchart of a remote sensing satellite image data management method according to an embodiment of the present application;
FIG. 2 is a flowchart of another method for managing remote sensing satellite image data according to an embodiment of the present application;
FIG. 3 is a flowchart of a remote sensing satellite image data management method according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a remote sensing satellite image data management device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a storage medium according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
As shown in fig. 1, an embodiment of the present application provides a remote sensing satellite image data management method, including:
s101, acquiring metadata information and image data of remote sensing satellite image data, and importing the metadata information into a preset metadata base according to a preset metadata structure model, wherein the preset metadata base comprises a mapping relation between the metadata information and the image data, and the metadata information comprises a space coordinate reference system of the remote sensing satellite image data and a data format of the metadata;
the metadata is used as description information of the remote sensing satellite image data, and records information of various parameters such as imaging time, a space coordinate reference system, geographic positions, product levels and the like of the remote sensing satellite data, so that the remote sensing satellite image data can be efficiently managed and retrieved through the metadata, and a preset metadata structure model is built according to the information contained in the geographic metadata and the requirements of remote sensing metadata management. The preset metadata structure model comprises a satellite platform, a sensor, a data format, coordinate information, image start time, image end time, center dimension coordinates, wave band information and other contents, and various multi-source heterogeneous remote sensing satellite metadata uniformly extracts metadata item contents according to the preset metadata structure model.
S102, storing the image data in a space-time data set mode, and importing metadata information of data slices in the space-time data set into a preset metadata base, wherein the metadata information of the data slices is attached to metadata information of the remote sensing satellite image data;
illustratively, the image data is segmented based on a space theodolite grid to obtain data slices, so that a space-time data set is obtained, and a slice file is named based on information that each data slice has space and time dimensions and metadata information of the slice file is stored in a metadata base.
S103, acquiring progressive segmented display target image data according to preset search conditions.
In the massive remote sensing data, for a large-area-range target area, the single-time-phase full-coverage remote sensing image data volume acquired according to preset retrieval conditions is very large, the problem of long visual processing time can be solved through progressive segmentation display, an optimal remote sensing image data set of the single-time-phase full-coverage of the target area, namely, target image data, can be efficiently acquired, the flexibility of visual processing is improved, and the manpower resource consumption of remote sensing data screening is reduced.
The method comprises the steps of obtaining metadata information and image data of remote sensing satellite image data, and importing the metadata information into a preset metadata base according to a preset metadata structure model, wherein the preset metadata base comprises a mapping relation between the metadata information and the image data, and the metadata information comprises a space coordinate reference system of the remote sensing satellite image data and a data format of the metadata; the format conversion is carried out on the multi-source remote sensing metadata, so that unified storage and management of the multi-source remote sensing metadata are realized; storing the image data in a space-time data set mode, and importing metadata information of data slices in the space-time data set into a preset metadata base, wherein the metadata information of the data slices is attached to metadata information of the remote sensing satellite image data; the data organization is more convenient when the time sequence analysis is carried out; and acquiring target image data displayed in a progressive segmentation way according to preset retrieval conditions, and realizing automatic and convenient visual processing of the single-phase remote sensing image data of the target area according to page segmentation.
In one possible implementation manner, the step of importing the metadata information into a preset metadata base according to a preset metadata structure model, where the metadata information includes a spatial coordinate reference system of the remote sensing satellite image data and a data format of the metadata includes:
acquiring a format conversion rule of a data format of the metadata and a target data format of the preset metadata structure model, and converting the data format of the metadata into metadata of the target data format based on the format conversion rule;
acquiring a coordinate conversion rule of a space coordinate reference system of the remote sensing satellite image data and a target space coordinate reference system of the preset metadata structure model, and converting the remote sensing satellite image data into remote sensing satellite image data under the target space coordinate reference system based on the coordinate conversion rule;
and importing the metadata in the target data format and the remote sensing satellite image data under the target space coordinate reference system into a preset metadata base.
Exemplary, as shown in fig. 2, a format conversion rule between each remote sensing satellite image metadata and a standard metadata model is determined according to a corresponding relation between different data formats, metadata information extraction is performed according to the format conversion rule, null values are given to non-existing metadata fields, and unified metadata information obtained by extraction is stored in a metadata database for unified management.
The coordinate conversion rule of the space coordinate reference system of the remote sensing satellite image data and the target space coordinate reference system of the preset metadata structure model is determined according to the corresponding relation between the space coordinate reference system of the remote sensing satellite image data and the target space coordinate reference system of the preset metadata structure model, metadata information conversion is carried out according to the coordinate conversion rule, and unified metadata information obtained through conversion is stored in a metadata database for unified management.
In one possible implementation manner, the step of importing the metadata in the target data format and the remote sensing satellite image data under the target space coordinate reference system into the preset metadata base includes:
and establishing a relational data table with a NoSQL field through the PostgreSQL to store the metadata in a target data format and the remote sensing satellite image data under a target space coordinate reference system, wherein the relational data table comprises the mapping relation between the metadata information and the image data.
For example, a relational data table with a NoSQL field is established through PostgreSQL to store metadata in a target data format and remote sensing satellite image data under a target space coordinate reference system, the relational data table comprises a metadata table, a data type table, a mapping rule table, a template library table and the like, wherein the metadata table is responsible for recording each piece of remote sensing satellite image data stored in a system, metadata fields of the remote sensing satellite image data are described by jsonb format fields managed in a key-vlue form, and in order to optimize image retrieval, a time column, longitude and latitude coordinates, wei Xingming, a sensor name and a data product name column in the metadata are respectively constructed into indexes.
In one possible implementation manner, the step of storing the image data in a manner of a space-time data set, importing metadata information of a data slice in the space-time data set into a preset metadata base, wherein the metadata information of the data slice is attached to metadata information of the remote sensing satellite image data, includes:
dividing the image data based on spatial longitude and latitude, and storing a space-time data set of the image data;
acquiring metadata information of each data slice in the space-time data set;
and importing metadata information of the data slices in the space-time data set into a preset metadata database, wherein the metadata information of the data slices is attached to metadata information of the remote sensing satellite image data.
The storage process of the original data of the remote sensing satellite image data is mainly realized by extracting and warehousing metadata, the remote sensing satellite image data is not subjected to excessive processing, the storage efficiency is high, and the original data can be provided for other format conversion and data product generation by not carrying out excessive processing on the remote sensing satellite image data.
Illustratively, the space grid subdivision is to perform multi-stage seamless grid division on the surface of the earth, and simulate the surface of the earth by using polygons or grids with certain sizes with certain longitude and latitude as a scale. Because the grid has high standardization organization degree and then combines time characteristics, the space-time change condition of the geographic characteristics of the region can be conveniently represented.
The space grid subdivision can be generally divided into longitude and latitude grid subdivision, regular polyhedron grid subdivision based, grid subdivision based on geographic entities and the like, in the embodiment, a theodolite grid subdivision model is adopted, a GLTS (Clobal Logical Tile Scheme) grid model is adopted for division, and a space-time data set is formed by combining the remote sensing image data set divided by the space theodolite grid with information in the time dimension. The space-time data set can realize space-time integrated data organization, storage and analysis, has the dispersibility of data storage and the flexibility of organization, and is convenient for data storage and calculation in a distributed computing environment.
In one possible implementation manner, the step of storing the image data in a manner of a spatiotemporal data set includes:
and carrying out storage management on the spatio-temporal data set according to a directory level by constructing a directory management layer, wherein the directory level comprises a main directory and a sub directory, the main directory and the metadata information are mapped with each other, the sub directory and the metadata information of the data slice are mapped with each other, and the directory management layer provides a cloud storage function.
By using Openstack shift to realize a multi-user-oriented cloud storage process with a hierarchical directory, the shift uses consistency Hash theory and introduces a virtual node concept, so that when a cluster point is dynamically added or exited, a large amount of data movement is not required to be carried out on stored data which is already hashed in the cluster node, and the remapping of data of a new cluster can be realized, thereby ensuring the expandability of the system; meanwhile, the shift performs certain redundant storage on the data, so that the data persistence of the storage system is ensured.
When the space-time data set storage is managed according to the directory level, user-oriented multi-level directory management needs to be realized in the shift Object storage, namely, a directory management layer is added between the content storage and the Object file, and services provided by the directory management layer mainly comprise operations of creating a new directory, deleting the directory, inquiring subdirectories under the directory, an Object list and the like, and a cloud storage process is formed by combining the Object downloading and uploading functions provided by the shift.
In one possible implementation manner, the step of acquiring the target image data displayed in progressive segments according to the preset search condition includes:
a single full coverage search method of paging technology is adopted, and a search result set of the space-time data set of the target area is searched according to preset search conditions;
performing visual processing on the search result set by adopting a method of adding a layer to obtain initial image data of progressive segmented display;
and screening the initial image data according to preset conditions to obtain target image data meeting the preset conditions.
Exemplary, the step of obtaining the target image data displayed in a progressive segment according to the preset search condition includes: and (3) acquiring a remote sensing satellite image data set by single full-coverage paging retrieval, acquiring a remote sensing satellite image data fast view, visually displaying the remote sensing satellite image data, and screening the remote sensing satellite image data.
In one possible implementation manner, the step of searching the search result set of the space-time data set of the target area according to the preset search condition by using the single full coverage search method adopting the paging technology includes:
a single full coverage search method applying a paging technology obtains a search result set of a target area meeting business requirements;
acquiring a remote sensing image data fast view corresponding to the search result set according to page segmentation;
and taking the remote sensing image data fast view as a target retrieval result set.
Exemplary, a single full coverage page search obtains a remote sensing satellite image dataset. The single full coverage search method using paging technology obtains the image dataset of the full coverage of the research area, the latest time, the least cloud amount and the same area as the image data of one scene. And obtaining a remote sensing satellite image data fast view. And acquiring an image dataset which displays the full coverage of the target area according to pages, has the latest time and the least cloud cover and has the same area as the image data of one scene, and acquiring the remote sensing image data fast view according to the page segments. And visually displaying remote sensing satellite image data. And the space visual display of the remote sensing satellite image data fast view on the map is realized by adding the image layer. And screening remote sensing satellite image data. The image data of the target area is visually displayed in a page-by-page segmented and automatic mapping mode, the time is latest, the cloud amount is minimum, and the image data of one scene in the same area can be obtained by adding manual individual screening.
In one possible implementation manner, as shown in fig. 3, the step one of uniformly searching the multi-source heterogeneous remote sensing metadata structure is equivalent to storing the metadata in the target data format and the remote sensing satellite image data under the target space coordinate reference system by establishing a relational data table with NoSQL fields through PostgreSQL, the step two of storing and organizing the remote sensing image data in a space-time data set is equivalent to storing the image data in a space-time data set, the step three of searching the space-time data set based on cloud storage is equivalent to storing and managing the space-time data set according to a catalog level by constructing a catalog management layer, and the step four of progressively segmenting display for the remote sensing image data image quick view is equivalent to obtaining the progressively segmented display target image data according to preset searching conditions.
In another aspect, as shown in fig. 4, the present application provides a remote sensing satellite image data management device, where the monitoring device includes:
the data acquisition module 201 is configured to acquire metadata information and image data of remote sensing satellite image data, and import the metadata information into a preset metadata base according to a preset metadata structure model, where the preset metadata base includes a mapping relationship between the metadata information and the image data, and the metadata information includes a spatial coordinate reference system of the remote sensing satellite image data and a data format of the metadata;
the storage module 202 is configured to store the image data in a manner of a space-time data set, import metadata information of a data slice in the space-time data set into a preset metadata base, and attach metadata information of the data slice to metadata information of the remote sensing satellite image data;
the display module 203 is configured to obtain target image data displayed in progressive segments according to a preset search condition.
In one possible implementation, as shown in fig. 5, an embodiment of the present application provides an electronic device 300, including: comprising a memory 310, a processor 320 and a computer program 311 stored on the memory 310 and executable on the processor 320, the processor 320 implementing, when executing the computer program 311: acquiring metadata information and image data of remote sensing satellite image data, and importing the metadata information into a preset metadata base according to a preset metadata structure model, wherein the preset metadata base comprises a mapping relation between the metadata information and the image data, and the metadata information comprises a space coordinate reference system of the remote sensing satellite image data and a data format of the metadata; storing the image data in a space-time data set mode, and importing metadata information of data slices in the space-time data set into a preset metadata base, wherein the metadata information of the data slices is attached to metadata information of the remote sensing satellite image data; and obtaining target image data displayed in a progressive segmentation mode according to preset search conditions.
In one possible implementation, as shown in fig. 6, an embodiment of the present application provides a computer-readable storage medium 400 having a computer program 411 stored thereon, the computer program 411, when executed by a processor, implementing: acquiring metadata information and image data of remote sensing satellite image data, and importing the metadata information into a preset metadata base according to a preset metadata structure model, wherein the preset metadata base comprises a mapping relation between the metadata information and the image data, and the metadata information comprises a space coordinate reference system of the remote sensing satellite image data and a data format of the metadata; storing the image data in a space-time data set mode, and importing metadata information of data slices in the space-time data set into a preset metadata base, wherein the metadata information of the data slices is attached to metadata information of the remote sensing satellite image data; and obtaining target image data displayed in a progressive segmentation mode according to preset search conditions.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
It will be appreciated by those of ordinary skill in the art that the modules or steps of the application described above may be implemented in a general purpose computing device, they may be centralized on a single computing device, or distributed over a network of computing devices, or they may alternatively be implemented in program code executable by a computer device, such that they are stored in a memory device and executed by the computing device, or they may be separately fabricated as individual integrated circuit modules, or multiple modules or steps within them may be fabricated as a single integrated circuit module. Thus, the present application is not limited to any specific combination of hardware and software.
Note that the above is only a preferred embodiment of the present application and the technical principle applied. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of numerous obvious changes, rearrangements and substitutions without departing from the scope of the application. Therefore, while the application has been described in connection with the above embodiments, the application is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the application, which is set forth in the following claims. The foregoing disclosure is illustrative of the present application and is not to be construed as limiting the scope of the application, which is defined by the appended claims.
Claims (10)
1. The remote sensing satellite image data management method is characterized by comprising the following steps of:
acquiring metadata information and image data of remote sensing satellite image data, and importing the metadata information into a preset metadata base according to a preset metadata structure model, wherein the preset metadata base comprises a mapping relation between the metadata information and the image data, and the metadata information comprises a space coordinate reference system of the remote sensing satellite image data and a data format of the metadata;
storing the image data in a space-time data set mode, and importing metadata information of data slices in the space-time data set into a preset metadata base, wherein the metadata information of the data slices is attached to metadata information of the remote sensing satellite image data;
and acquiring target image data displayed in a progressive segmentation mode according to preset search conditions.
2. The method of claim 1, wherein the step of importing the metadata information into a preset metadata base according to a preset metadata structure model, the metadata information including a spatial coordinate reference system of the remote sensing satellite image data and a data format of the metadata includes:
acquiring a format conversion rule of a data format of the metadata and a target data format of the preset metadata structure model, and converting the data format of the metadata into metadata of the target data format based on the format conversion rule;
acquiring a coordinate conversion rule of a space coordinate reference system of the remote sensing satellite image data and a target space coordinate reference system of the preset metadata structure model, and converting the remote sensing satellite image data into remote sensing satellite image data under the target space coordinate reference system based on the coordinate conversion rule;
and importing the metadata in the target data format and the remote sensing satellite image data under the target space coordinate reference system into a preset metadata base.
3. The method of claim 2, wherein the step of importing the metadata in the target data format and the remote sensing satellite image data in the target space coordinate reference system into the preset metadata base comprises:
and establishing a relational data table with a NoSQL field through the PostgreSQL to store the metadata in a target data format and the remote sensing satellite image data under a target space coordinate reference system, wherein the relational data table comprises the mapping relation between the metadata information and the image data.
4. The method of claim 1, wherein the step of storing the image data in a space-time data set, importing metadata information of a data slice in the space-time data set into a preset metadata base, and attaching the metadata information of the data slice to the metadata information of the remote sensing satellite image data comprises:
dividing the image data based on spatial longitude and latitude, and storing a space-time data set of the image data;
acquiring metadata information of each data slice in the space-time data set;
and importing metadata information of the data slices in the space-time data set into a preset metadata database, wherein the metadata information of the data slices is attached to metadata information of the remote sensing satellite image data.
5. The method of claim 1, wherein the step of storing the image data in a space-time dataset comprises:
and carrying out storage management on the spatio-temporal data set according to a directory level by constructing a directory management layer, wherein the directory level comprises a main directory and a sub directory, the main directory and the metadata information are mapped with each other, the sub directory and the metadata information of the data slice are mapped with each other, and the directory management layer provides a cloud storage function.
6. The method for remote sensing satellite image data management according to claim 1, wherein the step of obtaining the target image data for progressive segmented display according to the preset search condition comprises:
a single full coverage search method of paging technology is adopted, and a search result set of the space-time data set of the target area is searched according to preset search conditions;
performing visual processing on the search result set by adopting a method of adding a layer to obtain initial image data of progressive segmented display;
and screening the initial image data according to preset conditions to obtain target image data meeting the preset conditions.
7. The method for managing remote sensing satellite image data according to claim 6, wherein the step of searching the search result set of the space-time data set of the target area according to the preset search condition by using the single full coverage search method of the paging technology comprises the steps of:
a single full coverage search method applying a paging technology obtains a search result set of a target area meeting business requirements;
acquiring a remote sensing image data fast view corresponding to the search result set according to page segmentation;
and taking the remote sensing image data fast view as a target retrieval result set.
8. A remote sensing satellite image data management device, wherein the monitoring device comprises:
the data acquisition module is used for acquiring metadata information and image data of the remote sensing satellite image data, and importing the metadata information into a preset metadata base according to a preset metadata structure model, wherein the preset metadata base comprises a mapping relation between the metadata information and the image data, and the metadata information comprises a space coordinate reference system of the remote sensing satellite image data and a data format of the metadata;
the storage module is used for storing the image data in a space-time data set mode, importing metadata information of data slices in the space-time data set into a preset metadata base, and attaching the metadata information of the data slices to the metadata information of the remote sensing satellite image data;
and the display module is used for acquiring the target image data displayed in a progressive and segmented mode according to the preset search condition.
9. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory in communication via the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the steps of the telemetry satellite image data management method of any one of claims 1 to 7.
10. A computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, which when executed by a processor performs the steps of the remote sensing satellite image data management method according to any one of claims 1 to 7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211292581.1A CN116701676A (en) | 2022-10-21 | 2022-10-21 | Remote sensing satellite image data management method and related equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211292581.1A CN116701676A (en) | 2022-10-21 | 2022-10-21 | Remote sensing satellite image data management method and related equipment |
Publications (1)
Publication Number | Publication Date |
---|---|
CN116701676A true CN116701676A (en) | 2023-09-05 |
Family
ID=87826385
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211292581.1A Pending CN116701676A (en) | 2022-10-21 | 2022-10-21 | Remote sensing satellite image data management method and related equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116701676A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117931810A (en) * | 2024-03-21 | 2024-04-26 | 成都歧明通信息科技有限公司 | Structured management method and system for spatial image data |
-
2022
- 2022-10-21 CN CN202211292581.1A patent/CN116701676A/en active Pending
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117931810A (en) * | 2024-03-21 | 2024-04-26 | 成都歧明通信息科技有限公司 | Structured management method and system for spatial image data |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8352480B2 (en) | Methods, apparatuses and computer program products for converting a geographical database into a map tile database | |
CN108776699B (en) | Method and device for processing meteorological data and satellite remote sensing data | |
Eldawy et al. | Shahed: A mapreduce-based system for querying and visualizing spatio-temporal satellite data | |
CN110969691B (en) | WebGL-based photographic data scheduling method and system | |
JP7300797B2 (en) | Fusion of scalable spatio-temporal density data | |
CN112115198A (en) | Urban remote sensing intelligent service platform | |
CN110309264A (en) | The method and apparatus of knowledge based map acquisition geographic products data | |
Regueiro et al. | Virtual integration of sensor observation data | |
Jhummarwala et al. | Parallel and distributed GIS for processing geo-data: an overview | |
Gao et al. | A multi-source spatio-temporal data cube for large-scale geospatial analysis | |
CN114925043B (en) | Application method and device based on space-time grid block data and electronic equipment | |
CN116701676A (en) | Remote sensing satellite image data management method and related equipment | |
Kang et al. | Spatial-temporal visualization and analysis of earth data under Cesium Digital Earth Engine | |
CN116257599A (en) | Electronic map display method and device, electronic equipment and storage medium | |
McGuire et al. | HydroCloud: A cloud-based system for hydrologic data integration and analysis | |
CN206117732U (en) | Cartographic data server system | |
CN105260389A (en) | Unmanned aerial vehicle reconnaissance image data management and visual display method | |
Wang et al. | Requirement-driven remote sensing metadata planning and online acquisition method for large-scale heterogeneous data | |
Li et al. | A web-based remote sensing data processing and production system with the unified integration of multi-disciplinary data and models | |
Huang et al. | Design and implementation of geological data management platform based on Webgis | |
Vo et al. | A highly scalable data management system for point cloud and full waveform lidar data | |
Gorte | Analysis of very large voxel datasets | |
CN111815495B (en) | CIM platform decision method, system, equipment and storage medium based on mixed reality | |
Zhao et al. | A hierarchical organization approach of multi-dimensional remote sensing data for lightweight Web Map Services | |
Zhang et al. | Spatial data infrastructure for e-government based on the geospatial services |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |