CN110263017A - A kind of key assignments storage method and device based on Grid remotely-sensed data file set - Google Patents

A kind of key assignments storage method and device based on Grid remotely-sensed data file set Download PDF

Info

Publication number
CN110263017A
CN110263017A CN201910500955.6A CN201910500955A CN110263017A CN 110263017 A CN110263017 A CN 110263017A CN 201910500955 A CN201910500955 A CN 201910500955A CN 110263017 A CN110263017 A CN 110263017A
Authority
CN
China
Prior art keywords
remotely
sensed data
file
source file
grid
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910500955.6A
Other languages
Chinese (zh)
Other versions
CN110263017B (en
Inventor
王建民
沈恩亚
刘英博
赵鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Publication of CN110263017A publication Critical patent/CN110263017A/en
Application granted granted Critical
Publication of CN110263017B publication Critical patent/CN110263017B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2228Indexing structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the present invention provides a kind of key assignments storage method and device based on Grid remotely-sensed data file set.The described method includes: obtaining the filename and file size of each remotely-sensed data source file, and the data format of the remotely-sensed data source file is determined according to the filename;Subdivision processing function corresponding with the data format is called to parse the remotely-sensed data in the remotely-sensed data source file according to the data format;If judgement knows that the file size is greater than threshold value, the remotely-sensed data of the remotely-sensed data source file after parsing is split into database according to default storage format by storage according to regular polygon Grid subdivision method.Described device is for executing the above method.Key assignments storage method and device provided in an embodiment of the present invention based on Grid remotely-sensed data file set, improves the storage efficiency of remotely-sensed data.

Description

A kind of key assignments storage method and device based on Grid remotely-sensed data file set
Technical field
The present invention relates to technical field of data processing, and in particular to a kind of key based on Grid remotely-sensed data file set It is worth storage method and device.
Background technique
Remote sensing technology has been widely used in many fields such as national economy, defense military and ecological protection, example Such as meteorological observation, ground mapping, military investigation and ecological ragime assessment.
With the extensive use of remote sensing technology, a large amount of remote sensing quantity is obtained using aircraft such as remote sensing satellite, aircrafts, And remotely-sensed data is many kinds of and format disunity.In the prior art, the remotely-sensed data received is directly stored, due to single The source file of remotely-sensed data is larger, causes storage efficiency low.In addition, the source file of remotely-sensed data is after analysis, usually The remotely-sensed data file of storage is named according to the time that the channel of remotely-sensed data and remotely-sensed data generate, and by this article Part name is used as the critical field of remotely-sensed data query process, to remotely-sensed data when being unfavorable for the calculating and analysis to remotely-sensed data Access.
Therefore, how to propose a kind of remotely-sensed data storage method, can quickly carry out the storage of remotely-sensed data, it is distant to improve The storage efficiency for feeling data becomes industry important topic urgently to be resolved.
Summary of the invention
For the defects in the prior art, the present invention provides a kind of key assignments based on Grid remotely-sensed data file set and deposits Method for storing and device.
On the one hand, the present invention proposes a kind of key assignments storage method based on Grid remotely-sensed data file set, comprising:
The filename and file size of each remotely-sensed data source file are obtained, and the remote sensing is determined according to the filename The data format of data source file;
Subdivision processing function corresponding with the data format is called to parse the remotely-sensed data according to the data format Remotely-sensed data in source file;
If judgement knows that the file size is greater than threshold value, after being parsed according to regular polygon Grid subdivision method The remotely-sensed data source file remotely-sensed data according to default storage format split storage into database.
Further, the method also includes if judgement knows that the file size is less than or equal to threshold value, after parsing The remotely-sensed data source file remotely-sensed data according to default storage format store into database.
Further, it is described according to regular polygon Grid subdivision method by the remotely-sensed data source file after parsing Remotely-sensed data split storage according to default storage format and into database include:
The remotely-sensed data of the remotely-sensed data source file split into according to regular polygon Grid subdivision method multiple Piecemeal remotely-sensed data, multiple piecemeal remotely-sensed datas are continuously stored, and each piecemeal remotely-sensed data and the remote sensing number Corresponding according to the continuous remotely-sensed data in the part of source file, the size of each piecemeal remotely-sensed data is no more than preset value.
Further, the method also includes encoding the piecemeal remotely-sensed data using space filling curve coding, make Each piecemeal remotely-sensed data obtains unique coding, using the coding of the piecemeal remotely-sensed data as the piecemeal remote sensing number According to access identities, the access identities of each piecemeal remotely-sensed data constitute index;Wherein, using the index as key, with The key and described value are stored into the database by the access identities of the piecemeal remotely-sensed data as value.
Further, the method also includes receiving the access request to remotely-sensed data, the access request includes at least One index field;
Piecemeal remotely-sensed data corresponding with the index field is found in the index according to the index field Access identities;Wherein, the index field and the corresponding relationship of the access identities are preset;
According to the access identities of each piecemeal remotely-sensed data, the corresponding remotely-sensed data of the index field is obtained.
Further, the method also includes establishing the remotely-sensed data source when receiving the remotely-sensed data source file The time of reception table of file.
On the other hand, the present invention provides a kind of key assignments storage device based on Grid remotely-sensed data file set, comprising:
Acquiring unit, for obtaining the filename and file size of each remotely-sensed data source file, and according to the file Name determines the data format of the remotely-sensed data source file;
Call unit, for calling subdivision processing function parsing corresponding with the data format according to the data format Remotely-sensed data in the remotely-sensed data source file;
First storage unit, if for judging to know that the file size is greater than threshold value, according to regular polygon spherical surface net The remotely-sensed data of the remotely-sensed data source file after parsing is split storage to number according to default storage format by lattice subdivision method According in library.
Further, described device further includes the second storage unit, if for judging to know that the file size is less than In threshold value, then the remotely-sensed data of the remotely-sensed data source file after parsing is stored according to default storage format to database In.
In another aspect, the present invention provides a kind of electronic equipment, comprising: processor, memory and communication bus, in which:
The processor and the memory complete mutual communication by the communication bus;
The memory is stored with the program instruction that can be executed by the processor, and the processor calls described program to refer to The key assignments storage method based on Grid remotely-sensed data file set for being able to carry out and providing such as the various embodiments described above is provided.
Another aspect, the present invention provide a kind of non-transient computer readable storage medium, and the non-transient computer is readable Storage medium stores computer instruction, the computer instruction make the computer execute as the various embodiments described above provide based on The key assignments storage method of Grid remotely-sensed data file set.
Key assignments storage method and device provided by the invention based on Grid remotely-sensed data file set, due to that can obtain The filename and file size of each remotely-sensed data source file are taken, and determines the data lattice of remotely-sensed data source file according to filename Then formula calls the remote sensing in subdivision processing function parsing remotely-sensed data source file corresponding with data format according to data format Data, after judgement knows that file size is greater than threshold value, according to regular polygon Grid subdivision method by the institute after parsing The remotely-sensed data for stating remotely-sensed data source file splits storage into database according to default storage format, improves remotely-sensed data Storage efficiency.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair Bright some embodiments for those of ordinary skill in the art without creative efforts, can be with root Other attached drawings are obtained according to these attached drawings.
Fig. 1 is that the process of key assignments storage method of the one embodiment of the invention based on Grid remotely-sensed data file set is illustrated Figure;
Fig. 2 is that the process of key assignments storage method of the another embodiment of the present invention based on Grid remotely-sensed data file set is shown It is intended to;
Fig. 3 is the structural representation of key assignments storage device of the one embodiment of the invention based on Grid remotely-sensed data file set Figure;
Fig. 4 is that the structure of key assignments storage device of the another embodiment of the present invention based on Grid remotely-sensed data file set is shown It is intended to;
Fig. 5 is the entity structure schematic diagram of one embodiment of the invention electronic equipment.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached in the embodiment of the present invention Figure, technical solution in the embodiment of the present invention are explicitly described, it is clear that described embodiment is a part of the invention Embodiment, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making wound Every other embodiment obtained under the premise of the property made labour, shall fall within the protection scope of the present invention.
Fig. 1 is that the process of key assignments storage method of the one embodiment of the invention based on Grid remotely-sensed data file set is illustrated Figure, as shown in Figure 1, the key assignments storage method provided by the invention based on Grid remotely-sensed data file set, comprising:
S101, the filename and file size for obtaining each remotely-sensed data source file, and institute is determined according to the filename State the data format of remotely-sensed data source file;
Specifically, the key assignments storage device (hereinafter referred to as storage device) based on Grid remotely-sensed data file set is connecing Receive from the remotely-sensed data of the aircraft such as remote sensing satellite, aircraft when, can obtain each remotely-sensed data source file filename and File size.The storage device can obtain the data format of the remotely-sensed data source file by parsing the filename.
S102, subdivision processing function corresponding with the data format is called to parse the remote sensing according to the data format Remotely-sensed data in data source file;
Specifically, the storage device is after the data format for obtaining the remotely-sensed data source file, according to the number Call corresponding with data format subdivision processing function according to format, to the remotely-sensed data in the remotely-sensed data source file into Row parsing.Wherein, the subdivision processing function is preset.
It, will according to regular polygon Grid subdivision method if S103, judgement know that the file size is greater than threshold value The remotely-sensed data of the remotely-sensed data source file after parsing splits storage into database according to default storage format.
Specifically, the file size is compared by the storage device with the threshold value, if the file size Greater than the threshold value, then according to regular polygon Grid subdivision method by the distant of the remotely-sensed data source file after parsing Sense data are split, and then according to the storage of default storage format into database, the final file size is greater than the threshold Remotely-sensed data in each of value remotely-sensed data source file is split into piecemeal remotely-sensed data, and each piecemeal Remotely-sensed data has corresponding access identities.
Wherein, the default storage format is configured based on practical experience, and the embodiment of the present invention is without limitation.
Wherein, the database can be reciprocity distributed data base, and the equity distributed data base is using P2P net The distributed data base of network has high reliablity, access efficiency high because it does not have host node and the difference from node Feature.
Key assignments storage method provided by the invention based on Grid remotely-sensed data file set, it is each due to that can obtain The filename and file size of remotely-sensed data source file, and determine according to filename the data format of remotely-sensed data source file, so The remotely-sensed data in subdivision processing function parsing remotely-sensed data source file corresponding with data format is called according to data format afterwards, After judgement knows that file size is greater than threshold value, according to regular polygon Grid subdivision method by the remote sensing after parsing The remotely-sensed data of data source file splits storage into database according to default storage format, improves the storage effect of remotely-sensed data Rate.
It is further, provided by the invention to be based on Grid remotely-sensed data file on the basis of the various embodiments described above The key assignments storage method of collection further include:
If judgement knows that the file size is less than or equal to threshold value, by the distant of the remotely-sensed data source file after parsing Feel data to store according to the default storage format into the database.
Specifically, the file size is compared by the storage device with the threshold value, if the file size Less than or equal to the threshold value, then the storage device will parse the remotely-sensed data that is obtained after the remotely-sensed data source file according to The default storage format storage is into database, without splitting the remotely-sensed data source file.
It is further, described to be solved according to regular polygon Grid subdivision method on the basis of the various embodiments described above The remotely-sensed data of the remotely-sensed data source file after analysis splits into data block storage into database according to default storage format Include:
The remotely-sensed data of the remotely-sensed data source file split into according to regular polygon Grid subdivision method multiple Piecemeal remotely-sensed data, multiple piecemeal remotely-sensed datas are continuously stored, and each piecemeal remotely-sensed data and the remote sensing number Corresponding according to the continuous remotely-sensed data in the part of source file, the size of each piecemeal remotely-sensed data is no more than preset value.
Specifically, mesh generation is to generate one group of fine-grained subnet from father's grid of coarseness using unified method Lattice form the tree hierarchy structure between grid, so that polyhedral surface to be divided into the discrete grid block set of multiresolution.This hair The regular polygon Grid subdivision method that bright embodiment uses, for example, HTM spherically stratified ionosphere triangular mesh generation method use Four points continuous to Grid of the thought of quaternary tree, and constitute with orthodrome the level triangle gridding knot of multiresolution Structure, each subdivision maintain the area of triangle gridding unit and the invariance of shape, and more points of recursiveness as far as possible in the process Resolution structure enables HTM spherical trigonometry grid to support the organizations of unity of uneven distribution data.
The storage device, can be by the distant of the remotely-sensed data source file according to regular polygon Grid subdivision method Sense data split into multiple piecemeal remotely-sensed datas.When storing each piecemeal remotely-sensed data, by each piecemeal remote sensing Data are continuously stored, and each piecemeal remotely-sensed data is continuous data, i.e., the described piecemeal remotely-sensed data is to come from The continuous remotely-sensed data in part in the remotely-sensed data source file, the piecemeal remotely-sensed data and the remotely-sensed data source document The continuous remotely-sensed data in the part of part is corresponding, and the size of each piecemeal remotely-sensed data is no more than preset value.Wherein, institute It states preset value to be configured based on practical experience, the embodiment of the present invention is without limitation.
It is further, provided by the invention to be based on Grid remotely-sensed data file on the basis of the various embodiments described above The key assignments storage method of collection further include:
The piecemeal remotely-sensed data is encoded using space filling curve coding, obtains each piecemeal remotely-sensed data Unique coding, using the access identities of the piecemeal remotely-sensed data encoded as the piecemeal remotely-sensed data, each described point The access identities of block remotely-sensed data constitute index;Wherein, using the index as key, with the access mark of the piecemeal remotely-sensed data Know as value, the key and described value are stored into the database.
Specifically, the storage device is encoded after obtaining the piecemeal remotely-sensed data using space filling curve, such as Hilbert curve encoding encodes the piecemeal remotely-sensed data, after coding, each piecemeal remotely-sensed data Unique coding is obtained, i.e., the described piecemeal remotely-sensed data and the coding correspond, and with the volume of the piecemeal remotely-sensed data The access identities of access identities of the code as the piecemeal remotely-sensed data, each piecemeal remotely-sensed data constitute index.Wherein, The key and described value are stored into institute using the access identities of the piecemeal remotely-sensed data as value using the index as key It states in database.
Fig. 2 is that the process of key assignments storage method of the another embodiment of the present invention based on Grid remotely-sensed data file set is shown It is intended to, as shown in Fig. 2, on the basis of the various embodiments described above, it is further, provided by the invention to be based on Grid remote sensing number According to the key assignments storage method of file set further include:
To the access request of remotely-sensed data, the access request includes at least one described index field for S201, reception;
Specifically, server can send the access request to remotely-sensed data, the storage device to the storage device It can receive the access request, the access request includes at least one described index field.Wherein, the index field packet Include but be not limited to title, number and mark etc..
S202, piecemeal remote sensing number corresponding with the index field is found in the index according to the index field According to access identities;Wherein, the index field and the corresponding relationship of the access identities are preset;
Specifically, the storage device is after receiving the access request, according to the index field in the rope Draw the middle lookup index field, and finds the access identities of piecemeal remotely-sensed data corresponding with the index field.Wherein, The index field and the corresponding relationship of the access identities are default.
S203, according to the access identities of each piecemeal remotely-sensed data, obtain the corresponding remote sensing number of the index field According to.
Specifically, the storage device the access identities for obtaining the corresponding piecemeal remotely-sensed data of the index field it Afterwards, it can be found according to the access identities of each piecemeal remotely-sensed data and respectively correspond to the piecemeal remotely-sensed data, searched The corresponding remotely-sensed data of each i.e. described index field of piecemeal remotely-sensed data arrived.The storage device is available described The corresponding remotely-sensed data of index field, and the corresponding remotely-sensed data of the index field is sent to the server.Wherein, institute It is default for stating the corresponding relationship of index field and the access identities.
On the basis of the various embodiments described above, further, on the basis of the various embodiments described above, further, this hair The key assignments storage method based on Grid remotely-sensed data file set of bright offer further include:
When receiving the remotely-sensed data source file, the time of reception table of the remotely-sensed data source file is established.
Specifically, the storage device can recorde each institute received when receiving the remotely-sensed data source file At the time of stating remotely-sensed data source file, the above-mentioned moment, that is, time of reception, by the filename of each remotely-sensed data source file with The corresponding storage of its time of reception.The storage device according to the filename of each remotely-sensed data source file with it is corresponding The time of reception establishes the time of reception table of the remotely-sensed data source file.
Fig. 3 is the structural representation of key assignments storage device of the one embodiment of the invention based on Grid remotely-sensed data file set Figure, as shown in figure 3, the key assignments storage device provided by the invention based on Grid remotely-sensed data file set includes acquiring unit 301, call unit 302 and the first storage unit 303, in which:
Acquiring unit 301 is used to obtain the filename and file size of each remotely-sensed data source file, and according to the text Part name determines the data format of the remotely-sensed data source file;Call unit 302 is used for according to data format calling and institute It states data format corresponding subdivision processing function and parses remotely-sensed data in the remotely-sensed data source file;First storage unit If 303 know that the file size is greater than threshold value for judging, after being parsed according to regular polygon Grid subdivision method The remotely-sensed data source file remotely-sensed data according to default storage format split storage into database.
Specifically, acquiring unit 301 can be obtained when receiving from the remotely-sensed data of the aircraft such as remote sensing satellite, aircraft Obtain the filename and file size of each remotely-sensed data source file.Acquiring unit 301 can be obtained by parsing the filename The data format of the remotely-sensed data source file.
Call unit 302 is after the data format for obtaining the remotely-sensed data source file, according to the data format tune Function is handled with subdivision corresponding with the data format, the remotely-sensed data in the remotely-sensed data source file is parsed. Wherein, the subdivision processing function is preset.
The file size is compared by the first storage unit 303 with the threshold value, if the file size is greater than The threshold value, then the first storage unit 303 by according to regular polygon Grid subdivision method by the remote sensing after parsing The remotely-sensed data of data source file is split, then according to the storage of default storage format into database, the final file size It is split into piecemeal remotely-sensed data greater than the remotely-sensed data in each of the threshold value remotely-sensed data source file, and every A piecemeal remotely-sensed data has corresponding access identities.Wherein, the default storage format is set based on practical experience It sets, the embodiment of the present invention is without limitation.Wherein, the database can be reciprocity distributed data base.
Key assignments storage device provided by the invention based on Grid remotely-sensed data file set, it is each due to that can obtain The filename and file size of remotely-sensed data source file, and determine according to filename the data format of remotely-sensed data source file, so The remotely-sensed data in subdivision processing function parsing remotely-sensed data source file corresponding with data format is called according to data format afterwards, After judgement knows that file size is greater than threshold value, according to regular polygon Grid subdivision method by the remote sensing after parsing The remotely-sensed data of data source file splits storage into database according to default storage format, improves the storage effect of remotely-sensed data Rate.
Fig. 4 is that the structure of key assignments storage device of the another embodiment of the present invention based on Grid remotely-sensed data file set is shown It is intended to, as shown in figure 4, the key assignments storage device provided by the invention based on Grid remotely-sensed data file set further includes second Storage unit 304, in which:
If the second storage unit 304 knows that the file size is less than or equal to threshold value for judging, by the institute after parsing The remotely-sensed data for stating remotely-sensed data source file is stored according to default storage format into database.
Specifically, the file size is compared by the second storage unit 304 with the threshold value, if the file is big It is small to be less than or equal to the threshold value, then the second storage unit 304 will parse the remote sensing number obtained after the remotely-sensed data source file It stores according to according to the default storage format into database, without splitting the remotely-sensed data source file.
The embodiment of device provided by the invention specifically can be used for executing the process flow of above-mentioned each method embodiment, Details are not described herein for function, is referred to the detailed description of above method embodiment.
Fig. 5 is the entity structure schematic diagram of one embodiment of the invention electronic equipment, as shown in figure 5, the electronic equipment packet Include processor (processor) 501, memory (memory) 502 and communication bus 503;
Wherein, processor 501, memory 502 complete mutual communication by communication bus 503;
Processor 501 is used to call the program instruction in memory 502, to execute provided by above-mentioned each method embodiment Method, for example, obtain the filename and file size of each remotely-sensed data source file, and institute is determined according to the filename State the data format of remotely-sensed data source file;Subdivision corresponding with the data format is called to handle letter according to the data format Number parses the remotely-sensed data in the remotely-sensed data source file;If judgement knows that the file size is greater than threshold value, according to just Polyhedron Grid subdivision method is by the remotely-sensed data of the remotely-sensed data source file after parsing according to default storage format Storage is split into database.
The present embodiment discloses a kind of computer program product, and the computer program product includes being stored in non-transient calculating Computer program on machine readable storage medium storing program for executing, the computer program include program instruction, when described program instruction is calculated When machine executes, computer is able to carry out method provided by above-mentioned each method embodiment, for example, obtains each remotely-sensed data The filename and file size of source file, and determine according to the filename data format of the remotely-sensed data source file;Root Subdivision processing function corresponding with the data format is called to parse in the remotely-sensed data source file according to the data format Remotely-sensed data;If judgement knows that the file size is greater than threshold value, will be parsed according to regular polygon Grid subdivision method The remotely-sensed data of the remotely-sensed data source file afterwards splits storage into database according to default storage format.
The present embodiment provides a kind of non-transient computer readable storage medium, the non-transient computer readable storage medium Computer instruction is stored, the computer instruction makes the computer execute method provided by above-mentioned each method embodiment, example It such as include: to obtain the filename and file size of each remotely-sensed data source file, and the remote sensing is determined according to the filename The data format of data source file;Subdivision processing function parsing corresponding with the data format is called according to the data format Remotely-sensed data in the remotely-sensed data source file;If judgement knows that the file size is greater than threshold value, according to regular polygon Grid subdivision method deposits the remotely-sensed data of the remotely-sensed data source file after parsing according to the fractionation of default storage format It stores up in database.
In addition, the logical order in above-mentioned memory can be realized and as independence by way of SFU software functional unit Product when selling or using, can store in a computer readable storage medium.Based on this understanding, of the invention Technical solution substantially the part of the part that contributes to existing technology or the technical solution can be with software in other words The form of product embodies, which is stored in a storage medium, including some instructions use so that One computer equipment (can be personal computer, device or the network equipment etc.) executes described in each embodiment of the present invention The all or part of the steps of method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read- Only Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can be with Store the medium of program code.
The apparatus embodiments described above are merely exemplary, wherein described, unit can as illustrated by the separation member It is physically separated with being or may not be, component shown as a unit may or may not be physics list Member, it can it is in one place, or may be distributed over multiple network units.It can be selected according to the actual needs In some or all of the modules achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art are not paying creativeness Labour in the case where, it can understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can It realizes by means of software and necessary general hardware platform, naturally it is also possible to pass through hardware.Based on this understanding, on Stating technical solution, substantially the part that contributes to existing technology can be embodied in the form of software products in other words, should Computer software product may be stored in a computer readable storage medium, such as ROM/RAM, magnetic disk, CD, including several fingers It enables and using so that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementation Method described in certain parts of example or embodiment.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations;Although Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features; And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit and Range.

Claims (10)

1. a kind of key assignments storage method based on Grid remotely-sensed data file set characterized by comprising
The filename and file size of each remotely-sensed data source file are obtained, and the remotely-sensed data is determined according to the filename The data format of source file;
Subdivision processing function corresponding with the data format is called to parse the remotely-sensed data source document according to the data format Remotely-sensed data in part;
If judgement knows that the file size is greater than threshold value, according to regular polygon Grid subdivision method by the institute after parsing The remotely-sensed data for stating remotely-sensed data source file splits storage into database according to default storage format.
2. the key assignments storage method according to claim 1 based on Grid remotely-sensed data file set, which is characterized in that Further include:
If judgement knows that the file size is less than or equal to threshold value, by the remote sensing number of the remotely-sensed data source file after parsing It stores according to according to default storage format into database.
3. the key assignments storage method according to claim 1 based on Grid remotely-sensed data file set, which is characterized in that It is described according to regular polygon Grid subdivision method by the remotely-sensed data of the remotely-sensed data source file after parsing according to pre- If storage format splits storage
The remotely-sensed data of the remotely-sensed data source file is split into multiple piecemeals according to regular polygon Grid subdivision method Remotely-sensed data, multiple piecemeal remotely-sensed datas are continuously stored, and each piecemeal remotely-sensed data and the remotely-sensed data source The continuous remotely-sensed data in the part of file is corresponding, and the size of each piecemeal remotely-sensed data is no more than preset value.
4. the key assignments storage method according to claim 3 based on Grid remotely-sensed data file set, which is characterized in that Further include:
The piecemeal remotely-sensed data is encoded using space filling curve coding, obtains each piecemeal remotely-sensed data unique Coding, using the coding of the piecemeal remotely-sensed data as the access identities of the piecemeal remotely-sensed data, each piecemeal is distant The access identities for feeling data constitute index;Wherein, using the index as key, made with the access identities of the piecemeal remotely-sensed data For value, the key and described value are stored into the database.
5. the key assignments storage method according to claim 4 based on Grid remotely-sensed data file set, which is characterized in that Further include:
The access request to remotely-sensed data is received, the access request includes at least one described index field;
The access of piecemeal remotely-sensed data corresponding with the index field is found in the index according to the index field Mark;Wherein, the index field and the corresponding relationship of the access identities are preset;
According to the access identities of each piecemeal remotely-sensed data, the corresponding remotely-sensed data of the index field is obtained.
6. the key assignments storage method according to any one of claims 1 to 5 based on Grid remotely-sensed data file set, It is characterized in that, further includes:
When receiving the remotely-sensed data source file, the time of reception table of the remotely-sensed data source file is established.
7. a kind of key assignments storage device based on Grid remotely-sensed data file set characterized by comprising
Acquiring unit, for obtaining the filename and file size of each remotely-sensed data source file, and it is true according to the filename The data format of the fixed remotely-sensed data source file;
Call unit, for calling subdivision corresponding with the data format to handle described in function parsing according to the data format Remotely-sensed data in remotely-sensed data source file;
First storage unit, if being cutd open for judging to know that the file size is greater than threshold value according to regular polygon Grid Divide method that the remotely-sensed data of the remotely-sensed data source file after parsing is split storage according to default storage format and arrives database In.
8. the key assignments storage device according to claim 7 based on Grid remotely-sensed data file set, which is characterized in that Further include:
Second storage unit, if for judging to know that the file size is less than or equal to threshold value, by the remote sensing after parsing The remotely-sensed data of data source file is stored according to default storage format into database.
9. a kind of electronic equipment characterized by comprising processor, memory and communication bus, in which:
The processor and the memory complete mutual communication by the communication bus;
The memory is stored with the program instruction that can be executed by the processor, and the processor calls described program to instruct energy It is enough to execute such as method as claimed in any one of claims 1 to 6.
10. a kind of non-transient computer readable storage medium, which is characterized in that the non-transient computer readable storage medium is deposited Computer instruction is stored up, the computer instruction makes the computer execute such as method as claimed in any one of claims 1 to 6.
CN201910500955.6A 2018-06-15 2019-06-11 Key value storage method and device based on spherical grid remote sensing data file set Active CN110263017B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810623509X 2018-06-15
CN201810623509 2018-06-15

Publications (2)

Publication Number Publication Date
CN110263017A true CN110263017A (en) 2019-09-20
CN110263017B CN110263017B (en) 2021-09-14

Family

ID=67917509

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910500955.6A Active CN110263017B (en) 2018-06-15 2019-06-11 Key value storage method and device based on spherical grid remote sensing data file set

Country Status (1)

Country Link
CN (1) CN110263017B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111026706A (en) * 2019-10-21 2020-04-17 武汉神库小匠科技有限公司 Method, device, equipment and medium for warehousing power system data

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030061228A1 (en) * 2001-06-08 2003-03-27 The Regents Of The University Of California Parallel object-oriented decision tree system
CN101964157A (en) * 2010-09-27 2011-02-02 中国人民解放军国防科学技术大学 Sphere rhombic grid recursive subdivision method
CN103428202A (en) * 2013-07-24 2013-12-04 浙江大学 Automatic monitored storage method of remote sensing data product based on file transfer protocol (FTP) and extensible markup language (XML)
CN103491185A (en) * 2013-09-25 2014-01-01 浙江大学 Remote sensing data cloud storage method based on image block organization
CN103714184A (en) * 2014-01-13 2014-04-09 许昌学院 Quick parallel processing method and device of remote-sensing images
CN103984759A (en) * 2014-05-30 2014-08-13 中国科学院遥感与数字地球研究所 Display-oriented multi-source remote sensing data set partition and reconstruction method
CN104159129A (en) * 2014-08-08 2014-11-19 北京大学 Method for progressively transmitting partial splitting blocks under remote sensing data limited bandwidth
CN107066562A (en) * 2017-03-31 2017-08-18 山东农业大学 A kind of storage method of satellite remote-sensing image data
CN107463706A (en) * 2017-08-18 2017-12-12 国网上海市电力公司 A kind of storage of magnanimity recorder data and parsing method and system based on Hadoop

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030061228A1 (en) * 2001-06-08 2003-03-27 The Regents Of The University Of California Parallel object-oriented decision tree system
US20050267911A1 (en) * 2001-06-08 2005-12-01 The Regents Of The University Of California Parallel object-oriented decision tree system
CN101964157A (en) * 2010-09-27 2011-02-02 中国人民解放军国防科学技术大学 Sphere rhombic grid recursive subdivision method
CN103428202A (en) * 2013-07-24 2013-12-04 浙江大学 Automatic monitored storage method of remote sensing data product based on file transfer protocol (FTP) and extensible markup language (XML)
CN103491185A (en) * 2013-09-25 2014-01-01 浙江大学 Remote sensing data cloud storage method based on image block organization
CN103714184A (en) * 2014-01-13 2014-04-09 许昌学院 Quick parallel processing method and device of remote-sensing images
CN103984759A (en) * 2014-05-30 2014-08-13 中国科学院遥感与数字地球研究所 Display-oriented multi-source remote sensing data set partition and reconstruction method
CN104159129A (en) * 2014-08-08 2014-11-19 北京大学 Method for progressively transmitting partial splitting blocks under remote sensing data limited bandwidth
CN107066562A (en) * 2017-03-31 2017-08-18 山东农业大学 A kind of storage method of satellite remote-sensing image data
CN107463706A (en) * 2017-08-18 2017-12-12 国网上海市电力公司 A kind of storage of magnanimity recorder data and parsing method and system based on Hadoop

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
YUNQIN ZHONG等: "An adaptive hierarchical caching scheme for remotely sensed database", 《2013 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM - IGARSS》 *
陈隆等: "遥感图像快速压缩传输系统的设计与实现", 《软件》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111026706A (en) * 2019-10-21 2020-04-17 武汉神库小匠科技有限公司 Method, device, equipment and medium for warehousing power system data
CN111026706B (en) * 2019-10-21 2023-10-13 武汉神库小匠科技有限公司 Warehouse entry method, device, equipment and medium for power system data

Also Published As

Publication number Publication date
CN110263017B (en) 2021-09-14

Similar Documents

Publication Publication Date Title
CN110851529B (en) Calculation power scheduling method and related equipment
US10585948B2 (en) Method and device for constructing spatial index of massive point cloud data
CN103995861B (en) A kind of distributed data device based on space correlation, method and system
CN112632566B (en) Vulnerability scanning method and device, storage medium and electronic equipment
Eshel On the fractal dimensions of a root system
CN106815254A (en) A kind of data processing method and device
CN104539681A (en) Distributed GIS accelerating system and GIS service processing method
CN109766242A (en) Monitoring method, device and system based on mobile user side and storage medium
Yu et al. A new algorithm based on Region Partitioning for Filtering candidate viewpoints of a multiple viewshed
CN111899323A (en) Three-dimensional earth drawing method and device
CN110263017A (en) A kind of key assignments storage method and device based on Grid remotely-sensed data file set
CN104301354B (en) A kind of method and system of the spatial class business datum GISization service based on cloud computing
CN110674134B (en) Geographic information data storage method, query method and device
CN111599015B (en) Spatial polygon gridding filling method and device under constraint condition
CN105701573B (en) A kind of route processing method and device based on GIS buffer zone analysis
CN112221151A (en) Map generation method and device, computer equipment and storage medium
CN105721527B (en) A kind of data processing method and server
CN110287344A (en) Audio and video products data capture method and device
CN113254215B (en) Data processing method and device, storage medium and electronic equipment
WO2022126646A9 (en) Automated platform for managing, deploying and orchestrating highly distributed service applications
CN115511343A (en) Method, device, equipment and storage medium for determining city core area
CN112804446B (en) Big data processing method and device based on cloud platform big data
CN114296965A (en) Feature retrieval method, feature retrieval device, electronic equipment and computer storage medium
CN109150938A (en) Satellite application public service platform based on cloud service
CN113347238A (en) Message partitioning method, system, device and storage medium based on block chain

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant