CN110046270A - Information memory managing method based on MongoDB - Google Patents
Information memory managing method based on MongoDB Download PDFInfo
- Publication number
- CN110046270A CN110046270A CN201910141214.3A CN201910141214A CN110046270A CN 110046270 A CN110046270 A CN 110046270A CN 201910141214 A CN201910141214 A CN 201910141214A CN 110046270 A CN110046270 A CN 110046270A
- Authority
- CN
- China
- Prior art keywords
- remote sensing
- sensing image
- storage system
- image storage
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Remote Sensing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Information memory managing method based on MongoDB of the invention, the specific steps are as follows: step 1, remote sensing image storage system request query result to landsat center requests metadata application according to the application record information at landsat center；Step 2, remote sensing image storage system request query result according to metadata application, and request MongoDB database returns to geographical location locating for thumbnail；Step 3, remote sensing image storage system judge geographical location binning state locating for thumbnail and update.The present invention can not only reduce the pressure of handling up of server end disk under remote sensing image storage system concurrent environment, it is also ensured that the scheduling and drafting efficiency of remote sensing image storage system.
Description
Technical field
The present invention relates to the technical fields of remote sensing image data memory management method, in particular to a kind of to be based on MongoDB
Information memory managing method.
Background technique
Using remotely-sensed data and integration technology, region is monitored, early warning and analysis, for formulating the specific side of taking precautions against natural calamities
Case and effectively preventing measure is taken, suffers from important meaning.How effectively the multidate of management region, fining magnanimity
The latest data that topography and geomorphology historical data and air remote sensing and satellite remote sensing technology obtain in real time supports efficient storage
And scheduling has become remote sensing image geographic information database data to meet the science decision of emergency disaster relief and using needs
The difficult point of management.The access of remote sensing image data also meets The long tail, i.e., most database access concentrates on small part
Up-to-date state data on.Obviously, it should enable active Up-to-date state terrain data convenient for valid memory access.
However, traditional relational data model and data organizational structure, only realize data in concept and logic level
The integrality of tissue, including sequence snapshot model, base figure correction model, geo-temporal coal-rock combination body and geo-temporal cube
Body Model etc., there is no the access weight for considering remote sensing image data, physics realization is used uniformly disk storage, leads to disk I/
O becomes the bottleneck of database scheduling performance, substantially increases magnetic disc i/o load and data scheduling time.
Summary of the invention
In order to solve the above-mentioned technical problem the present invention, and provides a kind of information memory managing method based on MongoDB.
MongoDB is the database based on distributed document storage, is write by C++ language, it is intended to be provided for WEB application
Expansible high-performance data storage solution.
The technical solution used in the present invention is:
Information memory managing method based on MongoDB of the invention, the specific steps are as follows:
Step 1, remote sensing image storage system are first to landsat center requests according to the application record information at landsat center
Query result is requested in data application；
Step 2, remote sensing image storage system request query result according to metadata application, and request MongoDB database returns to contracting
Geographical location locating for sketch map；
Step 3, remote sensing image storage system judge geographical location binning state locating for thumbnail and update.
In the step one, remote sensing image storage system is defended according to the application record of landsat central information to resource
Star center sends application request；
Landsat center returns to metadata application request to remote sensing image storage system；
Remote sensing image storage system judges whether metadata application request inquiry succeeds, if success, returns to landsat center
Query result is requested in metadata application, if failure, end operation；
Remote sensing image storage system judges whether metadata application request query result is sky, if it is not, Preservation Metadata application is asked
Query result is asked to record, if so, end operation.
In the step two, remote sensing image storage system is sentenced according to clear in metadata application request query result record
It lookes at figure address, downloads thumbnail；
Thumbnail information is converted into Base64 word according to the application record of landsat central information by remote sensing image storage system
The storage request of symbol string, and the request of the storage of Base64 character string is sent to MongoDB database, then remote sensing image stores
System update MongoDB database storage state and transmission storage request time；
The interface-crossover and internal interface of MongoDB data base call distributed data base distinguish geographical position locating for thumbnail
It sets, and is stored into the corresponding geography information table of remote sensing image storage system.
In the step three, 5 before remote sensing image storage system timing inquiry current time and transmission storage request time
All thumbnails between minute check geographical location locating for the thumbnail in geography information table；
Remote sensing image storage system judges whether geographical location locating for thumbnail is put in storage success in geography information table, if so, deleting
Except thumbnail, and updating data loading state is to be put in storage successfully, then end operation, if it is not, updating data loading state is not
Storage waits and retransmits storage request next time.
The advantages and positive effects of the present invention are:
The present invention can not only reduce the pressure of handling up of server end disk under remote sensing image storage system concurrent environment, can also be with
Guarantee the scheduling of remote sensing image storage system and draws efficiency.
Detailed description of the invention
Fig. 1 is flow diagram of the invention.
Specific embodiment
Referring to the drawings and embodiment the present invention will be described in detail.
As shown in Figure 1, the information memory managing method of the invention based on MongoDB, the specific steps are as follows:
Step 1, remote sensing image storage system are first to landsat center requests according to the application record information at landsat center
Query result is requested in data application；
Step 2, remote sensing image storage system request query result according to metadata application, and request MongoDB database returns to contracting
Geographical location locating for sketch map；
Step 3, remote sensing image storage system judge geographical location binning state locating for thumbnail and update.
In the step one, remote sensing image storage system is defended according to the application record of landsat central information to resource
Star center sends application request；
Landsat center returns to metadata application request to remote sensing image storage system；
Remote sensing image storage system judges whether metadata application request inquiry succeeds, if success, returns to landsat center
Query result is requested in metadata application, if failure, end operation；
Remote sensing image storage system judges whether metadata application request query result is sky, if it is not, Preservation Metadata application is asked
Query result is asked to record, if so, end operation.
In the step two, remote sensing image storage system is sentenced according to clear in metadata application request query result record
It lookes at figure address, downloads thumbnail；
Thumbnail information is converted into Base64 word according to the application record of landsat central information by remote sensing image storage system
The storage request of symbol string, and the request of the storage of Base64 character string is sent to MongoDB database, then remote sensing image stores
System update MongoDB database storage state and transmission storage request time；
The interface-crossover and internal interface of MongoDB data base call distributed data base distinguish geographical position locating for thumbnail
It sets, and is stored into the corresponding geography information table of remote sensing image storage system.
In the step three, 5 before remote sensing image storage system timing inquiry current time and transmission storage request time
All thumbnails between minute check geographical location locating for the thumbnail in geography information table；
Remote sensing image storage system judges whether geographical location locating for thumbnail is put in storage success in geography information table, if so, deleting
Except thumbnail, and updating data loading state is to be put in storage successfully, then end operation, if it is not, updating data loading state is not
Storage waits and retransmits storage request next time.
The present invention is in terms of scalability, and distributed data base, that is, MongoDB database provides leader follower replication and copy set is multiple
2 kinds of modes are made, redundancy backup and high availability are met, relative to leader follower replication, copy set, which is replicated in, guarantees that automatic fault turns
It is more advantageous to move aspect.Meanwhile MongoDB database also provides auto slice function, it is easy to accomplish extending transversely.And it is more
User's storage tape comes larger data amount and frequent I/O operation, and auto slice can be used with copy set and replicate the mode combined,
Different data acquisition systems is placed on to different fragments, each fragment there are multiple copies to be distributed in different machines, realizes number
According to the automatic fault transfer of library server, load balancing and automatic extension.
The high Up-to-date state terrain data storage of frequency of access on memory, will be lasted data and is stored in disk by the present invention
On, Up-to-date state terrain data transfers the magnetic disc i/o that can eliminate interior external memory.Remote sensing image storage not only can be reduced
The pressure of handling up of server end disk under system concurrency environment, it is also ensured that the scheduling and drafting effect of remote sensing image storage system
Rate has sufficiently excavated the distributed data base i.e. performance advantage of MongoDB database.
Claims (4)
1. a kind of information memory managing method based on MongoDB, it is characterised in that: specific step is as follows:
Step 1, remote sensing image storage system are first to landsat center requests according to the application record information at landsat center
Query result is requested in data application；
Step 2, remote sensing image storage system request query result according to metadata application, and request MongoDB database returns to contracting
Geographical location locating for sketch map；
Step 3, remote sensing image storage system judge geographical location binning state locating for thumbnail and update.
2. the information memory managing method according to claim 1 based on MongoDB, it is characterised in that: the step
In one, remote sensing image storage system sends to landsat center according to the application record of landsat central information and asks
It asks；
Landsat center returns to metadata application request to remote sensing image storage system；
Remote sensing image storage system judges whether metadata application request inquiry succeeds, if success, returns to landsat center
Query result is requested in metadata application, if failure, end operation；
Remote sensing image storage system judges whether metadata application request query result is sky, if it is not, Preservation Metadata application is asked
Query result is asked to record, if so, end operation.
3. the information memory managing method according to claim 1 based on MongoDB, it is characterised in that: the step
In two, remote sensing image storage system sentences the browse graph address requested in query result record according to metadata application, downloads breviary
Figure；
Thumbnail information is converted into Base64 word according to the application record of landsat central information by remote sensing image storage system
The storage request of symbol string, and the request of the storage of Base64 character string is sent to MongoDB database, then remote sensing image stores
System update MongoDB database storage state and transmission storage request time；
The interface-crossover and internal interface of MongoDB data base call distributed data base distinguish geographical position locating for thumbnail
It sets, and is stored into the corresponding geography information table of remote sensing image storage system.
4. the information memory managing method according to claim 1 based on MongoDB, it is characterised in that: the step
All breviaries in three, before remote sensing image storage system timing inquiry current time and transmission storage request time between 5 minutes
Figure checks geographical location locating for the thumbnail in geography information table；
Remote sensing image storage system judges whether geographical location locating for thumbnail is put in storage success in geography information table, if so, deleting
Except thumbnail, and updating data loading state is to be put in storage successfully, then end operation, if it is not, updating data loading state is not
Storage waits and retransmits storage request next time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910141214.3A CN110046270A (en) | 2019-02-26 | 2019-02-26 | Information memory managing method based on MongoDB |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910141214.3A CN110046270A (en) | 2019-02-26 | 2019-02-26 | Information memory managing method based on MongoDB |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110046270A true CN110046270A (en) | 2019-07-23 |
Family
ID=67274274
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910141214.3A Pending CN110046270A (en) | 2019-02-26 | 2019-02-26 | Information memory managing method based on MongoDB |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110046270A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114003755A (en) * | 2021-10-25 | 2022-02-01 | 中国自然资源航空物探遥感中心 | Multi-source satellite scene-separating image data organization storage and retrieval method, system and equipment |
-
2019
- 2019-02-26 CN CN201910141214.3A patent/CN110046270A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114003755A (en) * | 2021-10-25 | 2022-02-01 | 中国自然资源航空物探遥感中心 | Multi-source satellite scene-separating image data organization storage and retrieval method, system and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11704290B2 (en) | Methods, devices and systems for maintaining consistency of metadata and data across data centers | |
| US10452271B2 (en) | Reconstructing in-memory indices in a distributed data storage system | |
| CN104981802B (en) | For the content type of object memories directory system | |
| CN104813321B (en) | The content and metadata of uncoupling in distributed objects store the ecosystem | |
| US7657581B2 (en) | Metadata management for fixed content distributed data storage | |
| US8229893B2 (en) | Metadata management for fixed content distributed data storage | |
| CN101460930B (en) | Maintenance of link level consistency between database and file system | |
| US20160110109A1 (en) | Using scratch extents to facilitate copying operations in an append-only storage system | |
| US9547706B2 (en) | Using colocation hints to facilitate accessing a distributed data storage system | |
| JP5722962B2 (en) | Optimize storage performance | |
| US9569515B2 (en) | Facilitating distributed deletes in a replicated storage system | |
| US9772783B2 (en) | Constructing an index to facilitate accessing a closed extent in an append-only storage system | |
| US20060248119A1 (en) | External persistence of session state information | |
| CN107835983A (en) | Backup-and-restore is carried out in distributed data base using consistent database snapshot | |
| US9619322B2 (en) | Erasure-coding extents in an append-only storage system | |
| US9720607B2 (en) | Append-only storage system supporting open and closed extents | |
| KR102139087B1 (en) | Method, server, and computer readable medium for index recovery using index redo log | |
| US7761424B2 (en) | Recording notations per file of changed blocks coherent with a draining agent | |
| CN110046270A (en) | Information memory managing method based on MongoDB | |
| CN111274221A (en) | Large-scale cluster component service version change testing system | |
| US20100049714A1 (en) | Fast search replication synchronization processes | |
| KR20210033880A (en) | Method, server, and computer readable medium for index recovery using index redo log | |
| US9967310B2 (en) | Using an RPC framework to facilitate out-of-band data transfers | |
| AU2011265370B2 (en) | Metadata management for fixed content distributed data storage | |
| TAUNK et al. | The Hadoop distributed file system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190723 |