CN108829836A - Isomery remote sensing big data application platform - Google Patents
Isomery remote sensing big data application platform Download PDFInfo
- Publication number
- CN108829836A CN108829836A CN201810629868.6A CN201810629868A CN108829836A CN 108829836 A CN108829836 A CN 108829836A CN 201810629868 A CN201810629868 A CN 201810629868A CN 108829836 A CN108829836 A CN 108829836A
- Authority
- CN
- China
- Prior art keywords
- data
- satellite
- product
- layer
- remote
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to a kind of isomery remote sensing big data application platforms, belong to satellite remote sensing big data storage and management technical field, including application layer, system layer and hardware layer, and application layer is connect by system layer with hardware layer；Application layer is for being achieved and being managed to satellite remote-sensing image product；Corresponding file carries out fragment storage after the satellite remote-sensing image product treatment that system layer is used to that application layer to be written using the object addressable mechanism based on calculating；Hardware layer includes several storage devices nodes, and each storage devices node is corresponding with hardware resource, and storage devices node is used for the corresponding slicing files of storage file.The present invention is a kind of storage and management uniformity platform of remote sensing big data, the platform can support the storage and management to the satellite remote-sensing image product data of multiple types remote sensing satellite, and the object addressable mechanism based on calculating, the fragment storage for solving satellite remote-sensing image product is broken through, which has high stability and high reliability.
Description
Technical field
The present invention relates to satellite remote sensing big data storage and management technical fields, more particularly to a kind of big number of isomery remote sensing
According to application platform.
Background technique
In recent years, with the fast development of global satellite remote sensing technology and constantly improve for information infrastructure, remote sensing
Image data amount dramatically increases, exponentially growing trend.Especially since 2015, micro-thermoelectric generator technology is welcome
Blowout high-speed developing period, domestic remote sensing satellite quantity are in explosive growth, and still, the existing remotely-sensed data in China is flat at present
Platform does not support the management of multi-series Remote Sensing Products not only, but also there are the challenges in terms of big data storage architecture, i.e. disk read-write
Performance is poor, is being gradually increased with the gaps between their growth rates of main memory, so that traditional main memory-disk storage framework can not increasingly fit
The requirement of big data management is answered, the cost of use of conventional disc battle array is high, and expansibility is poor, at present for the magnanimity of remote sensing image product
Data can not still accomplish efficient retrieval, quickly positioning, and therefore, these problems existing for remotely-sensed data platform all make existing distant
Sense data platform is more and more difficult to meet challenge new brought by satellite remote sensing big data era.
Summary of the invention
Based on this, it is necessary to for do not supported existing for existing remotely-sensed data platform the management of multi-series Remote Sensing Products with
And there are problems that challenge in terms of big data storage architecture, a kind of isomery remote sensing big data application platform is provided.
To solve the above problems, the invention adopts the following technical scheme：
A kind of isomery remote sensing big data application platform, including application layer, system layer and hardware layer, the application layer pass through institute
System layer is stated to connect with the hardware layer；
For satellite remote-sensing image product to be achieved and managed, the satellite remote-sensing image product is the application layer
The satellite remote-sensing image picture or satellite remote-sensing image video obtained after Data Format Transform；
The satellite that the system layer is used to that the application layer to be written using the object addressable mechanism based on calculating is distant
Corresponding file carries out fragment storage after feeling audio and video products processing；
The hardware layer includes several storage devices nodes, and each storage devices node is corresponding with hardware money
Source, the storage devices node is for storing the corresponding slicing files of the file.
Above-mentioned isomery remote sensing big data application platform is a kind of storage and management uniformity platform of remote sensing big data, this is flat
Platform can support the storage and management to the satellite remote-sensing image product data of multiple types remote sensing satellite, and the object based on calculating
Addressing mechanism breaks through the fragment storage for solving satellite remote-sensing image product, can quick position location satellite remote sensing image when searching
The storage location of each fragment of product realizes the integrated management of satellite resource and data resource, realizes resource-sharing and clothes
Business, at the same isomery remote sensing big data application platform proposed by the invention have high stability and high reliability, operation not by
The image of Single Point of Faliure, the support of technological frame, may be implemented database it is lasting, be stably connected with, it is ensured that the company of issued transaction
It is continuous and complete, guarantee that business datum is accurately complete.
Detailed description of the invention
Fig. 1 is the structural schematic diagram of isomery remote sensing big data application platform in one embodiment of the invention；
Fig. 2 is the structural schematic diagram of isomery remote sensing big data application platform in the one of specific embodiment of the present invention.
Specific embodiment
Technical solution of the present invention is described in detail below in conjunction with attached drawing and preferred embodiment.
In one of the embodiments, as shown in Figure 1, isomery remote sensing big data application platform includes application layer 100, system
Layer 200 and hardware layer 300, application layer 100 are connect by system layer 200 with hardware layer 300；Application layer 100 is used for distant to satellite
Sense audio and video products are achieved and are managed, and satellite remote-sensing image product is the satellite remote sensing shadow obtained after Data Format Transform
As picture or satellite remote-sensing image video；System layer 200 is used for using the object addressable mechanism based on calculating to application layer 100
Corresponding file carries out fragment storage after the satellite remote-sensing image product treatment of write-in；Hardware layer 300 includes that several storages are set
Slave node, each storage devices node are corresponding with hardware resource, and storage devices node is for the corresponding fragment text of storage file
Part.
Specifically, in the present embodiment, isomery remote sensing big data application platform is Three-tier Architecture Model, respectively application layer
100, system layer 200 and hardware layer 300, wherein what application layer 100 operated is product object, integrates all business interfaces, is to use
Family interaction platform when file is written in application layer 100, achieves all Data Integrations, and gives system layer 200 and store and file；
When reading file, access system layer 200 is read out.To solve due to different satellites (such as " Jilin No.1 " series of satellites, height
Point series of satellites, high scape satellite, Worldview satellite and Landsat satellite etc.) image data format differences it is larger, lead
Difficulty larger problem when application layer 100 being caused to carry out data management, 100 customized satellite remote sensing date formats of application layer,
And the data of other satellites are formatted, the satellite remote-sensing image product to reach uniform format, therefore in the present invention
For the satellite remote-sensing image picture or satellite remote-sensing image video obtained after Data Format Transform.Satellite remote-sensing image produces
Product include the video product of satellite, push away and sweep audio and video products, fundamental geomatics product, control point data, auxiliary data and increasing
It is worth product etc..
What system layer 200 operated is blocks of files, and the technology of this layer core the most is namely based on the object addressable mechanism of calculating,
System layer 200 is after the satellite remote-sensing image product treatment that application layer 100 is written using the object addressable mechanism based on calculating
When corresponding file carries out fragment storage, application layer 100 is written by rule for system layer 200 satellite remote-sensing image product treatment
Corresponding file is divided into several blocks of files afterwards, and blocks of files is stored after multi-level mapping to storage devices node, this
In multi-level mapping to include blocks of files map to the one-to-many mapping of configuration group and the multi-to-multi of configuration group to storage devices node.
Specifically, application layer 100 will give system layer 200 after treated data processing, and application layer 100 is directly to system layer when reading
200 carry out key search, workflow of the system layer 200 to the access of corresponding file after satellite remote-sensing image product treatment
It is as follows：One file will be stored and need to undergo cubic map in cluster, this document can be drawn by rule before mapping
It is divided into multiple blocks of files, then system layer 200 carries out multi-level mapping operation to blocks of files, is blocks of files first to the one of configuration group
To more mappings, i.e., a blocks of files can only be uniquely mapped in a configuration group, but a configuration group can be accepted simultaneously
Multiple blocks of files；The followed by mapping of a multi-to-multi of configuration group and actual physical device, i.e. a configuration group can reflect simultaneously
It is mapped in n physical equipment, wherein n is exactly the quantity of copy, and a physical equipment can accept multiple configuration groups, and map
Position is calculated mainly by CRUSH (Controlled Replication Under Scalable Hashing) algorithm.This
The core of a process is the drawbacks of getting rid of static mappings, and static mappings will limit the automated storing of cluster, is going wrong
Shi Wufa quickly and effectively carries out the migration and reconstruct of data, and the present invention is mapped using three layers rather than direct two layers of dynamic
The major reason of mapping is that this mapping mode effectively prevents the quick-fried increasing of local amount of metadata, simplifies computation complexity and dimension
The workload of shield.System layer 200 is used as a distributed storage system, and all data are stored in a manner of object in bottom
Each physical node in cluster.
Hardware layer 300 includes a large amount of storage devices node, and each storage devices node possesses the hardware of oneself
Resource (including CPU, memory, hard disk and network etc.), it may not be necessary to large-scale disk battle array, to economize on resources.System layer 200 is write
It, can be by File Mapping to specific physical address when entering hardware layer 300；When reading hardware layer 300, it can be deposited by calculating to find
Storage space is set.
The isomery remote sensing big data application platform that the present embodiment is proposed is a kind of storage and management system of remote sensing big data
One mild-natured, which can support the storage and management to the satellite remote-sensing image product data of multiple types remote sensing satellite, and
Object addressable mechanism based on calculating, breaking through the fragment storage for solving satellite remote-sensing image product can quickly determine when searching
The storage location of each fragment of position satellite remote-sensing image product realizes the integrated management of satellite resource and data resource, real
Existing resource-sharing and service, while isomery remote sensing big data application platform proposed by the invention has high stability and highly reliable
Property, operation is not by the image of Single Point of Faliure, the support of technological frame, may be implemented database it is lasting, be stably connected with, it is ensured that
Issued transaction it is continuous and complete, guarantee business datum it is accurately complete.
As a kind of specific embodiment, application layer 100 checks that achieving data is when receiving archives data request
No presence；If so, verifying according to Satellite Product specification to the completeness for achieving data, meet satellite production when achieving data
When product specification, application layer 100 carries out archive operations.In the present embodiment, application layer 100 is receiving archives data request
When, to check that achieving data whether there is, it will be according to Satellite Product specification to archive data in the presence of achieving data
Completeness verified, if achieve data be unsatisfactory for product specification, not carry out archive operations.Application layer 100, which is given, is
The data of system layer 200 similarly should comply with Satellite Product specification, not file for achieving the redundant data in data
Operation.
As a kind of specific embodiment, as shown in Fig. 2, application layer 100 includes data filing module 110, data inspection
Rope module 120, data extraction module 130, product introduction module 140 and statistical analysis module 150；Data filing module 110 is used
In carrying out filing storage to satellite remote-sensing image product；Data retrieval module 120 is for examining satellite remote-sensing image product
Rope, retrieval include retrieval, catalogue retrieval, spatial position retrieval and classification retrieval based on metadata；Data extraction module 130 is used
In to the subsystem of user and ground segment provide data；Product introduction module 140 be used for advanced satellite remote-sensing image product into
Row is shown, while being also used to realize that the extraction to satellite special topic product data information, statistics and classification are shown；Statistically analyze mould
Block 150 generates statistical report form for platform information to be counted and analyzed, and platform information includes that satellite remote-sensing image produces
Product, satellite special topic product data information, product life cycle, daily archive information, user access information and data download information.
In the present embodiment, the application layer 100 of isomery remote sensing big data application platform include data filing module 110,
Data retrieval module 120, data extraction module 130, product introduction module 140 and statistical analysis module 150, are respectively utilized to complete
The functions such as filing, retrieval, extraction to satellite remote-sensing image product.
Data filing module 110 is mainly used for carrying out satellite remote-sensing image product filing storage, such as the view to satellite
Frequency product pushes away and sweeps all kinds of numbers such as audio and video products, fundamental geomatics product, control point data, auxiliary data and value-added product
According to carrying out filing storage.
Data retrieval module 120 is for realizing retrieval, catalogue retrieval, spatial position retrieval, classification inspection based on metadata
A variety of data retrieval functions such as rope, realize to satellite remote-sensing image product (video product including satellite, push away sweep audio and video products,
The Various types of data such as fundamental geomatics product, control point data, auxiliary data and value-added product) retrieval.
Data extraction module 130 is responsible for providing a user data, and data are supplied to user by different modes, for
Family browsing selection and downloading, while data extraction module 130 is also responsible for providing data to the subsystem of other ground segments.
Product introduction module 140 is responsible for the displaying of high-grade products, so that user is rapidly viewed satellite high-grade products, simultaneously
Product introduction module 140 provides the function of showing to the extraction of satellite special topic product data information, statistics and classification.
Statistical analysis module 150 is mainly used for counting platform information and being analyzed, and generates statistical report form, platform letter
Breath includes satellite remote-sensing image product, satellite remote-sensing image product, user access information, daily archive information, the week life of product
Phase and data download information etc., statistical analysis module 150 is to satellite remote-sensing image product, satellite remote-sensing image product, Yong Hufang
It asks that the data such as information, daily archive information, product life cycle and data download information are counted and analyzed, while generating simultaneously
Print ASSOCIATE STATISTICS report.
As a kind of specific embodiment, system layer 200 can be divided into three parts, be respectively meta data server,
Object storage cluster and cluster monitor, wherein meta data server is for replicating and the name space of distribution system layer 200；
Object storage cluster is used to store the corresponding data of satellite remote-sensing image product and metadata in a manner of object storage；Cluster prison
Visual organ is used to manage the mapping of object storage cluster.
The work of meta data server (being mainly used for caching and synchronous distributed meta data) is exactly to manage file system
Name space, although both metadata and data are stored in object storage cluster, the two manages respectively, supports expansible
Property.In fact, metadata is further split in a metadata server cluster, meta data server can be adaptively
Duplication and distribution name space, avoid the occurrence of hot spot.As shown in Fig. 2, meta data server manages name space part, it can be with
(for redundancy and performance) is overlapped.Meta data server is mapped in Ceph to name space using dynamic subtree logic point
Area executes, it allows Ceph to be adjusted to the workload of variation and (migrate name space between meta data server) simultaneously
The position of retention property.
Object storage cluster (be mainly used for storing using data and metadata as object, and execute other key functions) is no
Only include storage, further includes intelligence.Traditional driving is the simple target for only responding the order from initiator, but object is deposited
Storing up equipment is smart machine, it can be used as target and initiator, supports communication and cooperation with other object storage devices.
Cluster monitor (being mainly used for executing function for monitoring) implements the management of cluster mapping, but fault management is some
Element is executed in object storage itself, when object storage device breaks down or new equipment adds, cluster observation
Device just detects and safeguards an effective cluster mapping.This function executes in the way of a kind of distribution, maps in this mode
Upgrading can be with current traffic communication.
As shown in Fig. 2, system layer 200 includes RADOS, LIBRADOS, RADOS block device (RBD), RADOS gateway interface
(RGW) and CephFS, wherein RADOS is the basis of Ceph storage cluster, and all data are all in the form of object in the present system
Storage, RADOS are responsible for saving all objects；LIBRADOS is that various programming languages access RADOS interface with providing convenience
Mode, while also for RBD, RGW, CephFS, these components provide primary interface；RBD is Ceph block device, is provided persistently
Property block storage, it is automatic simplify configuration and adjusting；RGW provides object storage service, allows application program and this
Connection is established in the object storage of system；CephFS is that one of ceph file system offer stores user data simultaneously using this system
And the file system compatible with POSIX.One file of system layer 200 can be assigned to one from meta data server
Inode number (inode number, abbreviation INO), for file, this is a unique identifier, and then file is pushed away
Enter in some objects (according to the size of file).Use INO and objectnumber (object number, abbreviation ONO), each object
It is all assigned to an object ID (abbreviation OID), a simple Hash (also known as Hash), each object are used on OID
It is assigned to a placement group, placement group (being identified as PGID) is the concept container an of object.Finally, placement group is deposited to object
The mapping of storage equipment is a pseudorandom mapping, and using CRUSH algorithm, so, placement group (and copy) is deposited to object
The mapping of storage equipment does not just have to rely on any metadata, but relies on a pseudorandom mapping function.This operation handlebar storage
Minimizing overhead, simplify distribution and data query.
The present invention has the following technical effects：
(1) integrated management for realizing satellite resource and data resource, realizes resource-sharing and service, realizes optics high score
Resolution satellite data, high-resolution satellite video data, more/high-spectrum remote sensing data, noctilucence remotely-sensed data, Fundamental Geographic Information System
The data access of all kinds of remotely-sensed datas such as product and filing；
(2) the multiple types remote sensing satellite resource such as comprehensive Jilin series of satellites, domestic satallite, external satellite；With data acquisition
Based on integration, comprehensive aerospace data, aeronautical data and ground data form the integrated data center in day vacant lot；With magnanimity
Remotely-sensed data intelligent information retrieval algorithmic technique is core, provides the distant of profession for industry user, civilian users and government department
Feel information；And the software development of industry special topic, common people's application and development and comprehensive official communication are provided according to the specific demand of user on platform
The open services such as inquiry；
(3) platform structureization designs, flexibly detachable, has flexible extendible interface, is easy to modify adjustment, secondary opens
Hair and expansion reduce to greatest extent because upstream technology upgrades bring system implement general plan, guarantee the validity and continuity of investment
Property；
(4) platform has high stability, high reliability, and system uses B/S (Browser/Server, browser/service
Device) structure application model, install deployment concentratedly, so the operation of system is not influenced by Single Point of Faliure, the support of technological frame,
May be implemented database it is lasting, be stably connected with, it is ensured that issued transaction it is continuous and complete, guarantee business datum it is accurately complete.
Each technical characteristic of embodiment described above can be combined arbitrarily, for simplicity of description, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, all should be considered as described in this specification.
The embodiments described above only express several embodiments of the present invention, and the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to protection of the invention
Range.Therefore, the scope of protection of the patent of the invention shall be subject to the appended claims.
Claims (8)
1. a kind of isomery remote sensing big data application platform, which is characterized in that described to answer including application layer, system layer and hardware layer
It is connect by the system layer with the hardware layer with layer；
For the application layer for satellite remote-sensing image product to be achieved and managed, the satellite remote-sensing image product is to pass through
The satellite remote-sensing image picture or satellite remote-sensing image video obtained after Data Format Transform；
The system layer is used for the satellite remote sensing shadow that the application layer is written using the object addressable mechanism based on calculating
As file corresponding after product treatment carries out fragment storage；
The hardware layer includes several storage devices nodes, and each storage devices node is corresponding with hardware resource, institute
Storage devices node is stated for storing the corresponding slicing files of the file.
2. isomery remote sensing big data application platform according to claim 1, which is characterized in that
The application layer checks that achieving data whether there is when receiving archives data request；
If so, being verified according to Satellite Product specification to the completeness for achieving data, when the archive data meet
When the Satellite Product specification, the application layer carries out archive operations.
3. isomery remote sensing big data application platform according to claim 1 or 2, which is characterized in that the application layer includes
Data filing module, data retrieval module, data extraction module, product introduction module and statistical analysis module；
The data filing module is for carrying out filing storage to the satellite remote-sensing image product；
For the data retrieval module for retrieving to the satellite remote-sensing image product, the retrieval includes being based on metadata
Retrieval, catalogue retrieval, spatial position retrieval and classification retrieval；
The data extraction module is used to provide data to the subsystem of user and ground segment；
The product introduction module is also used to realize special to satellite for being shown advanced satellite remote-sensing image product
Extraction, statistics and the classification for inscribing product data information are shown；
The statistical analysis module generates statistical report form for platform information to be counted and analyzed, the platform information
Including the satellite remote-sensing image product, the satellite special topic product data information, the product life cycle, daily archive information,
User access information and data download information.
4. isomery remote sensing big data application platform according to claim 1 or 2, which is characterized in that
The file is divided into several blocks of files by rule by the system layer, and by the blocks of files after multi-level mapping
It stores to the storage devices node.
5. isomery remote sensing big data application platform according to claim 4, which is characterized in that
The multi-level mapping includes the blocks of files to the one-to-many mapping of configuration group and the configuration group to the storage equipment
The multi-to-multi of node maps.
6. isomery remote sensing big data application platform according to claim 1 or 2, which is characterized in that the system layer includes
Meta data server, object storage cluster and cluster monitor；
The meta data server is used to replicate and distribute the name space of the system layer；
The object storage cluster be used for by object storage in a manner of store the corresponding data of the satellite remote-sensing image product and
Metadata；
The cluster monitor is used to manage the mapping of the object storage cluster.
7. isomery remote sensing big data application platform according to claim 1 or 2, which is characterized in that
The hardware resource includes CPU, memory, hard disk and network.
8. isomery remote sensing big data application platform according to claim 1 or 2, which is characterized in that
The satellite remote-sensing image product includes the video product of satellite, pushes away and sweep audio and video products, fundamental geomatics product, control
Point data, auxiliary data and value-added product.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810629868.6A CN108829836A (en) | 2018-06-19 | 2018-06-19 | Isomery remote sensing big data application platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810629868.6A CN108829836A (en) | 2018-06-19 | 2018-06-19 | Isomery remote sensing big data application platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108829836A true CN108829836A (en) | 2018-11-16 |
Family
ID=64142549
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810629868.6A Pending CN108829836A (en) | 2018-06-19 | 2018-06-19 | Isomery remote sensing big data application platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108829836A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110209380A (en) * | 2019-05-30 | 2019-09-06 | 上海直真君智科技有限公司 | A kind of unified dynamic metadata processing method towards big data isomery model |
| WO2020252799A1 (en) * | 2019-06-18 | 2020-12-24 | 中国科学院计算机网络信息中心 | Parallel data access method and system for massive remote-sensing images |
| CN112417199A (en) * | 2020-12-03 | 2021-02-26 | 深圳前海微众银行股份有限公司 | Remote sensing image retrieval method, device, system and storage medium |
| CN114489957A (en) * | 2022-04-01 | 2022-05-13 | 国家卫星海洋应用中心 | Remote sensing satellite data processing method and device and electronic equipment |
| CN116186319A (en) * | 2022-11-23 | 2023-05-30 | 自然资源部国土卫星遥感应用中心 | Satellite image data archiving management method and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102663057A (en) * | 2012-03-02 | 2012-09-12 | 苏州武大影像信息工程研究院有限责任公司 | Method for managing multisource-isomerism aviation remote sensing data |
| CN102662610A (en) * | 2012-04-20 | 2012-09-12 | 中国科学院遥感应用研究所 | Remote-sensing data management system and method |
| CN103793442A (en) * | 2012-11-05 | 2014-05-14 | 北京超图软件股份有限公司 | Spatial data processing method and system |
| CN105045856A (en) * | 2015-07-09 | 2015-11-11 | 中国资源卫星应用中心 | Hadoop-based data processing system for big-data remote sensing satellite |
| CN105338118A (en) * | 2015-11-30 | 2016-02-17 | 上海斐讯数据通信技术有限公司 | Distributed storage system |
| CN106909644A (en) * | 2017-02-21 | 2017-06-30 | 中国科学院电子学研究所 | A kind of multistage tissue and indexing means towards mass remote sensing image |
-
2018
- 2018-06-19 CN CN201810629868.6A patent/CN108829836A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102663057A (en) * | 2012-03-02 | 2012-09-12 | 苏州武大影像信息工程研究院有限责任公司 | Method for managing multisource-isomerism aviation remote sensing data |
| CN102662610A (en) * | 2012-04-20 | 2012-09-12 | 中国科学院遥感应用研究所 | Remote-sensing data management system and method |
| CN103793442A (en) * | 2012-11-05 | 2014-05-14 | 北京超图软件股份有限公司 | Spatial data processing method and system |
| CN105045856A (en) * | 2015-07-09 | 2015-11-11 | 中国资源卫星应用中心 | Hadoop-based data processing system for big-data remote sensing satellite |
| CN105338118A (en) * | 2015-11-30 | 2016-02-17 | 上海斐讯数据通信技术有限公司 | Distributed storage system |
| CN106909644A (en) * | 2017-02-21 | 2017-06-30 | 中国科学院电子学研究所 | A kind of multistage tissue and indexing means towards mass remote sensing image |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110209380A (en) * | 2019-05-30 | 2019-09-06 | 上海直真君智科技有限公司 | A kind of unified dynamic metadata processing method towards big data isomery model |
| WO2020252799A1 (en) * | 2019-06-18 | 2020-12-24 | 中国科学院计算机网络信息中心 | Parallel data access method and system for massive remote-sensing images |
| US20220121688A1 (en) * | 2019-06-18 | 2022-04-21 | Computer Network Information Center, Chinese Academy Of Sciences | Parallel data access method and system for massive remote-sensing images |
| US11874855B2 (en) * | 2019-06-18 | 2024-01-16 | Computer Network Information Center, Chinese Academy Of Sciences | Parallel data access method and system for massive remote-sensing images |
| CN112417199A (en) * | 2020-12-03 | 2021-02-26 | 深圳前海微众银行股份有限公司 | Remote sensing image retrieval method, device, system and storage medium |
| CN114489957A (en) * | 2022-04-01 | 2022-05-13 | 国家卫星海洋应用中心 | Remote sensing satellite data processing method and device and electronic equipment |
| CN114489957B (en) * | 2022-04-01 | 2022-07-22 | 国家卫星海洋应用中心 | Remote sensing satellite data processing method and device and electronic equipment |
| CN116186319A (en) * | 2022-11-23 | 2023-05-30 | 自然资源部国土卫星遥感应用中心 | Satellite image data archiving management method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108829836A (en) | Isomery remote sensing big data application platform | |
| US20220405298A1 (en) | Large scale unstructured database systems | |
| US8504571B2 (en) | Directed placement of data in a redundant data storage system | |
| CN104813321B (en) | The content and metadata of uncoupling in distributed objects store the ecosystem | |
| CN107423422B (en) | Spatial data distributed storage and search method and system based on grid | |
| US8386436B2 (en) | System and method for data storage | |
| CN106708993A (en) | Spatial data storage processing middleware framework realization method based on big data technology | |
| CN103544045A (en) | HDFS-based virtual machine image storage system and construction method thereof | |
| CN102638584B (en) | Data distributing and caching method and data distributing and caching system | |
| CN110287150B (en) | Metadata distributed management method and system for large-scale storage system | |
| EP0663641A1 (en) | Summary catalogs | |
| CN113986873B (en) | Method for processing, storing and sharing data modeling of mass Internet of things | |
| CN109144966A (en) | A kind of high-efficiency tissue and management method of massive spatio-temporal data | |
| CN104657459A (en) | Massive data storage method based on file granularity | |
| JPH05334165A (en) | Parallel data base processing system and its secondary key retrieving method | |
| CN102890682A (en) | Method for creating index, searching method, device and system | |
| US20230024345A1 (en) | Data processing method and apparatus, device, and readable storage medium | |
| CN110413571A (en) | Based on the extensive remote sensing image data distributed storage method of MongoDB | |
| CN105808753A (en) | Regional digital resource system | |
| CN110505495A (en) | Multimedia resource takes out frame method, device, server and storage medium | |
| CN105095392A (en) | Method and device for data sharing among data marts | |
| CN101458655B (en) | Internal memory management method, system and internal memory control device | |
| CN106383897A (en) | Database capacity calculation method and apparatus | |
| US10331627B2 (en) | Method and system for unified technological stack management for relational databases | |
| CN107622123A (en) | A kind of document analysis method towards ASM file system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181116 |
|
| RJ01 | Rejection of invention patent application after publication |