CN110855638A - Remote sensing satellite data decompression processing system and method based on cloud computing - Google Patents

Remote sensing satellite data decompression processing system and method based on cloud computing Download PDF

Info

Publication number
CN110855638A
CN110855638A CN201911033494.2A CN201911033494A CN110855638A CN 110855638 A CN110855638 A CN 110855638A CN 201911033494 A CN201911033494 A CN 201911033494A CN 110855638 A CN110855638 A CN 110855638A
Authority
CN
China
Prior art keywords
data
component
decompression
block
original
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911033494.2A
Other languages
Chinese (zh)
Inventor
王海波
邓超
王冰冰
齐建超
吴郡
赵亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CHINA SURVEY SURVEYING AND MAPPING TECHNOLOGY Co.,Ltd.
Original Assignee
China Center for Resource Satellite Data and Applications CRESDA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Center for Resource Satellite Data and Applications CRESDA filed Critical China Center for Resource Satellite Data and Applications CRESDA
Priority to CN201911033494.2A priority Critical patent/CN110855638A/en
Publication of CN110855638A publication Critical patent/CN110855638A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04Protocols for data compression, e.g. ROHC

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Image Processing (AREA)
  • Radio Relay Systems (AREA)

Abstract

A remote sensing satellite data decompression processing system based on cloud computing comprises an input format component, a block reading component, a data dividing component, a decompression Mapper component, a decompression Shuffle component, a decompression Reducer component, an original data decompression component and an image splicing component; the method comprises the steps of performing parallel granularity division on original data of each sensor image according to a remote sensing data division description file and a data compression frame format, so that the original data can be processed in parallel; and performing high-speed parallel decompression processing on the segmented original data by adopting the optimized Map-Reduce calculation model, wherein the image data of one sensor can be subjected to parallel decompression processing by a plurality of nodes, and the data decompression, the image data sorting and the image data splicing are sequentially completed to form complete image data.

Description

Remote sensing satellite data decompression processing system and method based on cloud computing
Technical Field
The invention relates to a system and a method for decompressing and processing original data of a satellite remote sensing image, belongs to the field of remote sensing data processing, and is suitable for remote sensing satellite image processing.
Background
The original data downloaded from the satellite are packed into compressed code streams with an agreed format, and the ground must be provided with a de-format decompression device to complete corresponding inverse processing so as to recover the original image data.
At present, the original data decompression of the domestic remote sensing satellite mainly adopts a single-node single-step processing mode, and each special node is responsible for the decompression of data of one image virtual channel. From data acquisition, the original data is decompressed through the steps of frame synchronization, descrambling, format analysis, data segmentation, decompression, image splicing, data playback and the like. With the development of the remote sensing satellite technology in China, the satellite data transmission code rate and the performance of the satellite-borne compression encoder are both greatly improved. The single-node single-step flow is used for processing the high-speed data transmission code stream, the operation amount is extremely large, the single node is easy to cause system problems, and the reliability and the efficiency are extremely low. In order to ensure the reliability of data decompression, the special node can only reduce the decompression rate, cannot meet the real-time acquisition requirement of a user on the remote sensing image, and increases the system maintenance cost.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: the invention adopts a cloud computing architecture, overcomes the performance bottleneck problem of a single node mode, provides a remote sensing satellite data decompression system and method based on cloud computing, and solves the problems of poor timeliness and low reliability of the current remote sensing satellite data decompression processing. The method has huge performance and reliability advantages in the aspect of mass remote sensing data decompression, and can efficiently and reliably complete the decompression processing of the whole-orbit dual-channel original data without speed reduction decompression; meanwhile, the performance of the system can be further improved by adding cloud computing nodes, and the system has high expansibility.
The technical scheme adopted by the invention is as follows: a remote sensing satellite data decompression processing system based on cloud computing comprises an input format component, a block reading component, a data dividing component, a decompression Mapper component, a decompression Shuffle component, a decompression Reducer component, an original data decompression component and an image splicing component;
an input format component: according to the set size and position of original data blocks, the original data is cut into block data, a block reading component is called, key, value pairs of the original block data key values which can be processed by a decompression Mapper component are generated and distributed to Map processing nodes;
a data partitioning component: recording the size and the position of each original block data;
a block reading component: generating a key value and a value according to the original block data, and combining the key value pair < key, value > of the original block data;
decompression Mapper component: receiving key value pairs of original block data, performing data extraction operation, calling an original data decompression component, decompressing the original block data to generate image block data, and reorganizing the image block data into a key value pair (key, value) form;
decompression Shuffle component: receiving the image block data key value pair, sorting according to the image frame number and the intra-frame block number, and outputting to a decompression Reducer component;
decompression Reducer component: receiving the sequenced image block data, calling an image splicing component to splice the image data, recovering auxiliary data and verifying the data;
raw data decompression component: performing data decompression by taking the original block data as a unit, and outputting decompressed data;
the image splicing component: and sequencing the image blocks and the auxiliary data blocks with the same number according to the block numbers, splicing, and finally forming the image data and the auxiliary data which conform to the satellite data format specification.
A remote sensing satellite data decompression processing method based on cloud computing comprises the following steps:
(1) determining the input data block length for parallel calculation according to the original data format characteristics of each remote sensing satellite, calling a data division component, and generating an original data division information description file;
(2) according to an input original data segmentation information description file, calling an input format component, a block reading component and a data partitioning component, partitioning original data, partitioning the original data into a set of key value pairs (key, value) of the original block data, and distributing data nodes for storing each original block data;
(3) the Hadoop platform calculates each original block data key value pair distributed to the optimal Map processing node according to the load of each Map node and the storage position of the original block data;
(4) each decompression Mapper component processes key value pairs of original block data, performs data extraction operation, calls an original data decompression component at the same time, decompresses the original block data to generate image block data, recombines the image block data into a form of key value pairs of the image block data, and transmits processing results to a decompression Shuffle component in a data stream mode; if the node has an abnormal error, scheduling to other nodes for recalculation;
(5) the decompression Shuffle component receives the data stream, sorts the key value pairs according to the image amplitude numbers and the intra-amplitude block numbers, and transmits the key value pairs to each decompression Reducer component in a data stream mode;
(6) and each decompression Reducer component sorts the image blocks and the auxiliary data blocks with the same number according to the block numbers, splices the image data and the auxiliary data with the same number, simultaneously checks the image data and the auxiliary data, and finally generates complete image data and auxiliary data of each type of sensor of the remote sensing satellite.
The structure of the segmentation information description file is as follows:
<split>
< id > Block number </id >
< start > Start coordinate </start >
< end > end coordinate </end >
</split>
Wherein id is a data block sequence number, start is a data block start byte value, and end is a data block end byte value.
The input format component: according to the set size and position of the original data block, the original data is cut into block data, a block reading component is called, and key value pairs < key, value > of the original block data which can be processed by the decompression Mapper component are generated and distributed to each Map processing node.
The data partitioning component: and recording the size and the position of each original block data.
The block reading component: and generating a key value and a value according to the original block data, and combining the key value pair < key, value > of the original block data.
Compared with the prior art, the invention has the advantages that:
(1) according to the invention, the cloud computing technology is utilized to divide the large-scale remote sensing satellite original data into data blocks which can be processed in parallel, and high-speed parallel decompression processing is carried out.
(2) According to the invention, each data block is distributed to different server nodes of the cloud computing cluster for decompression processing, so that the calculation amount of each server node is greatly reduced, and the stability and reliability of the system are greatly improved.
(3) The invention can improve the system performance by increasing the cloud computing cluster server nodes, and has higher expansibility. Through the test of a plurality of remote sensing satellite data, the decompression performance of the algorithm can completely meet the requirements of massive original data of the remote sensing satellite in the future on decompression timeliness and stability.
(4) The method comprises the steps of performing parallel granularity division on original data of each sensor image according to a remote sensing data division description file and a data compression frame format, so that the original data can be processed in parallel; and performing high-speed parallel decompression processing on the segmented original data by adopting the optimized Map-Reduce calculation model, wherein the image data of one sensor can be subjected to parallel decompression processing by a plurality of nodes, and the data decompression, the image data sorting and the image data splicing are sequentially completed to form complete image data.
Drawings
Fig. 1 is a block diagram of a high-performance decompression algorithm based on cloud computing;
fig. 2 is a flow chart of a remote sensing satellite decompression method based on cloud computing.
Detailed Description
The invention is further described below with reference to the accompanying drawings.
The concept to which the present invention relates is defined first.
Cloud computing: the core idea of cloud computing is 'divide-and-conquer', mass data are subdivided into M parts, the M parts are mapped to M nodes for computing, iterative operation of the data is carried out in the period, intermediate data are collected to N nodes for computing final results, and large-scale data are utilized to accelerate program operation in parallel.
MapReduce model: MapReduce is a programming model for parallel computation of large-scale datasets. The model firstly appoints a Map function, maps an input key value pair set into a group of new key value pair sets, transfers the value sets with the same key value to a Reduce function, the Reduce function merges the value values, and the model finally outputs a merged and simplified key value pair set.
Decompression: original image data are decoded and restored from original data with formats downloaded from a remote sensing satellite through a certain algorithm.
Aiming at the characteristics of original data of a remote sensing satellite and a MapReduce cloud computing model, a bottom layer framework of MapReduce is redesigned to form a high-performance decompression algorithm module based on cloud computing, as shown in figure 1, the algorithm module is independent of satellite models and data types, can support block processing of data of multiple types of satellites and multiple frame formats, and is high in data processing speed and high in stability.
The remote sensing satellite data decompression processing system based on cloud computing comprises an input format component, a block reading component, a data dividing component, a decompression Mapper component, a decompression Shuffle component, a decompression Reducer component, an original data decompression component and an image splicing component. Each modular component is provided with an input stream and an output stream. The functions of the components are as follows:
an input format component: according to the set size and position of the original data block, the original data is cut into block data, a block reading component is called, and key value pairs < key, value > of the original block data which can be processed by the decompression Mapper component are generated and distributed to each Map processing node.
Wherein, key represents a serial number, and value represents a numerical value;
a block reading component: and generating a key value and a value according to the original block data, and combining the key value pair < key, value > of the original block data.
A data partitioning component: and recording the size and the position of each original block data.
Decompression Mapper component: and receiving key value pairs of the original block data, performing data extraction operation, calling an original data decompression component, decompressing the original block data to generate image block data, and reorganizing the image block data into a key value pair (key, value) form.
Decompression Shuffle component: and receiving the key value pairs of the image block data, sequencing the image block data according to the image frame number and the intra-frame block number, and outputting the image block data to a decompression Reducer component.
Decompression Reducer component: and receiving the sequenced image block data, and calling the image splicing component to perform image data splicing, auxiliary data recovery and data verification.
Raw data decompression component: and decompressing the data by taking the original block data as a unit, and outputting the decompressed data.
The image splicing component: and sequencing the image blocks and the auxiliary data blocks with the same number according to the block numbers, splicing, and finally forming the image data and the auxiliary data which conform to the satellite data format specification.
The remote sensing satellite data decompression method based on cloud computing comprises the following steps as shown in figure 2:
(1) according to the original data format characteristics of each remote sensing satellite, determining the input data block length for parallel calculation, calling a data division component, and generating an original data division information description file. The structure of the segmentation information description file is as follows:
<split>
< id > Block number </id >
< start > Start coordinate </start >
< end > end coordinate </end >
</split>
id is the serial number of the data block, start is the start byte value of the data block, and end is the end byte value of the data block.
(2) According to the input original data segmentation information description file, calling an original data partitioning component (an input format component, a block reading component and a data partitioning component), partitioning original data, segmenting the original data into a set of key value pairs < key, value >, and simultaneously distributing data nodes stored by each original block data.
(3) And the Hadoop platform allocates each original block data key value pair to the optimal Map processing node for operation according to the load condition of each Map node and the storage position of the original block data.
(4) Each decompression Mapper component processes the key value pair of the original block data to complete the work of auxiliary data extraction and decompression, and recombines the key value pair of the image block data into a form of key, value, and the processing result is transmitted to the decompression Shuffle component in a streaming way; and if the node has an abnormal error, scheduling to other nodes for re-operation.
(5) The decompression Shuffle component receives the data stream, sorts the key value pairs according to the image amplitude numbers and the intra-amplitude block numbers, and transmits the sorted key value pairs to each decompression Reducer component in a streaming mode.
(6) And the decompression Reducer component sorts the image blocks and the auxiliary data blocks with the same number according to the block numbers, splices the image data and the auxiliary data with the same number, simultaneously checks the image data and the auxiliary data, and finally generates complete image data and complete auxiliary data of each type of sensor of the satellite.
The present invention has not been described in detail, partly as is known to the person skilled in the art.

Claims (6)

1. A remote sensing satellite data decompression processing system based on cloud computing is characterized by comprising an input format component, a block reading component, a data dividing component, a decompression Mapper component, a decompression Shuffle component, a decompression Reducer component, an original data decompression component and an image splicing component;
an input format component: according to the set size and position of original data blocks, the original data is cut into block data, a block reading component is called, key, value pairs of the original block data key values which can be processed by a decompression Mapper component are generated and distributed to Map processing nodes;
a data partitioning component: recording the size and the position of each original block data;
a block reading component: generating a key value and a value according to the original block data, and combining the key value pair < key, value > of the original block data;
decompression Mapper component: receiving key value pairs of original block data, performing data extraction operation, calling an original data decompression component, decompressing the original block data to generate image block data, and reorganizing the image block data into a key value pair (key, value) form;
decompression Shuffle component: receiving the image block data key value pair, sorting according to the image frame number and the intra-frame block number, and outputting to a decompression Reducer component;
decompression Reducer component: receiving the sequenced image block data, calling an image splicing component to splice the image data, recovering auxiliary data and verifying the data;
raw data decompression component: performing data decompression by taking the original block data as a unit, and outputting decompressed data;
the image splicing component: and sequencing the image blocks and the auxiliary data blocks with the same number according to the block numbers, splicing, and finally forming the image data and the auxiliary data which conform to the satellite data format specification.
2. A remote sensing satellite data decompression processing method based on cloud computing is characterized by comprising the following steps:
(1) determining the input data block length for parallel calculation according to the original data format characteristics of each remote sensing satellite, calling a data division component, and generating an original data division information description file;
(2) according to an input original data segmentation information description file, calling an input format component, a block reading component and a data partitioning component, partitioning original data, partitioning the original data into a set of key value pairs (key, value) of the original block data, and distributing data nodes for storing each original block data;
(3) the Hadoop platform calculates each original block data key value pair distributed to the optimal Map processing node according to the load of each Map node and the storage position of the original block data;
(4) each decompression Mapper component processes key value pairs of original block data, performs data extraction operation, calls an original data decompression component at the same time, decompresses the original block data to generate image block data, recombines the image block data into a form of key value pairs of the image block data, and transmits processing results to a decompression Shuffle component in a data stream mode; if the node has an abnormal error, scheduling to other nodes for recalculation;
(5) the decompression Shuffle component receives the data stream, sorts the key value pairs according to the image amplitude numbers and the intra-amplitude block numbers, and transmits the key value pairs to each decompression Reducer component in a data stream mode;
(6) and each decompression Reducer component sorts the image blocks and the auxiliary data blocks with the same number according to the block numbers, splices the image data and the auxiliary data with the same number, simultaneously checks the image data and the auxiliary data, and finally generates complete image data and auxiliary data of each type of sensor of the remote sensing satellite.
3. The remote sensing satellite data decompression processing method based on cloud computing as claimed in claim 2, wherein the structure of the segmentation information description file is as follows:
<split>
< id > Block number </id >
< start > Start coordinate </start >
< end > end coordinate </end >
</split>
Wherein id is a data block sequence number, start is a data block start byte value, and end is a data block end byte value.
4. The remote sensing satellite data decompression processing method based on cloud computing as claimed in claim 2 or 3, wherein the input format component: according to the set size and position of the original data block, the original data is cut into block data, a block reading component is called, and key value pairs < key, value > of the original block data which can be processed by the decompression Mapper component are generated and distributed to each Map processing node.
5. The remote sensing satellite data decompression processing method based on cloud computing as claimed in claim 4, wherein the data partitioning component: and recording the size and the position of each original block data.
6. The remote sensing satellite data decompression processing method based on cloud computing as claimed in claim 5, wherein the block reading component: and generating a key value and a value according to the original block data, and combining the key value pair < key, value > of the original block data.
CN201911033494.2A 2019-10-28 2019-10-28 Remote sensing satellite data decompression processing system and method based on cloud computing Pending CN110855638A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911033494.2A CN110855638A (en) 2019-10-28 2019-10-28 Remote sensing satellite data decompression processing system and method based on cloud computing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911033494.2A CN110855638A (en) 2019-10-28 2019-10-28 Remote sensing satellite data decompression processing system and method based on cloud computing

Publications (1)

Publication Number Publication Date
CN110855638A true CN110855638A (en) 2020-02-28

Family

ID=69598058

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911033494.2A Pending CN110855638A (en) 2019-10-28 2019-10-28 Remote sensing satellite data decompression processing system and method based on cloud computing

Country Status (1)

Country Link
CN (1) CN110855638A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111415299A (en) * 2020-03-26 2020-07-14 浙江科技学院 High-resolution image style migration method
CN111445387A (en) * 2020-06-16 2020-07-24 浙江科技学院 High-resolution image style migration method based on random rearrangement of image blocks
CN114003755A (en) * 2021-10-25 2022-02-01 中国自然资源航空物探遥感中心 Multi-source satellite scene-separating image data organization storage and retrieval method, system and equipment
CN115883839A (en) * 2023-03-09 2023-03-31 湖北芯擎科技有限公司 Image verification method, device and equipment and computer readable storage medium
CN116471260A (en) * 2023-06-20 2023-07-21 中国科学院空天信息创新研究院 Remote sensing satellite original data distribution and transmission device and method
CN116634167A (en) * 2023-07-24 2023-08-22 中国科学院空天信息创新研究院 Satellite imaging data storage and extraction method
CN116668435A (en) * 2023-08-01 2023-08-29 中国科学院空天信息创新研究院 Interactive real-time remote sensing product generation method, device and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103428494A (en) * 2013-08-01 2013-12-04 浙江大学 Image sequence coding and recovering method based on cloud computing platform
CN103809969A (en) * 2014-01-15 2014-05-21 中国公路工程咨询集团有限公司 Remote-sensing image data parallel resampling method based on pre-fragmentation in cloud environment
CN105426903A (en) * 2015-10-27 2016-03-23 航天恒星科技有限公司 Cloud determination method and system for remote sensing satellite images
US20160086353A1 (en) * 2014-09-24 2016-03-24 University of Maribor Method and apparatus for near-lossless compression and decompression of 3d meshes and point clouds
CN105786942A (en) * 2015-11-27 2016-07-20 武汉大学 Geographic information storage system based on cloud platform
CN105844230A (en) * 2016-03-22 2016-08-10 浙江大学 Remote sensing image segmentation method based on cloud platform
CN109558376A (en) * 2018-11-09 2019-04-02 浙江工业大学 A kind of effective calculating towards MapReduce frame and data transmission Overlapped Execution method
CN110324632A (en) * 2019-05-29 2019-10-11 西安空间无线电技术研究所 A kind of data processing and verification method based on OpenMP multi-core parallel concurrent mechanism

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103428494A (en) * 2013-08-01 2013-12-04 浙江大学 Image sequence coding and recovering method based on cloud computing platform
CN103809969A (en) * 2014-01-15 2014-05-21 中国公路工程咨询集团有限公司 Remote-sensing image data parallel resampling method based on pre-fragmentation in cloud environment
US20160086353A1 (en) * 2014-09-24 2016-03-24 University of Maribor Method and apparatus for near-lossless compression and decompression of 3d meshes and point clouds
CN105426903A (en) * 2015-10-27 2016-03-23 航天恒星科技有限公司 Cloud determination method and system for remote sensing satellite images
CN105786942A (en) * 2015-11-27 2016-07-20 武汉大学 Geographic information storage system based on cloud platform
CN105844230A (en) * 2016-03-22 2016-08-10 浙江大学 Remote sensing image segmentation method based on cloud platform
CN109558376A (en) * 2018-11-09 2019-04-02 浙江工业大学 A kind of effective calculating towards MapReduce frame and data transmission Overlapped Execution method
CN110324632A (en) * 2019-05-29 2019-10-11 西安空间无线电技术研究所 A kind of data processing and verification method based on OpenMP multi-core parallel concurrent mechanism

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111415299A (en) * 2020-03-26 2020-07-14 浙江科技学院 High-resolution image style migration method
CN111415299B (en) * 2020-03-26 2023-03-28 浙江科技学院 High-resolution image style migration method
CN111445387A (en) * 2020-06-16 2020-07-24 浙江科技学院 High-resolution image style migration method based on random rearrangement of image blocks
CN111445387B (en) * 2020-06-16 2020-10-16 浙江科技学院 High-resolution image style migration method based on random rearrangement of image blocks
CN114003755A (en) * 2021-10-25 2022-02-01 中国自然资源航空物探遥感中心 Multi-source satellite scene-separating image data organization storage and retrieval method, system and equipment
CN114003755B (en) * 2021-10-25 2022-10-11 中国自然资源航空物探遥感中心 Multi-source satellite scene-separating image data organization storage and retrieval method, system and equipment
CN115883839A (en) * 2023-03-09 2023-03-31 湖北芯擎科技有限公司 Image verification method, device and equipment and computer readable storage medium
CN116471260A (en) * 2023-06-20 2023-07-21 中国科学院空天信息创新研究院 Remote sensing satellite original data distribution and transmission device and method
CN116471260B (en) * 2023-06-20 2023-09-08 中国科学院空天信息创新研究院 Remote sensing satellite original data distribution and transmission device and method
CN116634167A (en) * 2023-07-24 2023-08-22 中国科学院空天信息创新研究院 Satellite imaging data storage and extraction method
CN116634167B (en) * 2023-07-24 2023-11-07 中国科学院空天信息创新研究院 Satellite imaging data storage and extraction method
CN116668435A (en) * 2023-08-01 2023-08-29 中国科学院空天信息创新研究院 Interactive real-time remote sensing product generation method, device and storage medium
CN116668435B (en) * 2023-08-01 2023-11-10 中国科学院空天信息创新研究院 Interactive real-time remote sensing product generation method, device and storage medium

Similar Documents

Publication Publication Date Title
CN110855638A (en) Remote sensing satellite data decompression processing system and method based on cloud computing
CN102821278A (en) Remote desktop image transmission method and remote desktop image transmission system
CN103428494A (en) Image sequence coding and recovering method based on cloud computing platform
CN107463706B (en) Hadoop-based mass wave recording data storage and analysis method and system
CN107391596B (en) Power distribution network mass data fusion method and device
CN110677402A (en) Data integration method and device based on intelligent network card
CN106815254A (en) A kind of data processing method and device
CN106375360A (en) Method, device and system for updating graph data
CN102480335A (en) Method and system for transmitting business data
CN107229749A (en) A kind of wechat H5 webpage making method and system
CN109962711A (en) A kind of data compression method, electronic equipment and storage medium
CN103209328A (en) Multi-source satellite image real-time online processing technical method and device
CN112463739A (en) Data processing method and system based on ocean mode ROMS
CN103810197A (en) Hadoop-based data processing method and system
CN112905571B (en) Train rail transit sensor data management method and device
CN107679133B (en) Mining method applicable to massive real-time PMU data
JP5549177B2 (en) Compression program, method and apparatus, and decompression program, method and apparatus
CN110851301B (en) Recovery method and system for MP4 file
CN117332134A (en) Remote sensing satellite original data processing and management method, device, equipment and medium
CN109285015A (en) A kind of distribution method and system of virtual resource
CN115114805B (en) Information interaction pair discrete simulation method of autonomous traffic system architecture
CN115525235A (en) Data operation method and system based on storage structure
CN106227857B (en) Data-pushing and loading method and device
CN104484174A (en) Processing method and processing device for compressed file with RAR (Roshal A Rchive) format
JP2006100973A (en) Data compression apparatus and data expansion apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210106

Address after: 100048 1201, block a, building 1, yard 65, Zhichun Road, Haidian District, Beijing

Applicant after: CHINA SURVEY SURVEYING AND MAPPING TECHNOLOGY Co.,Ltd.

Address before: 100094, Beijing, Yongfeng Haidian District industrial base, No. 5 East Feng Feng Road

Applicant before: CHINA CENTRE FOR RESOURCES SATELLITE DATA AND APPLICATION

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200228