CN103559000A - Quality-oriented migration method and system for big image data - Google Patents

Quality-oriented migration method and system for big image data Download PDF

Info

Publication number
CN103559000A
CN103559000A CN201310586825.1A CN201310586825A CN103559000A CN 103559000 A CN103559000 A CN 103559000A CN 201310586825 A CN201310586825 A CN 201310586825A CN 103559000 A CN103559000 A CN 103559000A
Authority
CN
China
Prior art keywords
image data
grade
product
quality
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310586825.1A
Other languages
Chinese (zh)
Other versions
CN103559000B (en
Inventor
宗雪
高龙
周俭
李亮
刘阳成
刘晓蕊
高宝华
叶宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CETC 15 Research Institute
Original Assignee
CETC 15 Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CETC 15 Research Institute filed Critical CETC 15 Research Institute
Priority to CN201310586825.1A priority Critical patent/CN103559000B/en
Publication of CN103559000A publication Critical patent/CN103559000A/en
Application granted granted Critical
Publication of CN103559000B publication Critical patent/CN103559000B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Processing (AREA)

Abstract

The invention provides a quality-oriented migration method and system for big image data. The method comprises the steps as follows: a plurality of image data are saved in a shared memory area; a shooting quality grade is determined according to shooting quality of each image datum, and at the same time, product processing grades are determined according to processing processes of the image data; image data with the shooting quality grades and the product processing grades meeting requirements of threshold values simultaneously are stored in a working memory area; in the working memory area, optimal image data are selected and stored in a product memory area; in the product memory area, the optimal image data are selected and stored; and the image data in the product memory area are used for providing access. The invention provides the quality-oriented migration system for the big image data. For the big data, the processing efficiency during each processing operation is improved.

Description

A kind of magnanimity image data moving method and system towards quality
Technical field
The present invention relates to field of data migration, in particular to a kind of magnanimity image data moving method and system towards quality.
Background technology
Mass data also can be described as large data (Big data), when the mass data processing in the face of such, conventionally needs a lot of platform computing machines to work simultaneously, far beyond user, in the acceptable time, mass data is being operated.
For example: the history image that camera is taken, the image that remote sensing satellite is taken etc., these data are along with the accumulation of time, can there are the data of repeating data or some inefficacies, in these data, some data are not all transferred in each access, and some data may be because of undesirable and never accessed.Depositing of these image datas, in follow-up processing, efficiency is very low.
Summary of the invention
The present invention aims to provide a kind of magnanimity image data moving method towards quality, slow to solve above-mentioned mass data access speed, the problem that treatment effeciency is low.
The invention provides a kind of magnanimity image data moving method towards quality, comprising: a plurality of image datas are kept to shared memory; By the shooting quality of each image data, determine its photographic quality grade, by the processing procedure of image data, determine its product treatment grade simultaneously; The image data of selecting described photographic quality grade and described product treatment grade simultaneously to meet threshold value is stored to working storage; In described working storage, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, select optimum image data, be stored to product memory block; In described product memory block, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, select and preserve optimum image data; Use the image data in described product memory block, access is provided.
Preferably, will not meet the image data of threshold value or non-optimum, be stored to offline storage district.
Preferably, according to the memory capacity of the time interval or each memory block, trigger the operation of described selection image data.
Preferably, also comprise: before the current image data of operation, by setting up the label of corresponding described current image data, prevent operating collision.
Preferably, the described label of setting up corresponding described current image data prevents that operating collision from comprising: before the current image data of operation, judge under its place catalogue whether have empty file of the same name; If there is shut-down operation; If there is no, create the empty file of the same name with it, and operate this image data; After EO, delete the empty file described of the same name creating.
Preferably, the described shooting quality by each image data determines that its photographic quality grade comprises: access each image data as the attribute of shooting quality, it is one of following that described attribute at least comprises: resolution, size, pixel quantity, color, tone, saturation degree, contrast and brightness; According between the attribute area of setting with the corresponding relation of photographic quality grade, determine the photographic quality grade of each image data; The described processing procedure by image data determines that its product treatment grade comprises: determine the operation of described processing procedure, it is one of following that described operation comprises: image conversion, encoding and decoding, enhancing, restore, cut apart, the running time; According to the quantity of operation and the corresponding relation of product treatment grade set, determine the product treatment grade of each image data.
Embodiments of the invention also provide a kind of magnanimity image data migratory system towards quality, comprising: share module for reading and writing, for a plurality of image datas are kept to shared memory; Grade module for determine its photographic quality grade by the shooting quality of each image data, is determined its product treatment grade by the processing procedure of image data simultaneously; Work memory module, is stored to working storage for the image data of selecting described photographic quality grade and described product treatment grade to meet threshold value simultaneously; Workspace screening module, in described working storage, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, selects optimum image data, is stored to product memory block; Product zone screening module, in described product memory block, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, selects and preserves optimum image data; Output module, for using the image data of described product memory block, provides access.
Preferably, also comprise: offline storage module, for not meeting the image data of threshold value or non-optimum, is stored to offline storage district.
Preferably, also comprise, trigger module, for triggering the operation of described selection image data according to the memory capacity of the time interval or each memory block.
Preferably, also comprise: anti-collision module, for before the current image data of operation, prevents operating collision by setting up the label of corresponding described current image data.
By above-mentioned steps, according to the product treatment grade of image and shooting quality grade, the image of mass data is constantly screened, thereby obtain the most applicable image that service is provided, solved in prior art, in the face of mass data, each processing while operating, inefficient problem.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, forms the application's a part, and schematic description and description of the present invention is used for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 shows the process flow diagram of embodiment;
Fig. 2 shows the process flow diagram of another embodiment;
Fig. 3 shows towards the system assumption diagram of the magnanimity image data migration of quality;
It is the overview flow chart towards the magnanimity image data migration of quality that Fig. 4 shows;
Fig. 5 shows the module rack composition of system embodiment.
Embodiment
Below with reference to the accompanying drawings and in conjunction with the embodiments, describe the present invention in detail.
S11: a plurality of image datas are kept to shared memory;
S12: determine its photographic quality grade by the shooting quality of each image data, determine its product treatment grade by the processing procedure of image data simultaneously;
S13: the image data of selecting described photographic quality grade and described product treatment grade simultaneously to meet threshold value is stored to working storage;
S14: in described working storage, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, select optimum image data, be stored to product memory block;
S15: in described product memory block, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, select and preserve optimum image data;
S16: use the image data in described product memory block, access is provided.
By above-mentioned steps, according to the product treatment grade of image and shooting quality grade, the image of mass data is constantly screened, thereby obtain the most applicable image that service is provided, solved in prior art, in the face of mass data, each processing while operating, inefficient problem.
Method of the present invention, according to following 3 aspect examination images:
(1) by quality preliminary screening: judge photographic quality grade and product treatment grade according to two-dimentional quality factor (photographic quality grade and product treatment grade), abandon the problematic data of quality, quality grade is poor especially, substantially can not provide the data of service directly migrate to offline storage or directly delete.
(2) select in mass ratio excellent: (photographic quality grade or product treatment grade) mass ratio at the same level selects excellent, and the data of like products grade, filter out the data that quality grade is high service is provided, by the low Data Migration of quality grade to offline storage.
(3) by quality selected deposit excellent: from photographic quality grade, these two dimensions of product treatment grade, carry out that quality is selected deposits excellently,, when there is many parts of image datas of homogeneous photography, the rudimentary image data of homogeneous photography moved in offline storage; When there being the image data of more than 2 parts same data type, retain the higher data of quality scale; When quality scale is identical, preserve the nearer data of photography time.
Below by a detailed embodiment, concrete transition process is described, method of the present invention is repeatedly screened mass data, with remote sensing satellite data instance, the remote sensing images of taking for same target, need to take repeatedly, can form mass data like this, such as map, atmosphere, starry sky etc., in use, data volume is larger for these view data, if adopt method of the present invention, can improve the treatment effeciency in use procedure.The process of processing by method of the present invention, referring to Fig. 2, comprising:
S21: in shared memory, the grade of judgement image data;
Photographic quality grade is to produce qualitative attribute during according to Aerial Photography, and the quality of image is carried out to classification judgement; Access each image data as the attribute of shooting quality, it is one of following that described attribute at least comprises: resolution, size, pixel quantity, color, tone, saturation degree, contrast and brightness; Also can comprise shelter (cloud amount etc.), pixel integrality (error code etc.) etc.;
According between the attribute area of setting with the corresponding relation of photographic quality grade, determine the photographic quality grade of each image data; The quality of data that quality of data specific mass grade that quality grade is high is low is good;
The described processing procedure by image data determines that its product treatment grade comprises:
Determine the operation of described processing procedure, it is one of following that described operation comprises: image conversion, encoding and decoding, enhancing, restore, cut apart, the running time;
According to the quantity of operation and the corresponding relation of product treatment grade set, determine the product treatment grade of each image data.
Above-mentioned these grades, can set voluntarily according to the user demand of data, if need the output image of better effects, and parameter corresponding to adjustable height grade.
Shared memory is for depositing the primary data without any judgement that external system deposits in.Working storage is used for depositing through preliminary sieve to be chosen, and meets ageing requirement, enters in the recent period the data of system.Lasting memory block is for depositing data top-quality, high level, demand for services amount maximum.The data that offline storage district is poor especially by off-line media storage quality, be not used in service substantially.This structure dependence Data Transference Technology is carried out ensure quality, and good high priority data is stored on the storage medium that service ability is strong.So just greatly improve data acquisition service efficiency.
S22: judge whether to meet according to the product treatment grade after pickup quality grade and image processing, if met, carry out S23, if do not met, carry out S27, image data is stored to offline storage district.
The image data of selecting described photographic quality grade and described product treatment grade simultaneously to meet threshold value is stored to working storage;
The preliminary sieve of data is chosen the data in shared memory is carried out to anticipation, quality is poor especially, substantially can not directly migrate to offline storage for the data of serving, simultaneously by other Data Migrations in working storage.
S23: the image data that satisfy hierarchy is required stores working storage into.
S24: in working storage, image data at the same level is compared; According to comparative result, carry out S25, select optimum image data and store product memory block into; Or S27;
In described working storage, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, select optimum image data, be stored to product memory block;
For example, for the image data of satellite or monitoring, may be at synchronization, there are many parts of a plurality of images of repeatedly same target being taken, can select optimum image data according to according to shooting time, photographic quality grade and product quality grade, be stored to product memory block;
S25: be stored to product memory block by selecting optimum image data;
Data are relatively selected excellent in the grade comparison rule in sequential or S24, select image data high-grade or that the time is nearest, data are moved to product memory block from working storage, in this process, if have Data Migration that product hierarchy is high to product memory block, rudimentary product corresponding in product memory block is moved in offline storage.
S26: judge whether to have optimum image data in product memory block, if had, carry out S25, otherwise carry out S27.
Data are selected deposits excellent to be that the data in product memory block are carried out to selected arrangement, to retain the data of photographic quality grade and product treatment grade optimum so that service to be provided lastingly.In the situation of the term harmonizations such as image geographic range, when there is many parts of image datas of homogeneous photography, identical photographic quality grade, moves to the product treatment grade image data of homogeneous photography in offline storage; When there is the image data of 2 parts of (containing) above same data type, identical product quality grade, retains higher grade of photographic quality data.Certainly also can two grade colleagues consider, also can only compare one.
By above implementation step, utilization is towards the magnanimity image data moving method of quality, can realize one towards the mass data migratory system of quality, solve current existing magnanimity image data life cycle management problem, improve the use value of services of audio and video products data.
In above-mentioned each memory block, when image data is operated, possible this image data is taken by other processes, as access, copy, shearing etc., for avoiding operating collision, before the current image data of operation, by setting up the label of corresponding described current image data, prevent operating collision.
Comprise:
Before the current image data of operation, judge under its place catalogue whether have empty file of the same name;
If there is shut-down operation;
If there is no, create the empty file of the same name with it, and operate this image data; After EO, delete the empty file described of the same name creating.
Because data all relate to the deletion action of data on original memory location in the migration between each memory block, therefore may with other data access person, such as data output etc., produce access conflict.Design a set of transparent Data Migration access isolating interface.This interface is mainly to carry out the access of isolating exterior service processes to the data file of moving by data product being labelled, deleted the mode of label, the error in data that may cause while avoiding other data access person simultaneously same data file to be carried out to read access operations.
Labelling is under the catalogue with data file peer, creates an empty file, and its title starts with data file name.Deleting label is exactly to delete the empty file creating while labelling before.When Data Migration service prepares a data file to carry out migration operation, first judge that whether this data file has been stamped label by other data accesses person, if this document is not stamped label, carries out migration operation; If stamped label, show to have background process using this data file, Data Migration just wouldn't carry out migration operation to this data file, treats when moving, to repeat next time aforesaid operations again.
Based on above logical design, realizing access interface provides each data access person to use, and guarantees to come each visitor transparent to data access, does not produce each other conflict.
Preferably, the migration operation process of above-mentioned each memory block, and non real-time carrying out, trigger the operation of described selection image data according to the memory capacity of the time interval or each memory block.Comprise:
The generation of migration task has two kinds of modes, and a kind of is to trigger by time control, and a kind of is to trigger by space management.Time control is set flip-flop as required, and capture trigger message, at special time, triggers migration task, and triggering message is issued to task control module.Space management carries out monitoring analysis to each disk array memory capacity, when the alarm of residue memory capacity, disk space information is issued to task control module, produces migration task.
Migration task control
Task control, after receiving message, builds migration task queue, the concurrent execution of scheduling migration task, and migration tasks carrying process is controlled.According to the message of receiving, data dispatching is just chosen task (screen shared memory to working storage) respectively, data are selected the migration tasks such as excellent task (screening of working storage to product memory block) and the selected task of data (product memory block self screening) in task control meeting.
For example, be about to carry out just choose task, and the memory capacity of product memory block is full, the selected priority of data is heightened, and carries out selected task.
Describe the workflow of the inventive method above in detail, the process of the workflow of the inventive method, also can be referring to the schematic diagram shown in Fig. 3, Fig. 4,
Fig. 3 is system assumption diagram of the present invention, and system comprises that magnanimity image data hierarchical storage management structure, Data Migration are controlled, Data Migration is processed and Data Migration access isolating interface.
Fig. 4 is the framework flow process of integral system of the present invention.
The present invention also provides a kind of magnanimity image data migratory system towards quality, comprising:
Shared region module for reading and writing, for being kept at shared memory by a plurality of image datas;
Grade module for determine its photographic quality grade by the shooting quality of each image data, is determined its product treatment grade by the processing procedure of image data simultaneously;
Workspace memory module, is stored to working storage for the image data of selecting described photographic quality grade and described product treatment grade to meet threshold value simultaneously;
Workspace screening module, in described working storage, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, selects optimum image data, is stored to product memory block;
Product zone screening module, in described product memory block, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, selects and preserves optimum image data;
Output module, for using the image data of described product memory block, provides access.
Preferably, also comprise: offline storage module, for not meeting the image data of threshold value or non-optimum, is stored to offline storage district.
Preferably, also comprise, trigger module, for triggering the operation of described selection image data according to the memory capacity of the time interval or each memory block.
Preferably, also comprise: anti-collision module, for before the current image data of operation, prevents operating collision by setting up the label of corresponding described current image data.
Obviously, those skilled in the art should be understood that, above-mentioned each module of the present invention or each step can realize with general calculation element, they can concentrate on single calculation element, or be distributed on the network that a plurality of calculation elements form, alternatively, they can be realized with the executable program code of calculation element, thereby, they can be stored in memory storage and be carried out by calculation element, or they are made into respectively to each integrated circuit modules, or a plurality of modules in them or step are made into single integrated circuit module to be realized.Like this, the present invention is not restricted to any specific hardware and software combination.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.

Claims (10)

1. towards a magnanimity image data moving method for quality, it is characterized in that, comprising:
A plurality of image datas are kept to shared memory;
By the shooting quality of each image data, determine its photographic quality grade, by the processing procedure of image data, determine its product treatment grade simultaneously;
The image data of selecting described photographic quality grade and described product treatment grade simultaneously to meet threshold value is stored to working storage;
In described working storage, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, select optimum image data, be stored to product memory block;
In described product memory block, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, select and preserve optimum image data;
Use the image data in described product memory block, access is provided.
2. method according to claim 1, is characterized in that, will not meet the image data of threshold value or non-optimum, is stored to offline storage district.
3. method according to claim 1, is characterized in that, triggers the operation of described selection image data according to the memory capacity of the time interval or each memory block.
4. method according to claim 1, is characterized in that, also comprises: before the current image data of operation, by setting up the label of corresponding described current image data, prevent operating collision.
5. method according to claim 4, is characterized in that, the described label of setting up corresponding described current image data prevents that operating collision from comprising:
Before the current image data of operation, judge under its place catalogue whether have empty file of the same name;
If there is shut-down operation;
If there is no, create the empty file of the same name with it, and operate this image data; After EO, delete the empty file described of the same name creating.
6. method according to claim 1, is characterized in that, the described shooting quality by each image data determines that its photographic quality grade comprises:
Access each image data as the attribute of shooting quality, it is one of following that described attribute at least comprises: resolution, size, pixel quantity, color, tone, saturation degree, contrast and brightness;
According between the attribute area of setting with the corresponding relation of photographic quality grade, determine the photographic quality grade of each image data;
The described processing procedure by image data determines that its product treatment grade comprises:
Determine the operation of described processing procedure, it is one of following that described operation comprises: image conversion, encoding and decoding, enhancing, restore, cut apart, the running time;
According to the quantity of operation and the corresponding relation of product treatment grade set, determine the product treatment grade of each image data.
7. towards a magnanimity image data migratory system for quality, it is characterized in that, comprising:
Share module for reading and writing, for a plurality of image datas are kept to shared memory;
Grade module for determine its photographic quality grade by the shooting quality of each image data, is determined its product treatment grade by the processing procedure of image data simultaneously;
Work memory module, is stored to working storage for the image data of selecting described photographic quality grade and described product treatment grade to meet threshold value simultaneously;
Workspace screening module, in described working storage, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, selects optimum image data, is stored to product memory block;
Product zone screening module, in described product memory block, if same target exists a plurality of image datas of repeatedly taking, according to shooting time, photographic quality grade and product quality grade, selects and preserves optimum image data;
Output module, for using the image data of described product memory block, provides access.
8. system according to claim 7, is characterized in that, also comprises: offline storage module, for not meeting the image data of threshold value or non-optimum, is stored to offline storage district.
9. system according to claim 7, is characterized in that, also comprises, trigger module, for triggering the operation of described selection image data according to the memory capacity of the time interval or each memory block.
10. method according to claim 7, is characterized in that, also comprises: anti-collision module, for before the current image data of operation, prevents operating collision by setting up the label of corresponding described current image data.
CN201310586825.1A 2013-11-21 2013-11-21 A kind of massive image data moving method towards quality and system Active CN103559000B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310586825.1A CN103559000B (en) 2013-11-21 2013-11-21 A kind of massive image data moving method towards quality and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310586825.1A CN103559000B (en) 2013-11-21 2013-11-21 A kind of massive image data moving method towards quality and system

Publications (2)

Publication Number Publication Date
CN103559000A true CN103559000A (en) 2014-02-05
CN103559000B CN103559000B (en) 2016-03-09

Family

ID=50013260

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310586825.1A Active CN103559000B (en) 2013-11-21 2013-11-21 A kind of massive image data moving method towards quality and system

Country Status (1)

Country Link
CN (1) CN103559000B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019205036A1 (en) * 2018-04-25 2019-10-31 深圳市大疆创新科技有限公司 Data processing method and apparatus
WO2020057351A1 (en) * 2018-09-21 2020-03-26 深圳市九洲电器有限公司 Secured data uploading method and device, and client
CN111797089A (en) * 2019-04-09 2020-10-20 Oppo广东移动通信有限公司 Data writing method and device, storage medium and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11355537A (en) * 1998-06-08 1999-12-24 Nec Corp Image distributing device
US20050147310A1 (en) * 2002-03-14 2005-07-07 Microsoft Corporation Distributing limited storage among a collection of media objects
CN101059949A (en) * 2007-04-03 2007-10-24 广东威创日新电子有限公司 Mass image data compression, storage and display method
CN101339570A (en) * 2008-08-12 2009-01-07 北京航空航天大学 Efficient distributed organization and management method for mass remote sensing data
CN102012932A (en) * 2010-12-01 2011-04-13 北京建筑工程学院 Method and device for storing and retrieving measurable streetscape images

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11355537A (en) * 1998-06-08 1999-12-24 Nec Corp Image distributing device
US20050147310A1 (en) * 2002-03-14 2005-07-07 Microsoft Corporation Distributing limited storage among a collection of media objects
CN101059949A (en) * 2007-04-03 2007-10-24 广东威创日新电子有限公司 Mass image data compression, storage and display method
CN101339570A (en) * 2008-08-12 2009-01-07 北京航空航天大学 Efficient distributed organization and management method for mass remote sensing data
CN102012932A (en) * 2010-12-01 2011-04-13 北京建筑工程学院 Method and device for storing and retrieving measurable streetscape images

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
邓雪清,罗睿,李学友: "遥感图像海量存储系统的设计与分析", 《遥感信息》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019205036A1 (en) * 2018-04-25 2019-10-31 深圳市大疆创新科技有限公司 Data processing method and apparatus
WO2020057351A1 (en) * 2018-09-21 2020-03-26 深圳市九洲电器有限公司 Secured data uploading method and device, and client
CN111797089A (en) * 2019-04-09 2020-10-20 Oppo广东移动通信有限公司 Data writing method and device, storage medium and electronic equipment

Also Published As

Publication number Publication date
CN103559000B (en) 2016-03-09

Similar Documents

Publication Publication Date Title
CN102014282B (en) Distributed video transcoding scheduling method and system
CN106453572B (en) Method and system based on Cloud Server synchronous images
CN104063835A (en) Real-time parallel processing system and real-time parallel processing method for satellite remote sensing images
US9836516B2 (en) Parallel scanners for log based replication
CN113761609B (en) Cloud architecture CAD platform real-time rendering system and method based on server side
CN111666157B (en) Rapid processing method and system for geographic space image data
CN111399764B (en) Data storage method, data reading device, data storage equipment and data storage medium
CN105183768A (en) File management method, apparatus and terminal device
CN103559000B (en) A kind of massive image data moving method towards quality and system
CN103957240A (en) Weather system capable of shooting pictures in real time and conducting sharing and implementation method of weather system capable of shooting pictures in real time and conducting sharing
CN105550181A (en) File classification storage method and apparatus and terminal
CN108491445A (en) The methods of exhibiting and system of achievement data in region
CN103761262A (en) Repetition log control method based on syslogd
CN110705891A (en) Data processing method based on high-allocable changeability
CN112069127A (en) Backup method and system for CephFS file system
CN115033646A (en) Method for constructing real-time warehouse system based on Flink and Doris
CN109165210A (en) A kind of method and device of cluster Hbase Data Migration
US20210233280A1 (en) Encoding device control method and device, and storage medium
CN110109751B (en) Distribution method and device of distributed graph cutting tasks and distributed graph cutting system
WO2023219559A2 (en) Method, device and system for processing spatial data
CN116450753A (en) Customs service data structured management method and device, computer equipment group and storage medium
CN115797170A (en) High-performance service image tile splicing method and device and electronic equipment
CN115858486A (en) Data processing method and related equipment
CN106919574A (en) A kind of method of real-time processing remote synchronization file
CN116028574A (en) Government full life cycle big data management system and method thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant