CN109359100A - The visual modeling method of PB grades of historical datas and online data calculated in real time - Google Patents
The visual modeling method of PB grades of historical datas and online data calculated in real time Download PDFInfo
- Publication number
- CN109359100A CN109359100A CN201811141130.1A CN201811141130A CN109359100A CN 109359100 A CN109359100 A CN 109359100A CN 201811141130 A CN201811141130 A CN 201811141130A CN 109359100 A CN109359100 A CN 109359100A
- Authority
- CN
- China
- Prior art keywords
- subtask
- data
- time
- task
- calculating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses the visual modeling methods of a kind of PB grades of historical data and online data calculated in real time, comprising: real-time calculating task is divided into multiple subtasks；Obtain the parameter optimization data and calculating progress of each subtask；The parameter optimization data of each subtask and calculating progress are shown in the form of event time table, obtain the visual modeling result of PB grades of historical datas and online data calculated in real time.
Description
Technical field
The present invention relates to data processing field, in particular to a kind of PB grades of historical data and online data calculate in real time
Visual modeling method.
Background technique
Currently, in PB grades of historical datas and the real-time calculation processes of online data, since user is often passive
Receive the data calculated in real time, it is difficult to the processing progress of data is got information about, thus the inconvenient processing progress according to data
Carry out reasonable data processing task arrangement.
Summary of the invention
In order to solve the above problem, the present invention provides the visualization of a kind of PB grades of historical data and online data calculated in real time
Modeling method.
The visual modeling method of a kind of PB grades of historical datas and online data provided by the invention calculated in real time, packet
It includes:
Real-time calculating task is divided into multiple subtasks；
Obtain the parameter optimization data and calculating progress of each subtask；
The parameter optimization data of each subtask and calculating progress are shown in the form of event time table, are obtained
To the visual modeling result of PB grades of historical datas and online data calculated in real time.
Preferably, the parameter optimization data of the subtask and calculating progress, comprising:
The optimization write time of subtask, the task unserializing time, executes the calculating time, result at optimization read access time
It serializes the time, obtain the result time and task schedule delay.
Preferably, the parameter optimization data of the subtask and calculating progress, further includes:
The state of subtask, the state include that task dispatching waits for, in task execution and task completion status, the task
Completion status includes that mission failure, suspension of task and task normally complete；
The occupied resource in subtask, including occupied memory size, disk size, processor quantity；
Complete the time used in subtask.
Preferably, the visual modeling method of the PB grades of historical data and online data calculated in real time, further includes:
The statistical result of the state of subtask is shown in the form of event time table, the state of the subtask
Statistical result includes total task number, number of tasks in execution, waiting number of tasks, completed number of tasks, the task of failure
Number, the number of tasks stopped and the number of tasks normally completed.
Preferably, the calculating progress of subtask is obtained, specifically:
Obtain processed data volume in subtask；
Obtain total data volume to be dealt in subtask；
The calculating progress of subtask is obtained divided by total data volume with the processed data volume；
Or,
Obtain subtask it is processed at data processing step；
Obtain total data processing step to be dealt with of subtask；
By it is described it is processed at data processing step obtained in terms of subtask divided by total data processing step
Degree of adding.
Preferably, the calculating progress of subtask is obtained, specifically:
It obtains in similar subtask processed data volume under different disposal ability and handles processed data institute's used time
Between account for the accounting of subtask total processing time；
Obtain processed data volume in current subtask；
Obtain the processing capacity of current subtask；
Using the processing capacity as interpolation parameter, the processing capacity of current subtask has been located under different disposal ability
Interpolation is carried out in the function for the accounting that time used in the data volume and the processed data of processing of reason accounts for subtask total processing time；
The calculating progress of subtask is obtained according to processed data volume in interpolation result and current subtask.
Some beneficial effects of the invention may include:
The visual modeling method of a kind of PB grades of historical datas and online data provided by the invention calculated in real time, passes through
The real-time calculating progress of data is visualized in a manner of event time table, allows users to more intuitive basis
The processing progress of data carries out reasonable data processing task arrangement.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention can be by written explanation
Specifically noted structure is achieved and obtained in book, claims and attached drawing.
Below by drawings and examples, technical scheme of the present invention will be described in further detail.
Detailed description of the invention
Attached drawing is used to provide further understanding of the present invention, and constitutes part of specification, with reality of the invention
It applies example to be used to explain the present invention together, not be construed as limiting the invention.In the accompanying drawings:
Fig. 1 is a kind of visual modeling side of PB grades of historical data and online data calculated in real time in the embodiment of the present invention
The flow chart of method.
Specific embodiment
Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings, it should be understood that preferred reality described herein
Apply example only for the purpose of illustrating and explaining the present invention and is not intended to limit the present invention.
Fig. 1 is a kind of visual modeling side of PB grades of historical data and online data calculated in real time in the embodiment of the present invention
The flow chart of method.As shown in Figure 1, comprising:
Step S101, real-time calculating task is divided into multiple subtasks；
Step S102, the parameter optimization data of each subtask are obtained and calculate progress；
Step S103, by the parameter optimization data of each subtask and calculate progress in the form of event time table into
Row display, obtains the visual modeling result of PB grades of historical datas and online data calculated in real time.
The visual modeling method of a kind of PB grades of historical datas and online data provided by the invention calculated in real time, passes through
The real-time calculating progress of data is visualized in a manner of event time table, allows users to more intuitive basis
The processing progress of data carries out reasonable data processing task arrangement.
In order to obtain PB grades of historical datas faster, to complete the real-time of PB grades of historical datas and online data faster
The visual modeling of calculating is as a result, in one embodiment of the invention, the historical data is stored in cloud storage system, institute
Stating cloud storage system includes: main control server, storage server cluster and client, they carry out data by internal switch
Exchange；Main control server is used to provide directory information and metadata information to cloud storage client, and to storage server cluster
It is monitored, the directory information includes the path of the catalogue, date created, directory attribute；Metadata information includes this document
Path, creation/modification date, file attribute, file size, place primary storage server and backup storage server IP
Location, port numbers and corresponding GUID；Storage server cluster includes the more storage servers for data storage, it is equipped with
AC-RU caching, saves several file handles opened recently；Client is used to provide cloud storage client computer virtual disk clothes
Operation requests of the cloud storage client computer to virtual disk are submitted to main control server by business, and from storage server read/write
File data, the client modules are deployed in cloud storage client computer, and it is slow that it is equipped with adjusting controllable cache, that is, AC-RU
It deposits, saves the directory information of recent visit and the metadata information of file.
The storage method of the historical data are as follows:
Storage server cluster is established using more storage servers, periodically to master control after each storage server starting
Server sends heartbeat message, includes the current state of the storage server in heartbeat message；It is set in the memory of main control server
There is a logical node list for corresponding to multiple storage servers, when main control server receives the heartbeat report of each storage server
Wen Hou updates the logical node for corresponding to each storage server in list；
When client accesses any catalogue under virtual disk, cloud storage client is initiated to request to main control server, obtains
Subdirectory information and file metadata information under requested catalogue are taken, and subdirectory information obtained and file metadata are believed
Breath is stored in customer end A C-RU caching；
Cloud storage client request creates the operation of file or catalogue, wherein；When cloud storage client has creation file
When request, which is submitted to main control server by client, and whether the catalogue where main control server inspection creation file deposits
, if it does not exist, then the reply that Returning catalogue is not present；If it exists, then GUID is distributed for this document, from online storage service device
In select light load two primary storage servers as this document and backup storage server, and notify this two store
Server creates the file of entitled GUID, and two storage servers, which all create, successfully then to be returned creation successful time to client
It is multiple；When cloud storage client has the request to create directory, which is submitted to main control server, main control server by client
It checks that the parent directory of newly-built catalogue whether there is, if it does not exist, then returns to the reply that parent directory is not present；If it exists, then it establishes
New directory node, and be added in the subdirectory list of parent directory node, and return to creation to client and successfully reply；
Cloud storage client request reads file, written document, deletes file, duplication/movement file or Rename file operation,
Wherein: when cloud storage client request reads file, searching first number of this document from the AC-RU of cloud storage client caching first
It is believed that breath finds corresponding primary storage server by the metadata information of file if metadata information exists in caching, and
Specific a certain section of the data of reading this document are requested primary storage server；It is first if metadata information is not present in caching
Metadata request first is sent to main control server, and customer end A C-RU is added in the metadata information obtained from main control server
In caching；When cloud storage client request written document, the member of this document is searched from the AC-RU of cloud storage client caching first
Data information, if metadata information exists in caching, cloud storage client is found corresponding by the metadata information of file
Primary storage server and backup storage server, and to specific a certain section of the data of their request write-in this documents, wait main memories
It stores up server and backup storage server all returns after writing successfully response, secondary write operation success, otherwise it is assumed that writing failure；If
Metadata information is not present in caching, then sends metadata request to main control server first, and will obtain from main control server
Metadata information be added customer end A C-RU caching in；When cloud storage client request deletes file, first to main control server
File deletion requests are sent, main control server finds the specific master file for saving this document according to the metadata information of this document and deposits
Server and backup document storage server are stored up, and the metadata information is deleted from bibliographic structure, while is objective to cloud storage
Family end, which returns, deletes successfully response, and then main control server will notify the primary storage server and backup storage service of this document
Device deletes this document, and two storage servers execute file delete operation after the file for receiving main control server deletes instruction；
It is creation/read/write/deletion file operation combination that cloud storage client request, which replicates/move file operation,；Rename file is
File metadata information under bibliographic structure is modified in main control server；
Cloud storage client request deltrees operation, in which: when cloud storage client request deltrees, first looks at
With the presence or absence of the information for being deleted catalogue in customer end A C-RU caching, and if so, being removed from the cache, then to master control
Server sends directory delete request；If it does not exist, then directly sending directory delete request, master control service to main control server
Device traverses its subdirectory list and listed files after receiving directory delete request, recursively delete under the catalogue all subdirectories and
File, finally by the directory delete；During recurrence is deleted, when certain subdirectory is the leaf node in bibliographic structure, then directly delete
It removes, recurrence otherwise occurs and deletes process；
The read method of the historical data are as follows:
Initial data is obtained from raw data base, and subregion is carried out to the initial data according to preset rules；
B-tree indexed is established according to zoning ordinance；
It is stored according to data column type, the time range of data subregion and the data column in deposit data subregion successive
Sequence establishes column index；
Data block in the data subregion is split into multiple data sub-blocks, the data sub-block is numbered, often
The corresponding 1 data major key of a data sub-block, and the column data of the data major key is stored in corresponding number according to the column index
According in sub-block；
It is true by b-tree indexed according to the time range in the solicited message when receiving data retrieval request information
Data subregion where fixed data to be extracted, and determine the offset starting position in data subregion column and offset end position,
The initial position of each relatively described data sub-block of column, and root are determined by column index according to the column information in the solicited message
The initial position for determining the data major key is numbered according to the corresponding data sub-block of data major key in the solicited message；
According to the offset starting position in the initial position of data major key, the initial position of data sub-block, data subregion column
Data are extracted with offset end position；
Before carrying out subregion to the initial data according to preset rules, the initial data of acquisition is filled
Processing, so that filling treated data and time point alignment.
It is in one embodiment of the invention, described in order to more fully understand the processing time of subtask different phase
The parameter optimization data and calculating progress of subtask, comprising:
The optimization write time of subtask, the task unserializing time, executes the calculating time, result at optimization read access time
It serializes the time, obtain the result time and task schedule delay.
It is in one embodiment of the invention, described in order to more fully understand the processing status of subtask different phase
The parameter optimization data and calculating progress of subtask, further includes:
The state of subtask, the state include that task dispatching waits for, in task execution and task completion status, the task
Completion status includes that mission failure, suspension of task and task normally complete；
The occupied resource in subtask, including occupied memory size, disk size, processor quantity；
Complete the time used in subtask.
For the processing status of more fully entire task, in one embodiment of the invention, the PB grades of history number
According to the visual modeling method calculated in real time with online data, further includes:
The statistical result of the state of subtask is shown in the form of event time table, the state of the subtask
Statistical result includes total task number, number of tasks in execution, waiting number of tasks, completed number of tasks, the task of failure
Number, the number of tasks stopped and the number of tasks normally completed.
For the calculating progress of quick obtaining subtask, in one embodiment of the invention, the calculating of subtask is obtained
Progress, specifically:
Obtain processed data volume in subtask；
Obtain total data volume to be dealt in subtask；
The calculating progress of subtask is obtained divided by total data volume with the processed data volume；
Or,
Obtain subtask it is processed at data processing step；
Obtain total data processing step to be dealt with of subtask；
By it is described it is processed at data processing step obtained in terms of subtask divided by total data processing step
Degree of adding.
In order to accurately obtain the calculating progress of subtask, in one embodiment of the invention, the meter of subtask is obtained
Degree of adding, specifically:
It obtains in similar subtask processed data volume under different disposal ability and handles processed data institute's used time
Between account for the accounting of subtask total processing time；
Obtain processed data volume in current subtask；
Obtain the processing capacity of current subtask；
Using the processing capacity as interpolation parameter, the processing capacity of current subtask has been located under different disposal ability
Interpolation is carried out in the function for the accounting that time used in the data volume and the processed data of processing of reason accounts for subtask total processing time；
The calculating progress of subtask is obtained according to processed data volume in interpolation result and current subtask.
The visual modeling method of a kind of PB grades of historical datas and online data provided by the invention calculated in real time, passes through
The real-time calculating progress of data is visualized in a manner of event time table, allows users to more intuitive basis
The processing progress of data carries out reasonable data processing task arrangement.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The shape for the computer program product implemented in usable storage medium (including but not limited to magnetic disk storage and optical memory etc.)
Formula.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (6)
1. the visual modeling method of a kind of PB grades of historical data and online data calculated in real time characterized by comprising
Real-time calculating task is divided into multiple subtasks；
Obtain the parameter optimization data and calculating progress of each subtask；
The parameter optimization data of each subtask and calculating progress are shown in the form of event time table, obtain PB
The visual modeling result of grade historical data and online data calculated in real time.
2. the method as described in claim 1, which is characterized in that the parameter optimization data and calculating progress of the subtask, packet
It includes:
The optimization write time of subtask, the task unserializing time, executes the calculating time, result sequence at optimization read access time
Change the time, obtain the result time and task schedule delay.
3. the method as described in claim 1, which is characterized in that the parameter optimization data and calculating progress of the subtask, also
Include:
The state of subtask, the state include that task dispatching waits for, in task execution and task completion status, and the task is completed
State includes that mission failure, suspension of task and task normally complete；
The occupied resource in subtask, including occupied memory size, disk size, processor quantity；
Complete the time used in subtask.
4. the method as described in claim 1, which is characterized in that further include:
The statistical result of the state of subtask is shown in the form of event time table, the statistics of the state of the subtask
As a result include total task number, number of tasks in execution, waiting number of tasks, completed number of tasks, failure number of tasks, in
Number of tasks only and the number of tasks normally completed.
5. the method as described in claim 1, which is characterized in that the calculating progress of subtask is obtained, specifically:
Obtain processed data volume in subtask；
Obtain total data volume to be dealt in subtask；
The calculating progress of subtask is obtained divided by total data volume with the processed data volume；
Or,
Obtain subtask it is processed at data processing step；
Obtain total data processing step to be dealt with of subtask；
With it is described it is processed at data processing step divided by total data processing step obtain the calculating of subtask into
Degree.
6. the method as described in claim 1, which is characterized in that the calculating progress of subtask is obtained, specifically:
It obtains in similar subtask under different disposal ability processed data volume and handles the time used in processed data and account for
The accounting of subtask total processing time；
Obtain processed data volume in current subtask；
Obtain the processing capacity of current subtask；
It is using the processing capacity as interpolation parameter, the processing capacity of current subtask is processed under different disposal ability
Interpolation is carried out in the function for the accounting that time used in data volume and the processed data of processing accounts for subtask total processing time；
The calculating progress of subtask is obtained according to processed data volume in interpolation result and current subtask.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811141130.1A CN109359100A (en) | 2018-09-28 | 2018-09-28 | The visual modeling method of PB grades of historical datas and online data calculated in real time |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811141130.1A CN109359100A (en) | 2018-09-28 | 2018-09-28 | The visual modeling method of PB grades of historical datas and online data calculated in real time |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109359100A true CN109359100A (en) | 2019-02-19 |
Family
ID=65348241
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811141130.1A Pending CN109359100A (en) | 2018-09-28 | 2018-09-28 | The visual modeling method of PB grades of historical datas and online data calculated in real time |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109359100A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110850825A (en) * | 2019-11-13 | 2020-02-28 | 武汉恒力华振科技有限公司 | Industrial process data processing method based on event time |
| CN114417640A (en) * | 2022-03-28 | 2022-04-29 | 西安热工研究院有限公司 | Request type calculation method, system, equipment and storage medium for visual calculation |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102143215A (en) * | 2011-01-20 | 2011-08-03 | 中国人民解放军理工大学 | Network-based PB level cloud storage system and processing method thereof |
| CN102508639A (en) * | 2011-10-10 | 2012-06-20 | 北京邮电大学 | Distributed parallel processing method based on satellite remote sensing data characteristics |
| CN103902379A (en) * | 2012-12-25 | 2014-07-02 | 中国移动通信集团公司 | Task scheduling method and device and server cluster |
| CN104112011A (en) * | 2014-07-16 | 2014-10-22 | 深圳市国泰安信息技术有限公司 | Method and device for extracting mass data |
| CN104216782A (en) * | 2014-08-19 | 2014-12-17 | 东南大学 | Dynamic resource management method for high-performance computing and cloud computing hybrid environment |
| CN105337765A (en) * | 2015-10-10 | 2016-02-17 | 上海新炬网络信息技术有限公司 | Distributed hadoop cluster fault automatic diagnosis and restoration system |
| CN105573824A (en) * | 2014-10-10 | 2016-05-11 | 腾讯科技（深圳）有限公司 | Monitoring method and system of distributed computing system |
| CN106549829A (en) * | 2016-10-28 | 2017-03-29 | 北方工业大学 | Big data calculating platform monitoring system and method |
| CN107358347A (en) * | 2017-07-05 | 2017-11-17 | 西安电子科技大学 | Equipment cluster health state evaluation method based on industrial big data |
| CN108563496A (en) * | 2018-04-11 | 2018-09-21 | 深圳云天励飞技术有限公司 | Task analysis method, electronic equipment and storage medium |
-
2018
- 2018-09-28 CN CN201811141130.1A patent/CN109359100A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102143215A (en) * | 2011-01-20 | 2011-08-03 | 中国人民解放军理工大学 | Network-based PB level cloud storage system and processing method thereof |
| CN102508639A (en) * | 2011-10-10 | 2012-06-20 | 北京邮电大学 | Distributed parallel processing method based on satellite remote sensing data characteristics |
| CN103902379A (en) * | 2012-12-25 | 2014-07-02 | 中国移动通信集团公司 | Task scheduling method and device and server cluster |
| CN104112011A (en) * | 2014-07-16 | 2014-10-22 | 深圳市国泰安信息技术有限公司 | Method and device for extracting mass data |
| CN104216782A (en) * | 2014-08-19 | 2014-12-17 | 东南大学 | Dynamic resource management method for high-performance computing and cloud computing hybrid environment |
| CN105573824A (en) * | 2014-10-10 | 2016-05-11 | 腾讯科技（深圳）有限公司 | Monitoring method and system of distributed computing system |
| CN105337765A (en) * | 2015-10-10 | 2016-02-17 | 上海新炬网络信息技术有限公司 | Distributed hadoop cluster fault automatic diagnosis and restoration system |
| CN106549829A (en) * | 2016-10-28 | 2017-03-29 | 北方工业大学 | Big data calculating platform monitoring system and method |
| CN107358347A (en) * | 2017-07-05 | 2017-11-17 | 西安电子科技大学 | Equipment cluster health state evaluation method based on industrial big data |
| CN108563496A (en) * | 2018-04-11 | 2018-09-21 | 深圳云天励飞技术有限公司 | Task analysis method, electronic equipment and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| 孙文生等: "《统计学导论》", 31 March 2010 * |
| 白桃Ｋ: "《Spark Web UI监控》", 《SPARK WEB UI监控》 * |
| 马志亨: "《基于Spark的日志分析工具的设计与实现》", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110850825A (en) * | 2019-11-13 | 2020-02-28 | 武汉恒力华振科技有限公司 | Industrial process data processing method based on event time |
| CN110850825B (en) * | 2019-11-13 | 2021-06-08 | 武汉恒力华振科技有限公司 | Industrial process data processing method based on event time |
| CN114417640A (en) * | 2022-03-28 | 2022-04-29 | 西安热工研究院有限公司 | Request type calculation method, system, equipment and storage medium for visual calculation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11704290B2 (en) | Methods, devices and systems for maintaining consistency of metadata and data across data centers | |
| US10031935B1 (en) | Customer-requested partitioning of journal-based storage systems | |
| CN105549905B (en) | A kind of method that multi-dummy machine accesses distributed objects storage system | |
| US9460185B2 (en) | Storage device selection for database partition replicas | |
| US9690671B2 (en) | Manifest-based snapshots in distributed computing environments | |
| CN105468473B (en) | Data migration method and data migration device | |
| US9489443B1 (en) | Scheduling of splits and moves of database partitions | |
| CN104618482B (en) | Access method, server, conventional memory device, the system of cloud data | |
| CN107885758A (en) | The data migration method and dummy node of a kind of dummy node | |
| JP2017199439A (en) | System and method for implementing data storage service | |
| CN103782295B (en) | Query explain plan in a distributed data management system | |
| CN104184812B (en) | A kind of multipoint data transmission method based on private clound | |
| CN104301360A (en) | Method, log server and system for recording log data | |
| WO2009004620A2 (en) | Method and system for data storage and management | |
| CN109299056B (en) | A kind of method of data synchronization and device based on distributed file system | |
| US9984139B1 (en) | Publish session framework for datastore operation records | |
| US11250022B1 (en) | Offline index builds for database tables | |
| CN109460345B (en) | Real-time data calculation method and system | |
| CN110019469A (en) | Distributed data base data processing method, device, storage medium and electronic device | |
| Rajalakshmi et al. | An improved dynamic data replica selection and placement in cloud | |
| US10235407B1 (en) | Distributed storage system journal forking | |
| US10789234B2 (en) | Method and apparatus for storing data | |
| CN109359100A (en) | The visual modeling method of PB grades of historical datas and online data calculated in real time | |
| CN104391947B (en) | Magnanimity GIS data real-time processing method and system | |
| CN109716280A (en) | Flexible rank storage arrangement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190219 |
|
| RJ01 | Rejection of invention patent application after publication |