CN112579567A - MinIO-based industrial quality inspection file distributed storage system and method - Google Patents

MinIO-based industrial quality inspection file distributed storage system and method Download PDF

Info

Publication number
CN112579567A
CN112579567A CN202011471657.8A CN202011471657A CN112579567A CN 112579567 A CN112579567 A CN 112579567A CN 202011471657 A CN202011471657 A CN 202011471657A CN 112579567 A CN112579567 A CN 112579567A
Authority
CN
China
Prior art keywords
minio
data
file
distributed storage
stage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011471657.8A
Other languages
Chinese (zh)
Other versions
CN112579567B (en
Inventor
王星宇
韩锦
潘正颐
侯大为
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changzhou Weiyizhi Technology Co Ltd
Original Assignee
Changzhou Weiyizhi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changzhou Weiyizhi Technology Co Ltd filed Critical Changzhou Weiyizhi Technology Co Ltd
Priority to CN202011471657.8A priority Critical patent/CN112579567B/en
Publication of CN112579567A publication Critical patent/CN112579567A/en
Application granted granted Critical
Publication of CN112579567B publication Critical patent/CN112579567B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/211Schema design and management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/242Query formulation
    • G06F16/2433Query languages
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

The invention discloses a MinIO-based industrial quality inspection file distributed storage system and a MinIO-based industrial quality inspection file distributed storage method, wherein the storage system comprises a data preprocessing module, a data synchronization module, a data storage module and a data cleaning module which are connected in sequence; the method comprises a data preprocessing stage, a data synchronization stage, a data storage stage and a data cleaning stage which are sequentially carried out. The MinIO-based industrial quality control file distributed storage system and method solve the problems of poor system expansion and low resource utilization rate caused by mass storage of mass quality control pictures, and the MinIO is light in weight, so that the operation and maintenance cost can be further reduced.

Description

MinIO-based industrial quality inspection file distributed storage system and method
Technical Field
The invention relates to the technical field of storage methods, in particular to a MinIO-based industrial quality inspection file distributed storage system and method.
Background
Based on mass quality inspection pictures generated on an industrial quality inspection site, in actual industrial production, the traditional mode is used for single-point storage, the actual expansibility is poor, the resource availability is low, and the operation and maintenance cost is higher.
Chinese invention patent document CN110491478A (application No. 201910777317.9, application date: 2019, 08 and 22 months, applicant: zhong feng health cloud technology limited) discloses a ceph-based image file distributed storage system and an implementation method thereof, wherein the system comprises a ceph distributed file system, a receiving cache module, an operation scheduling module and a metadata storage module, and the method comprises the following steps: 1. deploying a ceph distributed storage cluster, configuring a temporary file directory for temporarily storing the received image files in a server, and enabling an operation scheduling module to read data in a receiving cache module; 2. the receiving cache module receives and stores the image file sent by the client; 3. and starting a file reading processing task and a file clearing task, wherein the file reading processing task is used for periodically reading and processing the image files in the temporary file directory, and the file clearing task is used for periodically deleting the processed image files. However, the method is based on CEPH operation and maintenance deployment, and the cost is high.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: in order to solve the problems existing in the background art, a MinIO-based industrial quality inspection file distributed storage system and a MinIO-based industrial quality inspection file distributed storage method are provided, the problems of poor system expansion and low resource utilization rate caused by mass storage of mass quality inspection pictures are solved, the MinIO is light in weight, and the operation and maintenance cost can be further reduced.
The technical scheme adopted by the invention for solving the technical problems is as follows: a distributed storage system based on MinIO industrial quality inspection files comprises a data preprocessing module, a data synchronization module, a data storage module and a data cleaning module which are connected in sequence;
the data preprocessing module is used for scanning configuration information and storing a temporary file to a disk;
the data synchronization module is used for monitoring in real time and uploading the temporary file by the initiation request;
the data storage module is used for storing the temporary file to the MinIO cluster and adding a file record;
the data cleaning module is used for cleaning temporary files at regular time to save system resources.
A method for a MinIO-based industrial quality control file distributed storage system comprises a data preprocessing stage, a data synchronization stage, a data storage stage and a data cleaning stage which are sequentially carried out.
More specifically, in the above technical solution, a method for a MinIO-based industrial quality control file distributed storage system includes the following steps:
the method comprises the following steps that firstly, system configuration is loaded in a data preprocessing stage, and system configuration information is scanned and loaded;
a second step, a data preprocessing stage receives a request initiated by a client and stores the file as a temporary file to a local server;
thirdly, uploading the temporary file to a local server in a data preprocessing stage and then issuing an event;
step four, event monitoring is carried out in a data synchronization stage, and temporary file information uploaded to a local server is collected in real time;
a fifth step of initiating a request to synchronously upload the local temporary file to the MinIO cluster in the data synchronization stage;
a sixth step of storing the local temporary file to the MinIO cluster according to the request in a data storage stage;
step seven, storing and recording the data to Mysql according to the storage result synchronization file in the data storage stage;
step eight, initiating a request to inquire a file storage record according to a timing task in a data cleaning stage, wherein specific timing time can be configured autonomously;
and a ninth step of cleaning the temporary file of the local server according to the query result in the data cleaning stage to finish data cleaning.
More specifically, in the foregoing technical solution, in the first step, the system configuration information includes basic server configuration information, MinIO configuration Endpoint, MinIO configuration Access Key, and MinIO configuration Secret Key.
More specifically, in the foregoing technical solution, in the second step, a request initiated by the client is received, and the file objects may be sequentially obtained from the request and saved as temporary files in the local server.
More specifically, in the above technical solution, in the third step, event issue is performed by using a Spring built-in ApplicationEventPublisher according to the result of the second step, so as to decouple the service.
More specifically, in the foregoing technical solution, in the fourth step, event monitoring is performed according to a Spring built-in ApplicationListener, and temporary file information uploaded to the local server is collected in real time.
Further specifically, in the above technical solution, in the fifth step, a request is initiated to sequentially upload files to the MinIO cluster according to the monitoring result of the fourth step.
Further specifically, in the above technical solution, in the ninth step, according to the query result, if the file has been successfully stored and a corresponding record exists in Mysql, the local server temporary file is cleaned, and data cleaning is completed.
The invention has the beneficial effects that: the MinIO-based industrial quality inspection file distributed storage system and method provided by the invention have the following advantages:
the distributed file system based on MinIO is flexible and has better expansibility;
secondly, the distributed file system built based on MinIO is lighter, and the operation and maintenance cost is reduced;
and thirdly, service is decoupled by using event release, so that service expansion is facilitated.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a flow chart of the present invention.
Detailed Description
In order to make the technical problems, technical solutions and advantageous effects solved by the present invention more clearly apparent, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, the MinIO-based industrial quality inspection file distributed storage system comprises a data preprocessing module, a data synchronization module, a data storage module and a data cleaning module which are connected in sequence.
The data preprocessing module is used for scanning configuration information and storing a temporary file to a disk;
the data synchronization module is used for monitoring in real time and uploading the temporary file by the initiation request;
the data storage module is used for storing the temporary file to the MinIO cluster and adding a file record;
the data cleaning module is used for cleaning temporary files at regular time to save system resources.
The data cleaning module inquires the record of the data storage module to periodically clean the temporary file and finish the disk space arrangement.
The data preprocessing module adopts Spring, Apache Common-FileUload and Spring application eventPublicher.
The data synchronization module adopts Spring, Spring application Listener.
The data storage module adopts Spring, Minio and Mysql.
The data cleaning module adopts Spring.
Referring to fig. 1, a method for a distributed storage system based on a MinIO industrial quality control file includes a data preprocessing stage, a data synchronization stage, a data storage stage and a data cleaning stage which are sequentially performed. The method comprises the following specific steps:
the method comprises the following steps that firstly, system configuration is loaded in a data preprocessing stage, and system configuration information is scanned and loaded;
a second step, a data preprocessing stage receives a request initiated by a client and stores the file as a temporary file to a local server;
a third step of issuing an event based on a Spring built-in ApplicationEventPublisher after uploading the temporary file to a local server in the data preprocessing stage; the content of event release comprises file name, file MD5, file disk path, operation time, operator, operation IP and the like;
in the data synchronization stage, event monitoring is carried out based on a Spring built-in applicationListener, and temporary file information uploaded to a local server is collected in real time; the content of event monitoring comprises a file name, a file MD5, a file disk path, operation time, an operator, an operation IP and the like;
a fifth step of initiating a request to synchronously upload the local temporary file to the MinIO cluster in the data synchronization stage; the MinIO cluster is a distributed object storage service formed by a plurality of miniO nodes, and the distributed cluster can avoid single-point faults due to the fact that the MinIO cluster is distributed on different nodes.
A sixth step of storing the local temporary file to the MinIO cluster according to the request in a data storage stage;
step seven, storing and recording the data to Mysql according to the storage result synchronization file in the data storage stage; mysql is one that may be used, but may also be others, such as: PostgreSQL, Sql Server, MongoDB, Redis, etc.
Step eight, initiating a request to inquire a file storage record according to a timing task in a data cleaning stage, wherein specific timing time can be configured autonomously;
and a ninth step of cleaning the temporary file of the local server according to the query result in the data cleaning stage to finish data cleaning.
In the first step, the system configuration information includes basic server configuration information, MinIO configuration Endpoint (URL of object storage service), MinIO configuration Access Key (unique identification account), and MinIO configuration Secret Key (account Key). The basic server configuration information comprises a Mysql server IP, a Mysql user name, a Mysql user password and the like.
In the second step, a request initiated by the client is received, and the file objects can be sequentially obtained from the request and saved to the local server as temporary files. Wherein, in turn, can be understood as a loop traversal operation, processing one traversal item at a time until all traversal items are processed.
In the third step, event issuing is carried out by utilizing a Spring built-in ApplicationEventPublisher according to the result of the second step, so that the service is decoupled. The patent mainly takes Spring related technology stacks as an example, and the implementation of other specific technology stacks is not limited, and other technology stacks can be Doubbo and the like. In addition, ApplicationEventPublisher is built-in event publication based on Spring. Other third party message middleware may also be employed including, without limitation, Kafka, RabbitMQ, and Active MQ, among others.
In the fourth step, event monitoring is carried out according to the built-in applicationListener of Spring, and temporary file information uploaded to the local server is collected in real time.
In the fifth step, according to the monitoring result of the fourth step, a request is initiated to sequentially upload the files to the MinIO cluster. Wherein, in turn, can be understood as a loop traversal operation, processing one traversal item at a time until all traversal items are processed.
In the ninth step, according to the query result, if the file is successfully stored and the corresponding record exists in the Mysql, the temporary file of the local server is cleaned, and data cleaning is completed, so that the purpose of effectively utilizing local disk resources is achieved.
It should be explained that:
MinIO is a high-performance distributed object storage system, which is a software product and can run 100% on standard hardware. Namely, MinIO can be well operated by low-cost machines such as X86.
Mysql is a Relational Database Management System developed by Mysql AB, Sweden, and belongs to the product under Oracle, is one of the most popular Relational Database Management systems, and is one of the best RDBMS (Relational Database Management System) application software in terms of WEB applications. In addition, Mysql is a relational database management system that keeps data in different tables, rather than putting all the data in one large repository, which increases speed and flexibility. Meanwhile, the SQL language used by Mysql is the most common standardized language for accessing databases. Mysql software adopts a double-authorization policy and is divided into a community version and a business version, and generally Mysql is selected as a website database for development of small and medium-sized websites due to the characteristics of small size, high speed, low overall ownership cost and particularly open source codes.
The Spring framework was created due to the complexity of software development, and springs used basic javabeans to accomplish what was previously only possible by EJBs. However, the use of Spring is not limited to server-side development. From the point of view of simplicity, testability and loose coupling, most Java applications can benefit from Spring. The purpose of Spring is to solve the complexity of enterprise application development; the Spring function is to use basic JavaBean to replace EJB and provide more enterprise application functions; the scope of application of Spring is any Java application. Spring is a lightweight controlled inversion (IoC) and cut-out-of-plane (AOP) container frame.
The ApplicationContext event mechanism is the implementation of observer design mode, and can implement the application context event processing through the ApplicationEvent class and the applicationListener interface. If there is an ApplicationListener Bean in the container, the ApplicationListener Bean will be automatically triggered whenever the ApplicationContext issues an ApplicationEvent, which must be triggered by the program display. Spring has some built-in events, and when some operation is completed, some event action is sent out. For example, listening to a contextrefreshedeventing event, which is triggered when all beans are initialized and loaded successfully, so that the ApplicationListener < contextrefreshedeventing > interface can receive the listening action and then write its logic. The event can be customized, monitored and customized, and is completely processed according to the own service logic.
The MinIO-based industrial quality control file distributed storage system and the method have the advantages that: the distributed file system based on MinIO is flexible and has better expansibility; the distributed file system built based on MinIO is lighter, and the operation and maintenance cost is reduced; service is decoupled by event distribution, which is convenient for service expansion.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention are equivalent to or changed within the technical scope of the present invention.

Claims (9)

1. The utility model provides a file distributed storage system is examined to industrial quality based on MinIO which characterized in that: the system comprises a data preprocessing module, a data synchronization module, a data storage module and a data cleaning module which are connected in sequence;
the data preprocessing module is used for scanning configuration information and storing a temporary file to a disk;
the data synchronization module is used for monitoring in real time and uploading the temporary file by the initiation request;
the data storage module is used for storing the temporary file to the MinIO cluster and adding a file record;
the data cleaning module is used for cleaning temporary files at regular time to save system resources.
2. The method of claim 1, wherein the MinIO industrial quality control file based distributed storage system comprises: the method comprises a data preprocessing stage, a data synchronization stage, a data storage stage and a data cleaning stage which are sequentially carried out.
3. The MinIO industrial quality control file distributed storage system-based method according to claim 2, comprising the following steps:
the method comprises the following steps that firstly, system configuration is loaded in a data preprocessing stage, and system configuration information is scanned and loaded;
a second step, a data preprocessing stage receives a request initiated by a client and stores the file as a temporary file to a local server;
thirdly, uploading the temporary file to a local server in a data preprocessing stage and then issuing an event;
step four, event monitoring is carried out in a data synchronization stage, and temporary file information uploaded to a local server is collected in real time;
a fifth step of initiating a request to synchronously upload the local temporary file to the MinIO cluster in the data synchronization stage;
a sixth step of storing the local temporary file to the MinIO cluster according to the request in a data storage stage;
step seven, storing and recording the data to Mysql according to the storage result synchronization file in the data storage stage;
step eight, initiating a request to inquire a file storage record according to a timing task in a data cleaning stage;
and a ninth step of cleaning the temporary file of the local server according to the query result in the data cleaning stage to finish data cleaning.
4. The method for the MinIO industrial quality control file based distributed storage system according to claim 3, wherein the MinIO industrial quality control file based distributed storage system comprises: in the first step, the system configuration information includes basic server configuration information, MinIO configuration Endpoint, MinIO configuration Access Key, and MinIO configuration Secret Key.
5. The MinIO-based industrial quality control file distributed storage method of claim 3, wherein the MinIO-based industrial quality control file distributed storage method comprises the following steps: in the second step, a request initiated by the client is received, and the file objects can be sequentially obtained from the request and saved to the local server as temporary files.
6. The method for the MinIO industrial quality control file based distributed storage system according to claim 3, wherein the MinIO industrial quality control file based distributed storage system comprises: in the third step, event issuing is carried out by utilizing a Spring built-in ApplicationEventPublisher according to the result of the second step, so that the service is decoupled.
7. The method for the MinIO industrial quality control file based distributed storage system according to claim 3, wherein the MinIO industrial quality control file based distributed storage system comprises: in the fourth step, event monitoring is carried out according to the built-in applicationListener of Spring, and temporary file information uploaded to the local server is collected in real time.
8. The MinIO-based industrial quality control file distributed storage method of claim 3, wherein the MinIO-based industrial quality control file distributed storage method comprises the following steps: in the fifth step, according to the monitoring result of the fourth step, a request is initiated to sequentially upload the files to the MinIO cluster.
9. The MinIO-based industrial quality control file distributed storage method of claim 3, wherein the MinIO-based industrial quality control file distributed storage method comprises the following steps: in the ninth step, according to the query result, if the file is successfully stored and a corresponding record exists in the Mysql, the temporary file of the local server is cleaned, and data cleaning is finished.
CN202011471657.8A 2020-12-14 2020-12-14 MinIO-based industrial quality inspection file distributed storage method Active CN112579567B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011471657.8A CN112579567B (en) 2020-12-14 2020-12-14 MinIO-based industrial quality inspection file distributed storage method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011471657.8A CN112579567B (en) 2020-12-14 2020-12-14 MinIO-based industrial quality inspection file distributed storage method

Publications (2)

Publication Number Publication Date
CN112579567A true CN112579567A (en) 2021-03-30
CN112579567B CN112579567B (en) 2022-02-08

Family

ID=75136210

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011471657.8A Active CN112579567B (en) 2020-12-14 2020-12-14 MinIO-based industrial quality inspection file distributed storage method

Country Status (1)

Country Link
CN (1) CN112579567B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113986850A (en) * 2021-10-27 2022-01-28 北京天宇威视科技股份有限公司 Storage method, device, equipment and computer readable storage medium of electronic file
CN115496749A (en) * 2022-11-14 2022-12-20 江苏智云天工科技有限公司 Product defect detection method and system based on target detection training preprocessing

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130100623A (en) * 2012-03-02 2013-09-11 오민수 Minio
CN105978949A (en) * 2016-04-27 2016-09-28 乐视控股(北京)有限公司 Off-line data uploading method and apparatus thereof
CN106445403A (en) * 2015-08-11 2017-02-22 张凡 Distributed storage method and system aiming at paired storage of mass data
CN107547653A (en) * 2017-09-11 2018-01-05 华北水利水电大学 A kind of distributed file storage system
CN108377363A (en) * 2018-02-07 2018-08-07 特斯联(北京)科技有限公司 A kind of monitor video acquisition methods based on event triggering
US20190188314A1 (en) * 2017-12-20 2019-06-20 Roku, Inc Mass insertion into single-threaded databases
CN110491478A (en) * 2019-08-22 2019-11-22 中电健康云科技有限公司 A kind of image file distributed storage system and its implementation based on ceph

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130100623A (en) * 2012-03-02 2013-09-11 오민수 Minio
CN106445403A (en) * 2015-08-11 2017-02-22 张凡 Distributed storage method and system aiming at paired storage of mass data
CN105978949A (en) * 2016-04-27 2016-09-28 乐视控股(北京)有限公司 Off-line data uploading method and apparatus thereof
CN107547653A (en) * 2017-09-11 2018-01-05 华北水利水电大学 A kind of distributed file storage system
US20190188314A1 (en) * 2017-12-20 2019-06-20 Roku, Inc Mass insertion into single-threaded databases
CN108377363A (en) * 2018-02-07 2018-08-07 特斯联(北京)科技有限公司 A kind of monitor video acquisition methods based on event triggering
CN110491478A (en) * 2019-08-22 2019-11-22 中电健康云科技有限公司 A kind of image file distributed storage system and its implementation based on ceph

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
BGBIAO: "开源分布式对象存储-MinIO", 《知乎(HTTPS://ZHUANLAN.ZHIHU.COM/P/103803549)》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113986850A (en) * 2021-10-27 2022-01-28 北京天宇威视科技股份有限公司 Storage method, device, equipment and computer readable storage medium of electronic file
CN115496749A (en) * 2022-11-14 2022-12-20 江苏智云天工科技有限公司 Product defect detection method and system based on target detection training preprocessing
CN115496749B (en) * 2022-11-14 2023-01-31 江苏智云天工科技有限公司 Product defect detection method and system based on target detection training preprocessing

Also Published As

Publication number Publication date
CN112579567B (en) 2022-02-08

Similar Documents

Publication Publication Date Title
CN109997126B (en) Event driven extraction, transformation, and loading (ETL) processing
US11507594B2 (en) Bulk data distribution system
US10684990B2 (en) Reconstructing distributed cached data for retrieval
US9286368B2 (en) Linking framework for information technology management
JP6416194B2 (en) Scalable analytic platform for semi-structured data
US7930143B2 (en) Systems and methods for sensor-based computing
CN111400326B (en) Smart city data management system and method thereof
CN109690524A (en) Data Serialization in distributed event processing system
CN110300963A (en) Data management system in large-scale data repository
CN107835983A (en) Backup-and-restore is carried out in distributed data base using consistent database snapshot
US20210286846A1 (en) Storing and identifying metadata through extended properties in a historization system
WO2013074665A1 (en) Data processing service
CN112579567B (en) MinIO-based industrial quality inspection file distributed storage method
CN104899274B (en) A kind of memory database Efficient Remote access method
US20140229435A1 (en) In-memory real-time synchronized database system and method
Qiao et al. Gobblin: Unifying data ingestion for Hadoop
US11256713B2 (en) Virtual transaction queues for database replication
CN114443599A (en) Data synchronization method and device, electronic equipment and storage medium
US20130007040A1 (en) Distributed requests on remote data
CA2918472C (en) A method and process for enabling distributing cache data sources for query processing and distributed disk caching of large data and analysis requests
Wang Activating Big Data at Scale
US11663216B2 (en) Delta database data provisioning
US20230030208A1 (en) Bulk data extract hybrid job processing
US20240012835A1 (en) Synchronizing changes in a distributed system with intermittent connectivity
US20230185691A1 (en) Differential logging of computing processes

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant