CN114816916A - Load data management method and system based on load balancer - Google Patents

Load data management method and system based on load balancer Download PDF

Info

Publication number
CN114816916A
CN114816916A CN202210427496.5A CN202210427496A CN114816916A CN 114816916 A CN114816916 A CN 114816916A CN 202210427496 A CN202210427496 A CN 202210427496A CN 114816916 A CN114816916 A CN 114816916A
Authority
CN
China
Prior art keywords
data
load
load balancer
matching
strategy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210427496.5A
Other languages
Chinese (zh)
Inventor
林培湛
杨菲
李刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Post Consumer Finance Co ltd
Original Assignee
China Post Consumer Finance Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Post Consumer Finance Co ltd filed Critical China Post Consumer Finance Co ltd
Priority to CN202210427496.5A priority Critical patent/CN114816916A/en
Publication of CN114816916A publication Critical patent/CN114816916A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3006Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3051Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3065Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • G06F11/3072Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3089Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
    • G06F11/3093Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Mathematical Physics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to a load data management method and a system based on a load balancer, which comprises the following steps: 1) collecting load-related data of a load balancer to form original data; 2) the collected data are treated, and the data are divided into structured data and unstructured data; 3) classifying and storing the structured data and the unstructured data; 4) realizing load data query through a port; 5) realizing auxiliary strategy and strategy matching query through an algorithm; the load data management method and system based on the load balancer solve the problem that data cannot be shared, so that a data island is eliminated, and the potential value of the data is fully played.

Description

Load data management method and system based on load balancer
Technical Field
The invention relates to the technical field of software development, in particular to a load data management method and system based on a load balancer.
Background
Load balancing builds on existing network architectures and provides an inexpensive, efficient, transparent way to extend the bandwidth of network devices and servers, increase throughput, enhance network data processing capabilities, and increase network flexibility and availability. The load balancing device is not an underlying network device but a performance optimization device. For network applications, load balancing is not required at the beginning, and when the access volume of the network applications is increased and a single processing unit cannot meet the load requirement, the network application traffic will become a bottleneck, and the load balancing plays a role.
Load balancing has two implications: the first layer meaning, the operation of a single heavy load is shared by a plurality of node devices to be processed in parallel, after the processing of each node device is finished, the result is summarized and returned to a user, and the system processing capacity is greatly improved, which is the cluster (clustering) technology commonly called by people. The second layer means that: a large amount of concurrent access or data traffic is shared by a plurality of node devices to be processed respectively, and the time for a user to wait for response is reduced, which is mainly aimed at Web servers, FTP servers, enterprise key application servers and other network applications.
Generally, load balancing may be divided according to different levels of the network (seven levels of the network). The load balancing of the second layer refers to using multiple physical links as a single aggregation logical link, which is a link aggregation (trunk) technology, and is not an independent device, but a common technology of network devices such as switches. Modern load balancing technology usually operates in the fourth or seventh layer of the network, which is a load balancing technology for network applications, and it is completely separated from switches and servers and becomes a separate technical device, refer to fig. 1.
Referring to fig. 2, currently, many companies use load balancing of load balancers as performance optimization equipment, which serves as a load balancing requirement for high concurrency and large data traffic of the companies, and the configuration and query of the load balancers need to be handled by full-time network managers; the load of the load balancer is configured mainly by two modes, one is to operate on a web page of the load balancer, and the other is to edit a configuration file and execute a related command on a command line; load balancer load information is a web interface query provided by a load balancer vendor, but the information is abstract and scattered. Thus, there are the following problems;
1. the load configuration and query operation of the load balancer can only be handled by network managers, which causes the network managers to be tired of coping with various configuration and query requirements of operation and maintenance personnel and developers, and the efficiency is low.
2. Whether a web page of a load balancer is adopted or a command line is adopted for operation, the requirements on professional knowledge and skills of operators are high, the judgment on operation fault tolerance is low, and the efficiency of configuration and query is low.
3. Although a load balancer manufacturer provides information such as web interface query load, the organization of the information is highly abstract, more professional terms are provided, and non-network management personnel have higher difficulty in use and are not beneficial to development of daily work.
4. The manufacturer of the load balancer does not provide an API (application programming interface) query interface for external information such as loads, so that the information cannot be shared, a data island is formed, the potential value of data is not favorably mined, and the data support function of the data in various fields such as operation, maintenance, development and operation cannot be exerted.
Disclosure of Invention
Based on this, it is necessary to provide a load data management method and system based on a load balancer, so as to solve the problem that data cannot be shared, thereby eliminating data islands and fully exerting the potential value of data.
An embodiment of the present invention provides a load data management method based on a load balancer, including the following steps:
1) collecting load-related data of a load balancer to form original data;
2) the collected data are treated, and the data are divided into structured data and unstructured data;
3) classifying and storing the structured data and the unstructured data;
4) realizing load data query through a port;
5) and realizing auxiliary strategies and strategy matching inquiry through an algorithm.
Preferably, the specific method for data acquisition is as follows: and (3) regularly acquiring data related to the load of the load balancer by reading the configuration file information of the load balancer or a crawler capture mode by using a script tool, and providing original data for a data analysis process.
Preferably, the data governance comprises the steps of:
firstly, analyzing the acquired data;
then, data cleaning is carried out on the analyzed data;
and finally, carrying out data aggregation on the cleaned data.
Preferably, the specific method for data analysis is as follows: and compiling an analysis script by using the regular expression and a custom matching algorithm, and regularly analyzing the original data obtained in the data acquisition process to obtain structured data and unstructured data.
Preferably, the specific method for data cleaning is as follows: and cleaning the redundant data and the dirty data obtained after analysis to obtain clean data which accords with the service body.
Preferably, the specific method of data aggregation is as follows: and integrating the cleaned data according to the service scene main body.
Preferably, the structured data is stored in a relational database and the unstructured data is stored in an unstructured database.
Preferably, the load data query method is that forward and reverse queries of the load link of the load balancer are realized by using an IP segment matching and port range matching algorithm through a vs monitoring address, a vs monitoring port, a pool member address and a pool member port;
the load data and strategy query method is that the matching and searching of the load data and strategy of the load balancer are realized through the algorithm matching of the load balancer strategy;
the strategy matching query method is that the load data and the strategy of the load balancer are matched and searched through the algorithm matching of the load balancer strategy.
The invention also provides a load data management system based on the load balancer, which comprises a data acquisition module, a load balancing module and a load balancing module, wherein the data acquisition module is used for acquiring load-related data of the load balancer;
the data treatment module is used for treating the acquired data;
the storage module is used for classifying and storing the aggregated data into structured data and unstructured data;
the query module is used for realizing load data query through a port; and realizing auxiliary strategies and strategy matching inquiry through an algorithm.
Preferably, the data governance module comprises: the data analysis module is used for compiling an analysis script by using a regular expression and a custom matching algorithm based on original data obtained in the data acquisition process, and regularly analyzing to obtain structured data and unstructured data;
a data cleaning module: cleaning the redundant data and the dirty data obtained after analysis to obtain clean and available data which accords with the service body;
a data aggregation module: and integrating the cleaned data according to the main body of the service scene.
According to the load data management method and system based on the load balancer, the effective utilization of the load data of the load balancer is realized through the processes of data acquisition and data management, the potential value of the load data of the load balancer is mined, and safe and reliable basic data are provided for operation, maintenance, development and the like; through the unification and standardization of load information query of the load balancer, information sharing is achieved, information islands are eliminated, authority barriers are broken, two hands of network management personnel are liberated, the service management efficiency and effect are improved, and the development, operation and maintenance management cost of the system is reduced.
Drawings
The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular description of preferred embodiments of the invention, as illustrated in the accompanying drawings. Like reference numerals refer to like parts throughout the drawings, and the drawings are not intended to be drawn to scale in actual dimensions, emphasis instead being placed upon illustrating the principles of the invention.
FIG. 1 is a load balancing architecture diagram of a load balancer;
FIG. 2 is a flow chart of load data processing of a load balancer in the prior art;
FIG. 3 is a flow chart of a load data management method based on a load balancer according to the present invention;
FIG. 4 is a data acquisition process diagram of the present invention;
FIG. 5 is a diagram of a data parsing process of the present invention;
FIG. 6 is a diagram of a data integration process of the present invention;
fig. 7 is a block diagram of a load data management system based on a load balancer.
Detailed Description
The present invention will be better understood and implemented by those skilled in the art by the following detailed description of the embodiments taken in conjunction with the accompanying drawings, which are not intended to limit the scope of the present invention.
As shown in fig. 1 to 7, in an aspect, an embodiment of the present invention provides a load data management method based on a load balancer, including the following steps, with reference to fig. 3:
1) collecting load-related data of a load balancer to form original data;
before data acquisition, load information of the load balancer needs to be combed, configuration formats and rules of configuration files are determined, and preparation work of acquiring and analyzing the rules is completed.
2) The collected data are treated, and the data are divided into structured data and unstructured data;
3) classifying and storing the structured data and the unstructured data; and according to the service scene, carrying out data integration processing, dividing the data into structured data and unstructured data, and storing the data.
Specifically, the structured data is stored in a relational database, and data with definite relations, such as vs and pool, are stored, and are mainly used for data storage with frequent updates. The unstructured data is stored in a non-relational database, and large-field data such as configuration file contents are stored, and are mainly used for temporary data storage, auxiliary data storage and auxiliary data query.
4) Realizing load data query through a port;
specifically, forward and reverse query of a load link of the load balancer is realized by using an IP (Internet protocol) segment (mask) matching algorithm and a port range matching algorithm through a vs monitoring address, a vs monitoring port, a pool member address and a pool member port, and operation and development personnel are helped to quickly locate load information of the load balancer.
5) And realizing auxiliary strategies and strategy matching inquiry through an algorithm.
Specifically, matching and searching of load data and strategies of the load balancer are achieved through algorithm matching of load balancer strategies such as irule and the like, and operation and development personnel can conveniently and quickly obtain the load data and strategy information of the load balancer. Matching and searching of load data and strategies of the load balancer are achieved through algorithm matching of load balancer strategies such as irule and the like, so that operation and maintenance and development personnel can obtain load information of the load balancer corresponding to the specified load balancer strategy and the corresponding strategy of the load balancer, and the load information and the corresponding strategy are used for searching, positioning and solving field problems.
When the method is implemented specifically, a unified load information query interface, a unified load data and strategy query interface and a unified strategy matching query interface are developed, and the interfaces are on-line and released.
Through the processes of data acquisition and data management, the effective utilization of load data of the load balancer is realized, the potential value of the load data of the load balancer is mined, and safe and reliable basic data are provided for operation, maintenance, development and the like. Through the unification and standardization of load information query of the load balancer, information sharing is achieved, information islands are eliminated, authority barriers are broken, two hands of network management personnel are liberated, the service management efficiency and effect are improved, and the development, operation and maintenance management cost of the system is reduced.
Referring to fig. 4, in a preferred embodiment, the specific method of data acquisition is: and (3) regularly acquiring data related to the load of the load balancer by reading the configuration file information of the load balancer or a crawler capture mode by using a script tool, and providing original data for a data analysis process.
In a preferred embodiment, the data governance comprises the steps of:
firstly, analyzing the acquired data;
then, data cleaning is carried out on the analyzed data;
and finally, carrying out data aggregation on the cleaned data.
Referring to fig. 5, in a preferred embodiment, the specific method of data parsing is: based on the original data obtained in the data acquisition process, combining the load design principle (such as irule, data group, vs and pool) of the load balancer, compiling an analysis script by using a regular expression and a custom matching algorithm, and regularly analyzing the original data obtained in the data acquisition process to obtain structured data and unstructured data.
In a preferred embodiment, the specific method of data cleansing is as follows: and cleaning the redundant data and the dirty data obtained after analysis to obtain clean data which accords with the service body. The data obtained in the analysis process has the conditions of redundancy, dirty data and the like, and the data is processed into clean and available data which accords with the business theme through data cleaning by combining the actual business condition.
Referring to fig. 6, in a preferred embodiment, the specific method of data aggregation is: and integrating the cleaned data according to the service scene main body. After the processes of data acquisition, data analysis and data cleaning, the data can be integrated according to a certain scene theme by combining with an actual service scene to provide a uniform data source for a next inquiry interface,
in a preferred embodiment, the structured data is stored in a relational database and the unstructured data is stored in an unstructured database.
In the preferred embodiment, the load data query realizes the forward and reverse query of the load link of the load balancer by using the IP section (mask) matching and port range matching algorithm through the vs monitoring address, the vs monitoring port, the pool member address and the pool member port, and helps the operation and development personnel to quickly position the load information of the load balancer;
load data and strategy query, namely matching and searching the load data and strategy of the load balancer through the algorithm matching of the load balancer strategies such as irule and the like, so that operation and development personnel can conveniently and quickly obtain the load data and strategy information of the load balancer;
and strategy matching query, namely matching and searching load data and strategies of the load balancer through algorithm matching of load balancer strategies such as irule and the like so that operation and maintenance and developers can obtain load information of the load balancer corresponding to the specified load balancer strategy and the corresponding strategy of the load balancer for searching, positioning and solving field problems.
Referring to fig. 7, the present invention further provides a load data management system based on a load balancer, comprising
The data acquisition module 1 is used for acquiring load-related data of the load balancer;
the data treatment module 2 is used for treating the acquired data;
the storage module 3 is used for classifying and storing the aggregated data into structured data and unstructured data;
the query module 4 is used for realizing load data query through a port; and realizing auxiliary strategies and strategy matching inquiry through an algorithm.
Preferably, the data governance module 2 comprises: the data analysis module is used for compiling an analysis script by using a regular expression and a custom matching algorithm based on original data obtained in the data acquisition process, and regularly analyzing to obtain structured data and unstructured data;
a data cleaning module: cleaning the redundant data and the dirty data obtained after analysis to obtain clean and available data which accords with the service body;
a data aggregation module: and integrating the cleaned data according to the service scene main body.
The specific embodiment is as follows: some brand-holding consumer financial companies, in order to adapt to the development of business, have used load balancers within the companies as load balancing devices for bearing the business demands of the companies with high concurrency and high traffic. Due to the fact that service development is rapid, online release and change of a service system are frequent, query requirements of company operation and development personnel on load information of a load balancer are increased rapidly, the problems of information sharing blockage, operation authority management confusion and the like are easily caused only by single-line maintenance of existing network management personnel, development of actual operation and maintenance and development work is not facilitated, and efficiency of company service expansion is greatly reduced.
By implementing the scheme of the invention, the load data of the load balancer is treated, gathered and inquired, the company realizes the comprehensive communication of the load data sharing link of the load balancer, greatly improves the efficiency and the effect of the load data inquiry of the load balancer, reduces the development and operation and maintenance cost, and improves the automation level and the operation and maintenance efficiency.
According to the load data management method and system based on the load balancer, the effective utilization of the load data of the load balancer is realized through the processes of data acquisition and data management, the potential value of the load data of the load balancer is mined, and safe and reliable basic data are provided for operation, maintenance, development and the like; through the unification and standardization of load information query of the load balancer, information sharing is achieved, information islands are eliminated, authority barriers are broken, two hands of network management personnel are liberated, the service management efficiency and effect are improved, and the development, operation and maintenance management cost of the system is reduced.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. A load data management method based on a load balancer is characterized by comprising the following steps:
1) collecting load-related data of a load balancer to form original data;
2) the collected data are treated, and the data are divided into structured data and unstructured data;
3) classifying and storing the structured data and the unstructured data;
4) and querying the data.
2. The load data management method based on the load balancer as claimed in claim 1, wherein the specific method of data collection is: and (3) regularly acquiring data related to the load of the load balancer by reading the configuration file information of the load balancer or a crawler capture mode by using a script tool, and providing original data for a data analysis process.
3. The load data management method based on the load balancer as claimed in claim 1, wherein the data governance comprises the steps of:
firstly, analyzing the acquired data;
then, data cleaning is carried out on the analyzed data;
and finally, carrying out data aggregation on the cleaned data.
4. The load data management method based on the load balancer as claimed in claim 3, wherein the specific method of data parsing is: and compiling an analysis script by using the regular expression and a custom matching algorithm, and regularly analyzing the original data obtained in the data acquisition process to obtain structured data and unstructured data.
5. The load data management method based on the load balancer as claimed in claim 3, wherein the specific method of data cleansing is: and cleaning the redundant data and the dirty data obtained after analysis to obtain clean data which accords with the service body.
6. The load data management method based on the load balancer as claimed in claim 3, wherein the specific method of the data aggregation is: and integrating the cleaned data according to the service scene main body.
7. The load data management method based on a load balancer of claim 1, wherein the structured data is stored in a relational database, and the unstructured data is stored in an unstructured database.
8. The load data management method based on a load balancer according to claim 1,
querying the data includes:
realizing load data query through a port;
realizing auxiliary strategy and strategy matching query through an algorithm;
the load data query method comprises the steps of utilizing an IP (Internet protocol) segment matching and port range matching algorithm to realize forward and reverse query of a load link of the load balancer through a vs monitoring address, a vs monitoring port, a pool member address and a pool member port;
the load data and strategy query method is that the matching and searching of the load data and strategy of the load balancer are realized through the algorithm matching of the load balancer strategy;
the strategy matching query method is that the matching and searching of the load data and the strategy of the load balancer are realized through the algorithm matching of the load balancer strategy.
9. A load data management system based on a load balancer is characterized by comprising a data acquisition module, a load balancing module and a load balancing module, wherein the data acquisition module is used for acquiring load-related data of the load balancer;
the data management module is used for managing the acquired data;
the storage module is used for classifying and storing the aggregated data into structured data and unstructured data;
the query module is used for realizing load data query through a port; and realizing auxiliary strategies and strategy matching inquiry through an algorithm.
10. The load data management system based on a load balancer of claim 9, wherein the data governance module comprises: the data analysis module is used for compiling an analysis script by using a regular expression and a custom matching algorithm based on original data obtained in the data acquisition process, and regularly analyzing to obtain structured data and unstructured data;
a data cleaning module: cleaning the redundant data and the dirty data obtained after analysis to obtain clean and available data which accords with the service body;
a data aggregation module: and integrating the cleaned data according to the service scene main body.
CN202210427496.5A 2022-04-22 2022-04-22 Load data management method and system based on load balancer Pending CN114816916A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210427496.5A CN114816916A (en) 2022-04-22 2022-04-22 Load data management method and system based on load balancer

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210427496.5A CN114816916A (en) 2022-04-22 2022-04-22 Load data management method and system based on load balancer

Publications (1)

Publication Number Publication Date
CN114816916A true CN114816916A (en) 2022-07-29

Family

ID=82505696

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210427496.5A Pending CN114816916A (en) 2022-04-22 2022-04-22 Load data management method and system based on load balancer

Country Status (1)

Country Link
CN (1) CN114816916A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102984079A (en) * 2012-12-18 2013-03-20 中国电子科技集团公司第十五研究所 Controlling method and system for load balancing
CN103984761A (en) * 2014-03-28 2014-08-13 广东轩辕网络科技股份有限公司 Massive isomerous data storage method and system
CN105376334A (en) * 2015-12-14 2016-03-02 曙光信息产业(北京)有限公司 Load balancing method and device
CN106506700A (en) * 2016-12-28 2017-03-15 北京优帆科技有限公司 A kind of transparent proxy method of load equalizer and SiteServer LBS
CN108234208A (en) * 2017-12-29 2018-06-29 三盟科技股份有限公司 The visualization load balancing dispositions method and system of resource management based on business
CN114064377A (en) * 2020-07-29 2022-02-18 中移(苏州)软件技术有限公司 Load balancer monitoring method, device, equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102984079A (en) * 2012-12-18 2013-03-20 中国电子科技集团公司第十五研究所 Controlling method and system for load balancing
CN103984761A (en) * 2014-03-28 2014-08-13 广东轩辕网络科技股份有限公司 Massive isomerous data storage method and system
CN105376334A (en) * 2015-12-14 2016-03-02 曙光信息产业(北京)有限公司 Load balancing method and device
CN106506700A (en) * 2016-12-28 2017-03-15 北京优帆科技有限公司 A kind of transparent proxy method of load equalizer and SiteServer LBS
CN108234208A (en) * 2017-12-29 2018-06-29 三盟科技股份有限公司 The visualization load balancing dispositions method and system of resource management based on business
CN114064377A (en) * 2020-07-29 2022-02-18 中移(苏州)软件技术有限公司 Load balancer monitoring method, device, equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
佚名: "Spring-Cloud组件之ribbon 、IRule 、Feign", 《HTTPS://BLOG.CSDN.NET/QQ_33486185/ARTICLE/DETAILS/90513590》 *

Similar Documents

Publication Publication Date Title
US8126909B2 (en) System and method for analyzing data records
US11650971B2 (en) System and method for large-scale data processing using an application-independent framework
US7650331B1 (en) System and method for efficient large-scale data processing
US9652287B2 (en) Using databases for both transactions and analysis
CN111327681A (en) Cloud computing data platform construction method based on Kubernetes
US6901405B1 (en) Method for persisting a schedule and database schema
CN106599043A (en) Middleware used for multilevel database and multilevel database system
CN106126601A (en) A kind of social security distributed preprocess method of big data and system
US8135703B2 (en) Multi-partition query governor in a computer database system
EP2182448A1 (en) Federated configuration data management
CN111061788A (en) Multi-source heterogeneous data conversion integration system based on cloud architecture and implementation method thereof
TWI497321B (en) Query optimization in a parallel computer system with multiple networks
CN107193898B (en) The inquiry sharing method and system of log data stream based on stepped multiplexing
DE102016208672A1 (en) Manage redundancies between application bundles
CN1959676A (en) Apparatus and method for materialized query table journaling in a computer database system
CN1575464A (en) Segmentation and processing of continuous data streams using transactional semantics
CN101196901B (en) Computer system and method for database query
CN112579287A (en) Cloud arrangement system and method based on read-write separation and automatic expansion
CN109308290A (en) A kind of efficient data cleaning conversion method based on CIM
CN112579552A (en) Log storage and calling method, device and system
CN114816916A (en) Load data management method and system based on load balancer
CN112052284A (en) Main data management method and system under big data
CN108932258A (en) Data directory processing method and processing device
CN116010447A (en) Load balancing method and device for optimizing heterogeneous database user query
CN206421382U (en) Data processing system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20220729

RJ01 Rejection of invention patent application after publication