CN112667618B - Public area sanitary platform quality control system and method - Google Patents
Public area sanitary platform quality control system and method Download PDFInfo
- Publication number
- CN112667618B CN112667618B CN202011628425.9A CN202011628425A CN112667618B CN 112667618 B CN112667618 B CN 112667618B CN 202011628425 A CN202011628425 A CN 202011628425A CN 112667618 B CN112667618 B CN 112667618B
- Authority
- CN
- China
- Prior art keywords
- quality control
- data
- rule
- configurator
- calculator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a public area sanitary platform quality control system and a method, wherein the system comprises a column type storage database, a data reader, a quality control calculator, a data memory and a configurator; the column type storage database is used for converting input source data into column type storage; the configurator is used for storing the configuration information of the quality control rule coding and the quality control rule algorithm in the quality control calculator, and is used for configuring the quality control rule and the fields in the data table of the columnar storage database to form the configuration relation (rule set, data set); the data reader reads the data in batches according to the rules, and the data are respectively transmitted into the data storage according to batches after being calculated according to the quality control rules. The method is converted into a column type storage mode, invalid data can be removed to the greatest extent when the data is subjected to joint query, and the query efficiency of the data is greatly improved. The method solves the problem that the quality control result is difficult to output intuitively, rapidly and efficiently under the conditions of huge data volume and limited hardware resources.
Description
Technical Field
The invention relates to the field of public area sanitary platform data quality control, in particular to a public area sanitary platform quality control system and method.
Background
At present, the data quality control mode of the regional health platform is to read line data of source data and simultaneously read a quality control rule configured in advance to check each field of each line. The quality control rule and the current processing mode of the source data are divided into two types, namely, the quality control rule is configured into an SQL sentence through a storage process, the data quality control is completed in the data query process, and a quality control table structure is output. According to the method, the quality control rule is written into the SQL sentence, so that the quality control calculation complexity is greatly increased, and the hardware IO read-write requirement on the environment where the database is located is higher due to the SQL complexity. And the quality control rules are disordered and chaotic, and the maintenance cost is high.
In another mode, the source data is read, the quality control rule is read into the memory, and the verification of the data quality control rule is completed through memory calculation. The method increases the calculation performance of the data, but has larger memory requirement on the data, increases hardware cost and threshold, and simultaneously has no scientific mode control on the writing performance of the calculation result because the method only increases the calculation performance of the data, so that the calculation performance result can not be written into a result library for display even if the calculation performance result is completed.
In any way, under the condition of huge data volume and limited hardware resources, the quality control result is difficult to intuitively, rapidly and efficiently output to a front-end page for display, the hardware becomes a calculation bottleneck in a quality control scene, the quality control verification of source data is often faced for tens or even hundreds of hours, and finally the output of the quality control result is finished.
Disclosure of Invention
The invention provides a quality control system and a quality control method for a public area sanitary platform, which are used for solving the problem that the quality control result is difficult to intuitively, rapidly and efficiently output under the conditions of huge data volume and limited hardware resources in the conventional quality control scheme of the public area sanitary platform.
In a first aspect, a quality control system for a public area sanitary platform is provided, including a columnar storage database, a data reader, a quality control calculator, a data memory and a configurator;
the column storage database is used for converting input source data into column storage;
the configurator is used for storing configuration information of the quality control rule codes and the quality control rule algorithm in the quality control calculator and configuring fields in the data table of the quality control rule and the column type storage database to form a configuration relation (rule set, data set);
the data reader is used for reading configuration from the configurator and mapping quality control rules and fields; the data in the column type storage database is read in batches and transmitted to the quality control calculator;
the quality control calculator comprises a plurality of quality control rule algorithms which are used for receiving the data input by the data reader and performing quality control verification on the data to obtain quality control results and transmitting the quality control results to the data memory;
the data storage is connected with the quality control result data output by the quality control calculator, and the quality control result data is split according to the quality control rule dimension and the table dimension in the column type storage database and then output.
Further, the system also comprises a flow controller for balancing throughput among the data reader, the quality control calculator and the data storage according to the minimum data processing capacity per unit time.
Further, the configurator includes a rule mapping configurator and a rule-data set configurator;
the rule mapping configurator is used for storing configuration information of the quality control rule codes and the quality control rule algorithm in the quality control calculator;
the rule-data set configurator is used for configuring the quality control rule configured by the rule mapping configurator and fields in a data table of the columnar storage database to form a configuration relation (rule set, data set).
Further, the data reader also includes an internal register for transmitting a save to a data location of the quality control calculator.
Further, the data reader is used for determining the quantity of the read data of each batch according to the input of the flow controller.
Further, the quality control calculator also stores the quality control rule algorithm codes and the configuration information of the quality control rule algorithm.
Further, the data storage splits and outputs quality control result data according to quality control rules according to quality control rule dimensions and table dimensions in a column type storage database, and the method comprises the following steps:
the data memory stores quality control result data;
combining quality control result data according to batches;
splitting the combined quality control result data according to the quality control rule;
and merging data sets in the data table of the same column type storage database according to the quality control rule.
Further, the system also comprises a quality control result database and a display, wherein the quality control result database is used for receiving and storing the quality control result data output by the data memory, and the display is used for displaying the quality control result data in real time.
In a second aspect, a quality control method for a public area sanitary platform is provided, and the quality control system for the public area sanitary platform is used for quality control, and the quality control method comprises the following steps:
converting the structured data of the source data into a columnar storage database by an ETL tool;
initializing a configurator and reading configuration information;
the flow controller calculates the minimum reading speed of the data reader, the minimum calculating speed of the quality control calculator and the minimum writing speed of the data memory, and takes the minimum value VolumeUnit of the three;
the data reader reads the data in the column-type storage database according to the configuration information of the configurator and the reading speed VolumeUnit, and transmits the read data to the quality control calculator;
the quality control calculator performs quality control verification on the input data and outputs a quality control result;
and the data storage receives the quality control result, splits the quality control result data according to the quality control rule dimension and the table dimension in the column type storage database, and outputs the split quality control result data.
Further, the quality control calculator calculates the input data by combining the Spark matrix to make quality control check. The matrix calculation of Spark is introduced, and each calculation dynamic state can be decomposed into small calculations by utilizing the RDD characteristic of the Spark bottom layer, so that the distributed characteristic of a big data system is fully utilized, and the calculation capacity and speed of the whole system can be conveniently expanded.
Advantageous effects
The invention provides a public area sanitary platform quality control system and method, which have the following advantages:
(1) And the column storage is introduced, so that the reading and writing capability is greatly improved. In the prior line storage system, the whole line of fields are read in every time data is read, a large amount of condition judgment is needed in SQL grammar, so that SQL maintenance cost is high, in order to reduce SQL cost, the whole line of data is read, and performance is greatly reduced (because quality control verification generally only carries out quality control rule algorithm calculation on a single field, and the reading calculation of the whole line of data brings about that a large amount of fields which do not need to be calculated occupy memory, and calculation resources are wasted, and meanwhile, the calculation speed is reduced).
(2) The quality control processing speed is dynamically adjustable, so that data loss or system breakdown is avoided. In the prior art, the quality control process reads how much data is processed, and the conditions of inconsistent read-write speed and data calculation speed often occur in the system. Resulting in backlog of data at some links. Under the condition of huge data volume, unpredictable data loss and system breakdown are often caused, and finally, quality control results are unsatisfactory.
(3) The interaction is more friendly, and the traditional quality control calculation can be carried out only when all data result calculation is completed, so that the whole data can be loaded to the front-end page for display, and the page loading also needs a few minutes, so that the display effect and the unfriendly performance are caused. According to the scheme, the calculated quality control result can be transmitted to the front-end page in real time, the quality control result is dynamically displayed on the page, and interaction is more elegant.
(4) The method solves the problem that the quality control result is difficult to intuitively, rapidly and efficiently output by the conventional public area sanitary platform quality control scheme under the conditions of huge data volume and limited hardware resources.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a quality control system of a public area sanitary platform according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of converting source data to columnar storage according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a configuration relationship of (rule set, data set) provided by an embodiment of the present invention;
FIG. 4 is a read flow chart of a data reader provided by an embodiment of the present invention;
fig. 5 is a schematic diagram of data stored in a quality control calculator according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of source data provided by an embodiment of the present invention;
fig. 7 is an example of a processing procedure of the data memory provided by the embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be described in detail below. It will be apparent that the described embodiments are only some, but not all, embodiments of the invention. All other embodiments, based on the examples herein, which are within the scope of the invention as defined by the claims, will be within the scope of the invention as defined by the claims.
Example 1
As shown in fig. 1, the present embodiment provides a quality control system for a public area sanitary platform, which includes a column-type storage database, a data reader, a quality control calculator, a data memory, a flow controller and a configurator. The system is further described below with reference to the accompanying drawings.
The column type storage database is a storage mode based on HBase. The source data is converted into columnar storage by the ETL method. The storage structure is transformed as shown in fig. 2. And the data are converted into column-type storage data, so that the query efficiency is improved. The data quality control, the minimum dimension is a field, and the data is converted into a column type storage mode, so that invalid data can be removed to the greatest extent when the data is subjected to joint query, and the query efficiency of the data is greatly improved in a quality control scene with huge data quantity.
The configurator includes a rule mapping configurator and a rule-data set configurator. The rule mapping configurator is used for storing the configuration information of the quality control rule codes and the quality control rule algorithm in the quality control calculator. For example, a field null judgment algorithm NullSegment in the quality control calculator is configured with Rule1 in the Rule mapping configurator. The rule-data set configurator is configured to configure the quality control rule configured by the rule mapper with the fields in the data table to form a (rule set, data set) configuration relationship, and it should be noted that the data quality control rule and the table field are in a many-to-one relationship, as shown in fig. 3. The quality control rule algorithm is the prior art, and is not described herein.
And the data reader reads the column type storage database data in batches. Four works are mainly completed, configuration is read from a configurator, a quality control rule set and a data set are mapped into a relation (rule set, data set), and mapping of quality control rules and fields is completed; determining the quantity of read data of each batch according to the input of the flow controller; the data reader sequentially transmits the data to the next step according to the processing capacity of the subsequent node units; the data reader includes an internal register in which the data locations that have been entered into the quality control calculator are stored. The reading flow of the data reader is shown in fig. 4.
The quality control calculator consists of a plurality of quality control rule algorithms. The quality control calculator itself also needs to combine different algorithm units in algorithm unit. And receiving data input by the data reader, completing algorithm calculation together, and outputting a quality control result to a data memory. The quality control rule algorithm codes and configuration information of the quality control rule algorithm are also stored in the quality control calculator, as shown in fig. 5.
And the data storage organizes data according to the quality control rule dimension and the table dimension and writes the data into the result database. The original data is assumed to be three tables, namely a table a, a table B and a table D, wherein two fields in the table a are respectively represented by a field 1 and a field 2, and the corresponding data are respectively a data set 1 and a data set 2, the same table B is provided with the data set 1, and the table D is provided with the data set 1, as shown in fig. 6. There are three rules, rule1, rule 2, rule 3, respectively.
Meanwhile, there are now rule1, rule 2, rule 3. The configurator implements that rule1, rule 2 and rule 3 are respectively applied to the data sets in the table in fig. 6. Namely, (R1R 2R3, dataSetA 1), (R1R 2R3, dataSetA 2), (R1R 2R3, dataSetB 1), (R1R 2R3, dataSetC 1). The data reader reads the data in batches according to the rules, and the data are respectively transmitted into the data storage according to batches after being calculated according to the quality control rules.
The data store splits and stores data as follows, as illustrated by example in figure 7,
step one, the data storage stores quality control result data;
step two, merging quality control result data according to batches; triggering merging when the cacheable data amount in the data memory reaches a preset amount;
splitting the combined quality control result data according to a quality control rule;
and step four, merging data sets in the data table of the same column type storage database according to the quality control rule.
After the four steps are completed, the data are written into a quality control result database.
The flow controller, the minimum reading speed of the reader, the minimum calculating speed of the quality control calculator and the minimum writing speed of the data memory balance throughput among the three according to the minimum data processing capacity of the three, and ensure that the data volume in the whole reading, calculating and writing process is not overstocked and is not broken down due to overtime of the system.
Example 2
The embodiment provides a quality control method for a public area sanitary platform, which uses the quality control system for the public area sanitary platform as described in embodiment 1 to perform quality control, and comprises the following steps:
converting the structured data of the source data into a columnar storage database by an ETL tool;
initializing a configurator and reading configuration information; the method comprises the steps of firstly, reading mapping rule configuration of a quality control algorithm in a quality control calculator; a second configuration is carried out, and the mapping relation among each table, each field and the quality control rule set is read;
the flow controller calculates the minimum reading speed of the data reader, the minimum calculating speed of the quality control calculator and the minimum writing speed of the data memory, and takes the minimum value VolumeUnit of the three;
the data reader reads the data in the column-type storage database according to the configuration information of the configurator and the reading speed VolumeUnit, and transmits the read data to the quality control calculator;
the quality control calculator performs quality control verification on the input data and outputs a quality control result;
and the data storage receives the quality control result, splits the quality control result data according to the quality control rule dimension and the table dimension in the column type storage database, and outputs the split quality control result data.
Preferably, the quality control calculator calculates the input data in combination with the Spark matrix to perform quality control verification.
It is to be understood that the same or similar parts in the above embodiments may be referred to each other, and that in some embodiments, the same or similar parts in other embodiments may be referred to.
The quality control system and the quality control method for the public area sanitary platform provided by the embodiment have the following advantages:
(1) And the column storage is introduced, so that the reading and writing capability is greatly improved. In the prior line storage system, the whole line of fields are read in every time data is read, a large amount of condition judgment is needed in SQL grammar, so that SQL maintenance cost is high, in order to reduce SQL cost, the whole line of data is read, and performance is greatly reduced (because quality control verification generally only carries out quality control rule algorithm calculation on a single field, and the reading calculation of the whole line of data brings about that a large amount of fields which do not need to be calculated occupy memory, and calculation resources are wasted, and meanwhile, the calculation speed is reduced).
(2) The quality control processing speed is dynamically adjustable, so that data loss or system breakdown is avoided. In the prior art, the quality control process reads how much data is processed, and the conditions of inconsistent read-write speed and data calculation speed often occur in the system. Resulting in backlog of data at some links. Under the condition of huge data volume, unpredictable data loss and system breakdown are often caused, and finally, quality control results are unsatisfactory.
(3) The matrix calculation of Spark is introduced, and each calculation dynamic state can be decomposed into small calculations by utilizing the RDD characteristic of the Spark bottom layer, so that the distributed characteristic of a big data system is fully utilized, and the calculation capacity and speed of the whole system can be conveniently expanded.
(4) The interaction is more friendly, and the traditional quality control calculation can be carried out only when all data result calculation is completed, so that the whole data can be loaded to the front-end page for display, and the page loading also needs a few minutes, so that the display effect and the unfriendly performance are caused. According to the scheme, the calculated quality control result can be transmitted to the front-end page in real time, the quality control result is dynamically displayed on the page, and interaction is more elegant.
While embodiments of the present invention have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the invention, and that variations, modifications, alternatives and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the invention.
Claims (8)
1. The public area sanitary platform quality control system is characterized by comprising a column type storage database, a data reader, a quality control calculator, a data memory and a configurator;
the column storage database is used for converting input source data into column storage;
the configurator is used for storing configuration information of the quality control rule codes and the quality control rule algorithm in the quality control calculator and configuring fields in the data table of the quality control rule and the column type storage database to form a configuration relation (rule set, data set);
the data reader is used for reading configuration from the configurator and mapping quality control rules and fields; the data in the column type storage database is read in batches and transmitted to the quality control calculator;
the quality control calculator comprises a plurality of quality control rule algorithms which are used for receiving the data input by the data reader and performing quality control verification on the data to obtain quality control results and transmitting the quality control results to the data memory;
the data storage is connected with the quality control result data output by the quality control calculator, and the quality control result data is split according to the quality control rule dimension and the table dimension in the column type storage database and then output;
the system also comprises a flow controller, wherein the flow controller is used for balancing throughput among the data reader, the quality control calculator and the data storage according to the minimum data processing capacity per unit time;
the data storage splits and outputs quality control result data according to quality control rules according to quality control rule dimensions and table dimensions in a column type storage database, and the method comprises the following steps:
the data memory stores quality control result data;
combining quality control result data according to batches;
splitting the combined quality control result data according to the quality control rule;
and merging data sets in the data table of the same column type storage database according to the quality control rule.
2. The public area sanitary platform quality control system of claim 1, wherein the configurator comprises a rule mapping configurator and a rule-data set configurator;
the rule mapping configurator is used for storing configuration information of the quality control rule codes and the quality control rule algorithm in the quality control calculator;
the rule-data set configurator is used for configuring the quality control rule configured by the rule mapping configurator and fields in a data table of the columnar storage database to form a configuration relation (rule set, data set).
3. The public area sanitary platform quality control system of claim 1, wherein the data reader further comprises an internal register for transmitting a save to a data location of the quality control calculator.
4. The public area sanitary platform quality control system according to claim 1, wherein the data reader is configured to determine how much data to read per batch based on the input from the fluidics device.
5. The public area sanitary platform quality control system according to claim 1, wherein the quality control calculator further stores quality control rule algorithm codes and configuration information of the quality control rule algorithm.
6. The public area sanitation platform quality control system according to claim 1, further comprising a quality control result database and a display, wherein the quality control result database is used for receiving and storing quality control result data output by the data storage, and the display is used for displaying the quality control result data in real time.
7. A quality control method for a public area sanitary platform, which is characterized by using the quality control system for the public area sanitary platform according to any one of claims 1 to 6 for quality control, comprising the following steps:
converting the structured data of the source data into a columnar storage database by an ETL tool;
initializing a configurator and reading configuration information;
the flow controller calculates the minimum reading speed of the data reader, the minimum calculating speed of the quality control calculator and the minimum writing speed of the data memory, and takes the minimum value VolumeUnit of the three;
the data reader reads the data in the column-type storage database according to the configuration information of the configurator and the reading speed VolumeUnit, and transmits the read data to the quality control calculator;
the quality control calculator performs quality control verification on the input data and outputs a quality control result;
and the data storage receives the quality control result, splits the quality control result data according to the quality control rule dimension and the table dimension in the column type storage database, and outputs the split quality control result data.
8. The method according to claim 7, wherein the quality control calculator calculates the quality control check by combining the input data with Spark matrix.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011628425.9A CN112667618B (en) | 2020-12-30 | 2020-12-30 | Public area sanitary platform quality control system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011628425.9A CN112667618B (en) | 2020-12-30 | 2020-12-30 | Public area sanitary platform quality control system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112667618A CN112667618A (en) | 2021-04-16 |
| CN112667618B true CN112667618B (en) | 2023-06-06 |
Family
ID=75412747
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011628425.9A Active CN112667618B (en) | 2020-12-30 | 2020-12-30 | Public area sanitary platform quality control system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112667618B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104391903A (en) * | 2014-11-14 | 2015-03-04 | 广州科腾信息技术有限公司 | Distributed storage and parallel calculation-based power grid data quality detection method |
| CN107679146A (en) * | 2017-09-25 | 2018-02-09 | 南方电网科学研究院有限责任公司 | Power grid data quality verification method and system |
| CN108595563A (en) * | 2018-04-13 | 2018-09-28 | 林秀丽 | A kind of data quality management method and device |
| CN108595664A (en) * | 2018-04-28 | 2018-09-28 | 尚谷科技（天津）有限公司 | A kind of agricultural data monitoring method under hadoop environment |
| CN109933581A (en) * | 2019-03-01 | 2019-06-25 | 武汉达梦数据库有限公司 | A kind of data quality checking method and system |
| CN109947746A (en) * | 2017-10-26 | 2019-06-28 | 亿阳信通股份有限公司 | A kind of quality of data management-control method and system based on ETL process |
| CN111897806A (en) * | 2020-06-28 | 2020-11-06 | 苏宁金融科技(南京)有限公司 | Big data offline data quality inspection method and device |
| CN112115121A (en) * | 2020-11-20 | 2020-12-22 | 陕西云基华海信息技术有限公司 | Data governance real-time data quality detection system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10565172B2 (en) * | 2017-02-24 | 2020-02-18 | International Business Machines Corporation | Adjusting application of a set of data quality rules based on data analysis |
-
2020
- 2020-12-30 CN CN202011628425.9A patent/CN112667618B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104391903A (en) * | 2014-11-14 | 2015-03-04 | 广州科腾信息技术有限公司 | Distributed storage and parallel calculation-based power grid data quality detection method |
| CN107679146A (en) * | 2017-09-25 | 2018-02-09 | 南方电网科学研究院有限责任公司 | Power grid data quality verification method and system |
| CN109947746A (en) * | 2017-10-26 | 2019-06-28 | 亿阳信通股份有限公司 | A kind of quality of data management-control method and system based on ETL process |
| CN108595563A (en) * | 2018-04-13 | 2018-09-28 | 林秀丽 | A kind of data quality management method and device |
| CN108595664A (en) * | 2018-04-28 | 2018-09-28 | 尚谷科技（天津）有限公司 | A kind of agricultural data monitoring method under hadoop environment |
| CN109933581A (en) * | 2019-03-01 | 2019-06-25 | 武汉达梦数据库有限公司 | A kind of data quality checking method and system |
| CN111897806A (en) * | 2020-06-28 | 2020-11-06 | 苏宁金融科技(南京)有限公司 | Big data offline data quality inspection method and device |
| CN112115121A (en) * | 2020-11-20 | 2020-12-22 | 陕西云基华海信息技术有限公司 | Data governance real-time data quality detection system |
Non-Patent Citations (1)
| Title |
|---|
| 区域卫生信息平台数据质量控制模式研究;夏寒等;《中国卫生信息管理杂志》;20160620(第03期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112667618A (en) | 2021-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10176208B2 (en) | Processing time series data from multiple sensors | |
| CN110990638B (en) | Large-scale data query acceleration device and method based on FPGA-CPU heterogeneous environment | |
| US20190318231A1 (en) | Method for acceleration of a neural network model of an electronic euqipment and a device thereof related appliction information | |
| CN110413611B (en) | Data storage and query method and device | |
| US8489555B2 (en) | Method of managing storage and retrieval of data objects | |
| US11468093B2 (en) | Synopsis based advanced partition elimination | |
| JP7382233B2 (en) | Parallel computation offload to database accelerators | |
| US11734258B2 (en) | Constraint data statistics | |
| JP2024009919A (en) | Device for storing storage object data | |
| CN114297258B (en) | Method and equipment for acquiring comprehensive arrangement data of multi-column data | |
| US20220253668A1 (en) | Data processing method and device, storage medium and electronic device | |
| WO2017107130A1 (en) | Data query method and database system | |
| CN113535745B (en) | Hierarchical database operation acceleration system and method | |
| CN112667618B (en) | Public area sanitary platform quality control system and method | |
| CN110704404A (en) | Data quality checking method, device and system | |
| CN113312344A (en) | Data serialization and deserialization method, device, system, medium and product | |
| JPWO2005041067A1 (en) | Information processing method and information processing system | |
| US11061876B2 (en) | Fast aggregation on compressed data | |
| KR102479261B1 (en) | Method for restoring huge lod query result using mapreduce and apparatus thereof | |
| CN112286995A (en) | Data analysis method, device, server, system and storage medium | |
| US20230168809A1 (en) | Intelligence processor device and method for reducing memory bandwidth | |
| US20230068947A1 (en) | Systems and methods for processing inter-dependent data for risk modelling and analysis | |
| CN116757913A (en) | Matrix data processing method, device, computer equipment and storage medium | |
| JP2024131004A (en) | Method and database system for optimizing query processing execution method | |
| CN116911270A (en) | Form template generation method, apparatus, device, storage medium and program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |