CN112667618A - Public area sanitation platform quality control system and method - Google Patents
Public area sanitation platform quality control system and method Download PDFInfo
- Publication number
- CN112667618A CN112667618A CN202011628425.9A CN202011628425A CN112667618A CN 112667618 A CN112667618 A CN 112667618A CN 202011628425 A CN202011628425 A CN 202011628425A CN 112667618 A CN112667618 A CN 112667618A
- Authority
- CN
- China
- Prior art keywords
- quality control
- data
- rule
- calculator
- configurator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a public area sanitation platform quality control system and a method, wherein the system comprises a column type storage database, a data reader, a quality control calculator, a data memory and a configurator; the columnar storage database is used for converting input source data into columnar storage; the configurator is used for storing the quality control rule codes and the configuration information of a quality control rule algorithm in the quality control calculator and configuring the quality control rules and fields in a data table of the column type storage database to form a configuration relation of a rule set and a data set; the data reader reads data in batches according to the rules, and the data are respectively transmitted into the data memory in batches after being calculated by the quality control rules. The data processing method has the advantages that the data processing method is converted into a column type storage mode, invalid data can be removed to the maximum extent when the data are subjected to combined query, and the query efficiency of the data is greatly improved. The problem that quality control results are difficult to output intuitively, rapidly and efficiently under the conditions of large data volume and limited hardware resources is solved.
Description
Technical Field
The invention relates to the field of public area sanitation platform data quality control, in particular to a public area sanitation platform quality control system and method.
Background
In the current data quality control mode of the regional sanitation platform, the data of source data is read, and simultaneously, the preset quality control rules are read to carry out rule verification on each field of each row. The quality control rules and the current processing modes of the source data are divided into two types, namely, the quality control rules are configured into SQL sentences through a storage process, the data quality control is completed in the data query process, and a quality control table structure is output. In the mode, the quality control rule is written into the SQL statement, so that the quality control calculation complexity is greatly increased, and the hardware IO read-write requirement on the environment where the database is located is higher due to the SQL complexity. And the quality control rules are disordered and the maintenance cost is high.
In another mode, source data are read, the quality control rule is read into a memory, and the data quality control rule is verified through memory calculation. In the method, the calculation performance of the data is increased, but the requirement on the memory of the data is high, the hardware cost and the threshold are increased, and meanwhile, the writing performance of the calculation result is not controlled in a scientific mode because the calculation performance of the data is only increased, so that the calculation performance result cannot be written into a result library for display even though the calculation performance result is completed.
In any way, under the conditions of huge data volume and limited hardware resources, the quality control result is difficult to be intuitively, rapidly and efficiently output to a front-end page for display, the hardware becomes a calculation bottleneck in a quality control scene, the quality control verification of source data is often faced for dozens of or even hundreds of hours, and finally the output of the quality control result is completed.
Disclosure of Invention
The invention provides a public area sanitation platform quality control system and method, which aim to solve the problem that the quality control result is difficult to output intuitively, quickly and efficiently under the conditions of large data volume and limited hardware resources in the existing public area sanitation platform quality control scheme.
In a first aspect, a public area sanitation platform quality control system is provided, which comprises a column type storage database, a data reader, a quality control calculator, a data storage and a configurator;
the columnar storage database is used for converting input source data into columnar storage;
the configurator is used for storing the quality control rule codes and the configuration information of a quality control rule algorithm in the quality control calculator and configuring the quality control rules and fields in a data table of the column type storage database to form a configuration relation of a rule set and a data set;
the data reader is used for reading configuration from the configurator and mapping quality control rules and fields; the system comprises a quality control calculator, a data storage database and a data processing module, wherein the quality control calculator is used for reading data in the column storage database in batches and transmitting the data to the quality control calculator;
the quality control calculator comprises a plurality of quality control rule algorithms and is used for receiving the data input by the data reader and carrying out quality control verification on the data to obtain a quality control result and transmitting the quality control result to the data memory;
the data memory is connected with and receives the quality control result data output by the quality control calculator, and splits the quality control result data according to the quality control rule dimensionality and the table dimensionality in the column type storage database and then outputs the split quality control result data.
Further, the flow controller is used for balancing the throughput among the data reader, the quality control calculator and the data storage according to the minimum data processing capacity per unit time.
Further, the configurator includes a rule mapping configurator and a rule-data set configurator;
the rule mapping configurator is used for storing the configuration information of the quality control rule codes and the quality control rule algorithm in the quality control calculator;
the rule-data set configurator is used for configuring the quality control rules configured by the rule mapping configurator and fields in the data tables of the columnar storage database to form a configuration relation of (rule set, data set).
Further, the data reader further comprises an internal register for transmitting a save to the data location of the quality control calculator.
Further, the data reader is used for determining the quantity of data read in each batch according to the input of the flow controller.
Further, the quality control calculator also stores the quality control rule algorithm code and the configuration information of the quality control rule algorithm.
Furthermore, the data storage device divides the quality control result data according to the quality control rule dimension and the table dimension in the column type storage database and then outputs the quality control result data, and the method comprises the following steps:
the data memory stores quality control result data;
merging quality control result data according to batches;
splitting the merged quality control result data according to a quality control rule;
and merging data set data in data tables of the same column storage database according to the quality control rule.
The system further comprises a quality control result database and a display, wherein the quality control result database is used for receiving and storing quality control result data output by the data storage, and the display is used for displaying the quality control result data in real time.
In a second aspect, a public area sanitation platform quality control method is provided, which uses the public area sanitation platform quality control system as described above to perform quality control, and includes the following steps:
converting structured data of the source data into a columnar storage database through an ETL tool;
initializing a configurator and reading configuration information;
the flow controller calculates the minimum reading speed of the data reader, the minimum calculating speed of the quality control calculator and the minimum writing speed of the data memory, and takes the minimum VolumeUnit of the three;
the data reader reads data in the column storage database according to the configuration information of the configurator and the reading speed VolumeUnit in a combined mode, and transmits the read data to the quality control calculator;
the quality control calculator performs quality control verification on the input data and outputs a quality control result;
and the data storage receives the quality control result, splits the quality control result data according to the quality control rule dimension and the table dimension in the column type storage database and outputs the split quality control result data.
Further, the quality control calculator calculates the input data by combining the Spark matrix to perform quality control verification. The matrix calculation of Spark is introduced, and by utilizing the RDD characteristic of Spark bottom layer, each calculation can be dynamically decomposed into small calculations, thus fully utilizing the distributed characteristic of large data system and conveniently expanding the calculation capability and speed of the whole system.
Advantageous effects
The invention provides a public area sanitation platform quality control system and method, which have the following advantages:
(1) and the columnar storage is introduced, so that the read-write capability is greatly increased. In the conventional line storage system, the whole line of fields are read in every time data is read, a large amount of condition judgment needs to be carried out in SQL grammar, so that the SQL maintenance cost is high, the whole line of data is read in order to reduce the SQL cost, and the performance is greatly reduced (because the quality control check generally only carries out the calculation of a quality control rule algorithm aiming at a single field, and the reading calculation of the whole line of data brings that a large amount of fields which do not need to be calculated occupy in a memory, thereby wasting calculation resources and reducing the calculation speed).
(2) The quality control processing speed can be dynamically adjusted, and data loss or system crash is avoided. In the conventional quality control processing, how much data is read and how much data is processed, and the situation that the reading and writing speed and the data calculation speed are inconsistent often occurs inside a system. Resulting in data being backlogged at some point. Under the condition of huge data quantity, unpredictable data loss and system crash are often caused, and finally the quality control result is unsatisfactory.
(3) Interaction is more friendly, in the past, quality control calculation can be carried out, only when all data results are calculated, the data can be loaded to a front-end page to be displayed, the page loading also needs several minutes, and the display effect is not friendly. According to the scheme, the calculated quality control result can be transmitted to the front-end page in real time, the page dynamically shows the quality control result, and interaction is more elegant.
(4) The problem that the quality control result is difficult to output intuitively, rapidly and efficiently under the conditions of large data volume and limited hardware resources in the existing public area health platform quality control scheme is solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic structural diagram of a public area sanitation platform quality control system provided by an embodiment of the invention;
FIG. 2 is a schematic diagram of converting source data into columnar stores provided by an embodiment of the present invention;
FIG. 3 is a schematic diagram of the configuration relationship (rule set, data set) provided by the embodiment of the present invention;
FIG. 4 is a read flow chart of a data reader provided by an embodiment of the present invention;
FIG. 5 is a diagram illustrating data stored in a quality control calculator according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of source data provided by an embodiment of the invention;
fig. 7 is an example of a processing procedure of the data storage provided by the embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be described in detail below. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the examples given herein without any inventive step, are within the scope of the present invention.
Example 1
As shown in fig. 1, the present embodiment provides a public area sanitation platform quality control system, which includes a column storage database, a data reader, a quality control calculator, a data storage, a flow controller, and a configurator. The system is further described with reference to the accompanying drawings.
And the columnar storage database is a storage mode based on HBase. And converting the source data into columnar storage in an ETL mode. The storage structure is transformed as shown in fig. 2. And the data are converted into columnar storage data, so that the query efficiency is improved. Data quality control is carried out, the minimum dimension is a field, a column type storage mode is converted, invalid data can be removed to the maximum degree when data are jointly queried, and data query efficiency is greatly improved in a quality control scene with huge data volume.
The configurator includes a rule mapping configurator and a rule-data set configurator. And the rule mapping configurator is used for storing the quality control rule codes and the configuration information of the quality control rule algorithm in the quality control calculator. For example, the field emptying algorithm NullSegment in the quality control calculator is matched with Rule1 in the Rule mapping configurator. And a rule-data set configurator, configured to configure the quality control rule configured by the rule mapper with the field in the data table to form a (rule set, data set) configuration relationship, where it is to be noted that the data quality control rule and the table field are in a many-to-one relationship, as shown in fig. 3. The quality control rule algorithms are all in the prior art, and are not described herein again.
And the data reader reads the column storage database data in batches. The method mainly completes four works, reads configuration from a configurator, maps a quality control rule set and a data set into a relation of (rule set, data set), and well maps the quality control rule and a field; determining the amount of data read in each batch according to the input of the flow controller; the data reader orderly transmits the data to the next step according to the processing capacity of the subsequent node unit; the data reader includes an internal register in which the data locations that have been passed into the quality control calculator are stored. The reading flow of the data reader is shown in fig. 4.
The quality control calculator is internally composed of individual quality control rule algorithms. The quality control calculator itself needs to combine different algorithm units in units of algorithm units. And receiving data input by the data reader, completing algorithm calculation together, and outputting a quality control result to the data memory. The quality control rule algorithm code and the configuration information of the quality control rule algorithm are also stored in the quality control calculator, as shown in fig. 5.
And the data memory organizes data according to the quality control rule dimension and the table dimension and writes the data into the result database. The original data is assumed to have three tables, namely a table a, a table B and a table D, wherein two fields in the table a are respectively represented by a field 1 and a field 2, and the corresponding data are respectively a data set 1 and a data set 2, the same table B has the data set 1, and the table D has the data set 1, as shown in fig. 6. There are three rules, rule1, rule 2, and rule 3.
At the same time, rule1, rule 2, rule 3 are now present. The rule1, rule 2 and rule 3 are implemented in the configurator and applied to the data sets in the table in fig. 6. Namely (R1R2R3, DataSetA1), (R1R2R3, DataSetA2), (R1R2R3, DataSetB1), (R1R2R3, DataSetC 1). The data reader reads data in batches according to the rules, and the data are respectively transmitted into the data memory in batches after being calculated by the quality control rules.
The data store splits the data and stores the data as follows, as shown by way of example in figure 7,
step one, the data memory stores quality control result data;
step two, merging quality control result data according to batches; triggering and merging when the amount of the data which can be cached in the data memory reaches a preset amount;
step three, splitting the merged quality control result data according to a quality control rule;
and step four, merging data set data in the data tables of the same column type storage database according to quality control rules.
And after the four steps are completed, writing the data into a quality control result database.
The flow controller balances the throughput among the minimum reading speed of the reader, the minimum calculating speed of the quality control calculator and the minimum writing speed of the data memory according to the minimum data processing capacity of the reader, the minimum calculating speed of the quality control calculator and the minimum writing speed of the data memory, and ensures that the data volume in the whole reading, calculating and writing process is not overstocked to cause overtime and breakdown of a system.
Example 2
The embodiment provides a quality control method for a public area sanitation platform, which uses the quality control system for the public area sanitation platform described in embodiment 1 to perform quality control, and comprises the following steps:
converting structured data of the source data into a columnar storage database through an ETL tool;
initializing a configurator and reading configuration information; the method comprises the steps of configuring one, reading mapping rule configuration of a quality control algorithm in a quality control calculator; secondly, reading the mapping relation among the tables, the fields and the quality control rule set;
the flow controller calculates the minimum reading speed of the data reader, the minimum calculating speed of the quality control calculator and the minimum writing speed of the data memory, and takes the minimum VolumeUnit of the three;
the data reader reads data in the column storage database according to the configuration information of the configurator and the reading speed VolumeUnit in a combined mode, and transmits the read data to the quality control calculator;
the quality control calculator performs quality control verification on the input data and outputs a quality control result;
and the data storage receives the quality control result, splits the quality control result data according to the quality control rule dimension and the table dimension in the column type storage database and outputs the split quality control result data.
Preferably, the quality control calculator performs quality control verification by combining the input data with Spark matrix calculation.
It is understood that the same or similar parts in the above embodiments may be mutually referred to, and the same or similar parts in other embodiments may be referred to for the content which is not described in detail in some embodiments.
The quality control system and method for the public area sanitation platform provided by the embodiment have the following advantages:
(1) and the columnar storage is introduced, so that the read-write capability is greatly increased. In the conventional line storage system, the whole line of fields are read in every time data is read, a large amount of condition judgment needs to be carried out in SQL grammar, so that the SQL maintenance cost is high, the whole line of data is read in order to reduce the SQL cost, and the performance is greatly reduced (because the quality control check generally only carries out the calculation of a quality control rule algorithm aiming at a single field, and the reading calculation of the whole line of data brings that a large amount of fields which do not need to be calculated occupy in a memory, thereby wasting calculation resources and reducing the calculation speed).
(2) The quality control processing speed can be dynamically adjusted, and data loss or system crash is avoided. In the conventional quality control processing, how much data is read and how much data is processed, and the situation that the reading and writing speed and the data calculation speed are inconsistent often occurs inside a system. Resulting in data being backlogged at some point. Under the condition of huge data quantity, unpredictable data loss and system crash are often caused, and finally the quality control result is unsatisfactory.
(3) The matrix calculation of Spark is introduced, and by utilizing the RDD characteristic of Spark bottom layer, each calculation can be dynamically decomposed into small calculations, thus fully utilizing the distributed characteristic of large data system and conveniently expanding the calculation capability and speed of the whole system.
(4) Interaction is more friendly, in the past, quality control calculation can be carried out, only when all data results are calculated, the data can be loaded to a front-end page to be displayed, the page loading also needs several minutes, and the display effect is not friendly. According to the scheme, the calculated quality control result can be transmitted to the front-end page in real time, the page dynamically shows the quality control result, and interaction is more elegant.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (10)
1. A public area sanitation platform quality control system is characterized by comprising a column type storage database, a data reader, a quality control calculator, a data memory and a configurator;
the columnar storage database is used for converting input source data into columnar storage;
the configurator is used for storing the quality control rule codes and the configuration information of a quality control rule algorithm in the quality control calculator and configuring the quality control rules and fields in a data table of the column type storage database to form a configuration relation of a rule set and a data set;
the data reader is used for reading configuration from the configurator and mapping quality control rules and fields; the system comprises a quality control calculator, a data storage database and a data processing module, wherein the quality control calculator is used for reading data in the column storage database in batches and transmitting the data to the quality control calculator;
the quality control calculator comprises a plurality of quality control rule algorithms and is used for receiving the data input by the data reader and carrying out quality control verification on the data to obtain a quality control result and transmitting the quality control result to the data memory;
the data memory is connected with and receives the quality control result data output by the quality control calculator, and splits the quality control result data according to the quality control rule dimensionality and the table dimensionality in the column type storage database and then outputs the split quality control result data.
2. The system of claim 1, further comprising a flow controller for balancing throughput among the data reader, the quality control calculator, and the data storage according to a minimum data processing capacity per unit time among the data reader, the quality control calculator, and the data storage.
3. The public area health platform quality control system of claim 2, wherein the configurator comprises a rule mapping configurator and a rule-data set configurator;
the rule mapping configurator is used for storing the configuration information of the quality control rule codes and the quality control rule algorithm in the quality control calculator;
the rule-data set configurator is used for configuring the quality control rules configured by the rule mapping configurator and fields in the data tables of the columnar storage database to form a configuration relation of (rule set, data set).
4. The public area health platform quality control system of claim 2, wherein the data reader further comprises an internal register for transmitting a save to the data location of the quality control calculator.
5. The system of claim 2, wherein the data reader is configured to determine how much data is read per batch based on input from the flow controller.
6. The system of claim 2, wherein the quality control calculator further stores a quality control rule algorithm code and configuration information of the quality control rule algorithm.
7. The public area health platform quality control system of claim 2, wherein the data storage splits the quality control result data according to the quality control rule dimensions and the table dimensions in the column-wise storage database and outputs the split quality control result data according to the quality control rules, comprising:
the data memory stores quality control result data;
merging quality control result data according to batches;
splitting the merged quality control result data according to a quality control rule;
and merging data set data in data tables of the same column storage database according to the quality control rule.
8. The public area health platform quality control system of claim 2, further comprising a quality control result database for receiving and storing the quality control result data outputted from the data storage, and a display for displaying the quality control result data in real time.
9. A public area health platform quality control method, wherein the quality control is performed by using the public area health platform quality control system according to any one of claims 2 to 8, comprising the steps of:
converting structured data of the source data into a columnar storage database through an ETL tool;
initializing a configurator and reading configuration information;
the flow controller calculates the minimum reading speed of the data reader, the minimum calculating speed of the quality control calculator and the minimum writing speed of the data memory, and takes the minimum VolumeUnit of the three;
the data reader reads data in the column storage database according to the configuration information of the configurator and the reading speed VolumeUnit in a combined mode, and transmits the read data to the quality control calculator;
the quality control calculator performs quality control verification on the input data and outputs a quality control result;
and the data storage receives the quality control result, splits the quality control result data according to the quality control rule dimension and the table dimension in the column type storage database and outputs the split quality control result data.
10. The method for quality control of a public area health platform according to claim 9, wherein the quality control calculator performs quality control verification by combining the input data with Spark matrix calculation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011628425.9A CN112667618B (en) | 2020-12-30 | 2020-12-30 | Public area sanitary platform quality control system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011628425.9A CN112667618B (en) | 2020-12-30 | 2020-12-30 | Public area sanitary platform quality control system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112667618A true CN112667618A (en) | 2021-04-16 |
| CN112667618B CN112667618B (en) | 2023-06-06 |
Family
ID=75412747
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011628425.9A Active CN112667618B (en) | 2020-12-30 | 2020-12-30 | Public area sanitary platform quality control system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112667618B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104391903A (en) * | 2014-11-14 | 2015-03-04 | 广州科腾信息技术有限公司 | Distributed storage and parallel calculation-based power grid data quality detection method |
| CN107679146A (en) * | 2017-09-25 | 2018-02-09 | 南方电网科学研究院有限责任公司 | The method of calibration and system of electric network data quality |
| US20180246912A1 (en) * | 2017-02-24 | 2018-08-30 | International Business Machines Corporation | Adjusting application of a set of data quality rules based on data analysis |
| CN108595563A (en) * | 2018-04-13 | 2018-09-28 | 林秀丽 | A kind of data quality management method and device |
| CN108595664A (en) * | 2018-04-28 | 2018-09-28 | 尚谷科技（天津）有限公司 | A kind of agricultural data monitoring method under hadoop environment |
| CN109933581A (en) * | 2019-03-01 | 2019-06-25 | 武汉达梦数据库有限公司 | A kind of data quality checking method and system |
| CN109947746A (en) * | 2017-10-26 | 2019-06-28 | 亿阳信通股份有限公司 | A kind of quality of data management-control method and system based on ETL process |
| CN111897806A (en) * | 2020-06-28 | 2020-11-06 | 苏宁金融科技(南京)有限公司 | Big data offline data quality inspection method and device |
| CN112115121A (en) * | 2020-11-20 | 2020-12-22 | 陕西云基华海信息技术有限公司 | Data governance real-time data quality detection system |
-
2020
- 2020-12-30 CN CN202011628425.9A patent/CN112667618B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104391903A (en) * | 2014-11-14 | 2015-03-04 | 广州科腾信息技术有限公司 | Distributed storage and parallel calculation-based power grid data quality detection method |
| US20180246912A1 (en) * | 2017-02-24 | 2018-08-30 | International Business Machines Corporation | Adjusting application of a set of data quality rules based on data analysis |
| CN107679146A (en) * | 2017-09-25 | 2018-02-09 | 南方电网科学研究院有限责任公司 | The method of calibration and system of electric network data quality |
| CN109947746A (en) * | 2017-10-26 | 2019-06-28 | 亿阳信通股份有限公司 | A kind of quality of data management-control method and system based on ETL process |
| CN108595563A (en) * | 2018-04-13 | 2018-09-28 | 林秀丽 | A kind of data quality management method and device |
| CN108595664A (en) * | 2018-04-28 | 2018-09-28 | 尚谷科技（天津）有限公司 | A kind of agricultural data monitoring method under hadoop environment |
| CN109933581A (en) * | 2019-03-01 | 2019-06-25 | 武汉达梦数据库有限公司 | A kind of data quality checking method and system |
| CN111897806A (en) * | 2020-06-28 | 2020-11-06 | 苏宁金融科技(南京)有限公司 | Big data offline data quality inspection method and device |
| CN112115121A (en) * | 2020-11-20 | 2020-12-22 | 陕西云基华海信息技术有限公司 | Data governance real-time data quality detection system |
Non-Patent Citations (1)
| Title |
|---|
| 夏寒等: "区域卫生信息平台数据质量控制模式研究", 《中国卫生信息管理杂志》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112667618B (en) | 2023-06-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110413611B (en) | Data storage and query method and device | |
| EP2885728B1 (en) | Hardware implementation of the aggregation/group by operation: hash-table method | |
| US20040225858A1 (en) | Systems and methods for processor memory allocation | |
| US11308053B2 (en) | Buffered data-loading in column-partitioned database tables | |
| JP2000187668A (en) | Grouping method and overlap excluding method | |
| CN111913955A (en) | Data sorting processing device, method and storage medium | |
| CN103942342A (en) | Memory database OLTP and OLAP concurrency query optimization method | |
| US20180373760A1 (en) | Parallel compute offload to database accelerator | |
| CN112882663B (en) | Random writing method, electronic equipment and storage medium | |
| US20230128085A1 (en) | Data aggregation processing apparatus and method, and storage medium | |
| CN113535745B (en) | Hierarchical database operation acceleration system and method | |
| US9275756B2 (en) | Semiconductor test device and method of generating address scramble using the same | |
| US10997175B2 (en) | Method for predicate evaluation in relational database systems | |
| CN111813709B (en) | High-speed parallel storage method based on FPGA (field programmable Gate array) memory and calculation integrated architecture | |
| CN112667618A (en) | Public area sanitation platform quality control system and method | |
| CN102663051A (en) | Method and system for searching content addressable memory | |
| US20220100814A1 (en) | Graphics processor and acceleration method thereof | |
| CN113448624A (en) | Data access method, device and system and AI accelerator | |
| CN108920097B (en) | Three-dimensional data processing method based on interleaving storage | |
| CN112286995B (en) | Data analysis method, device, server, system and storage medium | |
| WO2016007069A1 (en) | Device and method for performing a fourier transform on a three dimensional data set | |
| US20220229583A1 (en) | Ai algorithm operation accelerator and method thereof, computing system and non-transitory computer readable media | |
| US20220138338A1 (en) | Data replacement apparatus, data replacement method, and program | |
| CN113505825B (en) | Graph calculating device | |
| CN100504847C (en) | Method and apparatus for inverse discrete cosine transform implementation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |