CN111475489A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN111475489A CN111475489A CN202010292476.2A CN202010292476A CN111475489A CN 111475489 A CN111475489 A CN 111475489A CN 202010292476 A CN202010292476 A CN 202010292476A CN 111475489 A CN111475489 A CN 111475489A
- Authority
- CN
- China
- Prior art keywords
- data
- database
- processed
- target
- management table
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title abstract description 11
- 238000012545 processing Methods 0.000 claims abstract description 93
- 238000013523 data management Methods 0.000 claims abstract description 42
- 238000000034 method Methods 0.000 claims abstract description 23
- 238000004140 cleaning Methods 0.000 claims abstract description 21
- 238000013500 data storage Methods 0.000 claims description 6
- 238000013508 migration Methods 0.000 abstract description 12
- 230000005012 migration Effects 0.000 abstract description 12
- 230000010354 integration Effects 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 6
- 238000012423 maintenance Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000007418 data mining Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000007635 classification algorithm Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/219—Managing data history or versioning
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data processing method and a data processing device, wherein the method comprises the following steps: receiving a data management table, and configuring data processing rules corresponding to each database in the data management table; acquiring information of a database to be processed; determining a data processing rule corresponding to the database to be processed in the data management table based on the information of the database to be processed, and taking the data processing rule as a target processing rule; and processing the data in the database to be processed according to the target processing rule in the data management table, so that the integration of data cleaning and migration in each database and the standardization of the rule are realized, and the whole database is ensured to be in a benign state.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and an apparatus for data processing, a computing device, and a storage medium.
Background
The database includes a hierarchical database, a network database and a relational database. In the internet today, the most commonly used databases are primarily relational and non-relational databases.
Currently, enterprises use a plurality of databases, such as MySQ L database and Oracle database in a relational database, and open-source HBase database in a non-relational database, in the prior art, data in different types of databases is lack of unified management for a long time, and expired data in each database is not subjected to secondary data analysis and mining.
Disclosure of Invention
In view of this, embodiments of the present invention provide a data processing method, an apparatus, a computing device, and a storage medium, so as to solve technical defects in the prior art.
The embodiment of the invention discloses a data processing method, which comprises the following steps:
receiving a data management table, and configuring data processing rules corresponding to each database in the data management table;
acquiring information of a database to be processed;
determining a data processing rule corresponding to the database to be processed in the data management table based on the information of the database to be processed, and taking the data processing rule as a target processing rule;
and processing the data in the database to be processed according to the target processing rule in the data management table.
The embodiment of the invention also discloses a data processing device, which comprises:
the configuration module is configured to receive a data management table, and configure data processing rules respectively corresponding to each database in the data management table;
the acquisition module is configured to acquire information of a database to be processed;
the determining module is configured to determine a data processing rule corresponding to the database to be processed in the data management table based on the information of the database to be processed and take the data processing rule as a target processing rule;
and the processing module is configured to process the data in the database to be processed according to the target processing rule in the data management table.
The embodiment of the invention discloses a computing device, which comprises a memory, a processor and computer instructions stored on the memory and capable of running on the processor, wherein the processor executes the instructions to realize the steps of the data processing method.
The embodiment of the invention discloses a storage medium, which stores computer instructions, and the instructions are executed by a processor to realize the steps of the data processing method.
According to the data processing method, the data processing device, the computing equipment and the storage medium, the data management table is received, the data processing rule corresponding to each database is configured in the data management table, the information of the database to be processed is obtained, the data processing rule corresponding to the database to be processed in the data management table is determined based on the information of the database to be processed and is used as the target processing rule, namely, different databases to be processed respectively correspond to the data processing rules in the data management table, and therefore data in the database to be processed are processed according to the target processing rule corresponding to the database to be processed in the data management table. The problem of manual processing of cleaning and migration of historical data and running data in each database is solved, the integration of cleaning and migration of data in each database and the standardization of rules are realized, and the whole database is ensured to be in a benign state.
Drawings
FIG. 1 is a flow chart illustrating a method of data processing according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of the data processing apparatus according to the present invention;
FIG. 3 is a schematic structural diagram of a computing device according to an embodiment of the invention.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein, but rather construed as limited to the embodiments set forth herein.
The terminology used in the description of the one or more embodiments is for the purpose of describing the particular embodiments only and is not intended to be limiting of the description of the one or more embodiments. As used in one or more embodiments of the present specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present specification refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It will be understood that, although the terms first, second, etc. may be used herein in one or more embodiments to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first can also be referred to as a second and, similarly, a second can also be referred to as a first without departing from the scope of one or more embodiments of the present description. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
The invention provides a data processing method, a data processing device, a computing device and a storage medium, and the invention is described in detail with reference to fig. 1.
Fig. 1 shows a schematic flow diagram of a method of data processing according to an embodiment of the invention, comprising steps 102 to 108.
Step 102: and receiving a data management table, and configuring data processing rules corresponding to each database in the data management table.
The database can be a MySQ L database and an Oracle database in a relational database or an open-source HBase database in a non-relational database, and the data processing rules corresponding to each database are configured in the data management table.
Step 104: and acquiring the information of the database to be processed.
The database to be processed is a database that needs to process data, for example, the database to be processed is the MySQ L database, the database to be processed may also be another database, and the information of the database to be processed may be a library name.
Step 106: and determining a data processing rule corresponding to the database to be processed in the data management table based on the information of the database to be processed, and taking the data processing rule as a target processing rule.
And determining a data processing rule corresponding to the database to be processed in the data management table, for example, determining a data processing rule corresponding to the MySQ L database in the data management table and using the data processing rule as a target processing rule, where the target processing rule in the data management table is data of preset data storage time limit information.
And the data processing rule corresponding to the Oracle database in the data management table can be determined and used as a target processing rule, so that the integration of data cleaning and migration in each database and the standardization of the processing rule are realized, the following steps are performed to complete the processing of the data in the database to be processed, and the whole database is ensured to be in a benign state.
Step 108: and processing the data in the database to be processed according to the target processing rule in the data management table.
The data exceeding the preset data storage time limit information, which is based on the data exceeding the preset data storage time limit information in the target processing rule, for example, three years, may be historical data and running data,
and taking the historical data and the running data reaching the preset data storage time limit in the database to be processed as target data, and processing the target data in the database to be processed.
Along the above example, namely processing historical data and running data stored in the MySQ L database for a time limit exceeding three years.
The historical data and the running data in the target data comprise a large number of tables, and the basic information, the storage time limit and the table type of the tables in the target data are recorded, so that the subsequent query or recovery of the target data is facilitated.
Specifically, the processing of the data in the database to be processed in step 108 is realized through steps 1082 to 1086 described below.
Step 1082: and migrating the target data in the database to be processed to a distributed file system.
The Distributed File System (HDFS) opens a File name space to the outside and allows data to be stored in a File form, so that high-throughput data access can be provided, the HDFS is suitable for application to a large-scale data set, and the HDFS can achieve the purpose of streaming reading of File System data.
The target data may be extracted (Extract), converted (Transform), and loaded (load) from the pending database into the distributed file system via an ET L tool (Extract-Transform-L oad).
After the step, target data migrated in the distributed file system can be analyzed and mined through mapreduce technology.
MapReduce is used in a naive Bayes classification algorithm, a K-models clustering algorithm and an EC L AT frequent item set mining algorithm for data mining, and the MapReduce technology can effectively improve the efficiency of mass data mining on the premise of ensuring the accuracy of the algorithm.
Step 1084: and cleaning target data in the database to be processed.
After the target data in the database to be processed is migrated to the distributed file system, the target data in the database to be processed is deleted in this step.
Step 1086: and collecting log data generated by the target data in the database to be processed in the cleaning and transferring process.
In the step, the execution condition of the cleaning and the migration of the target data can be monitored by collecting the log data generated in the cleaning and the migration processes of the target data.
Firstly, the data processing rules corresponding to the databases to be processed in the data management table are determined and used as target processing rules, namely, different databases to be processed respectively correspond to the data processing rules in the data management table, so that the data in the databases to be processed are processed according to the target processing rules corresponding to the databases to be processed in the data management table. The problem of manual processing of cleaning and migration of historical data and running data in each database is solved, the integration of cleaning and migration of data in each database and the standardization of rules are realized, and the whole database is ensured to be in a benign state.
Secondly, the cleaned data is converted into a file mode and stored in a distributed file system of a Hadoop of a big data center, and the data migrated from a database to be processed in the distributed file system can be analyzed and mined through a MapReduce technology, so that secondary value is brought.
Finally, the invention plays a very key role in the Operation and maintenance of a Business Operation Support System (BOSS for short), effectively reduces the Operation and maintenance cost, improves the efficiency of the maintenance personnel for processing problems, and reduces misoperation caused by artificial migration.
In addition, the following tables are obtained by recording information generated in the process of cleaning and migrating the target data, and the following tables are specifically obtained:
crmi _ datarule _ info: the table mainly records information of data processing rules, specifically including owner, table name, storage time limit, table type, and the like. The user main program reads the table information for cleaning.
crmi _ datacfg _ info: this table is a table for configuring database information, and is used in connection with the database in association with the cri _ database _ info table.
crmi _ datalog _ info: the table records whether a certain table in the database to be processed has a cleaning operation, if so, the time state of the table is updated, and if not, a record is recorded.
crmi _ receiver _ info: the table is used for recovering data, and the cleaned data is recovered.
crmi _ process _ info: the table is used for setting the starting and stopping of the main program, and the number of threads can be configured.
cri _ dataexec _ info: this table is a table for recording a cleaning track, and if the program cleaning or recovery is successful, the program moves to the history table of this table, namely, crmi _ dataexec _ info _ his, and the erroneous data is retained in this table.
crmi _ dataexec _ info _ his: and recording a track table of the cleaning rule, and displaying information by matching with the page.
cri _ locking _ fact: a home repository of record tables.
Fig. 2 is a block diagram of a data processing apparatus according to an embodiment of the present specification, including:
a configuration module 202, configured to receive a data management table, and configure a data processing rule corresponding to each database in the data management table;
an obtaining module 204 configured to obtain information of a database to be processed;
a determining module 206, configured to determine, based on the information of the to-be-processed database, a data processing rule corresponding to the to-be-processed database in the data management table and take the data processing rule as a target processing rule;
and the processing module 208 is configured to process the data in the database to be processed according to the target processing rule in the data management table.
The processing module 208 is further configured to:
storing time limit information based on preset data in the target processing rule;
and taking the historical data and the running data reaching the preset data storage time limit in the database to be processed as target data, and processing the target data in the database to be processed.
The processing module 208 is further configured to:
migrating the target data in the database to be processed to a distributed file system;
cleaning target data in the database to be processed;
and collecting log data generated by the target data in the database to be processed in the cleaning and transferring process.
The device further comprises:
a recording module configured to record basic information of a table in the target data, a stored time limit, and a table type.
The invention firstly solves the problem of manually processing the cleaning and migration of historical data and running data in each database, realizes the integration and the standardization of the rules of the cleaning and the migration of the data in each database, and ensures that the whole database is in a benign state.
Secondly, the cleaned data is converted into a file mode and stored in a distributed file system of a Hadoop of a big data center, and the data migrated from a database to be processed in the distributed file system can be analyzed and mined through a MapReduce technology, so that secondary value is brought.
Finally, the invention plays a very key role in the Operation and maintenance of a Business Operation Support System (BOSS for short), effectively reduces the Operation and maintenance cost, improves the efficiency of the maintenance personnel for processing problems, and reduces misoperation caused by artificial migration.
Fig. 3 is a block diagram illustrating a configuration of a computing device 300 according to an embodiment of the present description. The components of the computing device 300 include, but are not limited to, memory 310 and processor 320. The processor 320 is coupled to the memory 310 via a bus 330 and the database 350 is used to store data.
The computing device 300 also includes AN access device 340, the access device 340 enabling the computing device 300 to communicate via one or more networks 360. examples of such networks include a Public Switched Telephone Network (PSTN), a local area network (L AN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the Internet the access device 340 may include one or more of any type of network interface, e.g., a Network Interface Card (NIC), wired or wireless, such as AN IEEE802.11 Wireless local area network (W L AN) wireless interface, a Global microwave Internet Access (Wi-MAX) interface, AN Ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a Bluetooth interface, a Near Field Communication (NFC) interface, and so forth.
In one embodiment of the present description, the above-described components of computing device 300 and other components not shown in FIG. 3 may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device architecture shown in FIG. 3 is for purposes of example only and is not limiting as to the scope of the description. Those skilled in the art may add or replace other components as desired.
Computing device 300 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), a mobile phone (e.g., smartphone), a wearable computing device (e.g., smartwatch, smartglasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 300 may also be a mobile or stationary server.
An embodiment of the present invention further provides a computing device, which includes a memory, a processor, and computer instructions stored in the memory and executable on the processor, and when the processor executes the instructions, the steps of the method for processing data are implemented as described above.
An embodiment of the present invention further provides a storage medium storing computer instructions, which when executed by a processor implement the steps of the method for data processing as described above.
The above is an illustrative scheme of a storage medium of the present embodiment. It should be noted that the technical solution of the storage medium and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the storage medium can be referred to the description of the technical solution of the data processing method.
The computer instructions comprise computer program code which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, etc. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
It should be noted that, for the sake of simplicity, the above-mentioned method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present invention is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no acts or modules are necessarily required of the invention.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. Alternative embodiments are not exhaustive and do not limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.
Claims (7)
1. A method of data processing, comprising:
receiving a data management table, and configuring data processing rules corresponding to each database in the data management table;
acquiring information of a database to be processed;
determining a data processing rule corresponding to the database to be processed in the data management table based on the information of the database to be processed, and taking the data processing rule as a target processing rule;
and processing the data in the database to be processed according to the target processing rule in the data management table.
2. The method of claim 1, wherein processing the data in the pending database according to the target processing rule in the data management table comprises:
storing time limit information based on preset data in the target processing rule;
and taking the historical data and the running data reaching the preset data storage time limit in the database to be processed as target data, and processing the target data in the database to be processed.
3. The method of claim 2, wherein processing the target data in the database to be processed comprises:
migrating the target data in the database to be processed to a distributed file system;
cleaning target data in the database to be processed;
and collecting log data generated by the target data in the database to be processed in the cleaning and transferring process.
4. The method of claim 3, further comprising, prior to migrating the target data in the pending database to the distributed file system:
and recording the basic information, the stored time limit and the table type of the table in the target data.
5. An apparatus for data processing, comprising:
the configuration module is configured to receive a data management table, and configure data processing rules respectively corresponding to each database in the data management table;
the acquisition module is configured to acquire information of a database to be processed;
the determining module is configured to determine a data processing rule corresponding to the database to be processed in the data management table based on the information of the database to be processed and take the data processing rule as a target processing rule;
and the processing module is configured to process the data in the database to be processed according to the target processing rule in the data management table.
6. A computing device comprising a memory, a processor, and computer instructions stored on the memory and executable on the processor, wherein the processor implements the steps of the method of any one of claims 1-4 when executing the instructions.
7. A storage medium storing computer instructions, characterized in that the instructions, when executed by a processor, implement the steps of the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010292476.2A CN111475489A (en) | 2020-04-14 | 2020-04-14 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010292476.2A CN111475489A (en) | 2020-04-14 | 2020-04-14 | Data processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111475489A true CN111475489A (en) | 2020-07-31 |
Family
ID=71752463
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010292476.2A Pending CN111475489A (en) | 2020-04-14 | 2020-04-14 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111475489A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7146357B2 (en) * | 2003-03-17 | 2006-12-05 | Hitachi, Ltd. | Database system, server, query posing method, and data updating method |
| CN102323945A (en) * | 2011-09-02 | 2012-01-18 | 南京中兴力维软件有限公司 | SQL (Structured Query Language)-based database management method and device |
| CN102970165A (en) * | 2012-11-20 | 2013-03-13 | 北京思特奇信息技术股份有限公司 | Network equipment joint analysis alarm system |
| US20130144605A1 (en) * | 2011-12-06 | 2013-06-06 | Mehrman Law Office, PC | Text Mining Analysis and Output System |
| CN103338261A (en) * | 2013-07-04 | 2013-10-02 | 北京泰乐德信息技术有限公司 | Storage and processing method and system of rail transit monitoring data |
| CN108733787A (en) * | 2018-05-11 | 2018-11-02 | 中国平安人寿保险股份有限公司 | Database operation method, device, electronic equipment and storage medium |
| CN110502546A (en) * | 2019-08-22 | 2019-11-26 | 郑州阿帕斯科技有限公司 | A kind of data processing method and device |
| CN110851486A (en) * | 2018-07-26 | 2020-02-28 | 珠海格力电器股份有限公司 | Data storage method and device |
-
2020
- 2020-04-14 CN CN202010292476.2A patent/CN111475489A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7146357B2 (en) * | 2003-03-17 | 2006-12-05 | Hitachi, Ltd. | Database system, server, query posing method, and data updating method |
| CN102323945A (en) * | 2011-09-02 | 2012-01-18 | 南京中兴力维软件有限公司 | SQL (Structured Query Language)-based database management method and device |
| US20130144605A1 (en) * | 2011-12-06 | 2013-06-06 | Mehrman Law Office, PC | Text Mining Analysis and Output System |
| CN102970165A (en) * | 2012-11-20 | 2013-03-13 | 北京思特奇信息技术股份有限公司 | Network equipment joint analysis alarm system |
| CN103338261A (en) * | 2013-07-04 | 2013-10-02 | 北京泰乐德信息技术有限公司 | Storage and processing method and system of rail transit monitoring data |
| CN108733787A (en) * | 2018-05-11 | 2018-11-02 | 中国平安人寿保险股份有限公司 | Database operation method, device, electronic equipment and storage medium |
| CN110851486A (en) * | 2018-07-26 | 2020-02-28 | 珠海格力电器股份有限公司 | Data storage method and device |
| CN110502546A (en) * | 2019-08-22 | 2019-11-26 | 郑州阿帕斯科技有限公司 | A kind of data processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11941017B2 (en) | Event driven extract, transform, load (ETL) processing | |
| US11182404B2 (en) | Data replication technique in database management system | |
| US20190065570A1 (en) | System for automatically creating and associating data conversion programs with source and target data | |
| CN109918349B (en) | Log processing method, log processing device, storage medium and electronic device | |
| CN105493028B (en) | Data consistency and rollback for cloud analysis | |
| US11275768B2 (en) | Differential support for frequent pattern analysis | |
| CN113297135A (en) | Data processing method and device | |
| CN109669925B (en) | Management method and device of unstructured data | |
| CN108121778B (en) | Heterogeneous data exchange and cleaning system and method | |
| CN104239377A (en) | Platform-crossing data retrieval method and device | |
| CN111291047A (en) | Space-time data storage method and device, storage medium and electronic equipment | |
| CN113297269A (en) | Data query method and device | |
| Hua et al. | FAST: Near real-time searchable data analytics for the cloud | |
| Gupta et al. | Faster as well as early measurements from big data predictive analytics model | |
| CN113326363B (en) | Searching method and device, prediction model training method and device and electronic equipment | |
| EP3620932A1 (en) | Method and system for merging data | |
| CN112508720A (en) | Insurance client identity attribute screening method and screening device and electronic equipment | |
| CN111475489A (en) | Data processing method and device | |
| CN110750561A (en) | Method and device for mining associated application program | |
| CN114969083A (en) | Real-time data analysis method and system | |
| CN111488263A (en) | Method and device for analyzing logs in MySQ L database | |
| WO2020106487A1 (en) | Scalable architecture for a distributed time-series database | |
| JP2020154381A (en) | Information processing system, information processing device, information processing method, and program | |
| CN113297282A (en) | Data processing method, system and device | |
| CN117435591A (en) | Data management method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200731 |