CN110727532B - Data restoration method, electronic equipment and storage medium - Google Patents
Data restoration method, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN110727532B CN110727532B CN201910914112.0A CN201910914112A CN110727532B CN 110727532 B CN110727532 B CN 110727532B CN 201910914112 A CN201910914112 A CN 201910914112A CN 110727532 B CN110727532 B CN 110727532B
- Authority
- CN
- China
- Prior art keywords
- incomplete information
- information
- data
- incomplete
- storing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000008439 repair process Effects 0.000 claims abstract description 37
- 238000005516 engineering process Methods 0.000 claims abstract description 12
- 238000012545 processing Methods 0.000 claims abstract description 10
- 238000004364 calculation method Methods 0.000 claims abstract description 9
- 230000006399 behavior Effects 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 230000010354 integration Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0793—Remedial or corrective actions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Quality & Reliability (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data restoration method, electronic equipment and a storage medium, wherein the method comprises the following steps: transmitting the incomplete information data acquired by the Flume to a Kafka message queue, and repairing the incomplete information through SparkStreaming; storing the repaired incomplete information into an elastic search cluster, and storing the unrepaired incomplete information into an HDFS cluster; repairing and extracting unrepaired incomplete information in the HDFS cluster through a graph calculation association technology, and storing the repaired and extracted incomplete information into a Redis database. The problem of low repair efficiency of incomplete data is solved through the scheme, the data repair efficiency is effectively improved, and real-time repair processing of mass data is ensured.
Description
Technical Field
The present invention relates to the field of information security, and in particular, to a data repair method, an electronic device, and a storage medium.
Background
For enterprise-level applications, it is often desirable to have the capability to handle massive data access, and in addition to real-time feedback on user requests, it is also desirable to obtain user behavior data for storage analysis. However, a large number of users access data, generally, the data items are more, and the information of the behavior data elements is not complete when the server side captures the data every time, so that the subsequent integration of the data items with missing field values becomes very difficult.
At present, the existing incomplete data processing mode is to put collected behavior data into an elastic search cluster and search and integrate the collected behavior data by traversing the cluster, but because the cluster data is huge in quantity and the elastic search cluster bears tasks such as data inquiry and deletion in a system, the user behavior data restoration processing efficiency based on the elastic search cluster is very low.
Disclosure of Invention
In view of the above, the embodiments of the present invention provide a data repairing method, an electronic device, and a storage medium, so as to solve the problem of low efficiency of repairing incomplete data based on an elastic search cluster.
In a first aspect of an embodiment of the present invention, there is provided a method comprising:
transmitting the incomplete information data acquired by the Flume to a Kafka message queue, and repairing the incomplete information through SparkStreaming;
storing the repaired incomplete information into an elastic search cluster, and storing the unrepaired incomplete information into an HDFS cluster;
repairing and extracting unrepaired incomplete information in the HDFS cluster through a graph calculation association technology, and storing the repaired and extracted incomplete information into a Redis database.
In a second aspect of the embodiment of the present invention, there is provided an electronic device, including:
the first repair module is used for sending the incomplete information data acquired by the Flume to a Kafka message queue, and performing repair processing on the incomplete information through sparkStreaming;
the storage module is used for storing the repaired incomplete information into the elastic search cluster and storing the unrepaired incomplete information into the HDFS cluster;
the second repair module is used for repairing and extracting unrepaired incomplete information in the HDFS cluster through a graph calculation association technology, and storing the repaired and extracted incomplete information to the Redis database.
In a third aspect of the embodiments of the present invention, there is provided an electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the method according to the first aspect of the embodiments of the present invention when the computer program is executed by the processor.
In a fourth aspect of the embodiments of the present invention, there is provided a computer readable storage medium storing a computer program which, when executed by a processor, implements the steps of the method provided by the first aspect of the embodiments of the present invention.
In the embodiment of the invention, incomplete information acquired by the Flume is sent to the Kafka message queue, the incomplete information is repaired by sparkStreaming, the repaired data is stored in the elastic search cluster, the unrepaired data is stored in the HDFS cluster, the unrepaired data is repaired by a graph calculation correlation technology and then stored in the Redis database, thereby solving the problem of low repair efficiency of incomplete user behavior data, effectively improving the data repair efficiency, ensuring the real-time processing of incomplete element data of the user identity, and facilitating the confirmation of the user identity according to the complete element data.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings described below are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort to a person skilled in the art.
FIG. 1 is a flow chart of a data repair method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of another flow chart of a data repair method according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a data repair electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present invention more comprehensible, the technical solutions in the embodiments of the present invention are described in detail below with reference to the accompanying drawings, and it is apparent that the embodiments described below are only some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The term "comprising" in the description of the invention or in the claims and in the above-mentioned figures and other similar meaning expressions is meant to cover a non-exclusive inclusion, such as a process, method or system, apparatus comprising a series of steps or elements, without limitation to the steps or elements listed.
Aiming at massive network access data, there may be a problem that data elements are incomplete, for example, a field value corresponding to a certain element is lost, and the identity of a user (identity of terminal equipment) can be influenced for the missing data. Missing part data can be filled through data restoration, so that the service end can conveniently identify and analyze the user identity according to the restored data.
Referring to fig. 1, a flow chart of a data repairing method according to an embodiment of the present invention includes:
s101, transmitting incomplete information data acquired by Flume to a Kafka message queue, and repairing the incomplete information through sparkStreaming;
the Flume can be used for collecting mass logs in a distributed mode, and data are collected by customizing various data transmitters. After the user side sends the network access data to the servers, log information in each server can be collected based on the jump. The Kafka message queue can be used for processing massive logs to realize separation of message production and consumption. The massive logs collected by the server end have user identity information such as IP, port numbers, operation behaviors and the like, and user access information or identity information contains incomplete information, namely incomplete identity information or access information. The incomplete information repair task is generated through the Kafka message queue, and the SparkStreaming can process the repair task. The SparkStreaming is a stream processing framework, and can carry out batch processing on incomplete messages and repair elements filling the incomplete messages.
Optionally, filling and repairing incomplete items in the incomplete information according to the existing complete information of the Redis database. The repaired complete information and the captured complete information are stored in the Redis database, and the complete information item is extracted and filled with incomplete information after comparison according to the key value relation between the current incomplete information and the complete information.
Preferably, the repair of incomplete information based on Redis includes implementing repair and off-line repair, performing field filling on the incomplete information according to data in Redis in real time, and off-line repair uses a specific field to be repaired as a key and a corresponding field as a value according to acquired complete identity information data to form a key value associated data string, thereby improving repair efficiency and reducing memory occupation.
S102, storing the repaired incomplete information into an elastic search cluster, and storing the unrepaired incomplete information into an HDFS cluster;
the data processed by SparkStreaming can be divided into two parts: unrepaired incomplete information and repaired incomplete information. SparkStreaming is a high-throughput streaming system for processing real-time data streams, and can process various data sources (such as flash and Kafk) like maps and Reduce, and store the processed data sources in an external file system or database. The elastic search cluster and the HDFS cluster are both external file storage systems, wherein the elastic search cluster provides a distributed real-time full text search engine, and the HDFS cluster is a high-fault-tolerance and high-throughput distributed file system.
Taking a piece of incomplete data in a data stream as an example, acquiring a specific field in the incomplete data and taking a field containing a data value as a key of a Redis to acquire a corresponding value, taking the corresponding value to fill the piece of data, storing the filled data into an elastic search cluster, and if the corresponding value is not acquired, storing the piece of data into a data file of an HDFS.
And the repaired data is stored in the elastic search cluster, so that the data can be conveniently acquired and analyzed, and the unrepaired data is stored in the HDFS cluster, so that the offline repair is convenient.
S103, repairing and extracting unrepaired incomplete information in the HDFS cluster through a graph calculation association technology, and storing the repaired and extracted incomplete information into a Redis database.
The graph calculation association technology is to solve a specific problem through a data model of vertexes and edges based on association relations among objects. Solving unrepaired incomplete information in the HDFS cluster through a graph calculation association technology, specifically, acquiring a history complete entry in the HDFS by using an association repair mode, repairing the current incomplete information, storing a corresponding relation of key values in a Redis database after repairing, and storing repaired data in the Redis database in an elastic search cluster.
The repaired data in the HDFS cluster may be stored in the elastic search cluster, and the unrepaired data is added to the original data file.
Optionally, historical data in the HDFS cluster is obtained based on association restoration, available information in the historical data is extracted, the incomplete information is restored according to a corresponding relation between the available information and the incomplete information, and the key value relation is stored in a Redis database.
Preferably, according to the incomplete information after repair in the elastic search cluster and the incomplete information after repair and extraction in the HDFS cluster, the user operation behavior is obtained, and the identity of the terminal user is analyzed and identified.
In another embodiment of the present invention, as shown in fig. 2, a process of repairing incomplete information based on graph-based computing correlation technique is shown:
specifically, in S201, historical incomplete data, i.e., source data, is obtained from the HDFS, and the first field at the beginning of the source data is assumed to be an ID, and the second, third, and fourth fields are assumed to be specific identity fields, which may be denoted as a, B, C, where the four fields are denoted by 'N', i.e., repair filling is required. In S202, vertex data and Edge data of the graph are constructed according to the source data, the vertex data is in the form of (vertexId, vd), the Edge data is in the form of Edge (srcId, dstId, 0), the vertex data vertexId is obtained according to the hash value of the non-incomplete value field of the specific identity field of each line of the original data, vd is information corresponding to the non-incomplete value field, and the Edge data srcId and dstId are composed of hash values of two non-incomplete value fields of three specific identity fields. In S203, vertex data (vertexId, minVertexId) of the connected graph is obtained based on the vertex data and the edge data, wherein vertexId is a vertexId of a certain vertex of the connected graph, and minVertexId is a vertexId of a minimum vertex connected with the vertex in the connected graph. After integrating the original vertex data and the connected graph vertex data, the data form is expressed as (minVertexId, attr), wherein attr is the minimum vertex corresponding attribute. The integrated data is filled with incomplete data in the form of data (minvertemid, three specific field values) by a reduced bykey in S204. The complete item data form extracted by filtering is data with three specific fields, namely, the data meeting the requirement that three specific fields exist simultaneously is extracted, and the data with the data form (hashId, three specific fields) is obtained after conversion, wherein hashId represents the hash value of the specific fields. And in S205, storing the converted data into a Redis cluster, performing join integration and deduplication with vertex data to obtain repaired data (namely, the data of all specific identity fields can be repaired in source data), and finally establishing difference integration according to the repaired data ID (first field) and the source data ID (first field) to obtain unrepaired data (namely, the data of the incomplete specific field cannot be repaired).
According to the method provided by the embodiment, aiming at the problem of incomplete captured user information elements, incomplete identity information data is repaired and integrated in real time according to the preset rule, incomplete user identity information items are filled, the integrity of the data is guaranteed, real-time storage is realized, the terminal user can be identified and analyzed based on the complete user identity information, and meanwhile, the figure can be accurately represented.
It should be understood that the sequence number of each step in the above embodiment does not mean the sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention,
fig. 2 is a schematic structural diagram of an electronic device for data repair according to an embodiment of the present invention, where the electronic device includes:
the first repair module 210 is configured to send the incomplete information data acquired by the jume to a Kafka message queue, and repair the incomplete information through SparkStreaming;
optionally, the repairing the incomplete information by SparkStreaming specifically includes:
filling and repairing incomplete items in the incomplete information according to the existing complete information of the Redis database.
A storage module 220, configured to store repair-completed incomplete information into the elastic search cluster, and store unrepaired incomplete information into the HDFS cluster;
the second repair module 230 is configured to repair and extract unrepaired incomplete information in the HDFS cluster by using a graph computation association technique, and store the repaired and extracted incomplete information to the Redis database.
Optionally, the repairing and extracting the unrepaired incomplete information in the HDFS cluster by using the graph computing correlation technology includes:
and acquiring historical data in the HDFS cluster based on the association restoration, extracting available information in the historical data, restoring the incomplete information according to the corresponding relation between the available information and the incomplete information, and storing the key value relation into a Redis database.
Optionally, the second repair module further includes:
the analysis module is used for acquiring user operation behaviors and analyzing and identifying the identity of the terminal user according to the incomplete information after the repair in the elastic search cluster and the incomplete information after the repair and extraction in the HDFS cluster.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
It will be understood by those skilled in the art that all or part of the steps in implementing the method of the above embodiment may be implemented by a program to instruct related hardware, where the program may be stored in a computer readable storage medium, where the program includes steps S101 to S103 when executed, where the storage medium includes: ROM/RAM, magnetic disks, optical disks, etc.
The above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (6)
1. A method of data repair, comprising:
transmitting the incomplete information data acquired by the Flume to a Kafka message queue, and repairing the incomplete information through SparkStreaming;
storing the repaired incomplete information into an elastic search cluster, and storing the unrepaired incomplete information into an HDFS cluster;
repairing and extracting unrepaired incomplete information in the HDFS cluster by a graph calculation association technology, and storing the repaired and extracted incomplete information to a Redis database;
the repairing and extracting the unrepaired incomplete information in the HDFS cluster by the graph computing and associating technology, and storing the repaired and extracted incomplete information to a Redis database, comprising the following steps:
and acquiring historical data in the HDFS cluster based on association restoration, extracting available information in the historical data, restoring the incomplete information according to the corresponding relation between the available information and the incomplete information, storing the key value relation into a Redis database, acquiring user operation behaviors according to the incomplete information after restoration in the elastic search cluster and the incomplete information after restoration and extraction in the HDFS cluster, and analyzing and identifying the identity of the terminal user.
2. The method according to claim 1, wherein the repairing of the incomplete information by sparkstream specifically comprises:
filling and repairing incomplete items in the incomplete information according to the existing complete information of the Redis database.
3. An electronic device, comprising:
the first repair module is used for sending the incomplete information data acquired by the Flume to a Kafka message queue, and performing repair processing on the incomplete information through sparkStreaming;
the storage module is used for storing the repaired incomplete information into the elastic search cluster and storing the unrepaired incomplete information into the HDFS cluster;
a second repair module for repairing and extracting unrepaired incomplete information in the HDFS cluster by graph calculation association technology, storing the repaired and extracted incomplete information to a Redis database,
the repairing and extracting the unrepaired incomplete information in the HDFS cluster by the graph computing and associating technology, and storing the repaired and extracted incomplete information to a Redis database, comprising the following steps:
and acquiring historical data in the HDFS cluster based on association restoration, extracting available information in the historical data, restoring the incomplete information according to the corresponding relation between the available information and the incomplete information, storing the key value relation into a Redis database, acquiring user operation behaviors according to the incomplete information after restoration in the elastic search cluster and the incomplete information after restoration and extraction in the HDFS cluster, and analyzing and identifying the identity of the terminal user.
4. The electronic device according to claim 3, wherein the repairing of the incomplete information by SparkStreaming specifically comprises:
filling and repairing incomplete items in the incomplete information according to the existing complete information of the Redis database.
5. An electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the data restoration method according to any of claims 1-2 when the computer program is executed.
6. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the data restoration method according to any one of claims 1 to 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910914112.0A CN110727532B (en) | 2019-09-25 | 2019-09-25 | Data restoration method, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910914112.0A CN110727532B (en) | 2019-09-25 | 2019-09-25 | Data restoration method, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110727532A CN110727532A (en) | 2020-01-24 |
| CN110727532B true CN110727532B (en) | 2023-07-28 |
Family
ID=69219446
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910914112.0A Active CN110727532B (en) | 2019-09-25 | 2019-09-25 | Data restoration method, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110727532B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111475471B (en) * | 2020-04-03 | 2020-12-15 | 深圳市欧蒙设计有限公司 | Information system for industrial design resource sharing |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2886750B1 (en) * | 2005-06-06 | 2007-09-07 | Boozter Technologies Sarl | FORMING DATA RECORDING AND METHODS USING IT. |
| CN101540755B (en) * | 2008-03-18 | 2013-03-13 | 华为技术有限公司 | Method, system and device for recovering data |
| US20100232654A1 (en) * | 2009-03-11 | 2010-09-16 | Harris Corporation | Method for reconstructing iris scans through novel inpainting techniques and mosaicing of partial collections |
| US11232108B2 (en) * | 2016-07-05 | 2022-01-25 | Sedarius Tekara Perrotta | Method for managing data from different sources into a unified searchable data structure |
| CN108197222B (en) * | 2017-12-28 | 2020-03-24 | 北京中关村科金技术有限公司 | Method, system and related device for repairing abnormal stream data |
| CN108536845A (en) * | 2018-04-16 | 2018-09-14 | 中国刑事警察学院 | The incomplete data library file method of inspection |
-
2019
- 2019-09-25 CN CN201910914112.0A patent/CN110727532B/en active Active
Non-Patent Citations (1)
| Title |
|---|
| 基于机器学习算法的建筑能耗监测数据异常识别及修复方法;吴蔚沁;;建设科技(09);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110727532A (en) | 2020-01-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109034993B (en) | Account checking method, account checking equipment, account checking system and computer readable storage medium | |
| CN108628929B (en) | Method and apparatus for intelligent archiving and analysis | |
| CN109558400B (en) | Data processing method, device, equipment and storage medium | |
| CN110430260B (en) | Robot cloud platform based on big data cloud computing support and working method | |
| Yang et al. | A system architecture for manufacturing process analysis based on big data and process mining techniques | |
| US10860962B2 (en) | System for fully integrated capture, and analysis of business information resulting in predictive decision making and simulation | |
| US8626835B1 (en) | Social identity clustering | |
| CN108073625B (en) | System and method for metadata information management | |
| CN104331435A (en) | Low-influence high-efficiency mass data extraction method based on Hadoop big data platform | |
| CN112749266B (en) | Industrial question and answer method, device, system, equipment and storage medium | |
| CN110543506B (en) | Data analysis method and device, electronic equipment and storage medium | |
| CN111400288A (en) | Data quality inspection method and system | |
| CN105072196A (en) | Distributed data package storage, recall method and system | |
| CN112070416A (en) | AI-based RPA process generation method, apparatus, device and medium | |
| CN104796300A (en) | Method and device for data packet feature extraction | |
| CN113127307A (en) | Method for processing tracing request, related device, system and storage medium | |
| CN107871055B (en) | Data analysis method and device | |
| CN110727532B (en) | Data restoration method, electronic equipment and storage medium | |
| US11568344B2 (en) | Systems and methods for automated pattern detection in service tickets | |
| CN110019152A (en) | A kind of big data cleaning method | |
| CN107679097A (en) | A kind of distributed data processing method, system and storage medium | |
| CN116303379A (en) | Data processing method, system and computer storage medium | |
| CN106599244B (en) | General original log cleaning device and method | |
| CN106469086B (en) | Event processing method and device | |
| CN112070487A (en) | AI-based RPA process generation method, apparatus, device and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: 430000, 1301, 13th Floor, Building 2, Phase I, Guanggu Optoelectronic Information Industry Innovation and Entrepreneurship Base, No. 2 Huanglongshan South Road, Donghu New Technology Development Zone, Wuhan City, Hubei Province Patentee after: WUHAN UPOWER INFORMATION TECHNOLOGY CO.,LTD. Country or region after: China Address before: 430000, No. 2, 5th Floor, Building 24, Zone 3, 3S Geospatial Information Industry Base, Wuda Science and Technology Park, Donghu Development Zone, Wuhan City, Hubei Province Patentee before: WUHAN UPOWER INFORMATION TECHNOLOGY CO.,LTD. Country or region before: China |
|
| CP03 | Change of name, title or address |