CN113342861A - Data management method and device in business scene - Google Patents
Data management method and device in business scene Download PDFInfo
- Publication number
- CN113342861A CN113342861A CN202110760692.XA CN202110760692A CN113342861A CN 113342861 A CN113342861 A CN 113342861A CN 202110760692 A CN202110760692 A CN 202110760692A CN 113342861 A CN113342861 A CN 113342861A
- Authority
- CN
- China
- Prior art keywords
- data
- service
- governance
- flow
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24568—Data stream processing; Continuous queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention provides a data management method and a device in a service scene, wherein the method comprises the following steps: extracting original data in a database, acquiring a service scene corresponding to the original data, and classifying the original data according to the type of the service scene to obtain service data of each type; combing each service node in a service scene, constructing a service stream corresponding to the service scene, and determining a corresponding data stream according to the service stream; acquiring a data requirement of a service scene, and performing data management on service data in a data stream according to the data requirement; and acquiring the treatment service data in the service flow after the data treatment, and summarizing the treatment service data in the service flow to form the topological relation of the service system. By adopting the method, the efficiency of data management is ensured on the premise of ensuring the consistency of various data when various data management is carried out under a plurality of service scenes.
Description
Technical Field
The invention relates to the technical field of data management, in particular to a data management method and device in a service scene.
Background
With the rapid development of information technology, the data scale is gradually enlarged. Meanwhile, poor data comes along, the quality of data mining is greatly reduced, and serious trouble is caused to the information society. Poor quality data exists in a large number of fields and organizations, and statistics of foreign authorities show that: in the enterprise information system of the United states, 1% -30% of data have various errors and errors; 13.6% -81% of the key data is incomplete or stale as it exists in the medical information system in the United states. According to the survey results of Gartner: in an enterprise with 1000 strong global wealth, over 25% of the enterprise information systems have erroneous data. Most organizations do not consider the important influence of data quality on the aspects of large data platform construction, analysis and application and the like, and are blindly invested, and the whole planning and comprehensive treatment of large data resources are lacked, so that the termination and failure of some project implementation are finally caused. The failure of projects and the surge of data volume lead the importance of data governance to gradually gain the consensus of the industry and academia
However, in the prior art, data management needs to be checked and changed in a manual intervention mode, which is time-consuming, labor-consuming and inefficient, and because of the diversity of data sources, the manual intervention mode is increasingly unable to meet the management requirements for the diverse data.
Disclosure of Invention
Aiming at the problems in the prior art, the embodiment of the invention provides a data management method and device in a service scene.
The embodiment of the invention provides a data management method in a service scene, which comprises the following steps:
extracting original data in a database, acquiring a service scene corresponding to the original data, and classifying the original data according to the type of the service scene to obtain service data of each type;
combing each service node in the service scene, constructing a service flow corresponding to the service scene, and determining a corresponding data flow according to the service flow;
acquiring a data requirement of the service scene, and performing data governance on service data in the data stream according to the data requirement, wherein the data governance comprises data combing, data screening and data cleaning on the service data according to the data requirement;
and acquiring the treatment service data in the service flow after the data treatment, and summarizing the treatment service data in the service flow to form the topological relation of the service system.
In one embodiment, the method further comprises:
according to the data flow direction in the data flow, data combing is carried out on the flow direction relation and the association relation of each service node;
detecting abnormal data with abnormal values and abnormal sources in the service data, and screening the service data after the data carding according to the abnormal data;
and acquiring a preset data standard and a preset quality standard, and performing data cleaning on the service data after the data screening according to the data standard and the quality standard.
In one embodiment, the method further comprises:
and acquiring definition, marking and management specifications of service data in a service scene.
In one embodiment, the method further comprises:
acquiring a corresponding service department system according to the service scene, and acquiring historical data in the service department system;
and performing data analysis according to the historical data to determine the data requirement.
In one embodiment, the method further comprises:
identifying key data in the service node, and labeling the key data;
and in the data treatment, detecting the key data in the data stream according to the label, and analyzing the consistency of the result of the data treatment according to the detection result.
In one embodiment, the method further comprises:
unifying the data requirements on the governance service data in the service flow, and obtaining the topological relation among the governance service data according to the unified data requirements.
The embodiment of the invention provides a data management device in a service scene, which comprises:
the extraction module is used for extracting original data in a database, acquiring a service scene corresponding to the original data, and classifying the original data according to the type of the service scene to obtain service data of each type;
the combing module is used for combing each service node in the service scene, constructing a service flow corresponding to the service scene and determining a corresponding data flow according to the service flow;
the acquisition module is used for acquiring the data requirement of the service scene and performing data governance on the service data in the data stream according to the data requirement, wherein the data governance comprises data carding, data screening and data cleaning on the service data according to the data requirement;
and the summarizing module is used for obtaining the governance service data in the service flow after the data governance, and summarizing the governance service data in the service flow to form the topological relation of the service system.
In one embodiment, the apparatus further comprises:
the data combing module is used for combing the data of the flow direction relation and the incidence relation of each service node according to the data flow direction in the data flow;
the data screening module is used for detecting abnormal data with abnormal values and abnormal sources in the business data and screening the business data after the data combing according to the abnormal data;
and the data cleaning module is used for acquiring a preset data standard and a preset quality standard and cleaning the service data after the data screening according to the data standard and the quality standard.
The embodiment of the invention provides electronic equipment which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor executes the program and realizes the steps of the data management method in the service scene.
An embodiment of the present invention provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the data governance method in the service scenario.
The data management method and the data management device under the service scene provided by the embodiment of the invention extract the original data in the database, acquire the service scene corresponding to the original data, classify the original data according to the type of the service scene, and obtain the service data of each type; combing each service node in a service scene, constructing a service stream corresponding to the service scene, and determining a corresponding data stream according to the service stream; acquiring a data requirement of a service scene, and performing data governance on service data in the data stream according to the data requirement, wherein the data governance comprises data carding, data screening and data cleaning on the service data according to the data requirement; and acquiring the treatment service data in the service flow after the data treatment, and summarizing the treatment service data in the service flow to form the topological relation of the service system. Therefore, when various data are managed under a plurality of service scenes, the efficiency of data management is also ensured on the premise of ensuring the consistency of various data.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flow chart of a data governance method in a business scenario in an embodiment of the present invention;
FIG. 2 is a diagram of a data management device in a business scenario according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an electronic device in an embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flow chart of a data management method in a service scenario provided in an embodiment of the present invention, and as shown in fig. 1, the embodiment of the present invention provides a data management method in a service scenario, including:
step S101, extracting original data in a database, obtaining a service scene corresponding to the original data, and classifying the original data according to the type of the service scene to obtain service data of each type.
Specifically, extracting original data in a database, classifying the original data according to the types of the service scenes to obtain service data corresponding to each service scene, for example, taking a tobacco data management research as an example, collecting data generated, collected, processed and used by a technical center research and development system in the operation process, then sorting the original data from thirteen service systems, and classifying the original data according to the service scenes of the service systems to obtain the service data corresponding to each type of service systems.
Step S102, combing each service node in the service scene, constructing a service flow corresponding to the service scene, and determining a corresponding data flow according to the service flow.
Specifically, each service node in the service scene is combed, so that a service flow sequence of each service node corresponding to the service scene can be obtained, a corresponding service flow is constructed, and a data flow of each node corresponding to the service flow is determined.
Step S103, acquiring the data requirement of the service scene, and performing data governance on the service data in the data stream according to the data requirement, wherein the data governance comprises data combing, data screening and data cleaning on the service data according to the data requirement.
Specifically, a data requirement of service data corresponding to a service scene is acquired, wherein the data requirement includes definition, marking and management specifications of the service data in the service scene, and the service data in a data stream is subjected to data governance according to the data requirement, wherein the data governance adopts a set of general management mechanism for the service data of each source according to the data requirement to eliminate inconsistency among the data of various sources, and a specific data governance process can include steps of data combing, data screening, data cleaning and the like.
In addition, in the process of data governance, the steps of data combing, data screening and data cleaning may include: acquiring a data flow direction in a data flow of service data, and performing data combing on the flow direction relation and the association relation of each service node; detecting abnormal data with abnormal values and abnormal sources in the service data, and screening the service data after the data carding according to the abnormal data; and acquiring a preset data standard and a preset quality standard, and cleaning the service data after data screening according to the data standard and the quality standard to obtain a cleaned data management result.
In addition, the data requirements of the service scene are obtained, that is, the system data in the corresponding service department system in the current service scene is obtained, and standard analysis of the data can be performed from the system data, so that the requirements of the corresponding service department on the data are determined.
And step S104, acquiring the governance service data in the service flow after data governance, and summarizing the governance service data in the service flow to form a topological relation of a service system.
Specifically, after data management, management service data in each service flow is obtained, and the management service data in the service flows are summarized to form a topological relation of a service system, that is, the management service data in each service flow are unified in data requirements, and the topological relation between the management service data is obtained according to the unified data requirements.
The data management method under the service scene provided by the embodiment of the invention extracts the original data in the database, acquires the service scene corresponding to the original data, and classifies the original data according to the type of the service scene to obtain the service data of each type; combing each service node in a service scene, constructing a service stream corresponding to the service scene, and determining a corresponding data stream according to the service stream; acquiring a data requirement of a service scene, and performing data governance on service data in the data stream according to the data requirement, wherein the data governance comprises data carding, data screening and data cleaning on the service data according to the data requirement; and acquiring the treatment service data in the service flow after the data treatment, and summarizing the treatment service data in the service flow to form the topological relation of the service system. Therefore, the efficiency of data management can be ensured when various data management is carried out under a plurality of service scenes.
On the basis of the above embodiment, the data governance method in the service scenario further includes:
identifying key data in the service node, and labeling the key data;
and in the data treatment, detecting the key data in the data stream according to the label, and analyzing the consistency of the result of the data treatment according to the detection result.
In the embodiment of the invention, in the process of data management, in order to ensure the consistency of the data management, the key data in the data stream can be obtained, wherein the key data can be data with high priority, then the key data is labeled, in the process of data management of the data stream, the key data in the data stream can be detected according to the label, then the key data in the data stream can be compared according to the detection result, the consistency of the result of the data management can be analyzed according to the comparison result, and further the consistency of the result of the data management can be ensured.
According to the embodiment of the invention, the detection result is compared with the key data in the data stream, and the consistency of the data treatment result can be analyzed according to the comparison result, so that the consistency of the data treatment result is ensured.
Fig. 2 is a data management device in a service scenario according to an embodiment of the present invention, which includes: the device comprises an extraction module S201, a combing module S202, an acquisition module S203 and a summarizing module S204, wherein:
the extracting module S201 is configured to extract original data in a database, acquire a service scene corresponding to the original data, and classify the original data according to a type of the service scene to obtain service data of each type.
The combing module S202 is configured to comb each service node in the service scene, construct a service flow corresponding to the service scene, and determine a corresponding data flow according to the service flow.
An obtaining module S203, configured to obtain a data requirement of the service scene, and perform data governance on the service data in the data stream according to the data requirement, where the data governance includes performing data combing, data screening, and data cleaning on the service data according to the data requirement.
And the summarizing module S204 is used for obtaining the governance service data in the service flow after the data governance, and summarizing the governance service data in the service flow to form a topological relation of a service system.
In one embodiment, the apparatus may further comprise:
and the data combing module is used for combing the data of the flow direction relation and the incidence relation of each service node according to the data flow direction in the data flow.
And the data screening module is used for detecting abnormal data with abnormal values and abnormal sources in the service data and screening the service data after the data combing according to the abnormal data.
And the data cleaning module is used for acquiring a preset data standard and a preset quality standard and cleaning the service data after the data screening according to the data standard and the quality standard.
In one embodiment, the apparatus may further comprise:
and the second acquisition module is used for acquiring the definition, the marking and the management specification of the service data in the service scene.
In one embodiment, the apparatus may further comprise:
and the third acquisition module is used for acquiring the corresponding service department system according to the service scene and acquiring historical data in the service department system.
And the analysis module is used for carrying out data analysis according to the historical data and determining the data requirement.
In one embodiment, the apparatus may further comprise:
and the identification module is used for identifying the key data in the service node and marking the key data.
And the detection module is used for detecting the key data in the data stream according to the label in the data treatment and analyzing the consistency of the result of the data treatment according to the detection result.
For specific limitations of the data governance device in the service scenario, reference may be made to the above limitations on the data governance method in the service scenario, and details are not described here again. All modules in the data management device under the service scene can be completely or partially realized through software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
Fig. 3 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 3: a processor (processor)301, a memory (memory)302, a communication Interface (Communications Interface)303 and a communication bus 304, wherein the processor 301, the memory 302 and the communication Interface 303 complete communication with each other through the communication bus 304. The processor 301 may call logic instructions in the memory 302 to perform the following method: extracting original data in a database, acquiring a service scene corresponding to the original data, and classifying the original data according to the type of the service scene to obtain service data of each type; combing each service node in a service scene, constructing a service stream corresponding to the service scene, and determining a corresponding data stream according to the service stream; acquiring a data requirement of a service scene, and performing data governance on service data in the data stream according to the data requirement, wherein the data governance comprises data carding, data screening and data cleaning on the service data according to the data requirement; and acquiring the treatment service data in the service flow after the data treatment, and summarizing the treatment service data in the service flow to form the topological relation of the service system.
Furthermore, the logic instructions in the memory 302 may be implemented in software functional units and stored in a computer readable storage medium when sold or used as a stand-alone product. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, an embodiment of the present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program is implemented to perform the transmission method provided in the foregoing embodiments when executed by a processor, and for example, the method includes: extracting original data in a database, acquiring a service scene corresponding to the original data, and classifying the original data according to the type of the service scene to obtain service data of each type; combing each service node in a service scene, constructing a service stream corresponding to the service scene, and determining a corresponding data stream according to the service stream; acquiring a data requirement of a service scene, and performing data governance on service data in the data stream according to the data requirement, wherein the data governance comprises data carding, data screening and data cleaning on the service data according to the data requirement; and acquiring the treatment service data in the service flow after the data treatment, and summarizing the treatment service data in the service flow to form the topological relation of the service system.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A data governance method in a service scene is characterized by comprising the following steps:
extracting original data in a database, acquiring a service scene corresponding to the original data, and classifying the original data according to the type of the service scene to obtain service data of each type;
combing each service node in the service scene, constructing a service flow corresponding to the service scene, and determining a corresponding data flow according to the service flow;
acquiring a data requirement of the service scene, and performing data governance on service data in the data stream according to the data requirement, wherein the data governance comprises data combing, data screening and data cleaning on the service data according to the data requirement;
and acquiring the treatment service data in the service flow after the data treatment, and summarizing the treatment service data in the service flow to form the topological relation of the service system.
2. The method for data governance in a business scenario according to claim 1, wherein the performing data governance on the business data in the data stream according to the data requirement comprises:
according to the data flow direction in the data flow, data combing is carried out on the flow direction relation and the association relation of each service node;
detecting abnormal data with abnormal values and abnormal sources in the service data, and screening the service data after the data carding according to the abnormal data;
and acquiring a preset data standard and a preset quality standard, and performing data cleaning on the service data after the data screening according to the data standard and the quality standard.
3. The method for data governance under a service scenario according to claim 1, wherein the acquiring the data requirement corresponding to the service scenario includes:
and acquiring definition, marking and management specifications of service data in a service scene.
4. The method for data governance under a service scenario according to claim 1, wherein the acquiring the data requirement of the service scenario comprises:
acquiring a corresponding service department system according to the service scene, and acquiring historical data in the service department system;
and performing data analysis according to the historical data to determine the data requirement.
5. The method for data governance in a business scenario according to claim 1, further comprising:
identifying key data in the service node, and labeling the key data;
and in the data treatment, detecting the key data in the data stream according to the label, and analyzing the consistency of the result of the data treatment according to the detection result.
6. The data governance method under the business scenario according to claim 1, wherein the summarizing the governance business data in the business flow to form a topological relationship of the business system comprises:
unifying the data requirements on the governance service data in the service flow, and obtaining the topological relation among the governance service data according to the unified data requirements.
7. A data governance device under a business scenario, the device comprising:
the extraction module is used for extracting original data in a database, acquiring a service scene corresponding to the original data, and classifying the original data according to the type of the service scene to obtain service data of each type;
the combing module is used for combing each service node in the service scene, constructing a service flow corresponding to the service scene and determining a corresponding data flow according to the service flow;
the acquisition module is used for acquiring the data requirement of the service scene and performing data governance on the service data in the data stream according to the data requirement, wherein the data governance comprises data carding, data screening and data cleaning on the service data according to the data requirement;
and the summarizing module is used for obtaining the governance service data in the service flow after the data governance, and summarizing the governance service data in the service flow to form the topological relation of the service system.
8. The data governance device under a business scenario according to claim 7, wherein the device further comprises:
the data combing module is used for combing the data of the flow direction relation and the incidence relation of each service node according to the data flow direction in the data flow;
the data screening module is used for detecting abnormal data with abnormal values and abnormal sources in the business data and screening the business data after the data combing according to the abnormal data;
and the data cleaning module is used for acquiring a preset data standard and a preset quality standard and cleaning the service data after the data screening according to the data standard and the quality standard.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the data governance method in the business scenario of any one of claims 1 to 6 when executing the program.
10. A non-transitory computer readable storage medium, having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the data governance method in a business scenario according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110760692.XA CN113342861B (en) | 2021-07-06 | 2021-07-06 | Data management method and device in service scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110760692.XA CN113342861B (en) | 2021-07-06 | 2021-07-06 | Data management method and device in service scene |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113342861A true CN113342861A (en) | 2021-09-03 |
| CN113342861B CN113342861B (en) | 2022-11-11 |
Family
ID=77482616
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110760692.XA Active CN113342861B (en) | 2021-07-06 | 2021-07-06 | Data management method and device in service scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113342861B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106227787A (en) * | 2016-07-20 | 2016-12-14 | 北京星网锐捷网络技术有限公司 | Service traffics data message statistical method |
| CN106296127A (en) * | 2016-08-10 | 2017-01-04 | 国家电网公司 | A kind of dynamic construction system and method for intelligent substation operation flow |
| US20180011912A1 (en) * | 2016-07-11 | 2018-01-11 | Al-Elm Information Security Co. | Methods and systems for multi-dynamic data retrieval and data disbursement |
| CN109359109A (en) * | 2018-08-23 | 2019-02-19 | 阿里巴巴集团控股有限公司 | A kind of data processing method and system calculated based on distributed stream |
| CN110781236A (en) * | 2019-10-29 | 2020-02-11 | 山西云时代技术有限公司 | Method for constructing government affair big data management system |
| CN111611458A (en) * | 2020-06-09 | 2020-09-01 | 普元信息技术股份有限公司 | Method for realizing system data architecture combing based on metadata and data analysis technology in big data management |
| CN112181972A (en) * | 2020-11-02 | 2021-01-05 | 北京通付盾人工智能技术有限公司 | Data management method and device based on big data and computer equipment |
| CN112231315A (en) * | 2020-12-16 | 2021-01-15 | 武汉凡松科技有限公司 | Data management method based on big data |
| CN112241443A (en) * | 2019-07-16 | 2021-01-19 | 中国移动通信集团浙江有限公司 | Data quality monitoring method and device, computing equipment and computer storage medium |
| CN112487033A (en) * | 2020-11-30 | 2021-03-12 | 国网山东省电力公司电力科学研究院 | Service visualization method and system for data flow and network topology construction |
| CN112650747A (en) * | 2021-01-20 | 2021-04-13 | 天元大数据信用管理有限公司 | Big data management method in financial wind control service scene |
| CN112988900A (en) * | 2021-04-02 | 2021-06-18 | 广东机电职业技术学院 | Data filling and error correcting method and system based on multi-service scene |
-
2021
- 2021-07-06 CN CN202110760692.XA patent/CN113342861B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180011912A1 (en) * | 2016-07-11 | 2018-01-11 | Al-Elm Information Security Co. | Methods and systems for multi-dynamic data retrieval and data disbursement |
| CN106227787A (en) * | 2016-07-20 | 2016-12-14 | 北京星网锐捷网络技术有限公司 | Service traffics data message statistical method |
| CN106296127A (en) * | 2016-08-10 | 2017-01-04 | 国家电网公司 | A kind of dynamic construction system and method for intelligent substation operation flow |
| CN109359109A (en) * | 2018-08-23 | 2019-02-19 | 阿里巴巴集团控股有限公司 | A kind of data processing method and system calculated based on distributed stream |
| CN112241443A (en) * | 2019-07-16 | 2021-01-19 | 中国移动通信集团浙江有限公司 | Data quality monitoring method and device, computing equipment and computer storage medium |
| CN110781236A (en) * | 2019-10-29 | 2020-02-11 | 山西云时代技术有限公司 | Method for constructing government affair big data management system |
| CN111611458A (en) * | 2020-06-09 | 2020-09-01 | 普元信息技术股份有限公司 | Method for realizing system data architecture combing based on metadata and data analysis technology in big data management |
| CN112181972A (en) * | 2020-11-02 | 2021-01-05 | 北京通付盾人工智能技术有限公司 | Data management method and device based on big data and computer equipment |
| CN112487033A (en) * | 2020-11-30 | 2021-03-12 | 国网山东省电力公司电力科学研究院 | Service visualization method and system for data flow and network topology construction |
| CN112231315A (en) * | 2020-12-16 | 2021-01-15 | 武汉凡松科技有限公司 | Data management method based on big data |
| CN112650747A (en) * | 2021-01-20 | 2021-04-13 | 天元大数据信用管理有限公司 | Big data management method in financial wind control service scene |
| CN112988900A (en) * | 2021-04-02 | 2021-06-18 | 广东机电职业技术学院 | Data filling and error correcting method and system based on multi-service scene |
Non-Patent Citations (2)
| Title |
|---|
| O.BARRENECHEA 等: "Data governance reference model to streamline the supply chain process in SMEs", 《2019 IEEE XXVI INTERNATIONAL CONFERENCE ON ELECTRONICS,ELECTRICAL ENGINEERING AND COMPUTING》 * |
| 马广惠 等: "业务驱动的政府大数据平台数据治理", 《情报资料工作》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113342861B (en) | 2022-11-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11928144B2 (en) | Clustering of log messages | |
| CN109388566B (en) | Code coverage rate analysis method, device, equipment and storage medium | |
| CN107809331B (en) | Method and device for identifying abnormal flow | |
| CN111488363B (en) | Data processing method, device, electronic equipment and medium | |
| CN112506894A (en) | Service chain log processing method and device based on link tracking and computer equipment | |
| CN111475370A (en) | Operation and maintenance monitoring method, device and equipment based on data center and storage medium | |
| CN111078513B (en) | Log processing method, device, equipment, storage medium and log alarm system | |
| CN114185708A (en) | Data analysis method and device based on distributed link tracking and electronic equipment | |
| CN113254255B (en) | Cloud platform log analysis method, system, device and medium | |
| CN110471945B (en) | Active data processing method, system, computer equipment and storage medium | |
| CN110764980A (en) | Log processing method and device | |
| CN112328567B (en) | Processing method and device for Internet of things MME log data | |
| CN114153980A (en) | Knowledge graph construction method and device, inspection method and storage medium | |
| CN111966339B (en) | Buried point parameter input method and device, computer equipment and storage medium | |
| CN113342861B (en) | Data management method and device in service scene | |
| CN110309206B (en) | Order information acquisition method and system | |
| CN111767161A (en) | Remote calling depth recognition method and device, computer equipment and readable storage medium | |
| CN111367971A (en) | Financial system abnormity auxiliary analysis method and device based on data mining | |
| CN111581057A (en) | General log analysis method, terminal device and storage medium | |
| CN115509797A (en) | Method, device, equipment and medium for determining fault category | |
| CN115687406A (en) | Sampling method, device and equipment of call chain data and storage medium | |
| CN113138906A (en) | Call chain data acquisition method, device, equipment and storage medium | |
| CN113032341A (en) | Log processing method based on visual configuration | |
| CN113259878A (en) | Call bill settlement method, system, electronic device and computer readable storage medium | |
| CN114860847B (en) | Data link processing method, system and medium applied to big data platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210907 Address after: 650000 No. 6, Expo Road, Panlong District, Kunming, Yunnan Applicant after: CHINA TOBACCO YUNNAN INDUSTRIAL Co.,Ltd. Address before: 650051 No.6, Shibo Road, Panlong District, Kunming City, Yunnan Province Applicant before: CHINA TOBACCO YUNNAN INDUSTRIAL Co.,Ltd. Applicant before: Dalian Chem Data Solution Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |