CN117349478A - Resource data reconstruction integration system based on digital transformation enterprise - Google Patents
Resource data reconstruction integration system based on digital transformation enterprise Download PDFInfo
- Publication number
- CN117349478A CN117349478A CN202311293352.6A CN202311293352A CN117349478A CN 117349478 A CN117349478 A CN 117349478A CN 202311293352 A CN202311293352 A CN 202311293352A CN 117349478 A CN117349478 A CN 117349478A
- Authority
- CN
- China
- Prior art keywords
- integration
- data
- target data
- target
- association
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000010354 integration Effects 0.000 title claims abstract description 108
- 230000009466 transformation Effects 0.000 title claims abstract description 15
- 238000010586 diagram Methods 0.000 claims description 47
- 239000013598 vector Substances 0.000 claims description 35
- 238000005192 partition Methods 0.000 claims description 31
- 238000012790 confirmation Methods 0.000 claims description 30
- 238000004458 analytical method Methods 0.000 claims description 26
- 238000000034 method Methods 0.000 claims description 16
- 238000010276 construction Methods 0.000 claims description 15
- 230000002159 abnormal effect Effects 0.000 claims description 12
- 238000006243 chemical reaction Methods 0.000 claims description 10
- 238000012937 correction Methods 0.000 claims description 9
- 238000012098 association analyses Methods 0.000 claims description 8
- 238000012795 verification Methods 0.000 claims description 5
- 238000007405 data analysis Methods 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 4
- 238000013523 data management Methods 0.000 description 6
- 238000007726 management method Methods 0.000 description 6
- 230000005856 abnormality Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- 101001072091 Homo sapiens ProSAAS Proteins 0.000 description 1
- 102100036366 ProSAAS Human genes 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000002803 fossil fuel Substances 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
- G06F16/9024—Graphs; Linked lists
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/906—Clustering; Classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Economics (AREA)
- Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Water Supply & Treatment (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Software Systems (AREA)
- Public Health (AREA)
- Bioinformatics & Computational Biology (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a resource data reconstruction integration system based on a digital transformation enterprise, which relates to the technical field of data integration and solves the problem that the data is easy to lose after the data reconstruction integration is completed.
Description
Technical Field
The invention relates to the technical field of data integration, in particular to a resource data reconstruction integration system based on a digital transformation enterprise.
Background
The digital enterprise of the electric power resource is a digital asset which integrates digital marketing, digital technology, big data and electric power resource data, establishes a software matrix with various forms for the enterprise based on an SAAS cloud engine platform and takes the software matrix as a long-term carrier, the electric power resource is an original energy source which can be converted into electric energy and comprises fossil fuel, water energy, wind energy, nuclear energy and the like, the corresponding electric power resource data are complicated, and the complexity is higher when the actual reconstruction and integration are carried out.
The embodiment of the application with the patent application number of CN114238468A discloses a highway multisource heterogeneous data reconstruction integration system, and particularly relates to the technical field of highway network management, which comprises the following steps: a multi-source data acquisition module: the system comprises a highway foundation management information acquisition module and a real-time information acquisition module; a multi-source data transmission module: the system is used for synchronously transmitting the acquired information to a multi-source data management module in different places; a multi-source data management module: the method comprises data resource catalog management, data resource security management and data resource quality management; and the data management center: the data management center comprises a highway data management subsystem, a regional emergency data management subsystem and a data storage module. The highway multisource heterogeneous data reconstruction integration system integrates the highway data management subsystem and the regional emergency data management subsystem, can combine real-time conditions, brings great help to maintenance of the highway network, and has wide application prospects in the technical field of highway network management.
In the process of reconstructing and integrating the resource data, the original power resource digital transformation enterprise generally removes redundant data preferentially according to the overall attribute of the data, and integrates the data, but in the integrating process, whether similarity exists between the data is not analyzed, the integrating mode is irregular, the quality of the integrated data is low, after the data is reconstructed and integrated, the data is easy to lose, and in the later stage, when tracing the source, the lost data cannot be found out rapidly and effectively, and the original data is corrected and filled in time.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a resource data reconstruction and integration system based on a digital transformation enterprise, which solves the problem that the data is easy to lose after the data reconstruction and integration are completed.
In order to achieve the above purpose, the invention is realized by the following technical scheme: a resource data reconstruction integration system based on a digital transformation enterprise comprises an integration center and a tracing center;
the integration center comprises a target attribute confirmation unit, a similar feature confirmation unit and an integration unit;
the target attribute confirmation unit confirms the target data attribute participating in the data reconstruction integration, divides the target data of the same attribute into the same partition, adopts different models to confirm the feature vector of the corresponding data aiming at the data of different attributes, and transmits the determined feature vector into the similar feature confirmation unit;
the similar feature confirming unit confirms different feature vectors corresponding to different target data of the same partition, performs feature vector similarity analysis one by one, and then integrates the target data with the similarity analysis result meeting the integration condition to generate a target data integration packet and transmits the target data integration packet to the tracing center;
the tracing center comprises a relevance analysis unit, a database, a map confirmation unit, a waveform construction unit and a tracing filling unit; the database directly stores the received target data integration packets, a certain time is needed in the storage process, and the association analysis unit carries out association analysis on the target data integration packets in the same partition, confirms that the target data integration packets which are associated with each other exist, confirms association parameters among the corresponding target data integration packets, and records the association parameters;
the map confirmation unit is used for constructing association tree diagrams of a plurality of groups of target data integration packages according to association degree parameters among the plurality of groups of different target data integration packages, wherein the initial target integration packages are placed in an initial stage, subsequent target data integration packages are orderly ordered according to association relations, corresponding association tree diagrams are constructed, and the constructed association tree diagrams are transmitted into the waveform construction unit;
the waveform construction unit confirms the characteristic waveform diagram of the corresponding partition according to the constructed association tree diagram, memorizes the characteristic waveform diagram and transmits the constructed characteristic waveform diagram to the tracing filling unit;
the tracing filling unit is used for receiving and recording the confirmed characteristic waveform patterns, carrying out data analysis after the database stores a plurality of groups of target integration packets of the designated partition, confirming whether the characteristic waveform patterns are consistent or not, and judging whether data correction work is needed or not according to the analysis result;
the specific method is as follows:
after the database stores a plurality of groups of target integration packages of a designated partition, generating a partition analysis instruction, and constructing a comparison waveform diagram belonging to the partition by sequentially passing through a relevance analysis unit, a map confirmation unit and a waveform construction unit according to the partition analysis instruction;
comparing the comparison waveform diagram with the characteristic waveform diagram, judging whether the corresponding waveform diagrams are consistent, if so, not performing any processing, and if not, determining abnormal points with differences;
confirming the belonging stage according to the transverse coordinate value of the corresponding abnormal point, analyzing and comparing the association degree parameters of the belonging stage, and rapidly confirming the abnormal target integration packet according to the comparison result;
and tracing and correcting data according to the original data of the target integrated packet.
Advantageous effects
The invention provides a resource data reconstruction integration system based on a digital transformation enterprise. Compared with the prior art, the method has the following beneficial effects:
according to the method, data with different attributes are classified in advance in the data reconstruction and integration process, after classification is completed, feature vectors of the data with different attributes are confirmed according to different models, then different feature vectors are combined and analyzed, similarity is confirmed, attribute data with high similarity are integrated, a target data integration packet is confirmed, and a subsequent target integration packet is confirmed in sequence;
after the data reconstruction and integration are completed, the association degree analysis is adopted, the subsequent waveform mode is confirmed, abnormal data can be confirmed quickly, the position of the abnormal data is confirmed, tracing is performed quickly, the stage with the abnormal data can be determined quickly by adopting the layer-by-layer progressive mode, tracing range can be shortened, tracing speed is increased, meanwhile, correction can be performed on the data quickly, correction efficiency is improved, and correction time is shortened.
Drawings
Fig. 1 is a schematic diagram of a principle frame of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1
Referring to fig. 1, the application provides a resource data reconstruction integration system based on a digital transformation enterprise, which comprises an integration center and a tracing center;
the integration center comprises a target attribute confirmation unit, a similar feature confirmation unit and an integration unit, wherein the target attribute confirmation unit is electrically connected with an input node of the similar feature confirmation unit, the similar feature confirmation unit is electrically connected with an input node of the integration unit, the tracing center comprises a relevance analysis unit, a database, a map confirmation unit, a waveform construction unit and a tracing filling unit, the relevance analysis unit is electrically connected with the database and the input node of the map confirmation unit, the map confirmation unit is electrically connected with the input node of the waveform construction unit, and the waveform construction unit is electrically connected with the input node of the tracing filling unit;
the target attribute confirmation unit confirms the target data attribute participating in data reconstruction and integration, divides the target data of the same attribute into the same partition, adopts different models to confirm the feature vector of the corresponding data aiming at the data of different attributes, and transmits the determined feature vector into the similar feature confirmation unit, wherein the specific mode for confirming the feature vector of the corresponding data is as follows:
determining a conversion model to be extracted of the target data according to specific attributes of the target data, wherein the specific attributes comprise: bag of words data, numerical data, image data or time series data;
and outputting the feature vector of the target data according to the determined conversion model to be extracted, and transmitting the output feature vector into a similar feature confirmation unit, wherein the conversion model to be extracted is a preset model, is constructed in advance for the target data with different attributes, and is constructed by an operator by self.
The method further comprises the output mode of the feature vector:
for the bag-of-word data, the conversion model to be extracted is a bag-of-word model: each word is weighted by taking into account the importance of the word in the overall corpus.
For numerical data, the conversion model to be extracted is an original numerical feature model: for numeric data, the original numeric value can be directly used as one dimension of the vector for representation; normalization: for numerical data with different numerical ranges, normalization processing can be performed to scale it to a uniform range.
For image data, the conversion model to be extracted is an image feature extraction model: for image data, various feature extraction algorithms, such as SI FT, HOG, CNN, etc., may be used to extract a feature vector representation of the image.
For time series data, the conversion model to be extracted is a statistical feature model: for time series data, various statistical features, such as mean, variance, maximum, minimum, etc., may be selected as dimensions of the vector according to the time interval.
The similar feature confirming unit confirms different feature vectors corresponding to different target data of the same partition, performs feature vector similarity analysis one by one, and then integrates the target data with the similarity analysis result meeting the integration condition to generate a target data integration packet, and transmits the target data integration packet to the tracing center, wherein the specific mode for integrating is as follows:
randomly selecting two sets of feature vectors of the target data, constructing a two-dimensional coordinate system, combining one end of the feature vector with the origin of the two-dimensional coordinate system, so that two sets of feature vectors form an included angle with the included angle parameter of X i Wherein i represents the included angle formed by different feature vectors;
by F (X) i )＝COSX i Obtaining the corresponding included angle of the verification parameter F (X i ) And F (X) i )∈[-1，1]；
And then the verification parameter F (X i ) Comparing with a preset value Y1, wherein the specific value of Y1 is empirically determined by an operator, and Y1 is generally 0.5, when F (X i ) And (3) integrating the target data corresponding to the two groups of feature vectors to confirm a group of target data integration packets, and otherwise, not integrating.
Specifically, the angle X between two eigenvectors in two-dimensional coordinates i Will be less than or equal to 180 °, so the corresponding verification parameter F (X i ) Will only be [ -1,1]Does not exceed this range of values, and F (X i ) The closer to 1, the higher the similarity between the two feature vectors is, the more consistent the angle is, so that the similarity between the two target data is higher, the integration can be performed, and the corresponding target data integration packet is confirmed;
and when the target data are integrated, only two groups of target data with highest similarity are considered for integration, after the integration, the rest data are integrated in a pairwise analysis way, and the subsequent target integration packages are sequentially confirmed.
The database in the tracing center directly stores the received target data integration packets, a certain time is needed in the storage process, the association analysis unit carries out association analysis on the target data integration packets in the same partition, confirms that the target data integration packets which are associated with each other exist, confirms association parameters between the corresponding target data integration packets, and records the association parameters, wherein the specific mode for confirming the association parameters of the corresponding target data integration packets is as follows:
carrying out association analysis on a plurality of groups of target data integration packets, randomly selecting a group of target data integration packets, confirming the data source inside the target data integration packets, confirming the last group of target data integration packets according to the data source, and confirming association parameters with the last group of target data integration packets, wherein the association parameters = source data capacity ≡integral capacity of the target data integration packets;
and sequentially confirming the association degree parameters among a plurality of groups of different target data integration packets, and transmitting the confirmed association degree parameters to the map confirming unit.
The map confirmation unit constructs association tree diagrams of a plurality of groups of target data integration packages according to association degree parameters among the plurality of groups of different target data integration packages, wherein an initial target integration package is placed in an initial stage, subsequent target data integration packages are sequentially ordered according to association relations, corresponding association tree diagrams are constructed, and the constructed association tree diagrams are transmitted into the waveform construction unit;
the waveform construction unit confirms the characteristic waveform diagram of the corresponding partition according to the constructed association tree diagram, memorizes the characteristic waveform diagram, transmits the constructed characteristic waveform diagram into the tracing filling unit until all data integration packets in the corresponding partition are stored, and then carries out comparison and analysis, if no error exists, the deletion is carried out, if the error exists, the data tracing is carried out according to the characteristic waveform diagram, and the problem of corresponding data missing or abnormality in the database is timely solved, wherein the specific mode of confirming the characteristic waveform diagram of the corresponding partition is as follows:
according to the constructed association tree diagram, taking an initial target integration packet as an initial point, confirming the number of target integration packets appearing in a subsequent first stage, marking the initial point as G1, confirming the average value of a plurality of association parameters appearing in the first stage, marking the average value as J1, sequentially confirming the number Gt of target integration packets appearing in the subsequent stage, and simultaneously confirming the average value Jt appearing in the subsequent stage, wherein t=1, 2, … … and n, and particularly, in the tree diagram, a plurality of groups of different association objects and generated association parameters in different stages exist according to the trend from top to bottom, wherein the number of association objects can be used as transverse coordinates, the average value of the association parameters can be used as vertical coordinates, and corresponding waveform point coordinates can be determined, so that corresponding waveform curves can be determined;
determining corresponding point positions in a two-dimensional coordinate system according to the confirmed point position coordinates, connecting the confirmed point positions, confirming a corresponding characteristic waveform diagram, marking the characteristic waveform diagram of the subarea, and transmitting the marked characteristic waveform diagram to a tracing filling unit;
the tracing filling unit receives and records the confirmed characteristic waveform diagrams, after the database stores a plurality of groups of target integration packets of the designated partition, performs data analysis, confirms whether the characteristic waveform diagrams are consistent, and judges whether data correction work is needed according to analysis results, wherein the specific mode for performing the data analysis is as follows:
after the database stores a plurality of groups of target integration packages of a designated partition, generating a partition analysis instruction, and constructing a comparison waveform diagram belonging to the partition by sequentially passing through a relevance analysis unit, a map confirmation unit and a waveform construction unit according to the partition analysis instruction;
comparing the comparison waveform diagram with the characteristic waveform diagram, judging whether the corresponding waveform diagrams are consistent, if so, not performing any processing, and if not, determining abnormal points with differences;
confirming the belonging stage according to the transverse coordinate value of the corresponding abnormal point, analyzing and comparing the association degree parameters of the belonging stage, and rapidly confirming the abnormal target integration packet according to the comparison result;
and tracing the source according to the original data of the target integration packet, correcting the data, and filling the data.
Specifically, after reconstruction and integration are performed on target data, the target data can be stored, a certain period of time is needed in the storage process, partial data can be lost due to the existence of external interference factors in the storage process, the degree of difficulty is relatively high when the lost partial data is traced to the source subsequently due to the fact that the target data is stored as a whole, the stage with data abnormality can be rapidly determined by adopting the layer-by-layer progressive mode, tracing range can be shortened, tracing speed is accelerated, meanwhile, correction can be rapidly performed on the data, correction efficiency is improved, and correction time is shortened.
Some of the data in the above formulas are numerical calculated by removing their dimensionality, and the contents not described in detail in the present specification are all well known in the prior art.
The above embodiments are only for illustrating the technical method of the present invention and not for limiting the same, and it should be understood by those skilled in the art that the technical method of the present invention may be modified or substituted without departing from the spirit and scope of the technical method of the present invention.
Claims (6)
1. The resource data reconstruction integration system based on the digital transformation enterprise is characterized by comprising an integration center and a tracing center;
the integration center comprises a target attribute confirmation unit, a similar feature confirmation unit and an integration unit;
the target attribute confirmation unit confirms the target data attribute participating in the data reconstruction integration, divides the target data of the same attribute into the same partition, adopts different models to confirm the feature vector of the corresponding data aiming at the data of different attributes, and transmits the determined feature vector into the similar feature confirmation unit;
the similar feature confirming unit confirms different feature vectors corresponding to different target data of the same partition, performs feature vector similarity analysis one by one, and then integrates the target data with the similarity analysis result meeting the integration condition to generate a target data integration packet and transmits the target data integration packet to the tracing center;
the tracing center comprises a relevance analysis unit, a database, a map confirmation unit, a waveform construction unit and a tracing filling unit; the database directly stores the received target data integration packets, a certain time is needed in the storage process, and the association analysis unit carries out association analysis on the target data integration packets in the same partition, confirms that the target data integration packets which are associated with each other exist, confirms association parameters among the corresponding target data integration packets, and records the association parameters;
the map confirmation unit is used for constructing association tree diagrams of a plurality of groups of target data integration packages according to association degree parameters among the plurality of groups of different target data integration packages, wherein the initial target integration packages are placed in an initial stage, subsequent target data integration packages are orderly ordered according to association relations, corresponding association tree diagrams are constructed, and the constructed association tree diagrams are transmitted into the waveform construction unit;
the waveform construction unit confirms the characteristic waveform diagram of the corresponding partition according to the constructed association tree diagram, memorizes the characteristic waveform diagram and transmits the constructed characteristic waveform diagram to the tracing filling unit;
and the tracing filling unit is used for receiving and recording the confirmed characteristic waveform patterns, analyzing data after the database stores a plurality of groups of target integration packets of the designated partition, confirming whether the characteristic waveform patterns are consistent or not, and judging whether data correction work is needed or not according to the analysis result.
2. The system for reconstructing and integrating resource data based on digitized transformation enterprises according to claim 1, wherein the target attribute confirmation unit confirms the specific manner of the corresponding data feature vector is as follows:
determining a conversion model to be extracted of the target data according to specific attributes of the target data, wherein the specific attributes comprise: bag of words data, numerical data, image data or time series data;
and outputting the feature vector of the target data according to the determined conversion model to be extracted, and transmitting the output feature vector into a similar feature confirmation unit, wherein the conversion model to be extracted is a preset model, and is constructed in advance for the target data with different attributes.
3. The system for reconstructing and integrating resource data based on digital transformation enterprises according to claim 1, wherein the similar feature confirmation unit generates the target data integration packet in the following specific manner:
randomly selecting two sets of feature vectors of the target data, constructing a two-dimensional coordinate system, combining one end of the feature vector with the origin of the two-dimensional coordinate system, so that two sets of feature vectors form an included angle with the included angle parameter of X i Wherein i represents the included angle formed by different feature vectors;
by F (X) i )＝COSX i Obtaining the corresponding included angle of the verification parameter F (X i ) And F (X) i )∈[-1，1]；
And then the verification parameter F (X i ) Comparing with a preset value Y1, when F (X i ) And (3) integrating the target data corresponding to the two groups of feature vectors to confirm a group of target data integration packets, and otherwise, not integrating.
4. The system for reconstructing and integrating resource data based on digitized transformation enterprises according to claim 1, wherein the association degree analysis unit confirms the association degree parameter of the corresponding target data integration packet in the following specific manner:
carrying out association analysis on a plurality of groups of target data integration packets, randomly selecting a group of target data integration packets, confirming the data source inside the target data integration packets, confirming the last group of target data integration packets according to the data source, and confirming association parameters with the last group of target data integration packets, wherein the association parameters = source data capacity ≡integral capacity of the target data integration packets;
and sequentially confirming the association degree parameters among a plurality of groups of different target data integration packets, and transmitting the confirmed association degree parameters to the map confirming unit.
5. The system for reconstructing and integrating resource data based on digitized transformation enterprises according to claim 1, wherein the waveform construction unit confirms the specific manner of the corresponding partition characteristic waveform map is as follows:
according to the constructed association tree diagram, taking an initial target integration packet as an initial point, confirming the number of target integration packets appearing in a subsequent first stage, marking the number as G1, confirming the average value of a plurality of association parameters appearing in the first stage, marking the average value as J1, sequentially confirming the number Gt of target integration packets appearing in the subsequent stage, and simultaneously confirming the average value Jt appearing in the subsequent stage, wherein t=1, 2, … … and n;
and determining corresponding point positions in a two-dimensional coordinate system according to the determined point position coordinates, connecting the determined point positions, determining a corresponding characteristic waveform diagram, marking the characteristic waveform diagram of the partition, and transmitting the marked characteristic waveform diagram to a tracing filling unit.
6. The system for reconstructing and integrating resource data based on digital transformation enterprises according to claim 5, wherein the tracing shim unit performs data analysis in the following specific ways:
after the database stores a plurality of groups of target integration packages of a designated partition, generating a partition analysis instruction, and constructing a comparison waveform diagram belonging to the partition by sequentially passing through a relevance analysis unit, a map confirmation unit and a waveform construction unit according to the partition analysis instruction;
comparing the comparison waveform diagram with the characteristic waveform diagram, judging whether the corresponding waveform diagrams are consistent, if so, not performing any processing, and if not, determining abnormal points with differences;
confirming the belonging stage according to the transverse coordinate value of the corresponding abnormal point, analyzing and comparing the association degree parameters of the belonging stage, and rapidly confirming the abnormal target integration packet according to the comparison result;
and tracing and correcting data according to the original data of the target integrated packet.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311293352.6A CN117349478B (en) | 2023-10-08 | 2023-10-08 | Resource data reconstruction integration system based on digital transformation enterprise |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311293352.6A CN117349478B (en) | 2023-10-08 | 2023-10-08 | Resource data reconstruction integration system based on digital transformation enterprise |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117349478A true CN117349478A (en) | 2024-01-05 |
| CN117349478B CN117349478B (en) | 2024-05-24 |
Family
ID=89370415
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311293352.6A Active CN117349478B (en) | 2023-10-08 | 2023-10-08 | Resource data reconstruction integration system based on digital transformation enterprise |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117349478B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117874543A (en) * | 2024-03-12 | 2024-04-12 | 瑞达可信安全技术(广州)有限公司 | Data processing method, device, storage system and computer readable storage medium |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013183294A (en) * | 2012-03-01 | 2013-09-12 | Nec Corp | Radio station database creation device, radio wave monitoring device, and method and program |
| CN105930860A (en) * | 2016-04-13 | 2016-09-07 | 闽江学院 | Simulated analysis method of classification optimizing model for temperature-sensing big data of intelligent building |
| CN109544921A (en) * | 2018-11-26 | 2019-03-29 | 中南大学 | A kind of city road classification method based on traffic characteristics |
| US20190260789A1 (en) * | 2017-11-13 | 2019-08-22 | International Business Machines Corporation | Anomaly detection using cognitive computing |
| WO2020010569A1 (en) * | 2018-07-12 | 2020-01-16 | 深圳齐心集团股份有限公司 | Big data comprehensive analysis processing service system |
| CN112766342A (en) * | 2021-01-12 | 2021-05-07 | 安徽容知日新科技股份有限公司 | Abnormity detection method for electrical equipment |
| CN112818068A (en) * | 2020-08-27 | 2021-05-18 | 黄天红 | Big data and multidimensional feature-based data tracing method and system |
| CN112905380A (en) * | 2021-03-22 | 2021-06-04 | 上海海事大学 | System anomaly detection method based on automatic monitoring log |
| CN113986701A (en) * | 2021-10-20 | 2022-01-28 | 中国铁道科学研究院集团有限公司 | Equipment data processing method and device applied to intelligent traction power transformation system |
| CN114911949A (en) * | 2022-04-29 | 2022-08-16 | 南京信息职业技术学院 | Course knowledge graph construction method and system |
| CN115619867A (en) * | 2022-11-18 | 2023-01-17 | 腾讯科技（深圳）有限公司 | Data processing method, device, equipment, storage medium and program product |
| CN115952915A (en) * | 2023-01-09 | 2023-04-11 | 北京建筑大学 | Energy consumption prediction optimization method using fuzzy entropy classification |
| CN116467403A (en) * | 2023-06-05 | 2023-07-21 | 北京华宇信息技术有限公司 | Enterprise identity information data fusion method and device |
| CN116775797A (en) * | 2023-08-18 | 2023-09-19 | 湖南腾琨信息科技有限公司 | Urban space holographic map construction method based on multi-source big data fusion |
-
2023
- 2023-10-08 CN CN202311293352.6A patent/CN117349478B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013183294A (en) * | 2012-03-01 | 2013-09-12 | Nec Corp | Radio station database creation device, radio wave monitoring device, and method and program |
| CN105930860A (en) * | 2016-04-13 | 2016-09-07 | 闽江学院 | Simulated analysis method of classification optimizing model for temperature-sensing big data of intelligent building |
| US20190260789A1 (en) * | 2017-11-13 | 2019-08-22 | International Business Machines Corporation | Anomaly detection using cognitive computing |
| WO2020010569A1 (en) * | 2018-07-12 | 2020-01-16 | 深圳齐心集团股份有限公司 | Big data comprehensive analysis processing service system |
| CN109544921A (en) * | 2018-11-26 | 2019-03-29 | 中南大学 | A kind of city road classification method based on traffic characteristics |
| CN112818068A (en) * | 2020-08-27 | 2021-05-18 | 黄天红 | Big data and multidimensional feature-based data tracing method and system |
| CN112766342A (en) * | 2021-01-12 | 2021-05-07 | 安徽容知日新科技股份有限公司 | Abnormity detection method for electrical equipment |
| CN112905380A (en) * | 2021-03-22 | 2021-06-04 | 上海海事大学 | System anomaly detection method based on automatic monitoring log |
| CN113986701A (en) * | 2021-10-20 | 2022-01-28 | 中国铁道科学研究院集团有限公司 | Equipment data processing method and device applied to intelligent traction power transformation system |
| CN114911949A (en) * | 2022-04-29 | 2022-08-16 | 南京信息职业技术学院 | Course knowledge graph construction method and system |
| CN115619867A (en) * | 2022-11-18 | 2023-01-17 | 腾讯科技（深圳）有限公司 | Data processing method, device, equipment, storage medium and program product |
| CN115952915A (en) * | 2023-01-09 | 2023-04-11 | 北京建筑大学 | Energy consumption prediction optimization method using fuzzy entropy classification |
| CN116467403A (en) * | 2023-06-05 | 2023-07-21 | 北京华宇信息技术有限公司 | Enterprise identity information data fusion method and device |
| CN116775797A (en) * | 2023-08-18 | 2023-09-19 | 湖南腾琨信息科技有限公司 | Urban space holographic map construction method based on multi-source big data fusion |
Non-Patent Citations (1)
| Title |
|---|
| 倪静: "语义Web环境下基于模型的数据溯源研究", 《中国博士学位论文全文数据库信息科技辑》, no. 1, 15 January 2016 (2016-01-15), pages 138 - 175 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117874543A (en) * | 2024-03-12 | 2024-04-12 | 瑞达可信安全技术(广州)有限公司 | Data processing method, device, storage system and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117349478B (en) | 2024-05-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN117349478B (en) | Resource data reconstruction integration system based on digital transformation enterprise | |
| CN111027615B (en) | Middleware fault early warning method and system based on machine learning | |
| CN115145906B (en) | Preprocessing and completion method for structured data | |
| CN115293751A (en) | Method, system and equipment for processing BIM model data of rail transit | |
| CN114090402A (en) | User abnormal access behavior detection method based on isolated forest | |
| JP2021526670A (en) | General-purpose machine learning model, model file generation and analysis method | |
| CN116541911A (en) | Packaging design system based on artificial intelligence | |
| CN112181959A (en) | Special equipment multi-source data processing platform and processing method | |
| CN110990909A (en) | Three-dimensional CAD model data processing method | |
| CN112491797A (en) | Intrusion detection method and system based on unbalanced industrial control data set | |
| CN111177135B (en) | Landmark-based data filling method and device | |
| CN116166650A (en) | Multisource heterogeneous data cleaning method based on generation countermeasure network | |
| CN111159152A (en) | Secondary operation and maintenance data fusion method based on big data processing technology | |
| CN116611131B (en) | Automatic generation method, device, medium and equipment for packaging graphics | |
| Denkena et al. | Automated generation of a digital twin using scan and object detection for data acquisition | |
| CN115481084A (en) | BIM model resource management system | |
| CN115514784A (en) | Multisource data acquisition middle platform based on Internet of things | |
| CN114238045A (en) | System and method for judging and automatically repairing integrity of multi-source measurement data of power grid | |
| CN115223093A (en) | Construction site safety helmet wearing detection method based on improved YOLOX network | |
| CN107463540A (en) | The processing method and equipment for monitoring power quality of power quality data | |
| CN116049700B (en) | Multi-mode-based operation and inspection team portrait generation method and device | |
| CN114116821B (en) | Energy monitoring data storage method, equipment and medium based on time sequence database | |
| CN117094206B (en) | Simulation data generation system and generation method | |
| CN115470640B (en) | Compliance detection method and system based on flow tree decomposition and track matching strategy | |
| CN114065895A (en) | Rapid structural model correction method based on improved artificial bee colony algorithm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |