CN108228740A - Electric power full-service uniform data centre data analysis domain comparing tool - Google Patents
Electric power full-service uniform data centre data analysis domain comparing tool Download PDFInfo
- Publication number
- CN108228740A CN108228740A CN201711351824.3A CN201711351824A CN108228740A CN 108228740 A CN108228740 A CN 108228740A CN 201711351824 A CN201711351824 A CN 201711351824A CN 108228740 A CN108228740 A CN 108228740A
- Authority
- CN
- China
- Prior art keywords
- data
- comparison
- comparing
- management
- tool
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007405 data analysis Methods 0.000 title claims abstract description 9
- 230000000052 comparative effect Effects 0.000 claims abstract description 23
- 230000006870 function Effects 0.000 claims description 12
- 230000001360 synchronised effect Effects 0.000 claims description 9
- 238000012360 testing method Methods 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims description 4
- 238000012423 maintenance Methods 0.000 claims description 3
- 235000013399 edible fruits Nutrition 0.000 claims description 2
- 238000007726 management method Methods 0.000 description 32
- 238000012545 processing Methods 0.000 description 9
- 238000013461 design Methods 0.000 description 8
- 230000008878 coupling Effects 0.000 description 6
- 238000010168 coupling process Methods 0.000 description 6
- 238000005859 coupling reaction Methods 0.000 description 6
- 238000010276 construction Methods 0.000 description 4
- 229910002056 binary alloy Inorganic materials 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 238000012795 verification Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 244000309464 bull Species 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2246—Trees, e.g. B+trees
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to electric power full-service uniform data centre data analysis domain comparing tool, the electric power full-service uniform data centre data analysis domain comparing tool includes:(1) it is realized based on comparing tool to database connection management;(2) data type configuration management is realized based on comparing tool;(3) comparative group management is realized based on comparing tool;(4) comparison task management is realized based on comparing tool.
Description
Technical field
The present invention relates to a kind of electric power full-service uniform data centre data analysis domain comparing tools.
Background technology
With deepening continuously for each operating information system construction of State Grid Corporation of China and application, number caused by information system
According to State Grid Corporation of China's critical asset has been become, management and business model innovation also proposed data resource good application
New requirement.Therefore, solve that " multi-disciplinary business cooperation and information sharing are insufficient, the input of data bull, data accuracy, in real time
Property is not strong, and data extract repeatedly, redundant storage, of low quality " the problems such as be key point.Thoroughly to solve current data center
Existing deficiency, meets available data application demand, and State Grid Corporation of China starts the center construction of full-service uniform data, and with
The construction and application for full-service uniform data center deepen continuously, and full-service uniform data center is in the data check course of work
In, there are sources operation system data are various, data volume is big, artificial pattern verification is difficult, task is heavy, verify period length etc.
Problem, consistency, accuracy, the integrality of data can not be verified accurately in time.
Present situation is accessed based on full-service uniform data centre data, the checking consistency in face of mass data works, from source
End system performance, Internet resources expend state, incremental data memory capacity various aspects expansion investigation and analysis, to ensure that data are consistent
Property, integrality, service logic, validity need to develop adaptability tool and carry out the quality of data and verify work, it is necessary to build
Comparing tool solves problem above.
Invention content
The object of the present invention is to provide a kind of electric power full-service uniform data centre data analysis domain comparing tools.This
The technical solution of invention is as follows:
The electric power full-service uniform data centre data analysis domain comparing tool, including:
(1) it is realized based on comparing tool and compares object data connection management
It is destination end, source database linkage information to compare object data connection, and data connection management realizes all kinds of connections
Unified record, is obtained and is used quick lookup, and providing fundamental objects connection for comparing supports.It is main to realize different type
Database linkage information preserves, and connecting test, data list structure is checked, table synchronizing information function.
(2) data type configuration is realized based on comparing tool
Data type configuration realizes the mapping configuration that external data types correspond to native data types.Pass through matching for this module
It puts, can realize effective management of comparison tool processing data type, data length etc., different external data base types is reflected
It penetrates as local data base same type, avoids a series of problems that data difference alienation is brought.Realize verification object type
Personalized, configurationization function, can not only realize the comparison to certain type field, but also can filter out big text, binary system etc.
Super large field type efficiently compares so as to provide light weight, provides more selections to the user.
(3) comparative group management is realized based on comparing tool
By comparing the management of group, the setting of comparison rules is realized.Including comparative group management, setting source, destination end connection letter
Breath.Addition is more right:Source, the table structural information of destination end are selected, Auto-matching and by hand matching both of which are provided.Row
With information:Selection addition needs the row compared, provides a key Auto-matching same column.Condition coupling information:Data row are selected, if
Condition value is put, realizes defining for comparison data range.
(4) it is realized based on comparing tool and compares task management
It compares task management functions and mainly realizes comparison task according to contrast table Structure Comparison, result queries and export, by record
Number comparison, result queries and export, by detail contrast, result queries and export.Contrast table structure function:It is set according to comparative group
Comparison rule, the table specified to source, destination end carries out structural integrity comparison, from field name, quantity, field type,
Length etc. is compared, and inconsistent table is counted one by one to enumerate and is come, and realize the identical table name structure of source, destination end
Inconsistency directly compares display, and comparing result provides export.Compare record number:Comparison rule in the comparative group of setting
Then, source, destination end data table related data volume are compared, and count generation comparison result, result export is provided.Comparison
It is detailed:According to the comparison rule in the comparative group of setting, source, destination end data table related detailed data are compared, and
Statistics generation comparison result, provides difference detailed data and checks, be accurate to capable grade, field level.It provides and compares statistical result export.
Compared with the prior art, source, destination end system data in being built the present invention is based on national grid full-service data
Comparison scene, various system datas are compared, mainly Oracle, Mysql including source, destination end are compared,
The comparison of Mysql, Mysql are realized that source, destination end database table structure compare, record number compares and record is detailed and are compared, is
Full-service data construction quality verifies work and provides effective data supporting.The present invention is using accurate, flexible, timely, efficient number
It according to the mode of extraction, full dose is provided extracts and compare and condition extraction alignments, using the data of goal systems when doing full dose extraction
Data are synchronized in the database of this system by backup, as far as possible change the system of the data close to goal systems of this system
Point.Partial data is extracted according to the condition coupling that contrast groups are set when part is extracted, makes comparison accurately efficient, while as small as possible
To the system for being extracted data bring load on pressure.It compares using the comparison that directly compares and make a summary on algorithm, to simple
Type low volume data is compared using directly comparing, to data types such as big text, binary systems using abstract, the realization for comparison of making a summary
It is:The every a line for the data that data comparison tool extracts establishes informative abstract code, using MD5 algorithms, compares logarithm when extracting data
It determines whether to update the data according to the MD5 in the MD5 codes and goal systems of comparison source system, since MD5 codes have compressibility
With the easy property calculated, which pressure caused by goal systems is smaller, and promotes comparison efficiency.Meanwhile operation layer provides flexibly
Alignments meet the needs in customer service;This system realizes a variety of low layer alignments, and provides interface and enable users to
The low-level logic compared is adjusted, so as to improve the comparison performance of this system.Comparative group, comparison are established to, comparison task, designs table
Structure alignment, record number compare, detailed comparison, realize that more flexible configuration meets more application scenarios.Meanwhile it uses big
Measure database Lower level logical way of contrast:Data comparison tool establishes b-tree indexed in the major key locally for every cache table, compares
Whether field and inquiry field establish index can be by user's control.The maintenance of major key index is automatically performed by system, in same step number
According to when according to the data type of synchronous data volume and index field judge whether temporarily delete index, after data synchronously complete
It re-establishes, to avoid hydraulic performance decline caused by database update index during synchronous mass data.Exist when in the data of comparison
When Appendchunks, system can compare the MD5 codes or Hash codes of these fields by LOB, LONG, TEXT, to avoid up to text ratio
Compared with when the hydraulic performance decline that occurs.The MD5 codes way of contrast for also providing whole record simultaneously is selected for user.The present invention uses B/S
Framework makes full use of MVC design pattern and Mysql databases bottom data to handle advantage, provides flexible data check and compares
Strategy, efficient comparing provide effective tool support for data check work.
Description of the drawings
Fig. 1 is the deployment unit figure of the present invention.
The deployment topologies figure of Fig. 2 present invention.
Specific embodiment
The invention will be further described below.(But it is not limitation of the present invention).
First, system function
1st, it is realized based on comparing tool and compares object database connection management
Database connection management realizes the unified record of all kinds of connections, quick lookup, obtains and use, and is provided for comparing
Fundamental objects connection is supported.It is main realize distinct type data-base link information increase newly, inquire, changing, deleting, connecting test,
Data list structure is checked and table synchronizing information function.It provides and classifies by type of database, by connection type(Source, destination end)Point
Class, concrete function include:
A, data source control:It supports the management to Oracle, Mysql different data sources, realizes to IP, port numbers, data connection
The data sources configuration informations such as string such as check, increase newly, changing, deleting at the operations, realize and the data connection of data source is tested;
B, data connection table structure management:It supports the table information of the existing connection of real time inspection, can screen and check, select synchronization, is complete
Portion is synchronous, deletes synchronization.
2nd, data type configuration is realized based on comparing tool
Data type configuration realizes the mapping configuration that external data types correspond to native data types.Pass through matching for this module
It puts, realizes effective management to comparison tool processing data type, data length etc., different external data base types is reflected
It penetrates as local data base corresponding types, avoids a series of problems that data difference alienation is brought.Realize verification object type
Personalized, configurationization function, can not only realize the comparison to certain type field, but also can filter out big text, binary system etc.
Super large field type efficiently compares so as to provide light weight, provides more selections to the user.Support Oracle, Mysql number
According to library, realize to the checking of the information such as external connection type, minimum length, maximum length, corresponding native data types, increase newly,
The operations such as modification, deletion.
3rd, comparative group management is realized based on comparing tool
By comparing the management of group, the setting of comparison rules is realized.Including comparative group management, setting source, destination end connection letter
Breath.Addition is more right:Source, the table structural information of destination end are selected, Auto-matching and by hand matching both of which are provided.Row
With information:Selection addition needs the row compared, provides a key Auto-matching same column.Condition coupling information:Data row are selected, if
Condition value is put, realizes defining for comparison data range.Concrete function includes:
A, comparative group management:Source and destination end the composition comparative group that need to be compared, select data with existing connection, realize source, mesh
The operations such as the maintenance of group information is compared at mark end etc., and realization is checked, increased newly, changing, deleting, realize the management to comparative group;
B, comparison is to management:Source, destination end corresponding table composition are more right, and automatic mode and manually is supported in the addition compared pair
Pattern, the identical table of the lower key Auto-matching source of automatic mode, destination end title(Ignorecase)It is added to and compares centering,
Source, destination end table information are listed under manual mode, matching is manually selected for user.
C, row matching:Detail contrast needs to compare specific row, it is therefore desirable to setting row matching.Comparison tool is supported automatic
It matches same column and manually selects row matching.
D, condition coupling:To compare to setting condition coupling, comparison access range is reduced, supports that source, destination end are each
Field carries out condition setting.
4th, it is realized based on comparing tool and compares task management
It compares task management functions and mainly realizes comparison task according to contrast table Structure Comparison, result queries and export, by record
Number comparison, result queries and export, by detail contrast, result queries and export.Reduced extent real-time display, can manual termination.
A, task management is compared:The function of uniformly safeguarding comparison task is provided, comparative group is selected, is added to comparison task
In.Realize inquiring, increase newly, changing, deleting for comparison task.
B, contrast table structure:Realize source destination end table Structure Comparison, the source table quantity in Statistical Comparison group, destination end
The inconsistent quantity of table structure of table quantity, the inconsistent quantity of table name and same names, lists table name, source Field Count, mesh
End Field Count, same word hop count, different field number, different type number, different data lengths number etc. are marked, and can be checked different
The complete situation of table, different fields are highlighted.Comparing result export is provided.
C, comparison record number:According to comparative group, comparison to information, each is compared relatively to the record of source, destination end
Number provides comparing result export.
D, comparison is detailed:According to comparative group, comparison to information, compare each relatively to source, destination end record it is bright
Carefully, comparing result export is provided.
2nd, system concept model
1st, it is realized based on comparing tool and compares object database connection management
The conceptual entity of database connection management design includes:Data connection information, type of database, connection type classify, are same
Walk table information, synchronous meter managing detailed catalogue
Specific entity relationship is described as follows:
" type of database " includes " Oracle ", " Mysql ";
" connection type classification " includes " source ", " destination end ";
" data connection information " is associated with " synchronous meter information ", is one-to-many relationship, " synchronous meter information " and " synchronous meter detail
Information " is associated with, and is one-to-many relationship;
2nd, data type configuration is realized based on comparing tool
The conceptual entity of data type configuration design includes:Data type management, type of database.
Specific entity relationship is described as follows:
" type of database " includes " Oracle ", " Mysql ".
3rd, comparative group management is realized based on comparing tool
The conceptual entity of comparative group management design includes:Compare group information, data connection information, comparison to information, matching row letter
Breath, matching condition information.
Specific entity relationship is described as follows:
" comparing group information " configuration " data connection information ", " comparing to information ", " comparing group information " close with " compared with to information "
Connection is many-one relationship;
" comparing to information " configuration " row match information ", " condition coupling information " are many-one relationship.
4th, it is realized based on comparing tool and compares task management
The conceptual entity for comparing task management design includes:It compares mission bit stream, compare policy information, comparison result information, ratio
To result information-comparative group comparison result, comparison result information-compare to comparison result.
Specific entity relationship is described as follows:
" comparing policy information " is subordinated to " comparing mission bit stream ";
" comparing mission bit stream " is associated with " comparison result information ", is many-one relationship;
" comparison result information " and " comparison result information-comparative group comparison result ", " comparison result information-compared with tied to comparing
Fruit " is associated with, and is many-one relationship.
3rd, system physical deployment planning
1st, capacity planning designs
1)Database purchase service is estimated
This programme uses TPC-C(Transaction Processing ability benchmark program)Database server handling ability is estimated,
Unit be TPM values (Transaction Per Minute), i.e., the transaction stroke count of processing per minute.Using be calculated as below formula into
The estimation of row CPU processing capacities:
TPM=N×F/(T/60×C)
Meaning of parameters in formula is:
N:Concurrent quantity, under normal circumstances concurrent user number can be set as 80, for the unit that data center traffic is more complicated, concurrently
Number of users suggestion is set as 200.
F:The complexity of every business is actual tool processing relative to the complexity of standard TPC-C test benchmark environment
Ratio, this value of the complexity for the every transaction being compared to by every business in TPC standard testings are set as S=32(By providing this
Value may be set to 20 ~ 40).
T:Every traffic handling time upper limit, according to《Comparing tool Specification》It is average to system processing
Response time:The requirement of 90% operation≤1s, every traffic handling time upper limit should be advisable with 1 second.
C:Host CPU handles utilization rate, and practical application experience shows the cpu busy percentage of a host as being higher than 80%, then
Show that the utilization rate of CPU is excessively high, it can generation system bottleneck.And utilization rate is when being in 60%, is in utilization rate optimum state.
More than parameter substitution formula is estimated:
TPM=200×32/(1/60*60%)=640000tpmC。
Suggest that the communication server is equipped with the server of 640,000 tpmC or so according to above measuring and calculating.With reference to www.tpc.org nets
The data announced on standing, it is proposed that the server of application server selection and deployment 4CPU.Memory size and the ratio of CPU core calculation are pressed
According to 4:1 configuration, i.e. 4*4=16GB.
In addition, table structure, the comparing result of each operation system need to be managed by comparing tool etc., it is contemplated that company
1 annual data is 10G, and estimated in terms of database purchase by 1 annual increment, the data such as each module operation data and running log
Still there is increment growth space, it is contemplated that dynamic Increasing capacity 20G+1G.For being more than the data of online pot-life, filing behaviour is carried out
Make;Data base management system space (log space, temporary space etc.) is memory space necessary to database operation, space
Size directly affects the performance of database, which is expected to be 100G.Therefore, to ensure comparing tool in future 3 to 5
Year normal operation, it is proposed that the memory capacity of database be planned to 300G and more than.
2)Application server service is estimated
With reference to the logical architecture of comparing, this programme uses the SPECjAppServer2004 for Java applications to take application
Business device processing capacity is estimated that unit is JOPS (jAppServer Operations Per Second), i.e. Java is serviced
Trading volume per second.The calculation formula of jAppServer2004 values is as follows:
JAppServer2004 values=TASK × S × F/ (T × C)
Meaning of parameters in formula is:
TASK:Daily total business volume.
S:The complexity that tool application operation is merchandised relative to standard SPECjAppServer2004 test benchmarks environment
Ratio.Due to the transaction in the complexity of service application and SPECjAppServer2004 standard testings, there are larger differences
It is different, it must one rational respective value of setting.According to the characteristics of tool business, complexity proportion can be set as 10-20, i.e. S=
15。
F:The tool portfolio development redundancy 3 years following is reserved.This secondary design reserves 20% processing capacity, i.e. F=120%.
T:The duration of daily business period, unit are the seconds.Daily portfolio, which was concentrated in 8 hours, to be completed, i.e. T=8*
12000=96000 seconds.
C:Cpu busy percentage.Best cpu busy percentage is set as 60%.
More than parameter substitution formula is estimated:
SPECjAppServer2004 values=
=(12000*8) × 60 × 120%/(96000 × 60%)
=1200(JOPS)
Suggest that application server is equipped with operation of server of the JOPS values more than 1200 as management server according to above measuring and calculating
Environment.According to http:The data announced on //www.spec.org/jAppServer2004 websites, application server can be used
The server of 4CPU is configured, and the ratio of memory size and CPU core calculation is according to 4:1 configuration, i.e. 4*4=16GB.
Claims (1)
1. electric power full-service uniform data centre data analysis domain comparing tool, which is characterized in that the electric power full-service
Uniform data centre data analysis domain comparing tool, including:
(1) it is realized based on comparing tool to database connection management
Unified management of the realization to all kinds of operation system database linkage informations, support Sybase type Oracle,
Mysql provides connecting test, checks the functions such as database table information, synchronous meter structure;
(2) data type configuration management is realized based on comparing tool
Data type management realizes flexible setting of the comparison tool to comparison data library type, can compare needs according to practical,
Filter, screen certain, certain field types or certain type of specified conditions range, to realize that personalized compare provides data class
Type is supported;
(3) comparative group management is realized based on comparing tool
Comparative group management realize compare source, the comparison rules of destination end setting, setting comparative group, comparison to, matching row,
With condition, it can be achieved that table name Auto-matching, field name Auto-matching, and manual match pattern is added in, meet other comparison demands;
Data fence is set by matching condition, realizes that the extraction of critical data in mass data compares;
(4) comparison task management is realized based on comparing tool
It realizes the maintenance management of comparison task, realizes detailed to task progress contrast table structure, comparison record number, comparison;Comparison
Table structure:According to the comparison rule that comparative group is set, structural integrity comparison is carried out to the table that source, destination end are specified, from word
Name section, quantity, field type, length etc. are compared, and inconsistent table is counted one by one to enumerate and is come, and realize source
End, the identical table name structure inconsistency of destination end directly compare display;Comparing result provides export;Comparison record number:According to setting
Source, destination end data table related data volume is compared in comparison rule in the comparative group put, and counts generation and compare knot
Fruit provides result export;Comparison is detailed:According to the comparison rule in the comparative group of setting, to source, destination end data table related
Detailed data is compared, and counts generation comparison result, provides difference detailed data and checks, is accurate to capable grade, field level, carries
For comparing statistical result export.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711351824.3A CN108228740A (en) | 2017-12-15 | 2017-12-15 | Electric power full-service uniform data centre data analysis domain comparing tool |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711351824.3A CN108228740A (en) | 2017-12-15 | 2017-12-15 | Electric power full-service uniform data centre data analysis domain comparing tool |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108228740A true CN108228740A (en) | 2018-06-29 |
Family
ID=62652337
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201711351824.3A Pending CN108228740A (en) | 2017-12-15 | 2017-12-15 | Electric power full-service uniform data centre data analysis domain comparing tool |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108228740A (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109739745A (en) * | 2018-12-10 | 2019-05-10 | 山东泰安烟草有限公司 | Based on flow indicator to database hardware resource analysis method |
CN109815230A (en) * | 2018-12-23 | 2019-05-28 | 国网浙江省电力有限公司 | A kind of full-service data center Data Audit method of knowledge based map |
WO2020015067A1 (en) * | 2018-07-19 | 2020-01-23 | 平安科技(深圳)有限公司 | Data acquisition method, device, equipment and storage medium |
CN112364024A (en) * | 2020-11-30 | 2021-02-12 | 上海二三四五网络科技有限公司 | Control method and device for batch automatic comparison of table data |
CN112817792A (en) * | 2021-01-22 | 2021-05-18 | 浪潮电子信息产业股份有限公司 | Data backup method, device and system of IaaS system and storage medium |
CN113592667A (en) * | 2020-04-30 | 2021-11-02 | 南京南瑞继保电气有限公司 | Method for generating market model of electric power spot market from EMS |
CN115185982A (en) * | 2022-09-14 | 2022-10-14 | 浩鲸云计算科技股份有限公司 | Data preparation method and system based on data set arrangement |
US11941023B2 (en) | 2019-06-26 | 2024-03-26 | Zte Corporation | System and method for implementing incremental data comparison |
-
2017
- 2017-12-15 CN CN201711351824.3A patent/CN108228740A/en active Pending
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020015067A1 (en) * | 2018-07-19 | 2020-01-23 | 平安科技(深圳)有限公司 | Data acquisition method, device, equipment and storage medium |
CN109739745A (en) * | 2018-12-10 | 2019-05-10 | 山东泰安烟草有限公司 | Based on flow indicator to database hardware resource analysis method |
CN109815230A (en) * | 2018-12-23 | 2019-05-28 | 国网浙江省电力有限公司 | A kind of full-service data center Data Audit method of knowledge based map |
US11941023B2 (en) | 2019-06-26 | 2024-03-26 | Zte Corporation | System and method for implementing incremental data comparison |
CN113592667A (en) * | 2020-04-30 | 2021-11-02 | 南京南瑞继保电气有限公司 | Method for generating market model of electric power spot market from EMS |
CN112364024A (en) * | 2020-11-30 | 2021-02-12 | 上海二三四五网络科技有限公司 | Control method and device for batch automatic comparison of table data |
CN112364024B (en) * | 2020-11-30 | 2024-02-27 | 上海二三四五网络科技有限公司 | Control method and device for automatic comparison of table data in batches |
CN112817792A (en) * | 2021-01-22 | 2021-05-18 | 浪潮电子信息产业股份有限公司 | Data backup method, device and system of IaaS system and storage medium |
CN115185982A (en) * | 2022-09-14 | 2022-10-14 | 浩鲸云计算科技股份有限公司 | Data preparation method and system based on data set arrangement |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108228740A (en) | Electric power full-service uniform data centre data analysis domain comparing tool | |
CN106327055B (en) | A kind of electricity expense control method and system based on big data technology | |
CN111241129B (en) | Industrial production enterprise index data acquisition and calculation system | |
CN108089893A (en) | Definite method, apparatus, terminal device and the storage medium of redundant resource | |
CN102890720A (en) | Database inspection and maintenance method | |
CN113872813B (en) | Full life cycle management method and system for carrier communication equipment | |
CN102209118A (en) | Distributed mass data gathering method | |
CN111309581B (en) | Application performance detection method and device in database upgrading scene | |
CN101309173B (en) | Automatic concatenation algorithm for transmission network service circuit routing and data checking system | |
CN108388626A (en) | SQL automatic optimization methods, device, computer equipment and storage medium | |
CN111475490A (en) | Data management system and method for data directory system | |
CN103606032B (en) | A kind of method in two dimension power grid GIS data set | |
CN105335900A (en) | Data integration processing method based on power equipment state monitoring system | |
EP2610768A1 (en) | Data archiving and de-archiving in a business environment | |
CN102868601B (en) | Routing system related to network topology based on graphic configuration database businesses | |
CN112036759A (en) | Power grid engineering material list compiling and reporting method and system | |
CN105786877A (en) | Data storage method and system and data inquiry method | |
CN110033195A (en) | Adjust grid model splicing method to a kind of province based on CIM/CIS | |
CN104281584A (en) | XML database performance testing system and method | |
CN107146166B (en) | Distribution network planning auxiliary system | |
CN107943912A (en) | A kind of response type Resource TOC data visualization management method, terminal and device | |
CN107277143A (en) | A kind of resource matched management method and device | |
CN107093018A (en) | Communication engineering project information method for visualizing and device based on health model | |
CN104866535A (en) | Compression method and device of number segment records | |
CN101426220A (en) | Method, apparatus and system for base station cutover |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
WD01 | Invention patent application deemed withdrawn after publication | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180629 |