CN101452450A - Multiple source data conversion service method and apparatus thereof - Google Patents

Multiple source data conversion service method and apparatus thereof Download PDF

Info

Publication number
CN101452450A
CN101452450A CNA2007101715069A CN200710171506A CN101452450A CN 101452450 A CN101452450 A CN 101452450A CN A2007101715069 A CNA2007101715069 A CN A2007101715069A CN 200710171506 A CN200710171506 A CN 200710171506A CN 101452450 A CN101452450 A CN 101452450A
Authority
CN
China
Prior art keywords
data
module
source
conversion
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2007101715069A
Other languages
Chinese (zh)
Inventor
王治华
李瑞庆
刘敦楠
何光宇
陈雪青
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Shanghai Municipal Electric Power Co
Original Assignee
Tsinghua University
Shanghai Municipal Electric Power Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University, Shanghai Municipal Electric Power Co filed Critical Tsinghua University
Priority to CNA2007101715069A priority Critical patent/CN101452450A/en
Publication of CN101452450A publication Critical patent/CN101452450A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to a service method and a service device for converting multi-source data. The device comprises a data source interface module, a data importing module, a data cleaning module, a data converting module, a consolidated data structure module, a consolidated storage type module, a consolidated exporting interface module and a flexible export setting module. The service method and the service device for converting the multi-source data have the following advantages: 1) an independent device is specially responsible for operations, such as data exchange of various advanced application systems and various basic service systems in a power dispatching center, thereby improving efficiency of data conversion, and ensuring correctness and timeliness of the data conversion; 2) each advanced application system only needs to acquire data from a data conversion service device, thereby saving complicated workload of data conversion, and saving development cost and maintenance cost; and 3) the advanced application system is separated from data conversion, thereby saving hardware resource, and improving operating efficiency and operating stability of the application system.

Description

A kind of multiple source data conversion service method and device thereof
Technical field
The present invention relates to a kind of advanced application system (as systems such as decision support, data mining, report form statistics) and basic service system (as advance, pin, deposit system, management information system, the office automation system) Data Interchange Technology between relates in particular in the industry system information management such as electric power, telecommunications, finance, aviation, retail in order to the efficient that improves data-switching, multiple source data conversion service method and the device thereof that reduces development and maintenance cost, economize on hardware and the Internet resources of advanced application system.
Background technology
Current, the dispatching communication center of electric system, having set up with energy management system EMS (EnergyManagement System), scheduling information management system DMIS (Dispatching Management InformationSystem), Electricity Market Operation System etc. is the basic service system of representative.Except these basic service systems, (be called for short: the power-management centre) each department is in order to satisfy concrete need of work at the dispatching communication center of electric system, also need on the basis of above basic service system, set up some comparatively senior application systems at particular demands, as visual monitor system, Analog Simulation System, data analysis system, reporting system, data digging system etc.The data that these advanced application system are required often are derived from one or more basic service system.Therefore, in setting up the process of advanced application system, how from a plurality of basic service system acquisition, cleaning, translation data, promptly data integration job is a problem that must solve.
Referring to Fig. 1, on the one hand, foregoing basic service system is the business demand at different departments, as, energy management system, schedule information system, Electricity Market Operation System and other operation system are set up by the independent development of different exploitation units.Therefore, cycle of the type of each system database system, data tableau format, data acquisition etc. is all inequality.This situation is given the data integration job of advanced application system, has caused difficulty, for example:
1) data layout disunity between a plurality of data sources, the development difficulty of increase advanced application system;
2) the advanced application system server need dispose the data-driven program that is applicable to the disparate databases type, and occupying system resources increases system burden;
3) application's data importing work, occupying system resources influences running efficiency of system;
4) in a plurality of data sources, all the data that exist are in various degree omitted and the bad data problem, have reduced the operation stability of advanced application.
Referring to Fig. 2, on the other hand, because each advanced application system is also successively proposed and stand-alone development according to actual needs by each business department, therefore, each advanced application system is all independently carried out data importing, cleaning and the conversion work of multi-data source.
There are following problem in exploitation and operation for advanced application system:
1) each advanced application all needs to prepare the data-driven program in Various types of data source, and the installation of data-driven, renewal and maintenance work must be responsible for by advanced application system.The installation of driver itself can take the resource of system server, and the operation of driver and version conflict can be to reducing the operation stability of advanced application.
2) each advanced application all needs to collect and understand the database structure of each operation system when exploitation, the tables of data form, even the implication of each initial parameter, so that understand this Service Database and derive desired data, increased the development amount of advanced application.
3) each advanced application all needs the bad data of each business datum is cleared up and changed, bad data occurs under utmost point specific condition often, in the reality, therefore advanced application system does not often have enough budgets and energy specially the bad data of each operation system to be carried out particular study and sets up countermeasure, is difficult to avoid to be subjected to the influence of bad data and the stability of reduction system operation.If special deep research is also handled the bad data of each operation system, can increase the cost of development of advanced application system again greatly.
Because each basic service system and each advanced application system all are respectively, independently design, develop, be responsible for separately renewal, upgrading and maintenance work respectively, there is not unified coordinated management, also can bring following problem:
1) overlapping development problem
Each advanced application system in order to obtain the data of each operation system, all needs to carry out complete data importing, cleaning and housekeeping.In practice, these data processing work are often occupied significant proportion in advanced application system in the construction cycle, have increased cost of development.Different advanced applications is all successively finished the work of same type, and the work of these repeatability itself is also remarkable, if do not drop into enough costs, then can't ensure the quality of products, and input cost then causes the wasting of resources.
2) wasting of resources and operational efficiency problem
In practice, each advanced application all is independent project verification, independent budget.If advanced application system itself need operate on 1 station server, if not extra budget increase, data integration job also needs to move under same station server so.The operation of advanced application system certainly will be received the influence of data integration job and be lowered efficiency.If another station server of additional configuration then can cause the bigger wasting of resources.
3) increase of maintenance cost
Under existing scheme, when the basic service system renovates, if relate to the variation of database, the variation of LAN (Local Area Network), even very little variation, the capital is caused the advanced application system based on these operation system data and is seriously influenced, and all advanced application system all need to carry out corresponding transformation.From another angle, if a certain advanced application system, the data of 5 basic service systems have been used, so these 5 operation systems any one upgrade, advanced application system all has to carry out corresponding modification, frequent system upgrade transformation can influence the normal operation continuously of advanced application system, the increase that also can bring maintenance cost.
Therefore, for solving above data integration problem, that is: with disparate databases system in each basic service system, the data of different-format, carry out data importing respectively, data cleansing and data-switching, and with the redesign uniform data format store, the single data platform of consolidation form is provided for each advanced application, the applicant makes every effort to by designing independently a multi-data source data cleansing and a data converted conversion service device, bear whole data acquisitions, conversion and integrated work, data acquisition and advanced application system are separated, to avoid the overlapping development of each advanced application system, reduce day regular data repeat import conserve system resources, reduce wrong probability, improve system stability.
Summary of the invention
The present invention aims to provide a kind of independently multiple source data conversion service method and device thereof, data-switching is separated with application system, realization is to data importing, cleaning and the conversion work in a plurality of dissimilar distributed data source that comprises power information system, improve the efficient of data-switching, improve the operation stability of application system.
One of the present invention, a kind of multi-source data conversion service device, it is characterized in that: it comprises that the data source interface module, data importing module, data cleansing module, data conversion module, uniform data construction module, storage and uniform type block, unified export interface module and flexible derivation that connect successively are provided with module, wherein:
The data source interface module is used for the type of database according to all kinds of basic service system, the integrated interface that is applicable to the visit types of databases;
The data importing module is used for the responsible data that import each basic service system.Comprise:, determine data content to be imported according to the demand data of each advanced application; Select the particular data interface, visit basic business data storehouse imports data;
The data cleansing module is used to handle bad data, comprising: according to the data characteristics and the data content of each basic service system, determine the concrete grammar that bad data is handled; Completely examine the identification bad data to importing data; According to the bad data disposal route of drafting in advance, data are repaired processing;
Data conversion module, the type of database and corresponding different data memory format different according to each data source are uniform data format with Data Format Transform;
The uniform data construction module is used for the data list structure difference according to each data source, reunifies data structure, is convenient to storage and identification;
The storage and uniform type block is used to and satisfies the demand data that operates in all kinds of advanced applications under different operating system, the different pieces of information library, and the unification of data storage type is cross-platform text formatting, and the read-write rule of design text database;
Unify the export interface module, be used to be responsible for providing the unified interface of stored text database data derivation, satisfy the different pieces of information interface requirements of each senior application;
Derive flexibly module is set, be used for needs, content, derivation destination and the derivation time of derived data is set flexibly, be responsible for regularly deriving automatically of data according to each advanced application system.
In above-mentioned multi-source data conversion service device, the converted contents of data conversion module comprises: the conversion of the conversion of numeric class form, text class form, the conversion of date class form or the conversion of specified type form.
In above-mentioned multi-source data conversion service device, the content of the data structure that the uniform data construction module is unified comprises: time dimension, respectively the classify design of dimension, data list structure.
In above-mentioned multi-source data conversion service device, the content of the read-write rule of storage and uniform type block design text database comprises: the store path of the identifier of design text data table and read-write rule, design text data table, the automatic translation write-in program of design text data table and design text data table read translation program automatically.
In above-mentioned multi-source data conversion service device, derive the setting of the data derived rule that module is set flexibly: comprise selection, the customization of derivation destination, the customization of derivation cycle of derived data table; Data derive scheduler program automatically, are responsible for regularly carrying out the export (swf) command that has customized.
The present invention's two, a kind of multiple source data conversion service method comprises the following steps:
The integrated step of data source interface: according to the type of database of all kinds of basic service system, the integrated interface that is applicable to the visit types of databases;
The importing step of Various types of data:, determine data content to be imported according to the demand data of each advanced application; Select the particular data interface, visit basic business data storehouse imports data;
The cleaning step of Various types of data:, determine the concrete grammar that bad data is handled according to the data characteristics and the data content of each basic service system; Completely examine the identification bad data to importing data; According to the bad data disposal route of drafting in advance, data are repaired processing;
The switch process of Various types of data: the type of database and corresponding different data memory format different according to each data source are uniform data format with Data Format Transform;
The uniform data configuration steps: the data list structure difference of each data source, need reunify the design data structure, be convenient to storage and identification;
Storage and uniform type step: operate in different operating system in order to satisfy, the demand data of all kinds of advanced applications under the different pieces of information library is cross-platform text formatting with the unification of data storage type, and the read-write rule of design text database;
Derive flexibly step is set: according to the needs of each advanced application system, is set content, derivation destination and the derivation time of derived data flexibly, is responsible for regularly deriving automatically of data,
The setting of data derived rule: comprise selection, the customization of derivation destination, the customization of derivation cycle of derived data table;
Data derive scheduler program automatically, are responsible for regularly carrying out the export (swf) command that has customized.
Advantage that the present invention is compared with prior art had or good effect
1. be responsible for exchanges data work specially with independent device, improve the efficient of data-switching, guarantee the correctness and the promptness of data-switching as all kinds of advanced application system in the power-management centre and all kinds of basic service system;
2. each advanced application system only needs to obtain data from the data-switching service unit, has saved complicated data-switching workload, has saved cost of development, maintenance cost;
3. with advanced application system and separated from data conversion, save hardware resource, improved the operational efficiency and the operation stability of application system
Description of drawings
Fig. 1 is that two type systematics are the exchanges data synoptic diagram between basic service system and advanced application system;
Fig. 2 is the synoptic diagram of data flow between existing basic service system and advanced application system;
Fig. 3 is arranged on the multi-source data conversion service device illustrative view of functional configuration of the present invention between basic service system and advanced application system.
Embodiment
Basic ideas of the present invention:
1) the multi-source data conversion service device is independent of each basic service system, also is independent of each advanced application system;
2) multi-source data conversion service device public data, services that each advanced application system is provided;
3) the multi-source data conversion service device is a data source with each basic service system;
4) the multi-source data conversion service device provides data, services towards each advanced application system, satisfies required data demand.
The multi-source data conversion service device should operate in the intranet, and guarantees:
A. with being connected of each basic service system server;
B. with being connected of each advanced application system server;
C. enough network bandwidths (100M).
The multi-source data conversion service device should operate in the intranet, and guarantees:
A. with being connected of each basic service system server;
B. with being connected of each advanced application system server;
C. enough network bandwidths (100M).
As shown in Figure 3, the multi-source data conversion service device comprises eight modules:
Data source interface module 1 is used for the type of database according to all kinds of basic service system, the integrated interface that is applicable to the visit types of databases.Comprise:
Microsoft SQL Server database interface;
Microsoft Excel tables of data interface;
Microsoft Access database interface;
The oracle database interface;
IBM DB2 database interface;
My SQL database interface;
The Paradox database interface;
The dBase database interface;
The FoxPro database interface;
The XML database interface;
The text data interface.
Data importing module 2 is used for the responsible data that import each basic service system.Comprise:
According to the demand data of each advanced application, determine data content to be imported;
Select the particular data interface, visit basic business data storehouse imports data.
Data cleansing module 3 is used to handle bad data.Comprise:
According to the data characteristics and the data content of each basic service system, determine the concrete grammar that bad data is handled;
Completely examine the identification bad data to importing data; According to the bad data disposal route of drafting in advance, data are repaired processing.
Data conversion module 4, the type of database and corresponding different data memory format different according to each data source are uniform data format with Data Format Transform, comprising:
The conversion of numeric class form: as types such as integer, short, long, single precision, double precisions;
The conversion of text class form: as all kinds of char forms, text form, binary format, stream format;
The conversion of date class form: with each date class form, with the date of text storage, with the date of stored digital, unification is converted to the date type of setting;
The conversion of other type format:, be converted to text formatting by uniform requirement as path type, picture/mb-type etc.
Uniform data construction module 5 is used for the data list structure difference according to each data source, reunifies data structure, is convenient to storage and identification.The content of this uniform data structure comprises:
Time dimension;
Each dimension of classifying: as power plant's dimension, circuit dimension, regional dimension etc.;
The design of data list structure;
The data that import are stored with the uniform data structure.
Storage and uniform type block 6 is used to and satisfies the demand data that operates in all kinds of advanced applications under different operating system, the different pieces of information library, and the unification of data storage type is cross-platform text formatting, and the read-write rule of design text database.Comprise:
The identifier of design text data table and read-write rule;
The store path of design text data table;
The automatic translation write-in program of design text data table;
Design text data table read translation program automatically.
Unified export interface module 7 according to the different pieces of information interface requirements of each senior application, provides unified data export interface, comprising:
The data-interface stipulations;
The design of data-interface function;
The data-interface update mechanism;
The data-interface maintenance mechanism.
Derive flexibly module 8 is set, be used for needs, content, derivation destination and the derivation time of derived data is set flexibly, be responsible for regularly deriving automatically of data according to each advanced application system.Wherein,
The setting of data derived rule: comprise selection, the customization of derivation destination, the customization of derivation cycle of derived data table;
Data derive scheduler program automatically, are responsible for regularly carrying out the export (swf) command that has customized.
The present invention also provides a kind of multiple source data conversion service method, comprises the following steps:
The integrated step of data source interface: according to the type of database of all kinds of basic service system, the integrated interface that is applicable to the visit types of databases;
The importing step of Various types of data:, determine data content to be imported according to the demand data of each advanced application; Select the particular data interface, visit basic business data storehouse imports data;
The cleaning step of Various types of data:, determine the concrete grammar that bad data is handled according to the data characteristics and the data content of each basic service system; Completely examine the identification bad data to importing data; According to the bad data disposal route of drafting in advance, data are repaired processing;
The switch process of Various types of data: the type of database and corresponding different data memory format different according to each data source are uniform data format with Data Format Transform;
The uniform data configuration steps: the data list structure difference of each data source, need reunify the design data structure, be convenient to storage and identification;
Storage and uniform type step: operate in different operating system in order to satisfy, the demand data of all kinds of advanced applications under the different pieces of information library is cross-platform text formatting with the unification of data storage type, and the read-write rule of design text database;
Derive flexibly step is set: according to the needs of each advanced application system, is set content, derivation destination and the derivation time of derived data flexibly, is responsible for regularly deriving automatically of data,
The setting of data derived rule: comprise selection, the customization of derivation destination, the customization of derivation cycle of derived data table;
Data derive scheduler program automatically, are responsible for regularly carrying out the export (swf) command that has customized.
In sum, the present invention sets up independently, special, complete multi-source data conversion service device, be responsible for the data interaction between all kinds of advanced application system and all kinds of basic service system, on the one hand according to the data characteristics of all kinds of basic service system, set up data-interface, be responsible for data importing, cleaning and conversion work, the unified on the other hand Data Structure Design of carrying out, all kinds of business datums are stored with unified structure and cross-platform uniform data form under the data layout of unified design, desired data is exported in each advanced application system on request.The present invention is by designing independently a multi-data source data cleansing and a data converted conversion service device, bear whole data acquisitions, conversion and integrated work, data acquisition and advanced application system are separated, with the overlapping development of avoiding each advanced application system, the importing that repeats that reduces day regular data, conserve system resources, reduce wrong probability, raising system stability.
The present invention not only can be used in the transformation of electric power information.At present, a lot of industries such as telecommunications, finance, aviation, retail have all realized than more comprehensive information system management.Informationalized further developing will turn to senior intellectual analysis and decision-making by current service management.In this course, advanced application system (as systems such as decision support, data mining, report form statistics) and basic service system (as advance, pin, deposit system, management information system, the office automation system) exchanges data between is a commonplace problem.With the present invention apply to these fields, data-switching and senior application are separated, and independently are a special device with data-switching, will improve the efficient of data-switching greatly, reduce development and maintenance cost, economize on hardware and the Internet resources of advanced application system.
Below embodiment has been described in detail the present invention in conjunction with the accompanying drawings, and those skilled in the art can make the many variations example to the present invention according to the above description.Thereby some details among the embodiment should not constitute limitation of the invention, and the scope that the present invention will define with appended claims is as protection scope of the present invention.

Claims (6)

1. multi-source data conversion service device, it is characterized in that: it comprises that the data source interface module, data importing module, data cleansing module, data conversion module, uniform data construction module, storage and uniform type block, unified export interface module and flexible derivation that connect successively are provided with module, wherein:
The data source interface module is used for the type of database according to all kinds of basic service system, the integrated interface that is applicable to the visit types of databases;
The data importing module is used for the responsible data that import each basic service system.Comprise:, determine data content to be imported according to the demand data of each advanced application; Select the particular data interface, visit basic business data storehouse imports data;
The data cleansing module is used to handle bad data, comprising: according to the data characteristics and the data content of each basic service system, determine the concrete grammar that bad data is handled; Completely examine the identification bad data to importing data; According to the bad data disposal route of drafting in advance, data are repaired processing;
Data conversion module, the type of database and corresponding different data memory format different according to each data source are uniform data format with Data Format Transform;
The uniform data construction module is used for the data list structure difference according to each data source, reunifies data structure, is convenient to storage and identification;
The storage and uniform type block is used to and satisfies the demand data that operates in all kinds of advanced applications under different operating system, the different pieces of information library, and the unification of data storage type is cross-platform text formatting, and the read-write rule of design text database;
Unify the export interface module, be used to be responsible for providing the unified interface of stored text database data derivation, satisfy the different pieces of information interface requirements of each senior application;
Derive flexibly module is set, be used for needs, content, derivation destination and the derivation time of derived data is set flexibly, be responsible for regularly deriving automatically of data according to each advanced application system.
2. multi-source data conversion service device according to claim 1 is characterized in that: the converted contents of described data conversion module comprises: the conversion of the conversion of numeric class form, text class form, the conversion of date class form or the conversion of specified type form.
3. multi-source data conversion service device according to claim 1 is characterized in that: the content of the data structure that described uniform data construction module is unified comprises: time dimension, respectively the classify design of dimension, data list structure.
4. multi-source data conversion service device according to claim 1 is characterized in that: the content of the read-write rule of described storage and uniform type block design text database comprises: the store path of the identifier of design text data table and read-write rule, design text data table, the automatic translation write-in program of design text data table and design text data table read translation program automatically.
5. multi-source data conversion service device according to claim 1 is characterized in that: described flexible derivation is provided with the setting of the data derived rule of module: comprise selection, the customization of derivation destination, the customization of derivation cycle of derived data table; Data derive scheduler program automatically, are responsible for regularly carrying out the export (swf) command that has customized.
6. a multiple source data conversion service method comprises the following steps:
The integrated step of data source interface: according to the type of database of all kinds of basic service system, the integrated interface that is applicable to the visit types of databases;
The importing step of Various types of data:, determine data content to be imported according to the demand data of each advanced application; Select the particular data interface, visit basic business data storehouse imports data;
The cleaning step of Various types of data:, determine the concrete grammar that bad data is handled according to the data characteristics and the data content of each basic service system; Completely examine the identification bad data to importing data; According to the bad data disposal route of drafting in advance, data are repaired processing;
The switch process of Various types of data: the type of database and corresponding different data memory format different according to each data source are uniform data format with Data Format Transform;
The uniform data configuration steps: the data list structure difference of each data source, need reunify the design data structure, be convenient to storage and identification;
Storage and uniform type step: operate in different operating system in order to satisfy, the demand data of all kinds of advanced applications under the different pieces of information library is cross-platform text formatting with the unification of data storage type, and the read-write rule of design text database;
Derive flexibly step is set: according to the needs of each advanced application system, is set content, derivation destination and the derivation time of derived data flexibly, is responsible for regularly deriving automatically of data,
The setting of data derived rule: comprise selection, the customization of derivation destination, the customization of derivation cycle of derived data table;
Data derive scheduler program automatically, are responsible for regularly carrying out the export (swf) command that has customized.
CNA2007101715069A 2007-11-30 2007-11-30 Multiple source data conversion service method and apparatus thereof Pending CN101452450A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNA2007101715069A CN101452450A (en) 2007-11-30 2007-11-30 Multiple source data conversion service method and apparatus thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNA2007101715069A CN101452450A (en) 2007-11-30 2007-11-30 Multiple source data conversion service method and apparatus thereof

Publications (1)

Publication Number Publication Date
CN101452450A true CN101452450A (en) 2009-06-10

Family

ID=40734686

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2007101715069A Pending CN101452450A (en) 2007-11-30 2007-11-30 Multiple source data conversion service method and apparatus thereof

Country Status (1)

Country Link
CN (1) CN101452450A (en)

Cited By (75)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101957865A (en) * 2010-10-27 2011-01-26 杭州新中大软件股份有限公司 Data exchange and sharing technology among heterogeneous systems
CN102043837A (en) * 2010-12-01 2011-05-04 北京迅捷英翔网络科技有限公司 Data integration system and method
CN102043836A (en) * 2010-12-01 2011-05-04 北京迅捷英翔网络科技有限公司 Data adapting device and method
CN102207978A (en) * 2011-06-30 2011-10-05 北京新媒传信科技有限公司 Database access method and system
CN102360370A (en) * 2011-09-29 2012-02-22 迈普通信技术股份有限公司 Centralized data management system and method
CN102375825A (en) * 2010-08-13 2012-03-14 捷达世软件(深圳)有限公司 Process integration server and method for realizing system integration by utilizing same
CN102385739A (en) * 2011-11-15 2012-03-21 中国电力科学研究院 Integrated information management platform for county-level power supply enterprises
CN102508706A (en) * 2011-11-18 2012-06-20 北京航空航天大学 Multi-source data integrating platform and establishing method thereof
CN102567796A (en) * 2010-12-20 2012-07-11 北大方正集团有限公司 Method and device for importing data
CN102609884A (en) * 2012-02-07 2012-07-25 中国南方电网有限责任公司 System for managing electric power dispatching logs
CN102609769A (en) * 2011-01-19 2012-07-25 上海中信信息发展股份有限公司 Data acquisition tool and data acquisition method
CN102609501A (en) * 2012-02-02 2012-07-25 北京华电天仁电力控制技术有限公司 Data cleaning method based on real-time historical database
CN102609513A (en) * 2012-02-07 2012-07-25 云南电力试验研究院(集团)有限公司电力研究院 Multi-data-source database system for condition monitoring of electric transmission and transformation equipment
CN102622415A (en) * 2012-02-20 2012-08-01 南方电网科学研究院有限责任公司 Method for synchronous transmission of power quality monitoring data for multiple platforms
CN103034647A (en) * 2011-10-09 2013-04-10 镇江雅迅软件有限责任公司 Excel data import based on multi-threading technology
CN103092980A (en) * 2013-01-31 2013-05-08 中国科学院自动化研究所 Method and system of data automatic conversion and storage
CN103150324A (en) * 2012-12-26 2013-06-12 人民搜索网络股份公司 Chained processing-based data collecting system and method
CN103177119A (en) * 2013-04-09 2013-06-26 上海华力微电子有限公司 Data type automatic conversion system and method based on database
CN103187991A (en) * 2011-12-28 2013-07-03 宇龙计算机通信科技(深圳)有限公司 Data transmission system and data transmission method
CN103473378A (en) * 2013-09-30 2013-12-25 国家电网公司 Conventional data collecting system capable of collecting various structural data sources and collecting method
CN103530413A (en) * 2013-10-28 2014-01-22 北京国双科技有限公司 Method and device for processing data
CN103577499A (en) * 2012-08-10 2014-02-12 广州博纳信息技术有限公司 Integrated intelligent spatial comprehensive information platform
CN103593472A (en) * 2013-11-28 2014-02-19 国家电网公司 Power marketing system information obtaining method and device
CN103678450A (en) * 2013-09-10 2014-03-26 清华大学 Method for communication between on-line operation system and off-line simulation system in power system
CN103699555A (en) * 2013-07-03 2014-04-02 国电南瑞科技股份有限公司 Multisource data real-time database data generation method applicable to scheduling and transformer substation integrated system
CN103729455A (en) * 2014-01-06 2014-04-16 中国南方电网有限责任公司 Master data storage method based on primary copy storage pattern
CN103970513A (en) * 2013-01-24 2014-08-06 江苏云知智能科技有限公司 Source data information access method and platform
CN101645007B (en) * 2009-09-07 2014-08-20 浪潮通用软件有限公司 Interface processing method of general quality inspection management software
CN104200402A (en) * 2014-09-11 2014-12-10 国家电网公司 Publishing method and system of source data of multiple data sources in power grid
CN104216961A (en) * 2014-08-21 2014-12-17 北京奇艺世纪科技有限公司 Method and device for data processing
CN104317624A (en) * 2014-11-04 2015-01-28 南京联创科技集团股份有限公司 Plug-in processing based data assembling method
CN104408150A (en) * 2014-12-03 2015-03-11 天津南大通用数据技术股份有限公司 Data import/ export method and device adapted to a plurality of data formats of databases
CN104508660A (en) * 2012-06-04 2015-04-08 惠普发展公司,有限责任合伙企业 User-defined loading of data onto a database
CN104580097A (en) * 2013-10-22 2015-04-29 腾讯科技(深圳)有限公司 Data processing method, device and system
CN104601554A (en) * 2014-12-29 2015-05-06 北京致远协创软件有限公司 Data exchange method and device
CN104636341A (en) * 2013-11-06 2015-05-20 航天信息股份有限公司 Data cleaning storage method for added value tax one-number multi-name monitoring
CN104636337A (en) * 2013-11-06 2015-05-20 航天信息股份有限公司 Data cleaning storage method for added value tax
CN104636338A (en) * 2013-11-06 2015-05-20 航天信息股份有限公司 Data cleaning storage method for added value tax negative and positive note monitoring
CN104715051A (en) * 2015-03-30 2015-06-17 东南大学 Integrated processing method for power station system heterogeneous data fusion
WO2016008092A1 (en) * 2014-07-15 2016-01-21 Microsoft Technology Licensing, Llc Managing data-driven services
CN105320729A (en) * 2014-06-17 2016-02-10 Ims健康公司 Data collection and cleaning at source
CN105468736A (en) * 2015-11-23 2016-04-06 国云科技股份有限公司 Plug-in and component based data preprocessing system and realization method therefor
CN105512237A (en) * 2015-11-30 2016-04-20 用友网络科技股份有限公司 Data introduction system with complex structure
CN105574667A (en) * 2015-12-15 2016-05-11 中广核工程有限公司 Nuclear power design data integration method and system
CN105760370A (en) * 2014-12-14 2016-07-13 云南电力调度控制中心 Plug-in type report framework technology
CN105786695A (en) * 2014-12-26 2016-07-20 北大医疗信息技术有限公司 Data test method and system
CN105956932A (en) * 2016-04-29 2016-09-21 中国南方电网有限责任公司电网技术研究中心 Distribution and utilization data fusion method and system
CN105989179A (en) * 2015-03-06 2016-10-05 北京邮电大学 Financial data processing method and system
CN106021528A (en) * 2016-05-25 2016-10-12 北京京东尚科信息技术有限公司 Data processing method and device
CN106066871A (en) * 2016-05-30 2016-11-02 中国人民解放军装备学院 A kind of multiple and distributing sources access method based on open interface
CN106446064A (en) * 2016-09-05 2017-02-22 中国银行股份有限公司 Data conversion method and device
CN106708791A (en) * 2017-01-04 2017-05-24 竹间智能科技(上海)有限公司 Data format conversion method and device
CN106708860A (en) * 2015-11-13 2017-05-24 阿里巴巴集团控股有限公司 Chart processing method and system
CN106777104A (en) * 2016-12-15 2017-05-31 国云科技股份有限公司 A kind of system and implementation method for obtaining heterogeneous software system data
CN106777101A (en) * 2016-12-14 2017-05-31 深圳天源迪科信息技术股份有限公司 Data processing engine
CN107391550A (en) * 2017-06-06 2017-11-24 广东广业开元科技有限公司 A kind of report form generation method and system based on big data mould plate technique
CN107845042A (en) * 2017-10-24 2018-03-27 星际空间(天津)科技发展有限公司 Supervisory systems is imposed in house in a kind of state-owned land
CN108073720A (en) * 2017-12-30 2018-05-25 广州明动软件股份有限公司 Data quality management system and method applied to big data system
CN108154341A (en) * 2017-12-18 2018-06-12 千寻位置网络有限公司 United Dispatching platform and method of work based on data flow and workflow
CN108255988A (en) * 2017-12-28 2018-07-06 新智数字科技有限公司 The processing method and processing system of data
CN108733416A (en) * 2017-04-21 2018-11-02 北大方正集团有限公司 Date format processing method based on JavaScript and system
CN108733433A (en) * 2017-04-21 2018-11-02 北大方正集团有限公司 Method and system based on SQL subdivision period operations
CN109358840A (en) * 2017-12-29 2019-02-19 牧科技(北京)有限公司 Support the Data Integration analysis system and its method of a variety of milk Room software data interfaces
CN109639766A (en) * 2018-11-19 2019-04-16 山东新海软件股份有限公司 A kind of storage box based on cloud storage technology
CN109782722A (en) * 2019-01-31 2019-05-21 吕梁市军民融合协同创新研究院 One kind is towards the quick processing system of industrial scene large-scale production line multidimensional data
CN109871381A (en) * 2019-01-22 2019-06-11 积成电子股份有限公司 The method that grid operation data is adaptively stored and inquired
CN110019228A (en) * 2017-12-25 2019-07-16 北京金风科创风电设备有限公司 Multi-source data integration method and device based on fan data
CN110019153A (en) * 2017-09-13 2019-07-16 北京宸信征信有限公司 A kind of polymorphic type batch data processing system and its processing method
CN110032593A (en) * 2019-03-12 2019-07-19 平安城市建设科技(深圳)有限公司 Houseclearing querying method, device, equipment and computer readable storage medium
CN110555073A (en) * 2019-09-10 2019-12-10 政采云有限公司 data processing method and device, electronic equipment and storage medium
CN110660461A (en) * 2019-09-23 2020-01-07 广州市番禺区中心医院(广州市番禺区人民医院、广州市番禺区心血管疾病研究所) Cross-platform medical data information uploading system based on artificial intelligence
CN111737336A (en) * 2020-07-30 2020-10-02 湖南中车时代通信信号有限公司 Database and rail transit signal system
CN112306801A (en) * 2020-10-28 2021-02-02 联通(广东)产业互联网有限公司 Monitoring data processing method, system and medium based on heterogeneous data source
WO2021204041A1 (en) * 2020-04-08 2021-10-14 支付宝(杭州)信息技术有限公司 Data processing
CN114253480A (en) * 2021-12-21 2022-03-29 北京云迹科技股份有限公司 Data storage method and device, electronic equipment and storage medium

Cited By (98)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101645007B (en) * 2009-09-07 2014-08-20 浪潮通用软件有限公司 Interface processing method of general quality inspection management software
CN102375825A (en) * 2010-08-13 2012-03-14 捷达世软件(深圳)有限公司 Process integration server and method for realizing system integration by utilizing same
CN101957865A (en) * 2010-10-27 2011-01-26 杭州新中大软件股份有限公司 Data exchange and sharing technology among heterogeneous systems
CN102043837A (en) * 2010-12-01 2011-05-04 北京迅捷英翔网络科技有限公司 Data integration system and method
CN102043836A (en) * 2010-12-01 2011-05-04 北京迅捷英翔网络科技有限公司 Data adapting device and method
CN102567796A (en) * 2010-12-20 2012-07-11 北大方正集团有限公司 Method and device for importing data
CN102609769A (en) * 2011-01-19 2012-07-25 上海中信信息发展股份有限公司 Data acquisition tool and data acquisition method
CN102207978A (en) * 2011-06-30 2011-10-05 北京新媒传信科技有限公司 Database access method and system
CN102360370A (en) * 2011-09-29 2012-02-22 迈普通信技术股份有限公司 Centralized data management system and method
CN103034647A (en) * 2011-10-09 2013-04-10 镇江雅迅软件有限责任公司 Excel data import based on multi-threading technology
CN102385739A (en) * 2011-11-15 2012-03-21 中国电力科学研究院 Integrated information management platform for county-level power supply enterprises
CN102385739B (en) * 2011-11-15 2016-01-20 中国电力科学研究院 A kind of county power supply company integration information management platform
CN102508706A (en) * 2011-11-18 2012-06-20 北京航空航天大学 Multi-source data integrating platform and establishing method thereof
CN102508706B (en) * 2011-11-18 2013-08-07 北京航空航天大学 Multi-source data integrating platform and establishing method thereof
CN103187991A (en) * 2011-12-28 2013-07-03 宇龙计算机通信科技(深圳)有限公司 Data transmission system and data transmission method
CN102609501A (en) * 2012-02-02 2012-07-25 北京华电天仁电力控制技术有限公司 Data cleaning method based on real-time historical database
CN102609513A (en) * 2012-02-07 2012-07-25 云南电力试验研究院(集团)有限公司电力研究院 Multi-data-source database system for condition monitoring of electric transmission and transformation equipment
CN102609884A (en) * 2012-02-07 2012-07-25 中国南方电网有限责任公司 System for managing electric power dispatching logs
CN102622415A (en) * 2012-02-20 2012-08-01 南方电网科学研究院有限责任公司 Method for synchronous transmission of power quality monitoring data for multiple platforms
US10474658B2 (en) 2012-06-04 2019-11-12 Micro Focus Llc User-defined loading of data onto a database
CN104508660A (en) * 2012-06-04 2015-04-08 惠普发展公司,有限责任合伙企业 User-defined loading of data onto a database
CN103577499A (en) * 2012-08-10 2014-02-12 广州博纳信息技术有限公司 Integrated intelligent spatial comprehensive information platform
CN103150324A (en) * 2012-12-26 2013-06-12 人民搜索网络股份公司 Chained processing-based data collecting system and method
CN103970513A (en) * 2013-01-24 2014-08-06 江苏云知智能科技有限公司 Source data information access method and platform
CN103092980A (en) * 2013-01-31 2013-05-08 中国科学院自动化研究所 Method and system of data automatic conversion and storage
CN103177119A (en) * 2013-04-09 2013-06-26 上海华力微电子有限公司 Data type automatic conversion system and method based on database
CN103699555A (en) * 2013-07-03 2014-04-02 国电南瑞科技股份有限公司 Multisource data real-time database data generation method applicable to scheduling and transformer substation integrated system
CN103678450B (en) * 2013-09-10 2017-04-05 清华大学 Communication means in power system between on-line operation system and off-line emulation system
CN103678450A (en) * 2013-09-10 2014-03-26 清华大学 Method for communication between on-line operation system and off-line simulation system in power system
CN103473378A (en) * 2013-09-30 2013-12-25 国家电网公司 Conventional data collecting system capable of collecting various structural data sources and collecting method
CN104580097A (en) * 2013-10-22 2015-04-29 腾讯科技(深圳)有限公司 Data processing method, device and system
CN103530413B (en) * 2013-10-28 2017-05-10 北京国双科技有限公司 Method and device for processing data
CN103530413A (en) * 2013-10-28 2014-01-22 北京国双科技有限公司 Method and device for processing data
CN104636338A (en) * 2013-11-06 2015-05-20 航天信息股份有限公司 Data cleaning storage method for added value tax negative and positive note monitoring
CN104636338B (en) * 2013-11-06 2018-01-12 航天信息股份有限公司 A kind of data cleansing storage method for the monitoring of value-added tax negative and positive ticket
CN104636341A (en) * 2013-11-06 2015-05-20 航天信息股份有限公司 Data cleaning storage method for added value tax one-number multi-name monitoring
CN104636337A (en) * 2013-11-06 2015-05-20 航天信息股份有限公司 Data cleaning storage method for added value tax
CN104636341B (en) * 2013-11-06 2018-02-27 航天信息股份有限公司 A kind of data cleansing storage method for the several monitoring of value-added tax No.1
CN104636337B (en) * 2013-11-06 2018-01-12 航天信息股份有限公司 A kind of data cleansing storage method for value-added tax
CN103593472A (en) * 2013-11-28 2014-02-19 国家电网公司 Power marketing system information obtaining method and device
CN103729455B (en) * 2014-01-06 2015-01-21 中国南方电网有限责任公司 Master data storage method based on primary copy storage pattern
CN103729455A (en) * 2014-01-06 2014-04-16 中国南方电网有限责任公司 Master data storage method based on primary copy storage pattern
CN105320729B (en) * 2014-06-17 2020-10-20 Iqvia 公司 Data collection and cleansing at source
CN105320729A (en) * 2014-06-17 2016-02-10 Ims健康公司 Data collection and cleaning at source
WO2016008092A1 (en) * 2014-07-15 2016-01-21 Microsoft Technology Licensing, Llc Managing data-driven services
US10348595B2 (en) 2014-07-15 2019-07-09 Microsoft Technology Licensing, Llc Managing data-driven services
CN104216961B (en) * 2014-08-21 2019-03-29 北京奇艺世纪科技有限公司 A kind of data processing method and device
CN104216961A (en) * 2014-08-21 2014-12-17 北京奇艺世纪科技有限公司 Method and device for data processing
CN104200402A (en) * 2014-09-11 2014-12-10 国家电网公司 Publishing method and system of source data of multiple data sources in power grid
CN104317624A (en) * 2014-11-04 2015-01-28 南京联创科技集团股份有限公司 Plug-in processing based data assembling method
CN104317624B (en) * 2014-11-04 2017-06-06 南京联创科技集团股份有限公司 Data assembly method based on plug-in unit treatment
CN104408150A (en) * 2014-12-03 2015-03-11 天津南大通用数据技术股份有限公司 Data import/ export method and device adapted to a plurality of data formats of databases
CN105760370A (en) * 2014-12-14 2016-07-13 云南电力调度控制中心 Plug-in type report framework technology
CN105786695A (en) * 2014-12-26 2016-07-20 北大医疗信息技术有限公司 Data test method and system
CN105786695B (en) * 2014-12-26 2019-09-17 北大医疗信息技术有限公司 Data test method and system
CN104601554A (en) * 2014-12-29 2015-05-06 北京致远协创软件有限公司 Data exchange method and device
CN104601554B (en) * 2014-12-29 2018-02-27 北京致远互联软件股份有限公司 A kind of method for interchanging data and DEU data exchange unit
CN105989179A (en) * 2015-03-06 2016-10-05 北京邮电大学 Financial data processing method and system
CN104715051B (en) * 2015-03-30 2019-02-15 东南大学 A kind of integral treatment method towards the fusion of electric power station system isomeric data
CN104715051A (en) * 2015-03-30 2015-06-17 东南大学 Integrated processing method for power station system heterogeneous data fusion
CN106708860A (en) * 2015-11-13 2017-05-24 阿里巴巴集团控股有限公司 Chart processing method and system
CN105468736A (en) * 2015-11-23 2016-04-06 国云科技股份有限公司 Plug-in and component based data preprocessing system and realization method therefor
CN105512237A (en) * 2015-11-30 2016-04-20 用友网络科技股份有限公司 Data introduction system with complex structure
CN105512237B (en) * 2015-11-30 2018-11-16 用友网络科技股份有限公司 A kind of data import system of labyrinth
CN105574667A (en) * 2015-12-15 2016-05-11 中广核工程有限公司 Nuclear power design data integration method and system
CN105956932A (en) * 2016-04-29 2016-09-21 中国南方电网有限责任公司电网技术研究中心 Distribution and utilization data fusion method and system
CN106021528A (en) * 2016-05-25 2016-10-12 北京京东尚科信息技术有限公司 Data processing method and device
CN106066871A (en) * 2016-05-30 2016-11-02 中国人民解放军装备学院 A kind of multiple and distributing sources access method based on open interface
CN106446064B (en) * 2016-09-05 2020-07-21 中国银行股份有限公司 Data conversion method and device
CN106446064A (en) * 2016-09-05 2017-02-22 中国银行股份有限公司 Data conversion method and device
CN106777101B (en) * 2016-12-14 2020-04-24 深圳天源迪科信息技术股份有限公司 Data processing engine
CN106777101A (en) * 2016-12-14 2017-05-31 深圳天源迪科信息技术股份有限公司 Data processing engine
CN106777104A (en) * 2016-12-15 2017-05-31 国云科技股份有限公司 A kind of system and implementation method for obtaining heterogeneous software system data
CN106708791B (en) * 2017-01-04 2020-03-17 竹间智能科技(上海)有限公司 Data format conversion method and device
CN106708791A (en) * 2017-01-04 2017-05-24 竹间智能科技(上海)有限公司 Data format conversion method and device
CN108733433A (en) * 2017-04-21 2018-11-02 北大方正集团有限公司 Method and system based on SQL subdivision period operations
CN108733416A (en) * 2017-04-21 2018-11-02 北大方正集团有限公司 Date format processing method based on JavaScript and system
CN107391550A (en) * 2017-06-06 2017-11-24 广东广业开元科技有限公司 A kind of report form generation method and system based on big data mould plate technique
CN110019153B (en) * 2017-09-13 2022-03-04 北京宸信征信有限公司 Multi-type batch data processing system and processing method thereof
CN110019153A (en) * 2017-09-13 2019-07-16 北京宸信征信有限公司 A kind of polymorphic type batch data processing system and its processing method
CN107845042A (en) * 2017-10-24 2018-03-27 星际空间(天津)科技发展有限公司 Supervisory systems is imposed in house in a kind of state-owned land
CN108154341A (en) * 2017-12-18 2018-06-12 千寻位置网络有限公司 United Dispatching platform and method of work based on data flow and workflow
CN110019228A (en) * 2017-12-25 2019-07-16 北京金风科创风电设备有限公司 Multi-source data integration method and device based on fan data
CN108255988A (en) * 2017-12-28 2018-07-06 新智数字科技有限公司 The processing method and processing system of data
CN109358840A (en) * 2017-12-29 2019-02-19 牧科技(北京)有限公司 Support the Data Integration analysis system and its method of a variety of milk Room software data interfaces
CN108073720A (en) * 2017-12-30 2018-05-25 广州明动软件股份有限公司 Data quality management system and method applied to big data system
CN109639766A (en) * 2018-11-19 2019-04-16 山东新海软件股份有限公司 A kind of storage box based on cloud storage technology
CN109871381A (en) * 2019-01-22 2019-06-11 积成电子股份有限公司 The method that grid operation data is adaptively stored and inquired
CN109782722A (en) * 2019-01-31 2019-05-21 吕梁市军民融合协同创新研究院 One kind is towards the quick processing system of industrial scene large-scale production line multidimensional data
CN110032593A (en) * 2019-03-12 2019-07-19 平安城市建设科技(深圳)有限公司 Houseclearing querying method, device, equipment and computer readable storage medium
CN110555073A (en) * 2019-09-10 2019-12-10 政采云有限公司 data processing method and device, electronic equipment and storage medium
CN110660461A (en) * 2019-09-23 2020-01-07 广州市番禺区中心医院(广州市番禺区人民医院、广州市番禺区心血管疾病研究所) Cross-platform medical data information uploading system based on artificial intelligence
CN110660461B (en) * 2019-09-23 2023-03-24 广州市番禺区中心医院(广州市番禺区人民医院、广州市番禺区心血管疾病研究所) Cross-platform medical data information uploading system based on artificial intelligence
WO2021204041A1 (en) * 2020-04-08 2021-10-14 支付宝(杭州)信息技术有限公司 Data processing
CN111737336A (en) * 2020-07-30 2020-10-02 湖南中车时代通信信号有限公司 Database and rail transit signal system
CN112306801A (en) * 2020-10-28 2021-02-02 联通(广东)产业互联网有限公司 Monitoring data processing method, system and medium based on heterogeneous data source
CN112306801B (en) * 2020-10-28 2023-01-03 联通(广东)产业互联网有限公司 Monitoring data processing method, system and medium based on heterogeneous data source
CN114253480A (en) * 2021-12-21 2022-03-29 北京云迹科技股份有限公司 Data storage method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN101452450A (en) Multiple source data conversion service method and apparatus thereof
CN102750406B (en) Multi-version management method for model set and difference model-based power grid model
CN114004571B (en) Intelligent three-dimensional storage shelf goods position distribution system and method thereof
CN103593422A (en) Virtual access management method of heterogeneous database
CN202373025U (en) Intelligent device for dispatching business integration and data integration
CN104504485A (en) Integrative power system relay protection setting calculation method
CN102143202A (en) Information integration method and information integration system for industrial production equipment
CN105335822B (en) Big data analysis-oriented unified data model modeling method for smart power grid
CN103078920A (en) Online information verification system based on international electrotechnical commission (IEC) 61968 enterprise service bus (ESB)
CN101685452A (en) Data warehouse scheduling method and scheduling system
CN102609884A (en) System for managing electric power dispatching logs
CN113642299A (en) One-key generation method based on power grid statistical form
CN111709702A (en) Product full life cycle management system
WO2016137121A1 (en) Integrated platform management system for cooperation between manufacturers
CN105279234A (en) Cross-platform data acquisition and conversion method of state overhaul data of electric transmission and transformation equipment
CN103473305A (en) Method and system for performing decision-making process show in statistic analysis
CN102314643A (en) Intelligent ticket proposing method of power network dispatch operation ticket system
CN202331554U (en) Equipment management system
CN110826926A (en) Intelligent manufacturing execution system for surface assembly production line
CN116431611A (en) Automatic data processing module development method based on custom rules
CN102855310B (en) Well-organized electricity utilization data conversion method and device based on extensible customer segmentation model
CN113377952B (en) Automatic generation method for filing number of electronic file for quality test of water conservancy and hydropower engineering
CN101398923A (en) Service flowpath modelling approach and system based on order number
CN101271550A (en) Data distribution method and device in application system
CN112882837A (en) Mobile network resource management system based on cloud computing

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Open date: 20090610