CN106547766A

CN106547766A - A kind of data access method and device

Info

Publication number: CN106547766A
Application number: CN201510601348.0A
Authority: CN
Inventors: 吴德港; 刘宽
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2015-09-18
Filing date: 2015-09-18
Publication date: 2017-03-29

Abstract

The invention relates to wireless communication technology field, more particularly to a kind of data access method and device, to simplify data access process.In the embodiment of the present application, after the access request of service application transmission is received by unified access interface unit, according to the attribute information of the data to be visited included in access request, it is determined that at least one data source of storage data to be visited, according to data to be visited and at least one data source, determine the corresponding mission bit stream of each data source at least one data source, and the mission bit stream of determination is sent to into the corresponding data source of the mission bit stream；The initial data returned after each data source at least one data source performs the corresponding mission bit stream of each data source is received, according to each initial data, data to be output is determined, data to be output is returned to into service application.Thus, the developer of service application is familiar only with the make of access request, the skill set requirements degree of the developer to service application is reduced.

Description

A kind of data access method and device

Technical field

The application is related to database technical field, more particularly to a kind of data access method and device.

Background technology

The big data epoch, generally by mass data storage in data base.Mass data is managed for convenience, Generally by data temporally or other dimensions carry out the storage of point table.In order to optimize the utilization rate of data base, generally Data can be carried out the process such as moving according to the characteristic of data, such as, will seldom be accessed for data resettlement and arrive In the lower data base of carrying cost.

Give an example, according to day, Month And Year by data point table storage, be one point by the data storage of a day Table, by the general packet radio service (General Packet Radio Service, abbreviation GPRS) of N Ticket table is stored in data base's MPP (Massively Parallel Processing, abbreviation MPP) In, N is current year, the GPRS ticket tables by (N-1) Nian Zhi (N-3) between year move to In the lower Hadoop clusters of carrying cost, the GPRS tickets table by (N-3) before year is deleted.

As shown in figure 1, Fig. 1 illustrate in prior art each service application and each data base it Between annexation.Service application 1001 includes multiple business application, such as customer analysis service application 1002nd, market operation monitoring business application 1003, marketing assessment service application 1004, user behavior analysis Service application 1005, flow analysis service application 1006 etc..Data base includes various, and each data base carries For providing different access interface for service application, so that each service application passes through the corresponding access of the data base Interface accessing and manage the data base in data.Such as service application can pass through SQL (Structured Query Language, abbreviation SQL) interface accessing relational database management system (Relational Database Management System, abbreviation RDBMS) 1007, can be connect by SQL Mouth accesses MPP data bases (Database, abbreviation DB) 1008, can pass through application programming interface (Application Programming Interface, abbreviation API) accesses Hadoop clusters 1009.Each industry When business application needs to access the data in multiple data bases, many numbers that each service application is accessed with needs Simultaneously connect according to storehouse, in such as Fig. 1 customer analysis service application 1002 connect simultaneously RDBMS1007 and Hadoop clusters 1009.Data type defined in each data base is also differed, such as in data base Variable length character type is defined with varchar2 in oracle, the text used in GreeenPlum defines variable length Character type.

When service application need to access the different types of data base of two data simultaneously, the service application needs to visit The data of two data bases are asked, therefore on the one hand the service application needs to support the driving of two data bases Program or access interface, on the other hand, the developer of the service application needs to know both data bases' Programming language, i.e., be programmed respectively according to the data type of two data bases.

To sum up, the method for conducting interviews to data in prior art is complex, and each service application is opened Send out personnel requirement higher.

The content of the invention

The embodiment of the present application provides a kind of data access method and device, to simplify data access process.

A kind of first aspect, there is provided data access method, comprises the following steps：

After the access request of service application transmission is received by unified access interface unit, please according to accessing The attribute information of the data to be visited included in asking, it is determined that at least one data source of storage data to be visited；

According to data to be visited and at least one data source, each data source pair at least one data source is determined The mission bit stream answered, and the mission bit stream of determination is sent to into the corresponding data source of mission bit stream；

Receive after each data source at least one data source performs the corresponding mission bit stream of each data source The initial data of return；

According to each initial data, determine data to be output, and data to be output are returned to into service application.

With reference in a first aspect, in the first possible implementation of first aspect, the category of data to be visited Property information includes instance identification of the data to be visited in data source；

According to the attribute information of the data to be visited included in access request, it is determined that storage data to be visited are extremely A few data source, including：

According to the instance identification and the corresponding relation of data source of data, the number to be visited that attribute information is included is determined According to corresponding at least one data source of instance identification.

With reference in a first aspect, in second possible implementation of first aspect, the category of data to be visited Property information includes service identification of the data to be visited in service application；

The corresponding relation of the instance identification according to the service identification and data of data in data source, determines attribute The corresponding instance identification of service identification of the data to be visited that packet contains；

According to the instance identification and the corresponding relation of data source of data, the instance identification pair of data to be visited is determined At least one data source answered.

With reference to any one possible realization in second possible implementation of first aspect to first aspect Mode, in the third possible implementation of first aspect, according to data to be visited and at least one number According to source, the corresponding mission bit stream of each data source at least one data source is determined, including：

Following steps are performed for each data source at least one data source：

If it is determined that the data type of access request is inconsistent with the data type of the data source, then according to access The corresponding relation of the data type of request and the data type of data source, by the data type conversion of access request For the data type of the data source, the corresponding mission bit stream of the data source is obtained；

If it is determined that the data type of access request is consistent with the data type of the data source, then by access request As the corresponding mission bit stream of the data source.

With reference to any one possible realization in second possible implementation of first aspect to first aspect Mode, in the 4th kind of possible implementation of first aspect, according to data to be visited and at least one number According to source, the corresponding mission bit stream of each data source at least one data source is determined, including：

If it is determined that the data source of storage data to be visited is at least two, for each at least one data source Individual data source performs following steps：

The partial data of the data to be visited stored by the data source according to determining, generates the data source pair The operation information answered；Wherein, the part number of the data to be visited stored in including the data source by operation information According to attribute information；

If it is determined that the data type of the corresponding operation information of the data source is consistent with the data type of the data source, Then using the data source corresponding operation information as the corresponding mission bit stream of the data source；

If it is determined that the data type of the corresponding operation information of the data source is differed with the data type of the data source Cause, then the corresponding relation according to the data type of access request and the data type of data source, by the data source The data type conversion of corresponding operation information is the data type of the data source, obtains the data source corresponding Mission bit stream.

With reference to any one possible realization in the 4th kind of possible implementation of first aspect to first aspect Mode, in the 5th kind of possible implementation of first aspect, according to each initial data, it is determined that treating defeated Go out data, including：

If it is determined that data manipulation need not be carried out to initial data, and in the coded format and business of initial data Using coded format it is inconsistent when, the coded format of initial data is converted to into the coding lattice of service application Formula, obtains data to be output；

If it is determined that data manipulation need not be carried out to initial data, and in the coded format and business of initial data Using coded format it is consistent when, using initial data as data to be output；

If it is determined that need to carry out initial data data manipulation, and the coded format in initial data should with business When coded format is inconsistent, the coded format of the data obtained after carrying out data manipulation to initial data The coded format of service application is converted to, data to be output are obtained；

If it is determined that need to carry out initial data data manipulation, and the coded format in initial data should with business When coded format is consistent, the data obtained after carrying out data manipulation to initial data are used as number to be output According to.

With reference to the 5th kind of possible implementation of first aspect, in the 6th kind of possible realization of first aspect In mode, if meeting the one kind in following condition, it is determined that need to carry out data manipulation：

It is determined that the data source at least two, access request of storage data to be visited includes indicating to be visited Information that data are ranked up, access request include that it is to be viewed to indicate the format setting of data to be visited The information of form；

Data manipulation is carried out according to following manner：

If it is determined that the data source at least two of storage data to be visited, then by the original of each data source return Data are collected；

If access request includes the information for indicating to be ranked up data to be visited, each data source is returned The initial data for returning is ranked up；

If access request includes indicating by the information that the format setting of data to be visited is form to be viewed, The format setting of the initial data that each data source is returned is the form to be viewed that access request includes.

With reference to any one possible realization in the 6th kind of possible implementation of first aspect to first aspect Mode, in the 7th kind of possible implementation of first aspect, also includes：

The data in data source are managed according to management configured information, and will be received according to management configured information To the new corresponding data source of data of new data Cun Chudao in.

With reference to the 7th kind of possible implementation of first aspect, in the 8th kind of possible realization of first aspect In mode, management configured information includes indicating the data for meeting first condition are moved to mesh from source data source The information of mark data source；

The data in data source are managed according to management configured information, including：

The data for meeting first condition are determined from source data source；

If it is determined that the data type of the data type and target data source in source data source is inconsistent, first will be met Data type of the data type conversion of the data of condition for target data source；

The data storage for meeting first condition after by data type conversion to target data source, and from source data The data for meeting first condition are deleted in source.

A kind of second aspect, there is provided DAA, including：

Receiving unit, for the access request of service application transmission is received by unified access interface unit； In receiving at least one data source, each data source performs return after the corresponding mission bit stream of each data source Initial data；

Determining unit, in the access request that service application transmission is received by unified access interface unit Afterwards, the attribute information according to the data to be visited included in access request, it is determined that storage data to be visited are extremely A few data source；According to data to be visited and at least one data source, determine each at least one data source The corresponding mission bit stream of individual data source, and the mission bit stream of determination is sent to into the corresponding data of mission bit stream Source；According to each initial data, data to be output are determined；

Transmitting element, for data to be output are returned to service application.

With reference to second aspect, in the first possible implementation of second aspect, the category of data to be visited Property information includes instance identification of the data to be visited in data source；

Determining unit, specifically for：

With reference to second aspect, in second possible implementation of second aspect, the category of data to be visited Property information includes service identification of the data to be visited in service application；

Determining unit, specifically for：

With reference to any one possible realization in second possible implementation of second aspect to second aspect Mode, in the third possible implementation of second aspect, determining unit, at least one data Each data source in source, specifically for：

If it is determined that the data type of access request is consistent with the data type of corresponding data source, then will access Request is used as the corresponding mission bit stream of the data source.

With reference to any one possible realization in second possible implementation of second aspect to second aspect Mode, in the 4th kind of possible implementation of second aspect, however, it is determined that go out the number for storing data to be visited It is at least two according to source, determining unit, for each data source at least one data source, specifically for：

With reference to any one possible realization in the 4th kind of possible implementation of second aspect to second aspect Mode, in the 5th kind of possible implementation of second aspect, determining unit, specifically for：

With reference to the 5th kind of possible implementation of second aspect, in the 6th kind of possible realization of second aspect In mode, if meeting the one kind in following condition, it is determined that need to carry out data manipulation：

Data manipulation is carried out according to following manner：

With reference to any one possible realization in the 6th kind of possible implementation of second aspect to second aspect Mode, in the 7th kind of possible implementation of second aspect, also including administrative unit, is used for：

With reference to the 7th kind of possible implementation of second aspect, in the 8th kind of possible realization of second aspect In mode, management configured information includes indicating the data for meeting first condition are moved to mesh from source data source The information of mark data source；

Administrative unit, specifically for：

The data for meeting first condition are determined from source data source；

A kind of third aspect, there is provided DAA, including：

Processor, for reading the program in memorizer, performs following process：

In the embodiment of the present application, please in the access that service application transmission is received by unified access interface unit After asking, according to the attribute information of the data to be visited included in access request, it is determined that storage data to be visited At least one data source；According to data to be visited and at least one data source, in determining at least one data source The corresponding mission bit stream of each data source, and the mission bit stream of determination is sent to into the corresponding data of mission bit stream Source；Receive after each data source at least one data source performs the corresponding mission bit stream of each data source and return The initial data for returning；According to each initial data, determine data to be output, and data to be output are returned to Service application.Thus, any one service application only can send access request by unified access interface, i.e., Data at least one data source of accessible storage data to be visited, it is seen then that the exploit person of service application Member is familiar only with the make of access request, need not pay close attention to the concrete operations environment of each data source, drops The skill set requirements degree of the low developer to service application, simplifies the side for accessing data in data source Method, improves data access efficiency.

Description of the drawings

For the technical scheme being illustrated more clearly that in the embodiment of the present application, below will be to institute in embodiment description The accompanying drawing that needs are used is briefly introduced, it should be apparent that, drawings in the following description are only the application's Some embodiments, for one of ordinary skill in the art, on the premise of not paying creative work, Can be with according to these other accompanying drawings of accompanying drawings acquisition.

Fig. 1 is the annexation schematic diagram in prior art between each service application and each data base；

Fig. 2 is a kind of data access system configuration diagram that the embodiment of the present application is suitable for；

A kind of data access method schematic flow sheet that Fig. 3 is provided for the embodiment of the present application；

Storage mode and the number of the data that Fig. 3 a are provided for the embodiment of the present application in logic data model According to the storage mode schematic diagram in data source；

A kind of structural representation of DAA that Fig. 4 is provided for the embodiment of the present application；

The structural representation of another kind of DAA that Fig. 5 is provided for the embodiment of the present application.

Specific embodiment

In order that the purpose of the application, technical scheme and beneficial effect become more apparent, below in conjunction with accompanying drawing And embodiment, the application is further elaborated.It should be appreciated that described herein be embodied as Example only to explain the application, is not used to limit the application.

Fig. 2 illustrates a kind of data access system configuration diagram that the embodiment of the present application is suitable for.Such as Shown in Fig. 2, the system architecture includes service application 101, multiple data sources, and DAA 201.May include in DAA 201 that unifying access interface unit 202, SQL drives (SQL Enging the encapsulation of) 203, cache memory (cache storege) 204, and multiple external datas (Foreign Data Wrapper, abbreviation FDW), such as FDW205, FDW206, FDW207.

Unified access interface unit 202 is used to connect all service applications, such as customer analysis service application 102 etc..Alternatively, unified access interface unit 202 is specifically as follows java data bases connection (Java Data Base Connectivity, abbreviation JDBC) interface.That is, the data access in the embodiment of the present application Device 201 has done an encapsulation to each data source, provides a unified JDBC to each service application and connects Mouthful.In addition, unified access interface unit 202 can be with independently of DAA 201, positioned at data Between access mechanism 201 and service application 101.

Alternatively, DAA 201 is included into a driving for providing unified access interface unit 202, The driving of DAA 201 can drive 203 for SQL, for realizing access request is carried out parsing, Optimization, and accordingly generate the corresponding mission bit stream of each data source.Alternatively, definable DAA 201 are suitable for a standard syntax, for example：SQL92 standard syntax, to make the exploitation of each service application Personnel are suitable for unified standard grammer and write access request.

Alternatively, also include cache memory 204 in DAA 201, for caching the bottom of from The data obtained in each data source such as RDBMS107 of layer, so as to improve service application from data The efficiency of data is inquired about in access mechanism 201.

The data source connected by DAA 201 may include polytype, such as RDBMSM107, MPP DB108, Hadoop cluster 109 etc..Alternatively, the data source in the embodiment of the present application may include The data of database form storage, may also comprise the data of non-database form storage, in the embodiment of the present application Data source when being data base, data base can be various ways, can such as be non-relational database and relation Type data base.

The SQL that each data source has special access interface or driver, such as RDBMS107 connects Mouth, the SQL interfaces of MPP DB108, the api interface of Hadoop clusters 109, data base's inscriptions on bones or tortoise shells (oracle) database call interface (Oracle Call Interface, abbreviation OCI) driver, number According to the LIBPQ drivers of storehouse GreenPlum.In order that DAA 201 passes through each data The special access interface in source or driver connect each data source, and DAA includes multiple FDW.The ability of the SQL decompiling frameworks of FDW, data access dress are enhanced in the embodiment of the present application Put 201 to assign outside data as a table to realize necessary calculating, DAA by FDW 201 itself do not preserve these external datas, simply when needing using external data, by FDW come Data required for obtaining.Alternatively, each data source connects a FDW, such as data base RDBMS107 connects FDW205, and MPP DB108 connection FDW206, Hadoop clusters 109 connect FDW207。

Service application 101 includes multiple business application, such as the customer analysis service application 102, market operation Monitoring business application 103, marketing assessment service application 104, user behavior analysis service application 105, flow Analysis service application 106 etc..Service application be by data source data through cleaning, it is integrated, analysis, Excavate, visualization, so as to formed it is understandable that information, so as to help user excavate be hidden in big data In information and knowledge.Service application is generally by operational indicator come the letter by hiding in user's display data Breath.Operational indicator has various, the 4G user activities of such as telecommunications industry, people's flow monitoring, pseudo-base station inspection Survey, common form.

Based on the system architecture shown in Fig. 2, Fig. 3 shows a kind of data access that the embodiment of the present application is provided Method, alternatively, the DAA that said method flow process can be as shown in Figure 2 is realized, the method flow process Comprise the following steps：

Step 301, after the access request of service application transmission is received by unified access interface unit, According to the attribute information of the data to be visited included in access request, it is determined that at least the one of storage data to be visited Individual data source；

Step 302, according to data to be visited and at least one data source, determines each at least one data source The corresponding mission bit stream of individual data source, and the mission bit stream of determination is sent to into the corresponding data of mission bit stream Source；

Step 303, in receiving at least one data source, each data source performs the corresponding task of each data source The initial data returned after information；

Step 304, according to each initial data, determines data to be output, and data to be output is returned to Service application.

In above-mentioned steps 301, the unified access interface unit in the embodiment of the present application is used for as one or more Service application provides a unified interface, and alternatively, it can be JDBC interfaces that this unifies access interface unit. Alternatively, there is provided the driving of the interface can be driven for SQL, arbitrary service application can pass through the unification Interface sends information, such as access request or management configured information etc..Arbitrary service application passes through the unification Interface send access request and/or management configured information data type be the DAA The data type that successfully can be parsed, it is predefined to be DAA institute, so as to each industry Application developer is only it should be understood that the operating environment of the DAA, discernible data type etc. for business Information, you can the DAA is connected by the DAA in the embodiment of the present application Each data source carries out data access or data management.Alternatively, the grammer that DAA is suitable for is fixed Justice is SQL92 standard syntax.

In order to illustrate conveniently, by " the instance identification and data source of data in herein below in the embodiment of the present application Corresponding relation " definition " the first corresponding relation ", will " service identification and data of data be in data source Instance identification corresponding relation " be defined as " the second corresponding relation ", by " the data class of access request The corresponding relation of the data type of type and data source " is defined as the 3rd corresponding relation.In the embodiment of the present application The storage form of the first corresponding relation, the second corresponding relation and the 3rd corresponding relation has various, such as, data Table, text etc., the embodiment of the present application is without limitation.The embodiment of the present application provides one kind and alternatively implements Mode, the first corresponding relation, the second corresponding relation and the 3rd corresponding relation are deposited in the form of logic data model Storage.It is introduced as a example by logic-based data model pair in the embodiment of the present application.

A set of unified data type is pre-defined, table 1 is illustrated defined in the embodiment of the present application Unified data type table, as shown in table 1, defined a set of unified data type includes character type (Char), character type (String), shaping (Int), long shaping (Long), double precision shaping (Double), cloth Your type (Boolean) etc., may also include other data types, such as shaping (Real) and date type (Datetime). From the predefined unified data type afterwards data type used by selection logic data model, That is, the data access request or the data type of management configured information sent by service application is the logical number According to the data type that model is configured.

Table 1

Data type	Size
		Byte (Byte)	8
Short (Shot)	16
		Shaping (Int)	32
Long shaping (Long)	64
		Floating type (Float)	32
Double precision shaping (Double)	64
		Boolean type (Boolean)	1
Character type (Char)	16
		Character type (String)	Variable length
Boolean type (Boolean)	Need appointed day form
		Big object (BLOB/CLOB/NLOB)	Suitable for partial data source

Each data source has special access interface or driver, and each data source also has the data source Proprietary data type.Data type and number of the 3rd corresponding relation in the embodiment of the present application for access request According to the corresponding relation of the data type in source, and as the data type of access request is logic data model Data type, therefore, the data type and logic data model of the 3rd corresponding relation namely each data source Data type corresponding relation.Give an example, such as, in the data type of logic data model String (1000) corresponding to the varchar2 (1000) in the data type of data source oracle, in logic String (1000) in the data type of data model is corresponding to being exactly text in data source GreenPlum (1000)。

Secondly, also include the attribute information of data in each data source in logic data model.Attribute information can Including much information, such as instance identification of the data in data source, instance identification is data storage and is counting According to the mark used in source, usually English mark, row name id_no of the table in such as data base and Mobile_phone, or hdfs filename dw_user_info and gprs_cdr_yyyymmdd.Alternatively, Attribute information may also include service identification of the data in service application, and service identification is service-oriented application , the mark with business semantics, service identification are more square typically to the developer for making service application Just quickly understand defined in the meaning of the data.Service identification is usually Chinese mark, than in user table User identity card number and subscriber phone number.The industry of the data of data is may also include in logic data model Second corresponding relation of business mark and instance identification of the data in data source, thus, opening when service application The personnel of sending out when access request is write, the service identification that simple service-oriented can be used semantic, and not The instance identification of complexity of the data in data source must be related to, DAA can be closed according to the second correspondence System, determines instance identification of the service identification in data source, reduce further service application developer Work difficulty.

Also include data type of the data in logic data model in attribute information, such as, define the number According to for variable length character types or lint-long integer type, wherein, the data type in logic data model choose in Predefined unified data type.Other some description letters to data are may also include in attribute information Breath, the length of the such as data.

Alternatively, can be different according to the storage mode of data, the attribute of the data in logic data model is believed Preserved if breath is divided into the tables of data of dry type The generally data volume of ticket information table, can be by natural gift table, i.e., with one day point of table or one day one than larger The mode of individual file stores ticket information table.

The developer of each service application can send management configured information by unified access interface, and data are visited Ask that device can be managed to the data in data source according to management configured information, and according to management configured information By in new data Cun Chudao for the receiving new corresponding data source of data.Also include pipe in logic data model First corresponding relation of reason configured information, i.e. instance identification and data source.

Specifically, managing configured information may include the attribute of each data source institute data storage.The application reality The example below a1,3 several embodiments of example a 2 and example a are provided in applying example：

Example a 1, it is intended that data source Hadoop cluster, and to the data source Hadoop cluster-based storage data When, HDFS files need to be stored as, then need to be configured for storage formats such as txt/xml/json, than Such as file separator, xml paths, document No., compression type etc.；

Example a 2, it is intended that data source Hadoop cluster, and to the data source Hadoop cluster-based storage data When, Hbase tables need to be stored as, then need setting row race information；

Example a 3, it is intended that data source MPP greenplum clusters, then allow setting index information.

The storage rule of each data is may also include in management configured information, specifically, it is intended that data are deposited The data source of storage, and the storage period of the data, arrive when the storage period of data, DAA Data can be moved in target data source from source data source immediately or when periodicity performs task, Or burnin operation is performed to the data, that is, delete the data.There is provided in the embodiment of the present application following example b1, Example b2 and example b3 several embodiments：

Example b1, managing configured information includes indicating the data storage that newly will be received into source data source.This When, the data type of the data that DAA is really newly received whether with source data source in data type one Cause, if unanimously, according to management configured information by the data storage for newly receiving to source data source；If differing Cause, then by the data type conversion of the data for newly receiving be the corresponding data type in source data source, and according to pipe Reason configured information is by the data storage for newly receiving to source data source.During source data source is the embodiment of the present application Any one data source in data source.

Example b2, managing configured information includes indicating the data for meeting first condition are moved from source data source To the information of target data source.The data for meeting first condition can be apart from the current date number of 11 to 30 days According to.Now, DAA determines the data for meeting first condition from source data source, however, it is determined that source The data type of the data type and target data source of data source is inconsistent, will meet the data of first condition Data type of the data type conversion for target data source, by data type conversion after meet first condition Data storage is to target data source, and the data for meeting first condition are deleted from source data source.If it is determined that source The data type of data source is consistent with the data type of target data source, then deposit the data for meeting first condition Store up to target data source, and the data for meeting first condition are deleted from source data source.Source data source and target Data source is any two data sources in the data source in the embodiment of the present application.

Example b3, management configured information include indicating to meet the data deletion of second condition.Meet second The data of condition are apart from current date 30 days and the data of the above.Now, DAA is according to the pipe Reason configured information will meet the data deletion of second condition from data source.

Give an example, the storage rule of user's GPRS ticket tables (day table) is：It is nearest apart from current date 10 days in data storage in data source MPP, apart from the current date data storage of 11 to 30 days In data source HDFS, delete apart from current date 30 days and the data of the above.DAA root Following operation can be performed according to the storage rule：The daily new data for obtaining is stored into data source MPP, Daily the data before the 11st day are clipped in HDFS data sources, and by 30 days in HDFS data sources with On data deletion.

Management configured information may also include quality of data rule, such as arrange the user mobile phone in GPRS tickets The necessary non-NULL of number, thus, can be checked to the quality of data by periodic task scheduling, is found out The data that subscriber phone number in GPRS tickets must be empty for, are deleted or are reported.

Management configured information may also include data safety privacy, such as by GPRS call bill data models Subscriber phone number uses Advanced Encryption Standard (Advanced Encryption Standard, write a Chinese character in simplified form AES) Encryption, thus, then in data load process, data can be performed with encryption behaviour according to corresponding key information Make.

DAA can create corresponding text automatically in specified data source based on management configured information Part catalogue or database table.

Fig. 3 a illustrate storage side of the data of the embodiment of the present application offer in logic data model The storage mode schematic diagram of formula and the data in data source.As shown in Figure 3 a, in DAA The attribute information in logic data model in 201 as shown in table 2, illustrates logical number in table 2 According to the attribute information example in model.As shown in table 2, in logic data model the first row data business mark Know for " ID ", instance identification is " USER_ID ", and the data type of the data is " variable length word Symbol ", the length of the data type is 40.In logic data model, the service identification of the second row data is " GPRS Duration ", instance identification is " GPRS_TIME ", and the data type of the data is " lint-long integer ", the data The length of type is 20.

Table 2

Service identification	Instance identification	Data type	Length	…
					ID	USER_ID	Variable length character	40	…
GPRS durations	GPRS_TIME	Lint-long integer	20	…
					…	…	…	…	…

Wherein, the form of the GRPS_TIME in logic data model is The method for expressing of GPRS_CDR_YYYYMMDD, YYYYMMDD for time date.Logical number According to the management configured information in model it is：Counting away from the data storage in nearest 10 days of current date According in the MPP of source；Apart from the current date data storage of 11 to 30 days in data source HDFS；Delete Apart from current date 30 days and the data of the above.

Based on the logic data model shown in Fig. 3 a, table 3 illustrates data in data source MPP3101 In concrete storage form.Data are stored in data source MPP3103 in the form of table (tables), its The string of middle GRPS_TIME is as shown in table 3.

Table 3

GPRS_CDR_20150430
	GPRS_CDR_20150429
GPRS_CDR_20150428

GPRS_CDR_20150427
	GPRS_CDR_20150426
…
	GPRS_CDR_20150421

The database schema definitional language performed by such as when the data of table 3 is generated in data source MPP3101 (Data Definition Language, abbreviation DDL) is specially：

Create table Create table GPRS_CDR_20150430 (USER_ID text)；

GRPS_TIME int；

…

Based on the logic data model shown in Fig. 3 a, table 4 illustrates data in data source Concrete storage form in HDFS3102.Data are in data source HDFS3102 with file (files) Form is stored, and the wherein storage form of GRPS_TIME is as shown in table 4.

Table 4

In data source HDFS3102, the file structure of data storage is specially, number Every string according to table is separated using vertical line " | ", can such as be " ID | GPRS durations | ... ".

In above-mentioned steps 301, any one or more service applications are received by unified access interface unit and is sent out The access request sent.A kind of optional embodiment is that DAA supports SQL statement, is accessed Request is the SQL statement that DAA successfully can be parsed, the data type and data of access request The data type of the logic data model of access mechanism is consistent.

After receiving access request, the parsing of syntax and semantics is carried out to the access request of the SQL statement. The attribute information of data to be visited is may include in access request, attribute information may include the example of data to be visited Mark, also may not include the instance identification of data to be visited, but including the service identification of data to be visited. That is, the operation object of data to be visited is actually concrete in logic data model, rather than each data source Physical database table or HDFS files.Syntactic analysiss are carried out to access request, to check that the access please Seeking Truth is no syntax error, it is ensured that the correctness of access request statements structure.Semantic point is carried out to access request Analysis, so that the examination of contextual relevance is carried out to the correct access request of sentence structure, and ties to sentence The correct access request of structure carries out type examination.If it find that there is mistake in the grammer or semanteme of access request, Then directly terminate performing current process.Alternatively, corresponding error code is returned to service application.

In the embodiment of the present application, in service application after DAA sets up connection, by unification Before access interface unit receives the access request of service application transmission, also receive service application and send user Mark.It is preset with DAA with the user totem information for sending access request claim, can be with The form storage of table.Afterwards according to it is default with send access request claim user totem information, to Family mark is authenticated；If it is determined that ID has the authority for sending access request, then according to access request In the attribute information of data to be visited that includes, it is determined that at least one data source of storage data to be visited.If Determine that ID does not have the authority for sending access request, then directly terminate performing current process.Alternatively, Corresponding error code is returned to service application.

In above-mentioned steps 301, it is determined that the mode of at least one data source of storage data to be visited has various, The embodiment of the present application provides the embodiment of in the following manner c1 and mode c2：

Mode c1, the attribute information of data to be visited include instance identification of the data to be visited in data source then According to the instance identification and the first corresponding relation of data source of data, the number to be visited that attribute information is included is determined According to corresponding at least one data source of instance identification.

Mode c2, the attribute information of data to be visited include business mark of the data to be visited in service application Know, then the second corresponding relation of the instance identification according to the service identification and data of data in data source, really Determine the corresponding instance identification of service identification of the data to be visited that attribute information is included；According to the example mark of data Know the first corresponding relation with data source, determine corresponding at least one data of instance identification of data to be visited Source.

In above-mentioned steps 302, according to data to be visited and each data source, determine that each data source is corresponding Mission bit stream specifically includes various ways, and following manner d1, mode d2, side are provided in the embodiment of the present application Formula d3, mode d4 and mode d5 several embodiments：

Mode d1, however, it is determined that the data source for going out to store data to be visited is one, and the data class of access request Type is inconsistent with the data type of corresponding data source, then the data type and data source according to access request 3rd corresponding relation of data type, by the data that the data type conversion of access request is corresponding data source Type, obtains the corresponding mission bit stream of data source.

Mode d2, however, it is determined that the data source for going out to store data to be visited is one, and the data class of access request Type is consistent with the data type of corresponding data source, then using access request as the corresponding task letter of data source Breath.

Mode d3, however, it is determined that the data source for going out to store data to be visited is at least two, then at least one In data source, each data source performs following steps：

If it is determined that the data type of access request is inconsistent with the data type of the data source, then according to access The corresponding relation of the data type of request and the data type of data source, by the data type conversion of access request For the data type of the data source, the corresponding mission bit stream of the data source is obtained；If it is determined that access request Data type is consistent with the data type of the data source, then using access request as the corresponding task of the data source Information.

Give an example for aforesaid way d3, in access request, data to be visited are apart from current date 20 days Within GPRS durations, judged according to the data to be visited, the GPRS within current date 10 days Duration in data source MPP, apart from the current date GPRS durations of 10 days to 20 days in data source HDFS In, now, however, it is determined that the data type for going out access request is identical with the data type of data source MPP, visit Ask that the data type of request is different from data source HDFS, then by access request directly as data source MPP Mission bit stream, by the data type conversion of the access request for data source HDFS data type, obtain The executable mission bit stream of data source HDFS.

Mode d4, however, it is determined that the data source for going out to store data to be visited is at least two, at least one number Following steps are performed according to each data source in source：

If it is determined that the data type of the corresponding operation information of the data source is consistent with the data type of the data source, Then using the data source corresponding operation information as the corresponding mission bit stream of the data source.

Mode d5, however, it is determined that the data source for going out to store data to be visited is at least two, at least one number Following steps are performed according to each data source in source：

If it is determined that the data type of the corresponding operation information of the data source is differed with the data type of the data source Cause, then the data type and the 3rd corresponding relation of the data type of data source according to access request, this is counted According to the data type that the data type conversion of the corresponding operation information in source is the data source, the data source pair is obtained The mission bit stream answered.

Give an example for aforesaid way d5, in access request, data to be visited are apart from current date 20 days Within GPRS durations, judged according to the data to be visited, the GPRS within current date 10 days Duration in data source MPP, apart from the current date GPRS durations of 10 days to 20 days in data source HDFS In, now, generate the corresponding operation information of data source MPP and " read within current date 10 days GPRS durations ", and the corresponding operation information of data source HDFS " read apart from current date 10 days extremely 20 GPRS durations ", the partial data of the data to be visited stored in including the data source by operation information Attribute information.Afterwards, if judging the data type and data source MPP and data source of access request HDFS is different, then by the data type conversion of data source MPP corresponding operation information be the data source Data type, obtain the executable mission bit stream of data source MPP, by data source HDFS correspondence Operation information data type conversion be the data source data type, obtaining data source HDFS can hold Capable mission bit stream.

Each data source corresponding mission bit stream is sent to into each data source, each data source performs each afterwards Self-corresponding mission bit stream, and initial data is returned to DAA performing after mission bit stream terminates. The initial data can be the data of the original storage in data source, and may also be data source has carried out some calculating Data afterwards.

In being embodied as, during across data source access big data, the sentence that can sink sinks to data source as far as possible Calculate, DAA only carries out some as far as possible and the data manipulation, now, data source such as such as collects, sorts The initial data of return is exactly that data source has carried out the data after some calculating according to the data for being stored.Across When data source small data quantity is accessed, the data in each data source all can be drawn into DAA In telling buffer storage, whole calculating and data manipulation are completed by DAA.Now, data The initial data that source returns is exactly the data stored by data source.

After DAA receives the initial data that all data sources are returned, in addition it is also necessary to determine whether to need The initial data is carried out data manipulation or coded format conversion, specifically, can by the following manner e1, Several implementations of mode e2, mode e3 and mode e4：

Mode e1, however, it is determined that data manipulation need not be carried out to initial data, and in the coding lattice of initial data When formula is inconsistent with the coded format of service application, the coded format of initial data is converted to into service application Coded format, obtains data to be output；

Mode e2, however, it is determined that data manipulation need not be carried out to initial data, and in the coding lattice of initial data When formula is consistent with the coded format of service application, using initial data as data to be output；

Mode e3, however, it is determined that need to carry out initial data data manipulation, and in the coded format of initial data When inconsistent with the coded format of service application, the data obtained after data manipulation being carried out to initial data Coded format is converted to the coded format of service application, obtains data to be output；

Mode e4, however, it is determined that need to carry out initial data data manipulation, and in the coded format of initial data When consistent with the coded format of service application, the data obtained after data manipulation being carried out to initial data as Data to be output.

In aforesaid way e1, mode e2, mode e3 and mode e4, if meeting the one kind in following condition, Then determining needs to carry out data manipulation：

It is determined that the data source at least two, access request of storage data to be visited includes indicating to be visited Information that data are ranked up, access request include that it is to be viewed to indicate the format setting of data to be visited The information of form.

In aforesaid way e1, mode e2, mode e3 and mode e4, data manipulation is carried out according to following manner：

If it is determined that the data source at least two of storage data to be visited, then by the original of each data source return Data are collected；If access request includes the information for indicating to be ranked up data to be visited, will be every The initial data that individual data source is returned is ranked up；If access request includes indicating the lattice of data to be visited Formula typesetting is the information of form to be viewed, then the format setting of the initial data for returning each data source is visit Ask the form to be viewed that request includes.

The embodiment of the present application provides a kind of easy data access method, there is provided a kind of service-oriented semanteme Unified access interface unit, each business unit can by the uniform interface unit access any one or it is many Individual data source, and when accessing different types of data source, the developer of service application waits to visit without the need for relation Data storage is asked in which data source, which kind of access interface and data class supported without care data source Type, developer's development process indifference of service application.The indiscriminate exploitation experience reduces big data The difficulty for using of platform, improves the development efficiency of service application.

Second aspect, provides the data managing method of logic-based data model in the embodiment of the present application, can Value, temperature according to data rationally arranges management configured information, effectively improves system resource service efficiency.

The third aspect, effectively shields basic unit's basic software based on DAA in the embodiment of the present application Ins and outs；That is, service application need to only access logic data model in DAA i.e. May have access to and peration data source, such as physical database table or Hadoop group documents.

Fourth aspect, the data source in the embodiment of the present application except can in addition to traditional relevant database, Can also be the cluster distributed files of Hadoop.

In terms of 5th, the DAA in the embodiment of the present application, can spirit by FDW external datas source The various data sources of access living.

Take a particular example below, for illustrating said process.

A newly-built logic data model in DAA, specially：Service identification is user GPRS Ticket table, instance identification are gprs_cdr_yyyymmdd, and the memory module of logic data model is according to number Day database table of natural gift table, i.e., one or one day file are pressed according to temporal information.

The data type of logic data model is set, it is specific as follows：

User identity card number (id_no), character type

Subscriber phone number (mobile_phone), character type

Ticket time started (start_time), timestamp

Ticket end time (end_time), timestamp

Ticket duration (cdr_len), integer, unit：Second

Management configured information is set, it is specific as follows：

The data storage of nearest 10 days is in predefined data source MPP；Data away from modern 11-30 days It is stored in predefined data source HDFS, is stored as txt forms, and separates each row letter using vertical line Breath；Away from modern 30 days data deletions in addition.

DAA is managed to the data in data source according to management configured information, specific as follows：

User's GPRS tickets table of nearest 10 days is loaded according to the date and time information of user's GPRS ticket tables To in data source MPP；

Dispatched by timed task, DAA daily by automatically the data before modern 11st day from Move in data source MPP into data source HDFS data source；And the user GPRS more than 30 days is talked about Single table is deleted from data source HDFS.

The access request that DAA is received is：Inquiry subscriber phone number is 13100000000 The GPRS of nearest 20 days consumes total duration, then the concrete SQL statement of data access request can be：

select sum(cdr_len)from gprs_cdr_yyyymmdd where begin_time>now()-20 And mobile_phone=' 13100000000 '；

DAA determines that data are located in data source MPP and data source HDFS respectively, data Access mechanism obtains subscriber phone number respectively from data source MPP according to said method flow process User's GPRS ticket tables of nearest 10 days of 13100000000, obtain user's handss from data source HDFS Machine number is user's GPRS ticket tables of nearest 10 to 20 days of 13100000000；

DAA enters to the data for obtaining from data source MPP and from data source HDFS respectively Row collects, and obtains the GPRS consumption total durations of nearest 20 days that subscriber phone number is 13100000000.

In the example, if access request is for " inquiry subscriber phone number is nearest the 20 of 13100000000 It user's GPRS ticket tables ", and be ranked up according to temporal information, then DAA needs right The data for obtaining from data source MPP and from data source HDFS respectively are ranked up according to temporal information, When determining that the coded format of service application is different from the coded format of DAA afterwards, after sequence Subscriber phone number is that user's GPRS tickets table of nearest 20 days of 13100000000 carries out code conversion, And be the user GPRS words of nearest 20 days of 13100000000 by the subscriber phone number after code conversion Single table is exported to service application.

In the example, as the data in MPP are the form of tables of data, the data in HDFS are txt lattice Formula, therefore, a kind of alternatively embodiment is that the data that will be obtained from data source HDFS enter row format row Version, makes from the neutralization of data source MPP the data form unification obtained from data source HDFS, afterwards by lattice The unified data output of formula is to service application.

It can be seen from the above：In the embodiment of the present application, received by unified access interface unit After the access request that service application sends, according to the attribute information of the data to be visited included in access request, It is determined that at least one data source of storage data to be visited；According to data to be visited and each data source, it is determined that The corresponding mission bit stream of each data source, and the mission bit stream of determination is sent to into corresponding data source；Receive The initial data that each data source is returned after performing the corresponding mission bit stream of data source；According to each original number According to determining data to be output, and data to be output returned to service application.Thus, any one business should Access request is sent with can only pass through unified access interface, you can access at least the one of storage data to be visited Data in individual data source, it is seen then that the developer of service application is familiar only with the make of access request i.e. Can, the concrete operations environment of each data source need not be paid close attention to, the skill of the developer to service application is reduced Degree can be required, the method for accessing data in data source is simplified, is improve data access efficiency.

Fig. 4 illustrates a kind of structural representation of DAA of the embodiment of the present application offer.

Based on same idea, the embodiment of the present application provides a kind of DAA, as shown in figure 4, including Receiving unit 401, determining unit 402, transmitting element 403, administrative unit 404：

Alternatively, the attribute information of data to be visited includes instance identification of the data to be visited in data source；

Determining unit, specifically for：

Alternatively, the attribute information of data to be visited includes business mark of the data to be visited in service application Know；

Determining unit, specifically for：

Optionally it is determined that unit, for each data source at least one data source, specifically for：

Alternatively, however, it is determined that go out to store data to be visited data source be at least two, determining unit, for Each data source at least one data source, specifically for：

If it is determined that the data source of storage data to be visited is at least two, perform for each data source following Step：

Optionally it is determined that unit, specifically for：

Alternatively, if meeting the one kind in following condition, it is determined that need to carry out data manipulation：

Data manipulation is carried out according to following manner：

Alternatively, also including administrative unit, it is used for：

Alternatively, managing configured information includes indicating the data for meeting first condition are moved from source data source To the information of target data source；

Administrative unit, specifically for：

The data for meeting first condition are determined from source data source；

It can be seen from the above：In the embodiment of the present application, received by unified access interface unit After the access request that service application sends, according to the attribute information of the data to be visited included in access request, It is determined that at least one data source of storage data to be visited；According to data to be visited and at least one data source, Determine the corresponding mission bit stream of each data source at least one data source, and the mission bit stream for determining is sent Give mission bit stream corresponding data source；In receiving at least one data source, each data source performs each data source The initial data returned after corresponding mission bit stream；According to each initial data, data to be output are determined, And data to be output are returned to into service application.Thus, any one service application can only by unified access Interface sends access request, you can access the data at least one data source of storage data to be visited, can See, the developer of service application is familiar only with the make of access request, need not pay close attention to each data The concrete operations environment in source, reduces the skill set requirements degree of the developer to service application, simplifies visit The method for asking data in data source, improves data access efficiency.

Fig. 5 illustrates the structural representation of another kind of DAA of the embodiment of the present application offer Figure.

Based on same idea, the embodiment of the present application provides a kind of DAA, as shown in figure 5, including Processor 500, transmitter 510, receiver 530, memorizer 520：

Processor, for reading the program in memorizer, performs following process：

Each data source at least one data source is received by receiver and performs corresponding of each data source The initial data returned after business information；

According to each initial data, determine data to be output, and data to be output are returned to by transmitter Service application.

Wherein, in Figure 5, bus architecture can include any number of interconnection bus and bridge, specifically by The various circuits of the memorizer that the one or more processors and memorizer that processor is represented are represented are linked at one Rise.Bus architecture can also by such as ancillary equipment, manostat and management circuit or the like it is various its He links together circuit, these be all it is known in the art, therefore, no longer enter traveling one herein to which Step description.EBI provides interface.Transmitter and receiver can be multiple elements, i.e., including transmitter With transmitter and receiver, there is provided for the unit for communicating with various other devices over a transmission medium.Process Device is responsible for bus architecture and common process, and memorizer can store processor and be made when operation is performed Data.

Processor, specifically for：

Alternatively, processor, for each data source at least one data source, specifically for：

Alternatively, however, it is determined that the data source for going out to store data to be visited is at least two, processor, for extremely Each data source in a few data source, specifically for：

Alternatively, processor, specifically for：

Data manipulation is carried out according to following manner：

Alternatively, processor, is additionally operable to：

Processor, specifically for：The data for meeting first condition are determined from source data source；

Alternatively, receiver, is additionally operable to：Service application transmission is being received by unified access interface unit Access request before, receive service application send ID；

It can be seen from the above：In the visit that service application transmission is received by unified access interface unit After asking request, according to the attribute information of the data to be visited included in access request, it is determined that storage number to be visited According at least one data source；According to data to be visited and at least one data source, at least one data are determined The corresponding mission bit stream of each data source in source, and it is corresponding that the mission bit stream of determination is sent to mission bit stream Data source；Receive each data source at least one data source perform the corresponding mission bit stream of each data source it The initial data for returning afterwards；According to each initial data, determine data to be output, and data to be output are returned Back to service application.Thus, any one service application only can send access request by unified access interface, Data i.e. at least one data source of accessible storage data to be visited, it is seen then that the exploitation of service application Personnel are familiar only with the make of access request, need not pay close attention to the concrete operations environment of each data source, The skill set requirements degree of the developer to service application is reduced, the side for accessing data in data source is simplified Method, improves data access efficiency.

Those skilled in the art are it should be appreciated that embodiments herein can be provided as method or computer journey Sequence product.Therefore, the application can adopt complete hardware embodiment, complete software embodiment or combine software With the form of the embodiment of hardware aspect.And, the application can wherein include meter using at one or more Calculation machine usable program code computer-usable storage medium (including but not limited to disk memory, CD-ROM, optical memory etc.) on the form of computer program implemented.

The application be with reference to according to the method for the embodiment of the present application, equipment (system), and computer program produce The flow chart and/or block diagram of product is describing.It should be understood that can by computer program instructions flowchart and / or block diagram in each flow process and/or square frame and flow chart and/or the flow process in block diagram and/ Or the combination of square frame.These computer program instructions can be provided to general purpose computer, special-purpose computer, embedded The processor of formula datatron or other programmable data processing devices is producing a machine so that by calculating The instruction of the computing device of machine or other programmable data processing devices is produced for realizing in flow chart one The device of the function of specifying in individual flow process or one square frame of multiple flow processs and/or block diagram or multiple square frames.

These computer program instructions may be alternatively stored in and computer or other programmable datas process can be guided to set In the standby computer-readable memory for working in a specific way so that be stored in the computer-readable memory Instruction produce and include the manufacture of command device, command device realization is in one flow process or multiple of flow chart The function of specifying in one square frame of flow process and/or block diagram or multiple square frames.

These computer program instructions can be also loaded in computer or other programmable data processing devices, made Obtain and series of operation steps is performed on computer or other programmable devices to produce computer implemented place Reason, so as to the instruction performed on computer or other programmable devices is provided for realizing in flow chart one The step of function of specifying in flow process or one square frame of multiple flow processs and/or block diagram or multiple square frames.

Although having been described for the preferred embodiment of the application, those skilled in the art once know base This creative concept, then can make other change and modification to these embodiments.So, appended right will Ask and be intended to be construed to include preferred embodiment and fall into the had altered of the application scope and change.

Obviously, those skilled in the art can carry out various changes and modification without deviating from this Shen to the application Spirit and scope please.So, if the application these modification and modification belong to the application claim and Within the scope of its equivalent technologies, then the application is also intended to comprising these changes and modification.

Claims

1. a kind of data access method, it is characterised in that comprise the following steps：

After the access request of service application transmission is received by unified access interface unit, according to the visit The attribute information of the data to be visited included in asking request, it is determined that at least one of the storage data to be visited Data source；

According to the data to be visited and at least one data source, in determining at least one data source The corresponding mission bit stream of each data source, and the mission bit stream for determining is sent to into the mission bit stream pair The data source answered；

In receiving at least one data source, each data source performs the corresponding task of each data source The initial data returned after information；

According to each initial data, determine data to be output, and the data to be output are returned to into institute State service application.

2. the method for claim 1, it is characterised in that the attribute of the data to be visited Information includes instance identification of the data to be visited in the data source；

The attribute information according to the data to be visited included in the access request, it is determined that treating described in storage At least one data source of data is accessed, including：

According to the corresponding relation of the instance identification of data and data source, waiting of determining that the attribute information includes is visited Ask corresponding at least one data source of the instance identification of data.

3. the method for claim 1, it is characterised in that the attribute of the data to be visited Information includes service identification of the data to be visited in the service application；

The corresponding relation of the instance identification according to the service identification and data of data in data source, it is determined that described The corresponding instance identification of the service identification of the data described to be visited that attribute information is included；

According to the instance identification and the corresponding relation of data source of data, the reality of the data to be visited is determined Corresponding at least one data source of example mark.

4. the method as described in claims 1 to 3 any claim, it is characterised in that the basis The data to be visited and at least one data source, determine each data at least one data source The corresponding mission bit stream in source, including：

Following steps are performed for each data source at least one data source：

If it is determined that the data type of the access request is inconsistent with the data type of the data source, then basis The corresponding relation of the data type of access request and the data type of data source, by the data of the access request Type is converted to the data type of the data source, obtains the corresponding mission bit stream of the data source；

If it is determined that the data type of the access request is consistent with the data type of the data source, then will be described Access request is used as the corresponding mission bit stream of the described data source.

5. the method as described in claims 1 to 3 any claim, it is characterised in that the basis The data to be visited and at least one data source, determine each data at least one data source The corresponding mission bit stream in source, including：

If it is determined that the data source of the storage data to be visited is at least two, for described at least one number Following steps are performed according to each data source in source：

The partial data of the data described to be visited stored by the data source according to determining, generates the data The corresponding operation information in source；Wherein, what the operation information was stored in including the data source is described to be visited The attribute information of the partial data of data；

If it is determined that the data type of the data type of the corresponding operation information of the data source and the data source Unanimously, then using the data source corresponding operation information as the corresponding mission bit stream of the data source；

If it is determined that the data type of the data type of the corresponding operation information of the data source and the data source Inconsistent, then the data type and the corresponding relation of the data type of data source according to access request, this is counted According to the data type that the data type conversion of the corresponding operation information in source is the data source, the data are obtained The corresponding mission bit stream in source.

6. the method as described in claim 1 to 5 any claim, it is characterised in that the basis Each described initial data, determines data to be output, including：

If it is determined that data manipulation need not be carried out to the initial data, and in the coding lattice of the initial data When formula is inconsistent with the coded format of the service application, the coded format of the initial data is converted to into institute The coded format of service application is stated, the data to be output are obtained；

If it is determined that data manipulation need not be carried out to the initial data, and in the coding lattice of the initial data When formula is consistent with the coded format of the service application, using the initial data as the data to be output；

If it is determined that need to carry out the initial data data manipulation, and in the coded format of the initial data When inconsistent with the coded format of the service application, will obtain after carrying out data manipulation to the initial data The coded format of data be converted to the coded format of the service application, obtain the data to be output；

If it is determined that need to carry out the initial data data manipulation, and in the coded format of the initial data When consistent with the coded format of the service application, obtain after data manipulation being carried out to the initial data Data are used as the data to be output.

7. method as claimed in claim 6, it is characterised in that if meeting the one kind in following condition, Then determining needs to carry out data manipulation：

It is determined that the data source at least two of the storage data to be visited, the access request include indicating The information that is ranked up to the data to be visited, the access request include indicating the number to be visited According to format setting be form to be viewed information；

Data manipulation is carried out according to following manner：

If it is determined that the data source at least two of the storage data to be visited, then return each described data source The initial data for returning is collected；

If the access request includes the information for indicating to be ranked up the data to be visited, by each The initial data that the data source is returned is ranked up；

If the access request includes indicating that by the format setting of the data to be visited be form to be viewed Information, then the format setting of the initial data for returning each described data source is the access request The form described to be viewed for including.

8. the method as described in claim 1 to 7 any claim, it is characterised in that also include：

The data in data source are managed according to management configured information, and according to the management configured information By in the corresponding data source of data new described in new data Cun Chudao for receiving.

9. method as claimed in claim 8, it is characterised in that the management configured information includes referring to Show and move the data for meeting first condition to the information of target data source from source data source；

It is described the data in data source to be managed according to management configured information, including：

The data for meeting the first condition are determined from the source data source；

If it is determined that the data type of the data type and the target data source in the source data source is inconsistent, will The data type conversion for meeting the data of the first condition is the data type of the target data source；

The data storage for meeting the first condition after by data type conversion to the target data source, and The data for meeting the first condition are deleted from source data source.

10. a kind of DAA, it is characterised in that include：

Receiving unit, for the access request of service application transmission is received by unified access interface unit； Receive after each data source at least one data source performs the corresponding mission bit stream of each data source The initial data of return；

Determining unit, in the access request that service application transmission is received by unified access interface unit Afterwards, the attribute information according to the data to be visited included in the access request, it is determined that storage is described to be visited At least one data source of data；According to the data to be visited and at least one data source, really The corresponding mission bit stream of each data source in fixed at least one data source, and the task for determining is believed Breath is sent to the corresponding data source of the mission bit stream；According to each initial data, number to be output is determined According to；

Transmitting element, for the data to be output are returned to the service application.

11. devices as claimed in claim 10, it is characterised in that the category of the data to be visited Property information includes instance identification of the data to be visited in the data source；

The determining unit, specifically for：

12. devices as claimed in claim 10, it is characterised in that the category of the data to be visited Property information includes service identification of the data to be visited in the service application；

The determining unit, specifically for：

13. devices as described in claim 10 to 12 any claim, it is characterised in that described true Order unit, for each data source at least one data source, specifically for：

If it is determined that the data type of the access request is consistent with the data type of the corresponding data source, Then using the access request as the corresponding mission bit stream of the data source.

14. devices as described in claim 10 to 12 any claim, it is characterised in that if it is determined that The data source for going out to store the data to be visited is at least two, the determining unit, for described at least Each data source in individual data source, specifically for：

15. devices as described in claim 10 to 14 any claim, it is characterised in that described true Order unit, specifically for：

16. devices as claimed in claim 15, it is characterised in that if meeting the one kind in following condition, Then determining needs to carry out data manipulation：

Data manipulation is carried out according to following manner：

17. devices as described in claim 10 to 16 any claim, it is characterised in that also include Administrative unit, is used for：

18. devices as claimed in claim 17, it is characterised in that the management configured information includes Instruction moves the data for meeting first condition to the information of target data source from source data source；

The administrative unit, specifically for：

19. a kind of DAAs, it is characterised in that include：

Processor, for reading the program in memorizer, performs following process：