CN109145049A - A kind of data assembled view real time updating method based on Incremental Log - Google Patents
A kind of data assembled view real time updating method based on Incremental Log Download PDFInfo
- Publication number
- CN109145049A CN109145049A CN201811087121.9A CN201811087121A CN109145049A CN 109145049 A CN109145049 A CN 109145049A CN 201811087121 A CN201811087121 A CN 201811087121A CN 109145049 A CN109145049 A CN 109145049A
- Authority
- CN
- China
- Prior art keywords
- data
- cds
- log
- service
- assembled view
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000012544 monitoring process Methods 0.000 claims description 6
- 230000007246 mechanism Effects 0.000 claims description 5
- 238000012986 modification Methods 0.000 claims description 5
- 230000004048 modification Effects 0.000 claims description 5
- 230000008859 change Effects 0.000 claims description 4
- 238000013475 authorization Methods 0.000 claims description 3
- 238000012217 deletion Methods 0.000 claims description 3
- 230000037430 deletion Effects 0.000 claims description 3
- 239000000284 extract Substances 0.000 claims description 3
- 150000001875 compounds Chemical class 0.000 claims 1
- 239000004744 fabric Substances 0.000 claims 1
- 210000004209 hair Anatomy 0.000 claims 1
- 238000007689 inspection Methods 0.000 claims 1
- 230000010354 integration Effects 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 description 5
- 238000009434 installation Methods 0.000 description 4
- 239000000203 mixture Substances 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- ZBRKMOHDGFGXLN-BQBZGAKWSA-N (1s,2s)-2-(3,4-dichlorobenzoyl)cyclopropane-1-carboxylic acid Chemical compound OC(=O)[C@H]1C[C@@H]1C(=O)C1=CC=C(Cl)C(Cl)=C1 ZBRKMOHDGFGXLN-BQBZGAKWSA-N 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013506 data mapping Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A kind of data assembled view real time updating method based on Incremental Log.Firstly, the data set in distributed heterogeneous data sources is encapsulated as data service, these data services encapsulate the interface to distributed isomeric data access；Secondly, choosing chartered atomic data service in simultaneously combined platform, combination producing complex data service according to the data requirements of user；Again, it executes in complex data service and obtains data assembled view, and the data in data assembled view are cached；Finally, by parsing data source Incremental Log, real-time update view it is data cached.The present invention provides a kind of effective data assembled view real time updating method for the data integration based on data service, ensure that the freshness of data.
Description
Technical field
The present invention relates to a kind of data assembled view real time updating method based on Incremental Log.
Background technique
Information technology is in the deep application in the fields such as internet, Internet of Things, mobile computing and widely available so that almost every
Personal, every equipment all becomes the producer of data, and data type and data scale just increase at an unprecedented rate.This
A little data often using a large amount of different types of data storages, have across main features such as enterprise, isomery, autonomies.Utilize data
Distributed heterogeneous data sources are converted to data service by serviceization technology, then pass through Services Composition technology for data service collection
Tissue is the data unified model with global data feature, to be effectively integrated and manage distributed heterogeneous data sources.It will
Each heterogeneous data source model information is integrated into a central server, is supplied to user with a unified virtual view, real
Border data are still stored in each data source systems, realize the virtual integrated of cross-domain data.
Virtual view can cache data, to improve the efficiency of data access.However, when heterogeneous data source itself counts
When according to changing, the data inconsistency problem between data source and virtual view will cause.In fact, each data
The journal file of library system saves various operations to database, such as modification, the deletion of data etc., for safeguarding data
Integrality and recovery database.These journal files are read using special method or tool, such as the day of DB2 database
DBCC order dbcc log of will function reading db2Readlog, SQL Server database, Oracle company analysis tool
LogMiner etc..By parsing journal file, the affairs of data manipulation are extracted, the increment variation of data is obtained.Then according to change
Type and content more navigate to impacted viewdata in caching in real time and are updated.
In terms of data service combination is with Data View generation, Liu et al. (International Conference on
Information Science&Applications, 2014) describe the advanced data services frame of modern enterprise information system
Structure, this framework solve two main problems: the semantic intergration of data and the adaptability problem of data server, and target is branch
Various enterprise information systems are held, is combined by data service and obtains data and shared data.Various isomeric data resources (are closed
It is type database, XML file, Web service, OLAP), internal model describes business and number by Semantic mapping and Data View
Relationship between, and data are presented in semantic level by business terms, realize isomer data integration；Xu Xuehui (Shandong section
Skill university, 2012) it by the environment of analysis data service combination and the process of data service modeling, proposes with user and is
The data service combined method of the heart is realized the building of Data View by service-user based on this；(the computer science such as a warm man of virtue and ability
With exploration, 2012) propose the dynamic creation method iViewer across organization business Data View, by the building of Data View
Journey is converted into through combination operation visualization and easy-to-use data service and realizes；(the IEEE Transactions on such as Gu
Services Computing, 2010) service data link model is proposed, by outputting and inputting between attribute for data service
Data mapping relations be described, realize data-driven in the application in automatic service combination field；Amdouni etc.
(IEEE International Conference on Services Computing, 2014) proposes a kind of for not
It determines the probabilistic method of data service modeling, calculates the combination algebra of combination output probability, and propose a kind of algorithm to find
The correct executive plan of combination.
In terms of data service view update and optimization, roc etc. (Chinese journal of computers, 2013) gives nested views
Concept is calling of the tuple definition pointer realization in nested views to arbitrary levels data service, and uses for reference in relational algebra
Basic operation, complex data service composition operation is defined, propose a kind of dynamic based on data service update it is embedding
The method of view is covered, while the log updated by record data service and the nested views incremental update in the log are calculated
Method improves the data carry mechanism of nested views；In addition, roc etc. (Chinese journal of computers, 2011) is also to data assembled view
Optimization update method is studied, and reduces the time that Data View updates by the method for data buffer storage.
Summary of the invention
The present invention will overcome the drawbacks described above of the prior art, propose that a kind of data assembled view based on Incremental Log is real-time
Update method caches the data in data assembled view, by the Incremental Log updating cache in real time for parsing data source
Data ensure that the data consistency between data assembled view and data source, improve the access efficiency of data.
A kind of data assembled view real time updating method based on Incremental Log, comprising the following steps:
(1) data set of data source is encapsulated as atomic data service；
Data set in distributed heterogeneous data sources is encapsulated as data service, these Data service registerings are in data service
It is accessed for user by internet on platform, atomic data service defines in the following manner:
Define 1 atomic data service: can independent access and semantic not subdivisible data service be known as atomic data clothes
Business, it is expressed as one eight tuple ADS=< Id, Name, Fields, Description, Input, Output,
Operations, Publisher >, wherein Id is the unique identification of ADS, and Name is the title of ADS, and Fields is the attribute of ADS
List, Description are the semantic descriptions of ADS, and Input is the input of ADS, there is one or more, and Output is the defeated of ADS
It out, is a relationship, Operations is the operation that ADS can be performed, including inquiry, modification and deletion, Publisher are
The publisher of ADS；
(2) according to atomic data service creation complex data service；
According to the specific data requirements of user, chartered atomic data service in simultaneously combined platform is chosen, combination
As a result it is known as complex data and services CDS, defines in the following manner:
Define 2 complex data services: being made of several atomic data services and can independently accessed data service be known as
Complex data service, it is expressed as one eight tuple CDS=< Id, Name, Sub-DSDG, Description, Input,
Output, Operations, Publisher >, wherein Id is the unique identification of CDS；Name is the title of CDS；Sub-DSG is
The subgraph of DSDG；Description is the semantic description of CDS；Input is the input of CDS, is had 1 to multiple；Output is CDS
Output, be a relationship；Operations is the operation that CDS can be performed；Publisher is the publisher of CDS；
(3) according to complex data service creation data assembled view；
Complex data service CDS contains atomic data service relevant to data requirements and its dependence, successively holds
Atomic data service in row CDS, and data assembled view DCV is obtained by intersecting and merging, difference operation, it defines in the following manner:
It defines 3 data assembled views: executing the result that complex data service generates and be known as data assembled view, in form
It is a two-dimensional table, gauge outfit is attribute list, remaining every row is a tuple；
Set operation in data assembled view DCV is any one of intersecting and merging, difference operation, respectively with symbol ∩,
∪ ,-indicate, it is defined as follows:
It defines 4 (set operation, *) and set operation, the result shape of output is carried out to multiple implementing results of data service
Formula is a two-dimensional table, with CDS1*CDS2It indicates, if Schema (CDS1)=R1, Schema (CDS2)=R2, then Schema
(CDS1*CDS2)=R1*R2, Tuple (CDS1*CDS2)=Tuple (CDS1)*Tuple(CDS2)；
The two-dimensional table and its data of data assembled view are cached in user terminal, and user is read out and analyzes, then
The data in caching can be read when secondary calling DCV first to improve data combination view generation efficiency；
However, the data when data source are updated, it will cause the data cached and data source of data assembled view
Latest data between inconsistent problem, this patent solved by the Incremental Log of data source；
(4) view is closed based on Incremental Log more new data set；
(4.1) Incremental Log of data source is obtained；
Generally, the update operation of data source can be fully recorded in journal file in such a way that increment is modified, and be passed through
Incremental Log is obtained, extracts the affairs of data manipulation, it will be able to obtain specific data more new content；Implementation method is to allow number
According to the Incremental Log in service monitored data source, with the data variation in synchrodata source, the specific steps are as follows:
Step a1: the log mechanism in turn-on data source, by the update operation note of data source into log；
Step a2: the configuration data service data source to be connected IP address including data source and logs in authorization message, such as
Fruit is to start for the first time, the initial designated position of log is arranged, otherwise the position of default setting last time log successfully resolved；
Step a3: after data service and data source establish connection, being interacted by protocol data message, reads number
According to the Update log data in source；
Step a4: it when the data in data source change, is recorded in log in a manner of increment modification, and will more
New log is pushed to data service；
Step a5: after data service listens to Incremental Log, log is parsed by log protocol, and from data source again
Request updated data；
(4.2) the data cached of assembled view is updated；
After data service listens to the Incremental Log of data source, operated according to the updating type of log:
1) updating type is INSERT or DELETE
When updating type is INSERT or DELETE, it is operated as follows:
Step b1: when data source is newly-increased or deletes partial data, check assembled view it is data cached whether comprising institute more
New data, if so, continuing next step；
Step b2: according to the log of monitoring, the data of INSERT or DELETE are obtained；
Step b3: the data of the INSERT or DELETE of data and acquisition in caching are carried out and operate or difference operates；
2) updating type is UPDATE；
When updating type is UPDATE, operate according to the following steps:
Step c1: when data source has modified partial data, check that data cached whether contain of assembled view is updated
Data, if so, continuing next step；
Step c2: according to the log of monitoring, the data for updating front and back are obtained；
Step c3: the data before the data and update in caching are subjected to poor operation, then are carried out simultaneously with updated data
Operation；
3) updating type is ALTER or TRUNCATE；
When updating type is ALTER or TRUNCATE, operate according to the following steps:
Step d1: it when data source deletes part attribute or table, checks that assembled view is data cached and whether contains by shadow
Loud attribute, if so, continuing next step；
Step d2: according to the attribute of monitoring, in corresponding data service is done at failure, and corresponding caching number is removed
According to；
Data cached one be able to maintain with data source data after being operated according to above step, in data assembled view
Cause property.
The invention has the advantages that
Data set in distributed heterogeneous data sources is encapsulated as data service, and combination producing data combination view by the present invention
Figure, and data are cached, by parsing the log updating cache in real time data of data source, it can guarantee data assembled view
The consistency of data and data source data ensure that the freshness of data.
Detailed description of the invention
Fig. 1 is data service dependency graph of the invention.
Fig. 2 is the data assembled view real-time update mechanism choice of the invention based on Incremental Log.
Specific embodiment
Technical solution of the present invention is further illustrated with reference to the accompanying drawing.
For purposes of illustration only, setting there are an elevator information system, data are stored in MySQL database comprising relationship
Mode and attribute are as shown in table 1.
1 elevator enterprises data of information system collection of table
In conjunction with the elevator data collection to the specific embodiment party of the data assembled view real time updating method based on Incremental Log
Formula is illustrated, and steps are as follows:
(1) data set of data source is encapsulated as atomic data service；
Data set in distributed heterogeneous data sources is encapsulated as data service, these Data service registerings are in data service
On platform for user by internet access, as shown in table 2, according to atomic data service between dependence, construct
To data service dependency graph, as shown in Figure 1；
2 atomic data set of service of table
(2) according to atomic data service creation complex data service；
According to the specific data requirements of user, chartered atomic data service in simultaneously combined platform is chosen, combination
As a result it is known as complex data and services CDS, if there are the attribute lists of a query demand: { customer name, specifications and models, installation
Date, elevator type, installation site }, according to attribute list, chooses and combine atomic data service creation complex data service
CDS, the atomic data set of service for including are { ADS1,ADS2,ADS3,ADS4,ADS5,ADS6,ADS9,ADS10,ADS12, it is corresponding
Data service rely on shown in subgraph grey junction parts as shown in figure 1；
(3) according to complex data service creation data assembled view；
Complex data service CDS contains atomic data service relevant to data requirements and its dependence, successively holds
Atomic data service in row CDS, and data assembled view DCV is obtained by intersecting and merging, difference operation, the corresponding DCV of the CDS is such as
Shown in table 3；
3 data assembled view of table
| Customer name | Specifications and models | Installed date | Elevator type | Installation site |
| The mansion A | KWG2000/0.5VVVF | 2007-03-01 | Sightseeing elevator | City XX under Hangzhou |
| The mansion B | KWG2000 | 2008-08-01 | Sightseeing elevator | City XX under Hangzhou |
| The mansion C | SR1000/0.5-W | 2009-08-01 | Sightseeing elevator | City XX under Hangzhou |
| The mansion D | KWG2000/0.5VVVF | 2007-02-01 | Sightseeing elevator | City XX under Hangzhou |
The data buffer storage of data assembled view is in Redis database, when calling the DCV again, will be cached by reading
Corresponding data are directly obtained, avoid repeating CDS, improve the access efficiency of data assembled view；
(4) view is closed based on Incremental Log more new data set；
(4.1) Incremental Log of data source is obtained；
Generally, the update operation of data source can be fully recorded in journal file in such a way that increment is modified, and be passed through
Incremental Log is obtained, extracts the affairs of data manipulation, it will be able to obtain specific data more new content；Implementation method is to allow number
According to the Incremental Log in service monitored data source, with the data variation in synchrodata source；
Data assembled view real-time update mechanism based on Incremental Log is as shown in Fig. 2, opening elevator information system
MySQL database Binary log write-in functions, and be row, the binary log of MySQL by Binary log pattern configurations
Binary log has recorded all DDL and DML (in addition to data query sentence) sentence and sentence execution with event form and is disappeared
The time of consumption；
Canal is a open source projects based on the parsing of database Incremental Log, provides MySQL database incremental data
It subscribes to and the function of consumption, the IP address of data service disposition data source and logs in authorization, the position that log is initially formulated is set
Or the position of last log successfully resolved, the real-time acquisition of Incremental Log is realized based on Canal；
Data service and data source are established after Socket connects, and Socket connection is utilized to send the number based on MySQL agreement
According to packet and site information, the Binary log dump thread of MySQL database is created, then data service begins listening for MySQL
Database is transmitted through the data packet come, if there is EVENT packet, by the resolve packet based on Byte at event object, wherein including
Specific data changed content；
(4.2) the data cached of assembled view is updated；
After data service listens to the Incremental Log of data source, operated according to the updating type of log；If elevator
This record of " mansion A " that customer name is in client information table has been performed delete operation, and data service is obtained and solved in real time
The log is analysed, specifying information is as follows:
The change type of the Incremental Log is DELETE, wherein impacted database name is known as elevator, table name is
Ele_customers, deleted is the record that customer name is " mansion A ", checks the discovery data cached middle packet of assembled view
This attribute of customer name is contained, has navigated to the specific data in the caching, corresponding DELETE is executed to impacted record
Operation, after the data cached update of assembled view, the data assembled view for calling the DCV to obtain again is as shown in table 4.
The updated data assembled view of table 4
| Customer name | Specifications and models | Installed date | Elevator type | Installation site |
| The mansion B | KWG2000 | 2008-08-01 | Sightseeing elevator | City XX under Hangzhou |
| The mansion C | SR1000/0.5-W | 2009-08-01 | Sightseeing elevator | City XX under Hangzhou |
| The mansion D | KWG2000/0.5VVVF | 2007-02-01 | Sightseeing elevator | City XX under Hangzhou |
Content described in this specification embodiment is only enumerating to the way of realization of inventive concept, protection of the invention
Range should not be construed as being limited to the specific forms stated in the embodiments, and protection scope of the present invention is also and in art technology
Personnel conceive according to the present invention it is conceivable that equivalent technologies mean.
Claims (1)
1. a kind of data assembled view real time updating method based on Incremental Log, comprising the following steps:
(1) data set of data source is encapsulated as atomic data service；
Data set in distributed heterogeneous data sources is encapsulated as data service, these Data service registerings are in data service platform
On for user by internet access, atomic data service in the following manner define:
Define 1 atomic data service: can independent access and semantic not subdivisible data service be known as atomic data service, it
It is expressed as one eight tuple ADS=< Id, Name, Fields, Description, Input, Output, Operations,
Publisher >, wherein Id is the unique identification of ADS, and Name is the title of ADS, and Fields is the attribute list of ADS,
Description is the semantic description of ADS, and Input is the input of ADS, there is one or more, and Output is the output of ADS, is
One relationship, Operations is the operation that ADS can be performed, including inquiry, modification and deletion, Publisher are the hairs of ADS
Cloth person；
(2) according to atomic data service creation complex data service；
According to the specific data requirements of user, chartered atomic data service in simultaneously combined platform, combined result are chosen
Referred to as complex data services CDS, defines in the following manner:
Define 2 complex data services: being made of several atomic data services and can be independently accessed data service it is referred to as compound
Data service, it is expressed as one eight tuple CDS=< Id, Name, Sub-DSDG, Description, Input, Output,
Operations, Publisher >, wherein Id is the unique identification of CDS；Name is the title of CDS；Sub-DSG is the son of DSDG
Figure；Description is the semantic description of CDS；Input is the input of CDS, is had 1 to multiple；Output is the output of CDS, is
One relationship；Operations is the operation that CDS can be performed；Publisher is the publisher of CDS；
(3) according to complex data service creation data assembled view；
Complex data service CDS contains atomic data service relevant to data requirements and its dependence, successively executes CDS
In atomic data service, and data assembled view DCV is obtained by intersecting and merging, difference operation, defined in the following manner:
It defines 3 data assembled views: executing the result that complex data service generates and be known as data assembled view, be one in form
Two-dimensional table is opened, gauge outfit is attribute list, remaining every row is a tuple；
Set operation in data assembled view DCV is any one of intersecting and merging, difference operation, respectively with symbol ∩, ∪ ,-
It indicates, is defined as follows:
It defines 4 (set operation, *) and set operation is carried out to multiple implementing results of data service, the result formats of output are
One two-dimensional table, with CDS1*CDS2It indicates, if Schema (CDS1)=R1, Schema (CDS2)=R2, then Schema
(CDS1*CDS2)=R1*R2, Tuple (CDS1*CDS2)=Tuple (CDS1)*Tuple(CDS2)；
The two-dimensional table and its data of data assembled view are cached in user terminal, and user is read out and analyzes, and adjusts again
With the data that can be first read when the DCV in caching to improve data combination view generation efficiency；
However, the data when data source are updated, it will cause the data cached and data source of data assembled view most
Inconsistent problem between new data, this patent are solved by the Incremental Log of data source；
(4) view is closed based on Incremental Log more new data set；
(4.1) Incremental Log of data source is obtained；
Generally, the update operation of data source can be fully recorded in journal file in such a way that increment is modified, and pass through acquisition
Incremental Log extracts the affairs of data manipulation, it will be able to obtain specific data more new content；Implementation method is that data is allowed to take
The Incremental Log in business monitored data source, with the data variation in synchrodata source, the specific steps are as follows:
Step a1: the log mechanism in turn-on data source, by the update operation note of data source into log；
Step a2: the configuration data service data source to be connected and logs in authorization message at IP address including data source, if it is
Start for the first time, the initial designated position of log is set, otherwise the position of default setting last time log successfully resolved；
Step a3: after data service and data source establish connection, being interacted by protocol data message, reads data source
Update log data；
Step a4: it when the data in data source change, is recorded in log in a manner of increment modification, and by update
Log is pushed to data service；
Step a5: after data service listens to Incremental Log, log is parsed by log protocol, and re-request from data source
Updated data；
(4.2) the data cached of assembled view is updated；
After data service listens to the Incremental Log of data source, operated according to the updating type of log:
1) updating type is INSERT or DELETE；
When updating type is INSERT or DELETE, it is operated as follows:
Step b1: when data source is newly-increased or deletes partial data, whether data cached inspection assembled view includes to be updated
Data, if so, continuing next step；
Step b2: according to the log of monitoring, the data of INSERT or DELETE are obtained；
Step b3: the data of the INSERT or DELETE of data and acquisition in caching are carried out and operate or difference operates；
2) updating type is UPDATE；
When updating type is UPDATE, operate according to the following steps:
Step c1: when data source has modified partial data, checking that assembled view is data cached and whether contain updated data,
If so, continuing next step；
Step c2: according to the log of monitoring, the data for updating front and back are obtained；
Step c3: the data before the data and update in caching are subjected to poor operation, then carries out and operates with updated data；
3) updating type is ALTER or TRUNCATE；
When updating type is ALTER or TRUNCATE, operate according to the following steps:
Step d1: when data source deletes part attribute or table, check assembled view it is data cached whether contain it is impacted
Attribute, if so, continuing next step；
Step d2: it according to the attribute of monitoring, in corresponding data service is done at failure, and removes corresponding data cached；
After operating according to above step, data cached in data assembled view is able to maintain consistent with data source data
Property.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811087121.9A CN109145049A (en) | 2018-09-17 | 2018-09-17 | A kind of data assembled view real time updating method based on Incremental Log |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811087121.9A CN109145049A (en) | 2018-09-17 | 2018-09-17 | A kind of data assembled view real time updating method based on Incremental Log |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109145049A true CN109145049A (en) | 2019-01-04 |
Family
ID=64814479
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811087121.9A Pending CN109145049A (en) | 2018-09-17 | 2018-09-17 | A kind of data assembled view real time updating method based on Incremental Log |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109145049A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111639015A (en) * | 2020-05-22 | 2020-09-08 | 赵银波 | STDF (Standard template distribution function) rapid increment analysis method capable of adjusting analysis period and analysis point |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104298760A (en) * | 2014-10-23 | 2015-01-21 | 北京京东尚科信息技术有限公司 | Data processing method and data processing device applied to data warehouse |
| CN107239483A (en) * | 2017-04-14 | 2017-10-10 | 浙江工业大学 | A kind of cross-domain elevator data assembled view automatic generation method based on data, services |
-
2018
- 2018-09-17 CN CN201811087121.9A patent/CN109145049A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104298760A (en) * | 2014-10-23 | 2015-01-21 | 北京京东尚科信息技术有限公司 | Data processing method and data processing device applied to data warehouse |
| CN107239483A (en) * | 2017-04-14 | 2017-10-10 | 浙江工业大学 | A kind of cross-domain elevator data assembled view automatic generation method based on data, services |
Non-Patent Citations (2)
| Title |
|---|
| 张鹏等: "基于数据服务的嵌套视图动态更新方法", 《计算机学报》 * |
| 张鹏等: "基于数据服务的数据组合视图的优化更新", 《计算机学报》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111639015A (en) * | 2020-05-22 | 2020-09-08 | 赵银波 | STDF (Standard template distribution function) rapid increment analysis method capable of adjusting analysis period and analysis point |
| CN111639015B (en) * | 2020-05-22 | 2023-04-25 | 赵银波 | STDF rapid increment analysis method for adjusting analysis period and analysis point |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6502088B1 (en) | Method and system for improved access to non-relational databases | |
| US7685561B2 (en) | Storage API for a common data platform | |
| JP5864583B2 (en) | Support for parameterized queries / views in complex event processing | |
| KR101365832B1 (en) | Data access layer class generator | |
| CN100557609C (en) | A kind of persistent layer generation method and device | |
| US7673065B2 (en) | Support for sharing computation between aggregations in a data stream management system | |
| CN103631596B (en) | Business object data typing and the configuration device and collocation method for updating rule | |
| US8838654B1 (en) | Data modeling system for runtime schema extensibility | |
| US20020165724A1 (en) | Method and system for propagating data changes through data objects | |
| US20110270879A1 (en) | Support for user defined aggregations in a data stream management system | |
| US20090106189A1 (en) | Dynamically Sharing A Subtree Of Operators In A Data Stream Management System Operating On Existing Queries | |
| US20090055430A1 (en) | Method and system for model-based replication of data | |
| CN111712809A (en) | Learning ETL rules by example | |
| US20070027849A1 (en) | Integrating query-related operators in a programming language | |
| US20080320019A1 (en) | Pluggable merge patterns for data access services | |
| WO2023087673A1 (en) | Hierarchical data retrieval method and apparatus, and device | |
| JP2008511928A (en) | Metadata management | |
| JP2005182835A (en) | Method of creating data server for different kind of data source | |
| JP2022021343A (en) | Data capture and visualization system providing temporal data relationships | |
| US20160335274A1 (en) | Facilitating application processes defined using application objects to operate based on structured and unstructured data stores | |
| US20230334046A1 (en) | Obtaining inferences to perform access requests at a non-relational database system | |
| EP1573584A2 (en) | A knowledge repository system for computing devices | |
| US20070078840A1 (en) | Custom function library for inverse query evaluation of messages | |
| CN109145049A (en) | A kind of data assembled view real time updating method based on Incremental Log | |
| CN108845793A (en) | A kind of ORM design method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190104 |
|
| RJ01 | Rejection of invention patent application after publication |