CN105989049A - Data middle layer realizing method and system - Google Patents

Data middle layer realizing method and system Download PDF

Info

Publication number
CN105989049A
CN105989049A CN201510061991.9A CN201510061991A CN105989049A CN 105989049 A CN105989049 A CN 105989049A CN 201510061991 A CN201510061991 A CN 201510061991A CN 105989049 A CN105989049 A CN 105989049A
Authority
CN
China
Prior art keywords
data
memory database
read
application service
document data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510061991.9A
Other languages
Chinese (zh)
Inventor
章杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TVM Beijing Technology Co Ltd
Original Assignee
TVM Beijing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TVM Beijing Technology Co Ltd filed Critical TVM Beijing Technology Co Ltd
Priority to CN201510061991.9A priority Critical patent/CN105989049A/en
Publication of CN105989049A publication Critical patent/CN105989049A/en
Pending legal-status Critical Current

Links

Abstract

The invention discloses a data middle layer realizing method and a data middle layer realizing system. The data middle layer realizing method comprises the following steps: deploying and configuring a memory database; setting a corresponding relationship of the memory database and data tables in a file database; accessing to the memory database by application service, and proposing a read-writing request; synchronizing the memory database with the file database according to the corresponding relationship after responding to the read-writing request. By adopting the scheme of the embodiment of the invention, the speed and the efficiency of file database access can be increased, the data security can be improved, and the user experience can be greatly improved.

Description

A kind of data middle layer realization method and system
Technical field
The present invention relates to Internet technical field, particularly to a kind of data middle layer realization method and system.
Background technology
Middleware (middleware) is that a class connects component software and the computer software of application, and it includes one Group service.So that the multiple softwares operated on one or more machine are interacted by network.This skill The interoperability that art is provided, has promoted the evolution of Uniformly distributed formula architectural framework, and this framework is generally used for propping up Holding and simplify the distributed application program of those complexity, it includes web server, transaction monitor and message Queue software.
Middleware is a big class of basic software, belongs to the category of reusable software.As its name suggests, middleware It is in the centre of operating system software and the application software of user.
Middleware on operating system, network and data base, the lower floor of application software, total effect be for The application software being in oneself upper strata provides the environment running with developing, and helps user flexibility, develops efficiently Application software with integrated complex.Numerous about in the definition of middleware, commonplace received it is IDC statement: middleware is a kind of independent systems soft ware or service routine, Distributed Application software by This software between different technology share resource, middleware be positioned at client-server operating system it On, management calculates resource and network service.
The definition of middleware is shown by IDC, and middleware is a class software, rather than a kind of software;Middleware is not only Only realize interconnection, also to realize the interoperability between application;Middleware is software based on distributed treatment, Prominent feature is its network communicating function.
Middleware classification (classification of IDC): be broadly divided into six classes: terminal emulation/screen conversion middleware, In the middle of data access middleware, remote procedure call middleware, message-oriented middleware, transaction middleware, object Part.
Data access service middleware, it is simply that refer to that all connect application program and the software of data base.
Memory database, as the term suggests being placed in internal memory the data base of directly operation exactly by data.Relative to Disk, the reading and writing data speed of internal memory to be several orders of magnitude higher, and saves the data in internal memory and compares from magnetic The performance that can be greatly enhanced application is accessed on dish.
Memory database has abandoned the traditional approach of data in magnetic disk management, all heavy in internal memory based on total data Newly devise architecture, and be also carried out corresponding in terms of data buffer storage, fast algorithm, parallel work-flow Improvement, so data processing speed is more a lot of soon than the data processing speed of traditional database, the most all exist More than 10 times.The maximum feature of memory database is its " primary copy " or " working version " memory-resident, the most alive Move the affairs memory copying only with real-time internal memory database to come into contacts with.
In prior art, more and more depend on the Various types of data of database purchase.But, traditional number Read-write operation according to storehouse is more slow, often becomes the bottleneck of data access.And, directly to data base's Reading also exists many safety problems.Thus, need the reality wanting a kind of data middle layer to database access badly Existing, to improve the velocity efficiency to database access and safety.
Summary of the invention
The present invention provides a kind of data middle layer realization method and system, in order to solve in prior art data The speed accessing existence in storehouse is slow, efficiency is low, the problem of poor stability.
The present invention provides a kind of data middle layer implementation method, including:
Deployment configuration memory database;
Set the corresponding relation of tables of data in described memory database and document data bank;
Application service accesses described memory database and proposes read-write requests;
Described memory database is after responding described read-write requests, according to described corresponding relation, with described literary composition Part data base synchronize.
Described method also includes:
Described memory database is consistent with file data library structure.
Described corresponding relation includes:
Add the read-only data stored in document data bank to memory database readonly type In cache group;
Add the data needing read-write of storage in document data bank to memory database writethrough The cache group of global type.
Described method also includes:
Start replication agent, in data are loaded into memory database in document data bank;
Adjusting the data access direction of application service, it is right application service to be revised as the access of document data bank The access of memory database.
Described method also includes:
Described memory database according to the read-write requests of described application service, application service described in anticipation next step Data content may be read, in described document data bank, read described data content.
Described method also includes:
The data content that described memory database writes for described application service, application service described in anticipation is No meeting is read at once, the most not synchronize with described document data bank;Otherwise, same with described document data bank Step.
A kind of data middle layer realizes system, including:
Memory database deployment unit, for deployment configuration memory database;
Corresponding relation setup unit, for deployment configuration memory database;
Read-write processing unit, for receiving the read-write requests of described application service;
Internal storage data library unit, for responding after described read-write requests, according to described corresponding relation, with Described document data bank synchronizes.
Described system also includes:
Described internal storage data library unit is additionally operable to start replication agent, data in document data bank is added It is downloaded in memory database;
Described read-write processing unit is additionally operable to adjust the data access direction of application service, by application service to literary composition The access of part data base is revised as the access to memory database.
Described internal storage data library unit is additionally operable to:
According to the read-write requests of described application service, application service described in anticipation next step may read in data Hold, in described document data bank, read described data content.
Described internal storage data library unit is additionally operable to:
The data content that described application service is write, whether application service described in anticipation can read at once, if It is, not synchronize with described document data bank;Otherwise, synchronize with described document data bank.
Embodiment of the present invention deployment configuration memory database;Set in described memory database and document data bank The corresponding relation of tables of data;Application service accesses described memory database and proposes read-write requests;Described interior poke According to storehouse after responding described read-write requests, according to described corresponding relation, carry out same with described document data bank Step.The scheme of the embodiment of the present invention, it is possible to increase the speed of document data bank access and efficiency, and improve number According to safety, greatly improve user experience.
Other features and advantages of the present invention will illustrate in the following description, and, partly from explanation Book becomes apparent, or understands by implementing the present invention.The purpose of the present invention and other advantages can Realize by structure specifically noted in the description write, claims and accompanying drawing and obtain ?.
Below by drawings and Examples, technical scheme is described in further detail.
Accompanying drawing explanation
Accompanying drawing is for providing a further understanding of the present invention, and constitutes a part for description, with this Bright embodiment is used for explaining the present invention together, is not intended that limitation of the present invention.In the accompanying drawings:
A kind of data middle layer implementation method principle flow chart that Fig. 1 provides for the embodiment of the present invention 1;
A kind of data middle layer that Fig. 2 provides for the embodiment of the present invention 2 realizes system structure schematic diagram.
Detailed description of the invention
Below in conjunction with accompanying drawing, the preferred embodiments of the present invention are illustrated, it will be appreciated that described herein Preferred embodiment is merely to illustrate and explains the present invention, is not intended to limit the present invention.
As it is shown in figure 1, a kind of data middle layer implementation method principle process provided for the embodiment of the present invention 1 Figure, wherein,
Step 11, deployment configuration memory database.
Memory database, as the term suggests being placed in internal memory the data base of directly operation exactly by data.Relative to Disk, the reading and writing data speed of internal memory to be several orders of magnitude higher, and saves the data in internal memory and compares from magnetic The performance that can be greatly enhanced application is accessed on dish.Meanwhile, memory database has abandoned data in magnetic disk management Traditional approach, in internal memory, all redesigned architecture based on total data, and data buffer storage, Fast algorithm, parallel work-flow aspect have been also carried out being correspondingly improved, so data processing speed compares traditional data The data processing speed in storehouse is a lot, the most all more than 10 times soon.The maximum feature of memory database is Its " primary copy " or " working version " memory-resident, i.e. active transaction only internal memory with real-time internal memory database is copied Shellfish is come into contacts with.Obviously, it requires bigger amount of ram, but whole data base of the most any moment is left in Internal memory, i.e. memory database system are also intended to process I/O.
Memory database exchanges data process real-time, memory database to sacrifice memory source for for cost It is all relevant database product necessary to each enterprise of current communication society with disk database, disk What data base solved is massive store and data analysis problems, and memory database solution is to process in real time Problem concurrent with height.Both existence are complementary, and the real-time process performance of affairs of memory database is wanted Much stronger than disk database.But relative, his secure data area is also not reaching to disk database ratio The stage of shoulder.
Memory database using physical memory as the first storage medium of data, and using disk as backup.With The development of telecommunication service, system is the highest to the requirement of real-time and the requirement of amendment flexible to business, Demand for memory database is more and more higher in such cases.The way of disk database is data to be deposited Entering in internal memory and process, manageability and the data security reliability of this mode the most do not ensure.And it is interior Deposit data storehouse is improved for this weakness just.
The technology of memory database, a critically important feature, is the data in internal memory to be realized full thing Business processes, and this is only data to be placed in internal memory diverse with forms such as arrays.Further, interior poke Unrelated with application according to storehouse, it is clear that this architecture has its reasonability.Internal memory engine can realize looking into Asking and use identical data base with archive function, memory table has also used with disk table simultaneously Exactly the same access method.The selection of storage, is fully transparent for application developer.
For memory database, it is achieved that data management in internal memory, and it is not only as data The caching in storehouse.Data base data in magnetic disk block being cached in hosting unlike other, the internal memory of memory database Engine employs the specially designed Data Structure and Algorithm into random-access memory, and this design makes it avoid The problem often destroying cache database performance because using sequentialize commands.By memory database, reduce Magnetic disc i/o, it is possible to reached the process that the traditional database based on magnetic disc i/o cannot be intended in contrast Speed.
In the present embodiment, memory database needs consistent with disk database (document data bank) structure, this Sample prescription just data between memory database with document data bank are corresponding and operation.Document data bank is to close coefficient According to storehouse, then memory database equally needs to be set to relational database.It practice, memory database can be One mirror image of document data bank, simply scale is less than document data bank, wherein stores a part of file data Data in storehouse.
Step 12, the corresponding relation of tables of data in set memory data base and document data bank.
Data base is the important component part in large-scale application system, often enriching along with application system function And the passage of time, the data in data base all can be in growth in various degree, and traditional data base is It is data base based on disk, such as oracle, db2, SQL Server etc..When disk database stores Data when reaching to a certain degree, data base there will be I/O bottleneck, performance also can degradation, application Access and also can slowly wait.Faced with this situation, internal storage data can be disposed on big inner server configuring Storehouse and application, and then utilize memory database technology to be cached in internal memory by the hot spot data stored in disk, To reach to eliminate the bottleneck of disk I/O, improve the performance of system.
Corresponding with document data bank for memory database, not only need the correspondence of data, in addition it is also necessary to set up With manage relevant response mechanism, to be automatically performed data read-write between two data bases with synchronization.
Configuration files database, sets up management user, and gives corresponding authority;Configuration memory database, Set up cache management user, cache group is joined in memory database, start cache agent; Definition cache group, the data accessed by analyzing application are to do which kind of operation, including read-only or readable Writeable, wherein:
Add the read-only data stored in disk database to memory database readonly type In cache group, i.e. data in this partial memory are read-only, will not synchronize back in disk database;Will In disk database, the data needing read-write of storage add memory database writethrough global class to In the cache group of type, i.e. data in this partial memory are readable writeable, and can return disk by real-time synchronization In data base.So, the respective operations for Various types of data has been ensured.
Cache group towards be static caching system, the download website of such as google family, be used for delaying Deposit the file block of correspondence.Operating once set, value corresponding for key the most no longer changes.The when of use, Need the set operation used during self-defined cache miss.When there is miss when, first can be from according to key Consist hash value find the peer of correspondence, remove to find in peer the value of correspondence.If can not find, Then use self-defining get function to obtain alue from slow caching (such as db, file reads), and fill right Answer peer.Obtain next time, just directly take out from cache, do not visit again slow caching.It addition, be Avoid network to become bottleneck, after local peer obtains cache, can exist in the localCache of this locality, logical Cross lru algorithm to be managed.
The code of cache group is divided into consistenhash, cache grouppb, and lru, singleflight etc. are several Individual catalogue, deposits concordance Hash respectively, the protobuf agreement of cache group, and lru algorithm realizes, It is used for ensureing the singleflight of evaluation operation Exactly-once.
After configuration is complete, start replication agent, data in document data bank are loaded into interior poke According in storehouse;Adjust the data access direction of application service, the access of document data bank is revised by application service For the access to memory database.Application service will the most directly access file data to the access of data base Storehouse, and it is directed to memory database.
Here, it is necessary first to by the data syn-chronization in memory database and document data bank.Data syn-chronization is not That all of data are fully synchronized, but according to actual application service request operation, it would be desirable to data syn-chronization To memory database.When application service accesses memory database first, memory database does not has data. Request according to application service, it would be desirable to data syn-chronization in memory database, be then returned to application clothes Business.If application service carries out write operation, the most first in write memory database, the most again by memory database By this data syn-chronization to document data bank.
Data in memory database are not persistence, but preserve as required.For need not The data preserved, according to the principle of storehouse, by the data deletion used the earliest and write new data.
Memory database is synchronization with document data bank, has kinds of schemes, and such as, memory database is by thing Business log recording write log buffer district.Memory database is the relational database system of a kind of internal memory optimization, All left in physical memory by data and metadata, improve the operation response time of data base.Affairs day Will is one and the separate file of database file, all changes that data base is carried out by storage, and all remembers Record is inserted, updates, deletes, is submitted to, rollback and data base's patterns of change.Under default condition, all numbers Transaction journal is all used according to storehouse.The use of transaction journal is optional, but, unless because of cause specific not Use, otherwise should use all the time.Operating band has the data base of transaction journal can provide higher error protection merit Energy, better performance and data copy function.
Described transaction journal is specifically as follows WAL transaction log file, for recording the thing of memory database Business processes information.WAL is a kind of standard method realizing transaction journal.In short, the middle thought of WAL Want that the amendment to the data file carrier of table and index (WAL be) must be to can only occur in these amendments After having have recorded daily record.Transaction journal in log buffer district is unformatted transaction log file.
For data base, in order to realize basic ACID characteristic, it is necessary to before the transaction commits, will Affairs content is written in transaction log file with certain form.ACID characteristic: self-explanatory characters business atomicity, Concordance, isolation and persistency.The atomicity (Atomicity) of affairs refers to affairs or all Perform, or do not perform.The concordance (Consistency) of affairs refers to that affairs are consistent from one data base State be converted to another state.
The isolation (Isolation) of affairs is that other affairs are detectable the shadow of affairs before affairs are submitted to Ring.The most plural affairs do not have the state of staggered execution.Because so may result in number According to inconsistent.The persistency (Durability) of affairs refers to that once affairs are submitted to, and it is permanent.Namely After affairs are run successfully, the renewal with regard to system is permanent, will not unprovoked rollback.
And for memory database, in order to reach high performance, often reduce the requirement of " D " characteristic, The most do not use the such each transaction log record of document data bank it is first necessary to write disk file and be written to The submission affairs that after merit, ability is real, but first transaction log record is written to operating system shared drive One transaction journal buffer area in district, is brushed out disk by transaction journal asynchronously by log update process afterwards On transaction log file.Therefore, memory database the strictest in accordance with ACID characteristic.
Definition memory database and the corresponding relation of document data bank tables of data.Transaction journal refresh process is asynchronous Ground is by the information of the described transaction journal in described log buffer district, according to described memory database and number of files According to the corresponding relation of database data table, it is synchronized in document data bank.Document data bank can be Oracle or DB2 or Informix etc., be suitable for Transaction Processing (Online Transaction Processing, OLTP).Described transaction journal in transaction journal buffer area is unformatted transaction log file.
Owing to memory database and the corresponding relation of document data bank tables of data can be defined as required, therefore The corresponding relation of memory database and document data bank tables of data is configurable.Described method is according to affairs Log update process, asynchronously by the information in the described transaction journal in described log buffer district, according to institute State memory database and the corresponding relation of document data bank tables of data, be synchronized in document data bank.Therefore, Can ensure that memory database is consistent with document data bank constraint.
Constraint database is to ensure that the integrity of data and a set of mechanism of realizing.Mainly include NOTNULL constraint, UNIQUE constraints, PRIMARY KEY constraint, FOREIGN KEY are about Bundle.NOT NULL constraint is applied on single data row, and its protection data row it is necessary to have Data value.UNIQUE constraints can protect the multiple data in table to arrange, it is ensured that in the data row of protection The data of any two row are different from.PRIMARY KYE constraint can protect one or more row. PRIAMRY KEY constraint can act on each data row jointly with NOT NULL constraint.Table has uniquely Primary key.FOREIGN one or more data of KEY confining guard arrange, it is ensured that each data row Packet containing one or more null values, or on the data row of protection, have Primary key or unique simultaneously Constraint.
Memory database and the corresponding relation of document data bank tables of data, can be to pass through schema file (schema) define.Memory database, to the method for data synchronization of document data bank, can pass through schema Unformatted transaction log file is carried out form conversion, is inserted in document data bank.Acted on behalf of by transmission (cacheagent) ensure that memory database is consistent with the constraint of document data bank, data type is compatible.
Step 13, application service accesses memory database and proposes read-write requests.
Access the sensing of data base owing to have modified application service, all access of application service are directed to interior poke According to storehouse, thus, application service needs to propose read-write requests to memory database.For reading the request of data, Memory database can self search whether to there are this data now, if having, directly replys this request.If it is interior Deposit data storehouse does not has asked data, then needs to ask this data to document data bank, these data are same Step is to memory database, then responds the read request of application service.For write operation, memory database is directly write Enter data to relevant position.
Owing to the efficiency of memory database is the highest, even if then needing request data from document data bank, carried The time delay come also is controlled.
Step 14, memory database is after response read-write requests, according to corresponding relation, with document data bank Synchronize.
Memory database is responding the read-write requests of application service, after returning related data, needs obtaining Data arrange.For the data of write, asynchronous is synchronized in document data bank, to ensure file The content intact of data base.For the data read from document data bank, first enter elder generation according further to storehouse Go out principle, be saved in memory database, only needs write more data when, will use the earliest Data deletion.
In order to improve the efficiency of read-write, memory database is according to the read-write requests of described application service, anticipation institute Next step may read data content to state application service, reads in described data in described document data bank Hold.The step for, it is to preferably improve efficiency, sets the process of an anticipation.Application service is being read When taking related data, memory database is according to association algorithm, and next step may to be calculated application service The data read, read in memory database in advance, to facilitate next step reading data of application service to obtain Response faster.There is the association algorithm of a lot of anticipation in prior art, this is not limited by the present embodiment.
Further, the data content that memory database writes for application service, whether anticipation application service Can read at once, the most not synchronize with described document data bank;Otherwise, synchronize with described document data bank. This step is equally in order to improve efficiency, and the content for write needs to be stored temporarily in memory database, with Standby application service read requests at short notice.And wait the most at one's leisure in an asynchronous manner by these data with Document data bank synchronizes.
As in figure 2 it is shown, a kind of data middle layer for the embodiment of the present invention 2 offer realizes system structure signal Figure, wherein,
Memory database deployment unit 21, for deployment configuration memory database;
Corresponding relation setup unit 22, for deployment configuration memory database;
Read-write processing unit 23, for receiving the read-write requests of application service;
Internal storage data library unit 24, for after response read-write requests, according to corresponding relation, with number of files Synchronize according to storehouse.
Further, said system also includes:
Internal storage data library unit 24 is additionally operable to start replication agent, data in document data bank is added It is downloaded in memory database;
Read-write processing unit 23 is additionally operable to adjust the data access direction of application service, by application service to literary composition The access of part data base is revised as the access to memory database.
Further, above-mentioned internal storage data library unit 24 is additionally operable to:
According to the read-write requests of application service, next step possible reading data content of anticipation application service, Xiang Wen Part data base reads data content.
Further, above-mentioned internal storage data library unit 24 is additionally operable to:
Data content to application service write, whether anticipation application service can read at once, the most not with Document data bank synchronizes;Otherwise, Tong Bu with document data bank.
In sum, embodiment of the present invention deployment configuration memory database;Set described memory database and The corresponding relation of tables of data in document data bank;Application service accesses the proposition read-write of described memory database please Ask;Described memory database is after responding described read-write requests, according to described corresponding relation, with described literary composition Part data base synchronize.The scheme of the embodiment of the present invention, it is possible to increase document data bank access speed and Efficiency, and improve Information Security, greatly improve user experience.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or meter Calculation machine program product.Therefore, the present invention can use complete hardware embodiment, complete software implementation or knot The form of the embodiment in terms of conjunction software and hardware.And, the present invention can use and wherein wrap one or more Computer-usable storage medium containing computer usable program code (include but not limited to disk memory and Optical memory etc.) form of the upper computer program implemented.
The present invention is with reference to method, equipment (system) and computer program product according to embodiments of the present invention The flow chart of product and/or block diagram describe.It should be understood that can by computer program instructions flowchart and / or block diagram in each flow process and/or flow process in square frame and flow chart and/or block diagram and/ Or the combination of square frame.These computer program instructions can be provided to general purpose computer, special-purpose computer, embedding The processor of formula datatron or other programmable data processing device is to produce a machine so that by calculating The instruction that the processor of machine or other programmable data processing device performs produces for realizing at flow chart one The device of the function specified in individual flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and computer or the process of other programmable datas can be guided to set In the standby computer-readable memory worked in a specific way so that be stored in this computer-readable memory Instruction produce and include the manufacture of command device, this command device realizes in one flow process or multiple of flow chart The function specified in flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, makes Sequence of operations step must be performed to produce computer implemented place on computer or other programmable devices Reason, thus the instruction performed on computer or other programmable devices provides for realizing flow chart one The step of the function specified in flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
Obviously, those skilled in the art can carry out various change and modification without deviating from this to the present invention The spirit and scope of invention.So, if these amendments of the present invention and modification belong to the claims in the present invention And within the scope of equivalent technologies, then the present invention is also intended to comprise these change and modification.

Claims (10)

1. a data middle layer implementation method, it is characterised in that including:
Deployment configuration memory database;
Set the corresponding relation of tables of data in described memory database and document data bank;
Application service accesses described memory database and proposes read-write requests;
Described memory database is after responding described read-write requests, according to described corresponding relation, with described literary composition Part data base synchronize.
2. the method for claim 1, it is characterised in that described method also includes:
Described memory database is consistent with file data library structure.
3. the method for claim 1, it is characterised in that described corresponding relation includes:
Add the read-only data stored in document data bank to memory database readonly type In cache group;
Add the data needing read-write of storage in document data bank to memory database writethrough The cache group of global type.
4. method as claimed in claim 3, it is characterised in that described method also includes:
Start replication agent, in data are loaded into memory database in document data bank;
Adjusting the data access direction of application service, it is right application service to be revised as the access of document data bank The access of memory database.
5. the method for claim 1, it is characterised in that described method also includes:
Described memory database according to the read-write requests of described application service, application service described in anticipation next step Data content may be read, in described document data bank, read described data content.
6. the method for claim 1, it is characterised in that described method also includes:
The data content that described memory database writes for described application service, application service described in anticipation is No meeting is read at once, the most not synchronize with described document data bank;Otherwise, same with described document data bank Step.
7. a data middle layer realizes system, it is characterised in that including:
Memory database deployment unit, for deployment configuration memory database;
Corresponding relation setup unit, for deployment configuration memory database;
Read-write processing unit, for receiving the read-write requests of described application service;
Internal storage data library unit, for responding after described read-write requests, according to described corresponding relation, with Described document data bank synchronizes.
8. system as claimed in claim 7, it is characterised in that described system also includes:
Described internal storage data library unit is additionally operable to start replication agent, data in document data bank is added It is downloaded in memory database;
Described read-write processing unit is additionally operable to adjust the data access direction of application service, by application service to literary composition The access of part data base is revised as the access to memory database.
9. system as claimed in claim 7, it is characterised in that described internal storage data library unit is additionally operable to:
According to the read-write requests of described application service, application service described in anticipation next step may read in data Hold, in described document data bank, read described data content.
10. system as claimed in claim 7, it is characterised in that described internal storage data library unit is additionally operable to:
The data content that described application service is write, whether application service described in anticipation can read at once, if It is, not synchronize with described document data bank;Otherwise, synchronize with described document data bank.
CN201510061991.9A 2015-02-05 2015-02-05 Data middle layer realizing method and system Pending CN105989049A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510061991.9A CN105989049A (en) 2015-02-05 2015-02-05 Data middle layer realizing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510061991.9A CN105989049A (en) 2015-02-05 2015-02-05 Data middle layer realizing method and system

Publications (1)

Publication Number Publication Date
CN105989049A true CN105989049A (en) 2016-10-05

Family

ID=57037455

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510061991.9A Pending CN105989049A (en) 2015-02-05 2015-02-05 Data middle layer realizing method and system

Country Status (1)

Country Link
CN (1) CN105989049A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107506375A (en) * 2017-07-17 2017-12-22 上海斐讯数据通信技术有限公司 Date storage method and device
CN107943846A (en) * 2017-11-01 2018-04-20 内蒙古科电数据服务有限公司 Data processing method, device and electronic equipment
CN109376214A (en) * 2018-08-31 2019-02-22 优视科技(中国)有限公司 Data processing method and device, system, computer equipment and readable medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101876996A (en) * 2009-12-01 2010-11-03 广州从兴电子开发有限公司 Method and system for synchronizing data from main memory data bank to file data bank
US20120246116A1 (en) * 2009-09-02 2012-09-27 Yanming Yang System and method for data replication between heterogeneous databases
CN102945251A (en) * 2012-10-12 2013-02-27 浪潮电子信息产业股份有限公司 Method for optimizing performance of disk database by memory database technology
CN103226612A (en) * 2013-05-08 2013-07-31 华北计算技术研究所 Content management system based on main memory database
CN103593485A (en) * 2013-12-04 2014-02-19 网易传媒科技(北京)有限公司 Method and device for achieving real-time operation on data base

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120246116A1 (en) * 2009-09-02 2012-09-27 Yanming Yang System and method for data replication between heterogeneous databases
CN101876996A (en) * 2009-12-01 2010-11-03 广州从兴电子开发有限公司 Method and system for synchronizing data from main memory data bank to file data bank
CN102945251A (en) * 2012-10-12 2013-02-27 浪潮电子信息产业股份有限公司 Method for optimizing performance of disk database by memory database technology
CN103226612A (en) * 2013-05-08 2013-07-31 华北计算技术研究所 Content management system based on main memory database
CN103593485A (en) * 2013-12-04 2014-02-19 网易传媒科技(北京)有限公司 Method and device for achieving real-time operation on data base

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107506375A (en) * 2017-07-17 2017-12-22 上海斐讯数据通信技术有限公司 Date storage method and device
CN107943846A (en) * 2017-11-01 2018-04-20 内蒙古科电数据服务有限公司 Data processing method, device and electronic equipment
CN107943846B (en) * 2017-11-01 2021-05-11 内蒙古科电数据服务有限公司 Data processing method and device and electronic equipment
CN109376214A (en) * 2018-08-31 2019-02-22 优视科技(中国)有限公司 Data processing method and device, system, computer equipment and readable medium
CN109376214B (en) * 2018-08-31 2022-03-08 阿里巴巴(中国)有限公司 Data processing method, device and system, computer equipment and readable medium

Similar Documents

Publication Publication Date Title
KR102471196B1 (en) Journaled tables in database systems
US11669510B2 (en) Parallel processing of disjoint change streams into a single stream
KR101956236B1 (en) Data replication technique in database management system
KR102307371B1 (en) Data replication and data failover within the database system
Greenwald et al. Oracle essentials: Oracle database 12c
KR101658964B1 (en) System and method for datacenter workflow automation scenarios using virtual databases
KR101617339B1 (en) Virtual database system
George HBase: the definitive guide: random access to your planet-size data
KR100926880B1 (en) Data replication method and system in DVMS
US20120158650A1 (en) Distributed data cache database architecture
US9218405B2 (en) Batch processing and data synchronization in cloud-based systems
JPWO2011108695A1 (en) Parallel data processing system, parallel data processing method and program
US11818012B2 (en) Online restore to different topologies with custom data distribution
US10387384B1 (en) Method and system for semantic metadata compression in a two-tier storage system using copy-on-write
CN105989049A (en) Data middle layer realizing method and system
KR20190022600A (en) Data replication technique in database management system
US9009098B1 (en) Methods and apparatus for creating a centralized data store
US10628391B1 (en) Method and system for reducing metadata overhead in a two-tier storage architecture
Schaffner et al. The multi-tenant data placement problem
US11789971B1 (en) Adding replicas to a multi-leader replica group for a data set
US11188228B1 (en) Graphing transaction operations for transaction compliance analysis
JP4855537B2 (en) Database parallel editing method
US20230418711A1 (en) Repairing unresolved dangling references after failover
Sandberg High performance querying of time series market data
Diaz et al. Working with NoSQL Alternatives

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20161005

RJ01 Rejection of invention patent application after publication