CN105049530A - Adaption device and method for plurality of distributed cache systems - Google Patents
Adaption device and method for plurality of distributed cache systems Download PDFInfo
- Publication number
- CN105049530A CN105049530A CN201510521760.1A CN201510521760A CN105049530A CN 105049530 A CN105049530 A CN 105049530A CN 201510521760 A CN201510521760 A CN 201510521760A CN 105049530 A CN105049530 A CN 105049530A
- Authority
- CN
- China
- Prior art keywords
- data
- user
- cache
- buffer memory
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides an adaption device for a plurality of distributed cache systems. The adaption device comprises a uniform external service interface which is used for providing an API interface of a distributed cache service for a user; a distributed cache system identification unit which is used for identifying a distributed cache type according to user setting and a preset low-level feature; a distributed cache access proxy unit which is used for selecting a proxy suitable for current type cache; and a data and difference processing unit which is used for processing user access data and returned response data. The invention also provides an adaption method for the plurality of distributed cache systems. Through the technical scheme of the invention, a single object type can be fully utilized to establish a general and uniform cache thought into which a plurality of object types participate and which is oriented to adaption of a complex type distributed cache system.
Description
Technical field
The present invention relates to field of computer technology, particularly, relate to one kind of multiple distributed cache systems from adaptive device and one kind of multiple distributed cache systems from adaptation method.
Background technology
At present, along with the expansion of network service scale, popularizing gradually of cloud computing service, in order to user that the data and height of dealing with magnanimity are concurrent asks pressure bottleneck problem that caused traditional database produces, for a ripe web application system, distributed caching cluster improves systematic function and ensures the requisite function point of data consistency, and in system development, occupy more and more consequence.But distributed caching product is numerous at present, and lack the specification that service is externally provided of a unification, different distributed caching manufacturers provides different interfaces and access mechanism to user, then must plan by business development and designer the distributed cache system that good needs adopt and do the work of a certain amount of bottom adaptation during exploitation operation system, therefore, if an operation system thinks use distributed caching, then the service interface of distributed caching therewith can produce close-coupled thus some unnecessary dependences are produced to this buffer memory product.
Two problems easily can be brought like this: on the one hand, if an operation system thinks adaptive specific distributed caching at deployment phase, then again must do the customization of code level to this buffer memory product.On the other hand, if need to access multiple distributed caching cluster in operation system simultaneously, then need operation system from switching in different buffer memorys.And adopt different access mechanisms.In addition, this framework also can affect the bottom layer realization adjustment of subsequent product, if because some specific factor, the distributed caching that product needed replaces bottom realizes, so just must the service interface of adaptive new product again, this can cause much unnecessary extra work, these shortcomings above-mentioned all make the operation layer of operation system and technical support layer be difficult to be separated, do not meet the product design concept of low coupling, thus can cause a large amount of work is wasted in system in the adaptation of different Floor layer Technologies, also operation system is made main energy can not to be placed on process business in logic.
Therefore, need a kind of new distributed cache system from adaptation technique, can on existing distributed cache system adaptive formula formula basis, make full use of single object type and complete the distributed cache system of multi-object type from adaptive, set up general, the unique caching thinking certainly adaptive towards complicated type distributed cache system that multi-object type participates in.
Summary of the invention
The present invention is just based on the problems referred to above, propose a kind of new distributed cache system from adaptation technique, can on existing distributed cache system adaptive formula formula basis, make full use of single object type and complete the distributed cache system of multi-object type from adaptive, set up general, the unique caching thinking certainly adaptive towards complicated type distributed cache system that multi-object type participates in.
In view of this, the present invention proposes one kind of multiple distributed cache systems from adaptive device, comprising: unified external service interface, for the api interface providing distributed caching to serve for user; Distributed cache system recognition unit, for based on the api interface provided, according to user's setting and default low-level image feature identification distributed caching type; Distributed caching access agent unit, for the recognition result based on distributed caching type, chooses the agency being suitable for current type buffer memory; Data and difference processing unit, for the agency based on the current type buffer memory chosen, process user accesses data and the response data returned, mask the difference in data format, service interface and procotol between different bottom, and carry out corresponding open custom and expansion for different buffer memory types.In this technical scheme, unified external API and interface service can be provided, make the adjustment freely between various distributed caching that operation system can be seamless change and not need system self to go to do specific process to some distributed caching.
In technique scheme, preferably, the external service interface of described unification, specifically comprises: type identification module, for identifying the type of bottom distributed cache system; Interface adaptation module, for the recognition result of the type according to bottom distributed cache system, adaptive different cache interface.In this technical scheme, SPI interface can be provided, to make different distributed caching manufacturers do the bottom layer realization of self based on this.
In technique scheme, preferably, described distributed cache system recognition unit, specifically comprises: data transfer module, and for the cache interface based on adaptation, treating of transmission user is data cached; Treating of user is data cached, comprises the structured object of data and the major key of data; Buffer memory type identification module, for according to the system configuration preset, identifies that user treats data cached buffer memory type; This identification user treats the operation of data cached buffer memory type, comprises the buffer memory type that user specifies immediately, preferentially according to the corresponding implementation strategy of buffer memory type selecting that user specifies immediately; Data format conversion module, for according to identifying the buffer memory type that obtains, determines the Data Format Transform engine of distributed caching, to user's input treat data cachedly carry out format conversion.In this technical scheme, can according to the business scenario needs of reality, the various buffer memory product of Auto-matching in bottom layer realization, thus make the operation system on upper strata not need the product bottom regulating self to go to do different buffer memorys to mate.
In technique scheme, preferably, described distributed caching access agent unit, specifically comprise: adapter cache selects module, for based on the data format after conversion, by the data format after conversion, user is treated the data cached distributed caching that sends to is acted on behalf of; Distributed caching agency, according to the buffer memory type of mating in advance, selects the adapter cache that access is different; Data processing and respond module, for the cache client that different adapter caches is respectively corresponding dissimilar, to be treated user data cachedly to give cache client and the response processing that client returns by adapter cache.In this technical scheme, operation system can be made directly not mutual with various types of distributed caching, and the uniform client just provided with buffer memory adaption system is mutual, doing so avoids the close-coupled of operation system and concrete distributed caching product.
In technique scheme, preferably, described data and difference processing unit, specifically comprise: result set modular converter, for the response data that correspondence returns, adapter cache calls data cached format conversion engine, is the result set that business procedure can identify by the results conversion returned; Final result returns module, for the result set that will be converted to, returns to default operation system.In this technical scheme, various distributed caching can be masked the difference on service and bottom host-host protocol and data format is externally being provided.
According to a further aspect of the invention, also proposed one kind of multiple distributed cache systems from adaptation method, comprising: step 202: the api interface providing distributed caching to serve for user; Step 204: based on the api interface provided, according to user's setting and default low-level image feature identification distributed caching type; Step 206: based on the recognition result of distributed caching type, chooses the agency being suitable for current type buffer memory; Step 208: based on the agency of the current type buffer memory chosen, process user accesses data and the response data returned, mask the difference in data format, service interface and procotol between different bottom, and carry out corresponding open custom and expansion for different buffer memory types.In this technical scheme, unified external API and interface service can be provided, make the adjustment freely between various distributed caching that operation system can be seamless change and not need system self to go to do specific process to some distributed caching.
In technique scheme, preferably, described step 202, specifically comprises: step 302: the type identifying bottom distributed cache system; Step 304: according to the recognition result of the type of bottom distributed cache system, adaptive different cache interface.In this technical scheme, SPI interface can be provided, to make different distributed caching manufacturers do the bottom layer realization of self based on this.
In technique scheme, preferably, described step 204, specifically comprises: step 402: based on the cache interface of adaptation, and treating of transmission user is data cached; Treating of user is data cached, comprises the structured object of data and the major key of data; Step 404: according to the system configuration preset, identifies that user treats data cached buffer memory type; This identification user treats the operation of data cached buffer memory type, comprises the buffer memory type that user specifies immediately, preferentially according to the corresponding implementation strategy of buffer memory type selecting that user specifies immediately; Step 406: according to identifying the buffer memory type that obtains, determine the Data Format Transform engine of distributed caching, to user's input treat data cachedly carry out format conversion.In this technical scheme, can according to the business scenario needs of reality, the various buffer memory product of Auto-matching in bottom layer realization, thus make the operation system on upper strata not need the product bottom regulating self to go to do different buffer memorys to mate.
In technique scheme, preferably, described step 208, specifically comprises: step 502: based on the data format after conversion, by the data format after conversion, user is treated the data cached distributed caching that sends to is acted on behalf of; Distributed caching agency, according to the buffer memory type of mating in advance, selects the adapter cache that access is different; Step 504: the cache client that different adapter cache is corresponding dissimilar respectively, to be treated user data cachedly to give cache client and the response processing that client returns by adapter cache.In this technical scheme, operation system can be made directly not mutual with various types of distributed caching, and the uniform client just provided with buffer memory adaption system is mutual, doing so avoids the close-coupled of operation system and concrete distributed caching product.
In technique scheme, preferably, described step 210, specifically comprises: step 602: the response data that correspondence returns, and adapter cache calls data cached format conversion engine, is the result set that business procedure can identify by the results conversion returned; Step 604: by the result set be converted to, returns to default operation system.In this technical scheme, various distributed caching can be masked the difference on service and bottom host-host protocol and data format is externally being provided.
By above technical scheme, can on existing distributed cache system adaptive formula formula basis, make full use of single object type and complete the distributed cache system of multi-object type from adaptive, set up general, the unique caching thinking certainly adaptive towards complicated type distributed cache system that multi-object type participates in.
Accompanying drawing explanation
Fig. 1 shows the block diagram from adaptive device of multiple according to an embodiment of the invention distributed cache system;
Fig. 2 shows the flow chart from adaptation method of multiple according to an embodiment of the invention distributed cache system;
Fig. 3 shows the flow chart of unified according to an embodiment of the invention external service interface;
Fig. 4 shows the flow chart of distributed cache system recognition unit according to an embodiment of the invention;
Fig. 5 shows the flow chart of distributed caching access agent unit according to an embodiment of the invention;
Fig. 6 shows the flow chart of data and difference processing unit according to an embodiment of the invention;
Fig. 7 shows the detailed schematic diagram from adaptive device of multiple according to an embodiment of the invention distributed cache system;
Fig. 8 shows the realization flow figure that various according to an embodiment of the invention distributed cache system provides.
Embodiment
In order to more clearly understand above-mentioned purpose of the present invention, feature and advantage, below in conjunction with the drawings and specific embodiments, the present invention is further described in detail.It should be noted that, when not conflicting, the feature in the embodiment of the application and embodiment can combine mutually.
Set forth a lot of detail in the following description so that fully understand the present invention; but; the present invention can also adopt other to be different from other modes described here and implement, and therefore, protection scope of the present invention is not by the restriction of following public specific embodiment.
Fig. 1 shows the block diagram from adaptive device of multiple according to an embodiment of the invention distributed cache system.
As shown in Figure 1, multiple according to an embodiment of the invention distributed cache system from adaptive device 100, comprising: unified external service interface 102, for the api interface providing distributed caching to serve for user; Distributed cache system recognition unit 104, for based on the api interface provided, according to user's setting and default low-level image feature identification distributed caching type; Distributed caching access agent unit 106, for the recognition result based on distributed caching type, chooses the agency being suitable for current type buffer memory; Data and difference processing unit 108, for the agency based on the current type buffer memory chosen, process user accesses data and the response data returned, mask the difference in data format, service interface and procotol between different bottom, and carry out corresponding open custom and expansion for different buffer memory types.In this technical scheme, unified external API and interface service can be provided, make the adjustment freely between various distributed caching that operation system can be seamless change and not need system self to go to do specific process to some distributed caching.
In technique scheme, preferably, unified external service interface 102, specifically comprises: type identification module 1022, for identifying the type of bottom distributed cache system; Interface adaptation module 1024, for the recognition result of the type according to bottom distributed cache system, adaptive different cache interface.In this technical scheme, SPI interface can be provided, to make different distributed caching manufacturers do the bottom layer realization of self based on this.
In technique scheme, preferably, distributed cache system recognition unit 104, specifically comprises: data transfer module 1042, and for the cache interface based on adaptation, treating of transmission user is data cached; Treating of user is data cached, comprises the structured object of data and the major key of data; Buffer memory type identification module 1044, for according to the system configuration preset, identifies that user treats data cached buffer memory type; This identification user treats the operation of data cached buffer memory type, comprises the buffer memory type that user specifies immediately, preferentially according to the corresponding implementation strategy of buffer memory type selecting that user specifies immediately; Data format conversion module 1046, for according to identifying the buffer memory type that obtains, determines the Data Format Transform engine of distributed caching, to user's input treat data cachedly carry out format conversion.In this technical scheme, can according to the business scenario needs of reality, the various buffer memory product of Auto-matching in bottom layer realization, thus make the operation system on upper strata not need the product bottom regulating self to go to do different buffer memorys to mate.
In technique scheme, preferably, distributed caching access agent unit 106, specifically comprise: adapter cache selects module 1062, for based on the data format after conversion, by the data format after conversion, user is treated the data cached distributed caching that sends to is acted on behalf of; Distributed caching agency, according to the buffer memory type of mating in advance, selects the adapter cache that access is different; Data processing and respond module 1064, for the cache client that different adapter caches is respectively corresponding dissimilar, to be treated user data cachedly to give cache client and the response processing that client returns by adapter cache.In this technical scheme, operation system can be made directly not mutual with various types of distributed caching, and the uniform client just provided with buffer memory adaption system is mutual, doing so avoids the close-coupled of operation system and concrete distributed caching product.
In technique scheme, preferably, data and difference processing unit 108, specifically comprise: result set modular converter 1082, for the response data that correspondence returns, adapter cache calls data cached format conversion engine, is the result set that business procedure can identify by the results conversion returned; Final result returns module 1084, for the result set that will be converted to, returns to default operation system.In this technical scheme, various distributed caching can be masked the difference on service and bottom host-host protocol and data format is externally being provided.
Fig. 2 shows the flow chart from adaptation method of multiple according to an embodiment of the invention distributed cache system.
As shown in Figure 2, multiple according to an embodiment of the invention distributed cache system from adaptation method, comprising: step 202: the api interface providing distributed caching to serve for user; Step 204: based on the api interface provided, according to user's setting and default low-level image feature identification distributed caching type; Step 206: based on the recognition result of distributed caching type, chooses the agency being suitable for current type buffer memory; Step 208: based on the agency of the current type buffer memory chosen, process user accesses data and the response data returned, mask the difference in data format, service interface and procotol between different bottom, and carry out corresponding open custom and expansion for different buffer memory types.In this technical scheme, unified external API and interface service can be provided, make the adjustment freely between various distributed caching that operation system can be seamless change and not need system self to go to do specific process to some distributed caching.
In technique scheme, preferably, see Fig. 3, step 202, specifically comprises: step 302: the type identifying bottom distributed cache system; Step 304: according to the recognition result of the type of bottom distributed cache system, adaptive different cache interface.In this technical scheme, SPI interface can be provided, to make different distributed caching manufacturers do the bottom layer realization of self based on this.
In technique scheme, preferably, see Fig. 4, step 204, specifically comprises: step 402: based on the cache interface of adaptation, and treating of transmission user is data cached; Treating of user is data cached, comprises the structured object of data and the major key of data; Step 404: according to the system configuration preset, identifies that user treats data cached buffer memory type; This identification user treats the operation of data cached buffer memory type, comprises the buffer memory type that user specifies immediately, preferentially according to the corresponding implementation strategy of buffer memory type selecting that user specifies immediately; Step 406: according to identifying the buffer memory type that obtains, determine the Data Format Transform engine of distributed caching, to user's input treat data cachedly carry out format conversion.In this technical scheme, can according to the business scenario needs of reality, the various buffer memory product of Auto-matching in bottom layer realization, thus make the operation system on upper strata not need the product bottom regulating self to go to do different buffer memorys to mate.
In technique scheme, preferably, see Fig. 5, step 208, specifically comprises: step 502: based on the data format after conversion, by the data format after conversion, user is treated the data cached distributed caching that sends to is acted on behalf of; Distributed caching agency, according to the buffer memory type of mating in advance, selects the adapter cache that access is different; Step 504: the cache client that different adapter cache is corresponding dissimilar respectively, to be treated user data cachedly to give cache client and the response processing that client returns by adapter cache.In this technical scheme, operation system can be made directly not mutual with various types of distributed caching, and the uniform client just provided with buffer memory adaption system is mutual, doing so avoids the close-coupled of operation system and concrete distributed caching product.
In technique scheme, preferably, see Fig. 6, step 210, specifically comprises: step 602: the response data that correspondence returns, and adapter cache calls data cached format conversion engine, is the result set that business procedure can identify by the results conversion returned; Step 604: by the result set be converted to, returns to default operation system.In this technical scheme, various distributed caching can be masked the difference on service and bottom host-host protocol and data format is externally being provided.
Based on the defect that prior art exists, technical scheme of the present invention, propose a kind of function scheme of adapter distribution buffer memory, object is exactly the technical problem solving prior art existence, various distributed caching can be masked the difference on service and bottom host-host protocol and data format is externally being provided, the program provides unified external API and interface service, the adjustment freely between various distributed caching that operation system can be seamless is made to change and not need system self to go to do specific process to some distributed caching, thus service logic can be absorbed in and not by the interference of bottom layer realization.
Except the distributed caching of adaptive main flow at present, technical scheme of the present invention, provides SPI interface in addition, to make different distributed caching manufacturers do the bottom layer realization of self based on this, thus ensure that technical scheme of the present invention, can expand flexibly.
According to above-mentioned foothold, technical scheme of the present invention, propose a kind of can the caching agent scheme of the various distributed caching cluster of automatic adaptation, namely a kind of can from the client scheme of adaptive multiple distributed cache system, can according to the business scenario needs of reality, the various buffer memory product of Auto-matching in bottom layer realization, thus make the operation system on upper strata not need the product bottom regulating self to go to do different buffer memorys to mate.
In order to realize above-mentioned target, technical scheme of the present invention, propose a kind of can the various distributed caching cluster of self adaptation system schema.In the inventive solutions, provide unified interface to development of user, system unit is mainly divided into four parts: unified external service interface, distributed cache system recognition unit, distributed caching access agent unit and data and difference processing unit.
The api interface that unified external service interface provides distributed caching to serve for user, not by the impact that the concrete buffer memory of bottom realizes.Distributed cache system recognition unit identifies distributed caching type according to the feature of user's setting and some bottoms.Distributed caching access agent unit can choose the agency of applicable current type buffer memory according to the result of recognition unit, to reach the object of the client of the various types of distributed caching of automatic adaptation.The response data that data and difference processing unit mainly process user accesses data and return, mask the difference that different bottom layer realization causes in data format, service interface and procotol etc. in several ways, and these data and difference processing unit have higher extensibility, corresponding open custom and expansion can be done for different buffer memory types.
Above-mentioned each unit comprehensive effect, ensure that the buffer memory of bottom realizes completely transparent to the developer of service logic, developer can be absorbed in business, does not need the buffer memory realization being concerned about that bottom is concrete, decreases adaptive workload.
The schematic diagram of this system as shown in Figure 7.Visible in the figure 7: operation system is directly not mutual with various types of distributed caching.And the uniform client just provided with buffer memory adaption system is mutual, doing so avoids the close-coupled of operation system and concrete distributed caching product.Self Matching client, first can identify the type of bottom distributed cache system, carrys out adaptive different cache interface according to different types.
Simultaneously for different buffer memory products, the data format of employing and procotol are all variant, here need to process this species diversity from adaptive client.As shown in Figure 7, one deck under buffer memory recognition system is identification and the adaptation engine of data cached form, the data difference of the caching system process that this engine process is different, by shielding these difference, provide unified discernible data format to upper-layer service system.Technical scheme of the present invention, data for the distributed caching of current main-stream have all done corresponding process to transmission difference, certainly, some process is the raising in order to performance, such as in order to more efficiently and some caching system mutual, initiatively can convert data to the data of binary system or json form, this all ensure that system can better operate., except the buffer memory of main flow realizes, can SPI be opened here simultaneously, for the buffer memory that some do not realize, the expansion that can here be Myself easily.As Fig. 8, this functional block can relate to the realization that various distributed cache system provides.
One deck is descended to be technical scheme of the present invention again, the distributed caching pci client adapter PCI provided, identical with transform engine with data format identification, at this one deck, by the client of distributed cachings different for adaptation.Here the recognition result of buffer memory recognition system can be adopted, adaptation is done for different clients, namely the access for different buffer memory product is provided to realize, at present, the adaptation that this system provides the distributed caching of main flow on market realizes, but in order to the more product of compatibility, this primary unit takes open strategy, also SPI can be opened here, the expansion of more products can be supported.The concrete workflow diagram of distributed caching adaption system as shown in Figure 8.
With visiting distribution formula buffer memory, the example storing data describes this mechanism above-mentioned, and tentation data is an object, and the key stored is the major key of this object.Then this example combines flow chart above, sums up from the execution step of adaptive caching system as follows:
1) first operation system is called from adaptive client, and client externally provides unified interface here, and user does not pay close attention to the concrete buffer memory of bottom and realizes.
2) user transmits data, comprises the structured object of data and the major key of data.
3) Self Matching system is according to system configuration identification buffer memory type, and user also can specify specific buffer memory type immediately here, then system preferentially can select different implementation strategies according to the specified class of user, so also makes system more easy-to-use and flexible
4) according to buffer memory type, thus determine the realization of the Data Format Transform engine of distributed caching, here can by dissimilar realization, preliminary treatment is done to the data of user's input, if the type of such as buffer memory support is binary system, then preferentially can change and conversion is in advance done to structure object, here can by user's designated conversion strategy, thus user can be allowed to have an opportunity to participate in, according to specific customization, and make the conversion of data more efficient, certainly, here also can not change, adopt acquiescence processing mode or in some distributed cache systems, concrete distributed caching client can be given the conversion of data type to process.But consider in some scenarios, the special customization of operation system can make flow process more efficient, therefore, decontrol SPI here to the specific implementation of distributed caching
5) if data are converted to the form of expectation, then send to distributed caching to act on behalf of the data after conversion, distributed caching agency can select according to the buffer memory type of mating before to access different adapter caches
6) data are given cache client by adapter cache here and process the response that client returns by the cache client that different adapter cache is corresponding dissimilar respectively
7) response data that returns of correspondence, adapter cache can call the 4th equally) results conversion returned is the result set that business procedure can identify by data cached format conversion engine in step.Finally return to operation system.
In above process, operation system can not carry out direct interaction with the cache client of bottom, thus can not produce dependence to concrete realization, reaches the object of internal system decoupling zero, thus makes Business Entity more easily expand and transplant.
Compared with prior art, technical scheme of the present invention, analyzed by the actual scene applied Corporation Distributed buffer memory and problem, provide the perfect mechanism of adapter distribution caching system, thus make operation system break away from dependence to bottom specific implementation, and solve operation system conversion and the problem that simply can transplant in different deployed environment between multiple realization flexibly.
More than be described with reference to the accompanying drawings technical scheme of the present invention, considered in correlation technique there is no easy, the unified solution certainly adaptive for complicated type distributed cache system.Existing distributed cache system cannot complete the distributed cache system of complicated type participation from adaptation procedure from adaptation.Therefore, the present invention proposes one kind of multiple distributed cache systems from adaptive device and one kind of multiple distributed cache systems from adaptation method, can on existing distributed cache system adaptive formula formula basis, make full use of single object type and complete the distributed cache system of multi-object type from adaptive, set up general, the unique caching thinking certainly adaptive towards complicated type distributed cache system that multi-object type participates in.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. one kind of multiple distributed cache systems from adaptive device, it is characterized in that, comprising:
Unified external service interface, for the api interface providing distributed caching to serve for user;
Distributed cache system recognition unit, for based on the api interface provided, according to user's setting and default low-level image feature identification distributed caching type;
Distributed caching access agent unit, for the recognition result based on distributed caching type, chooses the agency being suitable for current type buffer memory;
Data and difference processing unit, for the agency based on the current type buffer memory chosen, process user accesses data and the response data returned, mask the difference in data format, service interface and procotol between different bottom, and carry out corresponding open custom and expansion for different buffer memory types.
2. multiple distributed cache system according to claim 1 from adaptive device, it is characterized in that, the external service interface of described unification, specifically comprises:
Type identification module, for identifying the type of bottom distributed cache system;
Interface adaptation module, for the recognition result of the type according to bottom distributed cache system, adaptive different cache interface.
3. multiple distributed cache system according to claim 1 and 2 from adaptive device, it is characterized in that, described distributed cache system recognition unit, specifically comprises:
Data transfer module, for the cache interface based on adaptation, treating of transmission user is data cached; Treating of user is data cached, comprises the structured object of data and the major key of data;
Buffer memory type identification module, for according to the system configuration preset, identifies that user treats data cached buffer memory type; This identification user treats the operation of data cached buffer memory type, comprises the buffer memory type that user specifies immediately, preferentially according to the corresponding implementation strategy of buffer memory type selecting that user specifies immediately;
Data format conversion module, for according to identifying the buffer memory type that obtains, determines the Data Format Transform engine of distributed caching, to user's input treat data cachedly carry out format conversion.
4. multiple distributed cache system according to claim 1 and 2 from adaptive device, it is characterized in that, described distributed caching access agent unit, specifically comprises:
Adapter cache selects module, for based on the data format after conversion, by the data format after conversion, user is treated the data cached distributed caching that sends to is acted on behalf of; Distributed caching agency, according to the buffer memory type of mating in advance, selects the adapter cache that access is different;
Data processing and respond module, for the cache client that different adapter caches is respectively corresponding dissimilar, to be treated user data cachedly to give cache client and the response processing that client returns by adapter cache.
5. multiple distributed cache system according to claim 1 and 2 from adaptive device, it is characterized in that, described data and difference processing unit, specifically comprise:
Result set modular converter, for the response data that correspondence returns, adapter cache calls data cached format conversion engine, is the result set that business procedure can identify by the results conversion returned;
Final result returns module, for the result set that will be converted to, returns to default operation system.
6. one kind of multiple distributed cache systems from adaptation method, it is characterized in that, comprising:
Step 202: the api interface providing distributed caching to serve for user;
Step 204: based on the api interface provided, according to user's setting and default low-level image feature identification distributed caching type;
Step 206: based on the recognition result of distributed caching type, chooses the agency being suitable for current type buffer memory;
Step 208: based on the agency of the current type buffer memory chosen, process user accesses data and the response data returned, mask the difference in data format, service interface and procotol between different bottom, and carry out corresponding open custom and expansion for different buffer memory types.
7. multiple distributed cache system according to claim 6 from adaptation method, it is characterized in that, described step 202, specifically comprises:
Step 302: the type identifying bottom distributed cache system;
Step 304: according to the recognition result of the type of bottom distributed cache system, adaptive different cache interface.
8. the multiple distributed cache system according to claim 6 or 7 from adaptation method, it is characterized in that, described step 204, specifically comprises:
Step 402: based on the cache interface of adaptation, treating of transmission user is data cached; Treating of user is data cached, comprises the structured object of data and the major key of data;
Step 404: according to the system configuration preset, identifies that user treats data cached buffer memory type; This identification user treats the operation of data cached buffer memory type, comprises the buffer memory type that user specifies immediately, preferentially according to the corresponding implementation strategy of buffer memory type selecting that user specifies immediately;
Step 406: according to identifying the buffer memory type that obtains, determine the Data Format Transform engine of distributed caching, to user's input treat data cachedly carry out format conversion.
9. the multiple distributed cache system according to claim 6 or 7 from adaptation method, it is characterized in that, described step 208, specifically comprises:
Step 502: based on the data format after conversion, by the data format after conversion, treats that by user the data cached distributed caching that sends to is acted on behalf of; Distributed caching agency, according to the buffer memory type of mating in advance, selects the adapter cache that access is different;
Step 504: the cache client that different adapter cache is corresponding dissimilar respectively, to be treated user data cachedly to give cache client and the response processing that client returns by adapter cache.
10. the multiple distributed cache system according to claim 6 or 7 from adaptation method, it is characterized in that, described step 210, specifically comprises:
Step 602: the response data that correspondence returns, adapter cache calls data cached format conversion engine, is the result set that business procedure can identify by the results conversion returned;
Step 604: by the result set be converted to, returns to default operation system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510521760.1A CN105049530B (en) | 2015-08-24 | 2015-08-24 | A variety of distributed cache systems from adaptive device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510521760.1A CN105049530B (en) | 2015-08-24 | 2015-08-24 | A variety of distributed cache systems from adaptive device and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105049530A true CN105049530A (en) | 2015-11-11 |
| CN105049530B CN105049530B (en) | 2018-05-25 |
Family
ID=54455733
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510521760.1A Expired - Fee Related CN105049530B (en) | 2015-08-24 | 2015-08-24 | A variety of distributed cache systems from adaptive device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105049530B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105930171A (en) * | 2016-05-13 | 2016-09-07 | 乐视控股（北京）有限公司 | Distributed uniform cache realization method, device and system |
| CN106878431A (en) * | 2017-02-24 | 2017-06-20 | 深圳市中博睿存信息技术有限公司 | A kind of method and apparatus for converting distributed system interior joint communication message form |
| CN106972980A (en) * | 2017-02-24 | 2017-07-21 | 山东中创软件商用中间件股份有限公司 | The consistency verification method and device of a kind of application server cluster |
| CN107977165A (en) * | 2017-11-22 | 2018-05-01 | 用友金融信息技术股份有限公司 | Data buffer storage optimization method, device and computer equipment |
| CN109271139A (en) * | 2018-09-11 | 2019-01-25 | 北京北信源软件股份有限公司 | A kind of method of standardization management and device based on caching middleware |
| CN109739516A (en) * | 2018-12-29 | 2019-05-10 | 深圳供电局有限公司 | A kind of operation method and system of cloud caching |
| CN112948336A (en) * | 2021-03-30 | 2021-06-11 | 联想凌拓科技有限公司 | Data acceleration method, cache unit, electronic device and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102542368A (en) * | 2010-12-13 | 2012-07-04 | 金蝶软件（中国）有限公司 | Cache system access method and device |
| CN102750324A (en) * | 2012-05-28 | 2012-10-24 | 华为技术有限公司 | File storage system, file storage device and file access method |
| CN103440303A (en) * | 2013-08-21 | 2013-12-11 | 曙光信息产业股份有限公司 | Heterogeneous cloud storage system and data processing method thereof |
-
2015
- 2015-08-24 CN CN201510521760.1A patent/CN105049530B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102542368A (en) * | 2010-12-13 | 2012-07-04 | 金蝶软件（中国）有限公司 | Cache system access method and device |
| CN102750324A (en) * | 2012-05-28 | 2012-10-24 | 华为技术有限公司 | File storage system, file storage device and file access method |
| US20140365537A1 (en) * | 2012-05-28 | 2014-12-11 | Huawei Technologies Co., Ltd | File storage system, apparatus, and file access method |
| CN103440303A (en) * | 2013-08-21 | 2013-12-11 | 曙光信息产业股份有限公司 | Heterogeneous cloud storage system and data processing method thereof |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105930171A (en) * | 2016-05-13 | 2016-09-07 | 乐视控股（北京）有限公司 | Distributed uniform cache realization method, device and system |
| CN106878431A (en) * | 2017-02-24 | 2017-06-20 | 深圳市中博睿存信息技术有限公司 | A kind of method and apparatus for converting distributed system interior joint communication message form |
| CN106972980A (en) * | 2017-02-24 | 2017-07-21 | 山东中创软件商用中间件股份有限公司 | The consistency verification method and device of a kind of application server cluster |
| CN106878431B (en) * | 2017-02-24 | 2020-06-02 | 北京同有飞骥科技股份有限公司 | Method and device for converting node communication message format in distributed system |
| CN107977165A (en) * | 2017-11-22 | 2018-05-01 | 用友金融信息技术股份有限公司 | Data buffer storage optimization method, device and computer equipment |
| CN107977165B (en) * | 2017-11-22 | 2021-01-08 | 用友金融信息技术股份有限公司 | Data cache optimization method and device and computer equipment |
| CN109271139A (en) * | 2018-09-11 | 2019-01-25 | 北京北信源软件股份有限公司 | A kind of method of standardization management and device based on caching middleware |
| CN109739516A (en) * | 2018-12-29 | 2019-05-10 | 深圳供电局有限公司 | A kind of operation method and system of cloud caching |
| CN112948336A (en) * | 2021-03-30 | 2021-06-11 | 联想凌拓科技有限公司 | Data acceleration method, cache unit, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105049530B (en) | 2018-05-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105049530A (en) | Adaption device and method for plurality of distributed cache systems | |
| CN107507005B (en) | Off-link data access method and system based on alliance chain | |
| EP3667500B1 (en) | Using a container orchestration service for dynamic routing | |
| CN102520912B (en) | Core configuration discovery method and microprocessor thereof | |
| US20220391260A1 (en) | Method and Apparatus for Creating Container, Device, Medium, and Program Product | |
| US20140279986A1 (en) | System and Method for Performing a Transaction in a Massively Parallel Processing Database | |
| CN105681477B (en) | A kind of data access method and a kind of server | |
| CN113821332B (en) | Method, device, equipment and medium for optimizing efficiency of automatic machine learning system | |
| CN110213304A (en) | A kind of block chain network interconnected method and system | |
| CN106844048A (en) | Distributed shared memory method and system based on ardware feature | |
| CN103999063B (en) | The Memory Sharing of processor | |
| CN110535679A (en) | Management method, framework, network slice sales platform and the management system of slice | |
| CN111818194A (en) | Domain name based access system and method | |
| KR102584447B1 (en) | workflow engine framework for cross-domain extension | |
| CN104199740B (en) | The no tight coupling multinode multicomputer system and method for shared system address space | |
| CN103514395A (en) | Plug-in right control method and system | |
| CN109343983A (en) | Information interacting method, device, equipment and storage medium between functional module | |
| CN109885612A (en) | The synchronization take-effective method and device of block chain intelligence contract | |
| CN102664952B (en) | Method for managing and monitoring embedded equipment cluster | |
| CN105608197A (en) | Method and system for obtaining Memcache data under high concurrency | |
| CN116800616B (en) | Management method and related device of virtualized network equipment | |
| CN114416277A (en) | Container deployment affinity configuration optimization method based on NUMA (non uniform memory access) architecture | |
| CN109617713A (en) | The implementation method and server of resource dissemination | |
| CN109889406A (en) | For managing method, apparatus, equipment and the storage medium of network connection | |
| CN109388388A (en) | Information interacting method, device, equipment and storage medium between functional module |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180525 Termination date: 20200824 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |