CN107273522B - Multi-application-oriented data storage system and data calling method - Google Patents
Multi-application-oriented data storage system and data calling method Download PDFInfo
- Publication number
- CN107273522B CN107273522B CN201710481856.9A CN201710481856A CN107273522B CN 107273522 B CN107273522 B CN 107273522B CN 201710481856 A CN201710481856 A CN 201710481856A CN 107273522 B CN107273522 B CN 107273522B
- Authority
- CN
- China
- Prior art keywords
- data
- cache
- metadata
- application
- cache unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2291—User-Defined Types; Storage management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
- G06F16/24573—Query processing with adaptation to user needs using data annotations, e.g. user-defined metadata
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/282—Hierarchical databases, e.g. IMS, LDAP data stores or Lotus Notes
Abstract
The embodiment of the invention relates to a data storage system and a data calling method for multiple applications, wherein the system comprises: a metadata base for storing metadata of the system; each cache module faces one application and at least comprises a first-level cache unit and a second-level cache unit; the cache module is used for storing the metadata stored or exported in the metadata database as cache data in the first-level cache unit or the second-level cache unit according to rules; the data exchange engine is used for calling cache data of the required metadata from the first-level cache unit or the second-level cache unit according to the data request instruction of the application; or sending the data generated by the application to the cache module corresponding to the application, so as to store the data in the metadata form to the metadata base through the cache module.
Description
Technical Field
The invention relates to the field of computers, in particular to a data storage system and a data calling method for multiple applications.
Background
Enterprise-level information is growing at an explosive pace, changing the state of survival and competitiveness of the enterprise with its unique, non-negligible importance. In an enterprise Management Information System (MIS) network environment, data storage and retrieval occur at all times, and the amount of data increases geometrically with the increase in the size of an enterprise and the increase in user personnel under the enterprise.
Data for managing the information system is stored in a database of the enterprise, and when a user needs to call the data using some application, the application requests export/write of the data from/to the database. However, the speed of accessing data by a Central Processing Unit (CPU) at the user end is very fast, and more than one billion instructions and data can be accessed and processed in one second, and the exporting/writing speed of the database is much slower. Therefore, taking the case of calling data by an application as an example, a commonly used method at present calls a framework cache for data of a database, and copies all data frequently accessed by the application in the database into the cache, so that when the data is called by the application, the data can be frequently fetched from the database but from the cache, and the speed is much higher.
However, in general, the amount of data of users in an enterprise in an information management system is large, and the number of applications used by each user is also large, which results in that the amount of data in a database that is frequently accessed is large. Particularly, when applications are added to the management information system, a large amount of data to be cached is directly increased, and under such a condition, the data storage mechanism and the architecture of the data storage system of the existing management information system cannot meet the requirement of an enterprise user for quick and effective data invocation.
Disclosure of Invention
The embodiment of the invention provides a data storage system and a data calling method for multiple applications, which can perform independent cache calling on data based on different applications and perform hierarchical cache on data with different access frequencies and different levels, thereby effectively improving the speed of data calling and improving the working efficiency of a management information system.
In a first aspect, an embodiment of the present invention provides a multi-application-oriented data storage system, where the system includes:
a metadata base for storing metadata of the system;
each cache module faces one application and at least comprises a first-level cache unit and a second-level cache unit; the cache module is used for storing the metadata stored or exported in the metadata database as cache data in the first-level cache unit or the second-level cache unit according to rules;
the data exchange engine is used for calling cache data of the required metadata from the first-level cache unit or the second-level cache unit according to the data request instruction of the application; or sending data generated by the application to the cache module corresponding to the application so as to store the data in the metadata form to the metadata base through the cache module;
the data exchange engine sends a metadata calling request to a cache module corresponding to the application according to a data request instruction of the application; the cache module queries cache data of the required metadata in a first-level cache unit of the cache module according to the metadata calling request; when the cache data of the required metadata exists in the first-level cache unit, returning the cache data of the required metadata to the application through the data exchange engine; when the first-level cache unit does not have cache data of the required metadata, querying the cache data of the required metadata in a second-level cache unit of the cache module, and returning the cache data of the required metadata stored in the second-level cache unit to the application through a data exchange engine.
Preferably, the rule includes a calling frequency of the metadata;
the first-level cache unit is specifically configured to temporarily store metadata of which the calling frequency exceeds a first threshold.
Further preferably, the second-level cache unit is specifically configured to store the metadata of which the calling frequency exceeds the second threshold and does not exceed the first threshold.
Further preferably, the first-level cache unit and the second-level cache unit are further configured to store relational data for recording a relationship between the applications.
Preferably, the data storage system is a heterogeneous data storage system.
In a second aspect, an embodiment of the present invention provides a data call method for a data storage system, where the method includes:
the data exchange engine sends a metadata calling request to a cache module corresponding to the application according to a data request instruction of the application;
the cache module queries cache data of the required metadata in a first-level cache unit of the cache module according to the metadata calling request;
when the cache data of the required metadata exists in the first-level cache unit, returning the cache data of the required metadata to the application through the data exchange engine;
when the first-level cache unit does not have cache data of the required metadata, querying the cache data of the required metadata in a second-level cache unit of the cache module, and returning the cache data of the required metadata stored in the second-level cache unit to the application through a data exchange engine.
Preferably, when there is no cache data of the required metadata in the secondary cache unit, the method further includes:
the secondary cache unit acquires the required metadata from a metadata database according to the data call request and stores the metadata as cache data;
and returning the cache data to the application through a data exchange engine.
Preferably, the method further comprises:
and the caching module caches the metadata of which the calling frequency exceeds a first threshold value in a first caching unit according to the metadata calling request, and caches the metadata of which the calling frequency exceeds a second threshold value and does not exceed the first threshold value in a second caching unit.
According to the data storage system provided by the invention, a multi-level cache mechanism is adopted for calling data in the metadata base, and the cache modules which support the multi-level cache mechanism for each application are constructed to perform hierarchical cache on the data with different access frequencies, so that the data which is accessed most frequently can be applied and obtained at the fastest speed, and the data which is accessed more frequently and less frequently can be applied and obtained at the faster speed. Meanwhile, a system architecture for calling data under independent cache based on different applications is adopted, so that the data request speed of each application is not influenced when the system function is expanded to increase the application number. The data storage system can effectively improve the speed of data calling and improve the working efficiency of the management information system.
Drawings
FIG. 1 is a schematic diagram of a multi-application oriented data storage system according to an embodiment of the present invention;
fig. 2 is a flowchart of a data storage method based on a data storage system according to a second embodiment of the present invention;
fig. 3 is a flowchart of a data calling method based on a data storage system according to a third embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention are described in further detail below with reference to the accompanying drawings.
Fig. 1 is a schematic diagram illustrating a system structure of a data storage system for multiple applications according to an embodiment of the present invention in detail, where fig. 1 is a schematic diagram illustrating the data storage system according to the embodiment of the present invention.
As shown in fig. 1, the data storage system of the present embodiment includes: the metadata database 10, a plurality of cache modules (in the embodiment, the cache module 20-1, the cache module 20-2, and the cache module 20-3 are exemplified), and a data exchange engine 30.
The metadata base 10 is used for storing metadata of the system;
each cache module faces to an application (for example, the cache module 20-1 faces to the application 1, the cache module 20-2 faces to the application 2, and the cache module 20-3 faces to the reference 3), and each cache module at least comprises a first-level cache unit 201 and a second-level cache unit 202; the cache module is used for storing the metadata stored in or exported from the metadata database 10 as cache data in the first-level cache unit 201 or the second-level cache unit 202 according to rules;
the storage of the cache data in the first-level cache unit 201 and the second-level cache unit 202 may be performed according to some preset rules. Such as: it is possible to specify which cache data is stored in the primary cache unit 201 and which cache data is stored in the secondary cache unit 202 according to the calling frequency of the metadata.
The data exchange engine 30 is configured to invoke cache data of the required metadata from the first-level cache unit 201 or the second-level cache unit 202 of the cache module corresponding to the application (e.g., the cache module 20-1 corresponding to the application 1) according to the data request instruction of the application; or sending the data generated by the application to a cache module corresponding to the application, and storing the data in the metadata form in the metadata base 10 through the cache module.
Specifically, when the application 1 requests to call data through the data exchange engine 30, it first searches whether there is needed data from the first-level cache unit 201 of the cache module 20-1, if so, reads and returns to the application 1, and if not, searches whether there is needed data from the second-level cache unit 202; if the data is found, the data is read and returned to the application 1, and if the data is not found, the corresponding data is called from the metadata base 10 by the second-level cache unit 202 to be cached in the second-level cache unit 202 and returned to the application 1. Then, the data is cached in the second level cache unit 202 all the time, and when the application 1 calls the data again in the future, the data can be called directly from the second level cache unit 202 without reading from the metadata database. Such a reading mechanism makes the hit rate of the application calling from the cache very high, that is, the data called by the application is mostly in the cache, and only a small part of the data needs to be read from the database. This saves the application a lot of time to request the data.
When some cache data in the second-level cache unit 202 is called many times, the cache data will be converted from the second-level cache unit 202 to be cached in the first-level cache unit 201. A threshold may be set to determine which cache data is stored in the level one cache unit 201. This threshold may be the number of times the data is invoked, e.g. up to 8 times; or may be a percentage ordering of the called frequency in the entire cache data, e.g., the calling frequency is the top 10%.
The most frequently accessed data is not invariant over time. That is, the data that has just been infrequently accessed, and the data that has just been the most frequently accessed, are now infrequent, so the data in the first-level cache unit 201 is dynamically updated according to a certain rule, so that it is ensured that the data in the first-level cache unit 201 is accessed most frequently.
In addition to storing data, the primary cache unit 201 and the secondary cache unit 202 are also used to store relational data that records relationships between applications. For example, some cache data may be called by the application 1 or the application 2, and when the application 1 modifies the data and the application 2 calls again, the modified data needs to be called. It can therefore be said that this data has an association between application 1 and application 2, and that there are various relationships of data between different applications. The data used to record and describe the relationship between the applications is the relational data described in this embodiment.
Some or most of the relational data may be stored in the primary cache unit 201, for example, 50% -90% of the relational data may be stored in the primary cache unit 201, and other relational data, for example, less common relational data, may be stored in the secondary cache unit 202.
Because the setting of the cache module is matched with the application, and the data calling and storing of each application use the independent cache module, when a plurality of users under a tenant use different applications, the data calling or storing of the applications can be carried out in parallel without mutual interference, and the speed of the data calling and storing is effectively improved. Different cache modules read and store data based on the same metadata base, so that data sources for acquiring data by different applications are the same, and data confusion is avoided. This ensures that the data storage system is fast and stable.
If different applications are based on different programming languages, the data structures of these applications may be inconsistent. In the present system, data stored by the application through the data exchange engine is stored discretely in the form of metadata of the system. That is, before storing, data of different applications are processed into metadata conforming to the specification of the data dictionary and then stored. When reading, the metadata is also acquired first, and then converted into data of an application recognizable data structure through data processing. Therefore, the data storage system facing multiple applications can support the storage of heterogeneous data of multiple applications.
Correspondingly, the embodiment of the invention also provides a data storage method and a data calling method based on the data storage system.
Fig. 2 is a flowchart of a data storage method based on a data storage system according to an embodiment of the present invention. The data storage method will be described first with reference to fig. 2 in conjunction with fig. 1.
The data storage method of the invention comprises the following steps:
in particular, the data structure of the written data is based on the application, and the data structures of applications based on different programming languages may be inconsistent. In the process of sending the write data obtained or generated by the application to the cache module, the write data needs to be compiled first and converted into a field set. Each field in these field sets has field attributes that include application attribute information for the field from the application, as well as other information. For example, if the written data is "zhangao, 30 years old", then the three fields of "zhangao", "30" and "year old" are included in this field set. Wherein, the 'Zhangin' is the name of a person, and the field attribute of the 'Zhangin' comprises the attribute which explains that the field record is the name of the person; if the written data is in a certain table entry of the application, such as a personnel list of department A under the table entry of personnel management, the attribute of the field of 'Zhang' also includes an attribute that the name of the person recorded in the field belongs to the department A. Of course, this field attribute also includes an attribute indicating which application writes (read-write) or can be called (read-only) the field.
specifically, the rule herein refers to the rule described in the foregoing embodiment, for example, a threshold is set according to the frequency of data access to determine which cache data is stored in the first-level cache unit and which cache data is stored in the second-level cache unit. If the data "zhangao, 30 years old" is modified by the application based on the existing data, such as the previously stored data is "zhangao, 29 years old", the modified field set may be stored in a previously stored cache location. For example, the previous data is stored in the level one cache unit, the modified field set is divided into "zhangao", "30" and "yearly" which can still be recorded in the level one cache unit. If the data of Zhanga, 30 years old is newly added and has not been stored in the first level cache unit and the second level cache unit before, the field set is divided into Zhanga, 30 and second level cache units and then recorded in the second level cache unit.
And step 230, importing the cache data into a metadata base and storing the cache data as metadata.
Specifically, the metadata database includes a metadata dictionary, which is used to define various types of metadata in the system, and is a collection of metadata descriptions. The metadata in the data dictionary may include: numbers, data describing the meaning of the numbers, and the like. When the cache data is imported into the metadata base for storage, it needs to be determined whether each of the split fields included in the cache data conforms to the specification of the metadata dictionary.
Still taking "zhangzhi, 30 years old" as an example, the buffer unit has been split into the fields "zhangzhi", "30", "year old". Assuming that these fields are all in accordance with the metadata dictionary, these three fields are stored in the metadata dictionary, and the attributes of the metadata are also recorded. For example, the stored "zhangzhi" may record attributes such as the department to which the zhangzhi belongs.
If a field does not conform to the specification of the metadata dictionary, the field needs to be conformed according to a preset mapping relation, and then the field is imported into the metadata database to be stored. For example, in the metadata dictionary, metadata specifying a number whose attribute is a record age is stored as being reserved one digit after the decimal point. Then, when the field "30" is stored, the field is processed to "30.0" according to the definition of the metadata dictionary and then stored.
The data storage method based on the multi-application-oriented data storage system provided by the embodiment of the invention can independently cache data based on different applications and hierarchically cache data with different access frequencies and different levels, thereby effectively improving the data storage speed and improving the working efficiency of a management information system.
Fig. 3 is a flowchart of a data calling method based on a data storage system according to an embodiment of the present invention. The data calling method will be described with reference to fig. 3 in conjunction with fig. 1.
The data calling method comprises the following steps:
specifically, when an application needs to make a data call to data, a data request command is first sent through the data exchange engine. The data request instruction carries information such as the attribute and data relationship of the requested data.
When different users use different applications to simultaneously request for calling data under the same tenant, each application calls the data from the cache module corresponding to the application through the data exchange engine, and the data can be in parallel without mutual interference.
specifically, after receiving the data request instruction, the cache module may first search for whether there is corresponding data in the cache module according to information such as the attribute and the data relationship of the data carried by the data request instruction.
In the data storage system of the present invention, the data storage in the cache module is hierarchically stored according to the access frequency (or possibly other rules), and the cache module is divided into at least two levels of caches, i.e. the first level cache unit and the second level cache unit described in the above embodiments. The first-level cache unit stores data with higher access frequency, and the second-level cache unit stores other data with lower access frequency except the data with higher access frequency.
specifically, if the required data is found in the first-level cache unit, the data in the cache is directly called by the data exchange engine and returned to the application.
Specifically, if the first-level cache unit does not have the required data, the data is continuously searched from the second-level cache unit, and after the data is found, the data in the cache is called by the data exchange engine and returned to the application.
Normally, the required call data should be found in the level two cache units, but there may also be special cases, such as a physical shutdown or failure of the cache module, where the data is totally lost. In this case, the data cannot be found in the cache module when it is called. After the data are searched in the cache module in a failure mode, the secondary cache unit acquires the required metadata from the metadata base according to the data calling request and stores the metadata as cache data in the secondary cache unit; and returning the cached data to the application through the data exchange engine.
The data calling method based on the multi-application-oriented data storage system provided by the embodiment of the invention can independently call data based on different applications and hierarchically call data based on different access frequencies in a hierarchical cache manner, so that the data access speed is effectively increased and the working efficiency of a management information system is improved.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present embodiments.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The foregoing detailed description is provided to illustrate, explain and enable the best mode of the invention, and it should be understood that the above description is only exemplary of the invention, and is not intended to limit the scope of the invention, which is defined by the following claims.
Claims (6)
1. A multi-application oriented data storage system, the system comprising:
a metadata base for storing metadata of the system;
each cache module faces one application and at least comprises a first-level cache unit and a second-level cache unit; the cache module is used for storing the metadata stored or exported in the metadata database as cache data in the first-level cache unit or the second-level cache unit according to rules;
the rule includes a frequency of invocation of the metadata; the first-level cache unit is specifically used for temporarily storing the metadata of which the calling frequency exceeds a first threshold;
the second-level cache unit is specifically configured to store the metadata of which the calling frequency exceeds a second threshold and does not exceed the first threshold;
the data exchange engine is used for calling cache data of the required metadata from the first-level cache unit or the second-level cache unit according to the data request instruction of the application; or sending data generated by the application to the cache module corresponding to the application so as to store the data in the metadata form to the metadata base through the cache module;
the data exchange engine sends a metadata calling request to a cache module corresponding to the application according to a data request instruction of the application; the cache module queries cache data of the required metadata in a first-level cache unit of the cache module according to the metadata calling request; when the cache data of the required metadata exists in the first-level cache unit, returning the cache data of the required metadata to the application through the data exchange engine; when the first-level cache unit does not have cache data of the required metadata, querying the cache data of the required metadata in a second-level cache unit of the cache module, and returning the cache data of the required metadata stored in the second-level cache unit to the application through a data exchange engine.
2. The data storage system of claim 1, wherein the primary cache unit and the secondary cache unit are further configured to store relational data for recording relationships between the applications.
3. The data storage system of claim 1, wherein the data storage system is a heterogeneous data storage system.
4. A data calling method based on the data storage system of claim 1, wherein the method comprises:
the data exchange engine sends a metadata calling request to a cache module corresponding to the application according to a data request instruction of the application;
the cache module queries cache data of the required metadata in a first-level cache unit of the cache module according to the metadata calling request;
when the cache data of the required metadata exists in the first-level cache unit, returning the cache data of the required metadata to the application through the data exchange engine;
when the first-level cache unit does not have cache data of the required metadata, querying the cache data of the required metadata in a second-level cache unit of the cache module, and returning the cache data of the required metadata stored in the second-level cache unit to the application through a data exchange engine.
5. The method of claim 4, wherein when there is no cache data for the required metadata in the level two cache unit, the method further comprises:
the secondary cache unit acquires the required metadata from a metadata database according to the data call request and stores the metadata as cache data;
and returning the cache data to the application through a data exchange engine.
6. The method of claim 4, further comprising:
and the caching module caches the metadata of which the calling frequency exceeds a first threshold value in a first caching unit according to the metadata calling request, and caches the metadata of which the calling frequency exceeds a second threshold value and does not exceed the first threshold value in a second caching unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710481856.9A CN107273522B (en) | 2015-06-01 | 2015-06-01 | Multi-application-oriented data storage system and data calling method |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510293727.8A CN104866434B (en) | 2015-06-01 | 2015-06-01 | Towards data-storage system and data storage, the call method applied more |
| CN201710481856.9A CN107273522B (en) | 2015-06-01 | 2015-06-01 | Multi-application-oriented data storage system and data calling method |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510293727.8A Division CN104866434B (en) | 2015-06-01 | 2015-06-01 | Towards data-storage system and data storage, the call method applied more |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107273522A CN107273522A (en) | 2017-10-20 |
| CN107273522B true CN107273522B (en) | 2020-01-14 |
Family
ID=53912278
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510293727.8A Active CN104866434B (en) | 2015-06-01 | 2015-06-01 | Towards data-storage system and data storage, the call method applied more |
| CN201710481856.9A Active CN107273522B (en) | 2015-06-01 | 2015-06-01 | Multi-application-oriented data storage system and data calling method |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510293727.8A Active CN104866434B (en) | 2015-06-01 | 2015-06-01 | Towards data-storage system and data storage, the call method applied more |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN104866434B (en) |
Families Citing this family (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105183394B (en) * | 2015-09-21 | 2018-09-04 | 北京奇虎科技有限公司 | A kind of data storage handling method and device |
| CN105335512B (en) * | 2015-10-30 | 2019-09-17 | 小米科技有限责任公司 | Data query method and device |
| CN105447171A (en) * | 2015-12-07 | 2016-03-30 | 北京奇虎科技有限公司 | Data caching method and apparatus |
| CN107231395A (en) * | 2016-03-25 | 2017-10-03 | 阿里巴巴集团控股有限公司 | Date storage method, device and system |
| US10055867B2 (en) * | 2016-04-25 | 2018-08-21 | Qualcomm Incorporated | Accelerated light field display |
| CN106445839A (en) * | 2016-10-09 | 2017-02-22 | 国云科技股份有限公司 | High performance document storage system and method thereof |
| CN107133297A (en) * | 2017-04-26 | 2017-09-05 | 努比亚技术有限公司 | Data interactive method, system and computer-readable recording medium |
| CN107291633A (en) * | 2017-07-14 | 2017-10-24 | 长沙开雅电子科技有限公司 | A kind of new cluster-based storage write buffer grading management method |
| CN108551490B (en) * | 2018-05-14 | 2021-06-18 | 西京学院 | Industrial stream data coding and decoding system and method |
| CN109446222A (en) * | 2018-08-28 | 2019-03-08 | 厦门快商通信息技术有限公司 | A kind of date storage method of Double buffer, device and storage medium |
| CN111090705B (en) * | 2018-10-23 | 2023-08-25 | 杭州海康威视数字技术股份有限公司 | Multidimensional data processing method, device and equipment and storage medium |
| CN109977129A (en) * | 2019-03-28 | 2019-07-05 | 中国联合网络通信集团有限公司 | Multi-stage data caching method and equipment |
| CN110008143A (en) * | 2019-04-11 | 2019-07-12 | 苏州浪潮智能科技有限公司 | A kind of cache optimization method, device, equipment and computer readable storage medium |
| CN111125025B (en) * | 2019-12-23 | 2023-08-29 | 用友网络科技股份有限公司 | Metadata storage system, metadata storage method, metadata calling device, and readable storage medium |
| CN112115170B (en) * | 2020-09-18 | 2022-12-06 | 苏州浪潮智能科技有限公司 | Metadata caching method, system, equipment and medium |
| CN113761003A (en) * | 2021-04-15 | 2021-12-07 | 北京沃东天骏信息技术有限公司 | User portrait data processing method and device, electronic equipment and readable storage medium |
| CN113157603A (en) * | 2021-04-29 | 2021-07-23 | 上海阵量智能科技有限公司 | Data reading device, method, chip, computer equipment and storage medium |
| CN114296826A (en) * | 2021-12-29 | 2022-04-08 | 中国电信股份有限公司 | Data loading method and device, electronic equipment and nonvolatile storage medium |
| CN114116827B (en) * | 2022-01-28 | 2022-05-17 | 北京华品博睿网络技术有限公司 | Query system and method for user portrait data |
| CN115934583A (en) * | 2022-11-16 | 2023-04-07 | 智慧星光(安徽)科技有限公司 | Hierarchical caching method, device and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102955786A (en) * | 2011-08-22 | 2013-03-06 | 北大方正集团有限公司 | Method and system for caching and distributing dynamic webpage data |
| CN103020151A (en) * | 2012-11-22 | 2013-04-03 | 用友软件股份有限公司 | Large data quantity batch processing system and large data quantity batch processing method |
| CN103218450A (en) * | 2013-04-26 | 2013-07-24 | 国电南瑞科技股份有限公司 | Synchronization method for data in multi-application real-time database |
| CN103530349A (en) * | 2013-09-30 | 2014-01-22 | 乐视致新电子科技（天津）有限公司 | Method and equipment for cache updating |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7080060B2 (en) * | 2003-01-08 | 2006-07-18 | Sbc Properties, L.P. | System and method for intelligent data caching |
| CN100505762C (en) * | 2006-04-19 | 2009-06-24 | 华中科技大学 | Distributed multi-stage buffer storage system suitable for object network storage |
| CN101546282B (en) * | 2008-03-28 | 2011-05-18 | 国际商业机器公司 | Method and device used for writing and copying in processor |
| CN103488581B (en) * | 2013-09-04 | 2016-01-13 | 用友网络科技股份有限公司 | Data buffering system and data cache method |
| CN204926081U (en) * | 2015-06-01 | 2015-12-30 | 北京圆通慧达管理软件开发有限公司 | Data storae system towards multiple utility |
-
2015
- 2015-06-01 CN CN201510293727.8A patent/CN104866434B/en active Active
- 2015-06-01 CN CN201710481856.9A patent/CN107273522B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102955786A (en) * | 2011-08-22 | 2013-03-06 | 北大方正集团有限公司 | Method and system for caching and distributing dynamic webpage data |
| CN103020151A (en) * | 2012-11-22 | 2013-04-03 | 用友软件股份有限公司 | Large data quantity batch processing system and large data quantity batch processing method |
| CN103218450A (en) * | 2013-04-26 | 2013-07-24 | 国电南瑞科技股份有限公司 | Synchronization method for data in multi-application real-time database |
| CN103530349A (en) * | 2013-09-30 | 2014-01-22 | 乐视致新电子科技（天津）有限公司 | Method and equipment for cache updating |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104866434B (en) | 2017-10-03 |
| CN107273522A (en) | 2017-10-20 |
| CN104866434A (en) | 2015-08-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107273522B (en) | Multi-application-oriented data storage system and data calling method | |
| CN107247808B (en) | Distributed NewSQL database system and picture data query method | |
| US11269885B2 (en) | Cache for efficient record lookups in an LSM data structure | |
| JP6356675B2 (en) | Aggregation / grouping operation: Hardware implementation of hash table method | |
| US20100257181A1 (en) | Dynamic Hash Table for Efficient Data Access In A Relational Database System | |
| US7421562B2 (en) | Database system providing methodology for extended memory support | |
| US9652291B2 (en) | System and method utilizing a shared cache to provide zero copy memory mapped database | |
| US8868595B2 (en) | Enhanced control to users to populate a cache in a database system | |
| KR102440128B1 (en) | Memory management divice, system and method for unified object interface | |
| US8386445B2 (en) | Reorganizing database tables | |
| CN107665095B (en) | Apparatus, method and readable storage medium for memory space management | |
| CN109815240B (en) | Method, apparatus, device and storage medium for managing index | |
| US10747773B2 (en) | Database management system, computer, and database management method | |
| US10558636B2 (en) | Index page with latch-free access | |
| CN106407347A (en) | Data caching method and apparatus | |
| WO2023081032A1 (en) | Query-based database redaction | |
| EP3457287A1 (en) | Hierarchical virtual file systems for accessing data sets | |
| KR20190123819A (en) | Method for managing of memory address mapping table for data storage device | |
| KR102214697B1 (en) | A computer program for providing space managrment for data storage in a database management system | |
| US8463781B1 (en) | Pre-fetch of records identified by an index record | |
| CN204926081U (en) | Data storae system towards multiple utility | |
| CN109739874A (en) | Method, apparatus, computer equipment and the storage medium of data content are provided | |
| KR20210013747A (en) | A computer program for providing space managrment for data storage in a database management system | |
| CN116955364A (en) | Block chain-based data storage method, equipment and storage medium | |
| CN117056964A (en) | Private information retrieval method based on trusted execution environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |