CN105573673A - Database based data cache system - Google Patents
Database based data cache system Download PDFInfo
- Publication number
- CN105573673A CN105573673A CN201510932022.6A CN201510932022A CN105573673A CN 105573673 A CN105573673 A CN 105573673A CN 201510932022 A CN201510932022 A CN 201510932022A CN 105573673 A CN105573673 A CN 105573673A
- Authority
- CN
- China
- Prior art keywords
- layer
- data
- level
- order
- cache
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a database based data cache system. The system comprises a first level cache layer established in a database and used for caching data, a first level storage layer connected with the first level cache layer and used for storing data of the first level cache layer and a first level interface layer, the first level interface layer connected with the first level cache layer and used for conveniently extracting and inputting data of the first storage layer, a second level cache layer connected with the first interface layer and used for caching the data of the first level storage layer, a second level storage layer connected with the second level cache layer and used for storing data of the second level cache layer and a second level interface layer, the second level interface layer connected with the second level storage layer and used for extracting and inputting a second data layer by the outside, and a file system used for providing the stored data and the extracted data. The system has the beneficial effects that the data grading storage is realized, the data storage and calling efficiency is improved, and the difficulty in database development is lowered.
Description
Technical field
The present invention relates to database technical field, in particular, relate to a kind of data buffering system based on database.
Background technology
Along with developing rapidly of computer networking technology, the application of switch device is also increasingly extensive, also from strength to strength, configuration information also becomes and becomes increasingly complex the function that switch is supported, therefore it is also proposed higher requirement to the store and management of configuration datas all on switch.
At present to configuration data switch needing preserve, generally in a binary fashion, be stored in NVRAM (Non-VolatileRandomAccessMemory, the nonvolatile random access memory) equipment of hardware with certain data layout tissue.In existing switch system, the management of usual configuration data oneself is responsible for by each functional module, and each self-defining data mode disunity, easily causes the redundancy of configuration.Such as, one of them functional module needs to preserve each port and switching-state information corresponding to port, can define one group one to one data layout to store this configuration, and another functional module also need to preserve each port with corresponding other another organize the information of attribute, therefore also save another group configuration according to the form of this functional module oneself definition, so just easily cause configuration data disunity, unreasonable structure, and create redundancy, waste storage space again simultaneously.Be in charge of by upper layer application during existing configuration read-write, oneself definition module needs the configuration of preserving to read and write simultaneously, brings great inconvenience, because upper layer application developer to like this upper layer application developer.
When resolving configuration data, need to know certain concrete configuration by what form is deposited, and is stored in which position etc., when referring more particularly to the relevant configuration item of other modules mutual, also need the configuration organized formats considering other modules simultaneously, further increase the difficulty of exploitation.
Summary of the invention
Technical matters to be solved by this invention is to provide a kind of data buffering system based on database, realizes multi-level storage and the quick calling of data.
The technical scheme that the present invention solves the problems of the technologies described above is as follows: a kind of data buffering system based on database, and it comprises: file system, SQL statement analytic sheaf, the first data memory module and the second data memory module;
Described first data memory module comprises first order cache layer, first order accumulation layer and first order interface layer;
Described second data memory module comprises second level cache layer, second level accumulation layer and Second Committee interface layer;
The first order cache layer of described first data memory module, for data cached; The first order accumulation layer be connected with first order cache layer, for storing the data of first order cache layer and first order interface layer; The first order interface layer be connected with first order cache layer, for the convenient extraction to the first accumulation layer data and input;
The second level cache layer of described second data memory module, it is connected with first interface layer, for the data of buffer memory first order accumulation layer; The second level accumulation layer be connected with second level cache layer, for storing the data of second level cache layer and interface layer; The second level interface layer be connected with second level accumulation layer, for extraction and the input of outer bound pair second layer data Layer;
Described file system is connected with first order cache layer, the second cache layer and first order interface layer, second level interface layer and provides respectively and stores data and extract data;
Parsing between described SQL statement analytic sheaf adjustment first order accumulation layer and second level accumulation layer data and reading.
Of the present invention based in the data buffering system of database, described first order accumulation layer is configured with multiple storage space and stores data.
Of the present invention based in the data buffering system of database, described second level accumulation layer is configured with multiple storage space and stores data.
Beneficial effect of the present invention: the classification realizing data stores, and improves the storage efficiency of data and calls efficiency, reducing the development difficulty of database.
Accompanying drawing explanation
Fig. 1 is one-piece construction schematic diagram of the present invention.
Embodiment
Be described principle of the present invention and feature below in conjunction with accompanying drawing, example, only for explaining the present invention, is not intended to limit scope of the present invention.
As shown in Figure 1, a kind of data buffering system based on database, it comprises: file system, SQL statement analytic sheaf, the first data memory module and the second data memory module;
Described first data memory module comprises first order cache layer, first order accumulation layer and first order interface layer;
Described second data memory module comprises second level cache layer, second level accumulation layer and Second Committee interface layer;
The first order cache layer of described first data memory module, for data cached; The first order accumulation layer be connected with first order cache layer, for storing the data of first order cache layer and first order interface layer; The first order interface layer be connected with first order cache layer, for the convenient extraction to the first accumulation layer data and input;
The second level cache layer of described second data memory module, it is connected with first interface layer, for the data of buffer memory first order accumulation layer; The second level accumulation layer be connected with second level cache layer, for storing the data of second level cache layer and interface layer; The second level interface layer be connected with second level accumulation layer, for extraction and the input of outer bound pair second layer data Layer;
Described file system is connected with first order cache layer, the second cache layer and first order interface layer, second level interface layer and provides respectively and stores data and extract data;
Parsing between described SQL statement analytic sheaf adjustment first order accumulation layer and second level accumulation layer data and reading.
Of the present invention based in the data buffering system of database, described first order accumulation layer is configured with multiple storage space and stores data.
Of the present invention based in the data buffering system of database, described second level accumulation layer is configured with multiple storage space and stores data.
Data buffering system based on database of the present invention, data are stored into first order memory module by described file system, and Data Analysis is stored in the memory module of the second level by SQL statement analytic sheaf by data as required.
Compared with prior art, beneficial effect of the present invention: the classification realizing data stores, and improves the storage efficiency of data and calls efficiency, reducing the development difficulty of database.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (3)
1. based on a data buffering system for database, it is characterized in that, it comprises: file system, SQL statement analytic sheaf, the first data memory module and the second data memory module;
Described first data memory module comprises first order cache layer, first order accumulation layer and first order interface layer;
Described second data memory module comprises second level cache layer, second level accumulation layer and Second Committee interface layer;
The first order cache layer of described first data memory module, for data cached; The first order accumulation layer be connected with first order cache layer, for storing the data of first order cache layer and first order interface layer; The first order interface layer be connected with first order cache layer, for the convenient extraction to the first accumulation layer data and input;
The second level cache layer of described second data memory module, it is connected with first interface layer, for the data of buffer memory first order accumulation layer; The second level accumulation layer be connected with second level cache layer, for storing the data of second level cache layer and interface layer; The second level interface layer be connected with second level accumulation layer, for extraction and the input of outer bound pair second layer data Layer;
Described file system is connected with first order cache layer, the second cache layer and first order interface layer, second level interface layer and provides respectively and stores data and extract data;
Parsing between described SQL statement analytic sheaf adjustment first order accumulation layer and second level accumulation layer data and reading.
2. according to claim 1 based on the data buffering system of database, it is characterized in that, described first order accumulation layer is configured with multiple storage space and stores data.
3. according to claim 1 based on the data buffering system of database, it is characterized in that, described second level accumulation layer is configured with multiple storage space and stores data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510932022.6A CN105573673A (en) | 2015-12-11 | 2015-12-11 | Database based data cache system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510932022.6A CN105573673A (en) | 2015-12-11 | 2015-12-11 | Database based data cache system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105573673A true CN105573673A (en) | 2016-05-11 |
Family
ID=55883867
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510932022.6A Pending CN105573673A (en) | 2015-12-11 | 2015-12-11 | Database based data cache system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105573673A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107025075A (en) * | 2016-01-31 | 2017-08-08 | 浙江智源办公设备制造有限公司 | A kind of toy manufacture method |
| CN107291390A (en) * | 2017-06-20 | 2017-10-24 | 郑州云海信息技术有限公司 | A kind of data classification storage and device |
| CN112000287A (en) * | 2020-08-14 | 2020-11-27 | 北京浪潮数据技术有限公司 | IO request processing device, method, equipment and readable storage medium |
| CN112115170A (en) * | 2020-09-18 | 2020-12-22 | 苏州浪潮智能科技有限公司 | Metadata caching method, system, equipment and medium |
| CN113742290A (en) * | 2021-11-04 | 2021-12-03 | 上海闪马智能科技有限公司 | Data storage method and device, storage medium and electronic device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102841854A (en) * | 2011-05-20 | 2012-12-26 | 国际商业机器公司 | Method and system for executing data reading based on dynamic hierarchical memory cache (hmc) awareness |
| CN103593460A (en) * | 2013-11-25 | 2014-02-19 | 方正国际软件有限公司 | Data hierarchical storage system and data hierarchical storage method |
| CN103914516A (en) * | 2014-02-25 | 2014-07-09 | 深圳市中博科创信息技术有限公司 | Method and system for layer-management of storage system |
| CN104991817A (en) * | 2015-06-25 | 2015-10-21 | 国网山东省电力公司 | Configurable integration method and system for information system |
-
2015
- 2015-12-11 CN CN201510932022.6A patent/CN105573673A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102841854A (en) * | 2011-05-20 | 2012-12-26 | 国际商业机器公司 | Method and system for executing data reading based on dynamic hierarchical memory cache (hmc) awareness |
| CN103593460A (en) * | 2013-11-25 | 2014-02-19 | 方正国际软件有限公司 | Data hierarchical storage system and data hierarchical storage method |
| CN103914516A (en) * | 2014-02-25 | 2014-07-09 | 深圳市中博科创信息技术有限公司 | Method and system for layer-management of storage system |
| CN104991817A (en) * | 2015-06-25 | 2015-10-21 | 国网山东省电力公司 | Configurable integration method and system for information system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107025075A (en) * | 2016-01-31 | 2017-08-08 | 浙江智源办公设备制造有限公司 | A kind of toy manufacture method |
| CN107025075B (en) * | 2016-01-31 | 2020-02-04 | 浙江智源办公设备制造有限公司 | Toy manufacturing method |
| CN107291390A (en) * | 2017-06-20 | 2017-10-24 | 郑州云海信息技术有限公司 | A kind of data classification storage and device |
| CN107291390B (en) * | 2017-06-20 | 2020-05-15 | 苏州浪潮智能科技有限公司 | Data hierarchical storage method and device |
| CN112000287A (en) * | 2020-08-14 | 2020-11-27 | 北京浪潮数据技术有限公司 | IO request processing device, method, equipment and readable storage medium |
| CN112000287B (en) * | 2020-08-14 | 2022-06-17 | 北京浪潮数据技术有限公司 | IO request processing device, method, equipment and readable storage medium |
| CN112115170A (en) * | 2020-09-18 | 2020-12-22 | 苏州浪潮智能科技有限公司 | Metadata caching method, system, equipment and medium |
| CN112115170B (en) * | 2020-09-18 | 2022-12-06 | 苏州浪潮智能科技有限公司 | Metadata caching method, system, equipment and medium |
| CN113742290A (en) * | 2021-11-04 | 2021-12-03 | 上海闪马智能科技有限公司 | Data storage method and device, storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105573673A (en) | Database based data cache system | |
| CN102541927B (en) | Method and device for realizing data cache | |
| CN105183839A (en) | Hadoop-based storage optimizing method for small file hierachical indexing | |
| CN103577339A (en) | Method and system for storing data | |
| CN103810237A (en) | Data management method and system | |
| CN104809237A (en) | LSM-tree (The Log-Structured Merge-Tree) index optimization method and LSM-tree index optimization system | |
| CN101221538B (en) | System and method for implementing fast data search in caching | |
| CN105787012B (en) | A kind of method and storage system improving storage system processing small documents | |
| CN104021145A (en) | Mixed service concurrent access method and device | |
| CN105117351A (en) | Method and apparatus for writing data into cache | |
| CN105550246B (en) | The system and method for load networks picture under Android platform | |
| CN103412826A (en) | Garbage collection method and system of solid state disk | |
| CN103914483A (en) | File storage method and device and file reading method and device | |
| CN103647850A (en) | Data processing method, device and system of distributed version control system | |
| CN104504158A (en) | Memory caching method and device for rapidly updating business | |
| CN103049393B (en) | Memory headroom management method and device | |
| CN107729504A (en) | A kind of method and system for handling large data objectses | |
| CN110543435B (en) | Mixed mapping operation method, device and equipment of storage unit and storage medium | |
| CN106170776A (en) | For using, there is the invalid bandwidth read in reduction cache memory and the method and apparatus of power | |
| CN105574124A (en) | Data storage system based on product information | |
| CN102169497A (en) | Method and device for managing metadata through bitmaps | |
| CN102650972A (en) | Data storage method, device and system | |
| CN102737171B (en) | Method and device for storing virus file and storage equipment | |
| CN103207916A (en) | Metadata processing method and device | |
| CN105808451A (en) | Data caching method and related apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160511 |