CN110502335A - Distributed data base multilevel memory managing device - Google Patents
Distributed data base multilevel memory managing device Download PDFInfo
- Publication number
- CN110502335A CN110502335A CN201910505621.8A CN201910505621A CN110502335A CN 110502335 A CN110502335 A CN 110502335A CN 201910505621 A CN201910505621 A CN 201910505621A CN 110502335 A CN110502335 A CN 110502335A
- Authority
- CN
- China
- Prior art keywords
- memory
- administrative unit
- management
- unit
- level
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of distributed data base multilevel memory managing devices, including Memory Allocation administrative unit, memory partitioning unit, memory chain type administrative unit and memory to eliminate administrative unit；Memory Allocation management module includes level-one memory management unit and secondary memory administrative unit；The target memory that level-one memory management unit should be managed for the releasing memory from operating system and the distribution secondary memory administrative unit；Secondary memory administrative unit is used to carry out the target memory of level-one memory management unit respectively application and release management；Memory partitioning unit is that memory is divided into the different memory of how many memory size according to program size；Memory chain type administrative unit includes unallocated management chain, using management chain and superseded free chain；It is superseded for carrying out to the data of memory that memory eliminates administrative unit.The present invention improves memory usage and effective rate of utilization, meets the demand that growing data scale and user store data and handle.
Description
Technical field
The present invention relates to memory management technology fields, and in particular to a kind of distributed data base multilevel memory managing device.
Background technique
The memory management of distributed data base management system (DDBMS) is different from the memory management of general application program, because being related to
The access and processing of mass data because of the huge of data and increase scale, as a consequence it is hardly possible to all data all loaded into memory,
But can not all data all read from disk, such speed can be very slow, and it is long-time that Database Systems, which externally provide service,
It is continual, system release resource cannot be restarted at any time, therefore the management of memory is extremely important.Currently, memory management device is all
It is automatic memory management, the initial memory amount for needing that practical amount of ram is waited to be reached for program distribution in program operation process
When, memory use can be just obtained, and it also requires approachability analysis is carried out to object used in program, and in approachability analysis
Phenomena such as time for doing temporary is longer, leads to Caton.
Summary of the invention
The purpose of the present invention is to provide a kind of distributed data base multilevel memory managing devices, and the arrangement increases memories
Utilization rate and effective rate of utilization meet the demand that growing data scale and user store data and handle.
To achieve the above object, the present invention is achieved by the following technical solutions:
Distributed data base multilevel memory managing device, including Memory Allocation administrative unit, memory partitioning unit, memory chain
Formula administrative unit and memory eliminate administrative unit；
The Memory Allocation management module includes level-one memory management unit and secondary memory administrative unit；In the level-one
It deposits administrative unit and is used for the target that releasing memory and the distribution secondary memory administrative unit should manage from operating system
Memory；The secondary memory administrative unit is used to carry out application to the target memory of level-one memory management unit respectively and discharges pipe
Reason；
The memory partitioning unit is that memory is divided into the different memory of how many memory size according to program size；
The memory chain type administrative unit includes unallocated management chain, using management chain and superseded free chain；
It is superseded for carrying out to the data of memory that the memory eliminates administrative unit.
Further, further include memory block administrative unit, for internally deposit into row block avoid other routine access or
Modify the data on memory.
Further, the memory block administrative unit is that each memory is previously inserted into buffer area, by institute
It states buffer area and carries out lock management, realize the block to memory.
Further, memory is divided into different three kinds of memory size by the memory partitioning unit according to program size
It deposits, is level-one memory, secondary memory and three-level memory respectively, level-one memory can be split as two secondary memories or a three-level
Memory, secondary memory can be split as two three-level memories；It is each it is described in save as use state and unallocated state, will use
The links of state are using management chain, by unappropriated links in unallocated management chain.
Further, the memory eliminates administrative unit and superseded memory chain is connected in superseded free chain, and often eliminates
Four three-level blocks eliminate a second-order block；It often eliminates three second-order blocks and eliminates a level-one block.
Further, the Memory Allocation management module further includes emergency storage scheduling unit, for tight in memory source
The program of memory is needed to use the Memory Allocation in superseded free chain when opening.
The invention has the following advantages:
(1) it by setting level-one memory management unit and secondary memory administrative unit, realizes that multilevel memory independently distributes and mentions
Rise the allocative efficiency of memory source；
(2) memory is divided by three kinds of different memories of memory size by setting memory partitioning unit；Fining is multistage
The resource rational utilization rate of memory size raising memory；
(3) by setting memory chain type administrative unit managing internal memory, chain type management is that the management of memory is provided convenience, side
Just dynamic capacity-expanding；
(4) the reuse rate that the scientific and reasonable eliminative mechanism of administrative unit promotes memory source is eliminated by setting memory；
(5) administrative unit is blocked by setting memory, guarantees that the exclusive of memory block makes using unique block administrative mechanism
With；
(6) by setting emergency storage scheduling unit, guarantee system to provide effective scheduling memory strategy when memory anxiety
Efficient operation.
Specific embodiment
Distributed data base multilevel memory managing device provided in this embodiment, including Memory Allocation administrative unit, memory
Division unit, memory chain type administrative unit, memory eliminate administrative unit and memory blocks administrative unit.
The Memory Allocation management module includes level-one memory management unit and secondary memory administrative unit；In the level-one
It deposits administrative unit and is used for the target that releasing memory and the distribution secondary memory administrative unit should manage from operating system
Memory；The secondary memory administrative unit is used to carry out application to the target memory of level-one memory management unit respectively and discharges pipe
Reason；By being classified distribution management respectively, memory source allocative efficiency can be effectively promoted.
The memory partitioning unit is that memory is divided into the different memory of how many memory size according to program size；According to
Different application requests the memory size of demand different, in multilevel memory distribution, initializes and advises memory by size
Lattice are divided into a certain number of three-level memory blocks, secondary memory block, a large amount of level-one memory block, and work as three-level block and second-order block not
When being enough completely in use state or in the state of eliminating, part primary memory block can be split into a collection of three-level memory block,
Or a collection of secondary memory block, so that the program of request memory uses, but there is an exactly level-one block that cannot be split into simultaneously
Second-order block and three-level block are simultaneously deposited, this is for the considerations of facilitating unified management.
The memory chain type administrative unit includes unallocated management chain, using management chain and superseded free chain；It is initialized
Memory block afterwards all enters the unallocated management chain of memory, and the memory for distributing to program charges to memory using management chain, and program is eliminated
The memory of release enters memory and eliminates free chain, and memory all enters chain type management, avoids losing, and can be according to the memory of program
The increase dynamic of demand increases new memory block to program from chained list.
It is superseded for carrying out to the data of memory that the memory eliminates administrative unit；Memory request be that program temporarily makes
With distributing to and used after program releasable immediately, reused for other programs；And some memory requests need to appoint with entire
It is engaged in life cycle, can just be discharged until entire task finishes；The memory having again can be used only until always line along with some thread
The extinction of journey can be just recovered, and mass data can be loaded into memory for inquiring and modifying, referred to as by distributed data base management system (DDBMS)
For dsc data, a large amount of memory is occupied in this way, so needing to eliminate memory for less common data, frequently-used data is stationed
In memory, program operational efficiency can be improved, the present embodiment according to the importance for the data for using memory and will use frequent degree,
Data by memory and thereon are divided into level-one and eliminate the superseded block of block, second level and the superseded block of three-level；And it often eliminates in four three-levels
Counterfoil eliminates a secondary memory block；It often eliminates three secondary memory blocks and eliminates a level-one memory block；It avoids occurring only eliminating
Rudimentary piece, without eliminating high-level block, ensure that the reasonable of memory is eliminated.
The memory block administrative unit avoids on other routine access or modification memory for internally depositing into row block
Each memory is specifically previously inserted into buffer area by data, by carrying out lock management to the buffer area, is realized internal
The block deposited；Memory, according to the demand some need exclusive use of application, is needed to lock on memory and is avoided with data thereon
The data of other routine access modification thereon, the buffer area lock management mechanism that the present embodiment uses original creation replace monolith memory
It locks, buffer area is combined with memory, and lock management module is included in buffer area, other programs are because having lock on access discovery buffer area
Without accessing memory block corresponding with buffer area, that is, system lock resource is saved, and improve efficiency.
The Memory Allocation management module further includes emergency storage scheduling unit, for that will eliminate in memory source anxiety
Memory Allocation in free chain is needed the program of memory to use；When program is repeatedly applied for memory and is unable to satisfy, system is sentenced
Determine memory source anxiety, into emergency memorymodel state, what the memory after use no longer did not release immediately, and take and urge
The Memory Allocation freely eliminated in chain is given the program for needing memory by also mechanism, and takes a variety of methods such as superseded arrangement reserved
Enough memories supply required program internal memory demand, provide enough memories for the specific memory requirements such as sequence and guarantee program
Effectively quickly operation；Memory Allocation speed may slow down, and level-one Memory Allocation administrative unit can search that whether there is or not programs to release newly
Memory, and be included in unallocated management chain and distribute to memory request program.
The above is only the preferred embodiment of the present invention, but scope of protection of the present invention is not limited thereto, any
The transformation and replacement carried out based on technical solution provided by the present invention and inventive concept should all be covered in protection model of the invention
In enclosing.
Claims (6)
1. distributed data base multilevel memory managing device, it is characterised in that: divided including Memory Allocation administrative unit, memory single
Member, memory chain type administrative unit and memory eliminate administrative unit；
The Memory Allocation management module includes level-one memory management unit and secondary memory administrative unit；The level-one memory pipe
The target memory that reason unit should be managed for the releasing memory from operating system and the distribution secondary memory administrative unit；
The secondary memory administrative unit is used to carry out the target memory of level-one memory management unit respectively application and release management；
The memory partitioning unit is that memory is divided into the different memory of how many memory size according to program size；
The memory chain type administrative unit includes unallocated management chain, using management chain and superseded free chain；
It is superseded for carrying out to the data of memory that the memory eliminates administrative unit.
2. distributed data base multilevel memory managing device according to claim 1, it is characterised in that: further include memory envelope
Administrative unit is locked, blocks the data for avoiding other routine access or modifying on memory for internally depositing into row.
3. distributed data base multilevel memory managing device according to claim 2, it is characterised in that: the memory block
Administrative unit is that each memory is previously inserted into buffer area, by carrying out lock management to the buffer area, is realized internal
The block deposited.
4. distributed data base multilevel memory managing device according to claim 1, it is characterised in that: the memory divides
Memory is divided into three kinds of different memories of memory size according to program size by unit, be respectively level-one memory, secondary memory and
Three-level memory, level-one memory, which can be split as two secondary memories or a three-level memory, secondary memory, can be split as two
Three-level memory；It is each it is described in save as use state and unallocated state, by the links of use state using manage chain,
By unappropriated links in unallocated management chain.
5. distributed data base multilevel memory managing device according to claim 4, it is characterised in that: the memory is eliminated
Superseded memory chain is connected in and eliminates in free chain by administrative unit, and often eliminates four three-level blocks, eliminates a second-order block；Often wash in a pan
It eliminates three second-order blocks and eliminates a level-one block.
6. distributed data base multilevel memory managing device according to claim 5, it is characterised in that: the Memory Allocation
Management module further includes emergency storage scheduling unit, for giving the Memory Allocation in superseded free chain in memory source anxiety
The program of memory is needed to use.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910505621.8A CN110502335A (en) | 2019-06-12 | 2019-06-12 | Distributed data base multilevel memory managing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910505621.8A CN110502335A (en) | 2019-06-12 | 2019-06-12 | Distributed data base multilevel memory managing device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110502335A true CN110502335A (en) | 2019-11-26 |
Family
ID=68585796
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910505621.8A Pending CN110502335A (en) | 2019-06-12 | 2019-06-12 | Distributed data base multilevel memory managing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110502335A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112380017A (en) * | 2020-11-30 | 2021-02-19 | 成都虚谷伟业科技有限公司 | Memory management system based on loose memory release |
| CN115344507A (en) * | 2021-05-14 | 2022-11-15 | 华为技术有限公司 | Memory allocation method, device and system |
| CN117591293A (en) * | 2023-12-01 | 2024-02-23 | 深圳计算科学研究院 | Memory management method, memory management device, computer equipment and computer readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1427342A (en) * | 2001-12-21 | 2003-07-02 | 上海贝尔有限公司 | Internal storage management system and its distribution method |
| CN101110044A (en) * | 2007-08-28 | 2008-01-23 | 中兴通讯股份有限公司 | Method and system for internal memory monitoring management |
| CN101493787A (en) * | 2009-02-18 | 2009-07-29 | 中兴通讯股份有限公司 | Internal memory operation management method and system |
| CN102915276A (en) * | 2012-09-25 | 2013-02-06 | 武汉邮电科学研究院 | Memory control method for embedded systems |
| CN105589809A (en) * | 2014-10-24 | 2016-05-18 | 中国科学院深圳先进技术研究院 | Memory management method and device |
| CN106970881A (en) * | 2017-03-10 | 2017-07-21 | 浙江大学 | The one cold and hot page based on big page is followed the trail of and pressure recovery method |
-
2019
- 2019-06-12 CN CN201910505621.8A patent/CN110502335A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1427342A (en) * | 2001-12-21 | 2003-07-02 | 上海贝尔有限公司 | Internal storage management system and its distribution method |
| CN101110044A (en) * | 2007-08-28 | 2008-01-23 | 中兴通讯股份有限公司 | Method and system for internal memory monitoring management |
| CN101493787A (en) * | 2009-02-18 | 2009-07-29 | 中兴通讯股份有限公司 | Internal memory operation management method and system |
| CN102915276A (en) * | 2012-09-25 | 2013-02-06 | 武汉邮电科学研究院 | Memory control method for embedded systems |
| CN105589809A (en) * | 2014-10-24 | 2016-05-18 | 中国科学院深圳先进技术研究院 | Memory management method and device |
| CN106970881A (en) * | 2017-03-10 | 2017-07-21 | 浙江大学 | The one cold and hot page based on big page is followed the trail of and pressure recovery method |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112380017A (en) * | 2020-11-30 | 2021-02-19 | 成都虚谷伟业科技有限公司 | Memory management system based on loose memory release |
| CN112380017B (en) * | 2020-11-30 | 2024-04-09 | 成都虚谷伟业科技有限公司 | Memory management system based on loose memory release |
| CN115344507A (en) * | 2021-05-14 | 2022-11-15 | 华为技术有限公司 | Memory allocation method, device and system |
| CN117591293A (en) * | 2023-12-01 | 2024-02-23 | 深圳计算科学研究院 | Memory management method, memory management device, computer equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110502335A (en) | Distributed data base multilevel memory managing device | |
| CN101493787B (en) | Internal memory operation management method and system | |
| CN104915151B (en) | A kind of memory excess distribution method that active is shared in multi-dummy machine system | |
| CN105049268B (en) | Distributed computing resource distribution system and task processing method | |
| US20110246742A1 (en) | Memory pooling in segmented memory architecture | |
| CN1174323C (en) | Method of managing shared memory | |
| US20080243966A1 (en) | System and method for managing temporary storage space of a database management system | |
| US7908454B2 (en) | Application-specific heap management | |
| CN107544756B (en) | Key-Value log type local storage method based on SCM | |
| CN101221536A (en) | Internal memory managing method and device of embedded system | |
| CN101196832B (en) | Resource proxy machine facing illumination variant equipment | |
| CN105095094A (en) | Memory management method and equipment | |
| CN104573112B (en) | Page interrogation method and data processing node in OLTP Cluster Databases | |
| CN109086301A (en) | A kind of data management platform based on cloud computing | |
| CN109445565B (en) | GPU service quality guarantee method based on monopolization and reservation of kernel of stream multiprocessor | |
| CN110727517A (en) | Memory allocation method and device based on partition design | |
| US10338965B2 (en) | Managing a set of resources | |
| CN104077266B (en) | Many kernel operating system implementation methods and realize apparatus and system | |
| CN102567096A (en) | Mutual-exclusion semaphore management method for preventing deadlock under multi-task environment | |
| CN1326567A (en) | Job-parallel processor | |
| CN102855137B (en) | Methods and procedures design system for the programming of automation component | |
| CN102375780B (en) | Metadata cache management method in distributed file system | |
| CN108595259A (en) | A kind of internal memory pool managing method based on global administration | |
| US7188113B1 (en) | Reducing contention by slaves for free lists when modifying data in a table partition | |
| CN102541654A (en) | Efficient memory management method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |