CN108984129A - A kind of software and hardware two-stage internal storage data storage method - Google Patents
A kind of software and hardware two-stage internal storage data storage method Download PDFInfo
- Publication number
- CN108984129A CN108984129A CN201810823758.3A CN201810823758A CN108984129A CN 108984129 A CN108984129 A CN 108984129A CN 201810823758 A CN201810823758 A CN 201810823758A CN 108984129 A CN108984129 A CN 108984129A
- Authority
- CN
- China
- Prior art keywords
- data
- nearly
- virtual address
- memory devices
- address space
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0665—Virtualisation aspects at area level, e.g. provisioning of virtual or logical volumes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a kind of software and hardware two-stage internal storage data storage methods, data are stored on nearly memory devices and remote memory devices, wherein the access latency of nearly memory devices is less than the access latency of remote memory devices, nearly memory devices store data in the data cell with the address in nearly memory virtual address space, and remote memory devices store data in the data cell with the address in remote memory address space, a portion data are stored in nearly memory address space, remote storage equipment is in response to memory read access request, determine that the data for corresponding to the request are located on nearly memory devices, and if it is, then data are read from nearly memory devices；Otherwise, data are read from remote memory devices.The present invention can maximumlly carry out the distribution of Internet resources.
Description
Technical field
The present invention relates to computer application technology more particularly to a kind of software and hardware two-stage internal storage data storage methods.
Background technique
In the past few years, the availability and usage amount of cloud computing exponentially increase, under traditional calculation method,
User on your own computer runs software application program and/or by local server trustship access software service (such as
By the server of enterprise operation), on the contrary, calculating under cloud computing and storage resource being " in cloud ", it means that they are by object
Reason ground trustship is on the remote equipment accessed by computer network (such as internet), the calculating and storage of the trustship of cloud operator
Resource can be accessed by " service ", these services service, Web service or simple services commonly known as based on cloud.Base
In cloud service usually by data center's trustship, data center includes the physics peace for forming the server of specific part of cloud or cloud
Row.Data center generallys use the physical level of calculating, network and shared storage resource, to support the reduction of workload demands.
But for maximum resource distribution in existing network data, operator needs to track which resource can be used in which rack
In resource allocation, man power and material is consumed.
Technical solution
The invention mainly solves the technical problem of providing a kind of software and hardware two-stage internal storage data storage method, feature exists
In, including computer platform, the computer platform include be operatively coupled to one or more nearly memory devices and
It can be via the processor of the one or more remote memory devices of the structural reference, wherein when the access of nearly memory devices waits
Between the less access latency for remote memory devices, in the memory in one or more nearly memory devices at least
A part of data storage unit, the data cell is with the address in nearly memory virtual address space and one
Or the remote memory devices of at least part memory in multiple memories are stored data in remote memory virtual address
In the data cell of address in space；Store data in the data sheet with the address in nearly memory virtual address space
In member and in the data cell with the address in remote memory virtual address space, a part of the data of storage is stored in
In data cell in nearly memory virtual address space, remote memory virtual address space is in response to including accessing with storage
Data the corresponding virtual memory address of data cell memory read access request, determine whether data are stored in closely
In memory devices, if it is, accessing data from nearly memory devices, data are accessed from remote memory devices in addition to this.
Optionally, it monitors the access module of the data in remote memory virtual address space, and is based on access module,
By accessing the data cell from remote memory storage devices, and by the data cell from remote memory virtual address space
Copy to nearly memory virtual address space.
Optionally, multiple processes are executed on a processor, and service class is distributed to at least part of multiple processes, and
And it at least partially determines and whether is copied to data cell closely from remote memory virtual address space based on the rank of rank
In memory virtual address space.
The beneficial effects of the present invention are:
A kind of software and hardware two-stage internal storage data storage method of the invention can maximumlly carry out point of Internet resources
Match.
Detailed description of the invention
Fig. 1 is the schematic diagram according to rack scale design (RSD) configuration in data center.
Embodiment
The preferred embodiments of the present invention will be described in detail below so that advantages and features of the invention can be easier to by
It will be appreciated by those skilled in the art that so as to make a clearer definition of the protection scope of the present invention.
RSD is worked together using calculating, fabric, storage and management module, to realize that the optional of various virtual systems is matched
It sets, the POD manager (PODM) including 1) being used for multi-frame management, including firmware and software application interface (API), energy
It enough realizes resource and tactical management, and hardware and orchestration layer above is exposed by standard interface；2) calculating collected
System, network and can be based on the storage resource that workload demands selectively store；3) POD established in connection storage is wide
Domain storage uses storage algorithm to support the range for the purposes disposed as multi-frame resource or storage hardware, and has local
The calculate node of storage；4) the programmable hardware net structure of C, interconnection and management software with cable and backboard, to support
Extensive cost-benefit network topology structure, including current top bay switch designs and distribution switch in platform
On.
As shown in Figure 1, including multiple computer racks 202 in RSD environment, each computer rack includes frame top switch
204, gondola manager 206 and multiple system drawers collected, in general, the system drawer collected may include that the calculating collected is taken out
Drawer and the storage drawer collected, optionally, the system drawer collected can also include the memory drawer collected and collect defeated
Enter/export (I/O) drawer.In the illustrated embodiment, the system drawer collected includesCollect computer
208 He of drawerCollect and calculates drawer 210, collect storage drawer 212, collect memory drawer 214 and converge
Collect I/O drawer 216.Each of system drawer collected is connected to switch 204, such as 40 gigabits/second by high-speed link 218
(GB/s) or 100Gb/s ethernet link or 100+Gb/s silicon photonics (SIPH) optical link.In one embodiment, high-speed chain
Road 218 includes 800Gb/s SiPH optical link.Multiple computer racks 200 can be interconnected by their switch 204 (for example, arriving
POD level switch or data center switchboard), as by the way that shown in the connection with network 220, computer rack group 202 is managed by POD
Device (S) 206 is managed to manage as individual POD.In one embodiment, it is managed using single POD manager all in POD
Rack, distributed POD manager can be used for POD management operation, and RSD environment 200 further includes for managing each of RSD environment
The management interface 222 of aspect.This includes management rack configuration, stores the relevant parameter as rack configuration data 224.
The sequencing of above embodiments is not only for ease of description, represent the advantages or disadvantages of the embodiments.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used
To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features；
And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit and
Range.
Claims (3)
1. a kind of software and hardware two-stage internal storage data storage method, which is characterized in that including computer platform, the computer platform
Including being operatively coupled to one or more nearly memory devices and can far be deposited via the structural reference is one or more
The processor of storage device, wherein the less access for remote memory devices of the access latency of nearly memory devices waits
Time, at least part data storage unit in memory in one or more nearly memory devices, the data cell
At least part storage with the address in nearly memory virtual address space and in one or more of memories
The remote memory devices of device store data in the data cell with the address in remote memory virtual address space；By data
It is stored in the data cell with the address in nearly memory virtual address space and has remote memory virtual address empty
Between in address data cell in, a part of the data of storage is stored in the data sheet in nearly memory virtual address space
In member, remote memory virtual address space is in response to including that the data cell for the data to be accessed is corresponding virtually deposits with storage
The memory read access request of memory address, determines whether data are stored in nearly memory devices, if it is, from nearly storage
Device equipment accesses data, accesses data from remote memory devices in addition to this.
2. a kind of software and hardware two-stage internal storage data storage method according to claim 1, it is characterised in that: monitoring is remotely deposited
The access module of data in reservoir virtual address space, and it is based on access module, it is set by accessing from remote memory
Standby data cell, and the data cell from remote memory virtual address space is copied into nearly memory virtual address sky
Between.
3. a kind of software and hardware two-stage internal storage data storage method according to claim 2, it is characterised in that: on a processor
Multiple processes are executed, service class is distributed to at least part of multiple processes, and at least partially determines and whether is based on
The rank of rank copies to data cell in nearly memory virtual address space from remote memory virtual address space.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810823758.3A CN108984129A (en) | 2018-07-25 | 2018-07-25 | A kind of software and hardware two-stage internal storage data storage method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810823758.3A CN108984129A (en) | 2018-07-25 | 2018-07-25 | A kind of software and hardware two-stage internal storage data storage method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108984129A true CN108984129A (en) | 2018-12-11 |
Family
ID=64550438
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810823758.3A Pending CN108984129A (en) | 2018-07-25 | 2018-07-25 | A kind of software and hardware two-stage internal storage data storage method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108984129A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130132681A1 (en) * | 2011-11-22 | 2013-05-23 | Microsoft Corporation | Temporal standby list |
| CN103744799A (en) * | 2013-12-26 | 2014-04-23 | 华为技术有限公司 | Memory data access method, device and system |
| CN104798033A (en) * | 2012-12-28 | 2015-07-22 | 英特尔公司 | Apparatus and method for a hybrid latency-throughput processor |
| US20150378913A1 (en) * | 2013-03-20 | 2015-12-31 | Hewlett-Packard Development Company, L.P. | Caching data in a memory system having memory nodes at different hierarchical levels |
| US20180189188A1 (en) * | 2016-12-31 | 2018-07-05 | Intel Corporation | Unified hardware and software two-level memory |
-
2018
- 2018-07-25 CN CN201810823758.3A patent/CN108984129A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130132681A1 (en) * | 2011-11-22 | 2013-05-23 | Microsoft Corporation | Temporal standby list |
| CN104798033A (en) * | 2012-12-28 | 2015-07-22 | 英特尔公司 | Apparatus and method for a hybrid latency-throughput processor |
| US20150378913A1 (en) * | 2013-03-20 | 2015-12-31 | Hewlett-Packard Development Company, L.P. | Caching data in a memory system having memory nodes at different hierarchical levels |
| CN103744799A (en) * | 2013-12-26 | 2014-04-23 | 华为技术有限公司 | Memory data access method, device and system |
| US20180189188A1 (en) * | 2016-12-31 | 2018-07-05 | Intel Corporation | Unified hardware and software two-level memory |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104486445B (en) | Distributed extendable resource monitoring system based on cloud platform | |
| CN103827825B (en) | Virtual resource object component | |
| CN104253865B (en) | A kind of two-level management method of mixed type desktop cloud service platform | |
| Li et al. | Composable architecture for rack scale big data computing | |
| CN104252393B (en) | Manage the methods and applications resource distribution module of resource in Distributed Computer System | |
| US9716746B2 (en) | System and method using software defined continuity (SDC) and application defined continuity (ADC) for achieving business continuity and application continuity on massively scalable entities like entire datacenters, entire clouds etc. in a computing system environment | |
| CN104823170B (en) | Distributed caching cluster management | |
| CN103607424B (en) | Server connection method and server system | |
| CN104219279B (en) | System and method for the modularization framework of ultra-large distributed treatment application | |
| CN107077301A (en) | For the dynamic scaling for the storage volume for storing client file systems | |
| CN106663042A (en) | Scalable data storage pools | |
| CN104272386A (en) | Reducing power consumption by migration of data within tiered storage system | |
| CN105068755B (en) | A kind of data trnascription storage method towards cloud computing content distributing network | |
| CN104092756A (en) | Cloud storage system resource dynamic allocation method based on DHT mechanism | |
| CN102981929A (en) | Management method and system for disk mirror images | |
| CN105308553B (en) | Dynamic provides storage | |
| CN109075986A (en) | A kind of management method and relevant device of network function example | |
| Hajjat et al. | Dealer: application-aware request splitting for interactive cloud applications | |
| CN106464584A (en) | Providing router information according to a programmatic interface | |
| CN105468296A (en) | No-sharing storage management method based on virtualization platform | |
| CN106790659A (en) | A kind of space time information cloud storage management method | |
| CN107241426A (en) | A kind of distributed memory system of the home server hard disk based on cloud computing | |
| CN106775947A (en) | Large-scale virtual computing dynamic load balancing method based on openstack | |
| CN105791370B (en) | A kind of data processing method and associated server | |
| CN106547790A (en) | A kind of relevant database service system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20181211 |